Commit Graph

388 Commits

Author SHA1 Message Date
Alan Liu
20ed04f412 Convert non-ASCII characters to Unicode
X-SVN-Rev: 2463
2000-09-20 22:51:23 +00:00
Alan Liu
1b306ad4fe Convert non-ASCII characters to Unicode
X-SVN-Rev: 2461
2000-09-20 22:39:12 +00:00
Eric Mader
6dead1ec6d Initial checkin: this application writes the .brk files for ICU.
X-SVN-Rev: 2455
2000-09-19 21:05:46 +00:00
Alan Liu
8789277d67 Add missing newline to end of file (to make diff et al happy)
X-SVN-Rev: 2453
2000-09-19 19:26:47 +00:00
Alan Liu
d39ed7b0eb Convert non-ASCII characters to Unicode
X-SVN-Rev: 2452
2000-09-19 19:24:47 +00:00
Alan Liu
663e3b071d Add missing newline to end of file (to make diff et al happy)
X-SVN-Rev: 2451
2000-09-19 18:37:36 +00:00
Alan Liu
fcd4c3780e ICU-564 reduce C++ code memory leaks
X-SVN-Rev: 2447
2000-09-19 17:04:47 +00:00
Eric Mader
308e4ef84b In writeTablesToFile we need to look at the littleEndian flag
when writing the endianness flag

X-SVN-Rev: 2435
2000-09-15 16:07:52 +00:00
Ram Viswanadha
68b726a228 no message
X-SVN-Rev: 2429
2000-09-11 15:27:48 +00:00
Alan Liu
58c0f1bf5b Implement anchors.
X-SVN-Rev: 2408
2000-08-31 17:11:42 +00:00
Alan Liu
5cc3a06755 Implement anchors.
X-SVN-Rev: 2400
2000-08-30 20:40:30 +00:00
Alan Liu
2ccf765e0a Add test for anchors
X-SVN-Rev: 2305
2000-08-17 15:31:40 +00:00
Alan Liu
2209a45f2d ICU-89 change int8_t to uint8_t per compiler warnings
X-SVN-Rev: 2193
2000-08-11 17:31:41 +00:00
Alan Liu
f8afd6398e Add tests of CharacterIterator API
X-SVN-Rev: 2044
2000-07-26 16:21:30 +00:00
Alan Liu
1c254cf440 Conformance test suite fixes
X-SVN-Rev: 2043
2000-07-26 16:20:40 +00:00
Alan Liu
019802e4df Minor cleanup
X-SVN-Rev: 2042
2000-07-26 16:20:16 +00:00
Eric Mader
b2df4167b0 Updated some comments in ParseRule()
X-SVN-Rev: 2035
2000-07-25 21:11:59 +00:00
Alan Liu
10691bf5c2 For normalizer conformance testing
X-SVN-Rev: 2013
2000-07-21 21:27:56 +00:00
Alan Liu
4407b8c40e Change typeMask to typeBit#, go from 32 different classes to 64, keep all combining chars, handle canonical singletons
X-SVN-Rev: 2012
2000-07-21 21:26:34 +00:00
Alan Liu
f59bd17017 Regenerate
X-SVN-Rev: 2011
2000-07-21 21:26:12 +00:00
Alan Liu
b52b7de68d Add normalizer conformance test
X-SVN-Rev: 2010
2000-07-21 21:21:03 +00:00
Eric Mader
f0e480d865 Converted and cleaned up rules.
X-SVN-Rev: 1979
2000-07-20 17:15:06 +00:00
Eric Mader
c737bdcf44 When processing "*" and "+" need to add any new states created
by looping back to decision point list. Also did some minor cleanup.

X-SVN-Rev: 1978
2000-07-20 17:03:33 +00:00
Eric Mader
88c7f47c12 Fixed check for what categories are in $dictionary.
X-SVN-Rev: 1977
2000-07-20 17:02:08 +00:00
Eric Mader
01717271e9 Need to close output file when dumping word list.
X-SVN-Rev: 1976
2000-07-20 17:01:36 +00:00
Eric Mader
aed9e41539 Copy dictionary for rbbi tests to correct directory.
X-SVN-Rev: 1953
2000-07-19 21:17:55 +00:00
Eric Mader
fbfe74d4c3 New syntax, copied most recent default rules.
X-SVN-Rev: 1952
2000-07-19 21:17:18 +00:00
Eric Mader
cdbc66ca7d New dictionary w/ larger word list and current format...
X-SVN-Rev: 1951
2000-07-19 21:16:27 +00:00
Alan Liu
00fc8e0218 Improve performance re: non-composing combining chars
X-SVN-Rev: 1943
2000-07-19 15:43:07 +00:00
Alan Liu
940852abe7 Improve performance re: non-composing combining chars
X-SVN-Rev: 1942
2000-07-19 15:16:34 +00:00
Alan Liu
01972b503a New version with more compact typeMask
X-SVN-Rev: 1934
2000-07-18 19:20:16 +00:00
Alan Liu
52248fabaa Add doc
X-SVN-Rev: 1931
2000-07-18 18:41:22 +00:00
Alan Liu
3e9165477e Add test for zero-index combining char problem
X-SVN-Rev: 1930
2000-07-18 18:21:27 +00:00
Alan Liu
93bfa0ebb3 Eliminate zero-index combining chars to fix bug; EXPERIMENTAL
X-SVN-Rev: 1929
2000-07-18 18:20:28 +00:00
Alan Liu
c99e2d2805 Eliminate zero-index combining chars to fix bug; add javadoc; EXPERIMENTAL
X-SVN-Rev: 1928
2000-07-18 18:19:28 +00:00
Alan Liu
df9c62a61e Improve performance by placing debug code under if(false)
X-SVN-Rev: 1927
2000-07-18 18:18:18 +00:00
Alan Liu
3ca9f60f38 Add javadoc
X-SVN-Rev: 1926
2000-07-18 18:16:36 +00:00
Alan Liu
cba6a1eae2 Add isVerbose()
X-SVN-Rev: 1865
2000-07-13 21:34:32 +00:00
Alan Liu
250e41fdff Add composition exclusions test
X-SVN-Rev: 1864
2000-07-13 21:33:57 +00:00
Alan Liu
f3ccdbfdd2 Minor changes
X-SVN-Rev: 1863
2000-07-13 21:26:01 +00:00
Alan Liu
12b1d15ed7 HACK fix index out of range crash; this needs to be cleaned up later
X-SVN-Rev: 1862
2000-07-13 21:25:08 +00:00
Alan Liu
b2621edca5 Update to read CompositionsExclusions.txt
X-SVN-Rev: 1861
2000-07-13 21:24:42 +00:00
Alan Liu
11dee6497e Update for new composition exclusions fix
X-SVN-Rev: 1860
2000-07-13 21:24:27 +00:00
Alan Liu
ff9a1ce78f Clean up
X-SVN-Rev: 1819
2000-07-12 16:49:22 +00:00
Alan Liu
98964c6724 Add composed rules map
X-SVN-Rev: 1818
2000-07-12 16:44:13 +00:00
Alan Liu
1fb9f0685a Remove hard-coded UInfo path
X-SVN-Rev: 1817
2000-07-12 16:43:38 +00:00
Alan Liu
94b93602d7 Make BLOCKSHIFT public for NormalizerBuilder
X-SVN-Rev: 1816
2000-07-12 16:42:44 +00:00
Alan Liu
ca69d1a771 Update to use platform line separator
X-SVN-Rev: 1815
2000-07-12 16:42:16 +00:00
Alan Liu
b5e7994c13 Update to actually work with ICU
X-SVN-Rev: 1814
2000-07-12 16:41:26 +00:00
Alan Liu
cc796a7c86 Sync with ICU - rename EXPLODING_BASE to NON_COMPOSING_COMBINING
X-SVN-Rev: 1813
2000-07-12 16:40:58 +00:00