Commit Graph

376 Commits

Author SHA1 Message Date
Alan Liu
2209a45f2d ICU-89 change int8_t to uint8_t per compiler warnings
X-SVN-Rev: 2193
2000-08-11 17:31:41 +00:00
Alan Liu
f8afd6398e Add tests of CharacterIterator API
X-SVN-Rev: 2044
2000-07-26 16:21:30 +00:00
Alan Liu
1c254cf440 Conformance test suite fixes
X-SVN-Rev: 2043
2000-07-26 16:20:40 +00:00
Alan Liu
019802e4df Minor cleanup
X-SVN-Rev: 2042
2000-07-26 16:20:16 +00:00
Eric Mader
b2df4167b0 Updated some comments in ParseRule()
X-SVN-Rev: 2035
2000-07-25 21:11:59 +00:00
Alan Liu
10691bf5c2 For normalizer conformance testing
X-SVN-Rev: 2013
2000-07-21 21:27:56 +00:00
Alan Liu
4407b8c40e Change typeMask to typeBit#, go from 32 different classes to 64, keep all combining chars, handle canonical singletons
X-SVN-Rev: 2012
2000-07-21 21:26:34 +00:00
Alan Liu
f59bd17017 Regenerate
X-SVN-Rev: 2011
2000-07-21 21:26:12 +00:00
Alan Liu
b52b7de68d Add normalizer conformance test
X-SVN-Rev: 2010
2000-07-21 21:21:03 +00:00
Eric Mader
f0e480d865 Converted and cleaned up rules.
X-SVN-Rev: 1979
2000-07-20 17:15:06 +00:00
Eric Mader
c737bdcf44 When processing "*" and "+" need to add any new states created
by looping back to decision point list. Also did some minor cleanup.

X-SVN-Rev: 1978
2000-07-20 17:03:33 +00:00
Eric Mader
88c7f47c12 Fixed check for what categories are in $dictionary.
X-SVN-Rev: 1977
2000-07-20 17:02:08 +00:00
Eric Mader
01717271e9 Need to close output file when dumping word list.
X-SVN-Rev: 1976
2000-07-20 17:01:36 +00:00
Eric Mader
aed9e41539 Copy dictionary for rbbi tests to correct directory.
X-SVN-Rev: 1953
2000-07-19 21:17:55 +00:00
Eric Mader
fbfe74d4c3 New syntax, copied most recent default rules.
X-SVN-Rev: 1952
2000-07-19 21:17:18 +00:00
Eric Mader
cdbc66ca7d New dictionary w/ larger word list and current format...
X-SVN-Rev: 1951
2000-07-19 21:16:27 +00:00
Alan Liu
00fc8e0218 Improve performance re: non-composing combining chars
X-SVN-Rev: 1943
2000-07-19 15:43:07 +00:00
Alan Liu
940852abe7 Improve performance re: non-composing combining chars
X-SVN-Rev: 1942
2000-07-19 15:16:34 +00:00
Alan Liu
01972b503a New version with more compact typeMask
X-SVN-Rev: 1934
2000-07-18 19:20:16 +00:00
Alan Liu
52248fabaa Add doc
X-SVN-Rev: 1931
2000-07-18 18:41:22 +00:00
Alan Liu
3e9165477e Add test for zero-index combining char problem
X-SVN-Rev: 1930
2000-07-18 18:21:27 +00:00
Alan Liu
93bfa0ebb3 Eliminate zero-index combining chars to fix bug; EXPERIMENTAL
X-SVN-Rev: 1929
2000-07-18 18:20:28 +00:00
Alan Liu
c99e2d2805 Eliminate zero-index combining chars to fix bug; add javadoc; EXPERIMENTAL
X-SVN-Rev: 1928
2000-07-18 18:19:28 +00:00
Alan Liu
df9c62a61e Improve performance by placing debug code under if(false)
X-SVN-Rev: 1927
2000-07-18 18:18:18 +00:00
Alan Liu
3ca9f60f38 Add javadoc
X-SVN-Rev: 1926
2000-07-18 18:16:36 +00:00
Alan Liu
cba6a1eae2 Add isVerbose()
X-SVN-Rev: 1865
2000-07-13 21:34:32 +00:00
Alan Liu
250e41fdff Add composition exclusions test
X-SVN-Rev: 1864
2000-07-13 21:33:57 +00:00
Alan Liu
f3ccdbfdd2 Minor changes
X-SVN-Rev: 1863
2000-07-13 21:26:01 +00:00
Alan Liu
12b1d15ed7 HACK fix index out of range crash; this needs to be cleaned up later
X-SVN-Rev: 1862
2000-07-13 21:25:08 +00:00
Alan Liu
b2621edca5 Update to read CompositionsExclusions.txt
X-SVN-Rev: 1861
2000-07-13 21:24:42 +00:00
Alan Liu
11dee6497e Update for new composition exclusions fix
X-SVN-Rev: 1860
2000-07-13 21:24:27 +00:00
Alan Liu
ff9a1ce78f Clean up
X-SVN-Rev: 1819
2000-07-12 16:49:22 +00:00
Alan Liu
98964c6724 Add composed rules map
X-SVN-Rev: 1818
2000-07-12 16:44:13 +00:00
Alan Liu
1fb9f0685a Remove hard-coded UInfo path
X-SVN-Rev: 1817
2000-07-12 16:43:38 +00:00
Alan Liu
94b93602d7 Make BLOCKSHIFT public for NormalizerBuilder
X-SVN-Rev: 1816
2000-07-12 16:42:44 +00:00
Alan Liu
ca69d1a771 Update to use platform line separator
X-SVN-Rev: 1815
2000-07-12 16:42:16 +00:00
Alan Liu
b5e7994c13 Update to actually work with ICU
X-SVN-Rev: 1814
2000-07-12 16:41:26 +00:00
Alan Liu
cc796a7c86 Sync with ICU - rename EXPLODING_BASE to NON_COMPOSING_COMBINING
X-SVN-Rev: 1813
2000-07-12 16:40:58 +00:00
Alan Liu
a513270a1f Update to current Unicode 3.0 data
X-SVN-Rev: 1812
2000-07-12 16:40:31 +00:00
Alan Liu
16609a1761 Add support for composed system transliterators
X-SVN-Rev: 1811
2000-07-12 16:32:17 +00:00
Alan Liu
2a0fd0d01f Simplify loop limit logic
X-SVN-Rev: 1810
2000-07-12 16:31:36 +00:00
Alan Liu
6d9e8ff283 Fix d'dd / d'dh problem
X-SVN-Rev: 1740
2000-07-05 23:43:32 +00:00
Alan Liu
4ffd01cf63 Clean up rules, taking advantage of the bidirectional operator where possible.
X-SVN-Rev: 1739
2000-07-05 23:07:58 +00:00
Alan Liu
820a963b3b Add Hiragana-Katakana transliterator
X-SVN-Rev: 1715
2000-06-30 00:00:30 +00:00
Alan Liu
895ada9b84 Test handling of Transliterator.Position fields
X-SVN-Rev: 1712
2000-06-29 21:59:36 +00:00
Alan Liu
5ad646673b Fix handling of Transliterator.Position fields
X-SVN-Rev: 1711
2000-06-29 21:59:23 +00:00
Alan Liu
0067d14bf0 Fix handling of Positions fields
X-SVN-Rev: 1673
2000-06-28 20:49:54 +00:00
Alan Liu
451cdc7bf9 Clean up Transliterator::Position - rename temporary names
X-SVN-Rev: 1672
2000-06-28 20:36:59 +00:00
Alan Liu
c515e74056 Clean up Transliterator::Position and rename fields (related to jitterbug 450)
X-SVN-Rev: 1671
2000-06-28 20:31:43 +00:00
Alan Liu
55856a786a Test fieldDifference (j438)
X-SVN-Rev: 1621
2000-06-14 17:00:33 +00:00