Commit Graph

437 Commits

Author SHA1 Message Date
Alan Liu
1b306ad4fe Convert non-ASCII characters to Unicode
X-SVN-Rev: 2461
2000-09-20 22:39:12 +00:00
Eric Mader
6dead1ec6d Initial checkin: this application writes the .brk files for ICU.
X-SVN-Rev: 2455
2000-09-19 21:05:46 +00:00
Alan Liu
8789277d67 Add missing newline to end of file (to make diff et al happy)
X-SVN-Rev: 2453
2000-09-19 19:26:47 +00:00
Alan Liu
d39ed7b0eb Convert non-ASCII characters to Unicode
X-SVN-Rev: 2452
2000-09-19 19:24:47 +00:00
Alan Liu
663e3b071d Add missing newline to end of file (to make diff et al happy)
X-SVN-Rev: 2451
2000-09-19 18:37:36 +00:00
Alan Liu
fcd4c3780e ICU-564 reduce C++ code memory leaks
X-SVN-Rev: 2447
2000-09-19 17:04:47 +00:00
Eric Mader
308e4ef84b In writeTablesToFile we need to look at the littleEndian flag
when writing the endianness flag

X-SVN-Rev: 2435
2000-09-15 16:07:52 +00:00
Ram Viswanadha
68b726a228 no message
X-SVN-Rev: 2429
2000-09-11 15:27:48 +00:00
Alan Liu
58c0f1bf5b Implement anchors.
X-SVN-Rev: 2408
2000-08-31 17:11:42 +00:00
Alan Liu
5cc3a06755 Implement anchors.
X-SVN-Rev: 2400
2000-08-30 20:40:30 +00:00
Alan Liu
2ccf765e0a Add test for anchors
X-SVN-Rev: 2305
2000-08-17 15:31:40 +00:00
Alan Liu
2209a45f2d ICU-89 change int8_t to uint8_t per compiler warnings
X-SVN-Rev: 2193
2000-08-11 17:31:41 +00:00
Alan Liu
f8afd6398e Add tests of CharacterIterator API
X-SVN-Rev: 2044
2000-07-26 16:21:30 +00:00
Alan Liu
1c254cf440 Conformance test suite fixes
X-SVN-Rev: 2043
2000-07-26 16:20:40 +00:00
Alan Liu
019802e4df Minor cleanup
X-SVN-Rev: 2042
2000-07-26 16:20:16 +00:00
Eric Mader
b2df4167b0 Updated some comments in ParseRule()
X-SVN-Rev: 2035
2000-07-25 21:11:59 +00:00
Alan Liu
10691bf5c2 For normalizer conformance testing
X-SVN-Rev: 2013
2000-07-21 21:27:56 +00:00
Alan Liu
4407b8c40e Change typeMask to typeBit#, go from 32 different classes to 64, keep all combining chars, handle canonical singletons
X-SVN-Rev: 2012
2000-07-21 21:26:34 +00:00
Alan Liu
f59bd17017 Regenerate
X-SVN-Rev: 2011
2000-07-21 21:26:12 +00:00
Alan Liu
b52b7de68d Add normalizer conformance test
X-SVN-Rev: 2010
2000-07-21 21:21:03 +00:00
Eric Mader
f0e480d865 Converted and cleaned up rules.
X-SVN-Rev: 1979
2000-07-20 17:15:06 +00:00
Eric Mader
c737bdcf44 When processing "*" and "+" need to add any new states created
by looping back to decision point list. Also did some minor cleanup.

X-SVN-Rev: 1978
2000-07-20 17:03:33 +00:00
Eric Mader
88c7f47c12 Fixed check for what categories are in $dictionary.
X-SVN-Rev: 1977
2000-07-20 17:02:08 +00:00
Eric Mader
01717271e9 Need to close output file when dumping word list.
X-SVN-Rev: 1976
2000-07-20 17:01:36 +00:00
Eric Mader
aed9e41539 Copy dictionary for rbbi tests to correct directory.
X-SVN-Rev: 1953
2000-07-19 21:17:55 +00:00
Eric Mader
fbfe74d4c3 New syntax, copied most recent default rules.
X-SVN-Rev: 1952
2000-07-19 21:17:18 +00:00
Eric Mader
cdbc66ca7d New dictionary w/ larger word list and current format...
X-SVN-Rev: 1951
2000-07-19 21:16:27 +00:00
Alan Liu
00fc8e0218 Improve performance re: non-composing combining chars
X-SVN-Rev: 1943
2000-07-19 15:43:07 +00:00
Alan Liu
940852abe7 Improve performance re: non-composing combining chars
X-SVN-Rev: 1942
2000-07-19 15:16:34 +00:00
Alan Liu
01972b503a New version with more compact typeMask
X-SVN-Rev: 1934
2000-07-18 19:20:16 +00:00
Alan Liu
52248fabaa Add doc
X-SVN-Rev: 1931
2000-07-18 18:41:22 +00:00
Alan Liu
3e9165477e Add test for zero-index combining char problem
X-SVN-Rev: 1930
2000-07-18 18:21:27 +00:00
Alan Liu
93bfa0ebb3 Eliminate zero-index combining chars to fix bug; EXPERIMENTAL
X-SVN-Rev: 1929
2000-07-18 18:20:28 +00:00
Alan Liu
c99e2d2805 Eliminate zero-index combining chars to fix bug; add javadoc; EXPERIMENTAL
X-SVN-Rev: 1928
2000-07-18 18:19:28 +00:00
Alan Liu
df9c62a61e Improve performance by placing debug code under if(false)
X-SVN-Rev: 1927
2000-07-18 18:18:18 +00:00
Alan Liu
3ca9f60f38 Add javadoc
X-SVN-Rev: 1926
2000-07-18 18:16:36 +00:00
Alan Liu
cba6a1eae2 Add isVerbose()
X-SVN-Rev: 1865
2000-07-13 21:34:32 +00:00
Alan Liu
250e41fdff Add composition exclusions test
X-SVN-Rev: 1864
2000-07-13 21:33:57 +00:00
Alan Liu
f3ccdbfdd2 Minor changes
X-SVN-Rev: 1863
2000-07-13 21:26:01 +00:00
Alan Liu
12b1d15ed7 HACK fix index out of range crash; this needs to be cleaned up later
X-SVN-Rev: 1862
2000-07-13 21:25:08 +00:00
Alan Liu
b2621edca5 Update to read CompositionsExclusions.txt
X-SVN-Rev: 1861
2000-07-13 21:24:42 +00:00
Alan Liu
11dee6497e Update for new composition exclusions fix
X-SVN-Rev: 1860
2000-07-13 21:24:27 +00:00
Alan Liu
ff9a1ce78f Clean up
X-SVN-Rev: 1819
2000-07-12 16:49:22 +00:00
Alan Liu
98964c6724 Add composed rules map
X-SVN-Rev: 1818
2000-07-12 16:44:13 +00:00
Alan Liu
1fb9f0685a Remove hard-coded UInfo path
X-SVN-Rev: 1817
2000-07-12 16:43:38 +00:00
Alan Liu
94b93602d7 Make BLOCKSHIFT public for NormalizerBuilder
X-SVN-Rev: 1816
2000-07-12 16:42:44 +00:00
Alan Liu
ca69d1a771 Update to use platform line separator
X-SVN-Rev: 1815
2000-07-12 16:42:16 +00:00
Alan Liu
b5e7994c13 Update to actually work with ICU
X-SVN-Rev: 1814
2000-07-12 16:41:26 +00:00
Alan Liu
cc796a7c86 Sync with ICU - rename EXPLODING_BASE to NON_COMPOSING_COMBINING
X-SVN-Rev: 1813
2000-07-12 16:40:58 +00:00
Alan Liu
a513270a1f Update to current Unicode 3.0 data
X-SVN-Rev: 1812
2000-07-12 16:40:31 +00:00
Alan Liu
16609a1761 Add support for composed system transliterators
X-SVN-Rev: 1811
2000-07-12 16:32:17 +00:00
Alan Liu
2a0fd0d01f Simplify loop limit logic
X-SVN-Rev: 1810
2000-07-12 16:31:36 +00:00
Alan Liu
6d9e8ff283 Fix d'dd / d'dh problem
X-SVN-Rev: 1740
2000-07-05 23:43:32 +00:00
Alan Liu
4ffd01cf63 Clean up rules, taking advantage of the bidirectional operator where possible.
X-SVN-Rev: 1739
2000-07-05 23:07:58 +00:00
Alan Liu
820a963b3b Add Hiragana-Katakana transliterator
X-SVN-Rev: 1715
2000-06-30 00:00:30 +00:00
Alan Liu
895ada9b84 Test handling of Transliterator.Position fields
X-SVN-Rev: 1712
2000-06-29 21:59:36 +00:00
Alan Liu
5ad646673b Fix handling of Transliterator.Position fields
X-SVN-Rev: 1711
2000-06-29 21:59:23 +00:00
Alan Liu
0067d14bf0 Fix handling of Positions fields
X-SVN-Rev: 1673
2000-06-28 20:49:54 +00:00
Alan Liu
451cdc7bf9 Clean up Transliterator::Position - rename temporary names
X-SVN-Rev: 1672
2000-06-28 20:36:59 +00:00
Alan Liu
c515e74056 Clean up Transliterator::Position and rename fields (related to jitterbug 450)
X-SVN-Rev: 1671
2000-06-28 20:31:43 +00:00
Alan Liu
55856a786a Test fieldDifference (j438)
X-SVN-Rev: 1621
2000-06-14 17:00:33 +00:00
Alan Liu
c5d118a49f Implement fieldDifference (j438)
X-SVN-Rev: 1620
2000-06-14 17:00:20 +00:00
Alan Liu
90753438bf Update zipbin target
X-SVN-Rev: 1574
2000-06-06 23:25:08 +00:00
Alan Liu
7f9b062b7a Code and docs cleanup for secondary grouping.
X-SVN-Rev: 1541
2000-06-01 23:52:17 +00:00
Alan Liu
1e16594c42 Add tests for secondary grouping size (e.g. #,##,###)
X-SVN-Rev: 1530
2000-06-01 01:21:52 +00:00
Alan Liu
95817bf928 Add support for secondary grouping size (e.g. #,##,###)
X-SVN-Rev: 1529
2000-06-01 01:21:34 +00:00
Alan Liu
31019a86c8 Make compatible with both JDK 1.2.2 and JDK 1.3
X-SVN-Rev: 1510
2000-05-26 22:31:43 +00:00
Alan Liu
930bbfbb36 Change references to java.text.NumberFormat and .DecimalFormat to use com.ibm.text classes.
X-SVN-Rev: 1509
2000-05-26 21:38:55 +00:00
Alan Liu
c410ddc159 Rename UnicodeSet.xor to complement.
X-SVN-Rev: 1508
2000-05-26 20:57:44 +00:00
Alan Liu
d591465d46 Rename xor to complement.
X-SVN-Rev: 1507
2000-05-26 20:57:24 +00:00
Alan Liu
cfa0ac9637 Additional cleanup during ICU sync
X-SVN-Rev: 1495
2000-05-25 19:31:37 +00:00
Alan Liu
ba7ce0141d Streamline add()
X-SVN-Rev: 1486
2000-05-24 22:53:34 +00:00
Alan Liu
944cac0227 Cleanup and add docs.
X-SVN-Rev: 1483
2000-05-24 22:29:51 +00:00
Alan Liu
a7805be9fb Compact UnicodeSets
X-SVN-Rev: 1482
2000-05-24 22:21:00 +00:00
Alan Liu
4268c80ff5 Make compact method release internal buffers
X-SVN-Rev: 1481
2000-05-24 22:20:45 +00:00
Alan Liu
1799fb94fe Fix compile errors for new UnicodeSet API.
X-SVN-Rev: 1477
2000-05-24 22:03:39 +00:00
Alan Liu
e4f5989a47 Cleanup. Make API char-based.
X-SVN-Rev: 1476
2000-05-24 22:03:13 +00:00
Alan Liu
95a8ec6569 Obsolete; use UnicodeSet
X-SVN-Rev: 1472
2000-05-24 21:12:59 +00:00
Alan Liu
ad74744fbb Change from CharSet usage to UnicodeSet usage
X-SVN-Rev: 1462
2000-05-24 19:54:15 +00:00
Alan Liu
193a09d5c3 Disallow bad ranges
X-SVN-Rev: 1459
2000-05-24 18:25:51 +00:00
Alan Liu
d56b33f27e Use UInfo-based character property methods; minor fixes
X-SVN-Rev: 1453
2000-05-24 17:28:21 +00:00
Alan Liu
5553497e0f Add UInfo-based character property methods
X-SVN-Rev: 1452
2000-05-24 17:27:35 +00:00
Alan Liu
a2cea3f2da Port TestJ277 from ICU
X-SVN-Rev: 1443
2000-05-23 16:51:28 +00:00
Alan Liu
4576173828 Initial checkin; creates ICU rules from ICU4J rules
X-SVN-Rev: 1442
2000-05-23 16:50:38 +00:00
Alan Liu
721dca33fc Fix off by one bug in UnicodeSet variable parsing
X-SVN-Rev: 1441
2000-05-23 16:49:40 +00:00
Alan Liu
fbb6c04c00 Fix typo SEPEATOR -> SEPARATOR
X-SVN-Rev: 1440
2000-05-23 16:49:04 +00:00
Alan Liu
97a228e07a Fix doc; remove unused auto
X-SVN-Rev: 1439
2000-05-23 16:48:27 +00:00
Alan Liu
ed4a6972fc Don't use C comments; replace with C++ comments
X-SVN-Rev: 1438
2000-05-23 16:47:48 +00:00
Alan Liu
d60cec0ada Update docs
X-SVN-Rev: 1412
2000-05-18 22:49:51 +00:00
Alan Liu
4dea43407d Make SYMBOL_REF static
X-SVN-Rev: 1411
2000-05-18 22:49:20 +00:00
Alan Liu
3f8d04ca3c Update docs
X-SVN-Rev: 1409
2000-05-18 21:37:19 +00:00
Alan Liu
47b6a57c60 Add tests from inversion list test code; enhance tests to detect new problems
X-SVN-Rev: 1403
2000-05-18 19:13:18 +00:00
Alan Liu
eba3048b0a Don't call System.out.println in tests
X-SVN-Rev: 1402
2000-05-18 19:11:55 +00:00
Alan Liu
45ef6aac00 Change System.out.println to logln
X-SVN-Rev: 1401
2000-05-18 19:11:27 +00:00
Alan Liu
bbd9061552 Add output detail
X-SVN-Rev: 1400
2000-05-18 19:10:47 +00:00
Alan Liu
9e250a141d Move up to com.ibm.test package; delete com.ibm.test.topleveltest package
X-SVN-Rev: 1398
2000-05-18 19:10:19 +00:00
Alan Liu
158c8d3760 Update to support child tests properly
X-SVN-Rev: 1397
2000-05-18 19:09:51 +00:00
Alan Liu
7ee2df21f2 Move from topleveltest package; update to include new tests, and to use new TestFmwk API
X-SVN-Rev: 1396
2000-05-18 19:09:38 +00:00
Alan Liu
290c607266 Update path to Unicode data file to be relative to icu4j root dir
X-SVN-Rev: 1395
2000-05-18 19:08:40 +00:00
Alan Liu
8b47407a5e Rewrite UnicodeSet to use an inversion list internally. Some API changes.
X-SVN-Rev: 1394
2000-05-18 19:03:36 +00:00