Commit Graph

493 Commits

Author SHA1 Message Date
Eric Mader
65a8417978 Checkin in new central location. (Don't know why everything thinks this file
is binary...)

X-SVN-Rev: 2482
2000-09-22 18:48:05 +00:00
Eric Mader
f2a1c6bdb7 Checkin in new central location.
X-SVN-Rev: 2481
2000-09-22 18:47:34 +00:00
Eric Mader
4d40f33f9d Initial checkin of the word list for the Thai word break dictionary
X-SVN-Rev: 2480
2000-09-22 18:45:51 +00:00
Alan Liu
5175e1933f Move hex and other static methods from UInfo to Utility
X-SVN-Rev: 2475
2000-09-21 22:37:55 +00:00
Alan Liu
fb5bafafe6 Update and flesh out WinCVS instructions, jakarta-ant setup instructions, and add a note about the data files
X-SVN-Rev: 2472
2000-09-21 21:49:12 +00:00
Alan Liu
20ed04f412 Convert non-ASCII characters to Unicode
X-SVN-Rev: 2463
2000-09-20 22:51:23 +00:00
Alan Liu
1b306ad4fe Convert non-ASCII characters to Unicode
X-SVN-Rev: 2461
2000-09-20 22:39:12 +00:00
Eric Mader
6dead1ec6d Initial checkin: this application writes the .brk files for ICU.
X-SVN-Rev: 2455
2000-09-19 21:05:46 +00:00
Alan Liu
8789277d67 Add missing newline to end of file (to make diff et al happy)
X-SVN-Rev: 2453
2000-09-19 19:26:47 +00:00
Alan Liu
d39ed7b0eb Convert non-ASCII characters to Unicode
X-SVN-Rev: 2452
2000-09-19 19:24:47 +00:00
Alan Liu
663e3b071d Add missing newline to end of file (to make diff et al happy)
X-SVN-Rev: 2451
2000-09-19 18:37:36 +00:00
Alan Liu
fcd4c3780e ICU-564 reduce C++ code memory leaks
X-SVN-Rev: 2447
2000-09-19 17:04:47 +00:00
Eric Mader
308e4ef84b In writeTablesToFile we need to look at the littleEndian flag
when writing the endianness flag

X-SVN-Rev: 2435
2000-09-15 16:07:52 +00:00
Ram Viswanadha
68b726a228 no message
X-SVN-Rev: 2429
2000-09-11 15:27:48 +00:00
Alan Liu
58c0f1bf5b Implement anchors.
X-SVN-Rev: 2408
2000-08-31 17:11:42 +00:00
Alan Liu
5cc3a06755 Implement anchors.
X-SVN-Rev: 2400
2000-08-30 20:40:30 +00:00
Alan Liu
2ccf765e0a Add test for anchors
X-SVN-Rev: 2305
2000-08-17 15:31:40 +00:00
Alan Liu
2209a45f2d ICU-89 change int8_t to uint8_t per compiler warnings
X-SVN-Rev: 2193
2000-08-11 17:31:41 +00:00
Alan Liu
f8afd6398e Add tests of CharacterIterator API
X-SVN-Rev: 2044
2000-07-26 16:21:30 +00:00
Alan Liu
1c254cf440 Conformance test suite fixes
X-SVN-Rev: 2043
2000-07-26 16:20:40 +00:00
Alan Liu
019802e4df Minor cleanup
X-SVN-Rev: 2042
2000-07-26 16:20:16 +00:00
Eric Mader
b2df4167b0 Updated some comments in ParseRule()
X-SVN-Rev: 2035
2000-07-25 21:11:59 +00:00
Alan Liu
10691bf5c2 For normalizer conformance testing
X-SVN-Rev: 2013
2000-07-21 21:27:56 +00:00
Alan Liu
4407b8c40e Change typeMask to typeBit#, go from 32 different classes to 64, keep all combining chars, handle canonical singletons
X-SVN-Rev: 2012
2000-07-21 21:26:34 +00:00
Alan Liu
f59bd17017 Regenerate
X-SVN-Rev: 2011
2000-07-21 21:26:12 +00:00
Alan Liu
b52b7de68d Add normalizer conformance test
X-SVN-Rev: 2010
2000-07-21 21:21:03 +00:00
Eric Mader
f0e480d865 Converted and cleaned up rules.
X-SVN-Rev: 1979
2000-07-20 17:15:06 +00:00
Eric Mader
c737bdcf44 When processing "*" and "+" need to add any new states created
by looping back to decision point list. Also did some minor cleanup.

X-SVN-Rev: 1978
2000-07-20 17:03:33 +00:00
Eric Mader
88c7f47c12 Fixed check for what categories are in $dictionary.
X-SVN-Rev: 1977
2000-07-20 17:02:08 +00:00
Eric Mader
01717271e9 Need to close output file when dumping word list.
X-SVN-Rev: 1976
2000-07-20 17:01:36 +00:00
Eric Mader
aed9e41539 Copy dictionary for rbbi tests to correct directory.
X-SVN-Rev: 1953
2000-07-19 21:17:55 +00:00
Eric Mader
fbfe74d4c3 New syntax, copied most recent default rules.
X-SVN-Rev: 1952
2000-07-19 21:17:18 +00:00
Eric Mader
cdbc66ca7d New dictionary w/ larger word list and current format...
X-SVN-Rev: 1951
2000-07-19 21:16:27 +00:00
Alan Liu
00fc8e0218 Improve performance re: non-composing combining chars
X-SVN-Rev: 1943
2000-07-19 15:43:07 +00:00
Alan Liu
940852abe7 Improve performance re: non-composing combining chars
X-SVN-Rev: 1942
2000-07-19 15:16:34 +00:00
Alan Liu
01972b503a New version with more compact typeMask
X-SVN-Rev: 1934
2000-07-18 19:20:16 +00:00
Alan Liu
52248fabaa Add doc
X-SVN-Rev: 1931
2000-07-18 18:41:22 +00:00
Alan Liu
3e9165477e Add test for zero-index combining char problem
X-SVN-Rev: 1930
2000-07-18 18:21:27 +00:00
Alan Liu
93bfa0ebb3 Eliminate zero-index combining chars to fix bug; EXPERIMENTAL
X-SVN-Rev: 1929
2000-07-18 18:20:28 +00:00
Alan Liu
c99e2d2805 Eliminate zero-index combining chars to fix bug; add javadoc; EXPERIMENTAL
X-SVN-Rev: 1928
2000-07-18 18:19:28 +00:00
Alan Liu
df9c62a61e Improve performance by placing debug code under if(false)
X-SVN-Rev: 1927
2000-07-18 18:18:18 +00:00
Alan Liu
3ca9f60f38 Add javadoc
X-SVN-Rev: 1926
2000-07-18 18:16:36 +00:00
Alan Liu
cba6a1eae2 Add isVerbose()
X-SVN-Rev: 1865
2000-07-13 21:34:32 +00:00
Alan Liu
250e41fdff Add composition exclusions test
X-SVN-Rev: 1864
2000-07-13 21:33:57 +00:00
Alan Liu
f3ccdbfdd2 Minor changes
X-SVN-Rev: 1863
2000-07-13 21:26:01 +00:00
Alan Liu
12b1d15ed7 HACK fix index out of range crash; this needs to be cleaned up later
X-SVN-Rev: 1862
2000-07-13 21:25:08 +00:00
Alan Liu
b2621edca5 Update to read CompositionsExclusions.txt
X-SVN-Rev: 1861
2000-07-13 21:24:42 +00:00
Alan Liu
11dee6497e Update for new composition exclusions fix
X-SVN-Rev: 1860
2000-07-13 21:24:27 +00:00
Alan Liu
ff9a1ce78f Clean up
X-SVN-Rev: 1819
2000-07-12 16:49:22 +00:00
Alan Liu
98964c6724 Add composed rules map
X-SVN-Rev: 1818
2000-07-12 16:44:13 +00:00
Alan Liu
1fb9f0685a Remove hard-coded UInfo path
X-SVN-Rev: 1817
2000-07-12 16:43:38 +00:00
Alan Liu
94b93602d7 Make BLOCKSHIFT public for NormalizerBuilder
X-SVN-Rev: 1816
2000-07-12 16:42:44 +00:00
Alan Liu
ca69d1a771 Update to use platform line separator
X-SVN-Rev: 1815
2000-07-12 16:42:16 +00:00
Alan Liu
b5e7994c13 Update to actually work with ICU
X-SVN-Rev: 1814
2000-07-12 16:41:26 +00:00
Alan Liu
cc796a7c86 Sync with ICU - rename EXPLODING_BASE to NON_COMPOSING_COMBINING
X-SVN-Rev: 1813
2000-07-12 16:40:58 +00:00
Alan Liu
a513270a1f Update to current Unicode 3.0 data
X-SVN-Rev: 1812
2000-07-12 16:40:31 +00:00
Alan Liu
16609a1761 Add support for composed system transliterators
X-SVN-Rev: 1811
2000-07-12 16:32:17 +00:00
Alan Liu
2a0fd0d01f Simplify loop limit logic
X-SVN-Rev: 1810
2000-07-12 16:31:36 +00:00
Alan Liu
6d9e8ff283 Fix d'dd / d'dh problem
X-SVN-Rev: 1740
2000-07-05 23:43:32 +00:00
Alan Liu
4ffd01cf63 Clean up rules, taking advantage of the bidirectional operator where possible.
X-SVN-Rev: 1739
2000-07-05 23:07:58 +00:00
Alan Liu
820a963b3b Add Hiragana-Katakana transliterator
X-SVN-Rev: 1715
2000-06-30 00:00:30 +00:00
Alan Liu
895ada9b84 Test handling of Transliterator.Position fields
X-SVN-Rev: 1712
2000-06-29 21:59:36 +00:00
Alan Liu
5ad646673b Fix handling of Transliterator.Position fields
X-SVN-Rev: 1711
2000-06-29 21:59:23 +00:00
Alan Liu
0067d14bf0 Fix handling of Positions fields
X-SVN-Rev: 1673
2000-06-28 20:49:54 +00:00
Alan Liu
451cdc7bf9 Clean up Transliterator::Position - rename temporary names
X-SVN-Rev: 1672
2000-06-28 20:36:59 +00:00
Alan Liu
c515e74056 Clean up Transliterator::Position and rename fields (related to jitterbug 450)
X-SVN-Rev: 1671
2000-06-28 20:31:43 +00:00
Alan Liu
55856a786a Test fieldDifference (j438)
X-SVN-Rev: 1621
2000-06-14 17:00:33 +00:00
Alan Liu
c5d118a49f Implement fieldDifference (j438)
X-SVN-Rev: 1620
2000-06-14 17:00:20 +00:00
Alan Liu
90753438bf Update zipbin target
X-SVN-Rev: 1574
2000-06-06 23:25:08 +00:00
Alan Liu
7f9b062b7a Code and docs cleanup for secondary grouping.
X-SVN-Rev: 1541
2000-06-01 23:52:17 +00:00
Alan Liu
1e16594c42 Add tests for secondary grouping size (e.g. #,##,###)
X-SVN-Rev: 1530
2000-06-01 01:21:52 +00:00
Alan Liu
95817bf928 Add support for secondary grouping size (e.g. #,##,###)
X-SVN-Rev: 1529
2000-06-01 01:21:34 +00:00
Alan Liu
31019a86c8 Make compatible with both JDK 1.2.2 and JDK 1.3
X-SVN-Rev: 1510
2000-05-26 22:31:43 +00:00
Alan Liu
930bbfbb36 Change references to java.text.NumberFormat and .DecimalFormat to use com.ibm.text classes.
X-SVN-Rev: 1509
2000-05-26 21:38:55 +00:00
Alan Liu
c410ddc159 Rename UnicodeSet.xor to complement.
X-SVN-Rev: 1508
2000-05-26 20:57:44 +00:00
Alan Liu
d591465d46 Rename xor to complement.
X-SVN-Rev: 1507
2000-05-26 20:57:24 +00:00
Alan Liu
cfa0ac9637 Additional cleanup during ICU sync
X-SVN-Rev: 1495
2000-05-25 19:31:37 +00:00
Alan Liu
ba7ce0141d Streamline add()
X-SVN-Rev: 1486
2000-05-24 22:53:34 +00:00
Alan Liu
944cac0227 Cleanup and add docs.
X-SVN-Rev: 1483
2000-05-24 22:29:51 +00:00
Alan Liu
a7805be9fb Compact UnicodeSets
X-SVN-Rev: 1482
2000-05-24 22:21:00 +00:00
Alan Liu
4268c80ff5 Make compact method release internal buffers
X-SVN-Rev: 1481
2000-05-24 22:20:45 +00:00
Alan Liu
1799fb94fe Fix compile errors for new UnicodeSet API.
X-SVN-Rev: 1477
2000-05-24 22:03:39 +00:00
Alan Liu
e4f5989a47 Cleanup. Make API char-based.
X-SVN-Rev: 1476
2000-05-24 22:03:13 +00:00
Alan Liu
95a8ec6569 Obsolete; use UnicodeSet
X-SVN-Rev: 1472
2000-05-24 21:12:59 +00:00
Alan Liu
ad74744fbb Change from CharSet usage to UnicodeSet usage
X-SVN-Rev: 1462
2000-05-24 19:54:15 +00:00
Alan Liu
193a09d5c3 Disallow bad ranges
X-SVN-Rev: 1459
2000-05-24 18:25:51 +00:00
Alan Liu
d56b33f27e Use UInfo-based character property methods; minor fixes
X-SVN-Rev: 1453
2000-05-24 17:28:21 +00:00
Alan Liu
5553497e0f Add UInfo-based character property methods
X-SVN-Rev: 1452
2000-05-24 17:27:35 +00:00
Alan Liu
a2cea3f2da Port TestJ277 from ICU
X-SVN-Rev: 1443
2000-05-23 16:51:28 +00:00
Alan Liu
4576173828 Initial checkin; creates ICU rules from ICU4J rules
X-SVN-Rev: 1442
2000-05-23 16:50:38 +00:00
Alan Liu
721dca33fc Fix off by one bug in UnicodeSet variable parsing
X-SVN-Rev: 1441
2000-05-23 16:49:40 +00:00
Alan Liu
fbb6c04c00 Fix typo SEPEATOR -> SEPARATOR
X-SVN-Rev: 1440
2000-05-23 16:49:04 +00:00
Alan Liu
97a228e07a Fix doc; remove unused auto
X-SVN-Rev: 1439
2000-05-23 16:48:27 +00:00
Alan Liu
ed4a6972fc Don't use C comments; replace with C++ comments
X-SVN-Rev: 1438
2000-05-23 16:47:48 +00:00
Alan Liu
d60cec0ada Update docs
X-SVN-Rev: 1412
2000-05-18 22:49:51 +00:00
Alan Liu
4dea43407d Make SYMBOL_REF static
X-SVN-Rev: 1411
2000-05-18 22:49:20 +00:00
Alan Liu
3f8d04ca3c Update docs
X-SVN-Rev: 1409
2000-05-18 21:37:19 +00:00
Alan Liu
47b6a57c60 Add tests from inversion list test code; enhance tests to detect new problems
X-SVN-Rev: 1403
2000-05-18 19:13:18 +00:00
Alan Liu
eba3048b0a Don't call System.out.println in tests
X-SVN-Rev: 1402
2000-05-18 19:11:55 +00:00
Alan Liu
45ef6aac00 Change System.out.println to logln
X-SVN-Rev: 1401
2000-05-18 19:11:27 +00:00
Alan Liu
bbd9061552 Add output detail
X-SVN-Rev: 1400
2000-05-18 19:10:47 +00:00
Alan Liu
9e250a141d Move up to com.ibm.test package; delete com.ibm.test.topleveltest package
X-SVN-Rev: 1398
2000-05-18 19:10:19 +00:00
Alan Liu
158c8d3760 Update to support child tests properly
X-SVN-Rev: 1397
2000-05-18 19:09:51 +00:00
Alan Liu
7ee2df21f2 Move from topleveltest package; update to include new tests, and to use new TestFmwk API
X-SVN-Rev: 1396
2000-05-18 19:09:38 +00:00
Alan Liu
290c607266 Update path to Unicode data file to be relative to icu4j root dir
X-SVN-Rev: 1395
2000-05-18 19:08:40 +00:00
Alan Liu
8b47407a5e Rewrite UnicodeSet to use an inversion list internally. Some API changes.
X-SVN-Rev: 1394
2000-05-18 19:03:36 +00:00
Eric Mader
b44da5a3e1 Added "impel" and "unalienable"
X-SVN-Rev: 1363
2000-05-13 18:28:35 +00:00
Alan Liu
88e3406421 Add TimeZone and SimpleTimeZone to com.ibm.util.
X-SVN-Rev: 1360
2000-05-12 23:21:32 +00:00
Eric Mader
6c92553260 Added missing words, removed obscure words and some words that should be capitalized.
X-SVN-Rev: 1358
2000-05-12 01:32:29 +00:00
Eric Mader
8afebd5a10 Need to reset state to 0 when backing up.
X-SVN-Rev: 1357
2000-05-12 01:30:35 +00:00
Eric Mader
3ce17a1037 Correct two spelling errors in the Declaration of Independence.
X-SVN-Rev: 1356
2000-05-12 01:29:30 +00:00
Eric Mader
6da1e6e996 Merge with the current default word break and line break rules.
X-SVN-Rev: 1355
2000-05-12 01:29:02 +00:00
Doug Felt
824dc0c4f3 Whoops, need to force scroller block increment to at least 1, not 0.
X-SVN-Rev: 1348
2000-05-11 18:08:42 +00:00
Doug Felt
5275593e3f Scrollbars were getting created with negative block increments
if the component were not yet visible, leading to warnings on linux
systems.  Force block increment to at least zero in order to avoid
spurious warnings.

X-SVN-Rev: 1347
2000-05-10 21:54:57 +00:00
Doug Felt
afc7dc4f92 Sometimes the offscreen buffer was getting created
before the component was fully initialized.  This does not
create the buffer unless the component is visible.

X-SVN-Rev: 1346
2000-05-10 21:52:50 +00:00
Eric Mader
a4a8090ea9 Built with a larger word list and in the correct format...
X-SVN-Rev: 1345
2000-05-09 22:55:23 +00:00
Eric Mader
5f3646b38e Convert rules to new syntax.
X-SVN-Rev: 1344
2000-05-09 22:54:31 +00:00
Eric Mader
f5f970869c Hack to keep state machine for Thai word break rules from getting
stuck.

X-SVN-Rev: 1343
2000-05-09 22:50:42 +00:00
Eric Mader
24ba81049f Treat state like an unsigned short.
X-SVN-Rev: 1342
2000-05-09 22:49:12 +00:00
Eric Mader
8e742fa555 Copy english.dict to com.ibm.demo.rbbi instead of
com.ibm.text.resources

X-SVN-Rev: 1341
2000-05-09 22:44:28 +00:00
Eric Mader
c302b8c30d Changes for building large dictionaries.
X-SVN-Rev: 1340
2000-05-09 22:38:37 +00:00
Eric Mader
244719a599 Source file for building english.dict for rbbi demo.
X-SVN-Rev: 1339
2000-05-09 22:37:47 +00:00
Alan Liu
749ff7c5f6 Modify rules to maintain round-trip jamo-latin-jamo integrity
X-SVN-Rev: 1303
2000-05-01 20:56:34 +00:00
Alan Liu
d290f6a810 Extend error limit
X-SVN-Rev: 1302
2000-05-01 20:56:04 +00:00
Alan Liu
db7b1742ee Update syntax displayed by toString
X-SVN-Rev: 1292
2000-04-28 01:22:01 +00:00
Alan Liu
041d02897d Fix some pathological corner cases that fail round-trip
X-SVN-Rev: 1291
2000-04-28 01:21:29 +00:00
Alan Liu
31a28e98a1 Fix syntax errors
X-SVN-Rev: 1290
2000-04-28 00:25:54 +00:00
Alan Liu
8c56afe778 Improve error reporting
X-SVN-Rev: 1289
2000-04-28 00:25:42 +00:00
Alan Liu
c65b44c418 Update zip target
X-SVN-Rev: 1288
2000-04-27 23:34:06 +00:00
Alan Liu
8c22392060 Fix javadoc link errors
X-SVN-Rev: 1285
2000-04-27 22:41:39 +00:00
Alan Liu
14d85f2ab6 Fix javadoc errors
X-SVN-Rev: 1284
2000-04-27 22:34:40 +00:00
Alan Liu
c41110aae0 Cleanup
X-SVN-Rev: 1283
2000-04-27 22:28:47 +00:00
Alan Liu
8605327ffc Fix apparent typo
X-SVN-Rev: 1282
2000-04-27 22:17:47 +00:00
Alan Liu
057e6f20b9 Fix round trip failures by marking misplaced finals/nonfinals with ^/~
X-SVN-Rev: 1270
2000-04-26 23:25:53 +00:00
Alan Liu
392e27e223 Modify rules to fix round trip failures
X-SVN-Rev: 1268
2000-04-26 21:34:16 +00:00
Alan Liu
17fb1e156d Cleanup
X-SVN-Rev: 1267
2000-04-26 21:22:55 +00:00
Alan Liu
a7adfb1195 Modify handling of small h/k 'i' and 'vu' to allow round trip
X-SVN-Rev: 1266
2000-04-26 21:22:25 +00:00
Eric Mader
1799a86bdb Don't use getDisplayName() to select the display locale 'cause it
may not have gone in the menu that way... set and use selectMe
instead.

X-SVN-Rev: 1265
2000-04-26 19:13:48 +00:00
Eric Mader
44482299e1 Added DemoUtilities.compareLocales for partial matching of locales,
changed calendar demos to use it when building display langauge
menus.

X-SVN-Rev: 1264
2000-04-26 18:40:15 +00:00
Alan Liu
3d98d09a42 Fixed err/errln/logln stuff.
X-SVN-Rev: 1261
2000-04-26 17:39:58 +00:00
Alan Liu
7ae37ad56d Import Mark Davis' round trip test - currently fails!
X-SVN-Rev: 1260
2000-04-26 17:13:17 +00:00
Alan Liu
18003aee55 Create TestLog interface to allow delegation to non subclasses
X-SVN-Rev: 1259
2000-04-26 17:11:52 +00:00
Alan Liu
1c73019fa1 Make -v a synonym for -verbose
X-SVN-Rev: 1248
2000-04-25 17:40:11 +00:00
Alan Liu
19a8da8356 Minor parser cleanup.
X-SVN-Rev: 1247
2000-04-25 17:38:00 +00:00
Alan Liu
7e1ccff554 Eliminate ReplaceableString.getBuffer
X-SVN-Rev: 1246
2000-04-25 17:19:34 +00:00
Alan Liu
004aad2638 ICU4J -> icu4j
X-SVN-Rev: 1245
2000-04-25 17:18:28 +00:00
Alan Liu
943b8564c9 Add Replaceable.copy to retain out-of-band info during reordering.
X-SVN-Rev: 1244
2000-04-25 17:17:37 +00:00
Alan Liu
0b9db3eadf Add test for arbitrary length variable values.
X-SVN-Rev: 1243
2000-04-25 01:43:23 +00:00
Alan Liu
7a49adef39 Allow arbitrary length variable values. Clean up Data API. Update javadocs.
X-SVN-Rev: 1242
2000-04-25 01:42:58 +00:00
Alan Liu
cd1cfb9094 Remove unreachable null statement
X-SVN-Rev: 1241
2000-04-25 00:18:51 +00:00