Markus Scherer
d2966f1a4d
ICU-2481 prototype tailored normalization; remove old ignore_hangul
...
X-SVN-Rev: 11065
2003-02-15 01:54:25 +00:00
George Rhoten
b579d80f42
ICU-2000 Fix some compiler warnings.
...
X-SVN-Rev: 10760
2002-12-19 01:06:00 +00:00
Vladimir Weinstein
8e192f2f4a
ICU-2135 fixing memory problems
...
X-SVN-Rev: 10407
2002-11-28 08:53:37 +00:00
George Rhoten
5c279e1290
ICU-2474 Fix linkage problem
...
X-SVN-Rev: 10267
2002-11-15 17:36:49 +00:00
Markus Scherer
9ab5577904
ICU-2085 remove ignore_hangul from active duty
...
X-SVN-Rev: 10238
2002-11-13 22:34:33 +00:00
Markus Scherer
c2b0d61466
ICU-2094 add pErrorCode argument to uprv_haveProperties()
...
X-SVN-Rev: 10205
2002-11-08 02:22:15 +00:00
Markus Scherer
6ebcafd22d
ICU-1785 implement unorm_isNFSkippable() and unorm_addPropertyStarts()
...
X-SVN-Rev: 10153
2002-11-05 00:57:52 +00:00
Markus Scherer
9dc91204db
ICU-2044 unorm_compare set error code if properties not loaded
...
X-SVN-Rev: 9578
2002-08-05 21:11:37 +00:00
Ram Viswanadha
22dbbac8ae
ICU-845 add review comments
...
X-SVN-Rev: 9514
2002-08-01 18:56:29 +00:00
Ram Viswanadha
599146bec3
ICU-2044 add check to see if nomalzation data is loaded
...
X-SVN-Rev: 9496
2002-08-01 00:39:34 +00:00
Steven R. Loomis
1386f08c7f
ICU-1992 .dat -> .icu for non package files
...
X-SVN-Rev: 9233
2002-07-17 19:25:18 +00:00
Markus Scherer
1c14e937a4
ICU-1970 terminate empty result for FC_NFKC_Closure
...
X-SVN-Rev: 9158
2002-07-15 16:40:49 +00:00
George Rhoten
accd23770e
ICU-900 Fix some compiler warnings.
...
X-SVN-Rev: 9097
2002-07-11 17:15:08 +00:00
Markus Scherer
fbdd913923
ICU-1781 small cleanup in _composePart
...
X-SVN-Rev: 9086
2002-07-10 23:31:34 +00:00
GCL Shanghai
2fab4a8cb7
ICU-1953 backout buffer overflow changes
...
X-SVN-Rev: 9070
2002-07-09 12:47:45 +00:00
GCL Shanghai
6348e12895
ICU-1953 test for buffer overflows
...
X-SVN-Rev: 9044
2002-07-06 10:58:51 +00:00
Markus Scherer
ee5e768e09
ICU-1970 add API for FC_NFKC_Closure
...
X-SVN-Rev: 9035
2002-07-04 00:18:35 +00:00
Markus Scherer
153bea74fb
ICU-1781 add isNormalized()
...
X-SVN-Rev: 8853
2002-06-12 03:54:17 +00:00
George Rhoten
fd921bd52a
ICU-900 Fixed some compiler warnings.
...
X-SVN-Rev: 8849
2002-06-11 23:10:28 +00:00
Markus Scherer
f88d364569
ICU-1438 change unorm_compare to conform to UAX 21 2.5: fold then NFD
...
X-SVN-Rev: 8820
2002-06-08 03:46:21 +00:00
Markus Scherer
db9640733b
ICU-1438 fix 'unitialized' warnings - cp1/cp2 init looked like real bugs
...
X-SVN-Rev: 8761
2002-05-31 22:19:59 +00:00
Alan Liu
237c0e67c3
ICU-1115 move UnicodeSet from i18n to common; also move affiliated classes; update USet to wrap UnicodeSet
...
X-SVN-Rev: 8721
2002-05-29 18:36:09 +00:00
Markus Scherer
171d3a3ec7
ICU-1438 fix bugs in unorm_compare - temp buffer handling, missing decomposition of Hangul
...
X-SVN-Rev: 8701
2002-05-24 22:24:12 +00:00
Markus Scherer
c44455d477
ICU-1728 add u_strCompare and u_strCaseCompare taking separate lengths and optional code point order
...
X-SVN-Rev: 8695
2002-05-24 17:05:31 +00:00
Markus Scherer
f241f29d0a
ICU-1438 add unorm_cmpEquivFold and unorm_compare
...
X-SVN-Rev: 8660
2002-05-22 00:29:58 +00:00
Markus Scherer
b7682efdab
ICU-1682 provide direct access to decomposition of a code point - unorm_getDecomposition
...
X-SVN-Rev: 8154
2002-03-20 18:24:02 +00:00
Markus Scherer
facb0c82f7
ICU-1754 store data for canonical equivalence more compactly
...
X-SVN-Rev: 8034
2002-03-14 23:54:09 +00:00
Markus Scherer
e7b91a2472
ICU-845 fix bug in unorm_concatenate (reversed src/dest in memcpy)
...
X-SVN-Rev: 7959
2002-03-12 22:59:37 +00:00
Vladimir Weinstein
b600896b2d
ICU-1754 fixed bugs in support for canonical closure
...
X-SVN-Rev: 7941
2002-03-12 00:49:48 +00:00
Markus Scherer
dee8abeeec
ICU-1754 add internal APIs for canonical equivalence
...
X-SVN-Rev: 7931
2002-03-11 17:43:52 +00:00
Markus Scherer
efe9c23d9f
ICU-1754 parse/store in unorm.dat Full_Composition_Exclusion and FC_NFKC_Closure
...
X-SVN-Rev: 7905
2002-03-07 19:56:30 +00:00
Markus Scherer
e833400d37
ICU-1721 move u_getCombiningClass() from uchar.c to unorm.cpp
...
X-SVN-Rev: 7877
2002-03-04 01:24:54 +00:00
Markus Scherer
6bdadbb707
ICU-1686 some UCharIterator improvements - more consistent constant names, uiter_next32() etc.
...
X-SVN-Rev: 7715
2002-02-20 02:04:23 +00:00
Markus Scherer
b004960d4a
ICU-1686 change UCharIterator: add getIndex(); return int32_t instead of UChar, -1 instead of ffff if iteration bounds reached
...
X-SVN-Rev: 7686
2002-02-16 01:21:15 +00:00
Yves Arrouye
2e05f13093
ICU-1548 use 0, not NULL :-)
...
X-SVN-Rev: 7660
2002-02-14 05:53:56 +00:00
Markus Scherer
870550d939
ICU-845 add unorm_concatenate()
...
X-SVN-Rev: 7623
2002-02-10 01:35:54 +00:00
Markus Scherer
45ecba1dc5
ICU-1700 public C API for iterative normalization
...
X-SVN-Rev: 7622
2002-02-10 00:11:16 +00:00
George Rhoten
ade841729e
ICU-900 Fixed some compiler warnings.
...
X-SVN-Rev: 7589
2002-02-07 04:22:32 +00:00
Markus Scherer
14e0d7c46c
ICU-1586 use new UTrie in normalization
...
X-SVN-Rev: 7354
2001-12-19 20:14:25 +00:00
George Rhoten
859edb1416
ICU-1567 This should fix some of the AIX 4.3/Visual Age 5 preprocessor problems
...
X-SVN-Rev: 7187
2001-11-30 00:06:13 +00:00
Vladimir Weinstein
1b0596cd30
ICU-1541 consistently added U_CAPI & U_EXPORT2 to all the declarations and definitions
...
X-SVN-Rev: 7038
2001-11-21 01:02:11 +00:00
Markus Scherer
b0a436adcd
ICU-1007 remove unused fn argument
...
X-SVN-Rev: 6841
2001-11-13 21:21:00 +00:00
Markus Scherer
7b5cc6bdce
ICU-1007 fix bugs: Hangul NFKC, _findNextStarter() on supplementary characters, internal buffer overflow detection in _composePart()
...
X-SVN-Rev: 6752
2001-11-10 22:43:17 +00:00
Markus Scherer
374ff235a3
ICU-1007 fix edge case in iterative decomposition
...
X-SVN-Rev: 6473
2001-10-27 00:36:06 +00:00
Markus Scherer
c340e7426f
ICU-1007 check _haveData() in iteration
...
X-SVN-Rev: 6351
2001-10-19 23:25:07 +00:00
George Rhoten
4043997b6a
ICU-900 Fixed some compiler warnings.
...
X-SVN-Rev: 6342
2001-10-19 21:39:32 +00:00
Markus Scherer
237bf8e91e
ICU-1007 simplify internal normalization api (no growBuffers, c UCharIterator)
...
X-SVN-Rev: 6339
2001-10-19 17:36:02 +00:00
George Rhoten
65cedb37df
ICU-1264 Fix for HP/UX aCC namespace support
...
X-SVN-Rev: 6205
2001-10-12 05:54:15 +00:00
Helena Chapman
d816eefc57
ICU-1264 added namspace support where possible.
...
X-SVN-Rev: 6124
2001-10-08 23:26:58 +00:00
George Rhoten
e955f900c5
ICU-1028 os/390 fixes
...
X-SVN-Rev: 6079
2001-10-05 16:34:05 +00:00
George Rhoten
5140000164
ICU-392 Don't export as many symbols & fix some compiler warnings.
...
X-SVN-Rev: 6051
2001-10-04 20:42:25 +00:00
Markus Scherer
afa72151f8
ICU-1007 fix unorm_makeFCD()
...
X-SVN-Rev: 5935
2001-09-26 21:57:14 +00:00
Markus Scherer
2d1095223f
ICU-1007 fix internal APIs with growBuffer - dest and destCapacity must be in/out params! (not just input)
...
X-SVN-Rev: 5926
2001-09-26 01:22:00 +00:00
Markus Scherer
661cd1be03
ICU-1109 fix check for overlapping src/dest
...
X-SVN-Rev: 5886
2001-09-22 00:56:23 +00:00
Markus Scherer
6cc849aea3
ICU-1007 memory cleanup
...
X-SVN-Rev: 5701
2001-09-06 01:20:43 +00:00
Markus Scherer
0844431640
ICU-1109 implement new NUL-termination semantics
...
X-SVN-Rev: 5696
2001-09-05 23:39:38 +00:00
Markus Scherer
35e3da494f
ICU-1007 simplify esp. composition, add comments
...
X-SVN-Rev: 5680
2001-09-01 02:12:03 +00:00
Markus Scherer
d365d8a956
ICU-1007 complete implementation of Normalizer iteration
...
X-SVN-Rev: 5666
2001-08-31 21:37:39 +00:00
Markus Scherer
53b104c0e7
ICU-1007 improve code readability; start composition improvements
...
X-SVN-Rev: 5645
2001-08-31 00:45:53 +00:00
Markus Scherer
45d66e4ab9
ICU-1007 Jamo LVT instead of Jamo 123; more readable norm32 range checks and a separate fn for combining two characters
...
X-SVN-Rev: 5640
2001-08-30 22:29:47 +00:00
Markus Scherer
bed1f92331
ICU-1007 codereview comments; initial Normalizer iteration functions
...
X-SVN-Rev: 5613
2001-08-29 23:50:18 +00:00
Markus Scherer
6c890043bb
ICU-1007 avoid gcc warnings
...
X-SVN-Rev: 5519
2001-08-17 20:37:13 +00:00
Markus Scherer
6eb5998fc1
ICU-1007 replace old normalization implementation by new one, use unorm_quickCheck(UNORM_FCD) instead of the temporary checkFCD()
...
X-SVN-Rev: 5489
2001-08-17 00:21:18 +00:00
Markus Scherer
e0359d11ac
ICU-1007 reduce warnings
...
X-SVN-Rev: 5133
2001-06-28 20:46:46 +00:00
Markus Scherer
465f87c12d
ICU-1007 optimizations and Jamo composition fixes
...
X-SVN-Rev: 5121
2001-06-28 17:00:25 +00:00
Markus Scherer
b581e87e12
ICU-1007 new NF*C implementation
...
X-SVN-Rev: 5119
2001-06-28 00:34:35 +00:00
Markus Scherer
bbe5d3b59e
ICU-1007 re-fix reference type for _getNextCC() call to make it work on Windows
...
X-SVN-Rev: 5050
2001-06-21 19:20:48 +00:00
Ram Viswanadha
8954699039
ICU-1007 added cast to make gcc happy
...
X-SVN-Rev: 5049
2001-06-21 18:47:02 +00:00
Markus Scherer
6be4ed3a60
ICU-1007 add FCD support
...
X-SVN-Rev: 5045
2001-06-21 18:02:53 +00:00
Markus Scherer
42c2ec7dc8
ICU-1007 initial new normalization code
...
X-SVN-Rev: 5035
2001-06-20 22:24:42 +00:00
George Rhoten
0e7a391e51
ICU-961 os/390 needs U_CALLCONV for C function pointers in C++.
...
X-SVN-Rev: 4845
2001-05-31 20:11:35 +00:00
Syn Wee Quek
e297e86904
ICU-833
...
Added methods for exporting fcdcheck data.
X-SVN-Rev: 4465
2001-04-10 20:00:24 +00:00
Syn Wee Quek
1f0072aef6
ICU-833
...
Updated quickcheck and fcdcheck to return errorcode
when *chk.dat is not found.
X-SVN-Rev: 4443
2001-04-04 18:40:10 +00:00
Syn Wee Quek
5d0c31b788
ICU-833
...
Replaced hard coded quickcheck and fcdcheck data.
Now data gets created during a rebuild.
X-SVN-Rev: 4434
2001-04-04 02:31:28 +00:00
Syn Wee Quek
0dd4a398d2
ICU-833
...
Removed warnings
X-SVN-Rev: 4390
2001-03-28 23:27:10 +00:00
Syn Wee Quek
29f85bb9b6
ICU-833
...
Updated checkFCD implementation to use 2 bytes instead of the original 1byte FCD value.
X-SVN-Rev: 4363
2001-03-28 00:04:49 +00:00
George Rhoten
c4997713ef
ICU-903 Updated the copyright notice
...
X-SVN-Rev: 4238
2001-03-21 20:44:20 +00:00
Markus Scherer
f7da078199
ICU-890 fix unorm_normalize() - preflighting capacity could not be used
...
X-SVN-Rev: 4172
2001-03-17 23:33:02 +00:00
George Rhoten
6312cc8e02
ICU-865 Don't use true. Use TRUE.
...
X-SVN-Rev: 3912
2001-03-06 02:29:36 +00:00
Syn Wee Quek
ac007f9746
ICU-833
...
code review changes
X-SVN-Rev: 3892
2001-03-03 04:07:34 +00:00
Syn Wee Quek
ee52362459
ICU-833
...
Implemented fast route checkFCD and quickCheck.
X-SVN-Rev: 3765
2001-02-24 02:49:31 +00:00
Markus Scherer
2381075aa8
ICU-833 make normalizer function and enum names consistent with guidelines
...
X-SVN-Rev: 3634
2001-02-15 20:21:21 +00:00
Syn Wee Quek
b543b377f3
ICU-833
...
Trie quickcheck data.
Added checkFCD trie data and method.
X-SVN-Rev: 3632
2001-02-15 19:29:05 +00:00
Vladimir Weinstein
bf9f0b3ef3
ICU-96 collation update
...
X-SVN-Rev: 3582
2001-02-07 00:57:39 +00:00
Syn Wee Quek
3bbcb9b96b
ICU-833
...
QuickCheck constant array modification.
Instead of sets of 2 bits, we now use 2 sets of 4 bits.
First set for MAYBE and second set for YES.
Each bit represents one of the normalization form.
X-SVN-Rev: 3567
2001-02-06 02:01:29 +00:00
Vladimir Weinstein
7124fe04ef
ICU-833 added a newline to EOF
...
X-SVN-Rev: 3558
2001-02-05 05:34:51 +00:00
Syn Wee Quek
b41c0e7e55
ICU-833
...
QuickCheck addition.
Normalization enums conversion methods addition.
X-SVN-Rev: 3552
2001-02-03 01:25:27 +00:00
Vladimir Weinstein
82e011125e
ICU-756 normalization C API moved where it belongs
...
X-SVN-Rev: 3145
2000-12-06 00:52:58 +00:00