Commit Graph

286 Commits

Author SHA1 Message Date
Vladimir Weinstein
e9a7e8907d ICU-1083 More surrogate support. Unsafe and contraction end tables now handle surrogates correctly.
X-SVN-Rev: 5783
2001-09-18 18:37:57 +00:00
Vladimir Weinstein
91c3b146eb ICU-392 remove collator State APIs
X-SVN-Rev: 5760
2001-09-17 22:55:04 +00:00
Syn Wee Quek
2e6080b73e ICU-1030
Code review and optimizations updates for String Search.

X-SVN-Rev: 5717
2001-09-07 21:56:18 +00:00
Markus Scherer
0844431640 ICU-1109 implement new NUL-termination semantics
X-SVN-Rev: 5696
2001-09-05 23:39:38 +00:00
George Rhoten
493c52bce6 ICU-770 Internal API name change
X-SVN-Rev: 5649
2001-08-31 02:13:00 +00:00
George Rhoten
e3be3468c0 ICU-770 More data cleanup
X-SVN-Rev: 5619
2001-08-30 02:59:19 +00:00
George Rhoten
6a7682e8a0 ICU-900 Fixed some compiler warnings.
X-SVN-Rev: 5599
2001-08-28 18:53:23 +00:00
George Rhoten
a84135e73e ICU-900 Fixed some compiler warnings.
X-SVN-Rev: 5521
2001-08-17 21:05:56 +00:00
Markus Scherer
6eb5998fc1 ICU-1007 replace old normalization implementation by new one, use unorm_quickCheck(UNORM_FCD) instead of the temporary checkFCD()
X-SVN-Rev: 5489
2001-08-17 00:21:18 +00:00
Ram Viswanadha
d7d6c296e2 ICU-329 First take on add better error reporting with UParseError struct.
X-SVN-Rev: 5472
2001-08-16 00:55:16 +00:00
Vladimir Weinstein
20053b3398 ICU-1083 Optimization of surrogate operations
X-SVN-Rev: 5452
2001-08-10 20:30:44 +00:00
Andy Heninger
a62ee61efb ICU-1030 move ucol_unsafeCP into ucol_imp.h so it can be shared with string search impl.
X-SVN-Rev: 5444
2001-08-06 22:28:20 +00:00
Vladimir Weinstein
c8c203b10e ICU-392 get/set state implementation for current version (no compatibility yet)
X-SVN-Rev: 5207
2001-07-09 22:24:23 +00:00
Vladimir Weinstein
ac95eb8654 ICU-392 added API declarations and dummy implementations for state handling functions. Carved data structures some more.
X-SVN-Rev: 5195
2001-07-06 04:57:28 +00:00
George Rhoten
0ca315bb4e ICU-900 Fixed some compiler warnings
X-SVN-Rev: 5160
2001-07-02 22:56:52 +00:00
Syn Wee Quek
d89bb9c5fc ICU-861
Minor optimisation for the backwards iterator.

X-SVN-Rev: 5130
2001-06-28 20:42:56 +00:00
Vladimir Weinstein
e021c45787 ICU-1002 implemented getter and setter functions for variable top in C and C++
X-SVN-Rev: 5099
2001-06-26 22:24:10 +00:00
Markus Scherer
4bd57921ca ICU-973 use the new u_memcmpCodePointOrder()
X-SVN-Rev: 5079
2001-06-25 23:45:33 +00:00
Vladimir Weinstein
f8af8ef211 ICU-1002 changed semantics of variable top, fixed fractional UCA, added placeholder for setter API, added error codes
X-SVN-Rev: 5069
2001-06-25 04:01:49 +00:00
Syn Wee Quek
8b2f397e72 ICU-861 Optimised the backwards iterator and extra boundary checks.
X-SVN-Rev: 5026
2001-06-20 18:14:51 +00:00
Vladimir Weinstein
a7268db185 ICU-1003 removing incremental compare API
X-SVN-Rev: 5021
2001-06-19 21:18:41 +00:00
Vladimir Weinstein
5e30c2c882 ICU-96 BRAINDEAD CVS allowed new revision not to contain changes from the previous revision. Changes remerged now.
X-SVN-Rev: 4911
2001-06-07 21:28:56 +00:00
Andy Heninger
da3db6fbc5 ICU-880 GetSpecialCE Contraction code: add comments restructure w more use of inline funcs
X-SVN-Rev: 4905
2001-06-06 23:26:50 +00:00
Vladimir Weinstein
ef075eb26d ICU-96 fixed a memory leak
X-SVN-Rev: 4904
2001-06-06 22:13:37 +00:00
Vladimir Weinstein
3ff593d857 ICU-96 Initing of TokenParser structure moved to parser (cleanup)
X-SVN-Rev: 4894
2001-06-06 20:18:38 +00:00
Vladimir Weinstein
ec1bf1b9fc ICU-96 changed int usage to int32_t, removed dependency on limits.h and stdio.h
X-SVN-Rev: 4880
2001-06-03 23:40:41 +00:00
Vladimir Weinstein
dffcc4b530 ICU-96 ucol.cpp always needs limits.h
X-SVN-Rev: 4879
2001-06-02 23:51:42 +00:00
Vladimir Weinstein
a567c6fb3e ICU-96 fixed bug in treating continuations in ucol_strcoll/shifted/quad level.
X-SVN-Rev: 4875
2001-06-02 01:01:18 +00:00
George Rhoten
a869e621bb ICU-900 Fixed some compiler warnings
X-SVN-Rev: 4873
2001-06-01 22:08:06 +00:00
Vladimir Weinstein
bedc1b349b ICU-96 fixed a typo
X-SVN-Rev: 4841
2001-05-31 15:48:16 +00:00
Vladimir Weinstein
f5e2df945a ICU-96 Better handling of extreme normalization sizes. Fixed getRulesEx so that they don't choke on \u0000
X-SVN-Rev: 4839
2001-05-31 06:06:30 +00:00
Vladimir Weinstein
c7a2bac580 ICU-96 changed sortkey implementation as per code review
X-SVN-Rev: 4824
2001-05-29 04:59:29 +00:00
Vladimir Weinstein
9ac95a85a7 ICU-96 fixed LINUX compiler warnings
X-SVN-Rev: 4823
2001-05-28 20:57:59 +00:00
Andy Heninger
d056250053 ICU-880 Normalization fixes for strings containing null chars.
X-SVN-Rev: 4804
2001-05-25 19:30:01 +00:00
Syn Wee Quek
204e674db5 ICU-861
Cleaned up backwards iterator.

X-SVN-Rev: 4796
2001-05-25 16:54:06 +00:00
Andy Heninger
14ffa22646 ICU-880 Incremental Normalize bug fix: error if a non-normal sequence of
combining characters is terminated by surrogate pair.

X-SVN-Rev: 4795
2001-05-25 16:41:59 +00:00
Vladimir Weinstein
9c54cb62b4 ICU-96 code cleanup as per code review
X-SVN-Rev: 4786
2001-05-24 22:37:03 +00:00
Vladimir Weinstein
152b11f484 ICU-96 Hangul tailoring fix, different case bit function, added comments to strcoll
X-SVN-Rev: 4761
2001-05-22 22:26:58 +00:00
Vladimir Weinstein
eb53dfe572 ICU-96 [CODE REVIEW] /* THIS WOULD BE AN API CHANGE - WE HAD TO REMOVE IT FROM COMMON AND PUT IN UCOL.CPP */ We needed u_strncmpCodePointOrder for identical comparison
X-SVN-Rev: 4735
2001-05-21 22:54:51 +00:00
Vladimir Weinstein
cd8a95d0cf ICU-96 [CODE REVIEW] Commented code removal from ucol_strcoll, changing literals with #define constants, removed unneeded and harmful masking
X-SVN-Rev: 4733
2001-05-21 22:30:49 +00:00
Vladimir Weinstein
00a32c9550 ICU-96 modified BOCSU for identical level and moved it into a separate module
X-SVN-Rev: 4714
2001-05-18 19:49:04 +00:00
Vladimir Weinstein
9727f6aa75 ICU-96 New Fractional UCA with good offset for Han + updated offsets in implicit CE generation. Collation framework now passes UCA conformance test!
X-SVN-Rev: 4713
2001-05-18 18:09:53 +00:00
Vladimir Weinstein
bb14b94230 ICU-96 Case compression range fix + implicit generation fix
X-SVN-Rev: 4708
2001-05-17 23:14:44 +00:00
Andy Heninger
51854ca791 ICU-880 Added tests for incremental normalization
X-SVN-Rev: 4706
2001-05-17 23:09:35 +00:00
Syn Wee Quek
ebb67d12c9 ICU-861
Bail out when CE buffer is exhausted in the backwards iteration.

X-SVN-Rev: 4701
2001-05-17 21:34:04 +00:00
Yves Arrouye
2b53e9a143 ICU-832 keep including stdio.h because of the sprintf calls, and add
one conditional around a standalone fprintf.

X-SVN-Rev: 4700
2001-05-17 18:19:42 +00:00
Syn Wee Quek
2ee49e592a ICU-861
Added end of contraction checks to the backwards iteration.
Temporary increased size of CEBuffer.

X-SVN-Rev: 4696
2001-05-17 01:06:25 +00:00
Vladimir Weinstein
e474271f63 ICU-96 tiny constant fixes
X-SVN-Rev: 4695
2001-05-16 22:47:27 +00:00
Vladimir Weinstein
731131f9d7 ICU-96 fixed implicit generation for surrogates
X-SVN-Rev: 4689
2001-05-16 18:23:26 +00:00
George Rhoten
28d425786f ICU-832 Don't call fprint when not debugging collation. It takes up space in the DLL.
X-SVN-Rev: 4686
2001-05-16 17:09:31 +00:00
Vladimir Weinstein
495000031a ICU-96 optimization for discontiguos contractions - needs some cleanup, but functional
X-SVN-Rev: 4678
2001-05-15 23:00:04 +00:00
Vladimir Weinstein
ca9ea470bb ICU-96 fixed some initalization issues, a bug in shifted strcoll and implicit CEs secondaries and tertiaries
X-SVN-Rev: 4671
2001-05-15 17:38:18 +00:00
Syn Wee Quek
cede7f2aa4 ICU-861
Modified dicontiguos contraction handling

X-SVN-Rev: 4662
2001-05-14 18:57:54 +00:00
Syn Wee Quek
71e1a159a2 ICU-861
Modified dicontiguos contraction handling for end of string.

X-SVN-Rev: 4659
2001-05-12 00:12:55 +00:00
George Rhoten
fedfbd0a04 ICU-865 HP/UX CC can't handle an array within a switch statement.
X-SVN-Rev: 4656
2001-05-11 16:23:29 +00:00
Andy Heninger
22be543774 ICU-880 UnsafeCP and Contraction End hash tables, merge UCA data into all of them.
X-SVN-Rev: 4653
2001-05-11 01:13:08 +00:00
Syn Wee Quek
e84355aaf7 ICU-861
Modified contraction handling for end of string in backwards iteration.

X-SVN-Rev: 4649
2001-05-10 23:05:23 +00:00
Vladimir Weinstein
2941639b1d ICU-96 Two case bits implementation
X-SVN-Rev: 4646
2001-05-10 22:33:50 +00:00
Andy Heninger
ccb47e551d ICU-861 Added last-char-in-contraction hash table
X-SVN-Rev: 4642
2001-05-10 22:12:53 +00:00
Syn Wee Quek
aa6c989442 ICU-861
Added discontiguos contraction implementations

X-SVN-Rev: 4636
2001-05-10 17:49:24 +00:00
Andy Heninger
9718f0991a ICU-900 Undid a couple of the previous compiler warning fixes that broke
sort key compression, and made key compression be built by default.

X-SVN-Rev: 4599
2001-05-03 23:33:29 +00:00
George Rhoten
4390ce50c4 ICU-900 Fixed some compiler warnings
X-SVN-Rev: 4584
2001-05-02 23:36:22 +00:00
Vladimir Weinstein
4746d0b3de ICU-96 constants alignment
X-SVN-Rev: 4582
2001-05-02 05:09:40 +00:00
Syn Wee Quek
c434168ade ICU-861
Modified collIterateState->bufferaddress to pointer.

X-SVN-Rev: 4580
2001-05-02 01:36:29 +00:00
Syn Wee Quek
cfe6ff00f7 ICU-861
Minor optimization and clean up

X-SVN-Rev: 4572
2001-04-28 01:22:25 +00:00
Syn Wee Quek
1bfe6e02e2 ICU-861
Initialized collIterate->endp to be NULL when a null terminated string is used.

X-SVN-Rev: 4567
2001-04-26 01:15:34 +00:00
Syn Wee Quek
794fea28f5 ICU-861
Added normalization to contraction for forwards and backwards iteration

X-SVN-Rev: 4564
2001-04-25 23:28:55 +00:00
Vladimir Weinstein
6ca6bab953 ICU-96 primary compression in, needs to be turned on with UCOL_PRIM_COMPRESSION
X-SVN-Rev: 4555
2001-04-25 18:00:41 +00:00
Vladimir Weinstein
f7d61bafc9 ICU-96 primary compression under #ifdef UCOL_PRIM_COMPRESSION not finished, do not use
X-SVN-Rev: 4548
2001-04-24 23:32:40 +00:00
Syn Wee Quek
662d4ab558 ICU-861
Added normalization to contraction.
Note this is not totally working yet.

X-SVN-Rev: 4538
2001-04-24 03:18:54 +00:00
Vladimir Weinstein
4c635dfeca ICU-96 primary compression under #ifdef UCOL_PRIM_COMPRESSION not finished, do not use
X-SVN-Rev: 4537
2001-04-23 23:41:46 +00:00
Andy Heninger
d33a9fe478 ICU-880 strcoll: Bug fix in getNextCE, caused failure in citertst/TestBug672
when normaliztion was enabled.

X-SVN-Rev: 4530
2001-04-23 21:29:14 +00:00
Vladimir Weinstein
f55aa515d1 ICU-96 reflected changes to the UCA table, new identical level sortkey generation
X-SVN-Rev: 4527
2001-04-23 01:53:49 +00:00
Syn Wee Quek
34372f991b ICU-861
Implemented new incremental normalization in backwards iteration.

X-SVN-Rev: 4524
2001-04-20 22:29:53 +00:00
Vladimir Weinstein
5a1d249986 ICU-96 changed Fractional UCA - implicit generation
X-SVN-Rev: 4518
2001-04-19 23:49:03 +00:00
Vladimir Weinstein
ca370278a7 ICU-96 changed Fractional UCA - gap widened
X-SVN-Rev: 4515
2001-04-19 20:29:34 +00:00
Vladimir Weinstein
deed931e7a ICU-96 Added Markuses identical level generator
X-SVN-Rev: 4513
2001-04-19 19:02:01 +00:00
Vladimir Weinstein
8d3eb3b356 ICU-96 fixed variable top
X-SVN-Rev: 4510
2001-04-19 17:08:07 +00:00
George Rhoten
a1f7af0dd9 ICU-865 Don't use lowercase false and use the return type of strcmp() properly
X-SVN-Rev: 4507
2001-04-19 00:52:55 +00:00
Andy Heninger
fe8f7ca9cd ICU-880 strcoll: More performance tweaks, plus fix inlines for UNIX builds.
X-SVN-Rev: 4502
2001-04-18 19:31:05 +00:00
Yves Arrouye
f3f0c1c985 ICU-821 support setting debug/optimization flags.
X-SVN-Rev: 4497
2001-04-18 03:06:43 +00:00
Syn Wee Quek
19dd532d6c ICU-861
Added methods to store and load the collIterate state.

X-SVN-Rev: 4495
2001-04-18 01:34:26 +00:00
Syn Wee Quek
8ef71be0d9 ICU-861
Removed a redundant assignment.

X-SVN-Rev: 4486
2001-04-17 17:27:01 +00:00
Syn Wee Quek
cc5eba47d0 ICU-861
Added an extra size in normalization buffer to contain null-termination.
Added comments in ucol_impl.h that buffer size has to be >= 3.

X-SVN-Rev: 4483
2001-04-17 02:43:35 +00:00
Andy Heninger
c68d3dc63f ICU-880 strcoll: coding guideline changes. No logical change.
X-SVN-Rev: 4474
2001-04-12 19:59:28 +00:00
Syn Wee Quek
7d534e0d11 ICU-861
Modified fcdPosition in getSpecialPrevCE for thai.

X-SVN-Rev: 4473
2001-04-12 18:25:07 +00:00
Syn Wee Quek
f25427cd24 ICU-861
Updated backwards iterator
1) to use incremental fcd check
2) swap thai characters pairs at a time instead of blocks of it.

X-SVN-Rev: 4470
2001-04-12 00:08:26 +00:00
Andy Heninger
ee79f999e8 ICU-880 strcoll: incremental FCD check and no precalc of length
of null terminated strings

X-SVN-Rev: 4466
2001-04-10 22:06:25 +00:00
Andy Heninger
bed84e98b8 ICU-880 strcoll: incremental FCD check and no precalc of length
of null terminated strings

X-SVN-Rev: 4460
2001-04-06 23:37:48 +00:00
Vladimir Weinstein
db7dacac2a ICU-96 simplified debugging
X-SVN-Rev: 4457
2001-04-06 22:51:41 +00:00
Vladimir Weinstein
c10181baeb ICU-96 fix for variable top in tailorings + more tests
X-SVN-Rev: 4453
2001-04-05 22:48:23 +00:00
Ram Viswanadha
9b3d7e9c96 ICU-96 Fix initUCA, open & openRules methods to check status and clean up after themselves
X-SVN-Rev: 4449
2001-04-05 01:40:36 +00:00
Vladimir Weinstein
170db96e5c ICU-96 separate option struct implemented - take 1
X-SVN-Rev: 4407
2001-03-30 00:23:46 +00:00
Vladimir Weinstein
af5f69b9aa ICU-96 fixed compiler warnings in hangul decomposition and variableTop type
X-SVN-Rev: 4385
2001-03-28 20:12:12 +00:00
Vladimir Weinstein
ca2498db25 ICU-96 update to attribute getter
X-SVN-Rev: 4321
2001-03-23 23:48:26 +00:00
Vladimir Weinstein
f182a3214f ICU-96 fix for crash on AS400 due to negative pointer value
X-SVN-Rev: 4307
2001-03-23 07:48:40 +00:00
Vladimir Weinstein
3fd8f3bf61 ICU-96 fixed compiler warnings
X-SVN-Rev: 4285
2001-03-22 21:16:20 +00:00
Vladimir Weinstein
5bbb91861f ICU-96 fixed jamo special handling, made building more robust
X-SVN-Rev: 4274
2001-03-22 18:45:31 +00:00
Vladimir Weinstein
c50adff03c ICU-96 fixed japanese contraction handling
X-SVN-Rev: 4210
2001-03-21 00:22:54 +00:00
Andy Heninger
26d19f7d22 ICU-880 faster loop for strcoll leading chars == comparison.
X-SVN-Rev: 4191
2001-03-20 02:26:23 +00:00