Commit Graph

2663 Commits

Author SHA1 Message Date
Yoshito Umaoka
45cdda61a6
ICU-12973 CLDR Japanese Era data and tentative Japanese new era support (#111)
* Updated era data format in supplementalData.

* Include tentative era names in data. Implemented Japanese era loaded from CLDR data in ICU4J.

* ICU4C implementation, ICU4C refactoring. WIP.

* VS project updates and some bug fixes

Also added API comments.

* Review feedback and bug fixes

- NULL to nullptr
- use of LocalUResourceBundlePointer
- TYPO "name" to "named"
- env var checking stricmp() == 0

* API comment correction based on feedback

* Duplicate the comment in ucal.h to calendar.h

* Fixed spelling errors in API comment
2018-09-27 14:27:39 -07:00
Andy Heninger
740b24118f
ICU-8151 Simplify Finnish Line Break Tailoring, move to root. (#99) 2018-09-27 14:27:39 -07:00
Markus Scherer
d2ec8987a7
ICU-8966 ICU-12850 add API/data/code for text layout properties InPC, InSC, vo (#92)
ICU-8966: Indic_Positional_Category & Indic_Syllabic_Category

ICU-12850: Vertical_Orientation
2018-09-27 14:27:39 -07:00
Markus Scherer
fe3eb3ed5c
ICU-13530 add UCPTrie/CodePointTrie, switch normalization to use it (#48)
* ICU-13530 copy C/C++ files UTrie2 -> UTrie3

X-SVN-Rev: 40754

* ICU-13530 UTrie3 new files copied from UTrie2: rename types/functions/macros

X-SVN-Rev: 40755

* ICU-13530 debug-print building each UTrie2

X-SVN-Rev: 40756

* ICU-13530 remove two-byte-UTF-8 errorValue block; move highValue from end of data array into header; add errorValue to header

X-SVN-Rev: 40762

* ICU-13530 UTrie3 U16_NEXT/PREV: errorValue for unpaired surrogates

X-SVN-Rev: 40763

* ICU-13530 no more separate values for lead surrogate code units

X-SVN-Rev: 40764

* ICU-13530 change from 11:5 trie bits to 10:6 for simpler UTF-8 code

X-SVN-Rev: 40766

* ICU-13530 UTrie2 build UTrie3 as well, print sizes

X-SVN-Rev: 40767

* ICU-13530 debug-print countSame, sumOverlaps, countInitial

X-SVN-Rev: 40768

* ICU-13530 debug-print whether trie is for CanonIterData

X-SVN-Rev: 40769

* ICU-13530 no index-shift for BMP data, no separate index-2 for 2-byte UTF-8; builder changes incomplete

X-SVN-Rev: 40777

* ICU-13530 remove errorValue and highStart from UNewTrie3

X-SVN-Rev: 40778

* ICU-13530 rewrite UTrie3 builder code

X-SVN-Rev: 40783

* ICU-13530 UTrie3 bug fixes

X-SVN-Rev: 40788

* ICU-13530 fully re-inline _UTRIE3_U8_NEXT()

X-SVN-Rev: 40790

* ICU-13530 find most common all-same data block for dataNullBlock and initialValue

X-SVN-Rev: 40792

* ICU-13530 UTrie3 iterator functions take start and return the end of a range, rather than callback call for each range

X-SVN-Rev: 40800

* ICU-13530 mask off unused data value bits before building a UTrie3 with values less than 32 bits wide

X-SVN-Rev: 40803

* ICU-13530 split utrie3builder.h out of utrie3.h

X-SVN-Rev: 40804

* ICU-13530 separate types UTrie3 vs. UTrie3Builder, implement builder as wrapper over C++ class Trie3Builder in .cpp

X-SVN-Rev: 40809

* ICU-13530 function to make a UTrie3Builder from a UTrie3

X-SVN-Rev: 40810

* ICU-13530 debug-print some data; some cleanup

X-SVN-Rev: 40865

* ICU-13530 BMP 10:6 but supplementary 10:6:4

X-SVN-Rev: 40984

* ICU-13530 move errorValue & highValue to the end of the data table, minimal padding to 4 bytes

X-SVN-Rev: 41011

* ICU-13530 index-1 table gap of index-2 null blocks

X-SVN-Rev: 41018

* ICU-13530 test with more than 128k compacted data

X-SVN-Rev: 41034

* ICU-13530 supplementary bits 11:5:4 saves a little space

X-SVN-Rev: 41039

* ICU-13530 supplementary bits 6:5:5:4 instead of gap: about same size but simpler

X-SVN-Rev: 41050

* ICU-13530 remove unnecessary utrie3_clone(built trie)

X-SVN-Rev: 41058

* ICU-13530 remove unnecessary UTrie3StringIterator

X-SVN-Rev: 41059

* ICU-13530 back to UTRIE3_GET...() macros *returning* data values

X-SVN-Rev: 41060

* ICU-13530 fast vs. small

X-SVN-Rev: 41066

* ICU-13530 always load NFC data, add simple normalization performance test

X-SVN-Rev: 41110

* ICU-13530 change normalization main trie to UTrie3 with special values for lead surrogates; forbid non-inert surrogate code *points* because unable to store values different from code *units*; runtime code work around that for code point lookup and iteration; adjust UTS 46 for normalization no longer mapping unpaired surrogates to U+FFFD

X-SVN-Rev: 41122

* ICU-13530 simplenormperf bug fix and NFC base line

X-SVN-Rev: 41126

* ICU-13530 move normalization getRange skipping lead surrogates to API getRangeSkipLead()

X-SVN-Rev: 41182

* ICU-13530 switch CanonIterData and gennorm2 Norms to UTrie3

X-SVN-Rev: 41183

* ICU-13530 remove unused overwrite parameter from setRange()

X-SVN-Rev: 41184

* ICU-13530 getRange skip lead -> fixed surrogates

X-SVN-Rev: 41219

* ICU-13530 minor cleanup

X-SVN-Rev: 41221

* ICU-13530 UTS 46 code map unpaired surrogates to U+FFFD before normalization

X-SVN-Rev: 41224

* ICU-13530 minor internal-docs cleanup

X-SVN-Rev: 41225

* ICU-13530 rename UTrie3 to UCPTrie, and other name changes

X-SVN-Rev: 41226

* ICU-13530 add 8-bit data option; add type-any & valueBits-any for fromBinary(); macros consistently source type then data width

X-SVN-Rev: 41234

* ICU-13530 scrub the API docs for the proposal

X-SVN-Rev: 41319

* ICU-13530 tag internal definitions as such, or move them to an internal header

X-SVN-Rev: 41320

* ICU-13530 Java API skeleton

X-SVN-Rev: 41326

* ICU-13530 API feedback: ValueWidth, MutableCodePointTrie, base CodePointMap, ...

X-SVN-Rev: 41382

* ICU-13530 add UCPTrie valueWidth field and padding, and combine data pointers into a union

X-SVN-Rev: 41408

* ICU-13530 switch some macros to using dataAccess parameter: separate index vs. data lookups, no macro variant for each value width

X-SVN-Rev: 41409

* ICU-13530 StringIterator is no longer a java.util.Iterator (bad fit)

X-SVN-Rev: 41455

* ICU-13530 CodePointTrie.java code complete

X-SVN-Rev: 41518

* ICU-13530 finish Java port incl test; keep C++ parallel

* ICU-13530 adjust API for feedback: rename HandleValue to FilterValue, change getRange+getRangeFixedSurr(bool allSurr) to enum RangeOption+getRange(enum option); change remaining C macros to use dataAccess for 16/32/8-bit value widths; fix/clarify some API docs

* ICU-13530 add javadoc

* ICU-13530 document UCPTrie binary data format

* ICU-13530 update .nrm formatVersion 3->4, document change in surrogate handling with new trie

* ICU-13530 re-hardcode NFC data

* move trie swapper code into new file; add new files to Windows project files; turn off trie debugging

* ICU-13530 minor cleanup

* ICU-13530 test more range starts; fix a C test leak

* ICU-13530 regenerate Java data from scratch

* ICU-13530 review feedback changes: API docs typos, more @internal, C++11 field initializers, fix potential leak in MutableCodePointTrie::fromUCPTrie()

* ICU-13530 rename interface FilterValue to ValueFilter
2018-09-27 14:27:38 -07:00
Andy Heninger
fa5ae3dc45
ICU-7270 Line Break rule LB8 updated for UAX-14 conformance. (#41)
Includes all line break tailorings.
Corresponding updates to monkey test rules.
State table builder, fix missed table optimization, uncovered by new rule.
2018-09-27 14:27:38 -07:00
Peter Edberg
7c28a58b1f ICU-13823 Integrate data from cldr/tags/release-33-1-d03 to ICU trunk for ICU62 final
X-SVN-Rev: 41525
2018-06-14 22:33:37 +00:00
Yoshito Umaoka
59c7fd4ad3 ICU-13822 Removed VES from currency-numeric data for 62 release. CLDR 33.1 decided to defer this to later time.
X-SVN-Rev: 41511
2018-06-06 22:51:56 +00:00
Peter Edberg
4e6358240c ICU-13792 Integrate data from cldr/tags/release-33-1-d02 to ICU trunk for ICU62rc
X-SVN-Rev: 41479
2018-05-29 22:33:10 +00:00
Yoshito Umaoka
b0ece60be5 ICU-13667 Currency numeric code update for ICU 62 - added VES that will be effective on June 4.
X-SVN-Rev: 41474
2018-05-29 17:26:56 +00:00
Jeff Genovy
530744ae3b ICU-13667 Update filters for VS project file for numberformatter.
X-SVN-Rev: 41469
2018-05-26 19:23:18 +00:00
Markus Scherer
c6c8b7201a ICU-13630 update spoof checker inclusion/recommended sets from Unicode 9 to Unicode 11
X-SVN-Rev: 41466
2018-05-25 23:39:01 +00:00
Jeff Genovy
f23cbfa975 ICU-13667 Update ICU4C version number for 62.1 release candidate.
X-SVN-Rev: 41463
2018-05-25 21:29:10 +00:00
Jeff Genovy
208d28ec1f ICU-13556 Add missing order-only prerequisite in data/Makefile.in
X-SVN-Rev: 41453
2018-05-24 05:59:09 +00:00
Markus Scherer
186cd0a4dc ICU-13630 Unicode 11 zh data, take 2
X-SVN-Rev: 41435
2018-05-22 23:57:25 +00:00
Markus Scherer
ebca759ea1 ICU-13630 Unicode 11 update from near-final data 20180521
X-SVN-Rev: 41426
2018-05-22 01:56:20 +00:00
Andy Heninger
50fc9ce878 ICU-13770 Line Break Rules for Unicode 11, tailorings updated.
X-SVN-Rev: 41410
2018-05-18 17:47:03 +00:00
Andy Heninger
6e40252eb3 ICU-13770 RBBI Line break rules update, work in progress.
X-SVN-Rev: 41404
2018-05-17 18:07:43 +00:00
Andy Heninger
14cfaac98c ICU-13770 RBBI Line Break rules for Unicode 11. Root working; tailorings remain to do.
X-SVN-Rev: 41390
2018-05-16 23:26:58 +00:00
Yoshito Umaoka
d6215a2f34 ICU-13666 Revised tzdata2018e in ICU trunk to replace negative DST (Europe/Prague) rules with updated icuzones override.
X-SVN-Rev: 41325
2018-05-04 22:05:27 +00:00
Yoshito Umaoka
7438138f1d ICU-13666 tzdata2018e updates to ICU4 trunk.
X-SVN-Rev: 41323
2018-05-04 08:19:01 +00:00
Andy Heninger
0b8b2750e3 ICU-13194 RBBI safe rule synthesis, merge to trunk.
X-SVN-Rev: 41210
2018-04-07 00:03:36 +00:00
Markus Scherer
813b76c636 ICU-13630 Unicode 11 beta (data from apr03); merged from branches/markus/uni11
X-SVN-Rev: 41206
2018-04-06 18:42:58 +00:00
Andy Heninger
b58e06a604 ICU-13630 WSegSpace, use word property value in rules definitions.
X-SVN-Rev: 41205
2018-04-06 17:31:18 +00:00
Markus Scherer
ee37808752 ICU-13630 minor instructions update for numbering systems in CLDR
X-SVN-Rev: 41197
2018-04-05 21:29:58 +00:00
Markus Scherer
f7276c5c59 ICU-13630 finish updating ICU4J except RBBI tests
X-SVN-Rev: 41195
2018-04-05 03:37:21 +00:00
Andy Heninger
4e097dc49f ICU-13630 Update RBBI for Unicode 11 data.
X-SVN-Rev: 41194
2018-04-04 23:37:43 +00:00
Markus Scherer
03303a6cb6 ICU-13630 Unicode 11 beta data apr02 (security apr03), fix ICU4C tests except RBBI
X-SVN-Rev: 41191
2018-04-03 23:09:49 +00:00
Yoshito Umaoka
cee4e036f6 ICU-13666 tzdata2018d updates to ICU trunk.
X-SVN-Rev: 41167
2018-03-28 13:44:28 +00:00
Andy Heninger
aead9fb553 ICU-13194 RBBI auto reverse tables: size reduction, and remove hand written rules.
X-SVN-Rev: 41163
2018-03-28 01:20:13 +00:00
Markus Scherer
af6a771267 ICU-13630 implement, test, use emoji property Extended_Pictographic
X-SVN-Rev: 41094
2018-03-12 05:53:02 +00:00
Markus Scherer
b3aec18a3c ICU-13630 ucase.icu formatVersion 4: more compressible exceptions, and more room for future exceptions growth
X-SVN-Rev: 41093
2018-03-12 00:15:40 +00:00
Markus Scherer
1752b5c8c9 ICU-13630 Unicode 11 beta data mar06, API constants for new property values
X-SVN-Rev: 41092
2018-03-09 23:53:02 +00:00
Yoshito Umaoka
05458c3610 ICU-13581 Updated currency/numeric code data.
X-SVN-Rev: 41069
2018-03-06 18:00:29 +00:00
Jeff Genovy
118f3ba5f5 ICU-13581 Update readme for Windows build instructions for VS2015.
X-SVN-Rev: 41053
2018-03-03 02:03:38 +00:00
Jeff Genovy
bb915931d0 ICU-13586 No actual code changes. This change cleans up redundancies in the VS project files, and pulls in common or shared settings from a shared 'props' file. This means that you can now change one single file to target either VS2015 or VS2017, instead of needing to change many files. It also allows the VS project files to share common defines as well, meaning that if you need to target something other than Windows 7, you can make one change in one file, instead of needing to make hundreds. Also included in this change are improvements to the VS Solution files in order to properly denote the dependencies of the projects, which might be needed in the future for possible parallel project builds.
X-SVN-Rev: 41049
2018-03-02 03:20:22 +00:00
Markus Scherer
cd91ef4293 ICU-13581 pool bundles update
X-SVN-Rev: 41045
2018-03-02 00:41:32 +00:00
Peter Edberg
c033aaaf41 ICU-13603 Integrate data from CLDR release-33-alpha for ICU 61rc
X-SVN-Rev: 40980
2018-02-25 01:19:24 +00:00
Steven R. Loomis
97f525fd5e ICU-13595 Fix Segmentation Fault in Parallel Builds
Patch From @eli-nestlabs

X-SVN-Rev: 40962
2018-02-21 18:58:07 +00:00
Jeff Genovy
1b43bcc834 ICU-13581 Update version numbers in the readme files.
X-SVN-Rev: 40957
2018-02-21 01:43:49 +00:00
Jeff Genovy
e98aab020c ICU-13581 Update ICU4C version number for 61.1 rc.
X-SVN-Rev: 40945
2018-02-17 01:09:03 +00:00
Jeff Genovy
9f62b0dada ICU-13171 Update the VS project files to use VS 2017, plus various fixes to get Samples compiling.
Also add explicit defines for WINVER and _WIN32_WINNT for Windows 7 targeting in non-UWP projects.

X-SVN-Rev: 40935
2018-02-16 03:16:03 +00:00
Yoshito Umaoka
32ba591832 ICU-13552 tzdata2018c updates to ICU trunk. ICU override for Europe/Dublin was commented out in icuzones.
X-SVN-Rev: 40798
2018-01-24 03:20:50 +00:00
Yoshito Umaoka
a222a6fa25 ICU-13552 tzdata2018b updates to ICU trunk. Also fixed a few issues in the test code and script. tz2icu was also updated to support customized Links for ICU overide zones.
X-SVN-Rev: 40794
2018-01-24 01:37:07 +00:00
Yoshito Umaoka
a3dca5a303 ICU-13552 tzdata2018a updates to ICU trunk. Zoneinfo data Europe/Dublin is modified to keep DST offset positive. The tz tool tz2icu was updated to replace zoneinfo imported from tz database with ICU local definition.
X-SVN-Rev: 40787
2018-01-19 05:13:00 +00:00
Markus Scherer
cf4cb10c3d ICU-13462 fix Script_Extensions for 5 characters: data generator needs to revert them from block scx to sc (merged from maint-60 r40667)
X-SVN-Rev: 40699
2017-12-05 20:53:14 +00:00
Peter Edberg
6d58ccae2a ICU-13474 Integrate cldr/tags/release-32-0-1.beta1 into ICU, update tests
X-SVN-Rev: 40685
2017-12-02 00:02:56 +00:00
Andy Heninger
254e5f9580 ICU-13420 svn properties check tool fix, and prop update of files match autoprops settings.
X-SVN-Rev: 40674
2017-11-29 19:32:58 +00:00
Yoshito Umaoka
46dd205917 ICU-13141 tzdata2017c updates. Some patches in Makefile to support the latest Makefile in tzcode2017c. Added logKnownIssue in some test cases. See the ticket for the details.
X-SVN-Rev: 40634
2017-10-25 15:43:29 +00:00
Peter Edberg
a5e9be8dd6 ICU-13433 Integrate CLDR 32 tags/release-32-beta3
X-SVN-Rev: 40625
2017-10-20 03:29:11 +00:00
Yoshito Umaoka
6873ed8e2c ICU-13419 Imported the latest CLDR 32 locale data, updated some test cases.
X-SVN-Rev: 40616
2017-10-12 12:24:55 +00:00