mirror of
https://sourceware.org/git/glibc.git
synced 2024-11-21 12:30:06 +00:00
a7b5eb821d
Unicode 16.0.0 Support: Character encoding, character type info, and transliteration tables are all updated to Unicode 16.0.0, using the generator scripts contributed by Mike FABIAN (Red Hat). Changes in CHARMAP and WIDTH: Total added characters in newly generated CHARMAP: 5185 Total removed characters in newly generated WIDTH: 1 Total added characters in newly generated WIDTH: 170 The removed character from WIDTH is U+1171E AHOM CONSONANT SIGN MEDIAL RA. It changed like this: UnicodeData.txt 15.1.0: 1171E;AHOM CONSONANT SIGN MEDIAL RA;Mn;0;NSM;;;;;N;;;;; UnicodeData.txt 16.0.0: 1171E;AHOM CONSONANT SIGN MEDIAL RA;Mc;0;L;;;;;N;;;;; EastAsianWidth.txt 15.1.0: 1171D..1171F ; N # Mn [3] AHOM CONSONANT SIGN MEDIAL LA..AHOM CONSONANT SIGN MEDIAL LIGATING RA EastAsianWidth.txt 16.0.0: 1171E ; N # Mc AHOM CONSONANT SIGN MEDIAL RA I.e it changed from Mn (Mark Nonspacing) to Mc (Mark Spacing combining). So it should now have width 1 instead of 0, therefore it is OK that it was removed from WIDTH, characters not in WIDTH get width 1 by default. Nothing suspicious when browsing the list of the 170 added characters. Changes in ctype: alpha: Added 4452 characters in new ctype which were not in old ctype combining: Added 51 characters in new ctype which were not in old ctype combining_level3: Added 43 characters in new ctype which were not in old ctype graph: Added 5185 characters in new ctype which were not in old ctype lower: Added 25 characters in new ctype which were not in old ctype print: Added 5185 characters in new ctype which were not in old ctype punct: Missing 33 characters of old ctype in new ctype punct: Added 766 characters in new ctype which were not in old ctype tolower: Added 27 characters in new ctype which were not in old ctype totitle: Added 27 characters in new ctype which were not in old ctype toupper: Added 27 characters in new ctype which were not in old ctype upper: Added 27 characters in new ctype which were not in old ctype Nothing suspicous in the additions. About the 33 characters removed from `punct`: U+0363 - U+036F are identical in UnicodeData.txt. Difference in DerivedCoreProperties.txt: DerivedCoreProperties.txt 15.1.0: not there. DerivedCoreProperties.txt 16.0.0: 0363..036F ; Alphabetic # Mn [13] COMBINING LATIN SMALL LETTER A..COMBINING LATIN SMALL LETTER X So that’s the reason why they are added to `alpha` and removed from `punct`. Same for U+1DD3 - U+1DE6, they are identical in UnicodeData.txt but there is a difference in DerivedCoreProperties.txt: DerivedCoreProperties.txt 15.1.0: 1DE7..1DF4 ; Alphabetic # Mn [14] COMBINING LATIN SMALL LETTER ALPHA..COMBINING LATIN SMALL LETTER U WITH DIAERESIS DerivedCoreProperties.txt 16.0.0: 1DD3..1DF4 ; Alphabetic # Mn [34] COMBINING LATIN SMALL LETTER FLATTENED OPEN A ABOVE..COMBINING LATIN SMALL LETTER U WITH DIAERESIS So they became `Alphabetic` and were thus added to `alpha` and removed from `punct`. Resolves: BZ #32168 Reviewed-by: Carlos O'Donell <carlos@redhat.com> |
||
---|---|---|
.. | ||
charmaps | ||
locales | ||
tests | ||
tests-mbwc | ||
tst-fmon-locales | ||
tst-localedef-hardlinks.root | ||
unicode-gen | ||
am_ET.UTF-8.in | ||
az_AZ.UTF-8.in | ||
be_BY.UTF-8.in | ||
ber_DZ.UTF-8.in | ||
ber_MA.UTF-8.in | ||
bg_BG.UTF-8.in | ||
br_FR.UTF-8.in | ||
bs_BA.UTF-8.in | ||
bug-iconv-trans.c | ||
bug-setlocale1-static.c | ||
bug-setlocale1.c | ||
bug-usesetlocale.c | ||
C.UTF-8.in | ||
ckb_IQ.UTF-8.in | ||
cmn_TW.UTF-8.in | ||
collate-test.c | ||
crh_UA.UTF-8.in | ||
cs_CZ.in | ||
cs_CZ.UTF-8.in | ||
csb_PL.UTF-8.in | ||
cv_RU.UTF-8.in | ||
cy_GB.UTF-8.in | ||
da_DK.ISO-8859-1.in | ||
de_DE.ISO-8859-1.in | ||
Depend | ||
dsb_DE.UTF-8.in | ||
dump-ctype.c | ||
dz_BT.UTF-8.in | ||
en_US.ISO-8859-1.in | ||
en_US.UTF-8.in | ||
eo.UTF-8.in | ||
es_ES.UTF-8.in | ||
et_EE.UTF-8.in | ||
fa_IR.UTF-8.in | ||
fi_FI.UTF-8.in | ||
fil_PH.UTF-8.in | ||
fr_CA.UTF-8.in | ||
fr_FR.UTF-8.in | ||
fur_IT.UTF-8.in | ||
gen-locale.sh | ||
gez_ER.UTF-8@abegede.in | ||
ha_NG.UTF-8.in | ||
hr_HR.ISO-8859-2.in | ||
hr_HR.UTF-8.in | ||
hsb_DE.UTF-8.in | ||
hu_HU.UTF-8.in | ||
ig_NG.UTF-8.in | ||
ik_CA.UTF-8.in | ||
is_IS.UTF-8.in | ||
kk_KZ.UTF-8.in | ||
ku_TR.UTF-8.in | ||
ky_KG.UTF-8.in | ||
ln_CD.UTF-8.in | ||
lt_LT.UTF-8.in | ||
ltg_LV.UTF-8.in | ||
lv_LV.UTF-8.in | ||
Makefile | ||
mdf_RU.UTF-8.in | ||
mi_NZ.UTF-8.in | ||
ml_IN.UTF-8.in | ||
mn_MN.UTF-8.in | ||
mr_IN.UTF-8.in | ||
mt_MT.UTF-8.in | ||
nan_TW.UTF-8@latin.in | ||
nb_NO.UTF-8.in | ||
om_KE.UTF-8.in | ||
or_IN.UTF-8.in | ||
os_RU.UTF-8.in | ||
pl_PL.UTF-8.in | ||
ps_AF.UTF-8.in | ||
README | ||
rif_MA.UTF-8.in | ||
ro_RO.UTF-8.in | ||
ru_RU.UTF-8.in | ||
sah_RU.UTF-8.in | ||
sc_IT.UTF-8.in | ||
se_NO.UTF-8.in | ||
show-ucs-data.c | ||
si_LK.UTF-8.in | ||
sort-test.sh | ||
sq_AL.UTF-8.in | ||
sr_RS.UTF-8.in | ||
SUPPORTED | ||
sv_SE.ISO-8859-1.in | ||
sv_SE.UTF-8.in | ||
syr.UTF-8.in | ||
szl_PL.UTF-8.in | ||
tg_TJ.UTF-8.in | ||
th_TH.UTF-8.in | ||
tk_TM.UTF-8.in | ||
tr_TR.UTF-8.in | ||
tst-c-utf8-consistency.c | ||
tst-ctype-de_DE.ISO-8859-1.in | ||
tst-ctype.c | ||
tst-ctype.sh | ||
tst-digits.c | ||
tst-fmon.c | ||
tst-fmon.data | ||
tst-fmon.sh | ||
tst-iconv-emojis-trans.c | ||
tst-iconv-math-trans.c | ||
tst-langinfo-newlocale-static.c | ||
tst-langinfo-newlocale.c | ||
tst-langinfo-setlocale-static.c | ||
tst-langinfo-setlocale.c | ||
tst-langinfo-static.c | ||
tst-langinfo.c | ||
tst-langinfo.sh | ||
tst-leaks.c | ||
tst-locale-loadlocale.c | ||
tst-locale.sh | ||
tst-localedef-hardlinks.c | ||
tst-mbswcs1.c | ||
tst-mbswcs2.c | ||
tst-mbswcs3.c | ||
tst-mbswcs4.c | ||
tst-mbswcs5.c | ||
tst-mbswcs6.c | ||
tst-numeric.c | ||
tst-numeric.data | ||
tst-numeric.sh | ||
tst-rpmatch.c | ||
tst-rpmatch.sh | ||
tst-setlocale2.c | ||
tst-setlocale3.c | ||
tst-setlocale.c | ||
tst-sscanf.c | ||
tst-strfmon1.c | ||
tst-trans.c | ||
tst-trans.sh | ||
tst-wctype.c | ||
tst-wctype.input | ||
tst-xlocale1.c | ||
tst-xlocale2.c | ||
tt_RU.UTF-8.in | ||
tt_RU.UTF-8@iqtelif.in | ||
ug_CN.UTF-8.in | ||
uk_UA.UTF-8.in | ||
uz_UZ.UTF-8.in | ||
vi_VN.UTF-8.in | ||
xfrm-test.c | ||
yi_US.UTF-8.in | ||
yo_NG.UTF-8.in | ||
zh_CN.UTF-8.in |
POSIX locale descriptions and POSIX character set descriptions Ulrich Drepper Time-stamp: <2004/11/27 13:06:54 drepper> drepper@redhat.com This directory contains the data needed to build the locale data files to use the internationalization features of the GNU libc. POSIX.2 describes the `localedef' utility which is part of the GNU libc. You need this program to "compile" the locale description in a form suitable for fast access by the GNU libc functions. Any compilation is based on a given character set. Once you run `make install' for the GNU libc the data files are automatically installed in the right place, ready for use by the `localedef' program. To compile the locale data files you simply have to decide which locale (based on the location and the language) and which character set you use. E.g., French speaking Canadians would use the locale `fr_CA' and the character set `ISO_8859-1,1987'. Calling `localedef' to get the desired data should happen like this: localedef -i fr_CA -f ISO-8859-1 fr_CA This will place the 6 output files in the appropriate directory where the GNU libc functions can find them. Please note that you need permission to write to this directory ($(prefix)/share/locale, where $(prefix) is the value you specified while configuring GNU libc). If you do not have the necessary permissions, you can write the files into an arbitrary directory by giving a path including a '/' character instead of `fr_CA'. E.g., to put the new files in a subdirectory of the current directory simply use localedef -i fr_CA -f ISO-8859-1 ./fr_CA How to use these data files is described in the GNU libc manual, especially in the section describing the `setlocale' function. All problems should be reported using https://sourceware.org/bugzilla/ One more note: the `POSIX' locale definition is not meant to be used as an input file for `localedef'. It is rather there to show the values with are built in the libc binaries as default values when no legal locale is found or the "C" or "POSIX" locale is selected. The collation test suite ######################## This package also contains a (beginning of a) test suite for the collation functions in the GNU libc. The files are provided sorted. The test program shuffles the lines and sort them afterwards. Some of the files are provided in 8bit form, i.e., not only ASCII characters. So the tools you use to process the files should be 8bit clean. To run the test program the appropriate locale information must be installed. Therefore the localedef program is used to generate this data used the locale and charmap description files contained here. Since we cannot run the localedef program in case of cross-compilation no tests at all are performed. ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Local Variables: mode:text eval:(load-library "time-stamp") eval:(make-local-variable 'write-file-hooks) eval:(add-hook 'write-file-hooks 'time-stamp) eval:(setq time-stamp-format '(time-stamp-yyyy/mm/dd time-stamp-hh:mm:ss user-login-name)) End: