Commit Graph

195 Commits

Author SHA1 Message Date
Carlos O'Donell
466f2be6c0 Add generic C.UTF-8 locale (Bug 17318)
We add a new C.UTF-8 locale. This locale is not builtin to glibc, but
is provided as a distinct locale. The locale provides full support for
UTF-8 and this includes full code point sorting via STRCMP-based
collation (strcmp or wcscmp).

The collation uses a new keyword 'codepoint_collation' which drops all
collation rules and generates an empty zero rules collation to enable
STRCMP usage in collation. This ensures that we get full code point
sorting for C.UTF-8 with a minimal 1406 bytes of overhead (LC_COLLATE
structure information and ASCII collating tables).

The new locale is added to SUPPORTED. Minimal test data for specific
code points (minus those not supported by collate-test) is provided in
C.UTF-8.in, and this verifies code point sorting is working reasonably
across the range. The locale was tested manually with the full set of
code points without failure.

The locale is harmonized with locales already shipping in various
downstream distributions. A new tst-iconv9 test is added which verifies
the C.UTF-8 locale is generally usable.

Testing for fnmatch, regexec, and recomp is provided by extending
bug-regex1, bugregex19, bug-regex4, bug-regex6, transbug, tst-fnmatch,
tst-regcomp-truncated, and tst-regex to use C.UTF-8.

Tested on x86_64 or i686 without regression.

Reviewed-by: Florian Weimer <fweimer@redhat.com>
2021-09-06 11:30:28 -04:00
Mike FABIAN
ae199e7d64 Fix ckb_IQ [BZ #9809]
Add ckb_IQ to SUPPORTED file.
Add ckb_IQ.UTF-8.in collation test file.
Mention new ckb_IQ locale in NEWS.
2020-02-03 10:19:20 +01:00
Talachan Mon
c5fbd7c3ea Add new locale: mnw_MM (Mon language spoken in Myanmar) [BZ #25139] 2019-11-06 08:15:16 +01:00
Valery Timiriliyev
61c4aad705 New locale: Yakut (Sakha) for Russia (sah_RU) [BZ #22241]
* localedata/Makefile (test-input): Add sah_RU.UTF-8.
	(LOCALES): Likewise.
	* localedata/SUPPORTED (sah_RU/UTF-8): New entry.
	* localedata/locales/sah_RU: New file.
	* localedata/sah_RU.UTF-8.in: New file.

Reviewed-by: Carlos O'Donell <carlos@redhat.com>
2018-07-18 11:45:44 +02:00
Michael Wolf
a1e0c5fa88 New locale: Lower Sorbian (dsb_DE) [BZ #23208]
[BZ #23208]
	* localedata/SUPPORTED (dsb_DE/UTF-8): New entry.
	* localedata/locales/dsb_DE: New file.
2018-06-29 23:03:06 +02:00
Mike FABIAN
b06a054f58 Add new locale yuw_PG [BZ #20952]
[BZ #20952]
	* localedata/locales/yuw_PG: New file.
	* localedata/SUPPORTED: Add yuw_PG/UTF-8.
	* locale/iso-639.def: Add Yau (Uruwa).
2017-10-25 10:49:35 +02:00
Mike FABIAN
b6b08b8e21 Add new locale kab_DZ [BZ #18812]
[BZ #18812]
	* localedata/SUPPORTED: Add kab_DZ/UTF-8.
	* localedata/locales/kab_DZ: New file.
2017-10-20 18:13:22 +02:00
Mike FABIAN
2f9314b412 Add new locale shn_MM [BZ #13605]
[BZ #13605]
	* localedata/SUPPORTED: Add shn_MM/UTF-8.
	* localedata/locales/shn_MM: New file.
2017-10-20 08:52:01 +02:00
Mike FABIAN
4b0fa403ab Add new locale mjw_IN [BZ #13994]
[BZ #13994]
	* locale/iso-639.def: Add Karbi.
	* localedata/SUPPORTED: Add mjw_IN/UTF-8.
	* localedata/locales/mjw_IN: New file.
2017-10-19 16:11:28 +02:00
Aurelien Jarno
5bf58bc750 New locale ca_ES@valencia [BZ #2522]
The Valencian (meridional Catalan) locale is basically a copy of the
Catalan locale. The point of having a separate locale is only for PO
translations. This locale is already provided by several distributions
and is already supported by various projects like LibreOffice, Mozilla,
Gnome, KDE.

	Aurelien Jarno  <aurelien@aurel32.net>
	[BZ #2522]
	* localedata/locales/ca_ES@valencia: New file.
	* localedata/SUPPORTED: Add ca_ES@valencia/UTF-8.
2017-10-17 17:07:16 +02:00
Mike FABIAN
3f802aeb34 Add miq_NI locale for Miskito
[BZ #20498]
	* locale/iso-639.def: add Miskito.
	* localedata/SUPPORTED: Add miq_NI/UTF-8.
	* localedata/locales/miq_NI: New file.
2017-09-05 15:04:23 +02:00
Akhilesh Kumar
f8de9568d8 Add locale for mfe_MU
Add locale for “Morisyen” which is also called “Mauritian Creole”
and is spoken in Mauritius.

	[BZ #21971]
	* localedata/SUPPORTED: Add mfe_MU/UTF-8.
	* localedata/locales/mfe_MU: New File.

	[BZ #21971]
	* locale/iso-639.def: add Morisyen.
2017-08-29 13:56:41 +02:00
Akhilesh Kumar
e119dfcfd6 Added new locale en_SC
New locale is added for the Seychelles which is a member of the African
Union. English is an offical language for the Seychelles.

	[BZ #21854]
	* locales/en_SC: New file.
	* localedata/SUPPORTED : Add en_SC/UTF-8.
2017-08-09 11:02:03 +02:00
Akhilesh Kumar
6244070d41 Added new Locale bho_NP
Bhojpuri is one of the most common languages in Nepal and India.
http://codefornepal.org/en/2014/02/top-10-languages-spoken-as-mother-tongues-in-nepal/
https://en.wikipedia.org/wiki/Bhojpuri_language

Added "bho_NP" locale and Reference is taken form "bho_IN".

	[BZ #21845]
	* locales/bho_NP: New file, Bhojpuri locale for Nepal.
	* SUPPORTED: Add bho_NP/UTF-8
2017-08-03 12:11:35 +02:00
Mousa Moradi
30c0c707f7 Add new az_IR locale
[BZ #14172]
	* locales/az_IR: New file.
2017-07-27 16:10:12 +02:00
Akhilesh Kumar
64d38726e1 Added New Locale mai_NP
Maithili which is an official language not only in India but in Nepal as well.
https://en.wikipedia.org/wiki/Maithili_language
Reference is taken form mai_IN.

	[BZ #21835]
	* localedata/locales/mai_NP: New file.
	* localedata/SUPPORTED: Add mai_NP/UTF-8.
2017-07-26 12:19:53 +02:00
Akhilesh Kumar
babbf7552a New locale for bi_VU
[BZ #21767]
	* locales/bi_VU: new file.
	* localedata/SUPPORTED: Add bi_VU/UTF-8.
2017-07-14 08:25:43 +02:00
Akhilesh Kumar
1dd577fd33 Added Tongan language locale for Tonga
[BZ #21728]
	* localedata/locales/to_TO: new file
	* localedata/SUPPORTED: added to_TO/UTF-8
2017-07-13 09:46:44 +02:00
Akhilesh Kumar
64bdd005b2 Added Fiji Hindi language locale for Fiji
[BZ #21207]
	* locales/hif_FJ: New file.
	* SUPPORTED: Add hif_FJ/UTF-8.
	* locale/iso-639.def: Add Fiji Hindi (hif).
2017-07-13 09:46:44 +02:00
Chris Leonard
30200427a9 New locale for agr_PE.
[BZ #20496]
	* locale/iso-639.def: Add Awajún / Aguaruna (agr).

	[BZ #20496]
	* SUPPORTED: Add agr_PE.
	* locales/agr_PE: New file, Awajún / Aguaruna locale for Peru.
2017-07-12 09:08:44 +02:00
Akhilesh Kumar
a058c7c839 Added Samoan language locale for Samoa
[BZ #21710]
	* locales/sm_WS: New file.
	* SUPPORTED: Add sm_WS/UTF-8.
2017-07-12 09:08:10 +02:00
Akhilesh Kumar
97e7b6aa42 Added Tok-Pisin locale.
[BZ #21694]
Added tok-pisin language locale for Papua New Guinea.

Signed-off-by: Akhilesh Kumar <akhilesh.k@samsung.com>
2017-07-05 18:40:08 +02:00
Carlos O'Donell
8ba5c9b8d6 Bug 20686: Add el_GR@euro support.
Despite the fact that el_GR is ISO-8859-7:2003 which contains the euro
symobl, it is not possible to know this apriori to selecting the el_GR
locale. Therefore you don't know if el_GR can possibly have the 2003
ammendments which include the euro symbol. This is resolved by creating
an el_GR@euro locale similar to all the other @euro locales for non-UTF8
charsets.
2017-05-03 15:37:04 -04:00
Aurelien Jarno
f3ea66b37f New locale de_LI
The Principality of Liechtenstein currently does not have a corresponding
locale. Given the links with Switzerland, the best is to base the locale
on the de_CH one (German is the official language) and only change the
country related categories: LC_ADDRESS. and LC_TELEPHONE.

localedata/Changelog:
	* locales/de_LI: New locale.
	* SUPPORTED: Add de_LI.
2016-07-06 18:18:10 +02:00
Eduardo Trápani
39e050698f localedata: eo: new Esperanto locale [BZ #16190] 2016-06-11 01:24:26 -04:00
Neskie Manuel
b86970392c localedata: chr_US: new Cherokee locale [BZ #12143] 2016-05-07 20:01:55 -04:00
Arnas Udovičius
c2fc6747ec localedata: sgs_LT: new locale [BZ #12450]
Need to also update the database to include the new code.
2016-05-01 15:18:04 -04:00
Guy Rutenberg
146ffc146f localedata: en_IL: new English locale [BZ #19963] 2016-04-21 22:49:53 -04:00
Claude Paroz
c33ab198fd localedata: ln_CD: new locale [BZ #12676] 2016-04-21 22:48:10 -04:00
Matthias Wallnoefer
5f5682b965 localedata: de_IT: new locale 2016-04-13 17:44:54 -04:00
Mike Frysinger
20003c4988 localedata: iw_IL: delete old/deprecated locale [BZ #16137]
From the bug:
Obsolete locale.  The ISO-639 code for Hebrew was changed from 'iw'
to 'he' in 1989, according to Bruno Haible on libc-alpha 2003-09-01.

Reported-by: Chris Leonard <cjlhomeaddress@gmail.com>
2016-04-08 18:56:34 -04:00
Mike Frysinger
b6ebba701c locales: pap_AN: delete old/deprecated locale [BZ #16003]
From the bug:
Netherlands Antilles was dissolved, and "AN" is not a part of ISO 3166
anymore.  According to setlocale(3), "territory is an ISO 3166 country
code".  We now have pap_AW and pap_CW.

Reported-by: Chris Leonard <cjlhomeaddress@gmail.com>
2016-02-19 13:43:38 -05:00
Khem Raj
536fb97780 Reflect renaming of bh_IN and tu_IN in SUPPORTED file [BZ #17475] 2015-07-20 22:09:07 -04:00
Pravin Satpute
01839a33ec New locale raj_IN (#16857) 2014-12-01 15:23:47 +05:30
Pravin Satpute
2687f47b20 New locale ce_RU (BZ #17192) 2014-12-01 15:18:33 +05:30
Tatiana Udalova
fb89b46d1d New Bhilodi and Tulu locales (BZ #17475) 2014-11-12 17:06:39 +05:30
Andreas Schwab
bd1b9d956b Install uz_UZ.UTF-8 locale (BZ #16095) 2014-06-05 15:12:16 +02:00
Arun Kumar Pyasi
b46d046e7b New locale for the_NP. 2013-11-15 15:57:56 -05:00
Chris Leonard
9668fc1b82 New-locale-for-anp_IN 2013-10-29 08:30:22 -04:00
Chris Leonard
8c81eda97e Fix ar_SS in SUPPORTED 2013-10-07 16:50:12 -04:00
Chris Leonard
8a05c25298 Copy / modify pap_AN into pap_AW and pap_CW. 2013-10-04 08:54:27 -04:00
Wei-Lun Chao
77eb79caa4 New locale for cmn_TW 2013-09-23 22:36:14 -04:00
Wei-Lun Chao
90e44a6fdd New locale for hak_TW 2013-09-23 20:24:27 -04:00
Wei-Lun Chao
5057e7ce82 New locale for lzh_TW 2013-09-23 18:51:59 -04:00
Wei-Lun Chao
d61ed70042 New locale for nan_TW 2013-09-23 18:23:21 -04:00
Chris Leonard
ec901dcf28 New locale for ak_GH. 2013-09-21 22:48:46 -04:00
Chris Leonard
4f007a7839 Add quz_PE locale
2013-09-03  Chris Leonard  <cjl@sugarlabs.org>

	[BZ#15887]
	* locales/quz_PE: New locale for quz_PE.
	* SUPPORTED: Add quz_PE.
2013-09-03 11:07:14 +02:00
Nik Kalach
d928658238 Add Interlingua locale
[BZ#14879]
	* locales/ia_FR : New file
	* SUPPORTED (SUPPORTED-LOCALES): Add appropriate entry.
2012-11-29 08:31:13 +01:00
Andreas Jaeger
e959c02587 Fix typo for ayc_PE
* SUPPORTED (SUPPORTED-LOCALES): Fix typo for ayc_PE entry.
2012-11-21 21:42:38 +01:00
Chris Leonard
5a04f37674 Add locales niu_NU and niu_NZ
2012-11-21  Chris Leonard  <cjl@sugarlabs.org>

	[BZ #14863]
	* SUPPORTED: Add niu_NU and niu_NZ.
	* locales/niu_NU: Add Niuean (Vagahau Niue) locale for Niue,
	contributed by Chris Leonard <cjl@sugarlabs.org> and Emani
	Fakaotimanava-Lui <emani@niue.nu>.
	* locales/niu_NZ: Add Niuean (Vagahau Niue) locale for New
	Zealand, contributed by Chris Leonard <cjl@sugarlabs.org> and Emani
	Fakaotimanava-Lui <emani@niue.nu>.
2012-11-21 21:38:44 +01:00