qt5base-lts/util/locale_database
Edward Welbourne 4e84a8b29f Deduplicate locale data tables
Some entries in tables were sub-strings (e.g. prefixes) of others.
Since we store start-index and length (with no need for terminators),
any entry that appears as a sub-string of an earlier entry can be
recorded without making a separate copy of its content, just by
recording where it appeared as a sub-string of an earlier entry.

(Sadly this doesn't apply to month- or day-names and their
short-forms: for those, we store ';'-joined lists.  Thus, although
each short-form is a prefix of its long-form, the short-form is stored
in a list with other short-forms; and this is not a prefix of the list
of matching long-forms.)

The savings are modest (780 bytes at present), but cost us nothing
except when running the python script that generates the data files
(it takes a little longer now), which usually only happens at a CLDR
update.

Change-Id: I05bdaa9283365707bac0190ae983b31f074dd6ed
Reviewed-by: Lars Knoll <lars.knoll@qt.io>
2020-01-30 17:58:15 +01:00
..
testlocales Rename util/locale_database/ to include the e that was missing 2019-05-20 20:42:10 +02:00
cldr2qlocalexml.py Preserve the case of the exponent separator CLDR supplies 2020-01-30 17:56:14 +01:00
cldr2qtimezone.py Update CLDR to v36 2019-10-25 11:44:48 +02:00
dateconverter.py Rename util/locale_database/ to include the e that was missing 2019-05-20 20:42:10 +02:00
enumdata.py Update CLDR to v36 2019-10-25 11:44:48 +02:00
formattags.txt Rename util/locale_database/ to include the e that was missing 2019-05-20 20:42:10 +02:00
localexml.py Add support for the Islamic Civil calendar 2019-08-22 10:10:02 +00:00
qlocalexml2cpp.py Deduplicate locale data tables 2020-01-30 17:58:15 +01:00
README Rename util/locale_database/ to include the e that was missing 2019-05-20 20:42:10 +02:00
xpathlite.py Suggest name, when available, for unknown codes 2019-05-20 20:42:11 +02:00

locale_database is used to generate qlocale data from CLDR.

CLDR is the Common Locale Data Repository, a database for localized
data (like date formats, country names etc).  It is provided by the
Unicode consortium.