glibc/wcsmbs
Joseph Myers 64924422a9 C2x strtol binary constant handling
C2x adds binary integer constants starting with 0b or 0B, and supports
those constants in strtol-family functions when the base passed is 0
or 2.  Implement that strtol support for glibc.

As discussed at
<https://sourceware.org/pipermail/libc-alpha/2020-December/120414.html>,
this is incompatible with previous C standard versions, in that such
an input string starting with 0b or 0B was previously required to be
parsed as 0 (with the rest of the string unprocessed).  Thus, as
proposed there, this patch adds 20 new __isoc23_* functions with
appropriate header redirection support.  This patch does *not* do
anything about scanf %i (which will need 12 new functions per long
double variant, so 12, 24 or 36 depending on the glibc configuration),
instead leaving that for a future patch.  The function names would
remain as __isoc23_* even if C2x ends up published in 2024 rather than
2023.

Making this change leads to the question of what should happen to
internal uses of these functions in glibc and its tests.  The header
redirection (which applies for _GNU_SOURCE or any other feature test
macros enabling C2x features) has the effect of redirecting internal
uses but without those uses then ending up at a hidden alias (see the
comment in include/stdio.h about interaction with libc_hidden_proto).
It seems desirable for the default for internal uses to be the same
versions used by normal code using _GNU_SOURCE, so rather than doing
anything to disable that redirection, similar macro definitions to
those in include/stdio.h are added to the include/ headers for the new
functions.

Given that the default for uses in glibc is for the redirections to
apply, the next question is whether the C2x semantics are correct for
all those uses.  Uses with the base fixed to 10, 16 or any other value
other than 0 or 2 can be ignored.  I think this leaves the following
internal uses to consider (an important consideration for review of
this patch will be both whether this list is complete and whether my
conclusions on all entries in it are correct):

benchtests/bench-malloc-simple.c
benchtests/bench-string.h
elf/sotruss-lib.c
math/libm-test-support.c
nptl/perf.c
nscd/nscd_conf.c
nss/nss_files/files-parse.c
posix/tst-fnmatch.c
posix/wordexp.c
resolv/inet_addr.c
rt/tst-mqueue7.c
soft-fp/testit.c
stdlib/fmtmsg.c
support/support_test_main.c
support/test-container.c
sysdeps/pthread/tst-mutex10.c

I think all of these places are OK with the new semantics, except for
resolv/inet_addr.c, where the POSIX semantics of inet_addr do not
allow for binary constants; thus, I changed that file (to use
__strtoul_internal, whose semantics are unchanged) and added a test
for this case.  In the case of posix/wordexp.c I think accepting
binary constants is OK since POSIX explicitly allows additional forms
of shell arithmetic expressions, and in stdlib/fmtmsg.c SEV_LEVEL is
not in POSIX so again I think accepting binary constants is OK.

Functions such as __strtol_internal, which are only exported for
compatibility with old binaries from when those were used in inline
functions in headers, have unchanged semantics; the __*_l_internal
versions (purely internal to libc and not exported) have a new
argument to specify whether to accept binary constants.

As well as for the standard functions, the header redirection also
applies to the *_l versions (GNU extensions), and to legacy functions
such as strtoq, to avoid confusing inconsistency (the *q functions
redirect to __isoc23_*ll rather than needing their own __isoc23_*
entry points).  For the functions that are only declared with
_GNU_SOURCE, this means the old versions are no longer available for
normal user programs at all.  An internal __GLIBC_USE_C2X_STRTOL macro
is used to control the redirections in the headers, and cases in glibc
that wish to avoid the redirections - the function implementations
themselves and the tests of the old versions of the GNU functions -
then undefine and redefine that macro to allow the old versions to be
accessed.  (There would of course be greater complexity should we wish
to make any of the old versions into compat symbols / avoid them being
defined at all for new glibc ABIs.)

strtol_l.c has some similarity to strtol.c in gnulib, but has already
diverged some way (and isn't listed at all at
https://sourceware.org/glibc/wiki/SharedSourceFiles unlike strtoll.c
and strtoul.c); I haven't made any attempts at gnulib compatibility in
the changes to that file.

I note incidentally that inttypes.h and wchar.h are missing the
__nonnull present on declarations of this family of functions in
stdlib.h; I didn't make any changes in that regard for the new
declarations added.
2023-02-16 23:02:40 +00:00
..
bits Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
btowc.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
c8rtomb.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
c16rtomb.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
c32rtomb.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
Depend Update. 2000-09-06 22:15:07 +00:00
isoc99_fwscanf.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
isoc99_swscanf.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
isoc99_vfwscanf.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
isoc99_vswscanf.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
isoc99_vwscanf.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
isoc99_wscanf.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
Makefile C2x strtol binary constant handling 2023-02-16 23:02:40 +00:00
mbrlen.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
mbrtoc8.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
mbrtoc16.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
mbrtoc32.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
mbrtowc.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
mbsinit.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
mbsnrtowcs.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
mbsrtowcs_l.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
mbsrtowcs.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
test-c8rtomb.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
test-char-types.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
test-mbrtoc8.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
test-wcpcpy.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
test-wcpncpy.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
test-wcscat.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
test-wcschr.c Add wcschr test cases 2011-10-23 14:14:26 -04:00
test-wcschrnul.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
test-wcscmp.c Move wide char tests to wcsmbs directory 2011-09-08 18:01:07 -04:00
test-wcscpy.c Add tests for wcsrchr and wcscpy 2011-12-17 14:14:58 -05:00
test-wcscspn.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
test-wcslen.c Add wcslen test cases 2011-10-23 14:11:50 -04:00
test-wcsncat.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
test-wcsncmp.c Use correct signedness in wcsncmp 2015-04-13 21:25:04 +02:00
test-wcsncpy.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
test-wcsnlen.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
test-wcspbrk.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
test-wcsrchr.c Add tests for wcsrchr and wcscpy 2011-12-17 14:14:58 -05:00
test-wcsspn.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
test-wmemchr.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
test-wmemcmp.c Move wide char tests to wcsmbs directory 2011-09-08 18:01:07 -04:00
test-wmemset.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
tst-btowc.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
tst-c16-surrogate.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
tst-c16c32-1.c Add #include <stdint.h> for uint[32|64]_t usage (except installed headers). 2013-05-16 11:32:54 -05:00
tst-c32-state.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
tst-fgetwc-after-eof.c [BZ 1190] Make EOF sticky in stdio. 2018-03-13 08:31:56 -04:00
tst-mbrtowc2.c Prefer https for Sourceware links 2017-11-16 11:49:26 +05:30
tst-mbrtowc.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
tst-mbsrtowcs.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
tst-mbstowcs.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
tst-wchar-h.c Update wcsmbs tests to use the support test driver 2017-04-04 18:05:20 -03:00
tst-wcpncpy.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
tst-wcrtomb.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
tst-wcsnlen.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
tst-wcstod-nan-locale.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
tst-wcstod-nan-sign.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
tst-wcstod-round.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
tst-wcstof.c Update wcsmbs tests to use the support test driver 2017-04-04 18:05:20 -03:00
tst-wcstol-binary-c2x.c C2x strtol binary constant handling 2023-02-16 23:02:40 +00:00
tst-wcstol-binary-c11.c C2x strtol binary constant handling 2023-02-16 23:02:40 +00:00
tst-wcstol-binary-gnu2x.c C2x strtol binary constant handling 2023-02-16 23:02:40 +00:00
tst-wcstol-binary-gnu11.c C2x strtol binary constant handling 2023-02-16 23:02:40 +00:00
tst-wcstol-locale.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
tst-wprintf-binary.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
uchar.h Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
Versions C2x strtol binary constant handling 2023-02-16 23:02:40 +00:00
wchar.h C2x strtol binary constant handling 2023-02-16 23:02:40 +00:00
wcpcpy.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
wcpncpy.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
wcrtomb.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
wcsatcliff.c Fix handling of tail bytes of buffer in SSE2/SSSE3 x86-64 version strn{,case}cmp 2010-10-03 22:10:30 -04:00
wcscasecmp_l.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
wcscasecmp.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
wcscat.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
wcschr.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
wcschrnul.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
wcscmp.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
wcscoll_l.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
wcscoll.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
wcscpy.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
wcscspn.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
wcsdup.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
wcslen.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
wcsmbs-tst1.c Use '%z' instead of '%Z' on printf functions 2022-09-22 08:48:04 -03:00
wcsmbsload.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
wcsmbsload.h Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
wcsncase_l.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
wcsncase.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
wcsncat.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
wcsncmp.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
wcsncpy.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
wcsnlen.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
wcsnrtombs.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
wcspbrk.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
wcsrchr.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
wcsrtombs.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
wcsspn.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
wcsstr.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
wcstod_l.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
wcstod_nan.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
wcstod.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
wcstof_l.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
wcstof_nan.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
wcstof.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
wcstok.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
wcstol_l.c C2x strtol binary constant handling 2023-02-16 23:02:40 +00:00
wcstol.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
wcstold_l.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
wcstold_nan.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
wcstold.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
wcstoll_l.c C2x strtol binary constant handling 2023-02-16 23:02:40 +00:00
wcstoll.c C2x strtol binary constant handling 2023-02-16 23:02:40 +00:00
wcstoul_l.c C2x strtol binary constant handling 2023-02-16 23:02:40 +00:00
wcstoul.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
wcstoull_l.c C2x strtol binary constant handling 2023-02-16 23:02:40 +00:00
wcstoull.c C2x strtol binary constant handling 2023-02-16 23:02:40 +00:00
wcswidth.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
wcsxfrm_l.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
wcsxfrm.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
wctob.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
wcwidth.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
wcwidth.h Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
wmemchr.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
wmemcmp.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
wmemcpy.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
wmemmove.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
wmempcpy.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00
wmemset.c Update copyright dates with scripts/update-copyrights 2023-01-06 21:14:39 +00:00