Go to file
Joseph Myers 14f95a4203 Add script to build many glibc configurations.
This patch adds a Python (3.5 or later) script to build many different
configurations of glibc, including building the required cross
compilers first.  It's not intended to change any patch testing
requirements, although some people may wish to use it for high-risk
patches such as adding warning options (and it can also be used to
test building, including compiling tests, for an individual
configuration, if e.g. you wish to do such a compilation test of a
patch for an architecture it touches).

The configurations include all the GNU/Linux ABI variants in
<https://sourceware.org/glibc/wiki/ABIList> (although some do not yet
build cleanly) and it would be desirable to cover enough other
variants e.g. for CPUs using different sysdeps directories to test
building each piece of code in glibc at least once.  It would also be
desirable to extend it to cover Hurd and NaCl, which might best be
done by people familiar with those configurations.

You call the script as

build-many-glibcs.py /some/where thing-to-do <other-arguments>

where /some/where is a working directory for the script.  It will
create and use subdirectories build, install, logs therein.  You can
use it with thing-to-do being "checkout" to create a subdirectory src
therein, with subdirectories binutils, gcc, glibc, gmp, linux, mpc,
mpfr with the sources of those components, or create those directories
manually (all except glibc can be symlinks to sources elsewhere).  In
the checkout case, by default it checks out GCC 6 branch, binutils
2.27 branch, glibc mainline and releases of other components.  You can
specify <component>-<version> to choose a version to check out, where
<version> is "vcs-mainline" or "vcs-<branch>" to check out from
version control (only supported for gcc, binutils, glibc) and
otherwise a release version number to download and use a tarball;
components not specified on the command line have default versions
checked out.  If you rerun "checkout" (with the same version
specifications) it will update checkouts from version control, but
will not detect cases where the location something is expected to be
checked out from has changed.

Other than "checkout", thing-to-do is one of host-libraries,
compilers, glibcs.  So you run, in that order:

build-many-glibcs.py /some/where host-libraries
build-many-glibcs.py /some/where compilers
build-many-glibcs.py /some/where glibcs

host-libraries is run once and then those libraries are used for all
the compilers.  compilers can be run once and then used many times for
testing different glibc versions (so a bot only needs to update glibc
and rerun the glibcs task, if using stable GCC / binutils; if testing
the latest versions of the whole toolchain together including mainline
GCC, it would probably want to update everything and rerun both
compilers and glibcs).  You can also name particular variants after
"compilers" or "glibcs" to build just those variants (the possible
variants are hardcoded in the script).

I may add support for allowing the set of configurations to depend on
the GCC version (to get cleaner default results), and optionally
looping over architecture-independent glibc variants of CFLAGS and
configure options as well, for every glibc configuration listed
(e.g. -Os).

GCC versions before 4.9 are not expected to work (the code uses
--with-glibc-version to get the bootstrap GCC appropriately
configured).  There are various problems for particular configurations
as well.

Command-line options to the script: -jN to run N jobs in parallel
(default the number of CPU cores reported by the system); --keep=all
or --keep=failed to control keeping around build directories (default
--keep=none).

	* scripts/build-many-glibcs.py: New file.
2016-11-11 21:07:08 +00:00
argp Installed-header hygiene (BZ#20366): Simple self-contained fixes. 2016-09-23 08:43:55 -04:00
assert Update copyright dates with scripts/update-copyrights. 2016-01-04 16:05:18 +00:00
benchtests Use -fno-builtin for sqrt benchmark. 2016-10-21 21:18:03 +00:00
bits Define wordsize.h macros everywhere 2016-11-04 09:37:44 -07:00
catgets Fix building glibc master with NDEBUG and --with-cpu. 2016-03-15 23:23:24 -04:00
conform Fix linknamespace parallel test failures. 2016-11-03 22:47:02 +00:00
crypt crypt: Use internal names for the SHA-2 block functions 2016-10-28 21:49:21 +02:00
csu Remove __libc_csu_irel declaration 2016-09-10 15:50:53 +05:30
ctype Update copyright dates with scripts/update-copyrights. 2016-01-04 16:05:18 +00:00
debug Add tests for fortification of bcopy and bzero. 2016-08-19 09:04:35 -04:00
dirent Deprecate readdir_r, readdir64_r [BZ #19056] 2016-02-20 12:56:55 +01:00
dlfcn Fix warning caused by unused-result in bug-atexit3-lib.cc 2016-10-28 19:26:14 -02:00
elf Add include/crypt.h. 2016-10-28 22:40:16 -04:00
gmon Installed-header hygiene (BZ#20366): obsolete BSD u_* types. 2016-09-23 08:43:56 -04:00
gnulib Update copyright dates with scripts/update-copyrights. 2016-01-04 16:05:18 +00:00
grp Don't install the internal header grp-merge.h 2016-07-18 09:33:21 -03:00
gshadow Update copyright dates with scripts/update-copyrights. 2016-01-04 16:05:18 +00:00
hesiod hesiod: Avoid heap overflow in get_txt_records [BZ #20031] 2016-05-02 16:04:32 +02:00
hurd hurdmalloc: Run fork handler as late as possible [BZ #19431] 2016-09-22 01:45:48 +02:00
iconv gconv.h: fix build with GCC 7 2016-11-06 21:33:10 +01:00
iconvdata Bug 20729: Fix building with -Os. 2016-10-29 23:50:56 -04:00
include Bug 20729: Fix building with -Os. 2016-10-29 23:50:56 -04:00
inet Installed-header hygiene (BZ#20366): conditionally defined structures. 2016-09-23 08:43:56 -04:00
intl hurd: fix pathconf visibility 2016-09-18 23:45:12 +02:00
io Consolidate posix_fallocate{64} implementations 2016-10-07 14:16:41 -03:00
libidn Update copyright dates with scripts/update-copyrights. 2016-01-04 16:05:18 +00:00
libio Fix tst-memstream3 build failure 2016-10-02 10:24:32 -03:00
locale Bug 20729: Include libc-internal.h where required. 2016-10-31 16:46:57 -04:00
localedata localedata: lt_LT: use hyphens in d_fmt [BZ #20497] 2016-08-24 16:07:02 -04:00
login 2016-06-11 Paul Pluzhnikov <ppluzhnikov@google.com> 2016-06-11 14:50:16 -07:00
mach Fix old-style function definition 2016-09-20 23:10:51 +02:00
malloc malloc: Update comments about chunk layout 2016-10-28 22:36:58 +02:00
manual Do not hardcode platform names in manual/libm-err-tab.pl (bug 14139). 2016-11-04 16:49:06 +00:00
math Refactor some libm type-generic macros. 2016-11-10 21:41:56 +00:00
mathvec Update copyright dates with scripts/update-copyrights. 2016-01-04 16:05:18 +00:00
misc hurd: Fix unused variable warning 2016-10-10 22:45:18 +02:00
nis Installed-header hygiene (BZ#20366): Simple self-contained fixes. 2016-09-23 08:43:55 -04:00
nptl Consolidate lseek/lseek64/llseek implementations 2016-11-08 16:04:33 -02:00
nptl_db Bug 20729: Include libc-internal.h where required. 2016-10-31 16:46:57 -04:00
nscd Fix incorrect double-checked locking related to _res_hconf.initialized. 2016-08-18 20:53:37 +02:00
nss Fix incorrect double-checked locking related to _res_hconf.initialized. 2016-08-18 20:53:37 +02:00
po Update PO files. 2016-08-04 11:41:27 -04:00
posix Consolidate Linux ftruncate implementations 2016-11-09 17:46:11 -02:00
pwd Update copyright dates with scripts/update-copyrights. 2016-01-04 16:05:18 +00:00
resolv Bug 20729: Fix build failures on ppc64 and other arches. 2016-11-02 13:01:36 -04:00
resource Update copyright dates with scripts/update-copyrights. 2016-01-04 16:05:18 +00:00
rt Use libc_ifunc macro for clock_* symbols in librt. 2016-10-07 10:12:47 +02:00
scripts Add script to build many glibc configurations. 2016-11-11 21:07:08 +00:00
setjmp Update copyright dates with scripts/update-copyrights. 2016-01-04 16:05:18 +00:00
shadow Update copyright dates with scripts/update-copyrights. 2016-01-04 16:05:18 +00:00
signal Installed-header hygiene (BZ#20366): time.h types. 2016-09-23 08:43:56 -04:00
socket Installed-header hygiene (BZ#20366): conditionally defined structures. 2016-09-23 08:43:56 -04:00
soft-fp [soft-fp] Add support for various half-precision conversion routines. 2016-09-21 21:02:54 +00:00
stdio-common Fix warning from latest GCC in tst-printf.c 2016-11-01 16:00:09 -07:00
stdlib Ignore -Wmaybe-uninitialized in stdlib/bug-getcontext.c. 2016-11-11 21:05:51 +00:00
streams Update copyright dates with scripts/update-copyrights. 2016-01-04 16:05:18 +00:00
string Bug 20729: Fix building with -Os. 2016-10-29 23:50:56 -04:00
sunrpc Fix rpcgen buffer overrun (bug 20790). 2016-11-08 23:44:51 +00:00
sysdeps Make SH <sys/user.h> self-contained. 2016-11-11 21:04:28 +00:00
sysvipc Installed-header hygiene (BZ#20366): time.h types. 2016-09-23 08:43:56 -04:00
termios Declare tcgetsid for XPG4 (bug 20055). 2016-05-11 18:05:37 +00:00
time Fix -Wformat-length warning in time/tst-strptime2.c 2016-11-02 16:00:39 -07:00
timezone Remove mention of checktab.awk in timezone/README. 2016-03-14 14:11:51 -04:00
wcsmbs Add tst-wcstod-round 2016-08-19 11:17:07 -05:00
wctype Update copyright dates with scripts/update-copyrights. 2016-01-04 16:05:18 +00:00
.gitattributes Assume __NR_openat is always defined 2016-03-23 23:35:08 +01:00
.gitignore Add *.pyc to .gitignore 2015-05-18 15:26:26 +05:30
abi-tags Add arm-nacl port. 2015-04-17 09:02:19 -07:00
aclocal.m4 Rename localedir to complocaledir (bug 14259). 2015-11-27 10:22:38 -05:00
BUGS
ChangeLog Add script to build many glibc configurations. 2016-11-11 21:07:08 +00:00
ChangeLog.1
ChangeLog.2
ChangeLog.3
ChangeLog.4
ChangeLog.5
ChangeLog.6 Revert "ChangeLogs: convert to utf-8" 2016-02-12 16:35:27 -05:00
ChangeLog.7 Revert "ChangeLogs: convert to utf-8" 2016-02-12 16:35:27 -05:00
ChangeLog.8 ChangeLog: change Winblowz to Windows 2016-08-10 00:49:28 +08:00
ChangeLog.9
ChangeLog.10 Revert "ChangeLogs: convert to utf-8" 2016-02-12 16:35:27 -05:00
ChangeLog.11 ChangeLog: change Winblowz to Windows 2016-08-10 00:49:28 +08:00
ChangeLog.12 Revert "ChangeLogs: convert to utf-8" 2016-02-12 16:35:27 -05:00
ChangeLog.13
ChangeLog.14 Revert "ChangeLogs: convert to utf-8" 2016-02-12 16:35:27 -05:00
ChangeLog.15
ChangeLog.16
ChangeLog.17
ChangeLog.old-ports
ChangeLog.old-ports-aarch64
ChangeLog.old-ports-aix
ChangeLog.old-ports-alpha
ChangeLog.old-ports-am33
ChangeLog.old-ports-arm
ChangeLog.old-ports-cris
ChangeLog.old-ports-hppa
ChangeLog.old-ports-ia64
ChangeLog.old-ports-linux-generic
ChangeLog.old-ports-m68k
ChangeLog.old-ports-microblaze
ChangeLog.old-ports-mips
ChangeLog.old-ports-powerpc
ChangeLog.old-ports-tile
config.h.in Add configure check to test if gcc supports attribute ifunc. 2016-10-07 10:02:59 +02:00
config.make.in Avoid running $(CXX) during build to obtain header file paths 2016-09-21 10:45:32 +02:00
configure Add configure check to test if gcc supports attribute ifunc. 2016-10-07 10:02:59 +02:00
configure.ac Add configure check to test if gcc supports attribute ifunc. 2016-10-07 10:02:59 +02:00
CONFORMANCE
COPYING
COPYING.LIB
cppflags-iterator.mk
extra-lib.mk Remove NOT_IN_libc 2014-11-24 15:03:45 +05:30
extra-modules.mk Remove NOT_IN_libc 2014-11-24 15:03:45 +05:30
gen-locales.mk Split locale generation snippet into a separate file 2015-05-13 13:05:28 +05:30
INSTALL Add configure check to test if gcc supports attribute ifunc. 2016-10-07 10:02:59 +02:00
libc-abis
LICENSES
Makeconfig Generate .op pattern rules for profiling builds only 2016-09-21 10:45:19 +02:00
Makefile Installed header hygiene (BZ#20366): Test of installed headers. 2016-09-23 08:43:56 -04:00
Makefile.in New make target to only build benchmark binaries 2016-04-20 10:23:28 +05:30
Makerules Avoid running $(CXX) during build to obtain header file paths 2016-09-21 10:45:32 +02:00
NAMESPACE
NEWS Add SNAN, SNANF, SNANL macros. 2016-10-28 21:16:58 +00:00
o-iterator.mk
PROJECTS
README Require Linux 3.2 except on x86 / x86_64, 3.2 headers everywhere. 2016-02-24 17:15:12 +00:00
Rules Do not generate UNRESOLVED results for run-built-tests = no. 2016-11-04 21:29:00 +00:00
shlib-versions This is update for configure, build and install of vector math library. 2015-05-14 18:07:06 +03:00
test-skeleton.c Document do_test in test-skeleton.c 2016-11-07 08:28:52 -08:00
version.h Open development for 2.25. 2016-08-01 23:00:21 -04:00
WUR-REPORT

This directory contains the sources of the GNU C Library.
See the file "version.h" for what release version you have.

The GNU C Library is the standard system C library for all GNU systems,
and is an important part of what makes up a GNU system.  It provides the
system API for all programs written in C and C-compatible languages such
as C++ and Objective C; the runtime facilities of other programming
languages use the C library to access the underlying operating system.

In GNU/Linux systems, the C library works with the Linux kernel to
implement the operating system behavior seen by user applications.
In GNU/Hurd systems, it works with a microkernel and Hurd servers.

The GNU C Library implements much of the POSIX.1 functionality in the
GNU/Hurd system, using configurations i[4567]86-*-gnu.  The current
GNU/Hurd support requires out-of-tree patches that will eventually be
incorporated into an official GNU C Library release.

When working with Linux kernels, this version of the GNU C Library
requires Linux kernel version 3.2 or later on all architectures except
i[4567]86 and x86_64, where Linux kernel version 2.6.32 or later
suffices.

Also note that the shared version of the libgcc_s library must be
installed for the pthread library to work correctly.

The GNU C Library supports these configurations for using Linux kernels:

	aarch64*-*-linux-gnu
	alpha*-*-linux-gnu
	arm-*-linux-gnueabi
	hppa-*-linux-gnu	Not currently functional without patches.
	i[4567]86-*-linux-gnu
	x86_64-*-linux-gnu	Can build either x86_64 or x32
	ia64-*-linux-gnu
	m68k-*-linux-gnu
	microblaze*-*-linux-gnu
	mips-*-linux-gnu
	mips64-*-linux-gnu
	powerpc-*-linux-gnu	Hardware or software floating point, BE only.
	powerpc64*-*-linux-gnu	Big-endian and little-endian.
	s390-*-linux-gnu
	s390x-*-linux-gnu
	sh[34]-*-linux-gnu
	sparc*-*-linux-gnu
	sparc64*-*-linux-gnu
	tilegx-*-linux-gnu
	tilepro-*-linux-gnu

If you are interested in doing a port, please contact the glibc
maintainers; see http://www.gnu.org/software/libc/ for more
information.

See the file INSTALL to find out how to configure, build, and install
the GNU C Library.  You might also consider reading the WWW pages for
the C library at http://www.gnu.org/software/libc/.

The GNU C Library is (almost) completely documented by the Texinfo manual
found in the `manual/' subdirectory.  The manual is still being updated
and contains some known errors and omissions; we regret that we do not
have the resources to work on the manual as much as we would like.  For
corrections to the manual, please file a bug in the `manual' component,
following the bug-reporting instructions below.  Please be sure to check
the manual in the current development sources to see if your problem has
already been corrected.

Please see http://www.gnu.org/software/libc/bugs.html for bug reporting
information.  We are now using the Bugzilla system to track all bug reports.
This web page gives detailed information on how to report bugs properly.

The GNU C Library is free software.  See the file COPYING.LIB for copying
conditions, and LICENSES for notices about a few contributions that require
these additional notices to be distributed.  License copyright years may be
listed using range notation, e.g., 1996-2015, indicating that every year in
the range, inclusive, is a copyrightable year that would otherwise be listed
individually.