Ulrich Drepper
2f3f7b9da2
More small optimizations for x86-64 strlen.
2009-06-04 16:45:35 -07:00
Ulrich Drepper
747785f2b3
Tiny strlen for x86-64 optimization.
...
I didn't remove an instruction from a previous version in the final
version.
2009-06-04 10:54:29 -07:00
Ulrich Drepper
fd96f06208
Small optimization of STT_GNU_IFUNC handling.
...
The test to call the indirect function now includes a subtest to
checked whether the symbol is defined. When coming to that point
this is almost always the case. The test for STT_GNU_IFUNC on the
other hand rarely is true. Move it to the front means we don't have
to perform the second test unless really necessary.
2009-06-01 11:49:05 -07:00
Ulrich Drepper
b7629ee33f
Better error message for invalid relocatio in static binary.
2009-06-01 11:39:24 -07:00
Ulrich Drepper
8ea2372936
Fix up sched_cpucount in x86-64.
...
Now that static executables can handle IFUNC functions don't exclude
optimization for sched_cpucount for !SHARED.
2009-05-31 23:46:42 -07:00
Ulrich Drepper
7441470835
Finish IFUNC support for x86 and x86-64.
...
Add support for the IRELAIVE relocation and IFUNC in static executables.
2009-05-31 23:45:33 -07:00
Ulrich Drepper
963cb6fcb4
Simplify CPUID value handling.
...
SO far Intel and AMD use exactly the same bits meaning the same
things in CPUID index 1. Simplify the code. Should an architecture
come along which doesn't use the same semantics then it must use a
different index value than COMMON_CPUID_INDEX_1.
2009-05-31 17:52:05 -07:00
Ulrich Drepper
1de0c16183
Compact cache info data structure for x86/x86-64.
...
This saves about 1.5kB in the DSO.
2009-05-29 11:53:36 -07:00
H.J. Lu
e7535de78f
Add missing .text directives.
...
The ____longjmp_chk functions on x86 and x86-64 were placed in .rodata.str1.1.
2009-05-21 18:38:11 -07:00
Ulrich Drepper
b50f8e42ba
Check for valid stack frame in longjmp.
...
If longjmp restores the stack frame to an address which is beyond
the stack frame at the time of the longjmp call it would install
an uninitialized stack frame. If compiled with _FORTIFY_SOURCE
defined, longjmp will now bail out in this situation.
2009-05-15 19:37:13 -07:00
Ulrich Drepper
deb84c43b1
* version.h (VERSION): Bump to 2.10.1.
...
* nss/getXXbyYY_r.c: If NO_COMPAT_NEEDED is defined don't define any
compatibility functions.
* nss/getXXent_r.c: Likewise.
* gshadow/getsgent_r.c: Define NO_COMPAT_NEEDED.
* gshadow/getsgnam_r.c: Likewise.
* gshadow/Version: Remove duplicate entries.
* sysdeps/x86_64/cacheinfo.c (intel_02_cache_info): Add missing entries
for recent processor.
* sysdeps/unix/sysv/linux/i386/sysconf.c (intel_02_cache_info):
Likewise.
2009-05-10 18:38:52 +00:00
Ulrich Drepper
2221e33e5d
* sysdeps/x86_64/memchr.S: Handle invalid buffer pointers when
...
count is zero.
2009-05-09 06:40:15 +00:00
Ulrich Drepper
f0e3c47fd6
* sysdeps/ieee754/dbl-64/s_expm1.c: Set errno for overflow.
...
* sysdeps/ieee754/flt-32/s_expm1f.c: Likewise.
* sysdeps/x86_64/fpu/s_expm1l.S: Likewise.
2009-04-27 05:31:37 +00:00
Ulrich Drepper
6cc8844f1d
* sysdeps/unix/sysv/linux/dl-osinfo.h (dl_fatal): Remove inline
...
from definition.
* sysdeps/x86_64/dl-machine.h (elf_machine_rela): Don't define
label if it is not used.
* elf/dl-profile.c (_dl_start_profile): Define real-type variant
of gmon_hist_hdr and gmon_hdr structures and use them.
* elf/dl-load.c (open_verify): Add temporary variable to avoid
warning.
* nscd/nscd_helper.c (get_mapping): Avoid casts to avoid warnings.
* sunrpc/clnt_raw.c (clntraw_private_s): Use union in definition
to avoid cast.
* inet/rexec.c (rexec_af): Make sa2 a union to avoid warnings.
* inet/rcmd.c (rcmd_af): Make from a union of the various needed types
to avoid warnings.
(iruserok_af): Use ss_family instead of casts.
* gmon/gmon.c (write_hist): Define real-type variant of
gmon_hist_hdr structure and use it.
(write_gmon): Likewise for gmon_hdr.
* sysdeps/unix/sysv/linux/readv.c: Avoid declaration of replacement
function if we are not going to define it.
* sysdeps/unix/sysv/linux/writev.c: Likewise.
* inet/inet6_option.c (optin_alloc): Add temporary variable to
avoid warning.
* libio/strfile.h (struct _IO_streambuf): Use correct type and
name of VTable element.
* libio/iovsprintf.c: Avoid casts to avoid warnings.
* libio/iovsscanf.c: Likewise.
* libio/vasprintf.c: Likewise.
* libio/vsnprintf.c: Likewise.
* stdio-common/isoc99_vsscanf.c: Likewise.
* stdlib/strfmon_l.c: Likewise.
* debug/vasprintf_chk.c: Likewise.
* debug/vsnprintf_chk.c: Likewise.
* debug/vsprintf_chk.c: Likewise.
2009-04-26 20:12:37 +00:00
Ulrich Drepper
337c270829
* sysdeps/i386/fpu/s_tan.S: Set errno for ±Inf.
...
* sysdeps/i386/fpu/s_tanf.S: Likewise.
* sysdeps/i386/fpu/s_tanl.S: Likewise.
* sysdeps/ieee754/dbl-64/s_tan.c: Likewise.
* sysdeps/ieee754/flt-32/s_tanf.c: Likewise.
* sysdeps/x86_64/fpu/s_tanl.S: Likewise.
* math/libm-test.inc: Add tests for errno after tan calls with
±Inf.
2009-04-26 05:42:49 +00:00
Ulrich Drepper
0c59a1963e
* sysdeps/i386/fpu/s_cos.S: Set errno for ±Inf.
...
* sysdeps/i386/fpu/s_cosf.S: Likewise.
* sysdeps/i386/fpu/s_cosl.S: Likewise.
* sysdeps/i386/fpu/s_sin.S: Likewise.
* sysdeps/i386/fpu/s_sinf.S: Likewise.
* sysdeps/i386/fpu/s_sinl.S: Likewise.
* sysdeps/ieee754/dbl-64/s_sin.c: Likewise.
* sysdeps/ieee754/flt-32/s_cosf.c: Likewise.
* sysdeps/ieee754/flt-32/s_sinf.c: Likewise.
* sysdeps/ieee754/ldbl-96/s_cosl.c: Likewise.
* sysdeps/ieee754/ldbl-96/s_sinl.c: Likewise.
* sysdeps/x86_64/fpu/s_cosl.S: Likewise.
* sysdeps/x86_64/fpu/s_sinl.S: Likewise.
* math/libm-test.inc: Add tests for errno after sin/cos calls with
±Inf.
2009-04-26 01:04:54 +00:00
Ulrich Drepper
ae650a41ef
* sysdeps/x86_64/mp_clz_tab.c: New file.
2009-04-15 04:30:41 +00:00
Ulrich Drepper
893a5fd440
Optimizations from GMP.
...
* sysdeps/x86_64/add_n.S: New file.
* sysdeps/x86_64/addmul_1.S: New file.
* sysdeps/x86_64/lshift.S: New file.
* sysdeps/x86_64/mul_1.S: New file.
* sysdeps/x86_64/rshift.S: New file.
* sysdeps/x86_64/sub_n.S: New file.
* sysdeps/x86_64/submul_1.S: New file.
2009-04-14 22:26:05 +00:00
Ulrich Drepper
7fd23f1f3b
mpn_add_n for x86-64.
2009-04-14 22:24:59 +00:00
Ulrich Drepper
84aa52d7e9
* sysdeps/x86-64/strrchr.S: New file.
2009-04-14 05:58:16 +00:00
Ulrich Drepper
f140a0d53d
* sysdeps/x86_64/rawmemchr.S: New file.
2009-04-10 07:57:20 +00:00
Ulrich Drepper
4c8b8cc332
* malloc/malloc.c (_int_realloc): Add parameter with old block
...
size. Remove duplicated test. Don't handle mmap'ed blocks here.
Adjust all callers.
* malloc/hooks.c (realloc_check): Adjust _int_realloc call.
2009-04-08 18:00:34 +00:00
Ulrich Drepper
cd57745bd8
* sysdeps/x86_64/strchrnul.S: New file.
...
depending libcrypt on -lfreebl3.
2009-04-07 23:22:10 +00:00
Ulrich Drepper
ddba0f1700
* string/stratcliff.c (do_test): Add memchr tests..
...
* sysdeps/x86_64/memchr.S: Fix handling of end of buffer after
first read quad word.
2009-04-07 14:53:04 +00:00
Ulrich Drepper
322e23db24
* sysdeps/x86_64/memchr.S: New file.
2009-04-07 06:36:33 +00:00
Ulrich Drepper
1df6f9d808
* sysdeps/x86_64/strchr.S: Likewise.
2009-04-06 03:29:26 +00:00
Ulrich Drepper
a152f366dc
* sysdeps/x86_64/strlen.S: Optimize by using SSE2 instructions.
2009-04-05 18:49:28 +00:00
Ulrich Drepper
906dd40db3
[BZ #9881 ]
...
* inet/inet6_rth.c (inet6_rth_add): Add some error checking.
Patch mostly by Yang Hongyang <yanghy@cn.fujitsu.com>.
* inet/Makefile (tests): Add tst-inet6_rth.
* inet/tst-inet6_rth.c: New file.
alignment of La_x86_64_regs. Store xmm parameters.
2009-03-15 19:16:16 +00:00
Ulrich Drepper
a42ad61bae
* elf/dl-runtime.c (reloc_offset): Define.
...
(reloc_index): Define.
(_dl_fixup): Rename reloc_offset parameter to reloc_arg.
(_dl_fixup_profile): Likewise. Use reloc_index instead of
computing index from reloc_offset.
(_dl_call_pltexit): Likewise.
* sysdeps/x86_64/dl-trampoline.S (_dl_runtime_resolve): Just pass
the relocation index to _dl_fixup.
(_dl_runtime_profile): Likewise for _dl_fixup_profile and
_dl_call_pltexit.
* sysdeps/x86_64/dl-runtime.c: New file.
2009-03-15 00:26:14 +00:00
Ulrich Drepper
1f7c90a722
[BZ #9893 ]
...
* sysdeps/x86_64/dl-trampoline.S (_dl_runtime_profile): Fix
alignement of La_x86_64_regs. Store xmm parameters.
Patch mostly by Jiri Olsa <olsajiri@gmail.com>.
2009-03-14 23:57:33 +00:00
Ulrich Drepper
425ce2edb9
* config.h.in (USE_MULTIARCH): Define.
...
* configure.in: Handle --enable-multi-arch.
* elf/dl-runtime.c (_dl_fixup): Handle STT_GNU_IFUNC.
(_dl_fixup_profile): Likewise.
* elf/do-lookup.c (dl_lookup_x): Likewise.
* sysdeps/x86_64/dl-machine.h: Handle STT_GNU_IFUNC.
* elf/elf.h (STT_GNU_IFUNC): Define.
* include/libc-symbols.h (libc_ifunc): Define.
* sysdeps/x86_64/cacheinfo.c: If USE_MULTIARCH is defined, use the
framework in init-arch.h to get CPUID values.
* sysdeps/x86_64/multiarch/Makefile: New file.
* sysdeps/x86_64/multiarch/init-arch.c: New file.
* sysdeps/x86_64/multiarch/init-arch.h: New file.
* sysdeps/x86_64/multiarch/sched_cpucount.c: New file.
* config.make.in (experimental-malloc): Define.
* configure.in: Handle --enable-experimental-malloc.
* malloc/Makefile: Handle experimental-malloc flag.
* malloc/malloc.c: Implement PER_THREAD and ATOMIC_FASTBINS features.
* malloc/arena.c: Likewise.
* malloc/hooks.c: Likewise.
* malloc/malloc.h: Define M_ARENA_TEST and M_ARENA_MAX.
2009-03-13 23:53:18 +00:00
Ulrich Drepper
e7f110cdbd
* sysdeps/x86_64/dl-machine.h (elf_machine_rela): Add branch
...
prediction. A few size optimizations.
2009-03-12 06:31:25 +00:00
Jakub Jelinek
d82a27f841
* stdlib/monetary.h: Uglify function parameter names.
...
* sunrpc/rpc/pmap_clnt.h: Likewise.
* sunrpc/rpc/svc.h: Likewise.
* sunrpc/rpc/xdr.h: Likewise.
* sunrpc/rpc/clnt.h: Likewise.
* resolv/netdb.h: Likewise.
* resolv/arpa/nameser.h: Likewise.
* resolv/resolv.h: Likewise.
* argp/argp.h: Likewise.
* locale/langinfo.h: Likewise.
* io/sys/stat.h: Likewise.
* posix/spawn.h: Likewise.
* nis/rpcsvc/nislib.h: Likewise.
* malloc/obstack.h: Likewise.
* sysdeps/ia64/bits/link.h: Likewise.
* sysdeps/i386/bits/link.h: Likewise.
* sysdeps/s390/bits/link.h: Likewise.
* sysdeps/powerpc/bits/link.h: Likewise.
* sysdeps/x86_64/bits/link.h: Likewise.
* sysdeps/sparc/bits/link.h: Likewise.
* sysdeps/sh/bits/link.h: Likewise.
* sysdeps/unix/sysv/linux/i386/sys/io.h: Likewise.
* sysdeps/unix/sysv/linux/x86_64/sys/io.h: Likewise.
* sysdeps/unix/sysv/linux/sparc/sys/eventfd.h: Likewise.
* sysdeps/unix/sysv/linux/sys/eventfd.h: Likewise.
2009-02-16 Jakub Jelinek <jakub@redhat.com>
* stdlib/monetary.h: Uglify function parameter names.
* sunrpc/rpc/pmap_clnt.h: Likewise.
* sunrpc/rpc/svc.h: Likewise.
* sunrpc/rpc/xdr.h: Likewise.
* sunrpc/rpc/clnt.h: Likewise.
* resolv/netdb.h: Likewise.
* resolv/arpa/nameser.h: Likewise.
* resolv/resolv.h: Likewise.
* argp/argp.h: Likewise.
* locale/langinfo.h: Likewise.
* io/sys/stat.h: Likewise.
* posix/spawn.h: Likewise.
* nis/rpcsvc/nislib.h: Likewise.
* malloc/obstack.h: Likewise.
* sysdeps/ia64/bits/link.h: Likewise.
* sysdeps/i386/bits/link.h: Likewise.
* sysdeps/s390/bits/link.h: Likewise.
* sysdeps/powerpc/bits/link.h: Likewise.
* sysdeps/x86_64/bits/link.h: Likewise.
* sysdeps/sparc/bits/link.h: Likewise.
* sysdeps/sh/bits/link.h: Likewise.
* sysdeps/unix/sysv/linux/i386/sys/io.h: Likewise.
* sysdeps/unix/sysv/linux/x86_64/sys/io.h: Likewise.
* sysdeps/unix/sysv/linux/sparc/sys/eventfd.h: Likewise.
* sysdeps/unix/sysv/linux/sys/eventfd.h: Likewise.
2009-02-16 21:00:15 +00:00
Ulrich Drepper
6c03cd11e9
* include/atomic.h: Define catomic_and if not already defined.
...
* sysdeps/x86_64/bits/atomic.h: Define catomic_and.
* sysdeps/i386/i486/bits/atomic.h: Likewise.
2009-02-08 23:50:23 +00:00
Ulrich Drepper
ebc22416e4
* sysdeps/x86_64/cacheinfo.c (intel_02_known): Add new descriptors.
...
* sysdeps/unix/sysv/linux/i386/sysconf.c (intel_02_known): Likewise.
2009-02-01 18:13:41 +00:00
Ulrich Drepper
fd537e535f
[BZ #9750 ]
...
* nscd/mem.c (gc): Use alloca_count to get the real stack usage.
* include/alloca.h (alloca_account): Define.
* sysdeps/x86_64/stackinfo.h (stackinfo_get_sp): Define.
(stackinfo_sub_sp): Define.
2009-01-29 00:17:57 +00:00
Ulrich Drepper
50e481ceeb
* nscd/nscd_gethst_r.c (nscd_gethst_r): Don't use nscd if
...
LOCALDOMAIN is defined.
* nscd/nscd_getai.c (__nscd_getai): Likewise.
2008-12-29 20:56:13 +00:00
Ulrich Drepper
217d45cd35
* sysdeps/x86_64/bits/select.h: New file.
2008-12-29 20:16:11 +00:00
Roland McGrath
187f9fbc46
2008-11-11 Roland McGrath <roland@redhat.com>
...
* sysdeps/x86_64/configure: New file.
2008-11-11 09:50:06 +00:00
Ulrich Drepper
62a1ffc6fa
* sysdeps/x86_64/memset.S: Reduce size of tables for PIC.
2008-08-14 18:58:04 +00:00
Ulrich Drepper
9523fd2806
* sysdeps/i386/fpu/s_expm1l.S: Simply use exp implementation for large
...
parameters.
* sysdeps/x86_64/fpu/s_expm1l.S: Likewise.
Patch by Denys Vlasenko <dvlasenk@redhat.com>.
* nscd/connections.c (nscd_init): Typo in preprocessor directive.
2008-08-05 22:08:42 +00:00
Ulrich Drepper
2f9a1be867
[BZ #6442 ]
...
* string/endian.h: Add macros for fixed-size endian conversion.
* bits/byteswap.h: Allow inclusion from <endian.h>.
* sysdeps/i386/bits/byteswap.h: Likewise.
* sysdeps/ia64/bits/byteswap.h: Likewise.
* sysdeps/s390/bits/byteswap.h: Likewise.
* sysdeps/x86_64/bits/byteswap.h: Likewise.
* string/Makefile (tests): Add tst-endian.
* string/tst-endian.c: New file.
2008-05-15 02:54:33 +00:00
Ulrich Drepper
c9ff0187a6
Introduce TLS descriptors for i386 and x86_64.
...
* include/inline-hashtab.h: New file, copied from 2005's
libiberty, with fix for memory leak imported afterwards by
Glauber de Oliveira Costa.
* elf/tlsdeschtab.h: New file.
* elf/dl-reloc.c (_dl_try_allocate_static_tls): Extract from...
(_dl_allocate_static_tls): ... here. Rearrange failure path.
(CHECK_STATIC_TLS): Move to...
* elf/dynamic-link.h: ... this file.
(TRY_STATIC_TLS): New macro.
* elf/dl-conflict.c (CHECK_STATIC_TLS, TRY_STATIC_TLS): Override.
* elf/elf.h (R_386_TLS_GOTDESC, R_386_TLS_DESC_CALL,
R_386_TLS_DESC): Define.
(R_X86_64_PC64, R_X86_GOTOFF64, R_X86_64_GOTPC32): Merge from
binutils.
(R_X86_64_GOTPC32_TLSDESC, R_X86_64_TLSDESC_CALL,
R_X86_64_TLSDESC): Define.
(R_386_NUM, R_X86_64_NUM): Adjust.
* sysdeps/i386/Makefile (sysdep-dl-routines, sysdep_routines,
systep-rtld-routines): Add tlsdesc and dl-tlsdesc for elf subdir.
(gen-as-const-headers): Add tlsdesc.sym to csu subdir.
* sysdeps/i386/dl-lookupcfg.h: New file. Introduce _dl_unmap to
release tlsdesc_table.
* sysdeps/i386/dl-machine.h: Include dl-tlsdesc.h.
(elf_machine_type_class): Mark R_386_TLS_DESC as PLT class.
(elf_machine_rel): Handle R_386_TLS_DESC.
(elf_machine_rela): Likewise.
(elf_machine_lazy_rel): Likewise.
(elf_machine_lazy_rela): Likewise.
* sysdeps/i386/dl-tls.h (struct dl_tls_index): Name it.
* sysdeps/i386/dl-tlsdesc.S: New file.
* sysdeps/i386/dl-tlsdesc.h: New file.
* sysdeps/i386/tlsdesc.c: New file.
* sysdeps/i386/tlsdesc.sym: New file.
* sysdeps/i386/bits/linkmap.h (struct link_map_machine): Add
tlsdesc_table.
* sysdeps/x86_64/Makefile (sysdep-dl-routines, sysdep_routines,
systep-rtld-routines): Add tlsdesc and dl-tlsdesc for elf subdir.
(gen-as-const-headers): Add tlsdesc.sym to csu subdir.
* sysdeps/x86_64/dl-lookupcfg.h: New file. Introduce _dl_unmap to
release tlsdesc_table.
* sysdeps/x86_64/dl-machine.h: Include dl-tlsdesc.h.
(elf_machine_runtime_setup): Set up lazy TLSDESC GOT entry.
(elf_machine_type_class): Mark R_X86_64_TLSDESC as PLT class.
(elf_machine_rel): Handle R_X86_64_TLSDESC.
(elf_machine_rela): Likewise.
(elf_machine_lazy_rel): Likewise.
* sysdeps/x86_64/dl-tls.h (struct dl_tls_index): Name it.
(__tls_get_addr): Do not declare for non-shared compiles.
* sysdeps/x86_64/dl-tlsdesc.S: New file.
* sysdeps/x86_64/dl-tlsdesc.h: New file.
* sysdeps/x86_64/tlsdesc.c: New file.
* sysdeps/x86_64/tlsdesc.sym: New file.
* sysdeps/x86_64/bits/linkmap.h (struct link_map_machine): Add
tlsdesc_table for both 32- and 64-bit structs.
2008-05-13 05:41:30 +00:00
Ulrich Drepper
78c2bf0eb4
* sysdeps/x86_64/rtld-memset.c: New file.
...
2008-2-26 Harsha Jagasia <harsha.jagasia@amd.com>
* sysdeps/x86_64/cacheinfo.c (NOT_USED_RIGHT_NOW): Remove ifdef guards.
* sysdeps/x86_64/memset.S: Rewrite non-SSE code path as tuned for AMD
Barcelona machine. Make default fall through branch of
__x86_64_preferred_memory_instruction check as the integer code path.
2007-10-15 H.J. Lu <hongjiu.lu@intel.com>
* sysdeps/x86_64/cacheinfo.c
(__x86_64_preferred_memory_instruction): New variable.
(init_cacheinfo): Initialize __x86_64_preferred_memory_instruction.
* sysdeps/x86_64/memset.S: Rewrite.
2008-01-08 Jakub Jelinek <jakub@redhat.com>
* malloc/malloc.c (public_cALLOc): For arenas other than
2008-03-07 17:55:11 +00:00
Ulrich Drepper
ee269826ab
(intel_02_known): New entry 0x3f.
2007-12-23 19:32:28 +00:00
Ulrich Drepper
f6ed654cab
* sysdeps/x86_64/memset.S: Add sfence after movnti.
2007-11-08 01:07:04 +00:00
Ulrich Drepper
41ff2a4999
* sysdeps/x86_64/dl-trampoline.S (_dl_runtime_profile): Make sure
...
stack is properly aligned for the target function.
Correct unwind info.
2007-10-31 19:25:15 +00:00
Jakub Jelinek
ed13ccf1f7
* sysdeps/x86_64/memset.S (bzero): Renamed to __bzero. Add
...
weak_alias.
2007-10-17 Jakub Jelinek <jakub@redhat.com>
* sysdeps/x86_64/memset.S (bzero): Renamed to __bzero. Add
weak_alias.
2007-10-18 00:09:32 +00:00
Ulrich Drepper
406f28dbe5
* sysdeps/x86_64/cacheinfo.c: Comment out code added in support of
...
new memset.
too high for the improvements. Implement bzero unconditionally for
use in libc.
2007-10-17 15:58:16 +00:00
Ulrich Drepper
ac1cb5da08
* sysdeps/x86_64/memset.S: Revert to old version for now. The cost is
...
too high for the improvements.
2007-10-17 Ulrich Drepper <drepper@redhat.com>
Jakub Jelinek <jakub@redhat.com>
2007-10-17 15:44:30 +00:00