mirror of
https://sourceware.org/git/glibc.git
synced 2025-01-12 12:10:16 +00:00
c867597bff
Since the new SSE2/AVX2 memcpy/memmove are faster than the previous ones, we can remove the previous SSE2/AVX2 memcpy/memmove and replace them with the new ones. No change in IFUNC selection if SSE2 and AVX2 memcpy/memmove weren't used before. If SSE2 or AVX2 memcpy/memmove were used, the new SSE2 or AVX2 memcpy/memmove optimized with Enhanced REP MOVSB will be used for processors with ERMS. The new AVX512 memcpy/memmove will be used for processors with AVX512 which prefer vzeroupper. Since the new SSE2 memcpy/memmove are faster than the previous default memcpy/memmove used in libc.a and ld.so, we also remove the previous default memcpy/memmove and make them the default memcpy/memmove, except that non-temporal store isn't used in ld.so. Together, it reduces the size of libc.so by about 6 KB and the size of ld.so by about 2 KB. [BZ #19776] * sysdeps/x86_64/memcpy.S: Make it dummy. * sysdeps/x86_64/mempcpy.S: Likewise. * sysdeps/x86_64/memmove.S: New file. * sysdeps/x86_64/memmove_chk.S: Likewise. * sysdeps/x86_64/multiarch/memmove.S: Likewise. * sysdeps/x86_64/multiarch/memmove_chk.S: Likewise. * sysdeps/x86_64/memmove.c: Removed. * sysdeps/x86_64/multiarch/memcpy-avx-unaligned.S: Likewise. * sysdeps/x86_64/multiarch/memcpy-sse2-unaligned.S: Likewise. * sysdeps/x86_64/multiarch/memmove-avx-unaligned.S: Likewise. * sysdeps/x86_64/multiarch/memmove-sse2-unaligned-erms.S: Likewise. * sysdeps/x86_64/multiarch/memmove.c: Likewise. * sysdeps/x86_64/multiarch/memmove_chk.c: Likewise. * sysdeps/x86_64/multiarch/Makefile (sysdep_routines): Remove memcpy-sse2-unaligned, memmove-avx-unaligned, memcpy-avx-unaligned and memmove-sse2-unaligned-erms. * sysdeps/x86_64/multiarch/ifunc-impl-list.c (__libc_ifunc_impl_list): Replace __memmove_chk_avx512_unaligned_2 with __memmove_chk_avx512_unaligned. Remove __memmove_chk_avx_unaligned_2. Replace __memmove_chk_sse2_unaligned_2 with __memmove_chk_sse2_unaligned. Remove __memmove_chk_sse2 and __memmove_avx_unaligned_2. Replace __memmove_avx512_unaligned_2 with __memmove_avx512_unaligned. Replace __memmove_sse2_unaligned_2 with __memmove_sse2_unaligned. Remove __memmove_sse2. Replace __memcpy_chk_avx512_unaligned_2 with __memcpy_chk_avx512_unaligned. Remove __memcpy_chk_avx_unaligned_2. Replace __memcpy_chk_sse2_unaligned_2 with __memcpy_chk_sse2_unaligned. Remove __memcpy_chk_sse2. Remove __memcpy_avx_unaligned_2. Replace __memcpy_avx512_unaligned_2 with __memcpy_avx512_unaligned. Remove __memcpy_sse2_unaligned_2 and __memcpy_sse2. Replace __mempcpy_chk_avx512_unaligned_2 with __mempcpy_chk_avx512_unaligned. Remove __mempcpy_chk_avx_unaligned_2. Replace __mempcpy_chk_sse2_unaligned_2 with __mempcpy_chk_sse2_unaligned. Remove __mempcpy_chk_sse2. Replace __mempcpy_avx512_unaligned_2 with __mempcpy_avx512_unaligned. Remove __mempcpy_avx_unaligned_2. Replace __mempcpy_sse2_unaligned_2 with __mempcpy_sse2_unaligned. Remove __mempcpy_sse2. * sysdeps/x86_64/multiarch/memcpy.S (__new_memcpy): Support __memcpy_avx512_unaligned_erms and __memcpy_avx512_unaligned. Use __memcpy_avx_unaligned_erms and __memcpy_sse2_unaligned_erms if processor has ERMS. Default to __memcpy_sse2_unaligned. (ENTRY): Removed. (END): Likewise. (ENTRY_CHK): Likewise. (libc_hidden_builtin_def): Likewise. Don't include ../memcpy.S. * sysdeps/x86_64/multiarch/memcpy_chk.S (__memcpy_chk): Support __memcpy_chk_avx512_unaligned_erms and __memcpy_chk_avx512_unaligned. Use __memcpy_chk_avx_unaligned_erms and __memcpy_chk_sse2_unaligned_erms if if processor has ERMS. Default to __memcpy_chk_sse2_unaligned. * sysdeps/x86_64/multiarch/memmove-vec-unaligned-erms.S Change function suffix from unaligned_2 to unaligned. * sysdeps/x86_64/multiarch/mempcpy.S (__mempcpy): Support __mempcpy_avx512_unaligned_erms and __mempcpy_avx512_unaligned. Use __mempcpy_avx_unaligned_erms and __mempcpy_sse2_unaligned_erms if processor has ERMS. Default to __mempcpy_sse2_unaligned. (ENTRY): Removed. (END): Likewise. (ENTRY_CHK): Likewise. (libc_hidden_builtin_def): Likewise. Don't include ../mempcpy.S. (mempcpy): New. Add a weak alias. * sysdeps/x86_64/multiarch/mempcpy_chk.S (__mempcpy_chk): Support __mempcpy_chk_avx512_unaligned_erms and __mempcpy_chk_avx512_unaligned. Use __mempcpy_chk_avx_unaligned_erms and __mempcpy_chk_sse2_unaligned_erms if if processor has ERMS. Default to __mempcpy_chk_sse2_unaligned. |
||
|---|---|---|
| .. | ||
| bcopy.S | ||
| ifunc-impl-list.c | ||
| Makefile | ||
| memcmp-sse4.S | ||
| memcmp-ssse3.S | ||
| memcmp.S | ||
| memcpy_chk.S | ||
| memcpy-ssse3-back.S | ||
| memcpy-ssse3.S | ||
| memcpy.S | ||
| memmove_chk.S | ||
| memmove-avx512-no-vzeroupper.S | ||
| memmove-avx512-unaligned-erms.S | ||
| memmove-avx-unaligned-erms.S | ||
| memmove-ssse3-back.S | ||
| memmove-ssse3.S | ||
| memmove-vec-unaligned-erms.S | ||
| memmove.S | ||
| mempcpy_chk.S | ||
| mempcpy.S | ||
| memset_chk.S | ||
| memset-avx2-unaligned-erms.S | ||
| memset-avx512-no-vzeroupper.S | ||
| memset-avx512-unaligned-erms.S | ||
| memset-vec-unaligned-erms.S | ||
| memset.S | ||
| sched_cpucount.c | ||
| stpcpy-sse2-unaligned.S | ||
| stpcpy-ssse3.S | ||
| stpcpy.S | ||
| stpncpy-c.c | ||
| stpncpy-sse2-unaligned.S | ||
| stpncpy-ssse3.S | ||
| stpncpy.S | ||
| strcasecmp_l-ssse3.S | ||
| strcasecmp_l.S | ||
| strcat-sse2-unaligned.S | ||
| strcat-ssse3.S | ||
| strcat.S | ||
| strchr-sse2-no-bsf.S | ||
| strchr.S | ||
| strcmp-sse2-unaligned.S | ||
| strcmp-sse42.S | ||
| strcmp-ssse3.S | ||
| strcmp.S | ||
| strcpy-sse2-unaligned.S | ||
| strcpy-ssse3.S | ||
| strcpy.S | ||
| strcspn-c.c | ||
| strcspn.S | ||
| strncase_l-ssse3.S | ||
| strncase_l.S | ||
| strncat-c.c | ||
| strncat-sse2-unaligned.S | ||
| strncat-ssse3.S | ||
| strncat.S | ||
| strncmp-ssse3.S | ||
| strncmp.S | ||
| strncpy-c.c | ||
| strncpy-sse2-unaligned.S | ||
| strncpy-ssse3.S | ||
| strncpy.S | ||
| strpbrk-c.c | ||
| strpbrk.S | ||
| strspn-c.c | ||
| strspn.S | ||
| strstr-sse2-unaligned.S | ||
| strstr.c | ||
| test-multiarch.c | ||
| varshift.c | ||
| varshift.h | ||
| wcscpy-c.c | ||
| wcscpy-ssse3.S | ||
| wcscpy.S | ||
| wmemcmp-c.c | ||
| wmemcmp-sse4.S | ||
| wmemcmp-ssse3.S | ||
| wmemcmp.S | ||