glibc/sysdeps/powerpc/powerpc64/multiarch
Lucas A. M. Magalhaes dd59655e93 powerpc64le: Optimized memmove for POWER10
This patch was initially based on the __memmove_power7 with some ideas
from strncpy implementation for Power 9.

Improvements from __memmove_power7:

1. Use lxvl/stxvl for alignment code.

   The code for Power 7 uses branches when the input is not naturally
   aligned to the width of a vector. The new implementation uses
   lxvl/stxvl instead which reduces pressure on GPRs. It also allows
   the removal of branch instructions, implicitly removing branch stalls
   and mispredictions.

2. Use of lxv/stxv and lxvl/stxvl pair is safe to use on Cache Inhibited
   memory.

   On Power 10 vector load and stores are safe to use on CI memory for
   addresses unaligned to 16B. This code takes advantage of this to
   do unaligned loads.

   The unaligned loads don't have a significant performance impact by
   themselves. However doing so decreases register pressure on GPRs
   and interdependence stalls on load/store pairs. This also improved
   readability as there are now less code paths for different alignments.
   Finally this reduces the overall code size.

3. Improved performance.

   This version runs on average about 30% better than memmove_power7
   for lengths  larger than 8KB. For input lengths shorter than 8KB
   the improvement is smaller, it has on average about 17% better
   performance.

   This version has a degradation of about 50% for input lengths
   in the 0 to 31 bytes range when dest is unaligned.

Reviewed-by: Tulio Magno Quites Machado Filho <tuliom@linux.ibm.com>
2021-04-30 18:12:08 -03:00
..
bcopy-ppc64.c Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
bcopy.c powerpc64le: Optimized memmove for POWER10 2021-04-30 18:12:08 -03:00
bzero.c Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
ifunc-impl-list.c powerpc64le: Optimized memmove for POWER10 2021-04-30 18:12:08 -03:00
init-arch.h Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
Makefile powerpc64le: Optimized memmove for POWER10 2021-04-30 18:12:08 -03:00
memchr-power7.S Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
memchr-power8.S Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
memchr-ppc64.c Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
memchr.c Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
memcmp-power4.S Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
memcmp-power7.S Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
memcmp-power8.S Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
memcmp-ppc64.c Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
memcmp.c Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
memcpy-a2.S Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
memcpy-cell.S Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
memcpy-power4.S Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
memcpy-power6.S Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
memcpy-power7.S Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
memcpy-power8-cached.S Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
memcpy-ppc64.S Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
memcpy.c Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
memmove-power7.S powerpc64le: Optimized memmove for POWER10 2021-04-30 18:12:08 -03:00
memmove-power10.S powerpc64le: Optimized memmove for POWER10 2021-04-30 18:12:08 -03:00
memmove-ppc64.c Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
memmove.c powerpc64le: Optimized memmove for POWER10 2021-04-30 18:12:08 -03:00
mempcpy-power7.S Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
mempcpy-ppc64.c Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
mempcpy.c Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
memrchr-power7.S Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
memrchr-power8.S Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
memrchr-ppc64.c Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
memrchr.c Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
memset-power4.S Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
memset-power6.S Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
memset-power7.S Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
memset-power8.S Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
memset-ppc64.S Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
memset.c Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
rawmemchr-power7.S Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
rawmemchr-power9.S Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
rawmemchr-ppc64.c Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
rawmemchr.c Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
rtld-memset.c Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
rtld-strchr.S Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
stpcpy-power7.c Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
stpcpy-power8.S Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
stpcpy-power9.S Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
stpcpy-ppc64.c Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
stpcpy.c Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
stpncpy-power7.S Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
stpncpy-power8.S Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
stpncpy-power9.S Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
stpncpy-ppc64.c Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
stpncpy.c Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strcasecmp_l-power7.S Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strcasecmp_l.c Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strcasecmp-power7.S Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strcasecmp-power8.S Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strcasecmp-ppc64.c Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strcasecmp.c Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strcasestr-power8.S Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strcasestr-ppc64.c Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strcasestr.c Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strcat-power7.c Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strcat-power8.c Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strcat-ppc64.c Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strcat.c Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strchr-power7.S Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strchr-power8.S Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strchr-ppc64.S Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strchr.c Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strchrnul-power7.S Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strchrnul-power8.S Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strchrnul-ppc64.c Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strchrnul.c Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strcmp-power7.S Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strcmp-power8.S Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strcmp-power9.S Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strcmp-ppc64.S Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strcmp.c Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strcpy-power7.c Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strcpy-power8.S Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strcpy-power9.S Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strcpy-ppc64.c Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strcpy.c Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strcspn-power8.S Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strcspn-ppc64.c Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strcspn.c Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strlen-power7.S Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strlen-power8.S Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strlen-power9.S powerpc64le: add optimized strlen for P9 2020-06-05 15:30:00 -05:00
strlen-power10.S powerpc: Add optimized strlen for POWER10 2021-04-22 16:18:06 -03:00
strlen-ppc64.S Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strlen.c powerpc: Add optimized strlen for POWER10 2021-04-22 16:18:06 -03:00
strncase_l-power7.c Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strncase_l.c Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strncase-power7.c Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strncase-power8.S Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strncase-ppc64.c Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strncase.c Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strncat-power7.c Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strncat-power8.c Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strncat-ppc64.c Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strncat.c Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strncmp-power4.S Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strncmp-power7.S Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strncmp-power8.S Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strncmp-power9.S Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strncmp-ppc64.S Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strncmp.c Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strncpy-power7.S Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strncpy-power8.S Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strncpy-power9.S Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strncpy-ppc64.c Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strncpy.c Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strnlen-power7.S Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strnlen-power8.S Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strnlen-ppc64.c Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strnlen.c Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strrchr-power7.S Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strrchr-power8.S Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strrchr-ppc64.c Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strrchr.c Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strspn-power8.S Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strspn-ppc64.c Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strspn.c Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strstr-power7.S Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strstr-ppc64.c Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
strstr.c Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00
wordcopy-ppc64.c Update copyright dates with scripts/update-copyrights 2021-01-02 12:17:34 -08:00