mirror of
https://sourceware.org/git/glibc.git
synced 2024-12-02 09:40:13 +00:00
dd59655e93
This patch was initially based on the __memmove_power7 with some ideas from strncpy implementation for Power 9. Improvements from __memmove_power7: 1. Use lxvl/stxvl for alignment code. The code for Power 7 uses branches when the input is not naturally aligned to the width of a vector. The new implementation uses lxvl/stxvl instead which reduces pressure on GPRs. It also allows the removal of branch instructions, implicitly removing branch stalls and mispredictions. 2. Use of lxv/stxv and lxvl/stxvl pair is safe to use on Cache Inhibited memory. On Power 10 vector load and stores are safe to use on CI memory for addresses unaligned to 16B. This code takes advantage of this to do unaligned loads. The unaligned loads don't have a significant performance impact by themselves. However doing so decreases register pressure on GPRs and interdependence stalls on load/store pairs. This also improved readability as there are now less code paths for different alignments. Finally this reduces the overall code size. 3. Improved performance. This version runs on average about 30% better than memmove_power7 for lengths larger than 8KB. For input lengths shorter than 8KB the improvement is smaller, it has on average about 17% better performance. This version has a degradation of about 50% for input lengths in the 0 to 31 bytes range when dest is unaligned. Reviewed-by: Tulio Magno Quites Machado Filho <tuliom@linux.ibm.com>
39 lines
1.4 KiB
C
39 lines
1.4 KiB
C
/* PowerPC64 multiarch bcopy.
|
|
Copyright (C) 2014-2021 Free Software Foundation, Inc.
|
|
This file is part of the GNU C Library.
|
|
|
|
The GNU C Library is free software; you can redistribute it and/or
|
|
modify it under the terms of the GNU Lesser General Public
|
|
License as published by the Free Software Foundation; either
|
|
version 2.1 of the License, or (at your option) any later version.
|
|
|
|
The GNU C Library is distributed in the hope that it will be useful,
|
|
but WITHOUT ANY WARRANTY; without even the implied warranty of
|
|
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU
|
|
Lesser General Public License for more details.
|
|
|
|
You should have received a copy of the GNU Lesser General Public
|
|
License along with the GNU C Library; if not, see
|
|
<https://www.gnu.org/licenses/>. */
|
|
|
|
#include <string.h>
|
|
#include "init-arch.h"
|
|
|
|
extern __typeof (bcopy) __bcopy_ppc attribute_hidden;
|
|
/* __bcopy_power7 symbol is implemented at memmove-power7.S */
|
|
extern __typeof (bcopy) __bcopy_power7 attribute_hidden;
|
|
#ifdef __LITTLE_ENDIAN__
|
|
extern __typeof (bcopy) __bcopy_power10 attribute_hidden;
|
|
#endif
|
|
|
|
libc_ifunc (bcopy,
|
|
#ifdef __LITTLE_ENDIAN__
|
|
hwcap2 & (PPC_FEATURE2_ARCH_3_1 |
|
|
PPC_FEATURE2_HAS_ISEL)
|
|
&& (hwcap & PPC_FEATURE_HAS_VSX)
|
|
? __bcopy_power10 :
|
|
#endif
|
|
(hwcap & PPC_FEATURE_HAS_VSX)
|
|
? __bcopy_power7
|
|
: __bcopy_ppc);
|