AuroraMiddleware/glibc
1
0
Fork 0
mirror of https://sourceware.org/git/glibc.git synced 2024-11-26 06:50:07 +00:00
Code Issues Packages Projects Releases Wiki Activity
c4d4419433
glibc/sysdeps/x86_64/wcscmp.S

953 lines
23 KiB
ArmAsm
Raw Normal View History

Add optimized x86-64 wcscmp
2011-09-05 18:08:23 +00:00
/* Optimized wcscmp for x86-64 with SSE2.
Update copyright dates with scripts/update-copyrights.
2020-01-01 00:14:33 +00:00
Copyright (C) 2011-2020 Free Software Foundation, Inc.
Add optimized x86-64 wcscmp
2011-09-05 18:08:23 +00:00
Contributed by Intel Corporation.
This file is part of the GNU C Library.
The GNU C Library is free software; you can redistribute it and/or
modify it under the terms of the GNU Lesser General Public
License as published by the Free Software Foundation; either
version 2.1 of the License, or (at your option) any later version.
The GNU C Library is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU
Lesser General Public License for more details.
You should have received a copy of the GNU Lesser General Public
Replace FSF snail mail address with URLs.
2012-02-09 23:18:22 +00:00
License along with the GNU C Library; if not, see
Prefer https to http for gnu.org and fsf.org URLs Also, change sources.redhat.com to sourceware.org. This patch was automatically generated by running the following shell script, which uses GNU sed, and which avoids modifying files imported from upstream: sed -ri ' s,(http|ftp)(://(.*\.)?(gnu|fsf|sourceware)\.org($|[^.]|\.[^a-z])),https\2,g s,(http|ftp)(://(.*\.)?)sources\.redhat\.com($|[^.]|\.[^a-z]),https\2sourceware.org\4,g ' \ $(find $(git ls-files) -prune -type f \ ! -name '*.po' \ ! -name 'ChangeLog*' \ ! -path COPYING ! -path COPYING.LIB \ ! -path manual/fdl-1.3.texi ! -path manual/lgpl-2.1.texi \ ! -path manual/texinfo.tex ! -path scripts/config.guess \ ! -path scripts/config.sub ! -path scripts/install-sh \ ! -path scripts/mkinstalldirs ! -path scripts/move-if-change \ ! -path INSTALL ! -path locale/programs/charmap-kw.h \ ! -path po/libc.pot ! -path sysdeps/gnu/errlist.c \ ! '(' -name configure \ -execdir test -f configure.ac -o -f configure.in ';' ')' \ ! '(' -name preconfigure \ -execdir test -f preconfigure.ac ';' ')' \ -print) and then by running 'make dist-prepare' to regenerate files built from the altered files, and then executing the following to cleanup: chmod a+x sysdeps/unix/sysv/linux/riscv/configure # Omit irrelevant whitespace and comment-only changes, # perhaps from a slightly-different Autoconf version. git checkout -f \ sysdeps/csky/configure \ sysdeps/hppa/configure \ sysdeps/riscv/configure \ sysdeps/unix/sysv/linux/csky/configure # Omit changes that caused a pre-commit check to fail like this: # remote: *** error: sysdeps/powerpc/powerpc64/ppc-mcount.S: trailing lines git checkout -f \ sysdeps/powerpc/powerpc64/ppc-mcount.S \ sysdeps/unix/sysv/linux/s390/s390-64/syscall.S # Omit change that caused a pre-commit check to fail like this: # remote: *** error: sysdeps/sparc/sparc64/multiarch/memcpy-ultra3.S: last line does not end in newline git checkout -f sysdeps/sparc/sparc64/multiarch/memcpy-ultra3.S
2019-09-07 05:40:42 +00:00
<https://www.gnu.org/licenses/>. */
Add optimized x86-64 wcscmp
2011-09-05 18:08:23 +00:00
#include <sysdep.h>
Fix signedness in wcscmp comparison
2011-10-23 17:34:15 +00:00
/* Note: wcscmp uses signed comparison, not unsighed as in strcmp function. */
Add optimized x86-64 wcscmp
2011-09-05 18:08:23 +00:00
.text
Fix regcomp wcscoll, wcscmp namespace (bug 18497). regcomp brings in references to wcscoll, which isn't in all the standards that contain regcomp. In turn, wcscoll brings in references to wcscmp, also not in all those standards. This patch fixes this by making those functions into weak aliases of __wcscoll and __wcscmp and calling those names instead as needed. Tested for x86_64 and x86 (testsuite, and that disassembly of installed shared libraries is unchanged by the patch). [BZ #18497] * wcsmbs/wcscmp.c [!WCSCMP] (WCSCMP): Define as __wcscmp instead of wcscmp. (wcscmp): Define as weak alias of WCSCMP. * wcsmbs/wcscoll.c (STRCOLL): Define as __wcscoll instead of wcscoll. (USE_HIDDEN_DEF): Define. [!USE_IN_EXTENDED_LOCALE_MODEL] (wcscoll): Define as weak alias of __wcscoll. Don't use libc_hidden_weak. * wcsmbs/wcscoll_l.c (STRCMP): Define as __wcscmp instead of wcscmp. * sysdeps/i386/i686/multiarch/wcscmp-c.c [SHARED] (libc_hidden_def): Define __GI___wcscmp instead of __GI_wcscmp. (weak_alias): Undefine and redefine. * sysdeps/i386/i686/multiarch/wcscmp.S (wcscmp): Rename to __wcscmp and define as weak alias of __wcscmp. * sysdeps/x86_64/wcscmp.S (wcscmp): Likewise. * include/wchar.h (__wcscmp): Declare. Use libc_hidden_proto. (__wcscoll): Likewise. (wcscmp): Don't use libc_hidden_proto. (wcscoll): Likewise. * posix/regcomp.c (build_range_exp): Call __wcscoll instead of wcscoll. * posix/regexec.c (check_node_accept_bytes): Likewise. * conform/Makefile (test-xfail-XPG3/regex.h/linknamespace): Remove variable. (test-xfail-XPG4/regex.h/linknamespace): Likewise. (test-xfail-POSIX/regex.h/linknamespace): Likewise.
2015-06-09 21:07:30 +00:00
ENTRY (__wcscmp)
Add optimized x86-64 wcscmp
2011-09-05 18:08:23 +00:00
/*
* This implementation uses SSE to compare up to 16 bytes at a time.
*/
mov %esi, %eax
mov %edi, %edx
pxor %xmm0, %xmm0 /* clear %xmm0 for null char checks */
mov %al, %ch
mov %dl, %cl
and $63, %eax /* rsi alignment in cache line */
and $63, %edx /* rdi alignment in cache line */
and $15, %cl
jz L(continue_00)
cmp $16, %edx
jb L(continue_0)
cmp $32, %edx
jb L(continue_16)
cmp $48, %edx
jb L(continue_32)
L(continue_48):
and $15, %ch
jz L(continue_48_00)
cmp $16, %eax
jb L(continue_0_48)
cmp $32, %eax
jb L(continue_16_48)
cmp $48, %eax
jb L(continue_32_48)
.p2align 4
L(continue_48_48):
mov (%rsi), %ecx
cmp %ecx, (%rdi)
jne L(nequal)
test %ecx, %ecx
jz L(equal)
mov 4(%rsi), %ecx
cmp %ecx, 4(%rdi)
jne L(nequal)
test %ecx, %ecx
jz L(equal)
mov 8(%rsi), %ecx
cmp %ecx, 8(%rdi)
jne L(nequal)
test %ecx, %ecx
jz L(equal)
mov 12(%rsi), %ecx
cmp %ecx, 12(%rdi)
jne L(nequal)
test %ecx, %ecx
jz L(equal)
Fix WS
2011-10-23 17:35:24 +00:00
Add optimized x86-64 wcscmp
2011-09-05 18:08:23 +00:00
movdqu 16(%rdi), %xmm1
movdqu 16(%rsi), %xmm2
pcmpeqd %xmm1, %xmm0 /* Any null double_word? */
pcmpeqd %xmm2, %xmm1 /* compare first 4 double_words for equality */
psubb %xmm0, %xmm1 /* packed sub of comparison results*/
pmovmskb %xmm1, %edx
sub $0xffff, %edx /* if first 4 double_words are same, edx == 0xffff */
jnz L(less4_double_words_16)
movdqu 32(%rdi), %xmm1
movdqu 32(%rsi), %xmm2
pcmpeqd %xmm1, %xmm0 /* Any null double_word? */
pcmpeqd %xmm2, %xmm1 /* compare first 4 double_words for equality */
psubb %xmm0, %xmm1 /* packed sub of comparison results*/
pmovmskb %xmm1, %edx
sub $0xffff, %edx /* if first 4 double_words are same, edx == 0xffff */
jnz L(less4_double_words_32)
movdqu 48(%rdi), %xmm1
movdqu 48(%rsi), %xmm2
pcmpeqd %xmm1, %xmm0 /* Any null double_word? */
pcmpeqd %xmm2, %xmm1 /* compare first 4 double_words for equality */
psubb %xmm0, %xmm1 /* packed sub of comparison results*/
pmovmskb %xmm1, %edx
sub $0xffff, %edx /* if first 4 double_words are same, edx == 0xffff */
jnz L(less4_double_words_48)
add $64, %rsi
add $64, %rdi
jmp L(continue_48_48)
L(continue_0):
and $15, %ch
jz L(continue_0_00)
cmp $16, %eax
jb L(continue_0_0)
cmp $32, %eax
jb L(continue_0_16)
cmp $48, %eax
jb L(continue_0_32)
.p2align 4
L(continue_0_48):
mov (%rsi), %ecx
cmp %ecx, (%rdi)
jne L(nequal)
test %ecx, %ecx
jz L(equal)
mov 4(%rsi), %ecx
cmp %ecx, 4(%rdi)
jne L(nequal)
test %ecx, %ecx
jz L(equal)
mov 8(%rsi), %ecx
cmp %ecx, 8(%rdi)
jne L(nequal)
test %ecx, %ecx
jz L(equal)
mov 12(%rsi), %ecx
cmp %ecx, 12(%rdi)
jne L(nequal)
test %ecx, %ecx
jz L(equal)
movdqu 16(%rdi), %xmm1
movdqu 16(%rsi), %xmm2
pcmpeqd %xmm1, %xmm0 /* Any null double_word? */
pcmpeqd %xmm2, %xmm1 /* compare first 4 double_words for equality */
psubb %xmm0, %xmm1 /* packed sub of comparison results*/
pmovmskb %xmm1, %edx
sub $0xffff, %edx /* if first 4 double_words are same, edx == 0xffff */
jnz L(less4_double_words_16)
movdqu 32(%rdi), %xmm1
movdqu 32(%rsi), %xmm2
pcmpeqd %xmm1, %xmm0 /* Any null double_word? */
pcmpeqd %xmm2, %xmm1 /* compare first 4 double_words for equality */
psubb %xmm0, %xmm1 /* packed sub of comparison results*/
pmovmskb %xmm1, %edx
sub $0xffff, %edx /* if first 4 double_words are same, edx == 0xffff */
jnz L(less4_double_words_32)
mov 48(%rsi), %ecx
cmp %ecx, 48(%rdi)
jne L(nequal)
test %ecx, %ecx
jz L(equal)
mov 52(%rsi), %ecx
cmp %ecx, 52(%rdi)
jne L(nequal)
test %ecx, %ecx
jz L(equal)
mov 56(%rsi), %ecx
cmp %ecx, 56(%rdi)
jne L(nequal)
test %ecx, %ecx
jz L(equal)
mov 60(%rsi), %ecx
cmp %ecx, 60(%rdi)
jne L(nequal)
test %ecx, %ecx
jz L(equal)
add $64, %rsi
add $64, %rdi
jmp L(continue_0_48)
.p2align 4
L(continue_00):
and $15, %ch
jz L(continue_00_00)
cmp $16, %eax
jb L(continue_00_0)
cmp $32, %eax
jb L(continue_00_16)
cmp $48, %eax
jb L(continue_00_32)
.p2align 4
L(continue_00_48):
pcmpeqd (%rdi), %xmm0
mov (%rdi), %eax
pmovmskb %xmm0, %ecx
test %ecx, %ecx
jnz L(less4_double_words1)
Fix signedness in wcscmp comparison
2011-10-23 17:34:15 +00:00
cmp (%rsi), %eax
jne L(nequal)
Fix WS
2011-10-23 17:35:24 +00:00
Add optimized x86-64 wcscmp
2011-09-05 18:08:23 +00:00
mov 4(%rdi), %eax
Fix signedness in wcscmp comparison
2011-10-23 17:34:15 +00:00
cmp 4(%rsi), %eax
jne L(nequal)
Add optimized x86-64 wcscmp
2011-09-05 18:08:23 +00:00
mov 8(%rdi), %eax
Fix signedness in wcscmp comparison
2011-10-23 17:34:15 +00:00
cmp 8(%rsi), %eax
jne L(nequal)
Add optimized x86-64 wcscmp
2011-09-05 18:08:23 +00:00
mov 12(%rdi), %eax
Fix signedness in wcscmp comparison
2011-10-23 17:34:15 +00:00
cmp 12(%rsi), %eax
jne L(nequal)
Fix WS
2011-10-23 17:35:24 +00:00
Add optimized x86-64 wcscmp
2011-09-05 18:08:23 +00:00
movdqu 16(%rsi), %xmm2
pcmpeqd %xmm2, %xmm0 /* Any null double_word? */
pcmpeqd 16(%rdi), %xmm2 /* compare first 4 double_words for equality */
psubb %xmm0, %xmm2 /* packed sub of comparison results*/
pmovmskb %xmm2, %edx
sub $0xffff, %edx /* if first 4 double_words are same, edx == 0xffff */
jnz L(less4_double_words_16)
movdqu 32(%rsi), %xmm2
pcmpeqd %xmm2, %xmm0 /* Any null double_word? */
pcmpeqd 32(%rdi), %xmm2 /* compare first 4 double_words for equality */
psubb %xmm0, %xmm2 /* packed sub of comparison results*/
pmovmskb %xmm2, %edx
sub $0xffff, %edx /* if first 4 double_words are same, edx == 0xffff */
jnz L(less4_double_words_32)
movdqu 48(%rsi), %xmm2
pcmpeqd %xmm2, %xmm0 /* Any null double_word? */
pcmpeqd 48(%rdi), %xmm2 /* compare first 4 double_words for equality */
psubb %xmm0, %xmm2 /* packed sub of comparison results*/
pmovmskb %xmm2, %edx
sub $0xffff, %edx /* if first 4 double_words are same, edx == 0xffff */
jnz L(less4_double_words_48)
add $64, %rsi
add $64, %rdi
jmp L(continue_00_48)
.p2align 4
L(continue_32):
and $15, %ch
jz L(continue_32_00)
cmp $16, %eax
jb L(continue_0_32)
cmp $32, %eax
jb L(continue_16_32)
cmp $48, %eax
jb L(continue_32_32)
.p2align 4
L(continue_32_48):
mov (%rsi), %ecx
cmp %ecx, (%rdi)
jne L(nequal)
test %ecx, %ecx
jz L(equal)
mov 4(%rsi), %ecx
cmp %ecx, 4(%rdi)
jne L(nequal)
test %ecx, %ecx
jz L(equal)
mov 8(%rsi), %ecx
cmp %ecx, 8(%rdi)
jne L(nequal)
test %ecx, %ecx
jz L(equal)
mov 12(%rsi), %ecx
cmp %ecx, 12(%rdi)
jne L(nequal)
test %ecx, %ecx
jz L(equal)
mov 16(%rsi), %ecx
cmp %ecx, 16(%rdi)
jne L(nequal)
test %ecx, %ecx
jz L(equal)
mov 20(%rsi), %ecx
cmp %ecx, 20(%rdi)
jne L(nequal)
test %ecx, %ecx
jz L(equal)
mov 24(%rsi), %ecx
cmp %ecx, 24(%rdi)
jne L(nequal)
test %ecx, %ecx
jz L(equal)
mov 28(%rsi), %ecx
cmp %ecx, 28(%rdi)
jne L(nequal)
test %ecx, %ecx
jz L(equal)
movdqu 32(%rdi), %xmm1
movdqu 32(%rsi), %xmm2
pcmpeqd %xmm1, %xmm0 /* Any null double_word? */
pcmpeqd %xmm2, %xmm1 /* compare first 4 double_words for equality */
psubb %xmm0, %xmm1 /* packed sub of comparison results*/
pmovmskb %xmm1, %edx
sub $0xffff, %edx /* if first 4 double_words are same, edx == 0xffff */
jnz L(less4_double_words_32)
movdqu 48(%rdi), %xmm1
movdqu 48(%rsi), %xmm2
pcmpeqd %xmm1, %xmm0 /* Any null double_word? */
pcmpeqd %xmm2, %xmm1 /* compare first 4 double_words for equality */
psubb %xmm0, %xmm1 /* packed sub of comparison results*/
pmovmskb %xmm1, %edx
sub $0xffff, %edx /* if first 4 double_words are same, edx == 0xffff */
jnz L(less4_double_words_48)
add $64, %rsi
add $64, %rdi
jmp L(continue_32_48)
.p2align 4
L(continue_16):
and $15, %ch
jz L(continue_16_00)
cmp $16, %eax
jb L(continue_0_16)
cmp $32, %eax
jb L(continue_16_16)
cmp $48, %eax
jb L(continue_16_32)
.p2align 4
L(continue_16_48):
mov (%rsi), %ecx
cmp %ecx, (%rdi)
jne L(nequal)
test %ecx, %ecx
jz L(equal)
mov 4(%rsi), %ecx
cmp %ecx, 4(%rdi)
jne L(nequal)
test %ecx, %ecx
jz L(equal)
mov 8(%rsi), %ecx
cmp %ecx, 8(%rdi)
jne L(nequal)
test %ecx, %ecx
jz L(equal)
mov 12(%rsi), %ecx
cmp %ecx, 12(%rdi)
jne L(nequal)
test %ecx, %ecx
jz L(equal)
movdqu 16(%rdi), %xmm1
movdqu 16(%rsi), %xmm2
pcmpeqd %xmm1, %xmm0 /* Any null double_word? */
pcmpeqd %xmm2, %xmm1 /* compare first 4 double_words for equality */
psubb %xmm0, %xmm1 /* packed sub of comparison results*/
pmovmskb %xmm1, %edx
sub $0xffff, %edx /* if first 4 double_words are same, edx == 0xffff */
jnz L(less4_double_words_16)
mov 32(%rsi), %ecx
cmp %ecx, 32(%rdi)
jne L(nequal)
test %ecx, %ecx
jz L(equal)
mov 36(%rsi), %ecx
cmp %ecx, 36(%rdi)
jne L(nequal)
test %ecx, %ecx
jz L(equal)
mov 40(%rsi), %ecx
cmp %ecx, 40(%rdi)
jne L(nequal)
test %ecx, %ecx
jz L(equal)
mov 44(%rsi), %ecx
cmp %ecx, 44(%rdi)
jne L(nequal)
test %ecx, %ecx
jz L(equal)
movdqu 48(%rdi), %xmm1
movdqu 48(%rsi), %xmm2
pcmpeqd %xmm1, %xmm0 /* Any null double_word? */
pcmpeqd %xmm2, %xmm1 /* compare first 4 double_words for equality */
psubb %xmm0, %xmm1 /* packed sub of comparison results*/
pmovmskb %xmm1, %edx
sub $0xffff, %edx /* if first 4 double_words are same, edx == 0xffff */
jnz L(less4_double_words_48)
add $64, %rsi
add $64, %rdi
jmp L(continue_16_48)
.p2align 4
L(continue_00_00):
movdqa (%rdi), %xmm1
pcmpeqd %xmm1, %xmm0 /* Any null double_word? */
pcmpeqd (%rsi), %xmm1 /* compare first 4 double_words for equality */
psubb %xmm0, %xmm1 /* packed sub of comparison results*/
pmovmskb %xmm1, %edx
sub $0xffff, %edx /* if first 4 double_words are same, edx == 0xffff */
jnz L(less4_double_words)
movdqa 16(%rdi), %xmm3
pcmpeqd %xmm3, %xmm0 /* Any null double_word? */
pcmpeqd 16(%rsi), %xmm3 /* compare first 4 double_words for equality */
psubb %xmm0, %xmm3 /* packed sub of comparison results*/
pmovmskb %xmm3, %edx
sub $0xffff, %edx /* if first 4 double_words are same, edx == 0xffff */
jnz L(less4_double_words_16)
movdqa 32(%rdi), %xmm5
pcmpeqd %xmm5, %xmm0 /* Any null double_word? */
pcmpeqd 32(%rsi), %xmm5 /* compare first 4 double_words for equality */
psubb %xmm0, %xmm5 /* packed sub of comparison results*/
pmovmskb %xmm5, %edx
sub $0xffff, %edx /* if first 4 double_words are same, edx == 0xffff */
jnz L(less4_double_words_32)
movdqa 48(%rdi), %xmm1
pcmpeqd %xmm1, %xmm0 /* Any null double_word? */
pcmpeqd 48(%rsi), %xmm1 /* compare first 4 double_words for equality */
psubb %xmm0, %xmm1 /* packed sub of comparison results*/
pmovmskb %xmm1, %edx
sub $0xffff, %edx /* if first 4 double_words are same, edx == 0xffff */
jnz L(less4_double_words_48)
add $64, %rsi
add $64, %rdi
jmp L(continue_00_00)
.p2align 4
L(continue_00_32):
movdqu (%rsi), %xmm2
pcmpeqd %xmm2, %xmm0 /* Any null double_word? */
pcmpeqd (%rdi), %xmm2 /* compare first 4 double_words for equality */
psubb %xmm0, %xmm2 /* packed sub of comparison results*/
pmovmskb %xmm2, %edx
sub $0xffff, %edx /* if first 4 double_words are same, edx == 0xffff */
jnz L(less4_double_words)
add $16, %rsi
add $16, %rdi
jmp L(continue_00_48)
.p2align 4
L(continue_00_16):
movdqu (%rsi), %xmm2
pcmpeqd %xmm2, %xmm0 /* Any null double_word? */
pcmpeqd (%rdi), %xmm2 /* compare first 4 double_words for equality */
psubb %xmm0, %xmm2 /* packed sub of comparison results*/
pmovmskb %xmm2, %edx
sub $0xffff, %edx /* if first 4 double_words are same, edx == 0xffff */
jnz L(less4_double_words)
movdqu 16(%rsi), %xmm2
pcmpeqd %xmm2, %xmm0 /* Any null double_word? */
pcmpeqd 16(%rdi), %xmm2 /* compare first 4 double_words for equality */
psubb %xmm0, %xmm2 /* packed sub of comparison results*/
pmovmskb %xmm2, %edx
sub $0xffff, %edx /* if first 4 double_words are same, edx == 0xffff */
jnz L(less4_double_words_16)
add $32, %rsi
add $32, %rdi
jmp L(continue_00_48)
.p2align 4
L(continue_00_0):
movdqu (%rsi), %xmm2
pcmpeqd %xmm2, %xmm0 /* Any null double_word? */
pcmpeqd (%rdi), %xmm2 /* compare first 4 double_words for equality */
psubb %xmm0, %xmm2 /* packed sub of comparison results*/
pmovmskb %xmm2, %edx
sub $0xffff, %edx /* if first 4 double_words are same, edx == 0xffff */
jnz L(less4_double_words)
movdqu 16(%rsi), %xmm2
pcmpeqd %xmm2, %xmm0 /* Any null double_word? */
pcmpeqd 16(%rdi), %xmm2 /* compare first 4 double_words for equality */
psubb %xmm0, %xmm2 /* packed sub of comparison results*/
pmovmskb %xmm2, %edx
sub $0xffff, %edx /* if first 4 double_words are same, edx == 0xffff */
jnz L(less4_double_words_16)
movdqu 32(%rsi), %xmm2
pcmpeqd %xmm2, %xmm0 /* Any null double_word? */
pcmpeqd 32(%rdi), %xmm2 /* compare first 4 double_words for equality */
psubb %xmm0, %xmm2 /* packed sub of comparison results*/
pmovmskb %xmm2, %edx
sub $0xffff, %edx /* if first 4 double_words are same, edx == 0xffff */
jnz L(less4_double_words_32)
add $48, %rsi
add $48, %rdi
jmp L(continue_00_48)
.p2align 4
L(continue_48_00):
pcmpeqd (%rsi), %xmm0
mov (%rdi), %eax
pmovmskb %xmm0, %ecx
test %ecx, %ecx
jnz L(less4_double_words1)
Fix signedness in wcscmp comparison
2011-10-23 17:34:15 +00:00
cmp (%rsi), %eax
jne L(nequal)
Fix WS
2011-10-23 17:35:24 +00:00
Add optimized x86-64 wcscmp
2011-09-05 18:08:23 +00:00
mov 4(%rdi), %eax
Fix signedness in wcscmp comparison
2011-10-23 17:34:15 +00:00
cmp 4(%rsi), %eax
jne L(nequal)
Add optimized x86-64 wcscmp
2011-09-05 18:08:23 +00:00
mov 8(%rdi), %eax
Fix signedness in wcscmp comparison
2011-10-23 17:34:15 +00:00
cmp 8(%rsi), %eax
jne L(nequal)
Add optimized x86-64 wcscmp
2011-09-05 18:08:23 +00:00
mov 12(%rdi), %eax
Fix signedness in wcscmp comparison
2011-10-23 17:34:15 +00:00
cmp 12(%rsi), %eax
jne L(nequal)
Fix WS
2011-10-23 17:35:24 +00:00
Add optimized x86-64 wcscmp
2011-09-05 18:08:23 +00:00
movdqu 16(%rdi), %xmm1
pcmpeqd %xmm1, %xmm0 /* Any null double_word? */
pcmpeqd 16(%rsi), %xmm1 /* compare first 4 double_words for equality */
psubb %xmm0, %xmm1 /* packed sub of comparison results*/
pmovmskb %xmm1, %edx
sub $0xffff, %edx /* if first 4 double_words are same, edx == 0xffff */
jnz L(less4_double_words_16)
movdqu 32(%rdi), %xmm1
pcmpeqd %xmm1, %xmm0 /* Any null double_word? */
pcmpeqd 32(%rsi), %xmm1 /* compare first 4 double_words for equality */
psubb %xmm0, %xmm1 /* packed sub of comparison results*/
pmovmskb %xmm1, %edx
sub $0xffff, %edx /* if first 4 double_words are same, edx == 0xffff */
jnz L(less4_double_words_32)
movdqu 48(%rdi), %xmm1
pcmpeqd %xmm1, %xmm0 /* Any null double_word? */
pcmpeqd 48(%rsi), %xmm1 /* compare first 4 double_words for equality */
psubb %xmm0, %xmm1 /* packed sub of comparison results*/
pmovmskb %xmm1, %edx
sub $0xffff, %edx /* if first 4 double_words are same, edx == 0xffff */
jnz L(less4_double_words_48)
add $64, %rsi
add $64, %rdi
jmp L(continue_48_00)
.p2align 4
L(continue_32_00):
movdqu (%rdi), %xmm1
pcmpeqd %xmm1, %xmm0 /* Any null double_word? */
pcmpeqd (%rsi), %xmm1 /* compare first 4 double_words for equality */
psubb %xmm0, %xmm1 /* packed sub of comparison results*/
pmovmskb %xmm1, %edx
sub $0xffff, %edx /* if first 4 double_words are same, edx == 0xffff */
jnz L(less4_double_words)
add $16, %rsi
add $16, %rdi
jmp L(continue_48_00)
.p2align 4
L(continue_16_00):
movdqu (%rdi), %xmm1
pcmpeqd %xmm1, %xmm0 /* Any null double_word? */
pcmpeqd (%rsi), %xmm1 /* compare first 4 double_words for equality */
psubb %xmm0, %xmm1 /* packed sub of comparison results*/
pmovmskb %xmm1, %edx
sub $0xffff, %edx /* if first 4 double_words are same, edx == 0xffff */
jnz L(less4_double_words)
movdqu 16(%rdi), %xmm1
pcmpeqd %xmm1, %xmm0 /* Any null double_word? */
pcmpeqd 16(%rsi), %xmm1 /* compare first 4 double_words for equality */
psubb %xmm0, %xmm1 /* packed sub of comparison results*/
pmovmskb %xmm1, %edx
sub $0xffff, %edx /* if first 4 double_words are same, edx == 0xffff */
jnz L(less4_double_words_16)
add $32, %rsi
add $32, %rdi
jmp L(continue_48_00)
.p2align 4
L(continue_0_00):
movdqu (%rdi), %xmm1
pcmpeqd %xmm1, %xmm0 /* Any null double_word? */
pcmpeqd (%rsi), %xmm1 /* compare first 4 double_words for equality */
psubb %xmm0, %xmm1 /* packed sub of comparison results*/
pmovmskb %xmm1, %edx
sub $0xffff, %edx /* if first 4 double_words are same, edx == 0xffff */
jnz L(less4_double_words)
movdqu 16(%rdi), %xmm1
pcmpeqd %xmm1, %xmm0 /* Any null double_word? */
pcmpeqd 16(%rsi), %xmm1 /* compare first 4 double_words for equality */
psubb %xmm0, %xmm1 /* packed sub of comparison results*/
pmovmskb %xmm1, %edx
sub $0xffff, %edx /* if first 4 double_words are same, edx == 0xffff */
jnz L(less4_double_words_16)
movdqu 32(%rdi), %xmm1
pcmpeqd %xmm1, %xmm0 /* Any null double_word? */
pcmpeqd 32(%rsi), %xmm1 /* compare first 4 double_words for equality */
psubb %xmm0, %xmm1 /* packed sub of comparison results*/
pmovmskb %xmm1, %edx
sub $0xffff, %edx /* if first 4 double_words are same, edx == 0xffff */
jnz L(less4_double_words_32)
add $48, %rsi
add $48, %rdi
jmp L(continue_48_00)
.p2align 4
L(continue_32_32):
movdqu (%rdi), %xmm1
movdqu (%rsi), %xmm2
pcmpeqd %xmm1, %xmm0 /* Any null double_word? */
pcmpeqd %xmm2, %xmm1 /* compare first 4 double_words for equality */
psubb %xmm0, %xmm1 /* packed sub of comparison results*/
pmovmskb %xmm1, %edx
sub $0xffff, %edx /* if first 4 double_words are same, edx == 0xffff */
jnz L(less4_double_words)
add $16, %rsi
add $16, %rdi
jmp L(continue_48_48)
.p2align 4
L(continue_16_16):
movdqu (%rdi), %xmm1
movdqu (%rsi), %xmm2
pcmpeqd %xmm1, %xmm0 /* Any null double_word? */
pcmpeqd %xmm2, %xmm1 /* compare first 4 double_words for equality */
psubb %xmm0, %xmm1 /* packed sub of comparison results*/
pmovmskb %xmm1, %edx
sub $0xffff, %edx /* if first 4 double_words are same, edx == 0xffff */
jnz L(less4_double_words)
movdqu 16(%rdi), %xmm3
movdqu 16(%rsi), %xmm4
pcmpeqd %xmm3, %xmm0 /* Any null double_word? */
pcmpeqd %xmm4, %xmm3 /* compare first 4 double_words for equality */
psubb %xmm0, %xmm3 /* packed sub of comparison results*/
pmovmskb %xmm3, %edx
sub $0xffff, %edx /* if first 4 double_words are same, edx == 0xffff */
jnz L(less4_double_words_16)
add $32, %rsi
add $32, %rdi
jmp L(continue_48_48)
.p2align 4
L(continue_0_0):
movdqu (%rdi), %xmm1
movdqu (%rsi), %xmm2
pcmpeqd %xmm1, %xmm0 /* Any null double_word? */
pcmpeqd %xmm2, %xmm1 /* compare first 4 double_words for equality */
psubb %xmm0, %xmm1 /* packed sub of comparison results*/
pmovmskb %xmm1, %edx
sub $0xffff, %edx /* if first 4 double_words are same, edx == 0xffff */
jnz L(less4_double_words)
movdqu 16(%rdi), %xmm3
movdqu 16(%rsi), %xmm4
pcmpeqd %xmm3, %xmm0 /* Any null double_word? */
pcmpeqd %xmm4, %xmm3 /* compare first 4 double_words for equality */
psubb %xmm0, %xmm3 /* packed sub of comparison results*/
pmovmskb %xmm3, %edx
sub $0xffff, %edx /* if first 4 double_words are same, edx == 0xffff */
jnz L(less4_double_words_16)
movdqu 32(%rdi), %xmm1
movdqu 32(%rsi), %xmm2
pcmpeqd %xmm1, %xmm0 /* Any null double_word? */
pcmpeqd %xmm2, %xmm1 /* compare first 4 double_words for equality */
psubb %xmm0, %xmm1 /* packed sub of comparison results*/
pmovmskb %xmm1, %edx
sub $0xffff, %edx /* if first 4 double_words are same, edx == 0xffff */
jnz L(less4_double_words_32)
add $48, %rsi
add $48, %rdi
jmp L(continue_48_48)
.p2align 4
L(continue_0_16):
movdqu (%rdi), %xmm1
movdqu (%rsi), %xmm2
pcmpeqd %xmm1, %xmm0 /* Any null double_word? */
pcmpeqd %xmm2, %xmm1 /* compare first 4 double_words for equality */
psubb %xmm0, %xmm1 /* packed sub of comparison results*/
pmovmskb %xmm1, %edx
sub $0xffff, %edx /* if first 4 double_words are same, edx == 0xffff */
jnz L(less4_double_words)
movdqu 16(%rdi), %xmm1
movdqu 16(%rsi), %xmm2
pcmpeqd %xmm1, %xmm0 /* Any null double_word? */
pcmpeqd %xmm2, %xmm1 /* compare first 4 double_words for equality */
psubb %xmm0, %xmm1 /* packed sub of comparison results*/
pmovmskb %xmm1, %edx
sub $0xffff, %edx /* if first 4 double_words are same, edx == 0xffff */
jnz L(less4_double_words_16)
add $32, %rsi
add $32, %rdi
jmp L(continue_32_48)
.p2align 4
L(continue_0_32):
movdqu (%rdi), %xmm1
movdqu (%rsi), %xmm2
pcmpeqd %xmm1, %xmm0 /* Any null double_word? */
pcmpeqd %xmm2, %xmm1 /* compare first 4 double_words for equality */
psubb %xmm0, %xmm1 /* packed sub of comparison results*/
pmovmskb %xmm1, %edx
sub $0xffff, %edx /* if first 4 double_words are same, edx == 0xffff */
jnz L(less4_double_words)
add $16, %rsi
add $16, %rdi
jmp L(continue_16_48)
.p2align 4
L(continue_16_32):
movdqu (%rdi), %xmm1
movdqu (%rsi), %xmm2
pcmpeqd %xmm1, %xmm0 /* Any null double_word? */
pcmpeqd %xmm2, %xmm1 /* compare first 4 double_words for equality */
psubb %xmm0, %xmm1 /* packed sub of comparison results*/
pmovmskb %xmm1, %edx
sub $0xffff, %edx /* if first 4 double_words are same, edx == 0xffff */
jnz L(less4_double_words)
add $16, %rsi
add $16, %rdi
jmp L(continue_32_48)
.p2align 4
L(less4_double_words1):
cmp (%rsi), %eax
jne L(nequal)
test %eax, %eax
jz L(equal)
mov 4(%rsi), %ecx
cmp %ecx, 4(%rdi)
jne L(nequal)
test %ecx, %ecx
jz L(equal)
mov 8(%rsi), %ecx
cmp %ecx, 8(%rdi)
jne L(nequal)
test %ecx, %ecx
jz L(equal)
Fix signedness in wcscmp comparison
2011-10-23 17:34:15 +00:00
mov 12(%rsi), %ecx
cmp %ecx, 12(%rdi)
jne L(nequal)
xor %eax, %eax
Add optimized x86-64 wcscmp
2011-09-05 18:08:23 +00:00
ret
.p2align 4
L(less4_double_words):
Fix signedness in wcscmp comparison
2011-10-23 17:34:15 +00:00
xor %eax, %eax
Add optimized x86-64 wcscmp
2011-09-05 18:08:23 +00:00
test %dl, %dl
jz L(next_two_double_words)
and $15, %dl
jz L(second_double_word)
mov (%rdi), %eax
Fix signedness in wcscmp comparison
2011-10-23 17:34:15 +00:00
cmp (%rsi), %eax
jne L(nequal)
Add optimized x86-64 wcscmp
2011-09-05 18:08:23 +00:00
ret
.p2align 4
L(second_double_word):
mov 4(%rdi), %eax
Fix signedness in wcscmp comparison
2011-10-23 17:34:15 +00:00
cmp 4(%rsi), %eax
jne L(nequal)
Add optimized x86-64 wcscmp
2011-09-05 18:08:23 +00:00
ret
.p2align 4
L(next_two_double_words):
and $15, %dh
jz L(fourth_double_word)
mov 8(%rdi), %eax
Fix signedness in wcscmp comparison
2011-10-23 17:34:15 +00:00
cmp 8(%rsi), %eax
jne L(nequal)
Add optimized x86-64 wcscmp
2011-09-05 18:08:23 +00:00
ret
.p2align 4
L(fourth_double_word):
mov 12(%rdi), %eax
Fix signedness in wcscmp comparison
2011-10-23 17:34:15 +00:00
cmp 12(%rsi), %eax
jne L(nequal)
Add optimized x86-64 wcscmp
2011-09-05 18:08:23 +00:00
ret
.p2align 4
L(less4_double_words_16):
Fix signedness in wcscmp comparison
2011-10-23 17:34:15 +00:00
xor %eax, %eax
Add optimized x86-64 wcscmp
2011-09-05 18:08:23 +00:00
test %dl, %dl
jz L(next_two_double_words_16)
and $15, %dl
jz L(second_double_word_16)
mov 16(%rdi), %eax
Fix signedness in wcscmp comparison
2011-10-23 17:34:15 +00:00
cmp 16(%rsi), %eax
jne L(nequal)
Add optimized x86-64 wcscmp
2011-09-05 18:08:23 +00:00
ret
.p2align 4
L(second_double_word_16):
mov 20(%rdi), %eax
Fix signedness in wcscmp comparison
2011-10-23 17:34:15 +00:00
cmp 20(%rsi), %eax
jne L(nequal)
Add optimized x86-64 wcscmp
2011-09-05 18:08:23 +00:00
ret
.p2align 4
L(next_two_double_words_16):
and $15, %dh
jz L(fourth_double_word_16)
mov 24(%rdi), %eax
Fix signedness in wcscmp comparison
2011-10-23 17:34:15 +00:00
cmp 24(%rsi), %eax
jne L(nequal)
Add optimized x86-64 wcscmp
2011-09-05 18:08:23 +00:00
ret
.p2align 4
L(fourth_double_word_16):
mov 28(%rdi), %eax
Fix signedness in wcscmp comparison
2011-10-23 17:34:15 +00:00
cmp 28(%rsi), %eax
jne L(nequal)
Add optimized x86-64 wcscmp
2011-09-05 18:08:23 +00:00
ret
.p2align 4
L(less4_double_words_32):
Fix signedness in wcscmp comparison
2011-10-23 17:34:15 +00:00
xor %eax, %eax
Add optimized x86-64 wcscmp
2011-09-05 18:08:23 +00:00
test %dl, %dl
jz L(next_two_double_words_32)
and $15, %dl
jz L(second_double_word_32)
mov 32(%rdi), %eax
Fix signedness in wcscmp comparison
2011-10-23 17:34:15 +00:00
cmp 32(%rsi), %eax
jne L(nequal)
Add optimized x86-64 wcscmp
2011-09-05 18:08:23 +00:00
ret
.p2align 4
L(second_double_word_32):
mov 36(%rdi), %eax
Fix signedness in wcscmp comparison
2011-10-23 17:34:15 +00:00
cmp 36(%rsi), %eax
jne L(nequal)
Add optimized x86-64 wcscmp
2011-09-05 18:08:23 +00:00
ret
.p2align 4
L(next_two_double_words_32):
and $15, %dh
jz L(fourth_double_word_32)
mov 40(%rdi), %eax
Fix signedness in wcscmp comparison
2011-10-23 17:34:15 +00:00
cmp 40(%rsi), %eax
jne L(nequal)
Add optimized x86-64 wcscmp
2011-09-05 18:08:23 +00:00
ret
.p2align 4
L(fourth_double_word_32):
mov 44(%rdi), %eax
Fix signedness in wcscmp comparison
2011-10-23 17:34:15 +00:00
cmp 44(%rsi), %eax
jne L(nequal)
Add optimized x86-64 wcscmp
2011-09-05 18:08:23 +00:00
ret
.p2align 4
L(less4_double_words_48):
Fix signedness in wcscmp comparison
2011-10-23 17:34:15 +00:00
xor %eax, %eax
Add optimized x86-64 wcscmp
2011-09-05 18:08:23 +00:00
test %dl, %dl
jz L(next_two_double_words_48)
and $15, %dl
jz L(second_double_word_48)
mov 48(%rdi), %eax
Fix signedness in wcscmp comparison
2011-10-23 17:34:15 +00:00
cmp 48(%rsi), %eax
jne L(nequal)
Add optimized x86-64 wcscmp
2011-09-05 18:08:23 +00:00
ret
.p2align 4
L(second_double_word_48):
mov 52(%rdi), %eax
Fix signedness in wcscmp comparison
2011-10-23 17:34:15 +00:00
cmp 52(%rsi), %eax
jne L(nequal)
Add optimized x86-64 wcscmp
2011-09-05 18:08:23 +00:00
ret
.p2align 4
L(next_two_double_words_48):
and $15, %dh
jz L(fourth_double_word_48)
mov 56(%rdi), %eax
Fix signedness in wcscmp comparison
2011-10-23 17:34:15 +00:00
cmp 56(%rsi), %eax
jne L(nequal)
Add optimized x86-64 wcscmp
2011-09-05 18:08:23 +00:00
ret
.p2align 4
L(fourth_double_word_48):
mov 60(%rdi), %eax
Fix signedness in wcscmp comparison
2011-10-23 17:34:15 +00:00
cmp 60(%rsi), %eax
jne L(nequal)
Add optimized x86-64 wcscmp
2011-09-05 18:08:23 +00:00
ret
.p2align 4
L(nequal):
mov $1, %eax
Fix signedness in wcscmp comparison
2011-10-23 17:34:15 +00:00
jg L(nequal_bigger)
Add optimized x86-64 wcscmp
2011-09-05 18:08:23 +00:00
neg %eax
L(nequal_bigger):
ret
.p2align 4
L(equal):
xor %rax, %rax
ret
Fix regcomp wcscoll, wcscmp namespace (bug 18497). regcomp brings in references to wcscoll, which isn't in all the standards that contain regcomp. In turn, wcscoll brings in references to wcscmp, also not in all those standards. This patch fixes this by making those functions into weak aliases of __wcscoll and __wcscmp and calling those names instead as needed. Tested for x86_64 and x86 (testsuite, and that disassembly of installed shared libraries is unchanged by the patch). [BZ #18497] * wcsmbs/wcscmp.c [!WCSCMP] (WCSCMP): Define as __wcscmp instead of wcscmp. (wcscmp): Define as weak alias of WCSCMP. * wcsmbs/wcscoll.c (STRCOLL): Define as __wcscoll instead of wcscoll. (USE_HIDDEN_DEF): Define. [!USE_IN_EXTENDED_LOCALE_MODEL] (wcscoll): Define as weak alias of __wcscoll. Don't use libc_hidden_weak. * wcsmbs/wcscoll_l.c (STRCMP): Define as __wcscmp instead of wcscmp. * sysdeps/i386/i686/multiarch/wcscmp-c.c [SHARED] (libc_hidden_def): Define __GI___wcscmp instead of __GI_wcscmp. (weak_alias): Undefine and redefine. * sysdeps/i386/i686/multiarch/wcscmp.S (wcscmp): Rename to __wcscmp and define as weak alias of __wcscmp. * sysdeps/x86_64/wcscmp.S (wcscmp): Likewise. * include/wchar.h (__wcscmp): Declare. Use libc_hidden_proto. (__wcscoll): Likewise. (wcscmp): Don't use libc_hidden_proto. (wcscoll): Likewise. * posix/regcomp.c (build_range_exp): Call __wcscoll instead of wcscoll. * posix/regexec.c (check_node_accept_bytes): Likewise. * conform/Makefile (test-xfail-XPG3/regex.h/linknamespace): Remove variable. (test-xfail-XPG4/regex.h/linknamespace): Likewise. (test-xfail-POSIX/regex.h/linknamespace): Likewise.
2015-06-09 21:07:30 +00:00
END (__wcscmp)
x86-64: Optimize strcmp/wcscmp and strncmp/wcsncmp with AVX2 Optimize x86-64 strcmp/wcscmp and strncmp/wcsncmp with AVX2. It uses vector comparison as much as possible. Peak performance observed on a SkyLake machine: 9x, 3x, 2.5x and 5.5x for strcmp, strncmp, wcscmp and wcsncmp, respectively. The larger the comparison length, the more benefit using avx2 functions, except on the strcmp, where peak is observed at length == 32 bytes. Select AVX2 strcmp/wcscmp on AVX2 machines where vzeroupper is preferred and AVX unaligned load is fast. NB: It uses TZCNT instead of BSF since TZCNT produces the same result as BSF for non-zero input. TZCNT is faster than BSF and is executed as BSF if machine doesn't support TZCNT. * sysdeps/x86_64/multiarch/Makefile (sysdep_routines): Add strcmp-avx2, strncmp-avx2, wcscmp-avx2, wcscmp-sse2, wcsncmp-avx2 and wcsncmp-sse2. * sysdeps/x86_64/multiarch/ifunc-impl-list.c (__libc_ifunc_impl_list): Add tests for __strcmp_avx2, __strncmp_avx2, __wcscmp_avx2, __wcsncmp_avx2, __wcscmp_sse2 and __wcsncmp_sse2. * sysdeps/x86_64/multiarch/strcmp.c (OPTIMIZE (avx2)): (IFUNC_SELECTOR): Return OPTIMIZE (avx2) on AVX 2 machines if AVX unaligned load is fast and vzeroupper is preferred. * sysdeps/x86_64/multiarch/strncmp.c: Likewise. * sysdeps/x86_64/multiarch/strcmp-avx2.S: New file. * sysdeps/x86_64/multiarch/strncmp-avx2.S: Likewise. * sysdeps/x86_64/multiarch/wcscmp-avx2.S: Likewise. * sysdeps/x86_64/multiarch/wcscmp-sse2.S: Likewise. * sysdeps/x86_64/multiarch/wcscmp.c: Likewise. * sysdeps/x86_64/multiarch/wcsncmp-avx2.S: Likewise. * sysdeps/x86_64/multiarch/wcsncmp-sse2.c: Likewise. * sysdeps/x86_64/multiarch/wcsncmp.c: Likewise. * sysdeps/x86_64/wcscmp.S (__wcscmp): Add alias only if __wcscmp is undefined.
2018-05-03 16:09:30 +00:00
#ifndef __wcscmp
Fix regcomp wcscoll, wcscmp namespace (bug 18497). regcomp brings in references to wcscoll, which isn't in all the standards that contain regcomp. In turn, wcscoll brings in references to wcscmp, also not in all those standards. This patch fixes this by making those functions into weak aliases of __wcscoll and __wcscmp and calling those names instead as needed. Tested for x86_64 and x86 (testsuite, and that disassembly of installed shared libraries is unchanged by the patch). [BZ #18497] * wcsmbs/wcscmp.c [!WCSCMP] (WCSCMP): Define as __wcscmp instead of wcscmp. (wcscmp): Define as weak alias of WCSCMP. * wcsmbs/wcscoll.c (STRCOLL): Define as __wcscoll instead of wcscoll. (USE_HIDDEN_DEF): Define. [!USE_IN_EXTENDED_LOCALE_MODEL] (wcscoll): Define as weak alias of __wcscoll. Don't use libc_hidden_weak. * wcsmbs/wcscoll_l.c (STRCMP): Define as __wcscmp instead of wcscmp. * sysdeps/i386/i686/multiarch/wcscmp-c.c [SHARED] (libc_hidden_def): Define __GI___wcscmp instead of __GI_wcscmp. (weak_alias): Undefine and redefine. * sysdeps/i386/i686/multiarch/wcscmp.S (wcscmp): Rename to __wcscmp and define as weak alias of __wcscmp. * sysdeps/x86_64/wcscmp.S (wcscmp): Likewise. * include/wchar.h (__wcscmp): Declare. Use libc_hidden_proto. (__wcscoll): Likewise. (wcscmp): Don't use libc_hidden_proto. (wcscoll): Likewise. * posix/regcomp.c (build_range_exp): Call __wcscoll instead of wcscoll. * posix/regexec.c (check_node_accept_bytes): Likewise. * conform/Makefile (test-xfail-XPG3/regex.h/linknamespace): Remove variable. (test-xfail-XPG4/regex.h/linknamespace): Likewise. (test-xfail-POSIX/regex.h/linknamespace): Likewise.
2015-06-09 21:07:30 +00:00
libc_hidden_def (__wcscmp)
weak_alias (__wcscmp, wcscmp)
x86-64: Optimize strcmp/wcscmp and strncmp/wcsncmp with AVX2 Optimize x86-64 strcmp/wcscmp and strncmp/wcsncmp with AVX2. It uses vector comparison as much as possible. Peak performance observed on a SkyLake machine: 9x, 3x, 2.5x and 5.5x for strcmp, strncmp, wcscmp and wcsncmp, respectively. The larger the comparison length, the more benefit using avx2 functions, except on the strcmp, where peak is observed at length == 32 bytes. Select AVX2 strcmp/wcscmp on AVX2 machines where vzeroupper is preferred and AVX unaligned load is fast. NB: It uses TZCNT instead of BSF since TZCNT produces the same result as BSF for non-zero input. TZCNT is faster than BSF and is executed as BSF if machine doesn't support TZCNT. * sysdeps/x86_64/multiarch/Makefile (sysdep_routines): Add strcmp-avx2, strncmp-avx2, wcscmp-avx2, wcscmp-sse2, wcsncmp-avx2 and wcsncmp-sse2. * sysdeps/x86_64/multiarch/ifunc-impl-list.c (__libc_ifunc_impl_list): Add tests for __strcmp_avx2, __strncmp_avx2, __wcscmp_avx2, __wcsncmp_avx2, __wcscmp_sse2 and __wcsncmp_sse2. * sysdeps/x86_64/multiarch/strcmp.c (OPTIMIZE (avx2)): (IFUNC_SELECTOR): Return OPTIMIZE (avx2) on AVX 2 machines if AVX unaligned load is fast and vzeroupper is preferred. * sysdeps/x86_64/multiarch/strncmp.c: Likewise. * sysdeps/x86_64/multiarch/strcmp-avx2.S: New file. * sysdeps/x86_64/multiarch/strncmp-avx2.S: Likewise. * sysdeps/x86_64/multiarch/wcscmp-avx2.S: Likewise. * sysdeps/x86_64/multiarch/wcscmp-sse2.S: Likewise. * sysdeps/x86_64/multiarch/wcscmp.c: Likewise. * sysdeps/x86_64/multiarch/wcsncmp-avx2.S: Likewise. * sysdeps/x86_64/multiarch/wcsncmp-sse2.c: Likewise. * sysdeps/x86_64/multiarch/wcsncmp.c: Likewise. * sysdeps/x86_64/wcscmp.S (__wcscmp): Add alias only if __wcscmp is undefined.
2018-05-03 16:09:30 +00:00
#endif
Reference in New Issue Copy Permalink