glibc/sysdeps/x86_64/multiarch/memset-avx2-unaligned-erms-rtm.S

#define ZERO_UPPER_VEC_REGISTERS_RETURN \
  ZERO_UPPER_VEC_REGISTERS_RETURN_XTEST

#define VZEROUPPER_RETURN jmp	 L(return)

#define SECTION(p) p##.avx.rtm
#define MEMSET_SYMBOL(p,s)	p##_avx2_##s##_rtm
#define BZERO_SYMBOL(p,s)	p##_avx2_##s##_rtm
#define WMEMSET_SYMBOL(p,s)	p##_avx2_##s##_rtm

#include "memset-avx2-unaligned-erms.S"
x86-64: Add AVX optimized string/memory functions for RTM Since VZEROUPPER triggers RTM abort while VZEROALL won't, select AVX optimized string/memory functions with xtest jz 1f vzeroall ret 1: vzeroupper ret at function exit on processors with usable RTM, but without 256-bit EVEX instructions to avoid VZEROUPPER inside a transactionally executing RTM region. 2021-03-05 15:26:42 +00:00			`#define ZERO_UPPER_VEC_REGISTERS_RETURN \`
			`ZERO_UPPER_VEC_REGISTERS_RETURN_XTEST`

			`#define VZEROUPPER_RETURN jmp L(return)`

			`#define SECTION(p) p##.avx.rtm`
			`#define MEMSET_SYMBOL(p,s) p##_avx2_##s##_rtm`
x86-64: Optimize bzero memset with zero as the value to set is by far the majority value (99%+ for Python3 and GCC). bzero can be slightly more optimized for this case by using a zero-idiom xor for broadcasting the set value to a register (vector or GPR). Co-developed-by: Noah Goldstein <goldstein.w.n@gmail.com> 2022-02-07 13:55:15 +00:00			`#define BZERO_SYMBOL(p,s) p##_avx2_##s##_rtm`
x86-64: Add AVX optimized string/memory functions for RTM Since VZEROUPPER triggers RTM abort while VZEROALL won't, select AVX optimized string/memory functions with xtest jz 1f vzeroall ret 1: vzeroupper ret at function exit on processors with usable RTM, but without 256-bit EVEX instructions to avoid VZEROUPPER inside a transactionally executing RTM region. 2021-03-05 15:26:42 +00:00			`#define WMEMSET_SYMBOL(p,s) p##_avx2_##s##_rtm`

			`#include "memset-avx2-unaligned-erms.S"`