AuroraMiddleware/glibc
1
0
Fork 0
mirror of https://sourceware.org/git/glibc.git synced 2024-11-09 14:50:05 +00:00
Code Issues Packages Projects Releases Wiki Activity

Linux: Use rseq in sched_getcpu if available

Browse Source 
When available, use the cpu_id field from __rseq_abi on Linux to
implement sched_getcpu().  Fall-back on the vgetcpu vDSO if unavailable.

Benchmarks:

x86-64: Intel E5-2630 v3@2.40GHz, 16-core, hyperthreading

glibc sched_getcpu():                     13.7 ns (baseline)
glibc sched_getcpu() using rseq:           2.5 ns (speedup:  5.5x)
inline load cpuid from __rseq_abi TLS:     0.8 ns (speedup: 17.1x)
This commit is contained in:
Mathieu Desnoyers 2020-07-06 10:21:31 +02:00 committed by Florian Weimer
parent 0c76fc3c2b
commit 6e29cb3f61
1 changed files with 20 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

22
sysdeps/unix/sysv/linux/sched_getcpu.c
View File

@ -18,10 +18,12 @@
#include <errno.h>
#include <sched.h>
#include <sysdep.h>
#include <atomic.h>
#include <sysdep-vdso.h>
#include <sys/rseq.h>
int
sched_getcpu (void)
static int
vsyscall_sched_getcpu (void)
{
unsigned int cpu;
int r = -1;
@ -32,3 +34,19 @@ sched_getcpu (void)
#endif
return r == -1 ? r : cpu;
}
#ifdef RSEQ_SIG
int
sched_getcpu (void)
{
int cpu_id = atomic_load_relaxed (&__rseq_abi.cpu_id);
return cpu_id >= 0 ? cpu_id : vsyscall_sched_getcpu ();
}
#else /* RSEQ_SIG */
int
sched_getcpu (void)
{
return vsyscall_sched_getcpu ();
}
#endif /* RSEQ_SIG */