glibc/sysdeps/unix/sysv/linux/alpha/clone.S

137 lines
3.2 KiB
ArmAsm
Raw Normal View History

/* Copyright (C) 1996-2016 Free Software Foundation, Inc.
1996-11-20 03:45:46 +00:00
This file is part of the GNU C Library.
Contributed by Richard Henderson <rth@tamu.edu>, 1996.
1996-08-10 00:47:07 +00:00
1996-11-20 03:45:46 +00:00
The GNU C Library is free software; you can redistribute it and/or
2001-07-06 04:56:23 +00:00
modify it under the terms of the GNU Lesser General Public
License as published by the Free Software Foundation; either
version 2.1 of the License, or (at your option) any later version.
1996-08-10 00:47:07 +00:00
1996-11-20 03:45:46 +00:00
The GNU C Library is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU
2001-07-06 04:56:23 +00:00
Lesser General Public License for more details.
1996-08-10 00:47:07 +00:00
2001-07-06 04:56:23 +00:00
You should have received a copy of the GNU Lesser General Public
2012-03-09 23:56:38 +00:00
License along with the GNU C Library. If not, see
<http://www.gnu.org/licenses/>. */
1996-08-10 00:47:07 +00:00
/* clone() is even more special than fork() as it mucks with stacks
and invokes a function in the right context after its all over. */
#include <sysdep.h>
1996-10-08 23:39:13 +00:00
#define _ERRNO_H 1
1997-06-21 01:37:20 +00:00
#include <bits/errno.h>
1996-08-10 00:47:07 +00:00
#define CLONE_VM 0x00000100
/* int clone(int (*fn)(void *arg), void *child_stack, int flags,
void *arg, pid_t *ptid, void *tls, pid_t *ctid);
Note that everything past ARG is technically optional, based
on FLAGS, and that CTID is arg 7, and thus is on the stack.
However, since a load from top-of-stack better be legal always,
we don't bother checking FLAGS. */
1996-08-10 00:47:07 +00:00
.text
.align 4
.globl __clone
.ent __clone
.usepv __clone, USEPV_PROF
cfi_startproc
__clone:
1996-11-07 01:34:35 +00:00
#ifdef PROF
ldgp gp,0(pv)
1996-11-07 01:34:35 +00:00
lda AT, _mcount
jsr AT, (AT), _mcount
#endif
1996-08-10 00:47:07 +00:00
/* Sanity check arguments. */
ldiq v0, EINVAL
beq a0, SYSCALL_ERROR_LABEL /* no NULL function pointers */
beq a1, SYSCALL_ERROR_LABEL /* no NULL stack pointers */
1996-08-10 00:47:07 +00:00
/* Save the fn ptr and arg on the new stack. */
subq a1, 32, a1
stq a0, 0(a1)
stq a3, 8(a1)
stq a2, 16(a1)
/* The syscall is of the form clone(flags, usp, ptid, ctid, tls).
Shift the flags, ptid, ctid, tls arguments into place; the
child_stack argument is already correct. */
mov a2, a0
mov a4, a2
ldq a3, 0(sp)
mov a5, a4
/* Do the system call. */
ldiq v0, __NR_clone
1996-08-10 00:47:07 +00:00
call_pal PAL_callsys
bne a3, SYSCALL_ERROR_LABEL
beq v0, thread_start
1996-08-10 00:47:07 +00:00
/* Successful return from the parent. */
1996-08-10 00:47:07 +00:00
ret
PSEUDO_END(__clone)
cfi_endproc
1996-08-10 00:47:07 +00:00
/* Load up the arguments to the function. Put this block of code in
its own function so that we can terminate the stack trace with our
1997-01-20 02:49:42 +00:00
debug info. */
1996-08-10 00:47:07 +00:00
2014-05-21 21:36:45 +00:00
.align 4
1996-08-10 00:47:07 +00:00
.ent thread_start
cfi_startproc
1996-08-10 00:47:07 +00:00
thread_start:
mov 0, fp
cfi_def_cfa_register(fp)
cfi_undefined(ra)
1996-08-10 00:47:07 +00:00
/* Check and see if we need to reset the PID. */
ldq t0, 16(sp)
Fix clone (CLONE_VM) pid/tid reset (BZ#19957) As discussed in libc-alpha [1] current clone with CLONE_VM (without CLONE_THREAD set) will reset the pthread pid/tid fields to -1. The issue is since memory is shared between the parent and child it will clobber parent's cached pid/tid leading to internal inconsistencies if the value is not restored. And even it is restored it may lead to racy conditions when between set/restore a thread might invoke pthread function that validate the pthread with INVALID_TD_P/INVALID_NOT_TERMINATED_TD_P and thus get wrong results. As stated in BZ19957, previously reports of this behaviour was close with EWONTFIX due the fact usage of clone outside glibc is tricky since glibc requires consistent internal pthread, while using clone directly may not provide it. However since now posix_spawn uses clone (CLONE_VM) to fixes various issues related to previous vfork usage this issue requires fixing. The vfork implementation also does something similar, but instead it negates and restores only the *pid* field and functions that might access its value know to handle such case (getpid, raise and pthread ones that uses INVALID_TD_P/INVALID_NOT_TERMINATED_TD_P macros that check only *tid* field). Also vfork does not call __clone directly, instead calling either __NR_vfork or __NR_clone directly. So this patch removes this clone behavior by avoiding setting the pthread pid/tid field for CLONE_VM. There is no need to check for CLONE_THREAD, since the minimum supported kernel in all architecture implies that CLONE_VM must be used with CLONE_THREAD, otherwise clone returns EINVAL. Instead of current approach of: int clone(int (*fn)(void *), void *child_stack, int flags, ...) [...] if (flags & CLONE_THREAD) goto do_syscall; pid_t new_value; if (flags & CLONE_VM) new_value = -1; else new_value = getpid (); THREAD_SETMEM (THREAD_SELF, pid, new_value); THREAD_SETMEM (THREAD_SELF, tid, new_value); do_syscall: [...] The new approach uses: int clone(int (*fn)(void *), void *child_stack, int flags, ...) [...] if (flags & CLONE_VM) goto do_syscall; pid_t new_value = getpid (); THREAD_SETMEM (THREAD_SELF, pid, new_value); THREAD_SETMEM (THREAD_SELF, tid, new_value); do_syscall: [...] It also removes the linux tst-getpid2.c test which expects the previous behavior and instead add another clone test. Tested on x86_64, i686, x32, powerpc64le, aarch64, armhf, s390, and s390x. I also did limited check on mips32 and sparc64 (using the new added test). I also got reviews from both m68k, hppa, and tile. So I presume for these architecture the patch works. The fixes for alpha, microblaze, sh, ia64, and nio2 have not been tested. [1] https://sourceware.org/ml/libc-alpha/2016-04/msg00307.html * sysdeps/unix/sysv/linux/Makefile [$(subdir) == nptl] (test): Remove tst-getpid2. (test): Add tst-clone2. * sysdeps/unix/sysv/linux/tst-clone2.c: New file. * sysdeps/unix/sysv/linux/aarch64/clone.S (__clone): Do not change pid/tid fields for CLONE_VM. * sysdeps/unix/sysv/linux/arm/clone.S: Likewise. * sysdeps/unix/sysv/linux/i386/clone.S: Likewise. * sysdeps/unix/sysv/linux/mips/clone.S: Likewise. * sysdeps/unix/sysv/linux/powerpc/powerpc32/clone.S: Likewise. * sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S: Likewise. * sysdeps/unix/sysv/linux/s390/s390-32/clone.S: Likewise. * sysdeps/unix/sysv/linux/s390/s390-64/clone.S: Likewise. * sysdeps/unix/sysv/linux/sparc/sparc32/clone.S: Likewise. * sysdeps/unix/sysv/linux/sparc/sparc64/clone.S: Likewise. * sysdeps/unix/sysv/linux/x86_64/clone.S: Likewise. * sysdeps/unix/sysv/linux/tst-getpid2.c: Remove file.
2016-04-15 19:42:38 +00:00
lda t1, CLONE_VM
and t0, t1, t2
beq t2, 2f
1:
/* Load up the arguments. */
ldq pv, 0(sp)
ldq a0, 8(sp)
addq sp, 32, sp
/* Call the user's function. */
jsr ra, (pv)
ldgp gp, 0(ra)
1996-08-10 00:47:07 +00:00
/* Call _exit rather than doing it inline for breakpoint purposes. */
mov v0, a0
#ifdef PIC
bsr ra, HIDDEN_JUMPTARGET(_exit) !samegp
#else
jsr ra, HIDDEN_JUMPTARGET(_exit)
#endif
1996-08-10 00:47:07 +00:00
1997-01-20 02:49:42 +00:00
/* Die horribly. */
2014-05-21 21:36:45 +00:00
.align 4
1997-01-20 02:49:42 +00:00
halt
2014-05-21 21:36:45 +00:00
.align 4
2:
rduniq
mov v0, s0
lda v0, __NR_getxpid
callsys
3:
stl v0, PID_OFFSET(s0)
stl v0, TID_OFFSET(s0)
br 1b
cfi_endproc
1996-08-10 00:47:07 +00:00
.end thread_start
posix: New Linux posix_spawn{p} implementation This patch implements a new posix_spawn{p} implementation for Linux. The main difference is it uses the clone syscall directly with CLONE_VM and CLONE_VFORK flags and a direct allocated stack. The new stack and start function solves most the vfork limitation (possible parent clobber due stack spilling). The remaning issue are related to signal handling: 1. That no signal handlers must run in child context, to avoid corrupt parent's state. 2. Child must synchronize with parent to enforce stack deallocation and to possible return execv issues. The first one is solved by blocking all signals in child, even NPTL-internal ones (SIGCANCEL and SIGSETXID). The second issue is done by a stack allocation in parent and a synchronization with using a pipe or waitpid (in case or error). The pipe has the advantage of allowing the child signal an exec error (checked with new tst-spawn2 test). There is an inherent race condition in pipe2 usage for architectures that do not support the syscall directly. In such cases the a pipe plus fctnl is used instead and it may lead to file descriptor leak in parent (as decribed by fcntl documentation). The child process stack is allocate with a mmap with MAP_STACK flag using default architecture stack size. Although it is slower than use a stack buffer from parent, it allows some slack for the compatibility code to run scripts with no shebang (which may use a buffer with size depending of argument list count). Performance should be similar to the vfork default posix implementation and way faster than fork path (vfork on mostly linux ports are basically clone with CLONE_VM plus CLONE_VFORK). The only difference is the syscalls required for the stack allocation/deallocation. It fixes BZ#10354, BZ#14750, and BZ#18433. Tested on i386, x86_64, powerpc64le, and aarch64. [BZ #14750] [BZ #10354] [BZ #18433] * include/sched.h (__clone): Add hidden prototype. (__clone2): Likewise. * include/unistd.h (__dup): Likewise. * posix/Makefile (tests): Add tst-spawn2. * posix/tst-spawn2.c: New file. * sysdeps/posix/dup.c (__dup): Add hidden definition. * sysdeps/unix/sysv/linux/aarch64/clone.S (__clone): Likewise. * sysdeps/unix/sysv/linux/alpha/clone.S (__clone): Likewise. * sysdeps/unix/sysv/linux/arm/clone.S (__clone): Likewise. * sysdeps/unix/sysv/linux/hppa/clone.S (__clone): Likewise. * sysdeps/unix/sysv/linux/i386/clone.S (__clone): Likewise. * sysdeps/unix/sysv/linux/ia64/clone2.S (__clone): Likewise. * sysdeps/unix/sysv/linux/m68k/clone.S (__clone): Likewise. * sysdeps/unix/sysv/linux/microblaze/clone.S (__clone): Likewise. * sysdeps/unix/sysv/linux/mips/clone.S (__clone): Likewise. * sysdeps/unix/sysv/linux/nios2/clone.S (__clone): Likewise. * sysdeps/unix/sysv/linux/powerpc/powerpc32/clone.S (__clone): Likewise. * sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S (__clone): Likewise. * sysdeps/unix/sysv/linux/s390/s390-32/clone.S (__clone): Likewise. * sysdeps/unix/sysv/linux/s390/s390-64/clone.S (__clone): Likewise. * sysdeps/unix/sysv/linux/sh/clone.S (__clone): Likewise. * sysdeps/unix/sysv/linux/sparc/sparc32/clone.S (__clone): Likewise. * sysdeps/unix/sysv/linux/sparc/sparc64/clone.S (__clone): Likewise. * sysdeps/unix/sysv/linux/tile/clone.S (__clone): Likewise. * sysdeps/unix/sysv/linux/x86_64/clone.S (__clone): Likewise. * sysdeps/unix/sysv/linux/nptl-signals.h (____nptl_is_internal_signal): New function. * sysdeps/unix/sysv/linux/spawni.c: New file.
2016-01-19 19:33:32 +00:00
libc_hidden_def (__clone)
2005-05-26 14:30:48 +00:00
weak_alias (__clone, clone)