GENERIC HEAD from 2019-07-09 07:24:18 UTC, r349856M, vmcore.1142 GDB: no debug ports present KDB: debugger backends: ddb KDB: current backend: ddb ---<>--- Copyright (c) 1992-2019 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 13.0-CURRENT #0 r349856M: Tue Jul 9 10:23:25 CEST 2019 pho@x4.osted.lan:/usr/src/sys/i386/compile/PHO i386 FreeBSD clang version 8.0.1 (branches/release_80 363030) (based on LLVM 8.0.1) WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. Entering uma_startup with 9 boot pages configured startup_alloc from "UMA Kegs", 8 boot pages left startup_alloc from "UMA Zones", 7 boot pages left startup_alloc from "UMA Hash", 6 boot pages left startup_alloc from "vmem btag", 5 boot pages left startup_alloc from "UMA Zones", 4 boot pages left startup_alloc from "MAP", 3 boot pages left startup_alloc from "KMAP ENTRY", 2 boot pages left startup_alloc from "vmem", 1 boot pages left Entering uma_startup2 with 0 boot pages left VT(vga): resolution 640x480 CPU: AMD Phenom(tm) 9150e Quad-Core Processor (1800.02-MHz 686-class CPU) Origin="AuthenticAMD" Id=0x100f23 Family=0x10 Model=0x2 Stepping=3 Features=0x178bfbff Features2=0x802009 AMD Features=0xee500800 AMD Features2=0x7ff SVM: NP,NAsids=64 TSC: P-state invariant real memory = 8589934592 (8192 MB) avail memory = 8261382144 (7878 MB) : Trying to mount root from ufs:/dev/ada0s1a [rw]... WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. uhub5: on usbus2 uhub1: 2 ports with 2 removable, self powered uhub2: 2 ports with 2 removable, self powered uhub3: 2 ports with 2 removable, self powered uhub4: 2 ports with 2 removable, self powered uhub5: 2 ports with 2 removable, self powered Setting hostuuid: 00000000-0000-0000-0000-00218515337d. Setting hostid: 0x6b64ac17. warning: total configured swap (4194304 pages) exceeds maximum recommended amount (2009920 pages). warning: increase kern.maxswzone or reduce amount of swap. Starting file system checks: /dev/ada0s1a: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ada0s1a: clean, 605281 free (2625 frags, 75332 blocks, 0.3% fragmentation) /dev/ada0s1f: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ada0s1f: clean, 762236 free (10908 frags, 93916 blocks, 1.1% fragmentation) /dev/label/tmp: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/label/tmp: clean, 28206576 free (36456 frags, 3521265 blocks, 0.0% fragmentation) /dev/ada0s1d: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ada0s1d: clean, 1282487 free (298071 frags, 123052 blocks, 2.9% fragmentation) /dev/ada0s1e: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ada0s1e: clean, 2453399 free (159951 frags, 286681 blocks, 0.6% fragmentation) Mounting local filesystems:. ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat/pkg /usr/local/arduino/lib /usr/local/lib/compat /usr/local/lib/compat/pkg /usr/local/lib/e2fsprogs /usr/local/lib/gcc7 /usr/local/lib/gcc8 /usr/local/lib/mysql /usr/local/lib/nss /usr/local/lib/perl5/5.28/mach/CORE /usr/local/lib/pth /usr/local/lib/qt4 /usr/local/lib/qt5 /usr/local/llvm37/lib /usr/local/llvm39/lib a.out ldconfig path: /usr/lib/aout /usr/lib/compat/aout Setting hostname: x4.osted.lan. Setting up harvesting: [UMA],[FS_ATIME],SWI,INTERRUPT,NET_NG,[NET_ETHER],NET_TUN,MOUSE,KEYBOARD,ATTACH,CACHED Feeding entropy: uhub0: 10 ports with 10 removable, self powered . lo0: link state changed to UP re0: link state changed to DOWN Starting Network: lo0 re0. lo0: flags=8049 metric 0 mtu 16384 options=680003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x2 inet 127.0.0.1 netmask 0xff000000 groups: lo nd6 options=21 re0: flags=8843 metric 0 mtu 1500 options=8209b ether 00:21:85:15:33:7d inet 192.168.1.101 netmask 0xffffff00 broadcast 192.168.1.255 media: Ethernet autoselect (none) status: no carrier nd6 options=29 Starting devd. re0: link state changed to UP add host 127.0.0.1: gateway lo0 fib 0: route already in table add net default: gateway 192.168.1.1 add host ::1: gateway lo0 fib 0: route already in table add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Creating and/or trimming log files. Starting syslogd. Starting rpcbind. NFS access cache time=60 Starting watchdogd. No core dumps found. lock order reversal: 1st 0x11c65838 bufwait (bufwait) @ kern/vfs_bio.c:3904 2nd 0x23f0b800 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:289 stack backtrace: #0 0x102ebd1 at witness_debugger+0x61 #1 0x102e9a9 at witness_checkorder+0x8a9 #2 0xfd6d2d at _sx_xlock+0x4d #3 0x12a26b5 at ufsdirhash_add+0x45 #4 0x12a4f2e at ufs_direnter+0x3fe #5 0x12ac9dc at ufs_mkdir+0x78c #6 0x1560eed at VOP_MKDIR_APV+0x6d #7 0x1099a63 at kern_mkdirat+0x173 #8 0x10998e9 at sys_mkdir+0x19 #9 0x1530869 at syscall+0x2d9 #10 0xffc033b7 at _end+0xfdc500bf Clearing /tmp (X related). Starting nfsuserd. Starting mountd. Starting nfsd. Starting statd. Starting lockd. Recovering vi editor sessions:. Updating motd:. Mounting late filesystems:. Starting ntpd. Starting powerd. Starting smartd. Jul 9 10:40:45 x4 smartd[632]: Device: /dev/ada0, WARNING: A firmware update for this drive may be available, Jul 9 10:40:45 x4 smartd[632]: see the following Seagate web pages: Jul 9 10:40:45 x4 smartd[632]: http://knowledge.seagate.com/articles/en_US/FAQ/207931en Jul 9 10:40:45 x4 smartd[632]: http://knowledge.seagate.com/articles/en_US/FAQ/213891en Configuring vt: keymap blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting sendmail_submit. Starting sendmail_msp_queue. Starting cron. Local package initialization: backup. Starting nfscbd. Starting default mousedmoused: unable to open /dev/psm0: No such file or directory . Starting inetd. Tue Jul 9 10:40 FreeBSD/i386 (x4.osted.lan) (ttyu0) login: Jul 9 10:41:00 x4 su[816]: pho to root on /dev/pts/0 20190709 10:41:27 all (1/101): churn.sh pts leak: 1/2 20190709 10:51:38 all (2/101): context2.sh 20190709 10:56:42 all (3/101): datamove3.sh freework leak: 45/65. 20190709 10:56:46 all (4/101): db.sh newblk leak: 601/634. 20190709 10:59:50 all (5/101): devfd.sh lock order reversal: 1st 0x2d24be6c ufs (ufs) @ kern/vfs_syscalls.c:3440 2nd 0x11c44d2c bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:283 3rd 0x316a330c ufs (ufs) @ kern/vfs_subr.c:2687 stack backtrace: #0 0x102ebd1 at witness_debugger+0x61 #1 0x102e9a9 at witness_checkorder+0x8a9 #2 0xfa6288 at lockmgr_xlock_hard+0x48 #3 0xfa69f6 at __lockmgr_args+0x376 #4 0x129d0ff at ffs_lock+0x6f #5 0x1561898 at VOP_LOCK1_APV+0x58 #6 0x109ce28 at _vn_lock+0x58 #7 0x108bbdb at vget+0x7b #8 0x107f063 at vfs_hash_get+0xa3 #9 0x1298af7 at ffs_vgetf+0x27 #10 0x128ef91 at softdep_sync_buf+0x8d1 #11 0x129de21 at ffs_syncvnode+0x231 #12 0x129cfb8 at ffs_fsync+0x18 #13 0x1560959 at VOP_FSYNC_APV+0x69 #14 0x109938b at kern_fsync+0x16b #15 0x1099452 at sys_fsync+0x12 #16 0x1530869 at syscall+0x2d9 #17 0xffc033b7 at _end+0xfdc500bf lock order reversal: 1st 0x2d8c15e4 ufs (ufs) @ kern/vfs_mount.c:1354 2nd 0x31696d00 devfs (devfs) @ ufs/ffs/ffs_vfsops.c:1399 stack backtrace: #0 0x102ebd1 at witness_debugger+0x61 #1 0x102e9a9 at witness_checkorder+0x8a9 #2 0xfa5e65 at lockmgr_lock_fast_path+0x125 #3 0x107bd34 at vop_stdlock+0x24 #4 0x1561898 at VOP_LOCK1_APV+0x58 #5 0x109ce28 at _vn_lock+0x58 #6 0x12989c3 at ffs_flushfiles+0xb3 #7 0x127d9a1 at softdep_flushfiles+0x61 #8 0x129af12 at ffs_unmount+0x72 #9 0x1084f35 at dounmount+0x415 #10 0x1084a2b at sys_unmount+0x26b #11 0x1530869 at syscall+0x2d9 #12 0xffc033b7 at _end+0xfdc500bf 20190709 11:00:07 all (6/101): devfs2.sh 20190709 11:00:11 all (7/101): execi386.sh 20190709 11:00:13 all (8/101): execve.sh 20190709 11:00:55 all (9/101): f_offset.sh 20190709 11:02:16 all (10/101): fdatasync.sh 20190709 11:05:24 all (11/101): fdatasync2.sh freework leak: 897/962. 20190709 11:08:39 all (12/101): fifo2.sh 20190709 11:10:44 all (13/101): fifo4.sh 20190709 11:12:49 all (14/101): flock_open_close.sh lock order reversal: 1st 0x11d5b8c0 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:283 2nd 0x243d371c snaplk (snaplk) @ ufs/ffs/ffs_snapshot.c:2327 stack backtrace: #0 0x102ebd1 at witness_debugger+0x61 #1 0x102e9a9 at witness_checkorder+0x8a9 #2 0xfa6288 at lockmgr_xlock_hard+0x48 #3 0xfa69f6 at __lockmgr_args+0x376 #4 0x127c76f at ffs_copyonwrite+0x19f #5 0x129c123 at ffs_geom_strategy+0x73 #6 0x12ace97 at ufs_strategy+0x87 #7 0x1561c48 at VOP_STRATEGY_APV+0x78 #8 0x106ad73 at bufstrategy+0x43 #9 0x106ac1a at bufwrite+0x1fa #10 0x129dea1 at ffs_syncvnode+0x2b1 #11 0x129cfb8 at ffs_fsync+0x18 #12 0x1560959 at VOP_FSYNC_APV+0x69 #13 0x12aadf7 at ufs_remove+0xc7 #14 0x1560abd at VOP_REMOVE_APV+0x8d #15 0x1096513 at kern_funlinkat+0x273 #16 0x109628f at sys_unlink+0x1f #17 0x1530869 at syscall+0x2d9 lock order reversal: 1st 0x243d371c snaplk (snaplk) @ ufs/ufs/ufs_vnops.c:918 2nd 0x31304b94 ufs (ufs) @ ufs/ffs/ffs_snapshot.c:1650 stack backtrace: #0 0x102ebd1 at witness_debugger+0x61 #1 0x102e9a9 at witness_checkorder+0x8a9 #2 0xfa6288 at lockmgr_xlock_hard+0x48 #3 0xfa69f6 at __lockmgr_args+0x376 #4 0x127abff at ffs_snapremove+0xcf #5 0x1274cd8 at ffs_truncate+0x488 #6 0x12a3804 at ufs_inactive+0x1d4 #7 0x1561619 at VOP_INACTIVE_APV+0x69 #8 0x108bfc3 at vinactive+0xe3 #9 0x108c58f at vputx+0x2ef #10 0x1096564 at kern_funlinkat+0x2c4 #11 0x109628f at sys_unlink+0x1f #12 0x1530869 at syscall+0x2d9 #13 0xffc033b7 at _end+0xfdc500bf 20190709 11:22:33 all (15/101): fork.sh 20190709 11:22:42 all (16/101): ftruncate.sh 20190709 11:25:49 all (17/101): ftruncate2.sh 20190709 11:28:54 all (18/101): indir_trunc.sh 20190709 11:28:57 all (19/101): kern_umtx_inf_loop.sh 20190709 11:29:01 all (20/101): kevent.sh 20190709 11:31:05 all (21/101): kevent2.sh 20190709 11:31:18 all (22/101): kevent3.sh 20190709 11:31:24 all (23/101): kevent4.sh newblk leak: 65/699. 20190709 11:33:35 all (24/101): kevent6.sh lock order reversal: 1st 0x24880028 filedesc structure (filedesc structure) @ kern/kern_descrip.c:1241 2nd 0x30c2b750 ufs (ufs) @ kern/vfs_subr.c:5140 stack backtrace: #0 0x102ebd1 at witness_debugger+0x61 #1 0x102e9a9 at witness_checkorder+0x8a9 #2 0xfa6288 at lockmgr_xlock_hard+0x48 #3 0xfa69f6 at __lockmgr_args+0x376 #4 0x129d0ff at ffs_lock+0x6f #5 0x1561898 at VOP_LOCK1_APV+0x58 #6 0x109ce28 at _vn_lock+0x58 #7 0x108de8a at vfs_knllock+0x1a #8 0xf89d5c at knlist_remove_kq+0x7c #9 0xf89cd3 at knlist_remove+0x13 #10 0x1092c20 at filt_vfsdetach+0x20 #11 0xf8a67f at knote_fdclose+0x13f #12 0xf7ec01 at closefp+0xe1 #13 0xf7f3cd at kern_close+0x12d #14 0xf7f290 at sys_close+0x10 #15 0x1530869 at syscall+0x2d9 #16 0xffc033b7 at _end+0xfdc500bf 20190709 11:34:50 all (25/101): kevent7.sh lock order reversal: (sleepable after non-sleepable) 1st 0x243d4b88 pfs_node (pfs_node) @ fs/pseudofs/pseudofs_internal.h:105 2nd 0x11a70650 pidhash (pidhash) @ kern/kern_proc.c:429 stack backtrace: #0 0x102ebd1 at witness_debugger+0x61 #1 0x102e9a9 at witness_checkorder+0x8a9 #2 0xfd7d69 at _sx_slock_int+0x49 #3 0xfb520c at pfind+0x5c #4 0xf1e3aa at pfs_readdir+0x13a #5 0x1561389 at VOP_READDIR_APV+0x69 #6 0x109a1e9 at kern_getdirentries+0x1c9 #7 0x109a425 at sys_getdirentries+0x25 #8 0x1530869 at syscall+0x2d9 #9 0xffc033b7 at _end+0xfdc500bf 20190709 11:40:00 all (26/101): kevent8.sh 20190709 11:40:37 all (27/101): kevent9.sh 20190709 11:45:43 all (28/101): kinfo3.sh pts leak: 1/3 20190709 12:05:53 all (29/101): machipc.sh 20190709 12:05:55 all (30/101): machipc2.sh 20190709 12:05:58 all (31/101): mlockall3.sh 20190709 12:09:02 all (32/101): mlockall5.sh 20190709 12:09:05 all (33/101): mlockall7.sh 20190709 12:12:11 all (34/101): mmap10.sh 20190709 12:17:24 all (35/101): mmap11.sh Jul 9 12:17:38 x4 kernel: Failed to fully fault in a core file segment at VA 0x2041f000 with size 0x1000 to be written at offset 0x28000 for process mmap11 Jul 9 12:17:38 x4 kernel: Failed to fully fault in a core file segment at VA 0x20420000 with size 0x23000 to be written at offset 0x29000 for process mmap11 Jul 9 12:17:38 x4 kernel: Failed to fully fault in a core file segment at VA 0x2045f000 with size 0x1000 to be written at offset 0x4c000 for process mmap11 Jul 9 12:17:38 x4 kernel: Failed to fully fault in a core file segment at VA 0x20460000 with size 0x1000 to be written at offset 0x4d000 for process mmap11 Jul 9 12:17:38 x4 kernel: Failed to fully fault in a core file segment at VA 0x20461000 with size 0xa000 to be written at offset 0x4e000 for process mmap11 Jul 9 12:17:38 x4 kernel: Failed to fully fault in a core file segment at VA 0x205ea000 with size 0x4000 to be written at offset 0x58000 for process mmap11 Jul 9 12:17:38 x4 kernel: Failed to fully fault in a core file segment at VA 0x205ee000 with size 0x5000 to be written at offset 0x5c000 for process mmap11 Jul 9 12:17:38 x4 kernel: Failed to fully fault in a core file segment at VA 0x205f3000 with size 0x35000 to be written at offset 0x61000 for process mmap11 Jul 9 12:17:38 x4 kernel: Failed to fully fault in a core file segment at VA 0x20629000 with size 0x1000 to be written at offset 0x97000 for process mmap11 Jul 9 12:17:38 x4 kernel: Failed to fully fault in a core file segment at VA 0x2062a000 with size 0x12000 to be written at offset 0x98000 for process mmap11 Jul 9 12:17:38 x4 kernel: Failed to fully fault in a core file segment at VA 0x2063c000 with size 0x21000 to be written at offset 0xaa000 for process mmap11 Jul 9 12:17:38 x4 kernel: Failed to fully fault in a core file segment at VA 0x20800000 with size 0x200000 to be written at offset 0xcb000 for process mmap11 Jul 9 12:17:38 x4 kernel: Failed to fully fault in a core file segment at VA 0x20a00000 with size 0x155000 to be written at offset 0x2cb000 for process mmap11 Jul 9 12:17:38 x4 kernel: Failed to fully fault in a core file segment at VA 0x20b55000 with size 0xa000 to be written at offset 0x420000 for process mmap11 Jul 9 12:17:38 x4 kernel: Failed to fully fault in a core file segment at VA 0x20b5f000 with size 0x4a1000 to be written at offset 0x42a000 for process mmap11 Jul 9 12:17:38 x4 kernel: Failed to fully fault in a core file segment at VA 0x21000000 with size 0x200000 to be written at offset 0x8cb000 for process mmap11 Jul 9 12:18:04 x4 kernel: Failed to fully fault in a core file segment at VA 0x402000 with size 0x1000 to be written at offset 0x5000 for process mmap11 Jul 9 12:18:04 x4 kernel: Failed to fully fault in a core file segment at VA 0x403000 with size 0x1000 to be written at offset 0x6000 for process mmap11 Jul 9 12:18:04 x4 kernel: Failed to fully fault in a core file segment at VA 0x404000 with size 0x2000 to be written at offset 0x7000 for process mmap11 Jul 9 12:18:04 x4 kernel: Failed to fully fault in a core file segment at VA 0x406000 with size 0x1f000 to be written at offset 0x9000 for process mmap11 Jul 9 12:18:04 x4 kernel: Failed to fully fault in a core file segment at VA 0x2041f000 with size 0x1000 to be written at offset 0x28000 for process mmap11 Jul 9 12:18:04 x4 kernel: Failed to fully fault in a core file segment at VA 0x20420000 with size 0x23000 to be written at offset 0x29000 for process mmap11 Jul 9 12:18:04 x4 kernel: Failed to fully fault in a core file segment at VA 0x2045f000 with size 0x1000 to be written at offset 0x4c000 for process mmap11 Jul 9 12:18:04 x4 kernel: Failed to fully fault in a core file segment at VA 0x20460000 with size 0x1000 to be written at offset 0x4d000 for process mmap11 Jul 9 12:18:04 x4 kernel: Failed to fully fault in a core file segment at VA 0x20461000 with size 0xa000 to be written at offset 0x4e000 for process mmap11 Jul 9 12:18:04 x4 kernel: Failed to fully fault in a core file segment at VA 0x205ea000 with size 0x4000 to be written at offset 0x58000 for process mmap11 Jul 9 12:18:04 x4 kernel: Failed to fully fault in a core file segment at VA 0x205ee000 with size 0x5000 to be written at offset 0x5c000 for process mmap11 Jul 9 12:18:04 x4 kernel: Failed to fully fault in a core file segment at VA 0x205f3000 with size 0x35000 to be written at offset 0x61000 for process mmap11 Jul 9 12:18:04 x4 kernel: Failed to fully fault in a core file segment at VA 0x20629000 with size 0x1000 to be written at offset 0x97000 for process mmap11 Jul 9 12:18:04 x4 kernel: Failed to fully fault in a core file segment at VA 0x2062a000 with size 0x22000 to be written at offset 0x98000 for process mmap11 Jul 9 12:18:04 x4 kernel: Failed to fully fault in a core file segment at VA 0x2064c000 with size 0x20000 to be written at offset 0xba000 for process mmap11 Jul 9 12:18:04 x4 kernel: Failed to fully fault in a core file segment at VA 0x20800000 with size 0x200000 to be written at offset 0xda000 for process mmap11 Jul 9 12:18:04 x4 kernel: Failed to fully fault in a core file segment at VA 0x20a00000 with size 0x800000 to be written at offset 0x2da000 for process mmap11 Jul 9 12:18:04 x4 kernel: Failed to fully fault in a core file segment at VA 0x2041f000 with size 0x1000 to be written at offset 0x28000 for process mmap11 Jul 9 12:18:04 x4 kernel: Failed to fully fault in a core file segment at VA 0x20420000 with size 0x23000 to be written at offset 0x29000 for process mmap11 Jul 9 12:18:04 x4 kernel: Failed to fully fault in a core file segment at VA 0x2045f000 with size 0x1000 to be written at offset 0x4c000 for process mmap11 Jul 9 12:18:04 x4 kernel: Failed to fully fault in a core file segment at VA 0x20461000 with size 0xa000 to be written at offset 0x4e000 for process mmap11 Jul 9 12:18:04 x4 kernel: Failed to fully fault in a core file segment at VA 0x205ea000 with size 0x4000 to be written at offset 0x58000 for process mmap11 Jul 9 12:18:04 x4 kernel: Failed to fully fault in a core file segment at VA 0x205f3000 with size 0x35000 to be written at offset 0x61000 for process mmap11 Jul 9 12:18:04 x4 kernel: Failed to fully fault in a core file segment at VA 0x20629000 with size 0x1000 to be written at offset 0x97000 for process mmap11 Jul 9 12:18:04 x4 kernel: Failed to fully fault in a core file segment at VA 0x2062a000 with size 0x1d000 to be written at offset 0x98000 for process mmap11 Jul 9 12:18:04 x4 kernel: Failed to fully fault in a core file segment at VA 0x20647000 with size 0x25000 to be written at offset 0xb5000 for process mmap11 Jul 9 12:18:05 x4 kernel: Failed to fully fault in a core file segment at VA 0x20800000 with size 0x200000 to be written at offset 0xda000 for process mmap11 Jul 9 12:18:05 x4 kernel: Failed to fully fault in a core file segment at VA 0x20a00000 with size 0x200000 to be written at offset 0x2da000 for process mmap11 Jul 9 12:18:05 x4 kernel: Failed to fully fault in a core file segment at VA 0x20c00000 with size 0x800000 to be written at offset 0x4da000 for process mmap11 Jul 9 12:18:22 x4 kernel: Failed to fully fault in a core file segment at VA 0x2041f000 with size 0x1000 to be written at offset 0x28000 for process mmap11 Jul 9 12:18:22 x4 kernel: Failed to fully fault in a core file segment at VA 0x20420000 with size 0x23000 to be written at offset 0x29000 for process mmap11 Jul 9 12:18:22 x4 kernel: Failed to fully fault in a core file segment at VA 0x2045f000 with size 0x1000 to be written at offset 0x4c000 for process mmap11 Jul 9 12:18:22 x4 kernel: Failed to fully fault in a core file segment at VA 0x20460000 with size 0x1000 to be written at offset 0x4d000 for process mmap11 Jul 9 12:18:22 x4 kernel: Failed to fully fault in a core file segment at VA 0x20461000 with size 0xa000 to be written at offset 0x4e000 for process mmap11 Jul 9 12:18:22 x4 kernel: Failed to fully fault in a core file segment at VA 0x205ea000 with size 0x4000 to be written at offset 0x58000 for process mmap11 Jul 9 12:18:22 x4 kernel: Failed to fully fault in a core file segment at VA 0x205ee000 with size 0x5000 to be written at offset 0x5c000 for process mmap11 Jul 9 12:18:22 x4 kernel: Failed to fully fault in a core file segment at VA 0x205f3000 with size 0x35000 to be written at offset 0x61000 for process mmap11 Jul 9 12:18:22 x4 kernel: Failed to fully fault in a core file segment at VA 0x20629000 with size 0x1000 to be written at offset 0x97000 for process mmap11 Jul 9 12:18:22 x4 kernel: Failed to fully fault in a core file segment at VA 0x2062a000 with size 0x2a000 to be written at offset 0x98000 for process mmap11 Jul 9 12:18:22 x4 kernel: Failed to fully fault in a core file segment at VA 0x20654000 with size 0x8000 to be written at offset 0xc2000 for process mmap11 Jul 9 12:18:22 x4 kernel: Failed to fully fault in a core file segment at VA 0x2065c000 with size 0xa000 to be written at offset 0xca000 for process mmap11 Jul 9 12:18:22 x4 kernel: Failed to fully fault in a core file segment at VA 0x20800000 with size 0x200000 to be written at offset 0xd4000 for process mmap11 Jul 9 12:18:22 x4 kernel: Failed to fully fault in a core file segment at VA 0x20a00000 with size 0x200000 to be written at offset 0x2d4000 for process mmap11 Jul 9 12:18:22 x4 kernel: Failed to fully fault in a core file segment at VA 0x20c00000 with size 0x400000 to be written at offset 0x4d4000 for process mmap11 Jul 9 12:18:22 x4 kernel: Failed to fully fault in a core file segment at VA 0x21000000 with size 0x400000 to be written at offset 0x8d4000 for process mmap11 Jul 9 12:18:23 x4 kernel: Failed to fully fault in a core file segment at VA 0x20800000 with size 0x200000 to be written at offset 0xcf000 for process mmap11 Jul 9 12:18:23 x4 kernel: Failed to fully fault in a core file segment at VA 0x20a00000 with size 0x17a000 to be written at offset 0x2cf000 for process mmap11 Jul 9 12:18:26 x4 kernel: Failed to fully fault in a core file segment at VA 0x20420000 with size 0x23000 to be written at offset 0x29000 for process mmap11 Jul 9 12:18:26 x4 kernel: Failed to fully fault in a core file segment at VA 0x205f3000 with size 0x35000 to be written at offset 0x61000 for process mmap11 Jul 9 12:18:26 x4 kernel: Failed to fully fault in a core file segment at VA 0x2062a000 with size 0x2b000 to be written at offset 0x98000 for process mmap11 Jul 9 12:18:26 x4 kernel: Failed to fully fault in a core file segment at VA 0x20655000 with size 0x7000 to be written at offset 0xc3000 for process mmap11 Jul 9 12:18:26 x4 kernel: Failed to fully fault in a core file segment at VA 0x20800000 with size 0x200000 to be written at offset 0xca000 for process mmap11 Jul 9 12:18:26 x4 kernel: Failed to fully fault in a core file segment at VA 0x20a00000 with size 0x600000 to be written at offset 0x2ca000 for process mmap11 Jul 9 12:18:26 x4 kernel: Failed to fully fault in a core file segment at VA 0x21000000 with size 0x200000 to be written at offset 0x8ca000 for process mmap11 Jul 9 12:18:26 x4 kernel: Failed to fully fault in a core file segment at VA 0x402000 with size 0x1000 to be written at offset 0x5000 for process mmap11 Jul 9 12:18:26 x4 kernel: Failed to fully fault in a core file segment at VA 0x403000 with size 0x1000 to be written at offset 0x6000 for process mmap11 Jul 9 12:18:26 x4 kernel: Failed to fully fault in a core file segment at VA 0x404000 with size 0x19000 to be written at offset 0x7000 for process mmap11 Jul 9 12:18:26 x4 kernel: Failed to fully fault in a core file segment at VA 0x41d000 with size 0x8000 to be written at offset 0x20000 for process mmap11 Jul 9 12:18:26 x4 kernel: Failed to fully fault in a core file segment at VA 0x2041f000 with size 0x1000 to be written at offset 0x28000 for process mmap11 Jul 9 12:18:26 x4 kernel: Failed to fully fault in a core file segment at VA 0x20420000 with size 0x23000 to be written at offset 0x29000 for process mmap11 Jul 9 12:18:26 x4 kernel: Failed to fully fault in a core file segment at VA 0x2045f000 with size 0x1000 to be written at offset 0x4c000 for process mmap11 Jul 9 12:18:26 x4 kernel: Failed to fully fault in a core file segment at VA 0x20460000 with size 0x1000 to be written at offset 0x4d000 for process mmap11 Jul 9 12:18:26 x4 kernel: Failed to fully fault in a core file segment at VA 0x20461000 with size 0xa000 to be written at offset 0x4e000 for process mmap11 Jul 9 12:18:26 x4 kernel: Failed to fully fault in a core file segment at VA 0x205ea000 with size 0x4000 to be written at offset 0x58000 for process mmap11 Jul 9 12:18:26 x4 kernel: Failed to fully fault in a core file segment at VA 0x205ee000 with size 0x5000 to be written at offset 0x5c000 for process mmap11 Jul 9 12:18:26 x4 kernel: Failed to fully fault in a core file segment at VA 0x205f3000 with size 0x35000 to be written at offset 0x61000 for process mmap11 Jul 9 12:18:26 x4 kernel: Failed to fully fault in a core file segment at VA 0x20629000 with size 0x11000 to be written at offset 0x97000 for process mmap11 Jul 9 12:18:26 x4 kernel: Failed to fully fault in a core file segment at VA 0x2063a000 with size 0x29000 to be written at offset 0xa8000 for process mmap11 Jul 9 12:18:26 x4 kernel: Failed to fully fault in a core file segment at VA 0x20800000 with size 0x200000 to be written at offset 0xd1000 for process mmap11 Jul 9 12:18:26 x4 kernel: Failed to fully fault in a core file segment at VA 0x20a00000 with size 0x400000 to be written at offset 0x2d1000 for process mmap11 Jul 9 12:18:26 x4 kernel: Failed to fully fault in a core file segment at VA 0x20e00000 with size 0x5202000 to be written at offset 0x6d1000 for process mmap11 Jul 9 12:18:26 x4 kernel: Failed to fully fault in a core file segment at VA 0x2600f000 with size 0x5a07000 to be written at offset 0x58e0000 for process mmap11 Jul 9 12:18:26 x4 kernel: Failed to fully fault in a core file segment at VA 0x2ba1d000 with size 0x19e3000 to be written at offset 0xb2ee000 for process mmap11 Jul 9 12:18:27 x4 kernel: Failed to fully fault in a core file segment at VA 0x20420000 with size 0x23000 to be written at offset 0x29000 for process mmap11 Jul 9 12:18:27 x4 kernel: Failed to fully fault in a core file segment at VA 0x205f3000 with size 0x35000 to be written at offset 0x61000 for process mmap11 Jul 9 12:18:27 x4 kernel: Failed to fully fault in a core file segment at VA 0x2062a000 with size 0x32000 to be written at offset 0x98000 for process mmap11 Jul 9 12:18:27 x4 kernel: Failed to fully fault in a core file segment at VA 0x20800000 with size 0x200000 to be written at offset 0xcb000 for process mmap11 Jul 9 12:18:27 x4 kernel: Failed to fully fault in a core file segment at VA 0x20a00000 with size 0x600000 to be written at offset 0x2cb000 for process mmap11 Jul 9 12:18:27 x4 kernel: Failed to fully fault in a core file segment at VA 0x2d000000 with size 0x200000 to be written at offset 0x8cb000 for process mmap11 Jul 9 12:18:28 x4 kernel: Failed to fully fault in a core file segment at VA 0x2041f000 with size 0x1000 to be written at offset 0x28000 for process mmap11 Jul 9 12:18:28 x4 kernel: Failed to fully fault in a core file segment at VA 0x20420000 with size 0x23000 to be written at offset 0x29000 for process mmap11 Jul 9 12:18:28 x4 kernel: Failed to fully fault in a core file segment at VA 0x2045f000 with size 0x1000 to be written at offset 0x4c000 for process mmap11 Jul 9 12:18:28 x4 kernel: Failed to fully fault in a core file segment at VA 0x20460000 with size 0x1000 to be written at offset 0x4d000 for process mmap11 Jul 9 12:18:28 x4 kernel: Failed to fully fault in a core file segment at VA 0x20461000 with size 0xa000 to be written at offset 0x4e000 for process mmap11 Jul 9 12:18:28 x4 kernel: Failed to fully fault in a core file segment at VA 0x205ea000 with size 0x4000 to be written at offset 0x58000 for process mmap11 Jul 9 12:18:28 x4 kernel: Failed to fully fault in a core file segment at VA 0x205ee000 with size 0x5000 to be written at offset 0x5c000 for process mmap11 Jul 9 12:18:28 x4 kernel: Failed to fully fault in a core file segment at VA 0x205f3000 with size 0x35000 to be written at offset 0x61000 for process mmap11 Jul 9 12:18:28 x4 kernel: Failed to fully fault in a core file segment at VA 0x20629000 with size 0x1000 to be written at offset 0x97000 for process mmap11 Jul 9 12:18:28 x4 kernel: Failed to fully fault in a core file segment at VA 0x2062a000 with size 0x40000 to be written at offset 0x98000 for process mmap11 Jul 9 12:18:28 x4 kernel: Failed to fully fault in a core file segment at VA 0x20800000 with size 0x200000 to be written at offset 0xda000 for process mmap11 Jul 9 12:18:28 x4 kernel: Failed to fully fault in a core file segment at VA 0x20a00000 with size 0xa00000 to be written at offset 0x2da000 for process mmap11 20190709 12:22:38 all (36/101): mmap14.sh 20190709 12:25:18 all (37/101): mmap15.sh 20190709 12:30:38 all (38/101): mmap16.sh 20190709 12:30:43 all (39/101): mmap17.sh 20190709 12:30:49 all (40/101): mmap18.sh 20190709 12:37:46 all (41/101): mmap19.sh 20190709 12:44:18 all (42/101): mmap2.sh 20190709 12:54:49 all (43/101): mmap21.sh 20190709 13:04:06 all (44/101): mmap22.sh 20190709 13:09:17 all (45/101): mmap3.sh 20190709 13:19:39 all (46/101): mmap34.sh lock order reversal: 1st 0x31633a28 syncer (syncer) @ kern/vfs_subr.c:2267 2nd 0x30f5930c ufs (ufs) @ kern/vfs_subr.c:2687 stack backtrace: #0 0x102ebd1 at witness_debugger+0x61 #1 0x102e9a9 at witness_checkorder+0x8a9 #2 0xfa6288 at lockmgr_xlock_hard+0x48 #3 0xfa69f6 at __lockmgr_args+0x376 #4 0x129d0ff at ffs_lock+0x6f #5 0x1561898 at VOP_LOCK1_APV+0x58 #6 0x109ce28 at _vn_lock+0x58 #7 0x108bbdb at vget+0x7b #8 0x108daf2 at vfs_msync+0x92 #9 0x1092920 at sync_fsync+0xc0 #10 0x1560959 at VOP_FSYNC_APV+0x69 #11 0x1090977 at sched_sync+0x277 #12 0xf93e7c at fork_exit+0x6c #13 0xffc033ca at _end+0xfdc500d2 20190709 13:24:49 all (47/101): mmap37.sh 20190709 13:25:23 all (48/101): mmap7.sh 20190709 13:27:07 all (49/101): mmap8.sh 20190709 13:27:12 all (50/101): mmap9.sh 20190709 13:27:17 all (51/101): msync.sh 20190709 13:30:21 all (52/101): namecache2.sh 20190709 13:33:04 all (53/101): nfs15.sh Jul 9 13:33:08 x4 mountd[556]: can't export /mnt mount option is unknown 20190709 13:38:11 all (54/101): nfs15lockd.sh Jul 9 13:38:15 x4 syslogd: last message repeated 1 times 20190709 13:45:23 all (55/101): nfs15lockd3.sh Jul 9 13:45:26 x4 syslogd: last message repeated 1 times 20190709 13:45:34 all (56/101): overlap.sh 20190709 13:50:38 all (57/101): pkru.sh 20190709 13:50:41 all (58/101): pmc4.sh hwpmc: SOFT/16/64/0x67 TSC/1/64/0x20 K8/16/48/0x1ff 20190709 13:50:46 all (59/101): pmc5.sh hwpmc: SOFT/16/64/0x67 TSC/1/64/0x20 K8/16/48/0x1ff 20190709 13:50:50 all (60/101): pshared.sh 20190709 13:51:05 all (61/101): pthread.sh 20190709 13:51:16 all (62/101): pthread2.sh 20190709 14:12:42 all (63/101): pthread3.sh 20190709 14:22:29 all (64/101): pthread4.sh 20190709 14:47:48 all (65/101): pthread5.sh lock order reversal: 1st 0x1f93300 cpslk (cpslk) @ i386/i386/copyout.c:121 2nd 0x249133dc bufwait (bufwait) @ vm/vm_pager.c:379 stack backtrace: #0 0x102ebd1 at witness_debugger+0x61 #1 0x102e9a9 at witness_checkorder+0x8a9 #2 0xfa6288 at lockmgr_xlock_hard+0x48 #3 0xfa69f6 at __lockmgr_args+0x376 #4 0x12db9d9 at pbuf_ctor+0x79 #5 0x12b641b at uma_zalloc_arg+0xa0b #6 0x12af712 at swap_pager_getpages+0x2a2 #7 0x12dbc04 at vm_pager_get_pages+0x44 #8 0x12bd018 at vm_fault_hold+0x1938 #9 0x12bb69a at vm_fault+0x4a #10 0x1530263 at trap_pfault+0xf3 #11 0x152f880 at trap+0x3c0 #12 0xffc0316d at _end+0xfdc4fe75 #13 0x150b153 at copyin_slow0+0x13 #14 0x150af03 at cp_slow0+0x153 #15 0x150b117 at copyin+0xa7 #16 0x1028436 at uiomove_faultflag+0xf6 #17 0x1028333 at uiomove+0x13 witness_lock_list_get: witness exhausted 20190709 14:49:06 all (66/101): pthread6.sh 20190709 14:54:33 all (67/101): pthread7.sh 20190709 15:19:01 all (68/101): pthread8.sh 20190709 15:22:05 all (69/101): pthread9.sh Jul 9 15:22:08 x4 mountd[556]: can't export /mnt mount option is unknown 20190709 15:25:30 all (70/101): ptrace10.sh 20190709 15:27:18 all (71/101): ptrace11.sh 20190709 15:27:23 all (72/101): ptrace5.sh 20190709 15:32:26 all (73/101): ptrace6.sh 20190709 15:36:30 all (74/101): ptrace7.sh 20190709 15:40:34 all (75/101): rdgsbase.sh 20190709 15:40:37 all (76/101): readdir.sh Jul 9 15:44:51 x4 mountd[556]: can't export /mnt Jul 9 15:46:53 x4 mountd[556]: can't export /mnt mount option is unknown 20190709 15:54:55 all (77/101): rename10.sh 20190709 15:56:05 all (78/101): ruby.sh 20190709 15:56:09 all (79/101): segregs.sh 20190709 15:58:12 all (80/101): select.sh 20190709 16:08:23 all (81/101): selfd.sh 20190709 16:13:31 all (82/101): sendfile.sh 20190709 16:13:37 all (83/101): sendfile11.sh GEOM_ELI: Device md10.eli created. GEOM_ELI: Encryption: AES-XTS 128 GEOM_ELI: Crypto: software Expensive timeout(9) function: 0x1442020(0x1f5da64) 0.009962690 s GEOM_ELI: md10 has been killed. GEOM_ELI: Device md10.eli destroyed. 20190709 16:14:55 all (84/101): sendfile12.sh Expensive timeout(9) function: 0xd49b00(0x216d1000) 0.023720996 s 20190709 16:15:58 all (85/101): sendfile14.sh 20190709 16:16:08 all (86/101): shm.sh 20190709 16:17:12 all (87/101): sigaltstack.sh 20190709 16:17:15 all (88/101): signal0.sh 20190709 16:22:43 all (89/101): sigreturn.sh 20190709 16:22:47 all (90/101): sndstat.sh 20190709 16:22:51 all (91/101): suj30.sh Jul 9 16:26:24 x4 su[24052]: pho to root on /dev/pts/2 20190709 16:28:12 all (92/101): symlink2.sh 20190709 16:28:22 all (93/101): syscall4.sh FreeBSD/i386 (x4.osted.lan) (ttyu0) login: root Password: Jul 9 16:48:26 x4 login[780]: ROOT LOGIN (root) ON ttyu0 Last login: Mon Jul 8 22:33:39 on ttyu0 FreeBSD 13.0-CURRENT (PHO) #0 r349856M: Tue Jul 9 10:23:25 CEST 2019 You have new mail. root@x4:~ # init 1 root@x4:~ # Stopping inetd. Waiting for PIDS: 755. Stopping nfscbd. Waiting for PIDS: 720 721. Shutting down local packages:. Stopping cron. Waiting for PIDS: 684. Stopping sshd. Waiting for PIDS: 674. Stopping smartd. Waiting for PIDS: 634. Stopping powerd. Waiting for PIDS: 610. Stopping ntpd. Waiting for PIDS: 607. Stopping lockd. Waiting for PIDS: 569. Stopping statd. Waiting for PIDS: 566. Stopping nfsd. Waiting for PIDS: 562 565. Stopping mountd. Waiting for PIDS: 556. Stopping nfsuserd. Waiting for PIDS: 545 546 547 548 549. Stopping watchdogd. Waiting for PIDS: 502. Stopping rpcbind. Waiting for PIDS: 417if_delmulti_locked: detaching ifnet instance 0x23eef800 . Stopping devd. Waiting for PIDS: 336. Writing entropy file:. Writing early boot entropy file:. . Terminated Jul 9 16:48:33 x4 syslogd: exiting on signal 15 2019-07-09T16:48:52.882703+02:00 x4.osted.lan init 1 - - some processes would not die; ps axl advised Enter full pathname of shell or RETURN for /bin/sh: # ps auxwwl USER PID %CPU %MEM VSZ RSS TT STAT STARTED TIME COMMAND UID PPID CPU PRI NI MWCHAN root 11 398.1 0.0 0 64 - RNL 10:40 515:52.12 [idle] 0 0 0 155 0 - root 0 0.0 0.0 0 384 - DLs 10:40 0:00.43 [kernel] 0 0 0 -16 0 swapin root 1 0.0 0.0 3596 796 - SLs 10:40 0:00.18 /sbin/init 0 0 0 20 0 wait root 2 0.0 0.0 0 16 - DL 10:40 0:00.00 [crypto] 0 0 0 -16 0 crypto_w root 3 0.0 0.0 0 16 - DL 10:40 0:00.00 [crypto returns 0 0 0 -16 0 crypto_r root 4 0.0 0.0 0 16 - DL 10:40 0:00.00 [crypto returns 0 0 0 -16 0 crypto_r root 5 0.0 0.0 0 16 - DL 10:40 0:00.00 [crypto returns 0 0 0 -16 0 crypto_r root 6 0.0 0.0 0 16 - DL 10:40 0:00.00 [crypto returns 0 0 0 -16 0 crypto_r root 7 0.0 0.0 0 32 - DL 10:40 3:16.85 [cam] 0 0 0 -16 0 - root 8 0.0 0.0 0 16 - DL 10:40 0:00.00 [fdc0] 0 0 0 -16 0 - root 9 0.0 0.0 0 16 - DL 10:40 0:00.01 [soaiod1] 0 0 0 -16 0 - root 10 0.0 0.0 0 16 - DL 10:40 0:00.00 [audit] 0 0 0 -16 0 audit_wo root 12 0.0 0.0 0 304 - WL 10:40 5:42.91 [intr] 0 0 0 -52 0 - root 13 0.0 0.0 0 48 - DL 10:40 0:01.91 [geom] 0 0 0 -8 0 - root 14 0.0 0.0 0 16 - DL 10:40 0:00.00 [sequencer 00] 0 0 0 -16 0 seqstate root 15 0.0 0.0 0 480 - DL 10:40 0:01.08 [usb] 0 0 0 -68 0 - root 16 0.0 0.0 0 16 - DL 10:40 0:00.01 [soaiod2] 0 0 0 -16 0 - root 17 0.0 0.0 0 16 - DL 10:40 0:00.01 [soaiod3] 0 0 0 -16 0 - root 18 0.0 0.0 0 16 - DL 10:40 0:00.01 [soaiod4] 0 0 0 -16 0 - root 19 0.0 0.0 0 16 - DL 10:40 0:00.00 [sctp_iterator] 0 0 0 -16 0 waiting_ root 20 0.0 0.0 0 16 - DL 10:40 0:05.03 [rand_harvestq] 0 0 0 -16 0 - root 21 0.0 0.0 0 48 - DL 10:40 2:39.59 [pagedaemon] 0 0 0 -16 0 psleep root 22 0.0 0.0 0 16 - DL 10:40 0:00.34 [vmdaemon] 0 0 0 -16 0 psleep root 23 0.0 0.0 0 112 - DL 10:40 2:30.17 [bufdaemon] 0 0 0 21 0 qsleep root 24 0.0 0.0 0 16 - DL 10:40 0:00.18 [vnlru] 0 0 0 -16 0 vlruwt root 25 0.0 0.0 0 16 - DL 10:40 2:52.77 [syncer] 0 0 0 16 0 syncer root 23407 0.0 0.0 0 16 - DL 13:27 0:00.00 [aiod1] 0 0 0 -16 0 aiordy root 23408 0.0 0.0 0 16 - DL 13:27 0:00.00 [aiod2] 0 0 0 -16 0 aiordy root 23409 0.0 0.0 0 16 - DL 13:27 0:00.00 [aiod3] 0 0 0 -16 0 aiordy root 23410 0.0 0.0 0 16 - DL 13:27 0:00.00 [aiod4] 0 0 0 -16 0 aiordy root 37655 0.0 0.0 0 16 - DL 16:28 0:00.01 [md10] 0 0 0 -8 0 mdwait nobody 48575 0.0 0.0 42828 3828 - T 16:30 0:00.01 /tmp/syscall4 65534 1 0 20 0 umtxqb nobody 48604 0.0 0.0 28336 3588 - T 16:30 0:00.01 /tmp/syscall4 65534 1 0 20 0 umtxqb root 39585 0.0 0.0 5340 2700 u0 Ss 16:48 0:00.01 -sh (sh) 0 1 0 20 0 wait root 39587 0.0 0.0 5016 2612 u0 R+ 16:49 0:00.00 ps auxwwl 0 39585 0 20 0 - # procstat -k 48575 PID TID COMM TDNAME KSTACK 48575 100265 syscall4 test mi_switch sleepq_switch sleepq_wait _sleep umtxq_busy do_lock_umutex __umtx_op_wait_umutex syscall exit_tag 48575 100300 syscall4 calls mi_switch sleepq_switch sleepq_wait _sleep umtxq_busy do_lock_umutex __umtx_op_wait_umutex syscall exit_tag 48575 100330 syscall4 calls mi_switch sleepq_switch sleepq_wait _sleep umtxq_busy do_lock_umutex __umtx_op_wait_umutex syscall exit_tag 48575 100359 syscall4 calls mi_switch sleepq_switch sleepq_wait _sleep umtxq_busy do_lock_umutex __umtx_op_wait_umutex syscall exit_tag 48575 100435 syscall4 calls mi_switch sleepq_switch sleepq_wait _sleep umtxq_busy do_lock_umutex __umtx_op_wait_umutex syscall exit_tag 48575 101557 syscall4 calls mi_switch thread_suspend_switch thread_single exit1 sys_sys_exit syscall exit_tag # procstat -k 48604 PID TID COMM TDNAME KSTACK 48604 100433 syscall4 test mi_switch sleepq_switch sleepq_wait _sleep umtxq_busy do_lock_umutex __umtx_op_wait_umutex syscall exit_tag 48604 100843 syscall4 calls mi_switch sleepq_switch sleepq_wait _sleep umtxq_busy do_lock_umutex __umtx_op_wait_umutex syscall exit_tag 48604 101000 syscall4 calls mi_switch sleepq_switch sleepq_wait _sleep umtxq_busy do_lock_umutex __umtx_op_wait_umutex syscall exit_tag 48604 101272 syscall4 calls mi_switch thread_suspend_switch thread_single exit1 sys_sys_exit syscall exit_tag # KDB: enter: Break to debugger [ thread pid 11 tid 100006 ] Stopped at kdb_alt_break_internal+0xeb: movl $0,kdb_why db> run pho db:0:pho> set $lines 20000 db:0:pho> run pho1 db:1:pho1> bt Tracing pid 11 tid 100006 td 0x11fd6a80 kdb_alt_break_internal(0) at kdb_alt_break_internal+0xeb/frame 0x1b6e3b00 kdb_alt_break(2,23d6f88c) at kdb_alt_break+0x10/frame 0x1b6e3b0c uart_intr_rxready(23d6f800,ff953d,0,0,11fd6a80,...) at uart_intr_rxready+0x82/frame 0x1b6e3b28 uart_intr(23d6f800) at uart_intr+0x10e/frame 0x1b6e3b48 intr_event_handle(11ad2c00,1b6e3bbc) at intr_event_handle+0xaf/frame 0x1b6e3b68 intr_execute_handlers(11ffe138,1b6e3bbc,3) at intr_execute_handlers+0xc7/frame 0x1b6e3b94 lapic_handle_intr(32,1b6e3bbc,8,28,28,...) at lapic_handle_intr+0x55/frame 0x1b6e3bac Xapic_isr1() at 0xffc04208/frame 0x1b6e3bac --- interrupt, eip = 0x1545575, esp = 0x1b6e3bfc, ebp = 0x1b6e3bfc --- acpi_cpu_c1(0,3,245b,e7ca8b88,11e6ddc0,...) at acpi_cpu_c1+0x5/frame 0x1b6e3bfc acpi_cpu_idle(12fbf340,0) at acpi_cpu_idle+0x230/frame 0x1b6e3c2c cpu_idle_acpi(12fbf340,0) at cpu_idle_acpi+0x35/frame 0x1b6e3c40 cpu_idle(0) at cpu_idle+0xa3/frame 0x1b6e3c5c sched_idletd(0,1b6e3ce8) at sched_idletd+0x3ee/frame 0x1b6e3cb4 fork_exit(ffa440,0,1b6e3ce8,0,0,...) at fork_exit+0x6c/frame 0x1b6e3cd4 fork_trampoline() at 0xffc033ca/frame 0x1b6e3cd4 --- trap 0, eip = 0, esp = 0x1b6e3d20, ebp = 0 --- (null)() at 0 db:1:pho1> show allpcpu Current CPU: 3 cpuid = 0 dynamic pcpu = 0x8bdb80 curthread = 0x11fd7700: pid 11 tid 100003 "idle: cpu0" curpcb = 0x1b6d4d40 fpcurthread = none idlethread = 0x11fd7700: tid 100003 "idle: cpu0" APIC ID = 0 currentldt = 0x50 trampstk = 0xffc07ff0 kesp0 = 0x1b6d4d30 common_tssp = 0xffc01260 tlb gen = 48570536 curvnet = 0 spin locks held: cpuid = 1 dynamic pcpu = 0x10222b80 curthread = 0x11fd7380: pid 11 tid 100004 "idle: cpu1" curpcb = 0x1b6d9d40 fpcurthread = none idlethread = 0x11fd7380: tid 100004 "idle: cpu1" APIC ID = 1 currentldt = 0x50 trampstk = 0xffc0aff0 kesp0 = 0x1b6d9d30 common_tssp = 0xffc012c8 tlb gen = 48570545 curvnet = 0 spin locks held: cpuid = 2 dynamic pcpu = 0x10227b80 curthread = 0x11fd7000: pid 11 tid 100005 "idle: cpu2" curpcb = 0x1b6ded40 fpcurthread = none idlethread = 0x11fd7000: tid 100005 "idle: cpu2" APIC ID = 2 currentldt = 0x50 trampstk = 0xffc0bff0 kesp0 = 0x1b6ded30 common_tssp = 0xffc01330 tlb gen = 48570545 curvnet = 0 spin locks held: cpuid = 3 dynamic pcpu = 0x1022cb80 curthread = 0x11fd6a80: pid 11 tid 100006 "idle: cpu3" curpcb = 0x1b6e3d40 fpcurthread = none idlethread = 0x11fd6a80: tid 100006 "idle: cpu3" APIC ID = 3 currentldt = 0x50 trampstk = 0xffc0dff0 kesp0 = 0x1b6e3d30 common_tssp = 0xffc01398 tlb gen = 48570545 curvnet = 0 spin locks held: db:1:pho1> show alllocks db:1:pho1> show lockedvnods Locked vnodes db:1:pho1> show allchains chain 1: thread 159750 (pid 39585, sh) sleeping on 0x23d73074 "ttyin" chain 2: thread 100433 (pid 48604, test) sleeping on 0x1ed2638 "umtxqb" chain 3: thread 100843 (pid 48604, calls) sleeping on 0x1ed2638 "umtxqb" chain 4: thread 101000 (pid 48604, calls) sleeping on 0x1ed2638 "umtxqb" chain 5: thread 100265 (pid 48575, test) sleeping on 0x1ecdb08 "umtxqb" chain 6: thread 100300 (pid 48575, calls) sleeping on 0x1ecdb08 "umtxqb" chain 7: thread 100330 (pid 48575, calls) sleeping on 0x1ecdb08 "umtxqb" chain 8: thread 100359 (pid 48575, calls) sleeping on 0x1ecdb08 "umtxqb" chain 9: thread 100435 (pid 48575, calls) sleeping on 0x1ecdb08 "umtxqb" chain 10: thread 101524 (pid 37655, md10) sleeping on 0x426c3000 "mdwait" chain 11: thread 100928 (pid 23410, aiod4) sleeping on 0x34ea86a8 "aiordy" chain 12: thread 101575 (pid 23409, aiod3) sleeping on 0x3196e9fc "aiordy" chain 13: thread 101227 (pid 23408, aiod2) sleeping on 0x2e1e59fc "aiordy" chain 14: thread 100642 (pid 23407, aiod1) sleeping on 0x2e8b36a8 "aiordy" chain 15: thread 100104 (pid 25, syncer) sleeping on 0x1f46de4 "syncer" chain 16: thread 100101 (pid 23, bufdaemon) sleeping on 0x1f4677c "qsleep" chain 17: thread 100102 (pid 23, bufspacedaemon-0) sleeping on 0x1bfae80 "-" chain 18: thread 100113 (pid 23, /home worker) sleeping on 0x247d9084 "sdflush" chain 19: thread 100114 (pid 23, /tmp worker) sleeping on 0x11b73e84 "sdflush" chain 20: thread 100115 (pid 23, /usr worker) sleeping on 0x11b74084 "sdflush" chain 21: thread 100116 (pid 23, /var worker) sleeping on 0x11b73c84 "sdflush" chain 22: thread 100521 (pid 23, /mnt worker) sleeping on 0x32887284 "sdflush" chain 23: thread 100099 (pid 22, vmdaemon) sleeping on 0x1f5c238 "psleep" chain 24: thread 100097 (pid 21, dom0) sleeping on 0x1f907dc "psleep" chain 25: thread 100098 (pid 21, laundry: dom0) sleeping on 0x1f907e8 "launds" chain 26: thread 100100 (pid 21, uma) sleeping on 0x12b85f0 "umarcl" chain 27: thread 100094 (pid 20, rand_harvestq) sleeping on 0x1d31c80 "-" chain 28: thread 100090 (pid 19, sctp_iterator) sleeping on 0x1f8f8bc "waiting_for_work" chain 29: thread 100089 (pid 18, soaiod4) sleeping on 0x1f463a8 "-" chain 30: thread 100088 (pid 17, soaiod3) sleeping on 0x1f463a8 "-" chain 31: thread 100087 (pid 16, soaiod2) sleeping on 0x1f463a8 "-" chain 32: thread 100086 (pid 9, soaiod1) sleeping on 0x1f463a8 "-" chain 33: thread 100083 (pid 8, fdc0) sleeping on 0x216c483c "-" chain 34: thread 100048 (pid 15, usbus0) sleeping on 0x2170aacc "-" chain 35: thread 100049 (pid 15, usbus0) sleeping on 0x2170aafc "-" chain 36: thread 100050 (pid 15, usbus0) sleeping on 0x2170ab2c "-" chain 37: thread 100051 (pid 15, usbus0) sleeping on 0x2170ab5c "-" chain 38: thread 100052 (pid 15, usbus0) sleeping on 0x2170ab8c "-" chain 39: thread 100054 (pid 15, usbus1) sleeping on 0x23a91acc "-" chain 40: thread 100055 (pid 15, usbus1) sleeping on 0x23a91afc "-" chain 41: thread 100056 (pid 15, usbus1) sleeping on 0x23a91b2c "-" chain 42: thread 100057 (pid 15, usbus1) sleeping on 0x23a91b5c "-" chain 43: thread 100058 (pid 15, usbus1) sleeping on 0x23a91b8c "-" chain 44: thread 100060 (pid 15, usbus2) sleeping on 0x23ae3acc "-" chain 45: thread 100061 (pid 15, usbus2) sleeping on 0x23ae3afc "-" chain 46: thread 100062 (pid 15, usbus2) sleeping on 0x23ae3b2c "-" chain 47: thread 100063 (pid 15, usbus2) sleeping on 0x23ae3b5c "-" chain 48: thread 100064 (pid 15, usbus2) sleeping on 0x23ae3b8c "-" chain 49: thread 100065 (pid 15, usbus3) sleeping on 0x23b29acc "-" chain 50: thread 100066 (pid 15, usbus3) sleeping on 0x23b29afc "-" chain 51: thread 100067 (pid 15, usbus3) sleeping on 0x23b29b2c "-" chain 52: thread 100068 (pid 15, usbus3) sleeping on 0x23b29b5c "-" chain 53: thread 100069 (pid 15, usbus3) sleeping on 0x23b29b8c "-" chain 54: thread 100070 (pid 15, usbus4) sleeping on 0x23b70acc "-" chain 55: thread 100071 (pid 15, usbus4) sleeping on 0x23b70afc "-" chain 56: thread 100072 (pid 15, usbus4) sleeping on 0x23b70b2c "-" chain 57: thread 100073 (pid 15, usbus4) sleeping on 0x23b70b5c "-" chain 58: thread 100074 (pid 15, usbus4) sleeping on 0x23b70b8c "-" chain 59: thread 100076 (pid 15, usbus5) sleeping on 0x21704ca4 "-" chain 60: thread 100077 (pid 15, usbus5) sleeping on 0x21704cd4 "-" chain 61: thread 100078 (pid 15, usbus5) sleeping on 0x21704d04 "-" chain 62: thread 100079 (pid 15, usbus5) sleeping on 0x21704d34 "-" chain 63: thread 100080 (pid 15, usbus5) sleeping on 0x21704d64 "-" chain 64: thread 100043 (pid 7, doneq0) sleeping on 0x1c6b140 "-" chain 65: thread 100096 (pid 7, scanner) sleeping on 0x1c6b06c "-" chain 66: thread 100042 (pid 6, crypto returns 3) sleeping on 0x11ad0dc4 "crypto_ret_wait" chain 67: thread 100041 (pid 5, crypto returns 2) sleeping on 0x11ad0d8c "crypto_ret_wait" chain 68: thread 100040 (pid 4, crypto returns 1) sleeping on 0x11ad0d54 "crypto_ret_wait" chain 69: thread 100039 (pid 3, crypto returns 0) sleeping on 0x11ad0d1c "crypto_ret_wait" chain 70: thread 100038 (pid 2, crypto) sleeping on 0x1f5aff8 "crypto_wait" chain 71: thread 100033 (pid 14, sequencer 00) sleeping on 0x11b9f84c "seqstate" chain 72: thread 100030 (pid 13, g_event) sleeping on 0x1f7f868 "-" chain 73: thread 100031 (pid 13, g_up) sleeping on 0x1f7f870 "-" chain 74: thread 100032 (pid 13, g_down) sleeping on 0x1f7f864 "-" chain 75: thread 100002 (pid 1, init) sleeping on 0x11fce9fc "wait" chain 76: thread 100001 (pid 10, audit) sleeping on 0x1f900a0 "audit_worker_cv" chain 77: thread 100000 (pid 0, swapper) sleeping on 0x1f7f888 "swapin" chain 78: thread 100007 (pid 0, aiod_kick taskq) sleeping on 0x11f60f00 "-" chain 79: thread 100010 (pid 0, thread taskq) sleeping on 0x11f60d80 "-" chain 80: thread 100012 (pid 0, config_0) sleeping on 0x11fc2c00 "-" chain 81: thread 100013 (pid 0, kqueue_ctx taskq) sleeping on 0x11f60c80 "-" chain 82: thread 100014 (pid 0, if_config_tqg_0) sleeping on 0x11fc2b80 "-" chain 83: thread 100015 (pid 0, if_io_tqg_0) sleeping on 0x11fc2b00 "-" chain 84: thread 100016 (pid 0, if_io_tqg_1) sleeping on 0x11fc2a80 "-" chain 85: thread 100017 (pid 0, if_io_tqg_2) sleeping on 0x11fc2a00 "-" chain 86: thread 100018 (pid 0, if_io_tqg_3) sleeping on 0x11fc2980 "-" chain 87: thread 100019 (pid 0, softirq_0) sleeping on 0x11fc2900 "-" chain 88: thread 100020 (pid 0, softirq_1) sleeping on 0x11fc2880 "-" chain 89: thread 100021 (pid 0, softirq_2) sleeping on 0x11fc2800 "-" chain 90: thread 100022 (pid 0, softirq_3) sleeping on 0x11fc2780 "-" chain 91: thread 100029 (pid 0, firmware taskq) sleeping on 0x11f60c00 "-" chain 92: thread 100034 (pid 0, crypto_0) sleeping on 0x11f60b00 "-" chain 93: thread 100035 (pid 0, crypto_1) sleeping on 0x11f60b00 "-" chain 94: thread 100036 (pid 0, crypto_2) sleeping on 0x11f60b00 "-" chain 95: thread 100037 (pid 0, crypto_3) sleeping on 0x11f60b00 "-" chain 96: thread 100085 (pid 0, mca taskq) sleeping on 0x23d7b000 "-" chain 97: thread 100091 (pid 0, acpi_task_0) sleeping on 0x23ee5d00 "-" chain 98: thread 100092 (pid 0, acpi_task_1) sleeping on 0x23ee5d00 "-" chain 99: thread 100093 (pid 0, acpi_task_2) sleeping on 0x23ee5d00 "-" chain 100: thread 100095 (pid 0, CAM taskq) sleeping on 0x11f60a80 "-" db:1:pho1> show mount 0x24976000 /dev/ada0s1a on / (ufs) 0x24881000 devfs on /dev (devfs) 0x24975000 /dev/ada0s1f on /home (ufs) 0x24972000 /dev/label/tmp on /tmp (ufs) 0x2d3ca000 /dev/ada0s1d on /usr (ufs) 0x2d3c9000 /dev/ada0s1e on /var (ufs) 0x2d3c8000 procfs on /proc (procfs) 0x33e01000 /dev/md10a on /mnt (ufs) More info: show mount db:1:pho1> show bufqueues bqempty: 54 Buf domain 0 freebufs 4732 lofreebufs 311 hifreebufs 466 bufspace 11237376 maxbufspace 94683136 hibufspace 94027776 lobufspace 89326372 bufspacethresh 91677074 numdirtybuffers 5 lodirtybuffers 732 hidirtybuffers 1464 dirtybufthresh 1317 cleanq count 996 (10452992) dirtyq count 5 (81920) wakeup 0 lim 28 CPU 25, 1, 6, 14, Locked buffers: 0 space 0 Total buffers: 5779 space 11237376 db:0:pho> ps pid ppid pgrp uid state wmesg wchan cmd 39585 1 39585 0 Ss+ ttyin 0x23d73074 sh 48604 1 48295 65534 T (threaded) syscall4 100433 D umtxqb 0x1ed2638 test 100843 D umtxqb 0x1ed2638 calls 101000 D umtxqb 0x1ed2638 calls 101272 s calls 48575 1 48310 65534 T (threaded) syscall4 100265 D umtxqb 0x1ecdb08 test 100300 D umtxqb 0x1ecdb08 calls 100330 D umtxqb 0x1ecdb08 calls 100359 D umtxqb 0x1ecdb08 calls 100435 D umtxqb 0x1ecdb08 calls 101557 s calls 37655 0 0 0 DL mdwait 0x426c3000 [md10] 23410 0 0 0 DL aiordy 0x34ea86a8 [aiod4] 23409 0 0 0 DL aiordy 0x3196e9fc [aiod3] 23408 0 0 0 DL aiordy 0x2e1e59fc [aiod2] 23407 0 0 0 DL aiordy 0x2e8b36a8 [aiod1] 25 0 0 0 DL syncer 0x1f46de4 [syncer] 24 0 0 0 RL [vnlru] 23 0 0 0 DL (threaded) [bufdaemon] 100101 D qsleep 0x1f4677c [bufdaemon] 100102 D - 0x1bfae80 [bufspacedaemon-0] 100113 D sdflush 0x247d9084 [/home worker] 100114 D sdflush 0x11b73e84 [/tmp worker] 100115 D sdflush 0x11b74084 [/usr worker] 100116 D sdflush 0x11b73c84 [/var worker] 100521 D sdflush 0x32887284 [/mnt worker] 22 0 0 0 DL psleep 0x1f5c238 [vmdaemon] 21 0 0 0 DL (threaded) [pagedaemon] 100097 D psleep 0x1f907dc [dom0] 100098 D launds 0x1f907e8 [laundry: dom0] 100100 D umarcl 0x12b85f0 [uma] 20 0 0 0 DL - 0x1d31c80 [rand_harvestq] 19 0 0 0 DL waiting 0x1f8f8bc [sctp_iterator] 18 0 0 0 DL - 0x1f463a8 [soaiod4] 17 0 0 0 DL - 0x1f463a8 [soaiod3] 16 0 0 0 DL - 0x1f463a8 [soaiod2] 9 0 0 0 DL - 0x1f463a8 [soaiod1] 8 0 0 0 DL - 0x216c483c [fdc0] 15 0 0 0 DL (threaded) [usb] 100048 D - 0x2170aacc [usbus0] 100049 D - 0x2170aafc [usbus0] 100050 D - 0x2170ab2c [usbus0] 100051 D - 0x2170ab5c [usbus0] 100052 D - 0x2170ab8c [usbus0] 100054 D - 0x23a91acc [usbus1] 100055 D - 0x23a91afc [usbus1] 100056 D - 0x23a91b2c [usbus1] 100057 D - 0x23a91b5c [usbus1] 100058 D - 0x23a91b8c [usbus1] 100060 D - 0x23ae3acc [usbus2] 100061 D - 0x23ae3afc [usbus2] 100062 D - 0x23ae3b2c [usbus2] 100063 D - 0x23ae3b5c [usbus2] 100064 D - 0x23ae3b8c [usbus2] 100065 D - 0x23b29acc [usbus3] 100066 D - 0x23b29afc [usbus3] 100067 D - 0x23b29b2c [usbus3] 100068 D - 0x23b29b5c [usbus3] 100069 D - 0x23b29b8c [usbus3] 100070 D - 0x23b70acc [usbus4] 100071 D - 0x23b70afc [usbus4] 100072 D - 0x23b70b2c [usbus4] 100073 D - 0x23b70b5c [usbus4] 100074 D - 0x23b70b8c [usbus4] 100076 D - 0x21704ca4 [usbus5] 100077 D - 0x21704cd4 [usbus5] 100078 D - 0x21704d04 [usbus5] 100079 D - 0x21704d34 [usbus5] 100080 D - 0x21704d64 [usbus5] 7 0 0 0 DL (threaded) [cam] 100043 D - 0x1c6b140 [doneq0] 100096 D - 0x1c6b06c [scanner] 6 0 0 0 DL crypto_ 0x11ad0dc4 [crypto returns 3] 5 0 0 0 DL crypto_ 0x11ad0d8c [crypto returns 2] 4 0 0 0 DL crypto_ 0x11ad0d54 [crypto returns 1] 3 0 0 0 DL crypto_ 0x11ad0d1c [crypto returns 0] 2 0 0 0 DL crypto_ 0x1f5aff8 [crypto] 14 0 0 0 DL seqstat 0x11b9f84c [sequencer 00] 13 0 0 0 DL (threaded) [geom] 100030 D - 0x1f7f868 [g_event] 100031 D - 0x1f7f870 [g_up] 100032 D - 0x1f7f864 [g_down] 12 0 0 0 WL (threaded) [intr] 100008 I [swi6: task queue] 100009 I [swi6: Giant taskq] 100011 I [swi5: fast taskq] 100023 I [swi4: clock (0)] 100024 I [swi4: clock (1)] 100025 I [swi4: clock (2)] 100026 I [swi4: clock (3)] 100027 I [swi1: netisr 0] 100028 I [swi3: vm] 100044 I [irq24: hdac0] 100045 I [irq25: re0] 100046 I [irq22: ahci0] 100047 I [irq16: hdac1 ohci0] 100053 I [irq17: ohci1 ohci3] 100059 I [irq18: ohci2 ohci4] 100075 I [irq19: ehci0] 100081 I [irq14: ata0] 100082 I [swi0: uart] 100084 I [irq1: atkbd0] 11 0 0 0 RL (threaded) [idle] 100003 Run CPU 0 [idle: cpu0] 100004 Run CPU 1 [idle: cpu1] 100005 Run CPU 2 [idle: cpu2] 100006 Run CPU 3 [idle: cpu3] 1 0 1 0 SLs wait 0x11fce9fc [init] 10 0 0 0 DL audit_w 0x1f900a0 [audit] 0 0 0 0 DLs (threaded) [kernel] 100000 D swapin 0x1f7f888 [swapper] 100007 D - 0x11f60f00 [aiod_kick taskq] 100010 D - 0x11f60d80 [thread taskq] 100012 D - 0x11fc2c00 [config_0] 100013 D - 0x11f60c80 [kqueue_ctx taskq] 100014 D - 0x11fc2b80 [if_config_tqg_0] 100015 D - 0x11fc2b00 [if_io_tqg_0] 100016 D - 0x11fc2a80 [if_io_tqg_1] 100017 D - 0x11fc2a00 [if_io_tqg_2] 100018 D - 0x11fc2980 [if_io_tqg_3] 100019 D - 0x11fc2900 [softirq_0] 100020 D - 0x11fc2880 [softirq_1] 100021 D - 0x11fc2800 [softirq_2] 100022 D - 0x11fc2780 [softirq_3] 100029 D - 0x11f60c00 [firmware taskq] 100034 D - 0x11f60b00 [crypto_0] 100035 D - 0x11f60b00 [crypto_1] 100036 D - 0x11f60b00 [crypto_2] 100037 D - 0x11f60b00 [crypto_3] 100085 D - 0x23d7b000 [mca taskq] 100091 D - 0x23ee5d00 [acpi_task_0] 100092 D - 0x23ee5d00 [acpi_task_1] 100093 D - 0x23ee5d00 [acpi_task_2] 100095 D - 0x11f60a80 [CAM taskq] db:0:pho> show freepages DOMAIN: 0 FREE LIST 0: ORDER (SIZE) | NUMBER | POOL 0 -- -- -- -- 09 (002048K) | 000520 08 (001024K) | 000072 07 (000512K) | 000743 06 (000256K) | 003196 05 (000128K) | 003507 04 (000064K) | 006630 03 (000032K) | 010650 02 (000016K) | 011808 01 (000008K) | 014716 00 (000004K) | 018988 FREE LIST 1: ORDER (SIZE) | NUMBER | POOL 0 -- -- -- -- 09 (002048K) | 000918 08 (001024K) | 000556 07 (000512K) | 000764 06 (000256K) | 000796 05 (000128K) | 001187 04 (000064K) | 001500 03 (000032K) | 001707 02 (000016K) | 002010 01 (000008K) | 002399 00 (000004K) | 002772 FREE LIST 2: ORDER (SIZE) | NUMBER | POOL 0 -- -- -- -- 09 (002048K) | 000000 08 (001024K) | 000000 07 (000512K) | 000000 06 (000256K) | 000001 05 (000128K) | 000001 04 (000064K) | 000001 03 (000032K) | 000002 02 (000016K) | 000003 01 (000008K) | 000003 00 (000004K) | 000001 db:0:pho> acttrace Tracing command idle pid 11 tid 100003 td 0x11fd7700 (CPU 0) cpustop_handler(0,1b6d4bbc,1b6d4bb0,152f582,0,...) at cpustop_handler+0x27/frame 0x1b6d4ae8 ipi_nmi_handler(0,1b6d4b28,11fd7700,24fedc0,11fce6a8,...) at ipi_nmi_handler+0x34/frame 0x1b6d4af8 trap(1b6d4bbc,8,28,28,2167b800,...) at trap+0xc2/frame 0x1b6d4bb0 calltrap() at 0xffc0316d/frame 0x1b6d4bb0 --- trap 0x13, eip = 0x1545575, esp = 0x1b6d4bfc, ebp = 0x1b6d4bfc --- acpi_cpu_c1(0,0,245b,ee698fc5,24fedc0,...) at acpi_cpu_c1+0x5/frame 0x1b6d4bfc acpi_cpu_idle(adda157,0) at acpi_cpu_idle+0x230/frame 0x1b6d4c2c cpu_idle_acpi(adda157,0) at cpu_idle_acpi+0x35/frame 0x1b6d4c40 cpu_idle(0) at cpu_idle+0xa3/frame 0x1b6d4c5c sched_idletd(0,1b6d4ce8) at sched_idletd+0x3ee/frame 0x1b6d4cb4 fork_exit(ffa440,0,1b6d4ce8,0,0,...) at fork_exit+0x6c/frame 0x1b6d4cd4 fork_trampoline() at 0xffc033ca/frame 0x1b6d4cd4 --- trap 0, eip = 0, esp = 0x1b6d4d20, ebp = 0 --- (null)() at 0 Tracing command idle pid 11 tid 100004 td 0x11fd7380 (CPU 1) cpustop_handler(1,1b6d9bbc,1b6d9bb0,152f582,1f8d1c0,...) at cpustop_handler+0x27/frame 0x1b6d9ae8 ipi_nmi_handler(1f8d1c0,30,11fd7380,1f8d230,11fce6a8,...) at ipi_nmi_handler+0x34/frame 0x1b6d9af8 trap(1b6d9bbc,8,28,28,2167b600,...) at trap+0xc2/frame 0x1b6d9bb0 calltrap() at 0xffc0316d/frame 0x1b6d9bb0 --- trap 0x13, eip = 0x1545575, esp = 0x1b6d9bfc, ebp = 0x1b6d9bfc --- acpi_cpu_c1(0,1,245b,ee6998cb,11e63dc0,...) at acpi_cpu_c1+0x5/frame 0x1b6d9bfc acpi_cpu_idle(706ef695,0) at acpi_cpu_idle+0x230/frame 0x1b6d9c2c cpu_idle_acpi(706ef695,0) at cpu_idle_acpi+0x35/frame 0x1b6d9c40 cpu_idle(0) at cpu_idle+0xa3/frame 0x1b6d9c5c sched_idletd(0,1b6d9ce8) at sched_idletd+0x3ee/frame 0x1b6d9cb4 fork_exit(ffa440,0,1b6d9ce8,0,0,...) at fork_exit+0x6c/frame 0x1b6d9cd4 fork_trampoline() at 0xffc033ca/frame 0x1b6d9cd4 --- trap 0, eip = 0, esp = 0x1b6d9d20, ebp = 0 --- (null)() at 0 Tracing command idle pid 11 tid 100005 td 0x11fd7000 (CPU 2) cpustop_handler(2,1b6debbc,1b6debb0,152f582,1f8d2c0,...) at cpustop_handler+0x27/frame 0x1b6deae8 ipi_nmi_handler(1f8d2c0,30,11fd7000,1f8d330,11fce6a8,...) at ipi_nmi_handler+0x34/frame 0x1b6deaf8 trap(1b6debbc,8,28,28,2167b400,...) at trap+0xc2/frame 0x1b6debb0 calltrap() at 0xffc0316d/frame 0x1b6debb0 --- trap 0x13, eip = 0x1545575, esp = 0x1b6debfc, ebp = 0x1b6debfc --- acpi_cpu_c1(0,2,245b,ee696393,11e68dc0,...) at acpi_cpu_c1+0x5/frame 0x1b6debfc acpi_cpu_idle(2779b2e5,0) at acpi_cpu_idle+0x230/frame 0x1b6dec2c cpu_idle_acpi(2779b2e5,0) at cpu_idle_acpi+0x35/frame 0x1b6dec40 cpu_idle(0) at cpu_idle+0xa3/frame 0x1b6dec5c sched_idletd(0,1b6dece8) at sched_idletd+0x3ee/frame 0x1b6decb4 fork_exit(ffa440,0,1b6dece8,0,0,...) at fork_exit+0x6c/frame 0x1b6decd4 fork_trampoline() at 0xffc033ca/frame 0x1b6decd4 --- trap 0, eip = 0, esp = 0x1b6ded20, ebp = 0 --- (null)() at 0 Tracing command idle pid 11 tid 100006 td 0x11fd6a80 (CPU 3) kdb_alt_break_internal(0) at kdb_alt_break_internal+0xeb/frame 0x1b6e3b00 kdb_alt_break(2,23d6f88c) at kdb_alt_break+0x10/frame 0x1b6e3b0c uart_intr_rxready(23d6f800,ff953d,0,0,11fd6a80,...) at uart_intr_rxready+0x82/frame 0x1b6e3b28 uart_intr(23d6f800) at uart_intr+0x10e/frame 0x1b6e3b48 intr_event_handle(11ad2c00,1b6e3bbc) at intr_event_handle+0xaf/frame 0x1b6e3b68 intr_execute_handlers(11ffe138,1b6e3bbc,3) at intr_execute_handlers+0xc7/frame 0x1b6e3b94 lapic_handle_intr(32,1b6e3bbc,8,28,28,...) at lapic_handle_intr+0x55/frame 0x1b6e3bac Xapic_isr1() at 0xffc04208/frame 0x1b6e3bac --- interrupt, eip = 0x1545575, esp = 0x1b6e3bfc, ebp = 0x1b6e3bfc --- acpi_cpu_c1(0,3,245b,e7ca8b88,11e6ddc0,...) at acpi_cpu_c1+0x5/frame 0x1b6e3bfc acpi_cpu_idle(12fbf340,0) at acpi_cpu_idle+0x230/frame 0x1b6e3c2c cpu_idle_acpi(12fbf340,0) at cpu_idle_acpi+0x35/frame 0x1b6e3c40 cpu_idle(0) at cpu_idle+0xa3/frame 0x1b6e3c5c sched_idletd(0,1b6e3ce8) at sched_idletd+0x3ee/frame 0x1b6e3cb4 fork_exit(ffa440,0,1b6e3ce8,0,0,...) at fork_exit+0x6c/frame 0x1b6e3cd4 fork_trampoline() at 0xffc033ca/frame 0x1b6e3cd4 --- trap 0, eip = 0, esp = 0x1b6e3d20, ebp = 0 --- (null)() at 0 db:0:pho> allt Tracing command sh pid 39585 tid 159750 td 0x7f395380 sched_switch(7f395380,0,104) at sched_switch+0x598/frame 0x813019fc mi_switch(104,0) at mi_switch+0x1de/frame 0x81301a2c sleepq_switch(0,23d73004,8,7f3ac6a8,1ee8c94,...) at sleepq_switch+0xe1/frame 0x81301a50 sleepq_catch_signals(23d73074,7f395380,23d73004,81301ac8,f72668,...) at sleepq_catch_signals+0x3b7/frame 0x81301a7c sleepq_wait_sig(23d73074,0) at sleepq_wait_sig+0x11/frame 0x81301a90 _cv_wait_sig(23d73074,23d73004) at _cv_wait_sig+0x138/frame 0x81301ac8 tty_wait(23d73000,23d73074) at tty_wait+0x35/frame 0x81301ae0 ttydisc_read(23d73000,81301bd8,0) at ttydisc_read+0x1b9/frame 0x81301b14 ttydev_read(11e67c00,81301bd8,0) at ttydev_read+0x3d/frame 0x81301b30 devfs_read_f(2d2307a8,81301bd8,11fa0b00,0,7f395380) at devfs_read_f+0xaa/frame 0x81301b60 dofileread(2d2307a8,81301bd8,ffffffff,ffffffff,0) at dofileread+0x6d/frame 0x81301b90 kern_readv(7f395380,0,81301bd8) at kern_readv+0x3b/frame 0x81301bbc sys_read(7f395380,7f395608) at sys_read+0x48/frame 0x81301c08 syscall(81301ce8,3b,3b,3b,ffbfec50,...) at syscall+0x2d9/frame 0x81301cdc Xint0x80_syscall() at 0xffc033b7/frame 0x81301cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x20606ecb, esp = 0xffbfeb18, ebp = 0xffbfeb2c --- __bss_end() at 0x20606ecb Tracing command syscall4 pid 48604 tid 100433 td 0x33693700 sched_switch(33693700,0,104) at sched_switch+0x598/frame 0x31d59a8c mi_switch(104,0) at mi_switch+0x1de/frame 0x31d59abc sleepq_switch(33693700,0,1ed2638,31d59b34,fd8a37,...) at sleepq_switch+0xe1/frame 0x31d59ae0 sleepq_wait(1ed2638,0) at sleepq_wait+0x3a/frame 0x31d59af4 _sleep(1ed2638,1ed2638,0,1627057,0,0,0,0,100) at _sleep+0x307/frame 0x31d59b34 umtxq_busy(18851,33693700,31995380,206f4000,18a88,...) at umtxq_busy+0x9f/frame 0x31d59b68 do_lock_umutex(0,2) at do_lock_umutex+0x4fc/frame 0x31d59be0 __umtx_op_wait_umutex(33693700,33693988) at __umtx_op_wait_umutex+0x6c/frame 0x31d59c08 syscall(31d59ce8,3b,3b,3b,80018851,...) at syscall+0x2d9/frame 0x31d59cdc Xint0x80_syscall() at 0xffc033b7/frame 0x31d59cdc --- syscall (454, FreeBSD ELF32, sys__umtx_op), eip = 0x2045d3a3, esp = 0xfbbfde94, ebp = 0xfbbfdeb8 --- __bss_end() at 0x2045d3a3 Tracing command syscall4 pid 48604 tid 100843 td 0xa3a53000 sched_switch(a3a53000,0,104) at sched_switch+0x598/frame 0x8faa6a8c mi_switch(104,0) at mi_switch+0x1de/frame 0x8faa6abc sleepq_switch(a3a53000,0,1ed2638,8faa6b34,fd8a37,...) at sleepq_switch+0xe1/frame 0x8faa6ae0 sleepq_wait(1ed2638,0) at sleepq_wait+0x3a/frame 0x8faa6af4 _sleep(1ed2638,1ed2638,0,1627057,0,0,0,0,100) at _sleep+0x307/frame 0x8faa6b34 umtxq_busy(189eb,a3a53000,a27b9680,206f4000,18b98,...) at umtxq_busy+0x9f/frame 0x8faa6b68 do_lock_umutex(0,2) at do_lock_umutex+0x4fc/frame 0x8faa6be0 __umtx_op_wait_umutex(a3a53000,a3a53288) at __umtx_op_wait_umutex+0x6c/frame 0x8faa6c08 syscall(8faa6ce8,3b,3b,3b,800189eb,...) at syscall+0x2d9/frame 0x8faa6cdc Xint0x80_syscall() at 0xffc033b7/frame 0x8faa6cdc --- syscall (454, FreeBSD ELF32, sys__umtx_op), eip = 0x2045d3a3, esp = 0xfb9fbe9c, ebp = 0xfb9fbec0 --- __bss_end() at 0x2045d3a3 Tracing command syscall4 pid 48604 tid 101000 td 0x338a8700 sched_switch(338a8700,0,104) at sched_switch+0x598/frame 0x522eba8c mi_switch(104,0) at mi_switch+0x1de/frame 0x522ebabc sleepq_switch(338a8700,0,1ed2638,522ebb34,fd8a37,...) at sleepq_switch+0xe1/frame 0x522ebae0 sleepq_wait(1ed2638,0) at sleepq_wait+0x3a/frame 0x522ebaf4 _sleep(1ed2638,1ed2638,0,1627057,0,0,0,0,100) at _sleep+0x307/frame 0x522ebb34 umtxq_busy(18a88,338a8700,338a5f00,206f4000,189eb,...) at umtxq_busy+0x9f/frame 0x522ebb68 do_lock_umutex(0,2) at do_lock_umutex+0x4fc/frame 0x522ebbe0 __umtx_op_wait_umutex(338a8700,338a8988) at __umtx_op_wait_umutex+0x6c/frame 0x522ebc08 syscall(522ebce8,3b,3b,3b,80018a88,...) at syscall+0x2d9/frame 0x522ebcdc Xint0x80_syscall() at 0xffc033b7/frame 0x522ebcdc --- syscall (454, FreeBSD ELF32, sys__umtx_op), eip = 0x2045d3a3, esp = 0xfb5f7e9c, ebp = 0xfb5f7ec0 --- __bss_end() at 0x2045d3a3 Tracing command syscall4 pid 48604 tid 101272 td 0x33693a80 sched_switch(33693a80,0,10a) at sched_switch+0x598/frame 0x812b8b34 mi_switch(10a,0) at mi_switch+0x1de/frame 0x812b8b64 thread_suspend_switch(33693a80,2e0dd9fc) at thread_suspend_switch+0xfc/frame 0x812b8b94 thread_single(2e0dd9fc,1) at thread_single+0x437/frame 0x812b8bc0 exit1(33693a80,1,0,812b8cdc,1530869,...) at exit1+0xa8/frame 0x812b8bf4 sys_sys_exit(33693a80,33693d08) at sys_sys_exit+0x12/frame 0x812b8c08 syscall(812b8ce8,3b,3b,3b,fb2f4bd0,...) at syscall+0x2d9/frame 0x812b8cdc Xint0x80_syscall() at 0xffc033b7/frame 0x812b8cdc --- syscall (1, FreeBSD ELF32, sys_sys_exit), eip = 0x2057d443, esp = 0xfb2f4838, ebp = 0xfb2f4848 --- __bss_end() at 0x2057d443 Tracing command syscall4 pid 48575 tid 100265 td 0x8672b000 sched_switch(8672b000,0,104) at sched_switch+0x598/frame 0x5223fa8c mi_switch(104,0) at mi_switch+0x1de/frame 0x5223fabc sleepq_switch(8672b000,0,1ecdb08,5223fb34,fd8a37,...) at sleepq_switch+0xe1/frame 0x5223fae0 sleepq_wait(1ecdb08,0) at sleepq_wait+0x3a/frame 0x5223faf4 _sleep(1ecdb08,1ecdb08,0,1627057,0,0,0,0,100) at _sleep+0x307/frame 0x5223fb34 umtxq_busy(187a9,8672b000,866ea800,2061ae60,187e1,...) at umtxq_busy+0x9f/frame 0x5223fb68 do_lock_umutex(0,2) at do_lock_umutex+0x4fc/frame 0x5223fbe0 __umtx_op_wait_umutex(8672b000,8672b288) at __umtx_op_wait_umutex+0x6c/frame 0x5223fc08 syscall(5223fce8,3b,3b,3b,800187a9,...) at syscall+0x2d9/frame 0x5223fcdc Xint0x80_syscall() at 0xffc033b7/frame 0x5223fcdc --- syscall (454, FreeBSD ELF32, sys__umtx_op), eip = 0x2045d3a3, esp = 0xfbbfdcfc, ebp = 0xfbbfdd20 --- __bss_end() at 0x2045d3a3 Tracing command syscall4 pid 48575 tid 100300 td 0x6407fa80 sched_switch(6407fa80,0,104) at sched_switch+0x598/frame 0x69a63a8c mi_switch(104,0) at mi_switch+0x1de/frame 0x69a63abc sleepq_switch(6407fa80,0,1ecdb08,69a63b34,fd8a37,...) at sleepq_switch+0xe1/frame 0x69a63ae0 sleepq_wait(1ecdb08,0) at sleepq_wait+0x3a/frame 0x69a63af4 _sleep(1ecdb08,1ecdb08,0,1627057,0,0,0,0,100) at _sleep+0x307/frame 0x69a63b34 umtxq_busy(187cc,6407fa80,6404a900,2061ae60,187e1,...) at umtxq_busy+0x9f/frame 0x69a63b68 do_lock_umutex(0,2) at do_lock_umutex+0x4fc/frame 0x69a63be0 __umtx_op_wait_umutex(6407fa80,6407fd08) at __umtx_op_wait_umutex+0x6c/frame 0x69a63c08 syscall(69a63ce8,3b,3b,3b,800187cc,...) at syscall+0x2d9/frame 0x69a63cdc Xint0x80_syscall() at 0xffc033b7/frame 0x69a63cdc --- syscall (454, FreeBSD ELF32, sys__umtx_op), eip = 0x2045d3a3, esp = 0xfbafcd04, ebp = 0xfbafcd28 --- __bss_end() at 0x2045d3a3 Tracing command syscall4 pid 48575 tid 100330 td 0x31833700 sched_switch(31833700,0,104) at sched_switch+0x598/frame 0x315a4a8c mi_switch(104,0) at mi_switch+0x1de/frame 0x315a4abc sleepq_switch(31833700,0,1ecdb08,315a4b34,fd8a37,...) at sleepq_switch+0xe1/frame 0x315a4ae0 sleepq_wait(1ecdb08,0) at sleepq_wait+0x3a/frame 0x315a4af4 _sleep(1ecdb08,1ecdb08,0,1627057,0,0,0,0,100) at _sleep+0x307/frame 0x315a4b34 umtxq_busy(187ea,31833700,31811800,2061ae60,187e1,...) at umtxq_busy+0x9f/frame 0x315a4b68 do_lock_umutex(0,2) at do_lock_umutex+0x4fc/frame 0x315a4be0 __umtx_op_wait_umutex(31833700,31833988) at __umtx_op_wait_umutex+0x6c/frame 0x315a4c08 syscall(315a4ce8,3b,3b,3b,800187ea,...) at syscall+0x2d9/frame 0x315a4cdc Xint0x80_syscall() at 0xffc033b7/frame 0x315a4cdc --- syscall (454, FreeBSD ELF32, sys__umtx_op), eip = 0x2045d3a3, esp = 0xfb7f9d04, ebp = 0xfb7f9d28 --- __bss_end() at 0x2045d3a3 Tracing command syscall4 pid 48575 tid 100359 td 0x3171c000 sched_switch(3171c000,0,104) at sched_switch+0x598/frame 0x71988a8c mi_switch(104,0) at mi_switch+0x1de/frame 0x71988abc sleepq_switch(3171c000,0,1ecdb08,71988b34,fd8a37,...) at sleepq_switch+0xe1/frame 0x71988ae0 sleepq_wait(1ecdb08,0) at sleepq_wait+0x3a/frame 0x71988af4 _sleep(1ecdb08,1ecdb08,0,1627057,0,0,0,0,100) at _sleep+0x307/frame 0x71988b34 umtxq_busy(18807,3171c000,316c2600,2061ae60,187e1,...) at umtxq_busy+0x9f/frame 0x71988b68 do_lock_umutex(0,2) at do_lock_umutex+0x4fc/frame 0x71988be0 __umtx_op_wait_umutex(3171c000,3171c288) at __umtx_op_wait_umutex+0x6c/frame 0x71988c08 syscall(71988ce8,3b,3b,3b,80018807,...) at syscall+0x2d9/frame 0x71988cdc Xint0x80_syscall() at 0xffc033b7/frame 0x71988cdc --- syscall (454, FreeBSD ELF32, sys__umtx_op), eip = 0x2045d3a3, esp = 0xfb6f8d04, ebp = 0xfb6f8d28 --- __bss_end() at 0x2045d3a3 Tracing command syscall4 pid 48575 tid 100435 td 0x30fc6a80 sched_switch(30fc6a80,0,104) at sched_switch+0x598/frame 0x63d46a8c mi_switch(104,0) at mi_switch+0x1de/frame 0x63d46abc sleepq_switch(30fc6a80,0,1ecdb08,63d46b34,fd8a37,...) at sleepq_switch+0xe1/frame 0x63d46ae0 sleepq_wait(1ecdb08,0) at sleepq_wait+0x3a/frame 0x63d46af4 _sleep(1ecdb08,1ecdb08,0,1627057,0,0,0,0,100) at _sleep+0x307/frame 0x63d46b34 umtxq_busy(18853,30fc6a80,11ffdb00,2061ae60,1880f,...) at umtxq_busy+0x9f/frame 0x63d46b68 do_lock_umutex(0,2) at do_lock_umutex+0x4fc/frame 0x63d46be0 __umtx_op_wait_umutex(30fc6a80,30fc6d08) at __umtx_op_wait_umutex+0x6c/frame 0x63d46c08 syscall(63d46ce8,3b,3b,3b,80018853,...) at syscall+0x2d9/frame 0x63d46cdc Xint0x80_syscall() at 0xffc033b7/frame 0x63d46cdc --- syscall (454, FreeBSD ELF32, sys__umtx_op), eip = 0x2045d3a3, esp = 0xfb2f4d04, ebp = 0xfb2f4d28 --- __bss_end() at 0x2045d3a3 Tracing command syscall4 pid 48575 tid 101557 td 0x31809700 sched_switch(31809700,0,10a) at sched_switch+0x598/frame 0x322a1b34 mi_switch(10a,0) at mi_switch+0x1de/frame 0x322a1b64 thread_suspend_switch(31809700,243e5000) at thread_suspend_switch+0xfc/frame 0x322a1b94 thread_single(243e5000,1) at thread_single+0x437/frame 0x322a1bc0 exit1(31809700,1,0,322a1cdc,1530869,...) at exit1+0xa8/frame 0x322a1bf4 sys_sys_exit(31809700,31809988) at sys_sys_exit+0x12/frame 0x322a1c08 syscall(322a1ce8,3b,3b,3b,f89cbbd0,...) at syscall+0x2d9/frame 0x322a1cdc Xint0x80_syscall() at 0xffc033b7/frame 0x322a1cdc --- syscall (1, FreeBSD ELF32, sys_sys_exit), eip = 0x2057d443, esp = 0xf89cb838, ebp = 0xf89cb848 --- __bss_end() at 0x2057d443 Tracing command md10 pid 37655 tid 101524 td 0x33f06000 sched_switch(33f06000,0,104) at sched_switch+0x598/frame 0x63e04bc4 mi_switch(104,0) at mi_switch+0x1de/frame 0x63e04bf4 sleepq_switch(33f06000,0,426c3000,63e04c6c,fd8a37,...) at sleepq_switch+0xe1/frame 0x63e04c18 sleepq_wait(426c3000,5c) at sleepq_wait+0x3a/frame 0x63e04c2c _sleep(426c3000,426c3028,25c,1619471,0,0,0,0,100) at _sleep+0x307/frame 0x63e04c6c md_kthread(426c3000,63e04ce8) at md_kthread+0x1c2/frame 0x63e04cb4 fork_exit(bde510,426c3000,63e04ce8,0,0,...) at fork_exit+0x6c/frame 0x63e04cd4 fork_trampoline() at 0xffc033ca/frame 0x63e04cd4 --- trap 0, eip = 0, esp = 0x63e04d20, ebp = 0 --- (null)() at 0 Tracing command aiod4 pid 23410 tid 100928 td 0x31843700 sched_switch(31843700,0,104) at sched_switch+0x598/frame 0x31a57bac mi_switch(104,0) at mi_switch+0x1de/frame 0x31a57bdc sleepq_switch(2,31843700,177,31843700,0,...) at sleepq_switch+0xe1/frame 0x31a57c00 sleepq_timedwait(34ea86a8,5c,0,31a57c68,163a7ce,...) at sleepq_timedwait+0x47/frame 0x31a57c30 _sleep(34ea86a8,1f466f0,5c,15bf58f,ffffdd50,1d,0,0,100) at _sleep+0x23c/frame 0x31a57c70 aio_daemon(4,31a57ce8) at aio_daemon+0x297/frame 0x31a57cb4 fork_exit(106a190,4,31a57ce8,0,0,...) at fork_exit+0x6c/frame 0x31a57cd4 fork_trampoline() at 0xffc033ca/frame 0x31a57cd4 --- trap 0, eip = 0, esp = 0x31a57d20, ebp = 0 --- (null)() at 0 Tracing command aiod3 pid 23409 tid 101575 td 0x3183ba80 sched_switch(3183ba80,0,104) at sched_switch+0x598/frame 0x31cfabac mi_switch(104,0) at mi_switch+0x1de/frame 0x31cfabdc sleepq_switch(0,3183ba80,177,3183ba80,0,...) at sleepq_switch+0xe1/frame 0x31cfac00 sleepq_timedwait(3196e9fc,5c,414,33a7e358,2fd56ef4,...) at sleepq_timedwait+0x47/frame 0x31cfac30 _sleep(3196e9fc,1f466f0,5c,15bf58f,ffffdd50,1d,0,0,100) at _sleep+0x23c/frame 0x31cfac70 aio_daemon(3,31cface8) at aio_daemon+0x297/frame 0x31cfacb4 fork_exit(106a190,3,31cface8,0,0,...) at fork_exit+0x6c/frame 0x31cfacd4 fork_trampoline() at 0xffc033ca/frame 0x31cfacd4 --- trap 0, eip = 0, esp = 0x31cfad20, ebp = 0 --- (null)() at 0 Tracing command aiod2 pid 23408 tid 101227 td 0x31975380 sched_switch(31975380,0,104) at sched_switch+0x598/frame 0x323a3bac mi_switch(104,0) at mi_switch+0x1de/frame 0x323a3bdc sleepq_switch(0,31975380,177,31975380,0,...) at sleepq_switch+0xe1/frame 0x323a3c00 sleepq_timedwait(2e1e59fc,5c,414,2fd5a85c,34d18658,...) at sleepq_timedwait+0x47/frame 0x323a3c30 _sleep(2e1e59fc,1f466f0,5c,15bf58f,ffffdd50,1d,0,0,100) at _sleep+0x23c/frame 0x323a3c70 aio_daemon(2,323a3ce8) at aio_daemon+0x297/frame 0x323a3cb4 fork_exit(106a190,2,323a3ce8,0,0,...) at fork_exit+0x6c/frame 0x323a3cd4 fork_trampoline() at 0xffc033ca/frame 0x323a3cd4 --- trap 0, eip = 0, esp = 0x323a3d20, ebp = 0 --- (null)() at 0 Tracing command aiod1 pid 23407 tid 100642 td 0x3195c700 sched_switch(3195c700,0,104) at sched_switch+0x598/frame 0x321e4bac mi_switch(104,0) at mi_switch+0x1de/frame 0x321e4bdc sleepq_switch(1,3195c700,177,3195c700,0,...) at sleepq_switch+0xe1/frame 0x321e4c00 sleepq_timedwait(2e8b36a8,5c,414,33a7e1ac,a43ed9f8,...) at sleepq_timedwait+0x47/frame 0x321e4c30 _sleep(2e8b36a8,1f466f0,5c,15bf58f,ffffdd50,1d,0,0,100) at _sleep+0x23c/frame 0x321e4c70 aio_daemon(1,321e4ce8) at aio_daemon+0x297/frame 0x321e4cb4 fork_exit(106a190,1,321e4ce8,0,0,...) at fork_exit+0x6c/frame 0x321e4cd4 fork_trampoline() at 0xffc033ca/frame 0x321e4cd4 --- trap 0, eip = 0, esp = 0x321e4d20, ebp = 0 --- (null)() at 0 Tracing command syncer pid 25 tid 100104 td 0x11bb2a80 sched_switch(11bb2a80,0,104) at sched_switch+0x598/frame 0x271f4b8c mi_switch(104,0) at mi_switch+0x1de/frame 0x271f4bbc sleepq_switch(cb,11bb2a80,1bed538,11bb2a80,271f4c14,...) at sleepq_switch+0xe1/frame 0x271f4be0 sleepq_timedwait(1f46de4,0) at sleepq_timedwait+0x47/frame 0x271f4c10 _cv_timedwait_sbt(1f46de4,1f46dc4,fffffed8,0,0,0,100) at _cv_timedwait_sbt+0x157/frame 0x271f4c4c sched_sync(0,271f4ce8) at sched_sync+0x5e3/frame 0x271f4cb4 fork_exit(1090700,0,271f4ce8,0,0,...) at fork_exit+0x6c/frame 0x271f4cd4 fork_trampoline() at 0xffc033ca/frame 0x271f4cd4 --- trap 0, eip = 0, esp = 0x271f4d20, ebp = 0 --- (null)() at 0 Tracing command vnlru pid 24 tid 100103 td 0x11bb3000 sched_switch(11bb3000,0,104) at sched_switch+0x598/frame 0x22bfdb74 mi_switch(104,0) at mi_switch+0x1de/frame 0x22bfdba4 sleepq_switch(2,11bb3000,11bb3000,0,2488e354,...) at sleepq_switch+0xe1/frame 0x22bfdbc8 sleepq_timedwait(2488e354,60,22bfdc28,fb0f75,1ee8a04,...) at sleepq_timedwait+0x47/frame 0x22bfdbf4 _sleep(2488e354,1f46d90,260,167c867,fffffed8,0,0,0,100) at _sleep+0x23c/frame 0x22bfdc34 vnlru_proc(0,22bfdce8) at vnlru_proc+0x8f/frame 0x22bfdcb4 fork_exit(108fec0,0,22bfdce8,0,0,...) at fork_exit+0x6c/frame 0x22bfdcd4 fork_trampoline() at 0xffc033ca/frame 0x22bfdcd4 --- trap 0, eip = 0, esp = 0x22bfdd20, ebp = 0 --- (null)() at 0 Tracing command bufdaemon pid 23 tid 100101 td 0x11bb3380 sched_switch(11bb3380,0,104) at sched_switch+0x598/frame 0x287a5bb4 mi_switch(104,0) at mi_switch+0x1de/frame 0x287a5be4 sleepq_switch(0,11bb3380,11bb3380,0,1f4677c,...) at sleepq_switch+0xe1/frame 0x287a5c08 sleepq_timedwait(1f4677c,54,2488e750,2488e760,0,...) at sleepq_timedwait+0x47/frame 0x287a5c34 _sleep(1f4677c,1bf9b80,54,15a2f76,1999997c,0,0,0,100) at _sleep+0x23c/frame 0x287a5c74 buf_daemon(0,287a5ce8) at buf_daemon+0xb1/frame 0x287a5cb4 fork_exit(1071cc0,0,287a5ce8,0,0,...) at fork_exit+0x6c/frame 0x287a5cd4 fork_trampoline() at 0xffc033ca/frame 0x287a5cd4 --- trap 0, eip = 0, esp = 0x287a5d20, ebp = 0 --- (null)() at 0 Tracing command bufdaemon pid 23 tid 100102 td 0x23d9c700 sched_switch(23d9c700,0,104) at sched_switch+0x598/frame 0x287aaba4 mi_switch(104,0) at mi_switch+0x1de/frame 0x287aabd4 sleepq_switch(3,23d9c700,177,23d9c700,0,...) at sleepq_switch+0xe1/frame 0x287aabf8 sleepq_timedwait(1bfae80,5c,2488e750,2488e760,0,...) at sleepq_timedwait+0x47/frame 0x287aac28 _sleep(1bfae80,1bfadc0,25c,15a66da,fffffed8,0,0,0,100) at _sleep+0x23c/frame 0x287aac68 bufspace_daemon(1bf9c80,287aace8) at bufspace_daemon+0x2cb/frame 0x287aacb4 fork_exit(1071ff0,1bf9c80,287aace8,0,0,...) at fork_exit+0x6c/frame 0x287aacd4 fork_trampoline() at 0xffc033ca/frame 0x287aacd4 --- trap 0, eip = 0, esp = 0x287aad20, ebp = 0 --- (null)() at 0 Tracing command bufdaemon pid 23 tid 100113 td 0x2d371380 sched_switch(2d371380,0,104) at sched_switch+0x598/frame 0x2d0edbb4 mi_switch(104,0) at mi_switch+0x1de/frame 0x2d0edbe4 sleepq_switch(2,2d371380,177,2d371380,0,...) at sleepq_switch+0xe1/frame 0x2d0edc08 sleepq_timedwait(247d9084,54,2d0edc6c,fc9be0,247d9000,...) at sleepq_timedwait+0x47/frame 0x2d0edc38 _sleep(247d9084,247d9000,54,15d3a2e,7fffff6c,0,0,0,100) at _sleep+0x23c/frame 0x2d0edc78 softdep_flush(24975000,2d0edce8) at softdep_flush+0x15c/frame 0x2d0edcb4 fork_exit(1280df0,24975000,2d0edce8,0,0,...) at fork_exit+0x6c/frame 0x2d0edcd4 fork_trampoline() at 0xffc033ca/frame 0x2d0edcd4 --- trap 0, eip = 0, esp = 0x2d0edd20, ebp = 0 --- (null)() at 0 Tracing command bufdaemon pid 23 tid 100114 td 0x2d371000 sched_switch(2d371000,0,104) at sched_switch+0x598/frame 0x2d0f2bb4 mi_switch(104,0) at mi_switch+0x1de/frame 0x2d0f2be4 sleepq_switch(2,2d371000,177,2d371000,0,...) at sleepq_switch+0xe1/frame 0x2d0f2c08 sleepq_timedwait(11b73e84,54,2d0f2c6c,fc9be0,11b73e00,...) at sleepq_timedwait+0x47/frame 0x2d0f2c38 _sleep(11b73e84,11b73e00,54,15d3a2e,7fffff6c,0,0,0,100) at _sleep+0x23c/frame 0x2d0f2c78 softdep_flush(24972000,2d0f2ce8) at softdep_flush+0x15c/frame 0x2d0f2cb4 fork_exit(1280df0,24972000,2d0f2ce8,0,0,...) at fork_exit+0x6c/frame 0x2d0f2cd4 fork_trampoline() at 0xffc033ca/frame 0x2d0f2cd4 --- trap 0, eip = 0, esp = 0x2d0f2d20, ebp = 0 --- (null)() at 0 Tracing command bufdaemon pid 23 tid 100115 td 0x2d370a80 sched_switch(2d370a80,0,104) at sched_switch+0x598/frame 0x2d0f7bb4 mi_switch(104,0) at mi_switch+0x1de/frame 0x2d0f7be4 sleepq_switch(1,2d370a80,177,2d370a80,0,...) at sleepq_switch+0xe1/frame 0x2d0f7c08 sleepq_timedwait(11b74084,54,2d0f7c6c,fc9be0,11b74000,...) at sleepq_timedwait+0x47/frame 0x2d0f7c38 _sleep(11b74084,11b74000,54,15d3a2e,7fffff6c,0,0,0,100) at _sleep+0x23c/frame 0x2d0f7c78 softdep_flush(2d3ca000,2d0f7ce8) at softdep_flush+0x15c/frame 0x2d0f7cb4 fork_exit(1280df0,2d3ca000,2d0f7ce8,0,0,...) at fork_exit+0x6c/frame 0x2d0f7cd4 fork_trampoline() at 0xffc033ca/frame 0x2d0f7cd4 --- trap 0, eip = 0, esp = 0x2d0f7d20, ebp = 0 --- (null)() at 0 Tracing command bufdaemon pid 23 tid 100116 td 0x2d370700 sched_switch(2d370700,0,104) at sched_switch+0x598/frame 0x2d0fcbb4 mi_switch(104,0) at mi_switch+0x1de/frame 0x2d0fcbe4 sleepq_switch(2,2d370700,177,2d370700,0,...) at sleepq_switch+0xe1/frame 0x2d0fcc08 sleepq_timedwait(11b73c84,54,2d0fcc6c,fc9be0,11b73c00,...) at sleepq_timedwait+0x47/frame 0x2d0fcc38 _sleep(11b73c84,11b73c00,54,15d3a2e,7fffff6c,0,0,0,100) at _sleep+0x23c/frame 0x2d0fcc78 softdep_flush(2d3c9000,2d0fcce8) at softdep_flush+0x15c/frame 0x2d0fccb4 fork_exit(1280df0,2d3c9000,2d0fcce8,0,0,...) at fork_exit+0x6c/frame 0x2d0fccd4 fork_trampoline() at 0xffc033ca/frame 0x2d0fccd4 --- trap 0, eip = 0, esp = 0x2d0fcd20, ebp = 0 --- (null)() at 0 Tracing command bufdaemon pid 23 tid 100521 td 0x33ea4700 sched_switch(33ea4700,0,104) at sched_switch+0x598/frame 0x31a75bb4 mi_switch(104,0) at mi_switch+0x1de/frame 0x31a75be4 sleepq_switch(3,33ea4700,177,33ea4700,0,...) at sleepq_switch+0xe1/frame 0x31a75c08 sleepq_timedwait(32887284,54,31a75c6c,fc9be0,32887200,...) at sleepq_timedwait+0x47/frame 0x31a75c38 _sleep(32887284,32887200,54,15d3a2e,7fffff6c,0,0,0,100) at _sleep+0x23c/frame 0x31a75c78 softdep_flush(33e01000,31a75ce8) at softdep_flush+0x15c/frame 0x31a75cb4 fork_exit(1280df0,33e01000,31a75ce8,0,0,...) at fork_exit+0x6c/frame 0x31a75cd4 fork_trampoline() at 0xffc033ca/frame 0x31a75cd4 --- trap 0, eip = 0, esp = 0x31a75d20, ebp = 0 --- (null)() at 0 Tracing command vmdaemon pid 22 tid 100099 td 0x11bb3700 sched_switch(11bb3700,0,104) at sched_switch+0x598/frame 0x2879bb94 mi_switch(104,0) at mi_switch+0x1de/frame 0x2879bbc4 sleepq_switch(11bb3700,0,1f5c238,2879bc3c,fd8a37,...) at sleepq_switch+0xe1/frame 0x2879bbe8 sleepq_wait(1f5c238,74) at sleepq_wait+0x3a/frame 0x2879bbfc _sleep(1f5c238,1f5c224,74,15a2f6f,0,0,0,0,100) at _sleep+0x307/frame 0x2879bc3c vm_daemon(0,2879bce8) at vm_daemon+0xa88/frame 0x2879bcb4 fork_exit(12e31e0,0,2879bce8,0,0,...) at fork_exit+0x6c/frame 0x2879bcd4 fork_trampoline() at 0xffc033ca/frame 0x2879bcd4 --- trap 0, eip = 0, esp = 0x2879bd20, ebp = 0 --- (null)() at 0 Tracing command pagedaemon pid 21 tid 100097 td 0x11bb3a80 sched_switch(11bb3a80,0,104) at sched_switch+0x598/frame 0x22b189d4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22b18a04 sleepq_switch(0,11bb3a80,11bb3a80,0,1f907dc,...) at sleepq_switch+0xe1/frame 0x22b18a28 sleepq_timedwait(1f907dc,54,22b18a8c,fb0321,1c28b00,...) at sleepq_timedwait+0x47/frame 0x22b18a54 _sleep(1f907dc,1f90500,254,15a2f6f,1999997c,0,0,0,100) at _sleep+0x23c/frame 0x22b18a94 vm_pageout_worker(0,11bb3a80,11fcc000,11bb3a80,11fcc000,...) at vm_pageout_worker+0x266/frame 0x22b18c94 vm_pageout(0,22b18ce8) at vm_pageout+0x10a/frame 0x22b18cb4 fork_exit(12d8aa0,0,22b18ce8,0,0,...) at fork_exit+0x6c/frame 0x22b18cd4 fork_trampoline() at 0xffc033ca/frame 0x22b18cd4 --- trap 0, eip = 0, esp = 0x22b18d20, ebp = 0 --- (null)() at 0 Tracing command pagedaemon pid 21 tid 100098 td 0x23d9d000 sched_switch(23d9d000,0,104) at sched_switch+0x598/frame 0x28796a6c mi_switch(104,0) at mi_switch+0x1de/frame 0x28796a9c sleepq_switch(23d9d000,0,1f907e8,28796b14,fd8a37,...) at sleepq_switch+0xe1/frame 0x28796ac0 sleepq_wait(1f907e8,54) at sleepq_wait+0x3a/frame 0x28796ad4 _sleep(1f907e8,1f90440,54,1691717,0,...) at _sleep+0x307/frame 0x28796b14 vm_pageout_laundry_worker(0,28796ce8) at vm_pageout_laundry_worker+0xd03/frame 0x28796cb4 fork_exit(12da200,0,28796ce8,0,0,...) at fork_exit+0x6c/frame 0x28796cd4 fork_trampoline() at 0xffc033ca/frame 0x28796cd4 --- trap 0, eip = 0, esp = 0x28796d20, ebp = 0 --- (null)() at 0 Tracing command pagedaemon pid 21 tid 100100 td 0x23d9ca80 sched_switch(23d9ca80,0,104) at sched_switch+0x598/frame 0x287a0bbc mi_switch(104,0) at mi_switch+0x1de/frame 0x287a0bec sleepq_switch(1ee98c4,23d9ca80,0,1f5be4c,287a0c40,...) at sleepq_switch+0xe1/frame 0x287a0c10 sleepq_timedwait(12b85f0,54,0,287a0cb4,287a0c60,...) at sleepq_timedwait+0x47/frame 0x287a0c3c _sleep(12b85f0,1f5be4c,54,1602a75,fffffed8,0,0,0,100) at _sleep+0x23c/frame 0x287a0c7c uma_reclaim_worker(0,287a0ce8) at uma_reclaim_worker+0x104/frame 0x287a0cb4 fork_exit(12b8cc0,0,287a0ce8,0,0,...) at fork_exit+0x6c/frame 0x287a0cd4 fork_trampoline() at 0xffc033ca/frame 0x287a0cd4 --- trap 0, eip = 0, esp = 0x287a0d20, ebp = 0 --- (null)() at 0 Tracing command rand_harvestq pid 20 tid 100094 td 0x243fe000 sched_switch(243fe000,0,104) at sched_switch+0x598/frame 0x22b09b94 mi_switch(104,0) at mi_switch+0x1de/frame 0x22b09bc4 sleepq_switch(0,243fe000,243fe000,0,1d31c80,...) at sleepq_switch+0xe1/frame 0x22b09be8 sleepq_timedwait(1d31c80,0,1d36d74,0,22b09c50,...) at sleepq_timedwait+0x47/frame 0x22b09c14 _sleep(1d31c80,0,0,15a66da,19999999,0,0,0,4) at _sleep+0x23c/frame 0x22b09c54 random_kthread(0,22b09ce8) at random_kthread+0x23e/frame 0x22b09cb4 fork_exit(d43140,0,22b09ce8,0,0,...) at fork_exit+0x6c/frame 0x22b09cd4 fork_trampoline() at 0xffc033ca/frame 0x22b09cd4 --- trap 0, eip = 0, esp = 0x22b09d20, ebp = 0 --- (null)() at 0 Tracing command sctp_iterator pid 19 tid 100090 td 0x243ff000 sched_switch(243ff000,0,104) at sched_switch+0x598/frame 0x22af1bdc mi_switch(104,0) at mi_switch+0x1de/frame 0x22af1c10 sleepq_switch(243ff000,0,1f8f8bc,22af1c88,fd8a37,...) at sleepq_switch+0xe1/frame 0x22af1c34 sleepq_wait(1f8f8bc,0) at sleepq_wait+0x3a/frame 0x22af1c48 _sleep(1f8f8bc,1f8f884,0,159b324,0,0,0,0,100) at _sleep+0x307/frame 0x22af1c88 sctp_iterator_thread(0,22af1ce8) at sctp_iterator_thread+0x43/frame 0x22af1cb4 fork_exit(114a570,0,22af1ce8,0,0,...) at fork_exit+0x6c/frame 0x22af1cd4 fork_trampoline() at 0xffc033ca/frame 0x22af1cd4 --- trap 0, eip = 0, esp = 0x22af1d20, ebp = 0 --- (null)() at 0 Tracing command soaiod4 pid 18 tid 100089 td 0x243ff380 sched_switch(243ff380,0,104) at sched_switch+0x598/frame 0x22aebbb4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22aebbe4 sleepq_switch(2,243ff380,177,243ff380,0,...) at sleepq_switch+0xe1/frame 0x22aebc08 sleepq_timedwait(1f463a8,0,0,15acac3,161d4f9,...) at sleepq_timedwait+0x47/frame 0x22aebc38 _sleep(1f463a8,1f46388,0,15a66da,ffffdd50,1d,0,0,100) at _sleep+0x23c/frame 0x22aebc78 soaio_kproc_loop(4,22aebce8) at soaio_kproc_loop+0x14b/frame 0x22aebcb4 fork_exit(103b2e0,4,22aebce8,0,0,...) at fork_exit+0x6c/frame 0x22aebcd4 fork_trampoline() at 0xffc033ca/frame 0x22aebcd4 --- trap 0, eip = 0, esp = 0x22aebd20, ebp = 0 --- (null)() at 0 Tracing command soaiod3 pid 17 tid 100088 td 0x243ff700 sched_switch(243ff700,0,104) at sched_switch+0x598/frame 0x22ae6bb4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22ae6be4 sleepq_switch(1,243ff700,177,243ff700,0,...) at sleepq_switch+0xe1/frame 0x22ae6c08 sleepq_timedwait(1f463a8,0,0,15acac3,161d4f9,...) at sleepq_timedwait+0x47/frame 0x22ae6c38 _sleep(1f463a8,1f46388,0,15a66da,ffffdd50,1d,0,0,100) at _sleep+0x23c/frame 0x22ae6c78 soaio_kproc_loop(3,22ae6ce8) at soaio_kproc_loop+0x14b/frame 0x22ae6cb4 fork_exit(103b2e0,3,22ae6ce8,0,0,...) at fork_exit+0x6c/frame 0x22ae6cd4 fork_trampoline() at 0xffc033ca/frame 0x22ae6cd4 --- trap 0, eip = 0, esp = 0x22ae6d20, ebp = 0 --- (null)() at 0 Tracing command soaiod2 pid 16 tid 100087 td 0x243ffa80 sched_switch(243ffa80,0,104) at sched_switch+0x598/frame 0x22ae1bb4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22ae1be4 sleepq_switch(3,243ffa80,177,243ffa80,0,...) at sleepq_switch+0xe1/frame 0x22ae1c08 sleepq_timedwait(1f463a8,0,32107950,5acac3,161d4f9,...) at sleepq_timedwait+0x47/frame 0x22ae1c38 _sleep(1f463a8,1f46388,0,15a66da,ffffdd50,1d,0,0,100) at _sleep+0x23c/frame 0x22ae1c78 soaio_kproc_loop(2,22ae1ce8) at soaio_kproc_loop+0x14b/frame 0x22ae1cb4 fork_exit(103b2e0,2,22ae1ce8,0,0,...) at fork_exit+0x6c/frame 0x22ae1cd4 fork_trampoline() at 0xffc033ca/frame 0x22ae1cd4 --- trap 0, eip = 0, esp = 0x22ae1d20, ebp = 0 --- (null)() at 0 Tracing command soaiod1 pid 9 tid 100086 td 0x23e80000 sched_switch(23e80000,0,104) at sched_switch+0x598/frame 0x22adcbb4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22adcbe4 sleepq_switch(0,23e80000,177,23e80000,0,...) at sleepq_switch+0xe1/frame 0x22adcc08 sleepq_timedwait(1f463a8,0,0,15acac3,161d4f9,...) at sleepq_timedwait+0x47/frame 0x22adcc38 _sleep(1f463a8,1f46388,0,15a66da,ffffdd50,1d,0,0,100) at _sleep+0x23c/frame 0x22adcc78 soaio_kproc_loop(1,22adcce8) at soaio_kproc_loop+0x14b/frame 0x22adccb4 fork_exit(103b2e0,1,22adcce8,0,0,...) at fork_exit+0x6c/frame 0x22adccd4 fork_trampoline() at 0xffc033ca/frame 0x22adccd4 --- trap 0, eip = 0, esp = 0x22adcd20, ebp = 0 --- (null)() at 0 Tracing command fdc0 pid 8 tid 100083 td 0x23d9da80 sched_switch(23d9da80,0,104) at sched_switch+0x598/frame 0x22acdb94 mi_switch(104,0) at mi_switch+0x1de/frame 0x22acdbc4 sleepq_switch(23d9da80,0,216c483c,22acdc3c,fd8a37,...) at sleepq_switch+0xe1/frame 0x22acdbe8 sleepq_wait(216c483c,5c) at sleepq_wait+0x3a/frame 0x22acdbfc _sleep(216c483c,216c48f8,5c,15a66da,0,0,0,0,100) at _sleep+0x307/frame 0x22acdc3c fdc_thread(216c4800,22acdce8) at fdc_thread+0x10f1/frame 0x22acdcb4 fork_exit(14a7700,216c4800,22acdce8,0,0,...) at fork_exit+0x6c/frame 0x22acdcd4 fork_trampoline() at 0xffc033ca/frame 0x22acdcd4 --- trap 0, eip = 0, esp = 0x22acdd20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100048 td 0x21730000 sched_switch(21730000,0,104) at sched_switch+0x598/frame 0x22a15bf4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22a15c24 sleepq_switch(21730000,2170acf8,2170aacc,22a15c94,f72175,...) at sleepq_switch+0xe1/frame 0x22a15c48 sleepq_wait(2170aacc,0) at sleepq_wait+0x3a/frame 0x22a15c5c _cv_wait(2170aacc,2170acf8) at _cv_wait+0x135/frame 0x22a15c94 usb_process(2170aac4,22a15ce8) at usb_process+0x104/frame 0x22a15cb4 fork_exit(e3cfb0,2170aac4,22a15ce8,0,0,...) at fork_exit+0x6c/frame 0x22a15cd4 fork_trampoline() at 0xffc033ca/frame 0x22a15cd4 --- trap 0, eip = 0, esp = 0x22a15d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100049 td 0x2172fa80 sched_switch(2172fa80,0,104) at sched_switch+0x598/frame 0x22a1abf4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22a1ac24 sleepq_switch(2172fa80,2170acf8,2170aafc,22a1ac94,f72175,...) at sleepq_switch+0xe1/frame 0x22a1ac48 sleepq_wait(2170aafc,0) at sleepq_wait+0x3a/frame 0x22a1ac5c _cv_wait(2170aafc,2170acf8) at _cv_wait+0x135/frame 0x22a1ac94 usb_process(2170aaf4,22a1ace8) at usb_process+0x104/frame 0x22a1acb4 fork_exit(e3cfb0,2170aaf4,22a1ace8,0,0,...) at fork_exit+0x6c/frame 0x22a1acd4 fork_trampoline() at 0xffc033ca/frame 0x22a1acd4 --- trap 0, eip = 0, esp = 0x22a1ad20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100050 td 0x2172f700 sched_switch(2172f700,0,104) at sched_switch+0x598/frame 0x22a1fbf4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22a1fc24 sleepq_switch(2172f700,2170acf8,2170ab2c,22a1fc94,f72175,...) at sleepq_switch+0xe1/frame 0x22a1fc48 sleepq_wait(2170ab2c,0) at sleepq_wait+0x3a/frame 0x22a1fc5c _cv_wait(2170ab2c,2170acf8) at _cv_wait+0x135/frame 0x22a1fc94 usb_process(2170ab24,22a1fce8) at usb_process+0x104/frame 0x22a1fcb4 fork_exit(e3cfb0,2170ab24,22a1fce8,0,0,...) at fork_exit+0x6c/frame 0x22a1fcd4 fork_trampoline() at 0xffc033ca/frame 0x22a1fcd4 --- trap 0, eip = 0, esp = 0x22a1fd20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100051 td 0x2172f380 sched_switch(2172f380,0,104) at sched_switch+0x598/frame 0x22a24bf4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22a24c24 sleepq_switch(2172f380,2170acf8,2170ab5c,22a24c94,f72175,...) at sleepq_switch+0xe1/frame 0x22a24c48 sleepq_wait(2170ab5c,0) at sleepq_wait+0x3a/frame 0x22a24c5c _cv_wait(2170ab5c,2170acf8) at _cv_wait+0x135/frame 0x22a24c94 usb_process(2170ab54,22a24ce8) at usb_process+0x104/frame 0x22a24cb4 fork_exit(e3cfb0,2170ab54,22a24ce8,0,0,...) at fork_exit+0x6c/frame 0x22a24cd4 fork_trampoline() at 0xffc033ca/frame 0x22a24cd4 --- trap 0, eip = 0, esp = 0x22a24d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100052 td 0x2172f000 sched_switch(2172f000,0,104) at sched_switch+0x598/frame 0x22a29bf4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22a29c24 sleepq_switch(2172f000,2170acf8,2170ab8c,22a29c94,f72175,...) at sleepq_switch+0xe1/frame 0x22a29c48 sleepq_wait(2170ab8c,0) at sleepq_wait+0x3a/frame 0x22a29c5c _cv_wait(2170ab8c,2170acf8) at _cv_wait+0x135/frame 0x22a29c94 usb_process(2170ab84,22a29ce8) at usb_process+0x104/frame 0x22a29cb4 fork_exit(e3cfb0,2170ab84,22a29ce8,0,0,...) at fork_exit+0x6c/frame 0x22a29cd4 fork_trampoline() at 0xffc033ca/frame 0x22a29cd4 --- trap 0, eip = 0, esp = 0x22a29d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100054 td 0x21720700 sched_switch(21720700,0,104) at sched_switch+0x598/frame 0x22a34bf4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22a34c24 sleepq_switch(21720700,23a91cf8,23a91acc,22a34c94,f72175,...) at sleepq_switch+0xe1/frame 0x22a34c48 sleepq_wait(23a91acc,0) at sleepq_wait+0x3a/frame 0x22a34c5c _cv_wait(23a91acc,23a91cf8) at _cv_wait+0x135/frame 0x22a34c94 usb_process(23a91ac4,22a34ce8) at usb_process+0x104/frame 0x22a34cb4 fork_exit(e3cfb0,23a91ac4,22a34ce8,0,0,...) at fork_exit+0x6c/frame 0x22a34cd4 fork_trampoline() at 0xffc033ca/frame 0x22a34cd4 --- trap 0, eip = 0, esp = 0x22a34d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100055 td 0x21720380 sched_switch(21720380,0,104) at sched_switch+0x598/frame 0x22a39bf4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22a39c24 sleepq_switch(21720380,23a91cf8,23a91afc,22a39c94,f72175,...) at sleepq_switch+0xe1/frame 0x22a39c48 sleepq_wait(23a91afc,0) at sleepq_wait+0x3a/frame 0x22a39c5c _cv_wait(23a91afc,23a91cf8) at _cv_wait+0x135/frame 0x22a39c94 usb_process(23a91af4,22a39ce8) at usb_process+0x104/frame 0x22a39cb4 fork_exit(e3cfb0,23a91af4,22a39ce8,0,0,...) at fork_exit+0x6c/frame 0x22a39cd4 fork_trampoline() at 0xffc033ca/frame 0x22a39cd4 --- trap 0, eip = 0, esp = 0x22a39d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100056 td 0x21720000 sched_switch(21720000,0,104) at sched_switch+0x598/frame 0x22a3ebf4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22a3ec24 sleepq_switch(21720000,23a91cf8,23a91b2c,22a3ec94,f72175,...) at sleepq_switch+0xe1/frame 0x22a3ec48 sleepq_wait(23a91b2c,0) at sleepq_wait+0x3a/frame 0x22a3ec5c _cv_wait(23a91b2c,23a91cf8) at _cv_wait+0x135/frame 0x22a3ec94 usb_process(23a91b24,22a3ece8) at usb_process+0x104/frame 0x22a3ecb4 fork_exit(e3cfb0,23a91b24,22a3ece8,0,0,...) at fork_exit+0x6c/frame 0x22a3ecd4 fork_trampoline() at 0xffc033ca/frame 0x22a3ecd4 --- trap 0, eip = 0, esp = 0x22a3ed20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100057 td 0x23ae2380 sched_switch(23ae2380,0,104) at sched_switch+0x598/frame 0x22a43bf4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22a43c24 sleepq_switch(23ae2380,23a91cf8,23a91b5c,22a43c94,f72175,...) at sleepq_switch+0xe1/frame 0x22a43c48 sleepq_wait(23a91b5c,0) at sleepq_wait+0x3a/frame 0x22a43c5c _cv_wait(23a91b5c,23a91cf8) at _cv_wait+0x135/frame 0x22a43c94 usb_process(23a91b54,22a43ce8) at usb_process+0x104/frame 0x22a43cb4 fork_exit(e3cfb0,23a91b54,22a43ce8,0,0,...) at fork_exit+0x6c/frame 0x22a43cd4 fork_trampoline() at 0xffc033ca/frame 0x22a43cd4 --- trap 0, eip = 0, esp = 0x22a43d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100058 td 0x23ae2000 sched_switch(23ae2000,0,104) at sched_switch+0x598/frame 0x22a48bf4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22a48c24 sleepq_switch(23ae2000,23a91cf8,23a91b8c,22a48c94,f72175,...) at sleepq_switch+0xe1/frame 0x22a48c48 sleepq_wait(23a91b8c,0) at sleepq_wait+0x3a/frame 0x22a48c5c _cv_wait(23a91b8c,23a91cf8) at _cv_wait+0x135/frame 0x22a48c94 usb_process(23a91b84,22a48ce8) at usb_process+0x104/frame 0x22a48cb4 fork_exit(e3cfb0,23a91b84,22a48ce8,0,0,...) at fork_exit+0x6c/frame 0x22a48cd4 fork_trampoline() at 0xffc033ca/frame 0x22a48cd4 --- trap 0, eip = 0, esp = 0x22a48d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100060 td 0x23ae1700 sched_switch(23ae1700,0,104) at sched_switch+0x598/frame 0x22a53bf4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22a53c24 sleepq_switch(23ae1700,23ae3cf8,23ae3acc,22a53c94,f72175,...) at sleepq_switch+0xe1/frame 0x22a53c48 sleepq_wait(23ae3acc,0) at sleepq_wait+0x3a/frame 0x22a53c5c _cv_wait(23ae3acc,23ae3cf8) at _cv_wait+0x135/frame 0x22a53c94 usb_process(23ae3ac4,22a53ce8) at usb_process+0x104/frame 0x22a53cb4 fork_exit(e3cfb0,23ae3ac4,22a53ce8,0,0,...) at fork_exit+0x6c/frame 0x22a53cd4 fork_trampoline() at 0xffc033ca/frame 0x22a53cd4 --- trap 0, eip = 0, esp = 0x22a53d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100061 td 0x23ae1380 sched_switch(23ae1380,0,104) at sched_switch+0x598/frame 0x22a58bf4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22a58c24 sleepq_switch(23ae1380,23ae3cf8,23ae3afc,22a58c94,f72175,...) at sleepq_switch+0xe1/frame 0x22a58c48 sleepq_wait(23ae3afc,0) at sleepq_wait+0x3a/frame 0x22a58c5c _cv_wait(23ae3afc,23ae3cf8) at _cv_wait+0x135/frame 0x22a58c94 usb_process(23ae3af4,22a58ce8) at usb_process+0x104/frame 0x22a58cb4 fork_exit(e3cfb0,23ae3af4,22a58ce8,0,0,...) at fork_exit+0x6c/frame 0x22a58cd4 fork_trampoline() at 0xffc033ca/frame 0x22a58cd4 --- trap 0, eip = 0, esp = 0x22a58d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100062 td 0x23ae1000 sched_switch(23ae1000,0,104) at sched_switch+0x598/frame 0x22a5dbf4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22a5dc24 sleepq_switch(23ae1000,23ae3cf8,23ae3b2c,22a5dc94,f72175,...) at sleepq_switch+0xe1/frame 0x22a5dc48 sleepq_wait(23ae3b2c,0) at sleepq_wait+0x3a/frame 0x22a5dc5c _cv_wait(23ae3b2c,23ae3cf8) at _cv_wait+0x135/frame 0x22a5dc94 usb_process(23ae3b24,22a5dce8) at usb_process+0x104/frame 0x22a5dcb4 fork_exit(e3cfb0,23ae3b24,22a5dce8,0,0,...) at fork_exit+0x6c/frame 0x22a5dcd4 fork_trampoline() at 0xffc033ca/frame 0x22a5dcd4 --- trap 0, eip = 0, esp = 0x22a5dd20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100063 td 0x23ae0a80 sched_switch(23ae0a80,0,104) at sched_switch+0x598/frame 0x22a62bf4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22a62c24 sleepq_switch(23ae0a80,23ae3cf8,23ae3b5c,22a62c94,f72175,...) at sleepq_switch+0xe1/frame 0x22a62c48 sleepq_wait(23ae3b5c,0) at sleepq_wait+0x3a/frame 0x22a62c5c _cv_wait(23ae3b5c,23ae3cf8) at _cv_wait+0x135/frame 0x22a62c94 usb_process(23ae3b54,22a62ce8) at usb_process+0x104/frame 0x22a62cb4 fork_exit(e3cfb0,23ae3b54,22a62ce8,0,0,...) at fork_exit+0x6c/frame 0x22a62cd4 fork_trampoline() at 0xffc033ca/frame 0x22a62cd4 --- trap 0, eip = 0, esp = 0x22a62d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100064 td 0x23ae0700 sched_switch(23ae0700,0,104) at sched_switch+0x598/frame 0x22a67bf4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22a67c24 sleepq_switch(23ae0700,23ae3cf8,23ae3b8c,22a67c94,f72175,...) at sleepq_switch+0xe1/frame 0x22a67c48 sleepq_wait(23ae3b8c,0) at sleepq_wait+0x3a/frame 0x22a67c5c _cv_wait(23ae3b8c,23ae3cf8) at _cv_wait+0x135/frame 0x22a67c94 usb_process(23ae3b84,22a67ce8) at usb_process+0x104/frame 0x22a67cb4 fork_exit(e3cfb0,23ae3b84,22a67ce8,0,0,...) at fork_exit+0x6c/frame 0x22a67cd4 fork_trampoline() at 0xffc033ca/frame 0x22a67cd4 --- trap 0, eip = 0, esp = 0x22a67d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100065 td 0x23ae0380 sched_switch(23ae0380,0,104) at sched_switch+0x598/frame 0x22a6dbf4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22a6dc24 sleepq_switch(23ae0380,23b29cf8,23b29acc,22a6dc94,f72175,...) at sleepq_switch+0xe1/frame 0x22a6dc48 sleepq_wait(23b29acc,0) at sleepq_wait+0x3a/frame 0x22a6dc5c _cv_wait(23b29acc,23b29cf8) at _cv_wait+0x135/frame 0x22a6dc94 usb_process(23b29ac4,22a6dce8) at usb_process+0x104/frame 0x22a6dcb4 fork_exit(e3cfb0,23b29ac4,22a6dce8,0,0,...) at fork_exit+0x6c/frame 0x22a6dcd4 fork_trampoline() at 0xffc033ca/frame 0x22a6dcd4 --- trap 0, eip = 0, esp = 0x22a6dd20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100066 td 0x23ae0000 sched_switch(23ae0000,0,104) at sched_switch+0x598/frame 0x22a72bf4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22a72c24 sleepq_switch(23ae0000,23b29cf8,23b29afc,22a72c94,f72175,...) at sleepq_switch+0xe1/frame 0x22a72c48 sleepq_wait(23b29afc,0) at sleepq_wait+0x3a/frame 0x22a72c5c _cv_wait(23b29afc,23b29cf8) at _cv_wait+0x135/frame 0x22a72c94 usb_process(23b29af4,22a72ce8) at usb_process+0x104/frame 0x22a72cb4 fork_exit(e3cfb0,23b29af4,22a72ce8,0,0,...) at fork_exit+0x6c/frame 0x22a72cd4 fork_trampoline() at 0xffc033ca/frame 0x22a72cd4 --- trap 0, eip = 0, esp = 0x22a72d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100067 td 0x21731a80 sched_switch(21731a80,0,104) at sched_switch+0x598/frame 0x22a77bf4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22a77c24 sleepq_switch(21731a80,23b29cf8,23b29b2c,22a77c94,f72175,...) at sleepq_switch+0xe1/frame 0x22a77c48 sleepq_wait(23b29b2c,0) at sleepq_wait+0x3a/frame 0x22a77c5c _cv_wait(23b29b2c,23b29cf8) at _cv_wait+0x135/frame 0x22a77c94 usb_process(23b29b24,22a77ce8) at usb_process+0x104/frame 0x22a77cb4 fork_exit(e3cfb0,23b29b24,22a77ce8,0,0,...) at fork_exit+0x6c/frame 0x22a77cd4 fork_trampoline() at 0xffc033ca/frame 0x22a77cd4 --- trap 0, eip = 0, esp = 0x22a77d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100068 td 0x21731700 sched_switch(21731700,0,104) at sched_switch+0x598/frame 0x22a7cbf4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22a7cc24 sleepq_switch(21731700,23b29cf8,23b29b5c,22a7cc94,f72175,...) at sleepq_switch+0xe1/frame 0x22a7cc48 sleepq_wait(23b29b5c,0) at sleepq_wait+0x3a/frame 0x22a7cc5c _cv_wait(23b29b5c,23b29cf8) at _cv_wait+0x135/frame 0x22a7cc94 usb_process(23b29b54,22a7cce8) at usb_process+0x104/frame 0x22a7ccb4 fork_exit(e3cfb0,23b29b54,22a7cce8,0,0,...) at fork_exit+0x6c/frame 0x22a7ccd4 fork_trampoline() at 0xffc033ca/frame 0x22a7ccd4 --- trap 0, eip = 0, esp = 0x22a7cd20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100069 td 0x21731380 sched_switch(21731380,0,104) at sched_switch+0x598/frame 0x22a81bf4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22a81c24 sleepq_switch(21731380,23b29cf8,23b29b8c,22a81c94,f72175,...) at sleepq_switch+0xe1/frame 0x22a81c48 sleepq_wait(23b29b8c,0) at sleepq_wait+0x3a/frame 0x22a81c5c _cv_wait(23b29b8c,23b29cf8) at _cv_wait+0x135/frame 0x22a81c94 usb_process(23b29b84,22a81ce8) at usb_process+0x104/frame 0x22a81cb4 fork_exit(e3cfb0,23b29b84,22a81ce8,0,0,...) at fork_exit+0x6c/frame 0x22a81cd4 fork_trampoline() at 0xffc033ca/frame 0x22a81cd4 --- trap 0, eip = 0, esp = 0x22a81d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100070 td 0x23bba700 sched_switch(23bba700,0,104) at sched_switch+0x598/frame 0x22a87bf4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22a87c24 sleepq_switch(23bba700,23b70cf8,23b70acc,22a87c94,f72175,...) at sleepq_switch+0xe1/frame 0x22a87c48 sleepq_wait(23b70acc,0) at sleepq_wait+0x3a/frame 0x22a87c5c _cv_wait(23b70acc,23b70cf8) at _cv_wait+0x135/frame 0x22a87c94 usb_process(23b70ac4,22a87ce8) at usb_process+0x104/frame 0x22a87cb4 fork_exit(e3cfb0,23b70ac4,22a87ce8,0,0,...) at fork_exit+0x6c/frame 0x22a87cd4 fork_trampoline() at 0xffc033ca/frame 0x22a87cd4 --- trap 0, eip = 0, esp = 0x22a87d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100071 td 0x23bba380 sched_switch(23bba380,0,104) at sched_switch+0x598/frame 0x22a8cbf4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22a8cc24 sleepq_switch(23bba380,23b70cf8,23b70afc,22a8cc94,f72175,...) at sleepq_switch+0xe1/frame 0x22a8cc48 sleepq_wait(23b70afc,0) at sleepq_wait+0x3a/frame 0x22a8cc5c _cv_wait(23b70afc,23b70cf8) at _cv_wait+0x135/frame 0x22a8cc94 usb_process(23b70af4,22a8cce8) at usb_process+0x104/frame 0x22a8ccb4 fork_exit(e3cfb0,23b70af4,22a8cce8,0,0,...) at fork_exit+0x6c/frame 0x22a8ccd4 fork_trampoline() at 0xffc033ca/frame 0x22a8ccd4 --- trap 0, eip = 0, esp = 0x22a8cd20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100072 td 0x23bba000 sched_switch(23bba000,0,104) at sched_switch+0x598/frame 0x22a91bf4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22a91c24 sleepq_switch(23bba000,23b70cf8,23b70b2c,22a91c94,f72175,...) at sleepq_switch+0xe1/frame 0x22a91c48 sleepq_wait(23b70b2c,0) at sleepq_wait+0x3a/frame 0x22a91c5c _cv_wait(23b70b2c,23b70cf8) at _cv_wait+0x135/frame 0x22a91c94 usb_process(23b70b24,22a91ce8) at usb_process+0x104/frame 0x22a91cb4 fork_exit(e3cfb0,23b70b24,22a91ce8,0,0,...) at fork_exit+0x6c/frame 0x22a91cd4 fork_trampoline() at 0xffc033ca/frame 0x22a91cd4 --- trap 0, eip = 0, esp = 0x22a91d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100073 td 0x23bb9a80 sched_switch(23bb9a80,0,104) at sched_switch+0x598/frame 0x22a96bf4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22a96c24 sleepq_switch(23bb9a80,23b70cf8,23b70b5c,22a96c94,f72175,...) at sleepq_switch+0xe1/frame 0x22a96c48 sleepq_wait(23b70b5c,0) at sleepq_wait+0x3a/frame 0x22a96c5c _cv_wait(23b70b5c,23b70cf8) at _cv_wait+0x135/frame 0x22a96c94 usb_process(23b70b54,22a96ce8) at usb_process+0x104/frame 0x22a96cb4 fork_exit(e3cfb0,23b70b54,22a96ce8,0,0,...) at fork_exit+0x6c/frame 0x22a96cd4 fork_trampoline() at 0xffc033ca/frame 0x22a96cd4 --- trap 0, eip = 0, esp = 0x22a96d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100074 td 0x23bb9700 sched_switch(23bb9700,0,104) at sched_switch+0x598/frame 0x22a9bbf4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22a9bc24 sleepq_switch(23bb9700,23b70cf8,23b70b8c,22a9bc94,f72175,...) at sleepq_switch+0xe1/frame 0x22a9bc48 sleepq_wait(23b70b8c,0) at sleepq_wait+0x3a/frame 0x22a9bc5c _cv_wait(23b70b8c,23b70cf8) at _cv_wait+0x135/frame 0x22a9bc94 usb_process(23b70b84,22a9bce8) at usb_process+0x104/frame 0x22a9bcb4 fork_exit(e3cfb0,23b70b84,22a9bce8,0,0,...) at fork_exit+0x6c/frame 0x22a9bcd4 fork_trampoline() at 0xffc033ca/frame 0x22a9bcd4 --- trap 0, eip = 0, esp = 0x22a9bd20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100076 td 0x23bb9000 sched_switch(23bb9000,0,104) at sched_switch+0x598/frame 0x22aa6bf4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22aa6c24 sleepq_switch(23bb9000,21704ed0,21704ca4,22aa6c94,f72175,...) at sleepq_switch+0xe1/frame 0x22aa6c48 sleepq_wait(21704ca4,0) at sleepq_wait+0x3a/frame 0x22aa6c5c _cv_wait(21704ca4,21704ed0) at _cv_wait+0x135/frame 0x22aa6c94 usb_process(21704c9c,22aa6ce8) at usb_process+0x104/frame 0x22aa6cb4 fork_exit(e3cfb0,21704c9c,22aa6ce8,0,0,...) at fork_exit+0x6c/frame 0x22aa6cd4 fork_trampoline() at 0xffc033ca/frame 0x22aa6cd4 --- trap 0, eip = 0, esp = 0x22aa6d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100077 td 0x23bb8a80 sched_switch(23bb8a80,0,104) at sched_switch+0x598/frame 0x22aabbf4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22aabc24 sleepq_switch(23bb8a80,21704ed0,21704cd4,22aabc94,f72175,...) at sleepq_switch+0xe1/frame 0x22aabc48 sleepq_wait(21704cd4,0) at sleepq_wait+0x3a/frame 0x22aabc5c _cv_wait(21704cd4,21704ed0) at _cv_wait+0x135/frame 0x22aabc94 usb_process(21704ccc,22aabce8) at usb_process+0x104/frame 0x22aabcb4 fork_exit(e3cfb0,21704ccc,22aabce8,0,0,...) at fork_exit+0x6c/frame 0x22aabcd4 fork_trampoline() at 0xffc033ca/frame 0x22aabcd4 --- trap 0, eip = 0, esp = 0x22aabd20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100078 td 0x23bb8700 sched_switch(23bb8700,0,104) at sched_switch+0x598/frame 0x22ab0bf4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22ab0c24 sleepq_switch(23bb8700,21704ed0,21704d04,22ab0c94,f72175,...) at sleepq_switch+0xe1/frame 0x22ab0c48 sleepq_wait(21704d04,0) at sleepq_wait+0x3a/frame 0x22ab0c5c _cv_wait(21704d04,21704ed0) at _cv_wait+0x135/frame 0x22ab0c94 usb_process(21704cfc,22ab0ce8) at usb_process+0x104/frame 0x22ab0cb4 fork_exit(e3cfb0,21704cfc,22ab0ce8,0,0,...) at fork_exit+0x6c/frame 0x22ab0cd4 fork_trampoline() at 0xffc033ca/frame 0x22ab0cd4 --- trap 0, eip = 0, esp = 0x22ab0d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100079 td 0x23bb8380 sched_switch(23bb8380,0,104) at sched_switch+0x598/frame 0x22ab5bf4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22ab5c24 sleepq_switch(23bb8380,21704ed0,21704d34,22ab5c94,f72175,...) at sleepq_switch+0xe1/frame 0x22ab5c48 sleepq_wait(21704d34,0) at sleepq_wait+0x3a/frame 0x22ab5c5c _cv_wait(21704d34,21704ed0) at _cv_wait+0x135/frame 0x22ab5c94 usb_process(21704d2c,22ab5ce8) at usb_process+0x104/frame 0x22ab5cb4 fork_exit(e3cfb0,21704d2c,22ab5ce8,0,0,...) at fork_exit+0x6c/frame 0x22ab5cd4 fork_trampoline() at 0xffc033ca/frame 0x22ab5cd4 --- trap 0, eip = 0, esp = 0x22ab5d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100080 td 0x23bb8000 sched_switch(23bb8000,0,104) at sched_switch+0x598/frame 0x22ababf4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22abac24 sleepq_switch(23bb8000,21704ed0,21704d64,22abac94,f72175,...) at sleepq_switch+0xe1/frame 0x22abac48 sleepq_wait(21704d64,0) at sleepq_wait+0x3a/frame 0x22abac5c _cv_wait(21704d64,21704ed0) at _cv_wait+0x135/frame 0x22abac94 usb_process(21704d5c,22abace8) at usb_process+0x104/frame 0x22abacb4 fork_exit(e3cfb0,21704d5c,22abace8,0,0,...) at fork_exit+0x6c/frame 0x22abacd4 fork_trampoline() at 0xffc033ca/frame 0x22abacd4 --- trap 0, eip = 0, esp = 0x22abad20, ebp = 0 --- (null)() at 0 Tracing command cam pid 7 tid 100043 td 0x11bb4000 sched_switch(11bb4000,0,104) at sched_switch+0x598/frame 0x1b7c8bc4 mi_switch(104,0) at mi_switch+0x1de/frame 0x1b7c8bf4 sleepq_switch(11bb4000,0,1c6b140,1b7c8c6c,fd8a37,...) at sleepq_switch+0xe1/frame 0x1b7c8c18 sleepq_wait(1c6b140,5c) at sleepq_wait+0x3a/frame 0x1b7c8c2c _sleep(1c6b140,1c6b100,5c,15a66da,0,0,0,0,100) at _sleep+0x307/frame 0x1b7c8c6c xpt_done_td(1c6b100,1b7c8ce8) at xpt_done_td+0x72/frame 0x1b7c8cb4 fork_exit(90a1f0,1c6b100,1b7c8ce8,0,0,...) at fork_exit+0x6c/frame 0x1b7c8cd4 fork_trampoline() at 0xffc033ca/frame 0x1b7c8cd4 --- trap 0, eip = 0, esp = 0x1b7c8d20, ebp = 0 --- (null)() at 0 Tracing command cam pid 7 tid 100096 td 0x243e7700 sched_switch(243e7700,0,104) at sched_switch+0x598/frame 0x22b13bbc mi_switch(104,0) at mi_switch+0x1de/frame 0x22b13bec sleepq_switch(243e7700,0,1c6b06c,22b13c64,fd8a37,...) at sleepq_switch+0xe1/frame 0x22b13c10 sleepq_wait(1c6b06c,5c) at sleepq_wait+0x3a/frame 0x22b13c24 _sleep(1c6b06c,1c6b0cc,5c,15a66da,0,0,0,0,100) at _sleep+0x307/frame 0x22b13c64 xpt_scanner_thread(0,22b13ce8) at xpt_scanner_thread+0x63/frame 0x22b13cb4 fork_exit(90a490,0,22b13ce8,0,0,...) at fork_exit+0x6c/frame 0x22b13cd4 fork_trampoline() at 0xffc033ca/frame 0x22b13cd4 --- trap 0, eip = 0, esp = 0x22b13d20, ebp = 0 --- (null)() at 0 Tracing command crypto returns 3 pid 6 tid 100042 td 0x11bb4380 sched_switch(11bb4380,0,104) at sched_switch+0x598/frame 0x1b7c3bbc mi_switch(104,0) at mi_switch+0x1de/frame 0x1b7c3bec sleepq_switch(11bb4380,0,11ad0dc4,1b7c3c64,fd8a37,...) at sleepq_switch+0xe1/frame 0x1b7c3c10 sleepq_wait(11ad0dc4,6c) at sleepq_wait+0x3a/frame 0x1b7c3c24 _sleep(11ad0dc4,11ad0da8,6c,1687052,0,0,0,0,100) at _sleep+0x307/frame 0x1b7c3c64 crypto_ret_proc(11ad0da8,1b7c3ce8) at crypto_ret_proc+0x1e9/frame 0x1b7c3cb4 fork_exit(1232920,11ad0da8,1b7c3ce8,0,0,...) at fork_exit+0x6c/frame 0x1b7c3cd4 fork_trampoline() at 0xffc033ca/frame 0x1b7c3cd4 --- trap 0, eip = 0, esp = 0x1b7c3d20, ebp = 0 --- (null)() at 0 Tracing command crypto returns 2 pid 5 tid 100041 td 0x11bb4700 sched_switch(11bb4700,0,104) at sched_switch+0x598/frame 0x1b7bebbc mi_switch(104,0) at mi_switch+0x1de/frame 0x1b7bebec sleepq_switch(11bb4700,0,11ad0d8c,1b7bec64,fd8a37,...) at sleepq_switch+0xe1/frame 0x1b7bec10 sleepq_wait(11ad0d8c,6c) at sleepq_wait+0x3a/frame 0x1b7bec24 _sleep(11ad0d8c,11ad0d70,6c,1687052,0,0,0,0,100) at _sleep+0x307/frame 0x1b7bec64 crypto_ret_proc(11ad0d70,1b7bece8) at crypto_ret_proc+0x1e9/frame 0x1b7becb4 fork_exit(1232920,11ad0d70,1b7bece8,0,0,...) at fork_exit+0x6c/frame 0x1b7becd4 fork_trampoline() at 0xffc033ca/frame 0x1b7becd4 --- trap 0, eip = 0, esp = 0x1b7bed20, ebp = 0 --- (null)() at 0 Tracing command crypto returns 1 pid 4 tid 100040 td 0x11bb4a80 sched_switch(11bb4a80,0,104) at sched_switch+0x598/frame 0x1b7b9bbc mi_switch(104,0) at mi_switch+0x1de/frame 0x1b7b9bec sleepq_switch(11bb4a80,0,11ad0d54,1b7b9c64,fd8a37,...) at sleepq_switch+0xe1/frame 0x1b7b9c10 sleepq_wait(11ad0d54,6c) at sleepq_wait+0x3a/frame 0x1b7b9c24 _sleep(11ad0d54,11ad0d38,6c,1687052,0,0,0,0,100) at _sleep+0x307/frame 0x1b7b9c64 crypto_ret_proc(11ad0d38,1b7b9ce8) at crypto_ret_proc+0x1e9/frame 0x1b7b9cb4 fork_exit(1232920,11ad0d38,1b7b9ce8,0,0,...) at fork_exit+0x6c/frame 0x1b7b9cd4 fork_trampoline() at 0xffc033ca/frame 0x1b7b9cd4 --- trap 0, eip = 0, esp = 0x1b7b9d20, ebp = 0 --- (null)() at 0 Tracing command crypto returns 0 pid 3 tid 100039 td 0x11ad9700 sched_switch(11ad9700,0,104) at sched_switch+0x598/frame 0x1b7b4bbc mi_switch(104,0) at mi_switch+0x1de/frame 0x1b7b4bec sleepq_switch(11ad9700,0,11ad0d1c,1b7b4c64,fd8a37,...) at sleepq_switch+0xe1/frame 0x1b7b4c10 sleepq_wait(11ad0d1c,6c) at sleepq_wait+0x3a/frame 0x1b7b4c24 _sleep(11ad0d1c,11ad0d00,6c,1687052,0,0,0,0,100) at _sleep+0x307/frame 0x1b7b4c64 crypto_ret_proc(11ad0d00,1b7b4ce8) at crypto_ret_proc+0x1e9/frame 0x1b7b4cb4 fork_exit(1232920,11ad0d00,1b7b4ce8,0,0,...) at fork_exit+0x6c/frame 0x1b7b4cd4 fork_trampoline() at 0xffc033ca/frame 0x1b7b4cd4 --- trap 0, eip = 0, esp = 0x1b7b4d20, ebp = 0 --- (null)() at 0 Tracing command crypto pid 2 tid 100038 td 0x11ad9a80 sched_switch(11ad9a80,0,104) at sched_switch+0x598/frame 0x1b7afbcc mi_switch(104,0) at mi_switch+0x1de/frame 0x1b7afbfc sleepq_switch(11ad9a80,0,1f5aff8,1b7afc74,fd8a37,...) at sleepq_switch+0xe1/frame 0x1b7afc20 sleepq_wait(1f5aff8,6c) at sleepq_wait+0x3a/frame 0x1b7afc34 _sleep(1f5aff8,1f5afe0,6c,163ba01,0,0,0,0,100) at _sleep+0x307/frame 0x1b7afc74 crypto_proc(0,1b7afce8) at crypto_proc+0x250/frame 0x1b7afcb4 fork_exit(12325a0,0,1b7afce8,0,0,...) at fork_exit+0x6c/frame 0x1b7afcd4 fork_trampoline() at 0xffc033ca/frame 0x1b7afcd4 --- trap 0, eip = 0, esp = 0x1b7afd20, ebp = 0 --- (null)() at 0 Tracing command sequencer 00 pid 14 tid 100033 td 0x11e6c000 sched_switch(11e6c000,0,104) at sched_switch+0x598/frame 0x1b796bcc mi_switch(104,0) at mi_switch+0x1de/frame 0x1b796bfc sleepq_switch(11e6c000,11b9f804,11b9f84c,1b796c6c,f72175,...) at sleepq_switch+0xe1/frame 0x1b796c20 sleepq_wait(11b9f84c,0) at sleepq_wait+0x3a/frame 0x1b796c34 _cv_wait(11b9f84c,11b9f804) at _cv_wait+0x135/frame 0x1b796c6c seq_eventthread(11b9f800,1b796ce8) at seq_eventthread+0xcb/frame 0x1b796cb4 fork_exit(dc54b0,11b9f800,1b796ce8,0,0,...) at fork_exit+0x6c/frame 0x1b796cd4 fork_trampoline() at 0xffc033ca/frame 0x1b796cd4 --- trap 0, eip = 0, esp = 0x1b796d20, ebp = 0 --- (null)() at 0 Tracing command geom pid 13 tid 100030 td 0x11e6ca80 sched_switch(11e6ca80,0,104) at sched_switch+0x598/frame 0x1b783bd4 mi_switch(104,0) at mi_switch+0x1de/frame 0x1b783c04 sleepq_switch(11e6ca80,0,1f7f868,1b783c7c,fd8a37,...) at sleepq_switch+0xe1/frame 0x1b783c28 sleepq_wait(1f7f868,5c) at sleepq_wait+0x3a/frame 0x1b783c3c _sleep(1f7f868,1ec6fec,25c,15a66da,0,0,0,0,100) at _sleep+0x307/frame 0x1b783c7c g_run_events(0,1b783ce8) at g_run_events+0x47/frame 0x1b783cb4 fork_exit(f28270,0,1b783ce8,0,0,...) at fork_exit+0x6c/frame 0x1b783cd4 fork_trampoline() at 0xffc033ca/frame 0x1b783cd4 --- trap 0, eip = 0, esp = 0x1b783d20, ebp = 0 --- (null)() at 0 Tracing command geom pid 13 tid 100031 td 0x11e6c700 sched_switch(11e6c700,0,104) at sched_switch+0x598/frame 0x1b788bcc mi_switch(104,0) at mi_switch+0x1de/frame 0x1b788bfc sleepq_switch(11e6c700,0,1f7f870,1b788c74,fd8a37,...) at sleepq_switch+0xe1/frame 0x1b788c20 sleepq_wait(1f7f870,5c) at sleepq_wait+0x3a/frame 0x1b788c34 _sleep(1f7f870,1ec7034,25c,15a66da,0,0,0,0,100) at _sleep+0x307/frame 0x1b788c74 g_io_schedule_up(11e6c700) at g_io_schedule_up+0x8e/frame 0x1b788ca8 g_up_procbody(0,1b788ce8) at g_up_procbody+0x5b/frame 0x1b788cb4 fork_exit(f282c0,0,1b788ce8,0,0,...) at fork_exit+0x6c/frame 0x1b788cd4 fork_trampoline() at 0xffc033ca/frame 0x1b788cd4 --- trap 0, eip = 0, esp = 0x1b788d20, ebp = 0 --- (null)() at 0 Tracing command geom pid 13 tid 100032 td 0x11e6c380 sched_switch(11e6c380,0,104) at sched_switch+0x598/frame 0x1b78dbc4 mi_switch(104,0) at mi_switch+0x1de/frame 0x1b78dbf8 sleepq_switch(11e6c380,0,1f7f864,1b78dc70,fd8a37,...) at sleepq_switch+0xe1/frame 0x1b78dc1c sleepq_wait(1f7f864,5c) at sleepq_wait+0x3a/frame 0x1b78dc30 _sleep(1f7f864,1ec7014,25c,15a66da,0,0,0,0,100) at _sleep+0x307/frame 0x1b78dc70 g_io_schedule_down(11e6c380) at g_io_schedule_down+0xa6/frame 0x1b78dca8 g_down_procbody(0,1b78dce8) at g_down_procbody+0x5b/frame 0x1b78dcb4 fork_exit(f28320,0,1b78dce8,0,0,...) at fork_exit+0x6c/frame 0x1b78dcd4 fork_trampoline() at 0xffc033ca/frame 0x1b78dcd4 --- trap 0, eip = 0, esp = 0x1b78dd20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100008 td 0x11fd6380 sched_switch(11fd6380,0,109) at sched_switch+0x598/frame 0x1b6f1c4c mi_switch(109,0) at mi_switch+0x1de/frame 0x1b6f1c80 ithread_loop(11ad5020,1b6f1ce8) at ithread_loop+0x2f5/frame 0x1b6f1cb4 fork_exit(f96980,11ad5020,1b6f1ce8,0,0,...) at fork_exit+0x6c/frame 0x1b6f1cd4 fork_trampoline() at 0xffc033ca/frame 0x1b6f1cd4 --- trap 0, eip = 0, esp = 0x1b6f1d20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100009 td 0x11fd6000 sched_switch(11fd6000,0,109) at sched_switch+0x598/frame 0x1b6f6c4c mi_switch(109,0) at mi_switch+0x1de/frame 0x1b6f6c80 ithread_loop(11ad5010,1b6f6ce8) at ithread_loop+0x2f5/frame 0x1b6f6cb4 fork_exit(f96980,11ad5010,1b6f6ce8,0,0,...) at fork_exit+0x6c/frame 0x1b6f6cd4 fork_trampoline() at 0xffc033ca/frame 0x1b6f6cd4 --- trap 0, eip = 0, esp = 0x1b6f6d20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100011 td 0x11fd0700 exit_tag() at 0xffc033c0 Tracing command intr pid 12 tid 100023 td 0x11ad7000 sched_switch(11ad7000,0,109) at sched_switch+0x598/frame 0x1b748c4c mi_switch(109,0) at mi_switch+0x1de/frame 0x1b748c80 ithread_loop(11ad4f90,1b748ce8) at ithread_loop+0x2f5/frame 0x1b748cb4 fork_exit(f96980,11ad4f90,1b748ce8,0,0,...) at fork_exit+0x6c/frame 0x1b748cd4 fork_trampoline() at 0xffc033ca/frame 0x1b748cd4 --- trap 0, eip = 0, esp = 0x1b748d20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100024 td 0x11fd8a80 exit_tag() at 0xffc033c0 Tracing command intr pid 12 tid 100025 td 0x11fd8700 exit_tag() at 0xffc033c0 Tracing command intr pid 12 tid 100026 td 0x11fd8380 exit_tag() at 0xffc033c0 Tracing command intr pid 12 tid 100027 td 0x11e64700 sched_switch(11e64700,0,109) at sched_switch+0x598/frame 0x1b75cc4c mi_switch(109,0) at mi_switch+0x1de/frame 0x1b75cc80 ithread_loop(11ad4f50,1b75cce8) at ithread_loop+0x2f5/frame 0x1b75ccb4 fork_exit(f96980,11ad4f50,1b75cce8,0,0,...) at fork_exit+0x6c/frame 0x1b75ccd4 fork_trampoline() at 0xffc033ca/frame 0x1b75ccd4 --- trap 0, eip = 0, esp = 0x1b75cd20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100028 td 0x11e64380 exit_tag() at 0xffc033c0 Tracing command intr pid 12 tid 100044 td 0x21731000 sched_switch(21731000,0,109) at sched_switch+0x598/frame 0x1b7fac4c mi_switch(109,0) at mi_switch+0x1de/frame 0x1b7fac80 ithread_loop(2171f050,1b7face8) at ithread_loop+0x2f5/frame 0x1b7facb4 fork_exit(f96980,2171f050,1b7face8,0,0,...) at fork_exit+0x6c/frame 0x1b7facd4 fork_trampoline() at 0xffc033ca/frame 0x1b7facd4 --- trap 0, eip = 0, esp = 0x1b7fad20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100045 td 0x21730a80 sched_switch(21730a80,0,109) at sched_switch+0x598/frame 0x22a04c4c mi_switch(109,0) at mi_switch+0x1de/frame 0x22a04c80 ithread_loop(2171f020,22a04ce8) at ithread_loop+0x2f5/frame 0x22a04cb4 fork_exit(f96980,2171f020,22a04ce8,0,0,...) at fork_exit+0x6c/frame 0x22a04cd4 fork_trampoline() at 0xffc033ca/frame 0x22a04cd4 --- trap 0, eip = 0, esp = 0x22a04d20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100046 td 0x21730700 sched_switch(21730700,0,109) at sched_switch+0x598/frame 0x22a0ac4c mi_switch(109,0) at mi_switch+0x1de/frame 0x22a0ac80 ithread_loop(2171f010,22a0ace8) at ithread_loop+0x2f5/frame 0x22a0acb4 fork_exit(f96980,2171f010,22a0ace8,0,0,...) at fork_exit+0x6c/frame 0x22a0acd4 fork_trampoline() at 0xffc033ca/frame 0x22a0acd4 --- trap 0, eip = 0, esp = 0x22a0ad20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100047 td 0x21730380 sched_switch(21730380,0,109) at sched_switch+0x598/frame 0x22a10c4c mi_switch(109,0) at mi_switch+0x1de/frame 0x22a10c80 ithread_loop(11ad5ea0,22a10ce8) at ithread_loop+0x2f5/frame 0x22a10cb4 fork_exit(f96980,11ad5ea0,22a10ce8,0,0,...) at fork_exit+0x6c/frame 0x22a10cd4 fork_trampoline() at 0xffc033ca/frame 0x22a10cd4 --- trap 0, eip = 0, esp = 0x22a10d20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100053 td 0x21720a80 sched_switch(21720a80,0,109) at sched_switch+0x598/frame 0x22a2fc4c mi_switch(109,0) at mi_switch+0x1de/frame 0x22a2fc80 ithread_loop(11ad5e90,22a2fce8) at ithread_loop+0x2f5/frame 0x22a2fcb4 fork_exit(f96980,11ad5e90,22a2fce8,0,0,...) at fork_exit+0x6c/frame 0x22a2fcd4 fork_trampoline() at 0xffc033ca/frame 0x22a2fcd4 --- trap 0, eip = 0, esp = 0x22a2fd20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100059 td 0x23ae1a80 sched_switch(23ae1a80,0,109) at sched_switch+0x598/frame 0x22a4ec4c mi_switch(109,0) at mi_switch+0x1de/frame 0x22a4ec80 ithread_loop(11ad5e80,22a4ece8) at ithread_loop+0x2f5/frame 0x22a4ecb4 fork_exit(f96980,11ad5e80,22a4ece8,0,0,...) at fork_exit+0x6c/frame 0x22a4ecd4 fork_trampoline() at 0xffc033ca/frame 0x22a4ecd4 --- trap 0, eip = 0, esp = 0x22a4ed20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100075 td 0x23bb9380 exit_tag() at 0xffc033c0 Tracing command intr pid 12 tid 100081 td 0x23ae2a80 sched_switch(23ae2a80,0,109) at sched_switch+0x598/frame 0x22abfc4c mi_switch(109,0) at mi_switch+0x1de/frame 0x22abfc80 ithread_loop(11ad5e60,22abfce8) at ithread_loop+0x2f5/frame 0x22abfcb4 fork_exit(f96980,11ad5e60,22abfce8,0,0,...) at fork_exit+0x6c/frame 0x22abfcd4 fork_trampoline() at 0xffc033ca/frame 0x22abfcd4 --- trap 0, eip = 0, esp = 0x22abfd20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100082 td 0x23ae2700 sched_switch(23ae2700,0,109) at sched_switch+0x598/frame 0x22ac8c4c mi_switch(109,0) at mi_switch+0x1de/frame 0x22ac8c80 ithread_loop(11ad5e10,22ac8ce8) at ithread_loop+0x2f5/frame 0x22ac8cb4 fork_exit(f96980,11ad5e10,22ac8ce8,0,0,...) at fork_exit+0x6c/frame 0x22ac8cd4 fork_trampoline() at 0xffc033ca/frame 0x22ac8cd4 --- trap 0, eip = 0, esp = 0x22ac8d20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100084 td 0x23d9d700 exit_tag() at 0xffc033c0 Tracing command idle pid 11 tid 100003 td 0x11fd7700 (CPU 0) cpustop_handler(0,1b6d4bbc,1b6d4bb0,152f582,0,...) at cpustop_handler+0x27/frame 0x1b6d4ae8 ipi_nmi_handler(0,1b6d4b28,11fd7700,24fedc0,11fce6a8,...) at ipi_nmi_handler+0x34/frame 0x1b6d4af8 trap(1b6d4bbc,8,28,28,2167b800,...) at trap+0xc2/frame 0x1b6d4bb0 calltrap() at 0xffc0316d/frame 0x1b6d4bb0 --- trap 0x13, eip = 0x1545575, esp = 0x1b6d4bfc, ebp = 0x1b6d4bfc --- acpi_cpu_c1(0,0,245b,ee698fc5,24fedc0,...) at acpi_cpu_c1+0x5/frame 0x1b6d4bfc acpi_cpu_idle(adda157,0) at acpi_cpu_idle+0x230/frame 0x1b6d4c2c cpu_idle_acpi(adda157,0) at cpu_idle_acpi+0x35/frame 0x1b6d4c40 cpu_idle(0) at cpu_idle+0xa3/frame 0x1b6d4c5c sched_idletd(0,1b6d4ce8) at sched_idletd+0x3ee/frame 0x1b6d4cb4 fork_exit(ffa440,0,1b6d4ce8,0,0,...) at fork_exit+0x6c/frame 0x1b6d4cd4 fork_trampoline() at 0xffc033ca/frame 0x1b6d4cd4 --- trap 0, eip = 0, esp = 0x1b6d4d20, ebp = 0 --- (null)() at 0 Tracing command idle pid 11 tid 100004 td 0x11fd7380 (CPU 1) cpustop_handler(1,1b6d9bbc,1b6d9bb0,152f582,1f8d1c0,...) at cpustop_handler+0x27/frame 0x1b6d9ae8 ipi_nmi_handler(1f8d1c0,30,11fd7380,1f8d230,11fce6a8,...) at ipi_nmi_handler+0x34/frame 0x1b6d9af8 trap(1b6d9bbc,8,28,28,2167b600,...) at trap+0xc2/frame 0x1b6d9bb0 calltrap() at 0xffc0316d/frame 0x1b6d9bb0 --- trap 0x13, eip = 0x1545575, esp = 0x1b6d9bfc, ebp = 0x1b6d9bfc --- acpi_cpu_c1(0,1,245b,ee6998cb,11e63dc0,...) at acpi_cpu_c1+0x5/frame 0x1b6d9bfc acpi_cpu_idle(706ef695,0) at acpi_cpu_idle+0x230/frame 0x1b6d9c2c cpu_idle_acpi(706ef695,0) at cpu_idle_acpi+0x35/frame 0x1b6d9c40 cpu_idle(0) at cpu_idle+0xa3/frame 0x1b6d9c5c sched_idletd(0,1b6d9ce8) at sched_idletd+0x3ee/frame 0x1b6d9cb4 fork_exit(ffa440,0,1b6d9ce8,0,0,...) at fork_exit+0x6c/frame 0x1b6d9cd4 fork_trampoline() at 0xffc033ca/frame 0x1b6d9cd4 --- trap 0, eip = 0, esp = 0x1b6d9d20, ebp = 0 --- (null)() at 0 Tracing command idle pid 11 tid 100005 td 0x11fd7000 (CPU 2) cpustop_handler(2,1b6debbc,1b6debb0,152f582,1f8d2c0,...) at cpustop_handler+0x27/frame 0x1b6deae8 ipi_nmi_handler(1f8d2c0,30,11fd7000,1f8d330,11fce6a8,...) at ipi_nmi_handler+0x34/frame 0x1b6deaf8 trap(1b6debbc,8,28,28,2167b400,...) at trap+0xc2/frame 0x1b6debb0 calltrap() at 0xffc0316d/frame 0x1b6debb0 --- trap 0x13, eip = 0x1545575, esp = 0x1b6debfc, ebp = 0x1b6debfc --- acpi_cpu_c1(0,2,245b,ee696393,11e68dc0,...) at acpi_cpu_c1+0x5/frame 0x1b6debfc acpi_cpu_idle(2779b2e5,0) at acpi_cpu_idle+0x230/frame 0x1b6dec2c cpu_idle_acpi(2779b2e5,0) at cpu_idle_acpi+0x35/frame 0x1b6dec40 cpu_idle(0) at cpu_idle+0xa3/frame 0x1b6dec5c sched_idletd(0,1b6dece8) at sched_idletd+0x3ee/frame 0x1b6decb4 fork_exit(ffa440,0,1b6dece8,0,0,...) at fork_exit+0x6c/frame 0x1b6decd4 fork_trampoline() at 0xffc033ca/frame 0x1b6decd4 --- trap 0, eip = 0, esp = 0x1b6ded20, ebp = 0 --- (null)() at 0 Tracing command idle pid 11 tid 100006 td 0x11fd6a80 (CPU 3) kdb_alt_break_internal(0) at kdb_alt_break_internal+0xeb/frame 0x1b6e3b00 kdb_alt_break(2,23d6f88c) at kdb_alt_break+0x10/frame 0x1b6e3b0c uart_intr_rxready(23d6f800,ff953d,0,0,11fd6a80,...) at uart_intr_rxready+0x82/frame 0x1b6e3b28 uart_intr(23d6f800) at uart_intr+0x10e/frame 0x1b6e3b48 intr_event_handle(11ad2c00,1b6e3bbc) at intr_event_handle+0xaf/frame 0x1b6e3b68 intr_execute_handlers(11ffe138,1b6e3bbc,3) at intr_execute_handlers+0xc7/frame 0x1b6e3b94 lapic_handle_intr(32,1b6e3bbc,8,28,28,...) at lapic_handle_intr+0x55/frame 0x1b6e3bac Xapic_isr1() at 0xffc04208/frame 0x1b6e3bac --- interrupt, eip = 0x1545575, esp = 0x1b6e3bfc, ebp = 0x1b6e3bfc --- acpi_cpu_c1(0,3,245b,e7ca8b88,11e6ddc0,...) at acpi_cpu_c1+0x5/frame 0x1b6e3bfc acpi_cpu_idle(12fbf340,0) at acpi_cpu_idle+0x230/frame 0x1b6e3c2c cpu_idle_acpi(12fbf340,0) at cpu_idle_acpi+0x35/frame 0x1b6e3c40 cpu_idle(0) at cpu_idle+0xa3/frame 0x1b6e3c5c sched_idletd(0,1b6e3ce8) at sched_idletd+0x3ee/frame 0x1b6e3cb4 fork_exit(ffa440,0,1b6e3ce8,0,0,...) at fork_exit+0x6c/frame 0x1b6e3cd4 fork_trampoline() at 0xffc033ca/frame 0x1b6e3cd4 --- trap 0, eip = 0, esp = 0x1b6e3d20, ebp = 0 --- (null)() at 0 Tracing command init pid 1 tid 100002 td 0x11fd7a80 sched_switch(11fd7a80,0,104) at sched_switch+0x598/frame 0x119fd9b4 mi_switch(104,0) at mi_switch+0x1de/frame 0x119fd9e8 sleepq_switch(6c,119fda40,101eb27,11fce9fc,1ee80d4,...) at sleepq_switch+0xe1/frame 0x119fda0c sleepq_catch_signals(11fd7a80,0,11fce9fc,119fda8c,fd89be,...) at sleepq_catch_signals+0x3b7/frame 0x119fda38 sleepq_wait_sig(11fce9fc,6c) at sleepq_wait_sig+0x11/frame 0x119fda4c _sleep(11fce9fc,11fceaa4,36c,1671e1e,0,0,0,0,100) at _sleep+0x28e/frame 0x119fda8c kern_wait6(11fd7a80,7,0,0,119fdb14,32,0,0) at kern_wait6+0x3bd/frame 0x119fdae8 sys_wait4(11fd7a80,11fd7d08) at sys_wait4+0x78/frame 0x119fdc08 syscall(119fdce8,3b,3b,3b,400d0c,...) at syscall+0x2d9/frame 0x119fdcdc Xint0x80_syscall() at 0xffc033b7/frame 0x119fdcdc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x47f57f, esp = 0xffbfe868, ebp = 0xffbfe87c --- (null)() at 0x47f57f Tracing command audit pid 10 tid 100001 td 0x11fd8000 sched_switch(11fd8000,0,104) at sched_switch+0x598/frame 0x119f8bcc mi_switch(104,0) at mi_switch+0x1de/frame 0x119f8c00 sleepq_switch(11fd8000,1f9004c,1f900a0,119f8c70,f72175,...) at sleepq_switch+0xe1/frame 0x119f8c24 sleepq_wait(1f900a0,0) at sleepq_wait+0x3a/frame 0x119f8c38 _cv_wait(1f900a0,1f9004c) at _cv_wait+0x135/frame 0x119f8c70 audit_worker(0,119f8ce8) at audit_worker+0x7f/frame 0x119f8cb4 fork_exit(12514f0,0,119f8ce8,0,0,...) at fork_exit+0x6c/frame 0x119f8cd4 fork_trampoline() at 0xffc033ca/frame 0x119f8cd4 --- trap 0, eip = 0, esp = 0x119f8d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100000 td 0x1f7fc00 sched_switch(1f7fc00,0,104) at sched_switch+0x598/frame 0x24f9c04 mi_switch(104,0) at mi_switch+0x1de/frame 0x24f9c34 sleepq_switch(2,1f7fc00,177,1f7fc00,0,...) at sleepq_switch+0xe1/frame 0x24f9c58 sleepq_timedwait(1f7f888,54,2e1e9700,1ee9644,2c9,...) at sleepq_timedwait+0x47/frame 0x24f9c88 _sleep(1f7f888,0,54,1674a11,fffff470,9,0,0,100) at _sleep+0x23c/frame 0x24f9cc8 swapper(0,0,0,1c3f86c) at swapper+0x6d/frame 0x24f9d14 mi_startup() at mi_startup+0x2b5/frame 0x24f9d38 btext() at btext+0x5f Tracing command kernel pid 0 tid 100007 td 0x11fd6700 sched_switch(11fd6700,0,104) at sched_switch+0x598/frame 0x1b6ecbd4 mi_switch(104,0) at mi_switch+0x1de/frame 0x1b6ecc04 sleepq_switch(11fd6700,0,11f60f00,1b6ecc7c,fd8a37,...) at sleepq_switch+0xe1/frame 0x1b6ecc28 sleepq_wait(11f60f00,0) at sleepq_wait+0x3a/frame 0x1b6ecc3c _sleep(11f60f00,11f60f1c,0,15a66da,0,0,0,0,100) at _sleep+0x307/frame 0x1b6ecc7c taskqueue_thread_loop(1f8f430,1b6ecce8) at taskqueue_thread_loop+0xcb/frame 0x1b6eccb4 fork_exit(1023ab0,1f8f430,1b6ecce8,0,0,...) at fork_exit+0x6c/frame 0x1b6eccd4 fork_trampoline() at 0xffc033ca/frame 0x1b6eccd4 --- trap 0, eip = 0, esp = 0x1b6ecd20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100010 td 0x11fd0a80 sched_switch(11fd0a80,0,104) at sched_switch+0x598/frame 0x1b6fbbd4 mi_switch(104,0) at mi_switch+0x1de/frame 0x1b6fbc04 sleepq_switch(11fd0a80,0,11f60d80,1b6fbc7c,fd8a37,...) at sleepq_switch+0xe1/frame 0x1b6fbc28 sleepq_wait(11f60d80,0) at sleepq_wait+0x3a/frame 0x1b6fbc3c _sleep(11f60d80,11f60d9c,0,15a66da,0,0,0,0,100) at _sleep+0x307/frame 0x1b6fbc7c taskqueue_thread_loop(1f8f3e0,1b6fbce8) at taskqueue_thread_loop+0xcb/frame 0x1b6fbcb4 fork_exit(1023ab0,1f8f3e0,1b6fbce8,0,0,...) at fork_exit+0x6c/frame 0x1b6fbcd4 fork_trampoline() at 0xffc033ca/frame 0x1b6fbcd4 --- trap 0, eip = 0, esp = 0x1b6fbd20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100012 td 0x11fd0380 sched_switch(11fd0380,0,104) at sched_switch+0x598/frame 0x1b705bdc mi_switch(104,0) at mi_switch+0x1de/frame 0x1b705c10 sleepq_switch(0,11fc2c00,11fd0380,1b705c80,fd8c82,...) at sleepq_switch+0xe1/frame 0x1b705c34 sleepq_wait(11fc2c00,0) at sleepq_wait+0x3a/frame 0x1b705c48 msleep_spin_sbt(11fc2c00,11fc2c1c,15a66da,0,0,0,0,100) at msleep_spin_sbt+0x132/frame 0x1b705c80 gtaskqueue_thread_loop(11a53404,1b705ce8) at gtaskqueue_thread_loop+0x9c/frame 0x1b705cb4 fork_exit(100fe10,11a53404,1b705ce8,0,0,...) at fork_exit+0x6c/frame 0x1b705cd4 fork_trampoline() at 0xffc033ca/frame 0x1b705cd4 --- trap 0, eip = 0, esp = 0x1b705d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100013 td 0x11fd0000 sched_switch(11fd0000,0,104) at sched_switch+0x598/frame 0x1b70abd4 mi_switch(104,0) at mi_switch+0x1de/frame 0x1b70ac04 sleepq_switch(11fd0000,0,11f60c80,1b70ac7c,fd8a37,...) at sleepq_switch+0xe1/frame 0x1b70ac28 sleepq_wait(11f60c80,0) at sleepq_wait+0x3a/frame 0x1b70ac3c _sleep(11f60c80,11f60c9c,0,15a66da,0,0,0,0,100) at _sleep+0x307/frame 0x1b70ac7c taskqueue_thread_loop(1f80258,1b70ace8) at taskqueue_thread_loop+0xcb/frame 0x1b70acb4 fork_exit(1023ab0,1f80258,1b70ace8,0,0,...) at fork_exit+0x6c/frame 0x1b70acd4 fork_trampoline() at 0xffc033ca/frame 0x1b70acd4 --- trap 0, eip = 0, esp = 0x1b70ad20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100014 td 0x11ad9380 sched_switch(11ad9380,0,104) at sched_switch+0x598/frame 0x1b71bbdc mi_switch(104,0) at mi_switch+0x1de/frame 0x1b71bc10 sleepq_switch(0,11fc2b80,11ad9380,1b71bc80,fd8c82,...) at sleepq_switch+0xe1/frame 0x1b71bc34 sleepq_wait(11fc2b80,0) at sleepq_wait+0x3a/frame 0x1b71bc48 msleep_spin_sbt(11fc2b80,11fc2b9c,15a66da,0,0,0,0,100) at msleep_spin_sbt+0x132/frame 0x1b71bc80 gtaskqueue_thread_loop(11a53804,1b71bce8) at gtaskqueue_thread_loop+0x9c/frame 0x1b71bcb4 fork_exit(100fe10,11a53804,1b71bce8,0,0,...) at fork_exit+0x6c/frame 0x1b71bcd4 fork_trampoline() at 0xffc033ca/frame 0x1b71bcd4 --- trap 0, eip = 0, esp = 0x1b71bd20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100015 td 0x11ad9000 sched_switch(11ad9000,0,104) at sched_switch+0x598/frame 0x1b720bdc mi_switch(104,0) at mi_switch+0x1de/frame 0x1b720c10 sleepq_switch(0,11fc2b00,11ad9000,1b720c80,fd8c82,...) at sleepq_switch+0xe1/frame 0x1b720c34 sleepq_wait(11fc2b00,0) at sleepq_wait+0x3a/frame 0x1b720c48 msleep_spin_sbt(11fc2b00,11fc2b1c,15a66da,0,0,0,0,100) at msleep_spin_sbt+0x132/frame 0x1b720c80 gtaskqueue_thread_loop(11a53c04,1b720ce8) at gtaskqueue_thread_loop+0x9c/frame 0x1b720cb4 fork_exit(100fe10,11a53c04,1b720ce8,0,0,...) at fork_exit+0x6c/frame 0x1b720cd4 fork_trampoline() at 0xffc033ca/frame 0x1b720cd4 --- trap 0, eip = 0, esp = 0x1b720d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100016 td 0x11ad8a80 sched_switch(11ad8a80,0,104) at sched_switch+0x598/frame 0x1b725bdc mi_switch(104,0) at mi_switch+0x1de/frame 0x1b725c10 sleepq_switch(0,11fc2a80,11ad8a80,1b725c80,fd8c82,...) at sleepq_switch+0xe1/frame 0x1b725c34 sleepq_wait(11fc2a80,0) at sleepq_wait+0x3a/frame 0x1b725c48 msleep_spin_sbt(11fc2a80,11fc2a9c,15a66da,0,0,0,0,100) at msleep_spin_sbt+0x132/frame 0x1b725c80 gtaskqueue_thread_loop(11a53c14,1b725ce8) at gtaskqueue_thread_loop+0x9c/frame 0x1b725cb4 fork_exit(100fe10,11a53c14,1b725ce8,0,0,...) at fork_exit+0x6c/frame 0x1b725cd4 fork_trampoline() at 0xffc033ca/frame 0x1b725cd4 --- trap 0, eip = 0, esp = 0x1b725d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100017 td 0x11ad8700 sched_switch(11ad8700,0,104) at sched_switch+0x598/frame 0x1b72abdc mi_switch(104,0) at mi_switch+0x1de/frame 0x1b72ac10 sleepq_switch(0,11fc2a00,11ad8700,1b72ac80,fd8c82,...) at sleepq_switch+0xe1/frame 0x1b72ac34 sleepq_wait(11fc2a00,0) at sleepq_wait+0x3a/frame 0x1b72ac48 msleep_spin_sbt(11fc2a00,11fc2a1c,15a66da,0,0,0,0,100) at msleep_spin_sbt+0x132/frame 0x1b72ac80 gtaskqueue_thread_loop(11a53c24,1b72ace8) at gtaskqueue_thread_loop+0x9c/frame 0x1b72acb4 fork_exit(100fe10,11a53c24,1b72ace8,0,0,...) at fork_exit+0x6c/frame 0x1b72acd4 fork_trampoline() at 0xffc033ca/frame 0x1b72acd4 --- trap 0, eip = 0, esp = 0x1b72ad20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100018 td 0x11ad8380 sched_switch(11ad8380,0,104) at sched_switch+0x598/frame 0x1b72fbdc mi_switch(104,0) at mi_switch+0x1de/frame 0x1b72fc10 sleepq_switch(0,11fc2980,11ad8380,1b72fc80,fd8c82,...) at sleepq_switch+0xe1/frame 0x1b72fc34 sleepq_wait(11fc2980,0) at sleepq_wait+0x3a/frame 0x1b72fc48 msleep_spin_sbt(11fc2980,11fc299c,15a66da,0,0,0,0,100) at msleep_spin_sbt+0x132/frame 0x1b72fc80 gtaskqueue_thread_loop(11a53c34,1b72fce8) at gtaskqueue_thread_loop+0x9c/frame 0x1b72fcb4 fork_exit(100fe10,11a53c34,1b72fce8,0,0,...) at fork_exit+0x6c/frame 0x1b72fcd4 fork_trampoline() at 0xffc033ca/frame 0x1b72fcd4 --- trap 0, eip = 0, esp = 0x1b72fd20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100019 td 0x11ad8000 sched_switch(11ad8000,0,104) at sched_switch+0x598/frame 0x1b734bdc mi_switch(104,0) at mi_switch+0x1de/frame 0x1b734c10 sleepq_switch(0,11fc2900,11ad8000,1b734c80,fd8c82,...) at sleepq_switch+0xe1/frame 0x1b734c34 sleepq_wait(11fc2900,0) at sleepq_wait+0x3a/frame 0x1b734c48 msleep_spin_sbt(11fc2900,11fc291c,15a66da,0,0,0,0,100) at msleep_spin_sbt+0x132/frame 0x1b734c80 gtaskqueue_thread_loop(11a53004,1b734ce8) at gtaskqueue_thread_loop+0x9c/frame 0x1b734cb4 fork_exit(100fe10,11a53004,1b734ce8,0,0,...) at fork_exit+0x6c/frame 0x1b734cd4 fork_trampoline() at 0xffc033ca/frame 0x1b734cd4 --- trap 0, eip = 0, esp = 0x1b734d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100020 td 0x11ad7a80 sched_switch(11ad7a80,0,104) at sched_switch+0x598/frame 0x1b739bdc mi_switch(104,0) at mi_switch+0x1de/frame 0x1b739c10 sleepq_switch(0,11fc2880,11ad7a80,1b739c80,fd8c82,...) at sleepq_switch+0xe1/frame 0x1b739c34 sleepq_wait(11fc2880,0) at sleepq_wait+0x3a/frame 0x1b739c48 msleep_spin_sbt(11fc2880,11fc289c,15a66da,0,0,0,0,100) at msleep_spin_sbt+0x132/frame 0x1b739c80 gtaskqueue_thread_loop(11a53014,1b739ce8) at gtaskqueue_thread_loop+0x9c/frame 0x1b739cb4 fork_exit(100fe10,11a53014,1b739ce8,0,0,...) at fork_exit+0x6c/frame 0x1b739cd4 fork_trampoline() at 0xffc033ca/frame 0x1b739cd4 --- trap 0, eip = 0, esp = 0x1b739d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100021 td 0x11ad7700 sched_switch(11ad7700,0,104) at sched_switch+0x598/frame 0x1b73ebdc mi_switch(104,0) at mi_switch+0x1de/frame 0x1b73ec10 sleepq_switch(0,11fc2800,11ad7700,1b73ec80,fd8c82,...) at sleepq_switch+0xe1/frame 0x1b73ec34 sleepq_wait(11fc2800,0) at sleepq_wait+0x3a/frame 0x1b73ec48 msleep_spin_sbt(11fc2800,11fc281c,15a66da,0,0,0,0,100) at msleep_spin_sbt+0x132/frame 0x1b73ec80 gtaskqueue_thread_loop(11a53024,1b73ece8) at gtaskqueue_thread_loop+0x9c/frame 0x1b73ecb4 fork_exit(100fe10,11a53024,1b73ece8,0,0,...) at fork_exit+0x6c/frame 0x1b73ecd4 fork_trampoline() at 0xffc033ca/frame 0x1b73ecd4 --- trap 0, eip = 0, esp = 0x1b73ed20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100022 td 0x11ad7380 sched_switch(11ad7380,0,104) at sched_switch+0x598/frame 0x1b743bdc mi_switch(104,0) at mi_switch+0x1de/frame 0x1b743c10 sleepq_switch(0,11fc2780,11ad7380,1b743c80,fd8c82,...) at sleepq_switch+0xe1/frame 0x1b743c34 sleepq_wait(11fc2780,0) at sleepq_wait+0x3a/frame 0x1b743c48 msleep_spin_sbt(11fc2780,11fc279c,15a66da,0,0,0,0,100) at msleep_spin_sbt+0x132/frame 0x1b743c80 gtaskqueue_thread_loop(11a53034,1b743ce8) at gtaskqueue_thread_loop+0x9c/frame 0x1b743cb4 fork_exit(100fe10,11a53034,1b743ce8,0,0,...) at fork_exit+0x6c/frame 0x1b743cd4 fork_trampoline() at 0xffc033ca/frame 0x1b743cd4 --- trap 0, eip = 0, esp = 0x1b743d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100029 td 0x11e64000 sched_switch(11e64000,0,104) at sched_switch+0x598/frame 0x1b77ebd4 mi_switch(104,0) at mi_switch+0x1de/frame 0x1b77ec04 sleepq_switch(11e64000,0,11f60c00,1b77ec7c,fd8a37,...) at sleepq_switch+0xe1/frame 0x1b77ec28 sleepq_wait(11f60c00,0) at sleepq_wait+0x3a/frame 0x1b77ec3c _sleep(11f60c00,11f60c1c,0,15a66da,0,0,0,0,100) at _sleep+0x307/frame 0x1b77ec7c taskqueue_thread_loop(1ee720c,1b77ece8) at taskqueue_thread_loop+0xcb/frame 0x1b77ecb4 fork_exit(1023ab0,1ee720c,1b77ece8,0,0,...) at fork_exit+0x6c/frame 0x1b77ecd4 fork_trampoline() at 0xffc033ca/frame 0x1b77ecd4 --- trap 0, eip = 0, esp = 0x1b77ed20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100034 td 0x11e6ba80 sched_switch(11e6ba80,0,104) at sched_switch+0x598/frame 0x1b79bbd4 mi_switch(104,0) at mi_switch+0x1de/frame 0x1b79bc04 sleepq_switch(11e6ba80,0,11f60b00,1b79bc7c,fd8a37,...) at sleepq_switch+0xe1/frame 0x1b79bc28 sleepq_wait(11f60b00,0) at sleepq_wait+0x3a/frame 0x1b79bc3c _sleep(11f60b00,11f60b1c,0,15a66da,0,0,0,0,100) at _sleep+0x307/frame 0x1b79bc7c taskqueue_thread_loop(1f5b09c,1b79bce8) at taskqueue_thread_loop+0xcb/frame 0x1b79bcb4 fork_exit(1023ab0,1f5b09c,1b79bce8,0,0,...) at fork_exit+0x6c/frame 0x1b79bcd4 fork_trampoline() at 0xffc033ca/frame 0x1b79bcd4 --- trap 0, eip = 0, esp = 0x1b79bd20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100035 td 0x11e6b700 sched_switch(11e6b700,0,104) at sched_switch+0x598/frame 0x1b7a0bd4 mi_switch(104,0) at mi_switch+0x1de/frame 0x1b7a0c04 sleepq_switch(11e6b700,0,11f60b00,1b7a0c7c,fd8a37,...) at sleepq_switch+0xe1/frame 0x1b7a0c28 sleepq_wait(11f60b00,0) at sleepq_wait+0x3a/frame 0x1b7a0c3c _sleep(11f60b00,11f60b1c,0,15a66da,0,0,0,0,100) at _sleep+0x307/frame 0x1b7a0c7c taskqueue_thread_loop(1f5b09c,1b7a0ce8) at taskqueue_thread_loop+0xcb/frame 0x1b7a0cb4 fork_exit(1023ab0,1f5b09c,1b7a0ce8,0,0,...) at fork_exit+0x6c/frame 0x1b7a0cd4 fork_trampoline() at 0xffc033ca/frame 0x1b7a0cd4 --- trap 0, eip = 0, esp = 0x1b7a0d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100036 td 0x11e6b380 sched_switch(11e6b380,0,104) at sched_switch+0x598/frame 0x1b7a5bd4 mi_switch(104,0) at mi_switch+0x1de/frame 0x1b7a5c04 sleepq_switch(11e6b380,0,11f60b00,1b7a5c7c,fd8a37,...) at sleepq_switch+0xe1/frame 0x1b7a5c28 sleepq_wait(11f60b00,0) at sleepq_wait+0x3a/frame 0x1b7a5c3c _sleep(11f60b00,11f60b1c,0,15a66da,0,0,0,0,100) at _sleep+0x307/frame 0x1b7a5c7c taskqueue_thread_loop(1f5b09c,1b7a5ce8) at taskqueue_thread_loop+0xcb/frame 0x1b7a5cb4 fork_exit(1023ab0,1f5b09c,1b7a5ce8,0,0,...) at fork_exit+0x6c/frame 0x1b7a5cd4 fork_trampoline() at 0xffc033ca/frame 0x1b7a5cd4 --- trap 0, eip = 0, esp = 0x1b7a5d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100037 td 0x11e6b000 sched_switch(11e6b000,0,104) at sched_switch+0x598/frame 0x1b7aabd4 mi_switch(104,0) at mi_switch+0x1de/frame 0x1b7aac04 sleepq_switch(11e6b000,0,11f60b00,1b7aac7c,fd8a37,...) at sleepq_switch+0xe1/frame 0x1b7aac28 sleepq_wait(11f60b00,0) at sleepq_wait+0x3a/frame 0x1b7aac3c _sleep(11f60b00,11f60b1c,0,15a66da,0,0,0,0,100) at _sleep+0x307/frame 0x1b7aac7c taskqueue_thread_loop(1f5b09c,1b7aace8) at taskqueue_thread_loop+0xcb/frame 0x1b7aacb4 fork_exit(1023ab0,1f5b09c,1b7aace8,0,0,...) at fork_exit+0x6c/frame 0x1b7aacd4 fork_trampoline() at 0xffc033ca/frame 0x1b7aacd4 --- trap 0, eip = 0, esp = 0x1b7aad20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100085 td 0x23d9d380 sched_switch(23d9d380,0,104) at sched_switch+0x598/frame 0x22ad7bdc mi_switch(104,0) at mi_switch+0x1de/frame 0x22ad7c10 sleepq_switch(0,23d7b000,23d9d380,22ad7c80,fd8c82,...) at sleepq_switch+0xe1/frame 0x22ad7c34 sleepq_wait(23d7b000,0) at sleepq_wait+0x3a/frame 0x22ad7c48 msleep_spin_sbt(23d7b000,23d7b01c,15a66da,0,0,0,0,100) at msleep_spin_sbt+0x132/frame 0x22ad7c80 taskqueue_thread_loop(1f73d08,22ad7ce8) at taskqueue_thread_loop+0x9c/frame 0x22ad7cb4 fork_exit(1023ab0,1f73d08,22ad7ce8,0,0,...) at fork_exit+0x6c/frame 0x22ad7cd4 fork_trampoline() at 0xffc033ca/frame 0x22ad7cd4 --- trap 0, eip = 0, esp = 0x22ad7d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100091 td 0x243fea80 sched_switch(243fea80,0,104) at sched_switch+0x598/frame 0x22afabdc mi_switch(104,0) at mi_switch+0x1de/frame 0x22afac10 sleepq_switch(0,23ee5d00,243fea80,22afac80,fd8c82,...) at sleepq_switch+0xe1/frame 0x22afac34 sleepq_wait(23ee5d00,0) at sleepq_wait+0x3a/frame 0x22afac48 msleep_spin_sbt(23ee5d00,23ee5d1c,15a66da,0,0,0,0,100) at msleep_spin_sbt+0x132/frame 0x22afac80 taskqueue_thread_loop(1f75944,22aface8) at taskqueue_thread_loop+0x9c/frame 0x22afacb4 fork_exit(1023ab0,1f75944,22aface8,0,0,...) at fork_exit+0x6c/frame 0x22afacd4 fork_trampoline() at 0xffc033ca/frame 0x22afacd4 --- trap 0, eip = 0, esp = 0x22afad20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100092 td 0x243fe700 sched_switch(243fe700,0,104) at sched_switch+0x598/frame 0x22affbdc mi_switch(104,0) at mi_switch+0x1de/frame 0x22affc10 sleepq_switch(0,23ee5d00,243fe700,22affc80,fd8c82,...) at sleepq_switch+0xe1/frame 0x22affc34 sleepq_wait(23ee5d00,0) at sleepq_wait+0x3a/frame 0x22affc48 msleep_spin_sbt(23ee5d00,23ee5d1c,15a66da,0,0,0,0,100) at msleep_spin_sbt+0x132/frame 0x22affc80 taskqueue_thread_loop(1f75944,22affce8) at taskqueue_thread_loop+0x9c/frame 0x22affcb4 fork_exit(1023ab0,1f75944,22affce8,0,0,...) at fork_exit+0x6c/frame 0x22affcd4 fork_trampoline() at 0xffc033ca/frame 0x22affcd4 --- trap 0, eip = 0, esp = 0x22affd20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100093 td 0x243fe380 sched_switch(243fe380,0,104) at sched_switch+0x598/frame 0x22b04bdc mi_switch(104,0) at mi_switch+0x1de/frame 0x22b04c10 sleepq_switch(0,23ee5d00,243fe380,22b04c80,fd8c82,...) at sleepq_switch+0xe1/frame 0x22b04c34 sleepq_wait(23ee5d00,0) at sleepq_wait+0x3a/frame 0x22b04c48 msleep_spin_sbt(23ee5d00,23ee5d1c,15a66da,0,0,0,0,100) at msleep_spin_sbt+0x132/frame 0x22b04c80 taskqueue_thread_loop(1f75944,22b04ce8) at taskqueue_thread_loop+0x9c/frame 0x22b04cb4 fork_exit(1023ab0,1f75944,22b04ce8,0,0,...) at fork_exit+0x6c/frame 0x22b04cd4 fork_trampoline() at 0xffc033ca/frame 0x22b04cd4 --- trap 0, eip = 0, esp = 0x22b04d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100095 td 0x243e7a80 sched_switch(243e7a80,0,104) at sched_switch+0x598/frame 0x22b0ebd4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22b0ec04 sleepq_switch(243e7a80,0,11f60a80,22b0ec7c,fd8a37,...) at sleepq_switch+0xe1/frame 0x22b0ec28 sleepq_wait(11f60a80,0) at sleepq_wait+0x3a/frame 0x22b0ec3c _sleep(11f60a80,11f60a9c,0,15a66da,0,0,0,0,100) at _sleep+0x307/frame 0x22b0ec7c taskqueue_thread_loop(1c6b0f4,22b0ece8) at taskqueue_thread_loop+0xcb/frame 0x22b0ecb4 fork_exit(1023ab0,1c6b0f4,22b0ece8,0,0,...) at fork_exit+0x6c/frame 0x22b0ecd4 fork_trampoline() at 0xffc033ca/frame 0x22b0ecd4 --- trap 0, eip = 0, esp = 0x22b0ed20, ebp = 0 --- (null)() at 0 db:0:pho> dump Physical memory: 8034 MB Dumping 717 MB: 702 686 670 654 638 622 606 590 574 558 542 526 510 494 478 462 446 430 414 398 382 366 350 334 318 302 286 270 254 238 222 206 190 174 158 142 126 110 94 78 62 46 30 14 Dump complete db> reset cpu_reset: Restarting BSP cpu_reset_proxy: Stopped CPU 3 (kgdb) tid 101000 (kgdb) bt #0 0x00ff8088 in sched_switch (td=0x338a8700, newtd=0x9ffe7380, flags=0x104) at ../../../kern/sched_ule.c:2127 #1 0x00fd91ae in mi_switch (flags=0x104, newtd=0x0) at ../../../kern/kern_synch.c:452 #2 0x0101f121 in sleepq_switch (wchan=, pri=0x0) at ../../../kern/subr_sleepqueue.c:625 #3 0x0101effa in sleepq_wait (wchan=0x1ed2638 , pri=0x0) at ../../../kern/subr_sleepqueue.c:704 #4 0x00fd8a37 in _sleep (ident=0x1ed2638 , lock=0x1ed2638 , priority=0x0, wmesg=0x1627057 "umtxqb", sbt=0x0, pr=0x0, flags=0x100) at ../../../kern/kern_synch.c:217 #5 0x00fef81f in umtxq_busy (key=0x338a5f08) at ../../../kern/kern_umtx.c:547 #6 0x00fed81c in do_lock_normal (td=, m=, flags=, timeout=, mode=) at ../../../kern/kern_umtx.c:1149 #7 do_lock_umutex (td=, m=, timeout=0x0, mode=0x2) at ../../../kern/kern_umtx.c:2535 #8 0x00fea62c in __umtx_op_wait_umutex (td=0x338a8700, uap=0x338a8988) at ../../../kern/kern_umtx.c:3619 #9 0x01530869 in syscallenter (td=) at ../../../i386/i386/../../kern/subr_syscall.c:135 #10 syscall (frame=0x522ebce8) at ../../../i386/i386/trap.c:1160 #11 0xffc033b7 in ?? () #12 0x522ebce8 in ?? () Backtrace stopped: Cannot access memory at address 0xfb5f7ec4 (kgdb) f 5 #5 0x00fef81f in umtxq_busy (key=0x338a5f08) at ../../../kern/kern_umtx.c:547 547 msleep(uc, &uc->uc_lock, 0, "umtxqb", 0); (kgdb) l 542 } 543 } 544 #endif 545 while (uc->uc_busy) { 546 uc->uc_waiters++; 547 msleep(uc, &uc->uc_lock, 0, "umtxqb", 0); 548 uc->uc_waiters--; 549 } 550 } 551 uc->uc_busy = 1; (kgdb) p *key $1 = {hash = 0x1fa, type = 0x4, shared = 0x0, info = {shared = {object = 0x11fdfa60, offset = 0x206f4000}, private = {vs = 0x11fdfa60, addr = 0x206f4000}, both = {a = 0x11fdfa60, b = 0x206f4000}}} (kgdb) info loc uc = 0x1ed2638 (kgdb) p *uc $2 = {uc_lock = {lock_object = {lo_name = 0x15edfba "umtxql", lo_flags = 0x1430000, lo_data = 0x0, lo_witness = 0x2ded688}, mtx_lock = 0x0}, uc_queue = {{ lh_first = 0x0}, {lh_first = 0x0}}, uc_spare_queue = {lh_first = 0x0}, uc_busy = 0x1, uc_waiters = 0x3, uc_pi_list = {tqh_first = 0x0, tqh_last = 0x1ed2660 }} (kgdb) $ svn diff -x -p /usr/src/sys Index: /usr/src/sys/amd64/amd64/support.S =================================================================== --- /usr/src/sys/amd64/amd64/support.S (revision 349856) +++ /usr/src/sys/amd64/amd64/support.S (working copy) @@ -811,6 +811,7 @@ ENTRY(casueword32_nosmap) lock #endif cmpxchgl %ecx,(%rdi) /* new = %ecx */ + setne %cl /* * The old value is in %eax. If the store succeeded it will be the @@ -828,6 +829,7 @@ ENTRY(casueword32_nosmap) */ movl %esi,(%rdx) /* oldp = %rdx */ POP_FRAME_POINTER + movzbl %cl, %eax ret END(casueword32_nosmap) @@ -847,6 +849,7 @@ ENTRY(casueword32_smap) #endif cmpxchgl %ecx,(%rdi) /* new = %ecx */ clac + setne %cl /* * The old value is in %eax. If the store succeeded it will be the @@ -864,6 +867,7 @@ ENTRY(casueword32_smap) */ movl %esi,(%rdx) /* oldp = %rdx */ POP_FRAME_POINTER + movzbl %cl, %eax ret END(casueword32_smap) @@ -886,6 +890,7 @@ ENTRY(casueword_nosmap) lock #endif cmpxchgq %rcx,(%rdi) /* new = %rcx */ + setne %cl /* * The old value is in %rax. If the store succeeded it will be the @@ -897,6 +902,7 @@ ENTRY(casueword_nosmap) movq %rax,PCB_ONFAULT(%r8) movq %rsi,(%rdx) POP_FRAME_POINTER + movzbl %cl, %eax ret END(casueword_nosmap) @@ -916,6 +922,7 @@ ENTRY(casueword_smap) #endif cmpxchgq %rcx,(%rdi) /* new = %rcx */ clac + setne %cl /* * The old value is in %rax. If the store succeeded it will be the @@ -927,6 +934,7 @@ ENTRY(casueword_smap) movq %rax,PCB_ONFAULT(%r8) movq %rsi,(%rdx) POP_FRAME_POINTER + movzbl %cl, %eax ret END(casueword_smap) Index: /usr/src/sys/arm/arm/fusu.S =================================================================== --- /usr/src/sys/arm/arm/fusu.S (revision 349856) +++ /usr/src/sys/arm/arm/fusu.S (working copy) @@ -63,7 +63,7 @@ EENTRY_NP(casueword32) ldr r4, =(VM_MAXUSER_ADDRESS-3) cmp r0, r4 mvncs r0, #0 - bcs 2f + bcs 1f GET_PCB(r6) ldr r6, [r6] @@ -78,12 +78,10 @@ EENTRY_NP(casueword32) str r4, [r6, #PCB_ONFAULT] #if __ARM_ARCH >= 6 -1: + mov r5, #1 ldrex r4, [r0] cmp r4, r1 strexeq r5, r3, [r0] - cmpeq r5, #1 - beq 1b #else ldrt r4, [r0] cmp r4, r1 @@ -92,7 +90,10 @@ EENTRY_NP(casueword32) str r4, [r2] mov r0, #0 str r0, [r6, #PCB_ONFAULT] -2: +#if __ARM_ARCH >= 6 + mov r0, r5 +#endif +1: ldmfd sp!, {r4, r5, r6} RET EEND(casueword32) Index: /usr/src/sys/arm64/arm64/support.S =================================================================== --- /usr/src/sys/arm64/arm64/support.S (revision 349856) +++ /usr/src/sys/arm64/arm64/support.S (working copy) @@ -57,6 +57,7 @@ ENTRY(casueword32) cmp x0, x4 b.cs fsu_fault_nopcb adr x6, fsu_fault /* Load the fault handler */ + mov w5, #1 SET_FAULT_HANDLER(x6, x4) /* And set it */ ENTER_USER_ACCESS(w6, x4) 1: ldxr w4, [x0] /* Load-exclusive the data */ @@ -63,11 +64,10 @@ ENTRY(casueword32) cmp w4, w1 /* Compare */ b.ne 2f /* Not equal, exit */ stxr w5, w3, [x0] /* Store the new data */ - cbnz w5, 1b /* Retry on failure */ 2: EXIT_USER_ACCESS(w6) - SET_FAULT_HANDLER(xzr, x5) /* Reset the fault handler */ + SET_FAULT_HANDLER(xzr, x6) /* Reset the fault handler */ str w4, [x2] /* Store the read data */ - mov x0, #0 /* Success */ + mov w0, w5 /* Result same as store status */ ret /* Return */ END(casueword32) @@ -79,6 +79,7 @@ ENTRY(casueword) cmp x0, x4 b.cs fsu_fault_nopcb adr x6, fsu_fault /* Load the fault handler */ + mov w5, #1 SET_FAULT_HANDLER(x6, x4) /* And set it */ ENTER_USER_ACCESS(w6, x4) 1: ldxr x4, [x0] /* Load-exclusive the data */ @@ -85,11 +86,10 @@ ENTRY(casueword) cmp x4, x1 /* Compare */ b.ne 2f /* Not equal, exit */ stxr w5, x3, [x0] /* Store the new data */ - cbnz w5, 1b /* Retry on failure */ 2: EXIT_USER_ACCESS(w6) - SET_FAULT_HANDLER(xzr, x5) /* Reset the fault handler */ + SET_FAULT_HANDLER(xzr, x6) /* Reset the fault handler */ str x4, [x2] /* Store the read data */ - mov x0, #0 /* Success */ + mov w0, w5 /* Result same as store status */ ret /* Return */ END(casueword) Index: /usr/src/sys/i386/i386/copyout.c =================================================================== --- /usr/src/sys/i386/i386/copyout.c (revision 349856) +++ /usr/src/sys/i386/i386/copyout.c (working copy) @@ -428,6 +428,7 @@ suword32(volatile void *base, int32_t word) struct casueword_arg0 { uint32_t oldval; uint32_t newval; + int res; }; static void @@ -436,7 +437,8 @@ casueword_slow0(vm_offset_t kva, void *arg) struct casueword_arg0 *ca; ca = arg; - atomic_fcmpset_int((u_int *)kva, &ca->oldval, ca->newval); + ca->res = 1 - atomic_fcmpset_int((u_int *)kva, &ca->oldval, + ca->newval); } int @@ -452,7 +454,7 @@ casueword32(volatile uint32_t *base, uint32_t oldv casueword_slow0, &ca); if (res == 0) { *oldvalp = ca.oldval; - return (0); + return (ca.res); } return (-1); } @@ -469,7 +471,7 @@ casueword(volatile u_long *base, u_long oldval, u_ casueword_slow0, &ca); if (res == 0) { *oldvalp = ca.oldval; - return (0); + return (ca.res); } return (-1); } Index: /usr/src/sys/kern/kern_umtx.c =================================================================== --- /usr/src/sys/kern/kern_umtx.c (revision 349856) +++ /usr/src/sys/kern/kern_umtx.c (working copy) @@ -690,8 +690,26 @@ umtxq_count_pi(struct umtx_key *key, struct umtx_q return (0); } +/* + * Check for possible stops and suspensions while executing a umtx + * locking operation. + * + * The sleep argument controls whether the function can handle a stop + * request itself or it should return ERESTART and the request is + * proceed at the kernel/user boundary in ast. + * + * Typically, when retrying due to casueword(9) failure (rv == 1), we + * should handle the stop requests there, with exception of cases when + * the thread busied the umtx key, or when functions return + * immediately if umtxq_check_susp() returned non-zero. On the other + * hand, retrying the whole lock operation, we better not stop there + * but delegate the handling to ast. + * + * If the request is for thread termination P_SINGLE_EXIT, we cannot + * handle it at all, and simply return EINTR. + */ static int -umtxq_check_susp(struct thread *td) +umtxq_check_susp(struct thread *td, bool sleep) { struct proc *p; int error; @@ -710,7 +728,7 @@ static int if (p->p_flag & P_SINGLE_EXIT) error = EINTR; else - error = ERESTART; + error = sleep ? thread_suspend_check(0) : ERESTART; } PROC_UNLOCK(p); return (error); @@ -1049,9 +1067,12 @@ do_lock_normal(struct thread *td, struct umutex *m id | UMUTEX_CONTESTED); if (rv == -1) return (EFAULT); - if (owner == UMUTEX_RB_OWNERDEAD) + if (rv == 0) { + MPASS(owner == UMUTEX_RB_OWNERDEAD); return (EOWNERDEAD); /* success */ - rv = umtxq_check_susp(td); + } + MPASS(rv == 1); + rv = umtxq_check_susp(td, false); if (rv != 0) return (rv); continue; @@ -1070,13 +1091,16 @@ do_lock_normal(struct thread *td, struct umutex *m return (EFAULT); /* The acquire succeeded. */ - if (owner == UMUTEX_UNOWNED) + if (rv == 0) { + MPASS(owner == UMUTEX_UNOWNED); return (0); + } /* * If no one owns it but it is contested try * to acquire it. */ + MPASS(rv == 1); if (owner == UMUTEX_CONTESTED) { rv = casueword32(&m->m_owner, UMUTEX_CONTESTED, &owner, @@ -1084,14 +1108,16 @@ do_lock_normal(struct thread *td, struct umutex *m /* The address was invalid. */ if (rv == -1) return (EFAULT); - - if (owner == UMUTEX_CONTESTED) + if (rv == 0) { + MPASS(owner == UMUTEX_CONTESTED); return (0); + } + if (rv == 1) { + rv = umtxq_check_susp(td, false); + if (rv != 0) + return (rv); + } - rv = umtxq_check_susp(td); - if (rv != 0) - return (rv); - /* * If this failed the lock has * changed, restart. @@ -1098,6 +1124,11 @@ do_lock_normal(struct thread *td, struct umutex *m */ continue; } + + /* rv == 1 but not contested, likely store failure */ + rv = umtxq_check_susp(td, false); + if (rv != 0) + return (rv); } if (mode == _UMUTEX_TRY) @@ -1128,14 +1159,21 @@ do_lock_normal(struct thread *td, struct umutex *m rv = casueword32(&m->m_owner, owner, &old, owner | UMUTEX_CONTESTED); - /* The address was invalid. */ - if (rv == -1) { + /* The address was invalid or casueword failed to store. */ + if (rv == -1 || rv == 1) { umtxq_lock(&uq->uq_key); umtxq_remove(uq); umtxq_unbusy(&uq->uq_key); umtxq_unlock(&uq->uq_key); umtx_key_release(&uq->uq_key); - return (EFAULT); + if (rv == -1) + return (EFAULT); + if (rv == 1) { + rv = umtxq_check_susp(td, false); + if (rv != 0) + return (rv); + } + continue; } /* @@ -1145,15 +1183,15 @@ do_lock_normal(struct thread *td, struct umutex *m */ umtxq_lock(&uq->uq_key); umtxq_unbusy(&uq->uq_key); - if (old == owner) - error = umtxq_sleep(uq, "umtxn", timeout == NULL ? - NULL : &timo); + MPASS(old == owner); + error = umtxq_sleep(uq, "umtxn", timeout == NULL ? + NULL : &timo); umtxq_remove(uq); umtxq_unlock(&uq->uq_key); umtx_key_release(&uq->uq_key); if (error == 0) - error = umtxq_check_susp(td); + error = umtxq_check_susp(td, false); } return (0); @@ -1170,6 +1208,8 @@ do_unlock_normal(struct thread *td, struct umutex int error, count; id = td->td_tid; + +again: /* * Make sure we own this mtx. */ @@ -1185,9 +1225,14 @@ do_unlock_normal(struct thread *td, struct umutex error = casueword32(&m->m_owner, owner, &old, newlock); if (error == -1) return (EFAULT); - if (old == owner) - return (0); - owner = old; + if (error == 1) { + error = umtxq_check_susp(td, false); + if (error != 0) + return (error); + goto again; + } + MPASS(old == owner); + return (0); } /* We should only ever be in here for contested locks */ @@ -1215,8 +1260,14 @@ do_unlock_normal(struct thread *td, struct umutex umtx_key_release(&key); if (error == -1) return (EFAULT); - if (old != owner) - return (EINVAL); + if (error == 1) { + if (old != owner) + return (EINVAL); + error = umtxq_check_susp(td, false); + if (error != 0) + return (error); + goto again; + } return (0); } @@ -1233,6 +1284,7 @@ do_wake_umutex(struct thread *td, struct umutex *m int error; int count; +again: error = fueword32(&m->m_owner, &owner); if (error == -1) return (EFAULT); @@ -1259,14 +1311,26 @@ do_wake_umutex(struct thread *td, struct umutex *m owner != UMUTEX_RB_NOTRECOV) { error = casueword32(&m->m_owner, UMUTEX_CONTESTED, &owner, UMUTEX_UNOWNED); - if (error == -1) + if (error == -1) { error = EFAULT; + } else if (error == 1) { + umtxq_unbusy(&key); + umtxq_unlock(&key); + umtx_key_release(&key); + error = umtxq_check_susp(td, false); + if (error != 0) + return (error); + goto again; + } } umtxq_lock(&key); - if (error == 0 && count != 0 && ((owner & ~UMUTEX_CONTESTED) == 0 || - owner == UMUTEX_RB_OWNERDEAD || owner == UMUTEX_RB_NOTRECOV)) + if (error == 0 && count != 0) { + MPASS((owner & ~UMUTEX_CONTESTED) == 0 || + owner == UMUTEX_RB_OWNERDEAD || + owner == UMUTEX_RB_NOTRECOV); umtxq_signal(&key, 1); + } umtxq_unbusy(&key); umtxq_unlock(&key); umtx_key_release(&key); @@ -1330,12 +1394,12 @@ do_wake2_umutex(struct thread *td, struct umutex * error = EFAULT; break; } - if (old == owner) + if (error == 0) { + MPASS(old == owner); break; + } owner = old; - error = umtxq_check_susp(td); - if (error != 0) - break; + error = umtxq_check_susp(td, true); } } else if (count == 1) { error = fueword32(&m->m_owner, &owner); @@ -1349,12 +1413,12 @@ do_wake2_umutex(struct thread *td, struct umutex * error = EFAULT; break; } - if (old == owner) + if (error == 0) { + MPASS(old == owner); break; + } owner = old; - error = umtxq_check_susp(td); - if (error != 0) - break; + error = umtxq_check_susp(td, true); } } umtxq_lock(&key); @@ -1842,13 +1906,17 @@ do_lock_pi(struct thread *td, struct umutex *m, ui error = EFAULT; break; } - /* The acquire succeeded. */ - if (owner == UMUTEX_UNOWNED) { + if (rv == 0) { + MPASS(owner == UMUTEX_UNOWNED); error = 0; break; } + error = umtxq_check_susp(td, true); + if (error != 0) + break; + if (owner == UMUTEX_RB_NOTRECOV) { error = ENOTRECOVERABLE; break; @@ -1864,36 +1932,37 @@ do_lock_pi(struct thread *td, struct umutex *m, ui error = EFAULT; break; } + if (rv == 1) { + error = umtxq_check_susp(td, true); + if (error != 0) + return (error); + /* + * If this failed the lock could + * changed, restart. + */ + continue; + } - if (owner == old_owner) { - umtxq_lock(&uq->uq_key); - umtxq_busy(&uq->uq_key); - error = umtx_pi_claim(pi, td); - umtxq_unbusy(&uq->uq_key); - umtxq_unlock(&uq->uq_key); - if (error != 0) { - /* - * Since we're going to return an - * error, restore the m_owner to its - * previous, unowned state to avoid - * compounding the problem. - */ - (void)casuword32(&m->m_owner, - id | UMUTEX_CONTESTED, - old_owner); - } - if (error == 0 && - old_owner == UMUTEX_RB_OWNERDEAD) - error = EOWNERDEAD; - break; + MPASS(rv == 0); + MPASS(owner == old_owner); + umtxq_lock(&uq->uq_key); + umtxq_busy(&uq->uq_key); + error = umtx_pi_claim(pi, td); + umtxq_unbusy(&uq->uq_key); + umtxq_unlock(&uq->uq_key); + if (error != 0) { + /* + * Since we're going to return an + * error, restore the m_owner to its + * previous, unowned state to avoid + * compounding the problem. + */ + (void)casuword32(&m->m_owner, + id | UMUTEX_CONTESTED, old_owner); } - - error = umtxq_check_susp(td); - if (error != 0) - break; - - /* If this failed the lock has changed, restart. */ - continue; + if (error == 0 && old_owner == UMUTEX_RB_OWNERDEAD) + error = EOWNERDEAD; + break; } if ((owner & ~UMUTEX_CONTESTED) == id) { @@ -1932,28 +2001,33 @@ do_lock_pi(struct thread *td, struct umutex *m, ui error = EFAULT; break; } + if (rv == 1) { + umtxq_unbusy_unlocked(&uq->uq_key); + error = umtxq_check_susp(td, true); + if (error != 0) + break; - umtxq_lock(&uq->uq_key); - /* - * We set the contested bit, sleep. Otherwise the lock changed - * and we need to retry or we lost a race to the thread - * unlocking the umtx. Note that the UMUTEX_RB_OWNERDEAD - * value for owner is impossible there. - */ - if (old == owner) { - error = umtxq_sleep_pi(uq, pi, - owner & ~UMUTEX_CONTESTED, - "umtxpi", timeout == NULL ? NULL : &timo, - (flags & USYNC_PROCESS_SHARED) != 0); - if (error != 0) - continue; - } else { - umtxq_unbusy(&uq->uq_key); - umtxq_unlock(&uq->uq_key); + /* + * The lock changed and we need to retry or we + * lost a race to the thread unlocking the + * umtx. Note that the UMUTEX_RB_OWNERDEAD + * value for owner is impossible there. + */ + continue; } - error = umtxq_check_susp(td); + umtxq_lock(&uq->uq_key); + + /* We set the contested bit, sleep. */ + MPASS(old == owner); + error = umtxq_sleep_pi(uq, pi, owner & ~UMUTEX_CONTESTED, + "umtxpi", timeout == NULL ? NULL : &timo, + (flags & USYNC_PROCESS_SHARED) != 0); if (error != 0) + continue; + + error = umtxq_check_susp(td, true); + if (error != 0) break; } @@ -1978,6 +2052,8 @@ do_unlock_pi(struct thread *td, struct umutex *m, int count, error, pri; id = td->td_tid; + +usrloop: /* * Make sure we own this mtx. */ @@ -1995,6 +2071,12 @@ do_unlock_pi(struct thread *td, struct umutex *m, error = casueword32(&m->m_owner, owner, &old, new_owner); if (error == -1) return (EFAULT); + if (error == 1) { + error = umtxq_check_susp(td, true); + if (error != 0) + return (error); + goto usrloop; + } if (old == owner) return (0); owner = old; @@ -2074,15 +2156,20 @@ do_unlock_pi(struct thread *td, struct umutex *m, if (count > 1) new_owner |= UMUTEX_CONTESTED; +again: error = casueword32(&m->m_owner, owner, &old, new_owner); - + if (error == 1) { + error = umtxq_check_susp(td, false); + if (error == 0) + goto again; + } umtxq_unbusy_unlocked(&key); umtx_key_release(&key); if (error == -1) return (EFAULT); - if (old != owner) + if (error == 0 && old != owner) return (EINVAL); - return (0); + return (error); } /* @@ -2149,11 +2236,13 @@ do_lock_pp(struct thread *td, struct umutex *m, ui error = EFAULT; break; } - - if (owner == UMUTEX_CONTESTED) { + if (rv == 0) { + MPASS(owner == UMUTEX_CONTESTED); error = 0; break; - } else if (owner == UMUTEX_RB_OWNERDEAD) { + } + /* rv == 1 */ + if (owner == UMUTEX_RB_OWNERDEAD) { rv = casueword32(&m->m_owner, UMUTEX_RB_OWNERDEAD, &owner, id | UMUTEX_CONTESTED); if (rv == -1) { @@ -2160,20 +2249,36 @@ do_lock_pp(struct thread *td, struct umutex *m, ui error = EFAULT; break; } - if (owner == UMUTEX_RB_OWNERDEAD) { + if (rv == 0) { + MPASS(owner == UMUTEX_RB_OWNERDEAD); error = EOWNERDEAD; /* success */ break; } - error = 0; + + /* + * rv == 1, only check for suspension if we + * did not already catched a signal. If we + * get an error from the check, the same + * condition is checked by the umtxq_sleep() + * call below, so we should obliterate the + * error to not skip the last loop iteration. + */ + if (error == 0) { + error = umtxq_check_susp(td, false); + if (error == 0) { + if (try != 0) + error = EBUSY; + else + continue; + } + error = 0; + } } else if (owner == UMUTEX_RB_NOTRECOV) { error = ENOTRECOVERABLE; - break; } - if (try != 0) { + if (try != 0) error = EBUSY; - break; - } /* * If we caught a signal, we have retried and now @@ -2668,11 +2773,12 @@ do_rw_rdlock(struct thread *td, struct urwlock *rw umtx_key_release(&uq->uq_key); return (EFAULT); } - if (oldstate == state) { + if (rv == 0) { + MPASS(oldstate == state); umtx_key_release(&uq->uq_key); return (0); } - error = umtxq_check_susp(td); + error = umtxq_check_susp(td, true); if (error != 0) break; state = oldstate; @@ -2703,10 +2809,12 @@ do_rw_rdlock(struct thread *td, struct urwlock *rw error = EFAULT; break; } - if (oldstate == state) + if (rv == 0) { + MPASS(oldstate == state); goto sleep; + } state = oldstate; - error = umtxq_check_susp(td); + error = umtxq_check_susp(td, true); if (error != 0) break; } @@ -2718,7 +2826,7 @@ do_rw_rdlock(struct thread *td, struct urwlock *rw /* state is changed while setting flags, restart */ if (!(state & wrflags)) { umtxq_unbusy_unlocked(&uq->uq_key); - error = umtxq_check_susp(td); + error = umtxq_check_susp(td, true); if (error != 0) break; continue; @@ -2781,10 +2889,12 @@ sleep: error = EFAULT; break; } - if (oldstate == state) + if (rv == 0) { + MPASS(oldstate == state); break; + } state = oldstate; - error1 = umtxq_check_susp(td); + error1 = umtxq_check_susp(td, true); if (error1 != 0) { if (error == 0) error = error1; @@ -2840,22 +2950,25 @@ do_rw_wrlock(struct thread *td, struct urwlock *rw umtx_key_release(&uq->uq_key); return (EFAULT); } - if (oldstate == state) { + if (rv == 0) { + MPASS(oldstate == state); umtx_key_release(&uq->uq_key); return (0); } state = oldstate; - error = umtxq_check_susp(td); + error = umtxq_check_susp(td, true); if (error != 0) break; } if (error) { - if (!(state & (URWLOCK_WRITE_OWNER|URWLOCK_WRITE_WAITERS)) && + if ((state & (URWLOCK_WRITE_OWNER | + URWLOCK_WRITE_WAITERS)) == 0 && blocked_readers != 0) { umtxq_lock(&uq->uq_key); umtxq_busy(&uq->uq_key); - umtxq_signal_queue(&uq->uq_key, INT_MAX, UMTX_SHARED_QUEUE); + umtxq_signal_queue(&uq->uq_key, INT_MAX, + UMTX_SHARED_QUEUE); umtxq_unbusy(&uq->uq_key); umtxq_unlock(&uq->uq_key); } @@ -2885,10 +2998,12 @@ do_rw_wrlock(struct thread *td, struct urwlock *rw error = EFAULT; break; } - if (oldstate == state) + if (rv == 0) { + MPASS(oldstate == state); goto sleep; + } state = oldstate; - error = umtxq_check_susp(td); + error = umtxq_check_susp(td, true); if (error != 0) break; } @@ -2900,7 +3015,7 @@ do_rw_wrlock(struct thread *td, struct urwlock *rw if ((state & URWLOCK_WRITE_OWNER) == 0 && URWLOCK_READER_COUNT(state) == 0) { umtxq_unbusy_unlocked(&uq->uq_key); - error = umtxq_check_susp(td); + error = umtxq_check_susp(td, true); if (error != 0) break; continue; @@ -2958,10 +3073,12 @@ sleep: error = EFAULT; break; } - if (oldstate == state) + if (rv == 0) { + MPASS(oldstate == state); break; + } state = oldstate; - error1 = umtxq_check_susp(td); + error1 = umtxq_check_susp(td, true); /* * We are leaving the URWLOCK_WRITE_WAITERS * behind, but this should not harm the @@ -3021,13 +3138,13 @@ do_rw_unlock(struct thread *td, struct urwlock *rw error = EFAULT; goto out; } - if (oldstate != state) { + if (rv == 1) { state = oldstate; if (!(oldstate & URWLOCK_WRITE_OWNER)) { error = EPERM; goto out; } - error = umtxq_check_susp(td); + error = umtxq_check_susp(td, true); if (error != 0) goto out; } else @@ -3041,13 +3158,13 @@ do_rw_unlock(struct thread *td, struct urwlock *rw error = EFAULT; goto out; } - if (oldstate != state) { + if (rv == 1) { state = oldstate; if (URWLOCK_READER_COUNT(oldstate) == 0) { error = EPERM; goto out; } - error = umtxq_check_susp(td); + error = umtxq_check_susp(td, true); if (error != 0) goto out; } else @@ -3097,7 +3214,7 @@ do_sem_wait(struct thread *td, struct _usem *sem, struct abs_timeout timo; struct umtx_q *uq; uint32_t flags, count, count1; - int error, rv; + int error, rv, rv1; uq = td->td_umtxq; error = fueword32(&sem->_flags, &flags); @@ -3114,15 +3231,24 @@ do_sem_wait(struct thread *td, struct _usem *sem, umtxq_busy(&uq->uq_key); umtxq_insert(uq); umtxq_unlock(&uq->uq_key); +again: rv = casueword32(&sem->_has_waiters, 0, &count1, 1); if (rv == 0) - rv = fueword32(&sem->_count, &count); - if (rv == -1 || count != 0) { + rv1 = fueword32(&sem->_count, &count); + if (rv == -1 || (rv == 0 && (rv1 == -1 || count != 0)) || rv == 1) { umtxq_lock(&uq->uq_key); umtxq_unbusy(&uq->uq_key); umtxq_remove(uq); umtxq_unlock(&uq->uq_key); umtx_key_release(&uq->uq_key); + if (rv == 1) { + rv = umtxq_check_susp(td, true); + if (rv == 0) + goto again; + return (rv); + } + if (rv == 0) + rv = rv1; return (rv == -1 ? EFAULT : 0); } umtxq_lock(&uq->uq_key); @@ -3201,6 +3327,7 @@ do_sem2_wait(struct thread *td, struct _usem2 *sem if (timeout != NULL) abs_timeout_init2(&timo, timeout); +again: umtxq_lock(&uq->uq_key); umtxq_busy(&uq->uq_key); umtxq_insert(uq); @@ -3226,16 +3353,19 @@ do_sem2_wait(struct thread *td, struct _usem2 *sem if (count == USEM_HAS_WAITERS) break; rv = casueword32(&sem->_count, 0, &count, USEM_HAS_WAITERS); - if (rv == -1) { - umtxq_lock(&uq->uq_key); - umtxq_unbusy(&uq->uq_key); - umtxq_remove(uq); - umtxq_unlock(&uq->uq_key); - umtx_key_release(&uq->uq_key); + if (rv == 0) + break; + umtxq_lock(&uq->uq_key); + umtxq_unbusy(&uq->uq_key); + umtxq_remove(uq); + umtxq_unlock(&uq->uq_key); + umtx_key_release(&uq->uq_key); + if (rv == -1) return (EFAULT); - } - if (count == 0) - break; + rv = umtxq_check_susp(td, true); + if (rv != 0) + return (rv); + goto again; } umtxq_lock(&uq->uq_key); umtxq_unbusy(&uq->uq_key); @@ -3288,11 +3418,20 @@ do_sem2_wake(struct thread *td, struct _usem2 *sem if (cnt == 1) { umtxq_unlock(&key); rv = fueword32(&sem->_count, &count); - while (rv != -1 && count & USEM_HAS_WAITERS) + while (rv != -1 && count & USEM_HAS_WAITERS) { rv = casueword32(&sem->_count, count, &count, count & ~USEM_HAS_WAITERS); + if (rv == 1) { + rv = umtxq_check_susp(td, true); + if (rv != 0) + break; + } + } if (rv == -1) error = EFAULT; + else if (rv > 0) { + error = rv; + } umtxq_lock(&key); } Index: /usr/src/sys/mips/mips/support.S =================================================================== --- /usr/src/sys/mips/mips/support.S (revision 349856) +++ /usr/src/sys/mips/mips/support.S (working copy) @@ -336,19 +336,15 @@ XLEAF(casueword) GET_CPU_PCPU(v1) PTR_L v1, PC_CURPCB(v1) PTR_S v0, U_PCB_ONFAULT(v1) -1: + + li v0, 1 move t0, a3 ll t1, 0(a0) - bne a1, t1, 2f + bne a1, t1, 1f nop sc t0, 0(a0) # store word - beqz t0, 1b - nop - j 3f - li v0, 0 -2: - li v0, -1 -3: + xori v0, t0, 1 +1: PTR_S zero, U_PCB_ONFAULT(v1) jr ra sw t1, 0(a2) # unconditionally store old word @@ -363,19 +359,15 @@ XLEAF(casueword) GET_CPU_PCPU(v1) PTR_L v1, PC_CURPCB(v1) PTR_S v0, U_PCB_ONFAULT(v1) -1: + + li v0, 1 move t0, a3 lld t1, 0(a0) - bne a1, t1, 2f + bne a1, t1, 1f nop scd t0, 0(a0) # store double word - beqz t0, 1b - nop - j 3f - li v0, 0 -2: - li v0, -1 -3: + xori v0, t0, 1 +1: PTR_S zero, U_PCB_ONFAULT(v1) jr ra sd t1, 0(a2) # unconditionally store old word Index: /usr/src/sys/powerpc/powerpc/copyinout.c =================================================================== --- /usr/src/sys/powerpc/powerpc/copyinout.c (revision 349856) +++ /usr/src/sys/powerpc/powerpc/copyinout.c (working copy) @@ -433,6 +433,7 @@ casueword32(volatile uint32_t *addr, uint32_t old, pmap_t pm; jmp_buf env; uint32_t *p, val; + int res; td = curthread; pm = &td->td_proc->p_vmspace->vm_pmap; @@ -449,17 +450,19 @@ casueword32(volatile uint32_t *addr, uint32_t old, return (-1); } + res = 0; __asm __volatile ( - "1:\tlwarx %0, 0, %2\n\t" /* load old value */ - "cmplw %3, %0\n\t" /* compare */ - "bne 2f\n\t" /* exit if not equal */ - "stwcx. %4, 0, %2\n\t" /* attempt to store */ - "bne- 1b\n\t" /* spin if failed */ - "b 3f\n\t" /* we've succeeded */ + "lwarx %0, 0, %3\n\t" /* load old value */ + "cmplw %4, %0\n\t" /* compare */ + "bne 1f\n\t" /* exit if not equal */ + "stwcx. %5, 0, %3\n\t" /* attempt to store */ + "bne- 1f\n\t" /* if failed */ + "b 2f\n\t" /* we've succeeded */ + "1:\n\t" + "stwcx. %0, 0, %4\n\t" /* clear reservation (74xx) */ + "li %2, 1\n\t" "2:\n\t" - "stwcx. %0, 0, %2\n\t" /* clear reservation (74xx) */ - "3:\n\t" - : "=&r" (val), "=m" (*p) + : "=&r" (val), "=m" (*p), "=&r" (res) : "r" (p), "r" (old), "r" (new), "m" (*p) : "cr0", "memory"); @@ -466,7 +469,7 @@ casueword32(volatile uint32_t *addr, uint32_t old, td->td_pcb->pcb_onfault = NULL; *oldvalp = val; - return (0); + return (res); } #ifndef __powerpc64__ @@ -485,6 +488,7 @@ casueword(volatile u_long *addr, u_long old, u_lon pmap_t pm; jmp_buf env; u_long *p, val; + int res; td = curthread; pm = &td->td_proc->p_vmspace->vm_pmap; @@ -501,17 +505,19 @@ casueword(volatile u_long *addr, u_long old, u_lon return (-1); } + res = 0; __asm __volatile ( - "1:\tldarx %0, 0, %2\n\t" /* load old value */ - "cmpld %3, %0\n\t" /* compare */ - "bne 2f\n\t" /* exit if not equal */ - "stdcx. %4, 0, %2\n\t" /* attempt to store */ - "bne- 1b\n\t" /* spin if failed */ - "b 3f\n\t" /* we've succeeded */ + "ldarx %0, 0, %3\n\t" /* load old value */ + "cmpld %4, %0\n\t" /* compare */ + "bne 1f\n\t" /* exit if not equal */ + "stdcx. %5, 0, %3\n\t" /* attempt to store */ + "bne- 1f\n\t" /* if failed */ + "b 2f\n\t" /* we've succeeded */ + "1:\n\t" + "stdcx. %0, 0, %3\n\t" /* clear reservation (74xx) */ + "li %2, 1\n\t" "2:\n\t" - "stdcx. %0, 0, %2\n\t" /* clear reservation (74xx) */ - "3:\n\t" - : "=&r" (val), "=m" (*p) + : "=&r" (val), "=m" (*p), "=&r" (res) : "r" (p), "r" (old), "r" (new), "m" (*p) : "cr0", "memory"); @@ -518,6 +524,6 @@ casueword(volatile u_long *addr, u_long old, u_lon td->td_pcb->pcb_onfault = NULL; *oldvalp = val; - return (0); + return (res); } #endif Index: /usr/src/sys/riscv/riscv/support.S =================================================================== --- /usr/src/sys/riscv/riscv/support.S (revision 349856) +++ /usr/src/sys/riscv/riscv/support.S (working copy) @@ -60,14 +60,15 @@ ENTRY(casueword32) la a6, fsu_fault /* Load the fault handler */ SET_FAULT_HANDLER(a6, a4) /* And set it */ ENTER_USER_ACCESS(a4) -1: lr.w a4, 0(a0) /* Load-exclusive the data */ - bne a4, a1, 2f /* If not equal then exit */ + lr.w a4, 0(a0) /* Load-exclusive the data */ + bne a4, a1, 1f /* If not equal then exit */ sc.w a5, a3, 0(a0) /* Store the new data */ - bnez a5, 1b /* Retry on failure */ -2: EXIT_USER_ACCESS(a5) - SET_FAULT_HANDLER(x0, a5) /* Reset the fault handler */ + beqz a5, 2f /* Success */ +1: li a5, 1 /* Normalize failure result */ +2: EXIT_USER_ACCESS(a6) + SET_FAULT_HANDLER(x0, a6) /* Reset the fault handler */ sw a4, 0(a2) /* Store the read data */ - li a0, 0 /* Success */ + mv a0, a5 /* Success indicator */ ret /* Return */ END(casueword32) @@ -80,14 +81,15 @@ ENTRY(casueword) la a6, fsu_fault /* Load the fault handler */ SET_FAULT_HANDLER(a6, a4) /* And set it */ ENTER_USER_ACCESS(a4) -1: lr.d a4, 0(a0) /* Load-exclusive the data */ - bne a4, a1, 2f /* If not equal then exit */ + lr.d a4, 0(a0) /* Load-exclusive the data */ + bne a4, a1, 1f /* If not equal then exit */ sc.d a5, a3, 0(a0) /* Store the new data */ - bnez a5, 1b /* Retry on failure */ -2: EXIT_USER_ACCESS(a5) - SET_FAULT_HANDLER(x0, a5) /* Reset the fault handler */ + beqz a5, 2f /* Success */ +1: li a5, 1 /* Normalize failure result */ +2: EXIT_USER_ACCESS(a6) + SET_FAULT_HANDLER(x0, a6) /* Reset the fault handler */ sd a4, 0(a2) /* Store the read data */ - li a0, 0 /* Success */ + mv a0, a5 /* Success indicator */ ret /* Return */ END(casueword) Index: /usr/src/sys/sparc64/sparc64/support.S =================================================================== --- /usr/src/sys/sparc64/sparc64/support.S (revision 349856) +++ /usr/src/sys/sparc64/sparc64/support.S (working copy) @@ -403,8 +403,7 @@ fs_nofault_begin: .set susword, suword16 .set suword, suword64 - .globl casuword32, casuword, fuptr, suptr - .set casuword, casuword64 + .globl casuword32_int, casuword64_int, fuptr, suptr .set fuptr, fuword64 .set suptr, suword64 @@ -411,20 +410,20 @@ fs_nofault_begin: /* * int32_t casuword32(volatile int32_t *p, int32_t e, int32_t s) */ -ENTRY(casuword32) +ENTRY(casuword32_int) casa [%o0] ASI_AIUP, %o1, %o2 retl mov %o2, %o0 -END(casuword32) +END(casuword32_int) /* * int64_t casuword64(volatile int64_t *p, int64_t e, int64_t s) */ -ENTRY(casuword64) +ENTRY(casuword64_int) casxa [%o0] ASI_AIUP, %o1, %o2 retl mov %o2, %o0 -END(casuword64) +END(casuword64_int) /* * int fuword8(const void *base) Index: /usr/src/sys/sparc64/sparc64/vm_machdep.c =================================================================== --- /usr/src/sys/sparc64/sparc64/vm_machdep.c (revision 349856) +++ /usr/src/sys/sparc64/sparc64/vm_machdep.c (working copy) @@ -462,3 +462,28 @@ sf_buf_unmap(struct sf_buf *sf) pmap_qremove(sf->kva, 1); return (1); } + +uint32_t casuword32_int(volatile uint32_t *base, uint32_t oldval, + uint32_t newval); +uint32_t +casuword32(volatile uint32_t *base, uint32_t oldval, uint32_t newval) +{ + uint32_t ret; + + ret = casuword32_int(base, oldval, newval); + if (ret != -1) + ret = ret != oldval; + return (ret); +} + +u_long casuword64_int(volatile u_long *p, u_long oldval, u_long newval); +u_long +casuword(volatile u_long *p, u_long oldval, u_long newval) +{ + u_long ret; + + ret = casuword64_int(p, oldval, newval); + if (ret != -1L) + ret = ret != oldval; + return (ret); +} -- Test scenario: misc/syscall4.sh