GENERIC HEAD from 2013-07-21 17:23:49 UTC, r253524M, vmcore.3 GDB: no debug ports present KDB: debugger backends: ddb KDB: current backend: ddb Copyright (c) 1992-2013 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 10.0-CURRENT #1 r253524M: Mon Jul 22 09:43:32 CEST 2013 pho@t1.osted.lan:/var/tmp/vmobj-fullread/sys/amd64/compile/PHO amd64 FreeBSD clang version 3.3 (tags/RELEASE_33/final 183502) 20130610 WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. CPU: Intel(R) Xeon(R) CPU E5-2620 0 @ 2.00GHz (1995.24-MHz K8-class CPU) Origin = "GenuineIntel" Id = 0x206d7 Family = 0x6 Model = 0x2d Stepping = 7 Features=0xbfebfbff Features2=0x1fbee3ff AMD Features=0x2c100800 AMD Features2=0x1 TSC: P-state invariant, performance statistics real memory = 68719476736 (65536 MB) avail memory = 31063298048 (29624 MB) : Trying to mount root from ufs:/dev/da0p2 [rw]... Setting hostuuid: 3141f787-07e3-e111-b968-001e6756c168. Setting hostid: 0x564ac5b6. Starting ddb. Entropy harvesting: interrupts ethernet point_to_point kickstart. Starting file system checks: /dev/da0p2: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/da0p2: clean, 92777897 free (88617 frags, 11586160 blocks, 0.1% fragmentation) /dev/da0p3: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/da0p3: clean, 25343521 free (129 frags, 3167924 blocks, 0.0% fragmentation) Mounting local file systems:. Writing entropy file:. Setting hostname: t1.osted.lan. igb0: link state changed to UP Starting Network: lo0 igb0 igb1. lo0: flags=8049 metric 0 mtu 16384 options=600003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x3 inet 127.0.0.1 netmask 0xff000000 nd6 options=21 igb0: flags=8843 metric 0 mtu 1500 options=401bb ether 00:1e:67:56:c1:68 inet 192.168.1.108 netmask 0xffffff00 broadcast 192.168.1.255 inet6 fe80::21e:67ff:fe56:c168%igb0 prefixlen 64 scopeid 0x1 nd6 options=29 media: Ethernet autoselect (100baseTX ) status: active igb1: flags=8c02 metric 0 mtu 1500 options=401bb ether 00:1e:67:56:c1:69 nd6 options=29 media: Ethernet autoselect status: no carrier Starting devd. Starting Network: igb1. igb1: flags=8c02 metric 0 mtu 1500 options=401bb ether 00:1e:67:56:c1:69 nd6 options=29 media: Ethernet autoselect status: no carrier Configuring keyboard: keymap. ums0: on usbus2 ums0: 3 buttons and [Z] coordinates ID=0 Starting ums0 moused. Expensive timeout(9) function: 0xffffffff807149c0(0xffffffff815a5f50) 0.006106405 s add net default: gateway 192.168.1.1 add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib 32-bit compatibility ldconfig path: /usr/lib32 Creating and/or trimming log files. Starting syslogd. No core dumps found. Starting rpcbind. NFS access cache time=60 Clearing /tmp (X related). Starting nfsuserd. Starting mountd. Starting nfsd. Updating motd:. Mounting late file systems:. Starting ntpd. Starting powerd. Configuring syscons: keymap blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting cron. Starting default mousedmoused: unable to open /dev/psm0: No such file or directory . Mon Jul 22 09:47:08 CEST 2013 FreeBSD/amd64 (t1.osted.lan) (console) login: Jul 22 09:48:25 t1 su: pho to root on /dev/pts/0 lock order reversal: 1st 0xffffff8789ee8e28 bufwait (bufwait) @ kern/vfs_bio.c:3054 2nd 0xfffffe00558e1200 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:284 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xffffff8822111290 kdb_backtrace() at kdb_backtrace+0x39/frame 0xffffff8822111340 witness_checkorder() at witness_checkorder+0xd4f/frame 0xffffff88221113d0 _sx_xlock() at _sx_xlock+0x75/frame 0xffffff8822111410 ufsdirhash_add() at ufsdirhash_add+0x4c/frame 0xffffff8822111450 ufs_direnter() at ufs_direnter+0x688/frame 0xffffff8822111510 ufs_makeinode() at ufs_makeinode+0x573/frame 0xffffff88221116d0 VOP_CREATE_APV() at VOP_CREATE_APV+0x108/frame 0xffffff8822111700 vn_open_cred() at vn_open_cred+0x2f0/frame 0xffffff8822111850 kern_openat() at kern_openat+0x1f5/frame 0xffffff88221119a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff8822111ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff8822111ab0 --- syscall (5, FreeBSD ELF64, sys_open), rip = 0x800dd1b0a, rsp = 0x7fffffffd5f8, rbp = 0x7fffffffd6e0 --- 20130722 10:58:20 all (1/196): quota8.sh lock order reversal: 1st 0xffffff8789e1a288 bufwait (bufwait) @ vm/vm_pager.c:308 2nd 0xfffffe01411f27b8 ufs (ufs) @ dev/md/md.c:774 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xffffff8822125600 kdb_backtrace() at kdb_backtrace+0x39/frame 0xffffff88221256b0 witness_checkorder() at witness_checkorder+0xd4f/frame 0xffffff8822125740 __lockmgr_args() at __lockmgr_args+0x6f2/frame 0xffffff8822125870 ffs_lock() at ffs_lock+0x92/frame 0xffffff88221258c0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xf5/frame 0xffffff88221258f0 _vn_lock() at _vn_lock+0xc6/frame 0xffffff8822125960 mdstart_vnode() at mdstart_vnode+0x300/frame 0xffffff8822125a20 md_kthread() at md_kthread+0x17d/frame 0xffffff8822125a70 fork_exit() at fork_exit+0x84/frame 0xffffff8822125ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8822125ab0 --- trap 0, rip = 0, rsp = 0xffffff8822125b70, rbp = 0 --- lock order reversal: 1st 0xffffff8789f011e8 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:262 2nd 0xfffffe068f030d30 snaplk (snaplk) @ ufs/ffs/ffs_snapshot.c:2297 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xffffff8821e29cb0 kdb_backtrace() at kdb_backtrace+0x39/frame 0xffffff8821e29d60 witness_checkorder() at witness_checkorder+0xd4f/frame 0xffffff8821e29df0 __lockmgr_args() at __lockmgr_args+0x6f2/frame 0xffffff8821e29f20 ffs_copyonwrite() at ffs_copyonwrite+0x17a/frame 0xffffff8821e29fd0 ffs_geom_strategy() at ffs_geom_strategy+0xdd/frame 0xffffff8821e2a000 ufs_strategy() at ufs_strategy+0x8a/frame 0xffffff8821e2a030 VOP_STRATEGY_APV() at VOP_STRATEGY_APV+0x119/frame 0xffffff8821e2a060 bufstrategy() at bufstrategy+0x46/frame 0xffffff8821e2a0a0 bufwrite() at bufwrite+0x170/frame 0xffffff8821e2a0f0 ffs_syncvnode() at ffs_syncvnode+0x303/frame 0xffffff8821e2a170 ffs_snapshot() at ffs_snapshot+0x741/frame 0xffffff8821e2a480 ffs_mount() at ffs_mount+0x1053/frame 0xffffff8821e2a6b0 vfs_donmount() at vfs_donmount+0xf3e/frame 0xffffff8821e2a960 sys_nmount() at sys_nmount+0x72/frame 0xffffff8821e2a9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff8821e2aab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff8821e2aab0 --- syscall (378, FreeBSD ELF64, sys_nmount), rip = 0x80088297a, rsp = 0x7fffffffcf68, rbp = 0x7fffffffd6f0 --- lock order reversal: 1st 0xfffffe068f030d30 snaplk (snaplk) @ ufs/ufs/ufs_vnops.c:968 2nd 0xfffffe00557e9c98 ufs (ufs) @ ufs/ffs/ffs_snapshot.c:1628 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xffffff8822139210 kdb_backtrace() at kdb_backtrace+0x39/frame 0xffffff88221392c0 witness_checkorder() at witness_checkorder+0xd4f/frame 0xffffff8822139350 __lockmgr_args() at __lockmgr_args+0x6f2/frame 0xffffff8822139480 ffs_snapremove() at ffs_snapremove+0xfa/frame 0xffffff88221394f0 ffs_truncate() at ffs_truncate+0x27e/frame 0xffffff88221396d0 ufs_inactive() at ufs_inactive+0x171/frame 0xffffff8822139710 VOP_INACTIVE_APV() at VOP_INACTIVE_APV+0x10e/frame 0xffffff8822139740 vinactive() at vinactive+0x157/frame 0xffffff8822139790 vputx() at vputx+0x370/frame 0xffffff88221397f0 kern_unlinkat() at kern_unlinkat+0x256/frame 0xffffff88221399a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff8822139ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff8822139ab0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80093164a, rsp = 0x7fffffffd5a8, rbp = 0x7fffffffd640 --- lock order reversal: 1st 0xfffffe008a871068 ufs (ufs) @ kern/vfs_mount.c:1237 2nd 0xfffffe0141e97068 syncer (syncer) @ kern/vfs_subr.c:2210 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xffffff8821fef480 kdb_backtrace() at kdb_backtrace+0x39/frame 0xffffff8821fef530 witness_checkorder() at witness_checkorder+0xd4f/frame 0xffffff8821fef5c0 __lockmgr_args() at __lockmgr_args+0x6f2/frame 0xffffff8821fef6f0 vop_stdlock() at vop_stdlock+0x3c/frame 0xffffff8821fef710 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xf5/frame 0xffffff8821fef740 _vn_lock() at _vn_lock+0xc6/frame 0xffffff8821fef7b0 vputx() at vputx+0x328/frame 0xffffff8821fef810 dounmount() at dounmount+0x2a6/frame 0xffffff8821fef890 sys_unmount() at sys_unmount+0x376/frame 0xffffff8821fef9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff8821fefab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff8821fefab0 --- syscall (22, FreeBSD ELF64, sys_unmount), rip = 0x800885d7a, rsp = 0x7fffffffced8, rbp = 0x7fffffffcff0 --- lock order reversal: 1st 0xfffffe008a871068 ufs (ufs) @ kern/vfs_mount.c:1237 2nd 0xfffffe008a8e4068 devfs (devfs) @ ufs/ffs/ffs_softdep.c:1870 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xffffff8821fef3b0 kdb_backtrace() at kdb_backtrace+0x39/frame 0xffffff8821fef460 witness_checkorder() at witness_checkorder+0xd4f/frame 0xffffff8821fef4f0 __lockmgr_args() at __lockmgr_args+0x6f2/frame 0xffffff8821fef620 vop_stdlock() at vop_stdlock+0x3c/frame 0xffffff8821fef640 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xf5/frame 0xffffff8821fef670 _vn_lock() at _vn_lock+0xc6/frame 0xffffff8821fef6e0 softdep_flushworklist() at softdep_flushworklist+0x70/frame 0xffffff8821fef740 ffs_sync() at ffs_sync+0x29d/frame 0xffffff8821fef810 dounmount() at dounmount+0x360/frame 0xffffff8821fef890 sys_unmount() at sys_unmount+0x376/frame 0xffffff8821fef9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff8821fefab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff8821fefab0 --- syscall (22, FreeBSD ELF64, sys_unmount), rip = 0x800885d7a, rsp = 0x7fffffffced8, rbp = 0x7fffffffcff0 --- lock order reversal: 1st 0xfffffe068f194790 struct mount mtx (struct mount mtx) @ ufs/ffs/ffs_softdep.c:1961 2nd 0xfffffe04a9dd3688 FFS (FFS Lock) @ ufs/ffs/ffs_softdep.c:1967 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xffffff8821fef5c0 kdb_backtrace() at kdb_backtrace+0x39/frame 0xffffff8821fef670 witness_checkorder() at witness_checkorder+0xd4f/frame 0xffffff8821fef700 __mtx_lock_flags() at __mtx_lock_flags+0x96/frame 0xffffff8821fef740 softdep_flushfiles() at softdep_flushfiles+0xc2/frame 0xffffff8821fef7a0 ffs_unmount() at ffs_unmount+0x1a2/frame 0xffffff8821fef810 dounmount() at dounmount+0x39e/frame 0xffffff8821fef890 sys_unmount() at sys_unmount+0x376/frame 0xffffff8821fef9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff8821fefab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff8821fefab0 --- syscall (22, FreeBSD ELF64, sys_unmount), rip = 0x800885d7a, rsp = 0x7fffffffced8, rbp = 0x7fffffffcff0 --- 20130722 10:59:20 all (2/196): mountu.sh lock order reversal: 1st 0xfffffe008ac5d548 msdosfs (msdosfs) @ kern/vfs_subr.c:2099 2nd 0xfffffe00557e9a28 devfs (devfs) @ fs/msdosfs/msdosfs_vnops.c:882 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xffffff8821e39060 kdb_backtrace() at kdb_backtrace+0x39/frame 0xffffff8821e39110 witness_checkorder() at witness_checkorder+0xd4f/frame 0xffffff8821e391a0 __lockmgr_args() at __lockmgr_args+0x6f2/frame 0xffffff8821e392d0 vop_stdlock() at vop_stdlock+0x3c/frame 0xffffff8821e392f0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xf5/frame 0xffffff8821e39320 _vn_lock() at _vn_lock+0xc6/frame 0xffffff8821e39390 msdosfs_fsync() at msdosfs_fsync+0x4a/frame 0xffffff8821e393e0 VOP_FSYNC_APV() at VOP_FSYNC_APV+0x10e/frame 0xffffff8821e39410 msdosfs_sync() at msdosfs_sync+0xd6/frame 0xffffff8821e394b0 msdosfs_mount() at msdosfs_mount+0xfc/frame 0xffffff8821e396b0 vfs_donmount() at vfs_donmount+0xf3e/frame 0xffffff8821e39960 sys_nmount() at sys_nmount+0x72/frame 0xffffff8821e399a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff8821e39ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff8821e39ab0 --- syscall (378, FreeBSD ELF64, sys_nmount), rip = 0x800a8697a, rsp = 0x7fffffffd0e8, rbp = 0x7fffffffd710 --- 20130722 10:59:38 all (3/196): kevent.sh 20130722 10:59:43 all (4/196): core.sh 20130722 11:02:01 all (5/196): suj.sh 20130722 11:02:02 all (6/196): callout_reset_on.sh 20130722 11:21:39 all (7/196): kinfo2.sh Jul 22 11:24:50 t1 su: pho to root on /dev/pts/1 20130722 11:51:40 all (8/196): suj4.sh 20130722 11:51:41 all (9/196): fullpath.sh 20130722 11:52:41 all (10/196): snap4.sh 20130722 12:22:44 all (11/196): softupdate.sh 20130722 12:22:53 all (12/196): truncate3.sh 20130722 12:22:59 all (13/196): suj20.sh 20130722 12:35:34 all (1/213): unload2.sh 20130722 12:35:35 all (2/213): sendfile.sh lock order reversal: 1st 0xfffffe0055be2738 so_snd_sx (so_snd_sx) @ kern/uipc_sockbuf.c:145 2nd 0xfffffe0141cf0c98 ufs (ufs) @ kern/uipc_syscalls.c:2183 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xffffff88222793e0 kdb_backtrace() at kdb_backtrace+0x39/frame 0xffffff8822279490 witness_checkorder() at witness_checkorder+0xd4f/frame 0xffffff8822279520 __lockmgr_args() at __lockmgr_args+0x456/frame 0xffffff8822279650 ffs_lock() at ffs_lock+0x92/frame 0xffffff88222796a0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xf5/frame 0xffffff88222796d0 _vn_lock() at _vn_lock+0xc6/frame 0xffffff8822279740 kern_sendfile() at kern_sendfile+0x7d3/frame 0xffffff8822279940 do_sendfile() at do_sendfile+0x92/frame 0xffffff88222799a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff8822279ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff8822279ab0 --- syscall (393, FreeBSD ELF64, sys_sendfile), rip = 0x800aa783a, rsp = 0x7fffffffd5a8, rbp = 0x7fffffffd690 --- panic: vm_page_grab: VM_ALLOC_NOBUSY with object read lock cpuid = 10 KDB: enter: panic [ thread pid 37640 tid 101382 ] Stopped at kdb_enter+0x3e: movq $0,kdb_why db> run pho db:0:pho> bt Tracing pid 37640 tid 101382 td 0xfffffe03468f8000 kdb_enter() at kdb_enter+0x3e/frame 0xffffff8822279640 vpanic() at vpanic+0x146/frame 0xffffff8822279680 kassert_panic() at kassert_panic+0x136/frame 0xffffff88222796f0 vm_page_grab() at vm_page_grab+0xe7/frame 0xffffff8822279740 kern_sendfile() at kern_sendfile+0x922/frame 0xffffff8822279940 do_sendfile() at do_sendfile+0x92/frame 0xffffff88222799a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff8822279ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff8822279ab0 --- syscall (393, FreeBSD ELF64, sys_sendfile), rip = 0x800aa783a, rsp = 0x7fffffffd5a8, rbp = 0x7fffffffd690 --- db:0:bt> show allpcpu Current CPU: 10 cpuid = 0 dynamic pcpu = 0x5d2580 curthread = 0xfffffe005029b920: pid 11 "idle: cpu0" curpcb = 0xffffff800030fb80 fpcurthread = none idlethread = 0xfffffe005029b920: tid 100003 "idle: cpu0" curpmap = 0xffffffff815e2428 tssp = 0xffffffff815f9210 commontssp = 0xffffffff815f9210 rsp0 = 0xffffff800030fb80 gs32p = 0xffffffff815fac68 ldt = 0xffffffff815faca8 tss = 0xffffffff815fac98 spin locks held: cpuid = 1 dynamic pcpu = 0xffffff807ef05580 curthread = 0xfffffe005029b490: pid 11 "idle: cpu1" curpcb = 0xffffff8000314b80 fpcurthread = none idlethread = 0xfffffe005029b490: tid 100004 "idle: cpu1" curpmap = 0xffffffff815e2428 tssp = 0xffffffff815f9278 commontssp = 0xffffffff815f9278 rsp0 = 0xffffff8000314b80 gs32p = 0xffffffff815facd0 ldt = 0xffffffff815fad10 tss = 0xffffffff815fad00 spin locks held: cpuid = 2 dynamic pcpu = 0xffffff807ef0c580 curthread = 0xfffffe005029b000: pid 11 "idle: cpu2" curpcb = 0xffffff8000319b80 fpcurthread = none idlethread = 0xfffffe005029b000: tid 100005 "idle: cpu2" curpmap = 0xffffffff815e2428 tssp = 0xffffffff815f92e0 commontssp = 0xffffffff815f92e0 rsp0 = 0xffffff8000319b80 gs32p = 0xffffffff815fad38 ldt = 0xffffffff815fad78 tss = 0xffffffff815fad68 spin locks held: cpuid = 3 dynamic pcpu = 0xffffff807ef13580 curthread = 0xfffffe00502af000: pid 11 "idle: cpu3" curpcb = 0xffffff800031eb80 fpcurthread = none idlethread = 0xfffffe00502af000: tid 100006 "idle: cpu3" curpmap = 0xffffffff815e2428 tssp = 0xffffffff815f9348 commontssp = 0xffffffff815f9348 rsp0 = 0xffffff800031eb80 gs32p = 0xffffffff815fada0 ldt = 0xffffffff815fade0 tss = 0xffffffff815fadd0 spin locks held: cpuid = 4 dynamic pcpu = 0xffffff807ef1a580 curthread = 0xfffffe00502ae920: pid 11 "idle: cpu4" curpcb = 0xffffff8000323b80 fpcurthread = none idlethread = 0xfffffe00502ae920: tid 100007 "idle: cpu4" curpmap = 0xffffffff815e2428 tssp = 0xffffffff815f93b0 commontssp = 0xffffffff815f93b0 rsp0 = 0xffffff8000323b80 gs32p = 0xffffffff815fae08 ldt = 0xffffffff815fae48 tss = 0xffffffff815fae38 spin locks held: cpuid = 5 dynamic pcpu = 0xffffff807ef21580 curthread = 0xfffffe00502ae490: pid 11 "idle: cpu5" curpcb = 0xffffff8000328b80 fpcurthread = none idlethread = 0xfffffe00502ae490: tid 100008 "idle: cpu5" curpmap = 0xffffffff815e2428 tssp = 0xffffffff815f9418 commontssp = 0xffffffff815f9418 rsp0 = 0xffffff8000328b80 gs32p = 0xffffffff815fae70 ldt = 0xffffffff815faeb0 tss = 0xffffffff815faea0 spin locks held: cpuid = 6 dynamic pcpu = 0xffffff807ef28580 curthread = 0xfffffe00502ae000: pid 11 "idle: cpu6" curpcb = 0xffffff800032db80 fpcurthread = none idlethread = 0xfffffe00502ae000: tid 100009 "idle: cpu6" curpmap = 0xffffffff815e2428 tssp = 0xffffffff815f9480 commontssp = 0xffffffff815f9480 rsp0 = 0xffffff800032db80 gs32p = 0xffffffff815faed8 ldt = 0xffffffff815faf18 tss = 0xffffffff815faf08 spin locks held: cpuid = 7 dynamic pcpu = 0xffffff807ef2f580 curthread = 0xfffffe00502a1920: pid 11 "idle: cpu7" curpcb = 0xffffff8000332b80 fpcurthread = none idlethread = 0xfffffe00502a1920: tid 100010 "idle: cpu7" curpmap = 0xffffffff815e2428 tssp = 0xffffffff815f94e8 commontssp = 0xffffffff815f94e8 rsp0 = 0xffffff8000332b80 gs32p = 0xffffffff815faf40 ldt = 0xffffffff815faf80 tss = 0xffffffff815faf70 spin locks held: cpuid = 8 dynamic pcpu = 0xffffff807ef36580 curthread = 0xfffffe00502b0920: pid 11 "idle: cpu8" curpcb = 0xffffff8000337b80 fpcurthread = none idlethread = 0xfffffe00502b0920: tid 100011 "idle: cpu8" curpmap = 0xffffffff815e2428 tssp = 0xffffffff815f9550 commontssp = 0xffffffff815f9550 rsp0 = 0xffffff8000337b80 gs32p = 0xffffffff815fafa8 ldt = 0xffffffff815fafe8 tss = 0xffffffff815fafd8 spin locks held: cpuid = 9 dynamic pcpu = 0xffffff807ef3d580 curthread = 0xfffffe00502b0490: pid 11 "idle: cpu9" curpcb = 0xffffff800033cb80 fpcurthread = none idlethread = 0xfffffe00502b0490: tid 100012 "idle: cpu9" curpmap = 0xffffffff815e2428 tssp = 0xffffffff815f95b8 commontssp = 0xffffffff815f95b8 rsp0 = 0xffffff800033cb80 gs32p = 0xffffffff815fb010 ldt = 0xffffffff815fb050 tss = 0xffffffff815fb040 spin locks held: cpuid = 10 dynamic pcpu = 0xffffff807ef44580 curthread = 0xfffffe03468f8000: pid 37640 "sendfile" curpcb = 0xffffff8822279b80 fpcurthread = 0xfffffe03468f8000: pid 37640 "sendfile" idlethread = 0xfffffe00502b0000: tid 100013 "idle: cpu10" curpmap = 0xfffffe0055fb2778 tssp = 0xffffffff815f9620 commontssp = 0xffffffff815f9620 rsp0 = 0xffffff8822279b80 gs32p = 0xffffffff815fb078 ldt = 0xffffffff815fb0b8 tss = 0xffffffff815fb0a8 spin locks held: cpuid = 11 dynamic pcpu = 0xffffff807ef4b580 curthread = 0xfffffe00502af920: pid 11 "idle: cpu11" curpcb = 0xffffff8000346b80 fpcurthread = none idlethread = 0xfffffe00502af920: tid 100014 "idle: cpu11" curpmap = 0xffffffff815e2428 tssp = 0xffffffff815f9688 commontssp = 0xffffffff815f9688 rsp0 = 0xffffff8000346b80 gs32p = 0xffffffff815fb0e0 ldt = 0xffffffff815fb120 tss = 0xffffffff815fb110 spin locks held: cpuid = 12 dynamic pcpu = 0xffffff807ef52580 curthread = 0xfffffe00502af490: pid 11 "idle: cpu12" curpcb = 0xffffff800034bb80 fpcurthread = none idlethread = 0xfffffe00502af490: tid 100015 "idle: cpu12" curpmap = 0xffffffff815e2428 tssp = 0xffffffff815f96f0 commontssp = 0xffffffff815f96f0 rsp0 = 0xffffff800034bb80 gs32p = 0xffffffff815fb148 ldt = 0xffffffff815fb188 tss = 0xffffffff815fb178 spin locks held: cpuid = 13 dynamic pcpu = 0xffffff807ef59580 curthread = 0xfffffe00502b2490: pid 11 "idle: cpu13" curpcb = 0xffffff8000350b80 fpcurthread = none idlethread = 0xfffffe00502b2490: tid 100016 "idle: cpu13" curpmap = 0xffffffff815e2428 tssp = 0xffffffff815f9758 commontssp = 0xffffffff815f9758 rsp0 = 0xffffff8000350b80 gs32p = 0xffffffff815fb1b0 ldt = 0xffffffff815fb1f0 tss = 0xffffffff815fb1e0 spin locks held: cpuid = 14 dynamic pcpu = 0xffffff807ef60580 curthread = 0xfffffe00502b2000: pid 11 "idle: cpu14" curpcb = 0xffffff8000355b80 fpcurthread = none idlethread = 0xfffffe00502b2000: tid 100017 "idle: cpu14" curpmap = 0xffffffff815e2428 tssp = 0xffffffff815f97c0 commontssp = 0xffffffff815f97c0 rsp0 = 0xffffff8000355b80 gs32p = 0xffffffff815fb218 ldt = 0xffffffff815fb258 tss = 0xffffffff815fb248 spin locks held: cpuid = 15 dynamic pcpu = 0xffffff807ef67580 curthread = 0xfffffe00502b1920: pid 11 "idle: cpu15" curpcb = 0xffffff800035ab80 fpcurthread = none idlethread = 0xfffffe00502b1920: tid 100018 "idle: cpu15" curpmap = 0xffffffff815e2428 tssp = 0xffffffff815f9828 commontssp = 0xffffffff815f9828 rsp0 = 0xffffff800035ab80 gs32p = 0xffffffff815fb280 ldt = 0xffffffff815fb2c0 tss = 0xffffffff815fb2b0 spin locks held: cpuid = 16 dynamic pcpu = 0xffffff807ef6e580 curthread = 0xfffffe00502b1490: pid 11 "idle: cpu16" curpcb = 0xffffff800035fb80 fpcurthread = none idlethread = 0xfffffe00502b1490: tid 100019 "idle: cpu16" curpmap = 0xffffffff815e2428 tssp = 0xffffffff815f9890 commontssp = 0xffffffff815f9890 rsp0 = 0xffffff800035fb80 gs32p = 0xffffffff815fb2e8 ldt = 0xffffffff815fb328 tss = 0xffffffff815fb318 spin locks held: cpuid = 17 dynamic pcpu = 0xffffff807ef75580 curthread = 0xfffffe00502b1000: pid 11 "idle: cpu17" curpcb = 0xffffff8000364b80 fpcurthread = none idlethread = 0xfffffe00502b1000: tid 100020 "idle: cpu17" curpmap = 0xffffffff815e2428 tssp = 0xffffffff815f98f8 commontssp = 0xffffffff815f98f8 rsp0 = 0xffffff8000364b80 gs32p = 0xffffffff815fb350 ldt = 0xffffffff815fb390 tss = 0xffffffff815fb380 spin locks held: cpuid = 18 dynamic pcpu = 0xffffff807ef7c580 curthread = 0xfffffe00502b4000: pid 11 "idle: cpu18" curpcb = 0xffffff8000369b80 fpcurthread = none idlethread = 0xfffffe00502b4000: tid 100021 "idle: cpu18" curpmap = 0xffffffff815e2428 tssp = 0xffffffff815f9960 commontssp = 0xffffffff815f9960 rsp0 = 0xffffff8000369b80 gs32p = 0xffffffff815fb3b8 ldt = 0xffffffff815fb3f8 tss = 0xffffffff815fb3e8 spin locks held: cpuid = 19 dynamic pcpu = 0xffffff807ef83580 curthread = 0xfffffe00502b3920: pid 11 "idle: cpu19" curpcb = 0xffffff800036eb80 fpcurthread = none idlethread = 0xfffffe00502b3920: tid 100022 "idle: cpu19" curpmap = 0xffffffff815e2428 tssp = 0xffffffff815f99c8 commontssp = 0xffffffff815f99c8 rsp0 = 0xffffff800036eb80 gs32p = 0xffffffff815fb420 ldt = 0xffffffff815fb460 tss = 0xffffffff815fb450 spin locks held: cpuid = 20 dynamic pcpu = 0xffffff807ef8a580 curthread = 0xfffffe00502b3490: pid 11 "idle: cpu20" curpcb = 0xffffff8000373b80 fpcurthread = none idlethread = 0xfffffe00502b3490: tid 100023 "idle: cpu20" curpmap = 0xffffffff815e2428 tssp = 0xffffffff815f9a30 commontssp = 0xffffffff815f9a30 rsp0 = 0xffffff8000373b80 gs32p = 0xffffffff815fb488 ldt = 0xffffffff815fb4c8 tss = 0xffffffff815fb4b8 spin locks held: cpuid = 21 dynamic pcpu = 0xffffff807ef91580 curthread = 0xfffffe00502b3000: pid 11 "idle: cpu21" curpcb = 0xffffff8000378b80 fpcurthread = none idlethread = 0xfffffe00502b3000: tid 100024 "idle: cpu21" curpmap = 0xffffffff815e2428 tssp = 0xffffffff815f9a98 commontssp = 0xffffffff815f9a98 rsp0 = 0xffffff8000378b80 gs32p = 0xffffffff815fb4f0 ldt = 0xffffffff815fb530 tss = 0xffffffff815fb520 spin locks held: cpuid = 22 dynamic pcpu = 0xffffff807ef98580 curthread = 0xfffffe00502b2920: pid 11 "idle: cpu22" curpcb = 0xffffff800037db80 fpcurthread = none idlethread = 0xfffffe00502b2920: tid 100025 "idle: cpu22" curpmap = 0xffffffff815e2428 tssp = 0xffffffff815f9b00 commontssp = 0xffffffff815f9b00 rsp0 = 0xffffff800037db80 gs32p = 0xffffffff815fb558 ldt = 0xffffffff815fb598 tss = 0xffffffff815fb588 spin locks held: cpuid = 23 dynamic pcpu = 0xffffff807ef9f580 curthread = 0xfffffe00502b5920: pid 11 "idle: cpu23" curpcb = 0xffffff8000382b80 fpcurthread = none idlethread = 0xfffffe00502b5920: tid 100026 "idle: cpu23" curpmap = 0xffffffff815e2428 tssp = 0xffffffff815f9b68 commontssp = 0xffffffff815f9b68 rsp0 = 0xffffff8000382b80 gs32p = 0xffffffff815fb5c0 ldt = 0xffffffff815fb600 tss = 0xffffffff815fb5f0 spin locks held: db:0:allpcpu> show alllocks Process 37640 (sendfile) thread 0xfffffe03468f8000 (101382) shared rw vm object (vm object) r = 0 (0xfffffe06a7f820f0) locked @ kern/uipc_syscalls.c:2224 shared lockmgr ufs (ufs) r = 0 (0xfffffe0141cf0c98) locked @ kern/uipc_syscalls.c:2183 exclusive sx so_snd_sx (so_snd_sx) r = 0 (0xfffffe0055be2738) locked @ kern/uipc_sockbuf.c:145 Process 37639 (sendfile) thread 0xfffffe06a7d83000 (101727) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xfffffe03efef6e40) locked @ kern/uipc_sockbuf.c:148 db:0:alllocks> show lockedvnods Locked vnodes 0xfffffe0141cf0c30: tag ufs, type VREG usecount 3, writecount 0, refcount 5 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffffe06a7f820f0 ref 1 pages 1 lock type ufs: SHARED (count 1) #0 0xffffffff8089fec7 at __lockmgr_args+0x10b7 #1 0xffffffff80b0d832 at ffs_lock+0x92 #2 0xffffffff80d5f4f5 at VOP_LOCK1_APV+0xf5 #3 0xffffffff809717d6 at _vn_lock+0xc6 #4 0xffffffff8093e183 at kern_sendfile+0x7d3 #5 0xffffffff8093d922 at do_sendfile+0x92 #6 0xffffffff80cb4a12 at amd64_syscall+0x282 #7 0xffffffff80c9d06b at Xfast_syscall+0xfb ino 31, on dev da0p3 db:0:lockedvnods> show mount 0xfffffe005568ab58 /dev/da0p2 on / (ufs) 0xfffffe005568b000 devfs on /dev (devfs) 0xfffffe0055e6a3c8 /dev/da0p3 on /tmp (ufs) 0xfffffe0137d12000 procfs on /proc (procfs) More info: show mount db:0:mount> ps pid ppid pgrp uid state wmesg wchan cmd 37640 37639 36266 0 R+ CPU 10 sendfile 37639 37625 36266 0 S+ sbwait 0xfffffe03efef6e8c sendfile 37625 36858 36266 0 S+ wait 0xfffffe06a73104b8 sh 36858 36266 36266 0 S+ wait 0xfffffe06a774e4b8 sh 36266 1039 36266 0 S+ wait 0xfffffe02d39964b8 sh 23605 30051 23605 0 S+ select 0xfffffe008a48ae40 top 30051 25164 30051 0 S+ wait 0xfffffe04a9e05970 bash 25164 14170 25164 0 S+ pause 0xfffffe06a7a4ea18 csh 14170 1098 14170 1001 S+ wait 0xfffffe02d3982000 su 1098 1097 1098 1001 Ss+ wait 0xfffffe008ac3c970 bash 1097 1095 1095 1001 S select 0xfffffe008a675c40 sshd 1095 949 1095 0 Ss select 0xfffffe0055a289c0 sshd 1042 1039 1042 0 T+ sh 1039 1037 1039 0 S+ wait 0xfffffe0055c3f4b8 bash 1037 1036 1037 0 S+ pause 0xfffffe005570fa18 csh 1036 1032 1036 1001 S+ wait 0xfffffe005578c970 su 1032 1031 1032 1001 Ss+ wait 0xfffffe008aa8a4b8 bash 1031 1029 1029 1001 S select 0xfffffe008a498dc0 sshd 1029 949 1029 0 Ss select 0xfffffe0055b71a40 sshd 1028 1 1028 0 Ss+ ttyin 0xfffffe0054093ca8 getty 1027 1 1027 0 Ss+ ttyin 0xfffffe00540940a8 getty 1026 1 1026 0 Ss+ ttyin 0xfffffe00540944a8 getty 1025 1 1025 0 Ss+ ttyin 0xfffffe00540948a8 getty 1024 1 1024 0 Ss+ ttyin 0xfffffe0054094ca8 getty 1023 1 1023 0 Ss+ ttyin 0xfffffe00540950a8 getty 1022 1 1022 0 Ss+ ttyin 0xfffffe0054083ca8 getty 1021 1 1021 0 Ss+ ttyin 0xfffffe00540890a8 getty 1020 1 1020 0 Ss+ ttyin 0xfffffe00503aa4a8 getty 959 1 959 0 Ss nanslp 0xffffffff813977eb cron 955 1 955 25 Ss pause 0xfffffe0055eac560 sendmail 952 1 952 0 Ss select 0xfffffe0055b71ac0 sendmail 949 1 949 0 Ss select 0xfffffe008a9f1240 sshd 921 1 921 0 Ss select 0xfffffe008a559d40 powerd 918 1 918 0 Ss select 0xfffffe0055a28a40 ntpd 879 878 878 0 S (threaded) nfsd 100198 S rpcsvc 0xfffffe0055539020 nfsd: service 100197 S rpcsvc 0xfffffe00555390a0 nfsd: service 100196 S rpcsvc 0xfffffe0055539120 nfsd: service 100169 S rpcsvc 0xfffffe0055d8a4a0 nfsd: master 878 1 878 0 Ss select 0xfffffe008a94b0c0 nfsd 872 1 872 0 Ss select 0xfffffe008a559cc0 mountd 865 861 861 0 S select 0xfffffe008a94b1c0 nfsuserd 864 861 861 0 S select 0xfffffe00551db6c0 nfsuserd 863 861 861 0 S select 0xfffffe008a475940 nfsuserd 862 861 861 0 S select 0xfffffe0055a28ac0 nfsuserd 861 1 861 0 Ss pause 0xfffffe00558dfa18 nfsuserd 832 1 832 0 Ss select 0xfffffe008a8880c0 rpcbind 819 1 819 0 Ss select 0xfffffe008a48af40 syslogd 690 1 690 0 Ss select 0xfffffe0055a28b40 devd 673 1 673 0 Ss select 0xfffffe008a4759c0 moused 17 0 0 0 DL sdflush 0xffffffff8158bb7c [softdepflush] 16 0 0 0 DL vlruwt 0xfffffe00551464b8 [vnlru] 9 0 0 0 DL syncer 0xffffffff81584eb0 [syncer] 8 0 0 0 DL psleep 0xffffffff81584884 [bufdaemon] 7 0 0 0 DL pgzero 0xffffffff8158d67c [pagezero] 6 0 0 0 DL psleep 0xffffffff8158c8d0 [vmdaemon] 5 0 0 0 DL psleep 0xffffffff815f8f84 [pagedaemon] 4 0 0 0 DL idle 0xfffffe005029a970 [enc_daemon0] 3 0 0 0 DL ccb_scan 0xffffffff813618b0 [xpt_thrd] 2 0 0 0 DL waiting_ 0xffffffff815ed008 [sctp_iterator] 15 0 0 0 DL (threaded) [usb] 100119 D - 0xffffff8001163e18 [usbus2] 100118 D - 0xffffff8001163dc0 [usbus2] 100117 D - 0xffffff8001163d68 [usbus2] 100116 D - 0xffffff8001163d10 [usbus2] 100114 D - 0xffffff800115c1b0 [usbus1] 100113 D - 0xffffff800115c158 [usbus1] 100112 D - 0xffffff800115c100 [usbus1] 100111 D - 0xffffff800115c0a8 [usbus1] 100074 D - 0xffffff8000ea9e18 [usbus0] 100073 D - 0xffffff8000ea9dc0 [usbus0] 100072 D - 0xffffff8000ea9d68 [usbus0] 100071 D - 0xffffff8000ea9d10 [usbus0] 14 0 0 0 DL - 0xffffffff8137aaa8 [yarrow] 13 0 0 0 DL (threaded) [geom] 100055 D - 0xffffffff815e18c0 [g_down] 100054 D - 0xffffffff815e18b8 [g_up] 100053 D - 0xffffffff815e18b0 [g_event] 12 0 0 0 WL (threaded) [intr] 100122 I [swi0: uart] 100121 I [irq287: hdac1] 100120 I [irq286: ahci0] 100115 I [irq20: ehci1] 100110 I [irq285: xhci0] 100109 I [irq284: igb1:link] 100107 I [irq283: igb1:que 7] 100105 I [irq282: igb1:que 6] 100103 I [irq281: igb1:que 5] 100101 I [irq280: igb1:que 4] 100099 I [irq279: igb1:que 3] 100097 I [irq278: igb1:que 2] 100095 I [irq277: igb1:que 1] 100093 I [irq276: igb1:que 0] 100092 I [irq275: igb0:link] 100090 I [irq274: igb0:que 7] 100088 I [irq273: igb0:que 6] 100086 I [irq272: igb0:que 5] 100084 I [irq271: igb0:que 4] 100082 I [irq270: igb0:que 3] 100080 I [irq269: igb0:que 2] 100078 I [irq268: igb0:que 1] 100076 I [irq267: igb0:que 0] 100075 I [irq266: hdac0] 100070 I [irq22: ehci0] 100069 I [irq265: isci0] 100068 I [irq264: isci0] 100066 I [swi6: Giant taskq] 100065 I [swi6: task queue] 100060 I [swi2: cambio] 100059 I [swi5: fast taskq] 100052 I [swi4: clock] 100051 I [swi4: clock] 100050 I [swi4: clock] 100049 I [swi4: clock] 100048 I [swi4: clock] 100047 I [swi4: clock] 100046 I [swi4: clock] 100045 I [swi4: clock] 100044 I [swi4: clock] 100043 I [swi4: clock] 100042 I [swi4: clock] 100041 I [swi4: clock] 100040 I [swi4: clock] 100039 I [swi4: clock] 100038 I [swi4: clock] 100037 I [swi4: clock] 100036 I [swi4: clock] 100035 I [swi4: clock] 100034 I [swi4: clock] 100033 I [swi4: clock] 100032 I [swi4: clock] 100031 I [swi4: clock] 100030 I [swi4: clock] 100029 I [swi4: clock] 100028 I [swi1: netisr 0] 100027 I [swi3: vm] 11 0 0 0 RL (threaded) [idle] 100026 Run CPU 23 [idle: cpu23] 100025 Run CPU 22 [idle: cpu22] 100024 Run CPU 21 [idle: cpu21] 100023 Run CPU 20 [idle: cpu20] 100022 Run CPU 19 [idle: cpu19] 100021 Run CPU 18 [idle: cpu18] 100020 Run CPU 17 [idle: cpu17] 100019 Run CPU 16 [idle: cpu16] 100018 Run CPU 15 [idle: cpu15] 100017 Run CPU 14 [idle: cpu14] 100016 Run CPU 13 [idle: cpu13] 100015 Run CPU 12 [idle: cpu12] 100014 Run CPU 11 [idle: cpu11] 100013 CanRun [idle: cpu10] 100012 Run CPU 9 [idle: cpu9] 100011 Run CPU 8 [idle: cpu8] 100010 Run CPU 7 [idle: cpu7] 100009 Run CPU 6 [idle: cpu6] 100008 Run CPU 5 [idle: cpu5] 100007 Run CPU 4 [idle: cpu4] 100006 Run CPU 3 [idle: cpu3] 100005 Run CPU 2 [idle: cpu2] 100004 Run CPU 1 [idle: cpu1] 100003 Run CPU 0 [idle: cpu0] 1 0 1 0 SLs wait 0xfffffe005029a000 [init] 10 0 0 0 DL audit_wo 0xffffffff815f0778 [audit] 0 0 0 0 DLs (threaded) [kernel] 100124 D - 0xffffffff8139664a [deadlkres] 100123 D - 0xfffffe00502f7c00 [mca taskq] 100108 D - 0xfffffe00502f8500 [igb1 que] 100106 D - 0xfffffe00502f8600 [igb1 que] 100104 D - 0xfffffe00502f8700 [igb1 que] 100102 D - 0xfffffe00502f8800 [igb1 que] 100100 D - 0xfffffe00502f8900 [igb1 que] 100098 D - 0xfffffe00502f8a00 [igb1 que] 100096 D - 0xfffffe00502f8b00 [igb1 que] 100094 D - 0xfffffe00502f8c00 [igb1 que] 100091 D - 0xfffffe00502f8d00 [igb0 que] 100089 D - 0xfffffe00502f8e00 [igb0 que] 100087 D - 0xfffffe00502f9000 [igb0 que] 100085 D - 0xfffffe00502f9100 [igb0 que] 100083 D - 0xfffffe00502f9200 [igb0 que] 100081 D - 0xfffffe00502f9300 [igb0 que] 100079 D - 0xfffffe00502f9400 [igb0 que] 100077 D - 0xfffffe00502f9500 [igb0 que] 100067 D - 0xfffffe00502f9700 [ffs_trim taskq] 100064 D - 0xfffffe00502f9a00 [kqueue taskq] 100063 D - 0xfffffe00502f9b00 [acpi_task_2] 100062 D - 0xfffffe00502f9b00 [acpi_task_1] 100061 D - 0xfffffe00502f9b00 [acpi_task_0] 100058 D - 0xfffffe00502f9e00 [thread taskq] 100056 D - 0xfffffe00502fa000 [firmware taskq] 100000 D sched 0xffffffff815e19b8 [swapper] 1053 1042 1042 0 Z+ mlockall2 db:0:ps> allt Tracing command sendfile pid 37640 tid 101382 td 0xfffffe03468f8000 kdb_enter() at kdb_enter+0x3e/frame 0xffffff8822279640 vpanic() at vpanic+0x146/frame 0xffffff8822279680 kassert_panic() at kassert_panic+0x136/frame 0xffffff88222796f0 vm_page_grab() at vm_page_grab+0xe7/frame 0xffffff8822279740 kern_sendfile() at kern_sendfile+0x922/frame 0xffffff8822279940 do_sendfile() at do_sendfile+0x92/frame 0xffffff88222799a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff8822279ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff8822279ab0 --- syscall (393, FreeBSD ELF64, sys_sendfile), rip = 0x800aa783a, rsp = 0x7fffffffd5a8, rbp = 0x7fffffffd690 --- Tracing command sendfile pid 37639 tid 101727 td 0xfffffe06a7d83000 sched_switch() at sched_switch+0x482/frame 0xffffff8822936640 mi_switch() at mi_switch+0x179/frame 0xffffff8822936680 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff88229366c0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff8822936730 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff8822936760 _sleep() at _sleep+0x320/frame 0xffffff88229367f0 sbwait() at sbwait+0x7d/frame 0xffffff8822936810 soreceive_generic() at soreceive_generic+0x274/frame 0xffffff88229368d0 dofileread() at dofileread+0x7b/frame 0xffffff8822936910 kern_readv() at kern_readv+0x48/frame 0xffffff8822936950 sys_read() at sys_read+0x63/frame 0xffffff88229369a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff8822936ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff8822936ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b672da, rsp = 0x7fffffffd608, rbp = 0x7fffffffd630 --- Tracing command sh pid 37625 tid 101592 td 0xfffffe06a7311490 sched_switch() at sched_switch+0x482/frame 0xffffff8822693560 mi_switch() at mi_switch+0x179/frame 0xffffff88226935a0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff88226935e0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff8822693650 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff8822693680 _sleep() at _sleep+0x320/frame 0xffffff8822693710 kern_wait6() at kern_wait6+0x3e7/frame 0xffffff88226937b0 sys_wait4() at sys_wait4+0x76/frame 0xffffff88226939a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff8822693ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff8822693ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800d331fa, rsp = 0x7fffffffd488, rbp = 0x7fffffffd530 --- Tracing command sh pid 36858 tid 101704 td 0xfffffe068f5b4920 sched_switch() at sched_switch+0x482/frame 0xffffff88228c3560 mi_switch() at mi_switch+0x179/frame 0xffffff88228c35a0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff88228c35e0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff88228c3650 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff88228c3680 _sleep() at _sleep+0x320/frame 0xffffff88228c3710 kern_wait6() at kern_wait6+0x3e7/frame 0xffffff88228c37b0 sys_wait4() at sys_wait4+0x76/frame 0xffffff88228c39a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff88228c3ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff88228c3ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800d331fa, rsp = 0x7fffffffbfd8, rbp = 0x7fffffffc080 --- Tracing command sh pid 36266 tid 100276 td 0xfffffe01413a6490 sched_switch() at sched_switch+0x482/frame 0xffffff88220da560 mi_switch() at mi_switch+0x179/frame 0xffffff88220da5a0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff88220da5e0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff88220da650 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff88220da680 _sleep() at _sleep+0x320/frame 0xffffff88220da710 kern_wait6() at kern_wait6+0x3e7/frame 0xffffff88220da7b0 sys_wait4() at sys_wait4+0x76/frame 0xffffff88220da9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff88220daab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff88220daab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800d331fa, rsp = 0x7fffffffd5e8, rbp = 0x7fffffffd690 --- Tracing command top pid 23605 tid 101463 td 0xfffffe04a18fe490 sched_switch() at sched_switch+0x482/frame 0xffffff882240e580 mi_switch() at mi_switch+0x179/frame 0xffffff882240e5c0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff882240e600 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff882240e670 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xffffff882240e6a0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fe/frame 0xffffff882240e720 seltdwait() at seltdwait+0x8b/frame 0xffffff882240e760 kern_select() at kern_select+0x892/frame 0xffffff882240e960 sys_select() at sys_select+0x54/frame 0xffffff882240e9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff882240eab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff882240eab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800fc825a, rsp = 0x7fffffffd7c8, rbp = 0x7fffffffd9b0 --- Tracing command bash pid 30051 tid 101385 td 0xfffffe0157708920 sched_switch() at sched_switch+0x482/frame 0xffffff8822288560 mi_switch() at mi_switch+0x179/frame 0xffffff88222885a0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff88222885e0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff8822288650 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff8822288680 _sleep() at _sleep+0x320/frame 0xffffff8822288710 kern_wait6() at kern_wait6+0x3e7/frame 0xffffff88222887b0 sys_wait4() at sys_wait4+0x76/frame 0xffffff88222889a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff8822288ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff8822288ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80109c1fa, rsp = 0x7fffffffd2a8, rbp = 0x7fffffffd2f0 --- Tracing command csh pid 25164 tid 101686 td 0xfffffe01418fc000 sched_switch() at sched_switch+0x482/frame 0xffffff8822869760 mi_switch() at mi_switch+0x179/frame 0xffffff88228697a0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff88228697e0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff8822869850 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff8822869880 _sleep() at _sleep+0x320/frame 0xffffff8822869910 kern_sigsuspend() at kern_sigsuspend+0xcd/frame 0xffffff8822869970 sys_sigsuspend() at sys_sigsuspend+0x31/frame 0xffffff88228699a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff8822869ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff8822869ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800d44c1a, rsp = 0x7fffffffce08, rbp = 0x7fffffffce80 --- Tracing command su pid 14170 tid 100263 td 0xfffffe008a509920 sched_switch() at sched_switch+0x482/frame 0xffffff8822099560 mi_switch() at mi_switch+0x179/frame 0xffffff88220995a0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff88220995e0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff8822099650 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff8822099680 _sleep() at _sleep+0x320/frame 0xffffff8822099710 kern_wait6() at kern_wait6+0x3e7/frame 0xffffff88220997b0 sys_wait4() at sys_wait4+0x76/frame 0xffffff88220999a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff8822099ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff8822099ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800ed51fa, rsp = 0x7fffffffd4a8, rbp = 0x7fffffffda10 --- Tracing command bash pid 1098 tid 100212 td 0xfffffe008ac3e490 sched_switch() at sched_switch+0x482/frame 0xffffff8821f9a560 mi_switch() at mi_switch+0x179/frame 0xffffff8821f9a5a0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8821f9a5e0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff8821f9a650 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff8821f9a680 _sleep() at _sleep+0x320/frame 0xffffff8821f9a710 kern_wait6() at kern_wait6+0x3e7/frame 0xffffff8821f9a7b0 sys_wait4() at sys_wait4+0x76/frame 0xffffff8821f9a9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff8821f9aab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff8821f9aab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80109c1fa, rsp = 0x7fffffffd4d8, rbp = 0x7fffffffd520 --- Tracing command sshd pid 1097 tid 100170 td 0xfffffe0055712920 sched_switch() at sched_switch+0x482/frame 0xffffff8821ebb590 mi_switch() at mi_switch+0x179/frame 0xffffff8821ebb5d0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8821ebb610 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff8821ebb680 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff8821ebb6b0 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff8821ebb720 seltdwait() at seltdwait+0x78/frame 0xffffff8821ebb760 kern_select() at kern_select+0x892/frame 0xffffff8821ebb960 sys_select() at sys_select+0x54/frame 0xffffff8821ebb9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff8821ebbab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff8821ebbab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80257525a, rsp = 0x7fffffffd168, rbp = 0x7fffffffd1d0 --- Tracing command sshd pid 1095 tid 100138 td 0xfffffe00558ed490 sched_switch() at sched_switch+0x482/frame 0xffffff8821e1b630 mi_switch() at mi_switch+0x179/frame 0xffffff8821e1b670 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8821e1b6b0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff8821e1b720 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff8821e1b750 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff8821e1b7c0 seltdwait() at seltdwait+0x78/frame 0xffffff8821e1b800 sys_poll() at sys_poll+0x38c/frame 0xffffff8821e1b9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff8821e1bab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff8821e1bab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x80250d6ea, rsp = 0x7fffffffd1f8, rbp = 0x7fffffffd250 --- Tracing command sh pid 1042 tid 100184 td 0xfffffe008a4e9920 sched_switch() at sched_switch+0x482/frame 0xffffff8821f01940 mi_switch() at mi_switch+0x179/frame 0xffffff8821f01980 thread_suspend_switch() at thread_suspend_switch+0x174/frame 0xffffff8821f019d0 cursig() at cursig+0x628/frame 0xffffff8821f01a70 ast() at ast+0x33f/frame 0xffffff8821f01ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffd4e0 Tracing command bash pid 1039 tid 100162 td 0xfffffe0055c41920 sched_switch() at sched_switch+0x482/frame 0xffffff8821e93560 mi_switch() at mi_switch+0x179/frame 0xffffff8821e935a0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8821e935e0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff8821e93650 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff8821e93680 _sleep() at _sleep+0x320/frame 0xffffff8821e93710 kern_wait6() at kern_wait6+0x3e7/frame 0xffffff8821e937b0 sys_wait4() at sys_wait4+0x76/frame 0xffffff8821e939a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff8821e93ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff8821e93ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80109c1fa, rsp = 0x7fffffffd278, rbp = 0x7fffffffd2c0 --- Tracing command csh pid 1037 tid 100181 td 0xfffffe005578d000 sched_switch() at sched_switch+0x482/frame 0xffffff8821ef2760 mi_switch() at mi_switch+0x179/frame 0xffffff8821ef27a0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8821ef27e0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff8821ef2850 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff8821ef2880 _sleep() at _sleep+0x320/frame 0xffffff8821ef2910 kern_sigsuspend() at kern_sigsuspend+0xcd/frame 0xffffff8821ef2970 sys_sigsuspend() at sys_sigsuspend+0x31/frame 0xffffff8821ef29a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff8821ef2ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff8821ef2ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800d44c1a, rsp = 0x7fffffffcde8, rbp = 0x7fffffffce60 --- Tracing command su pid 1036 tid 100136 td 0xfffffe0055798000 sched_switch() at sched_switch+0x482/frame 0xffffff8821e11560 mi_switch() at mi_switch+0x179/frame 0xffffff8821e115a0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8821e115e0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff8821e11650 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff8821e11680 _sleep() at _sleep+0x320/frame 0xffffff8821e11710 kern_wait6() at kern_wait6+0x3e7/frame 0xffffff8821e117b0 sys_wait4() at sys_wait4+0x76/frame 0xffffff8821e119a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff8821e11ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff8821e11ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800ed51fa, rsp = 0x7fffffffd488, rbp = 0x7fffffffd9f0 --- Tracing command bash pid 1032 tid 100204 td 0xfffffe008aaac000 sched_switch() at sched_switch+0x482/frame 0xffffff8821f72560 mi_switch() at mi_switch+0x179/frame 0xffffff8821f725a0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8821f725e0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff8821f72650 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff8821f72680 _sleep() at _sleep+0x320/frame 0xffffff8821f72710 kern_wait6() at kern_wait6+0x3e7/frame 0xffffff8821f727b0 sys_wait4() at sys_wait4+0x76/frame 0xffffff8821f729a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff8821f72ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff8821f72ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80109c1fa, rsp = 0x7fffffffd4d8, rbp = 0x7fffffffd520 --- Tracing command sshd pid 1031 tid 100221 td 0xfffffe008a951000 sched_switch() at sched_switch+0x482/frame 0xffffff8821fc7590 mi_switch() at mi_switch+0x179/frame 0xffffff8821fc75d0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8821fc7610 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff8821fc7680 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff8821fc76b0 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff8821fc7720 seltdwait() at seltdwait+0x78/frame 0xffffff8821fc7760 kern_select() at kern_select+0x892/frame 0xffffff8821fc7960 sys_select() at sys_select+0x54/frame 0xffffff8821fc79a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff8821fc7ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff8821fc7ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80257525a, rsp = 0x7fffffffd168, rbp = 0x7fffffffd1d0 --- Tracing command sshd pid 1029 tid 100220 td 0xfffffe008a951490 sched_switch() at sched_switch+0x482/frame 0xffffff8821fc2630 mi_switch() at mi_switch+0x179/frame 0xffffff8821fc2670 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8821fc26b0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff8821fc2720 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff8821fc2750 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff8821fc27c0 seltdwait() at seltdwait+0x78/frame 0xffffff8821fc2800 sys_poll() at sys_poll+0x38c/frame 0xffffff8821fc29a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff8821fc2ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff8821fc2ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x80250d6ea, rsp = 0x7fffffffd1f8, rbp = 0x7fffffffd250 --- Tracing command getty pid 1028 tid 100219 td 0xfffffe008ac79490 sched_switch() at sched_switch+0x482/frame 0xffffff8821fbd620 mi_switch() at mi_switch+0x179/frame 0xffffff8821fbd660 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8821fbd6a0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff8821fbd710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff8821fbd740 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff8821fbd7b0 tty_wait() at tty_wait+0x42/frame 0xffffff8821fbd7e0 ttydisc_read() at ttydisc_read+0x353/frame 0xffffff8821fbd840 ttydev_read() at ttydev_read+0x6d/frame 0xffffff8821fbd870 devfs_read_f() at devfs_read_f+0x7f/frame 0xffffff8821fbd8d0 dofileread() at dofileread+0x7b/frame 0xffffff8821fbd910 kern_readv() at kern_readv+0x48/frame 0xffffff8821fbd950 sys_read() at sys_read+0x63/frame 0xffffff8821fbd9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff8821fbdab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff8821fbdab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b582da, rsp = 0x7fffffffdc98, rbp = 0x7fffffffdcd0 --- Tracing command getty pid 1027 tid 100218 td 0xfffffe008ac79920 sched_switch() at sched_switch+0x482/frame 0xffffff8821fb8620 mi_switch() at mi_switch+0x179/frame 0xffffff8821fb8660 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8821fb86a0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff8821fb8710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff8821fb8740 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff8821fb87b0 tty_wait() at tty_wait+0x42/frame 0xffffff8821fb87e0 ttydisc_read() at ttydisc_read+0x353/frame 0xffffff8821fb8840 ttydev_read() at ttydev_read+0x6d/frame 0xffffff8821fb8870 devfs_read_f() at devfs_read_f+0x7f/frame 0xffffff8821fb88d0 dofileread() at dofileread+0x7b/frame 0xffffff8821fb8910 kern_readv() at kern_readv+0x48/frame 0xffffff8821fb8950 sys_read() at sys_read+0x63/frame 0xffffff8821fb89a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff8821fb8ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff8821fb8ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b582da, rsp = 0x7fffffffdc98, rbp = 0x7fffffffdcd0 --- Tracing command getty pid 1026 tid 100217 td 0xfffffe008ac3e920 sched_switch() at sched_switch+0x482/frame 0xffffff8821fb3620 mi_switch() at mi_switch+0x179/frame 0xffffff8821fb3660 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8821fb36a0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff8821fb3710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff8821fb3740 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff8821fb37b0 tty_wait() at tty_wait+0x42/frame 0xffffff8821fb37e0 ttydisc_read() at ttydisc_read+0x353/frame 0xffffff8821fb3840 ttydev_read() at ttydev_read+0x6d/frame 0xffffff8821fb3870 devfs_read_f() at devfs_read_f+0x7f/frame 0xffffff8821fb38d0 dofileread() at dofileread+0x7b/frame 0xffffff8821fb3910 kern_readv() at kern_readv+0x48/frame 0xffffff8821fb3950 sys_read() at sys_read+0x63/frame 0xffffff8821fb39a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff8821fb3ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff8821fb3ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b582da, rsp = 0x7fffffffdc98, rbp = 0x7fffffffdcd0 --- Tracing command getty pid 1025 tid 100216 td 0xfffffe0055776000 sched_switch() at sched_switch+0x482/frame 0xffffff8821fae620 mi_switch() at mi_switch+0x179/frame 0xffffff8821fae660 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8821fae6a0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff8821fae710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff8821fae740 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff8821fae7b0 tty_wait() at tty_wait+0x42/frame 0xffffff8821fae7e0 ttydisc_read() at ttydisc_read+0x353/frame 0xffffff8821fae840 ttydev_read() at ttydev_read+0x6d/frame 0xffffff8821fae870 devfs_read_f() at devfs_read_f+0x7f/frame 0xffffff8821fae8d0 dofileread() at dofileread+0x7b/frame 0xffffff8821fae910 kern_readv() at kern_readv+0x48/frame 0xffffff8821fae950 sys_read() at sys_read+0x63/frame 0xffffff8821fae9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff8821faeab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff8821faeab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b582da, rsp = 0x7fffffffdc98, rbp = 0x7fffffffdcd0 --- Tracing command getty pid 1024 tid 100215 td 0xfffffe0055776490 sched_switch() at sched_switch+0x482/frame 0xffffff8821fa9620 mi_switch() at mi_switch+0x179/frame 0xffffff8821fa9660 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8821fa96a0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff8821fa9710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff8821fa9740 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff8821fa97b0 tty_wait() at tty_wait+0x42/frame 0xffffff8821fa97e0 ttydisc_read() at ttydisc_read+0x353/frame 0xffffff8821fa9840 ttydev_read() at ttydev_read+0x6d/frame 0xffffff8821fa9870 devfs_read_f() at devfs_read_f+0x7f/frame 0xffffff8821fa98d0 dofileread() at dofileread+0x7b/frame 0xffffff8821fa9910 kern_readv() at kern_readv+0x48/frame 0xffffff8821fa9950 sys_read() at sys_read+0x63/frame 0xffffff8821fa99a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff8821fa9ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff8821fa9ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b582da, rsp = 0x7fffffffdc98, rbp = 0x7fffffffdcd0 --- Tracing command getty pid 1023 tid 100214 td 0xfffffe0055776920 sched_switch() at sched_switch+0x482/frame 0xffffff8821fa4620 mi_switch() at mi_switch+0x179/frame 0xffffff8821fa4660 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8821fa46a0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff8821fa4710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff8821fa4740 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff8821fa47b0 tty_wait() at tty_wait+0x42/frame 0xffffff8821fa47e0 ttydisc_read() at ttydisc_read+0x353/frame 0xffffff8821fa4840 ttydev_read() at ttydev_read+0x6d/frame 0xffffff8821fa4870 devfs_read_f() at devfs_read_f+0x7f/frame 0xffffff8821fa48d0 dofileread() at dofileread+0x7b/frame 0xffffff8821fa4910 kern_readv() at kern_readv+0x48/frame 0xffffff8821fa4950 sys_read() at sys_read+0x63/frame 0xffffff8821fa49a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff8821fa4ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff8821fa4ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b582da, rsp = 0x7fffffffdc98, rbp = 0x7fffffffdcd0 --- Tracing command getty pid 1022 tid 100213 td 0xfffffe0055761000 sched_switch() at sched_switch+0x482/frame 0xffffff8821f9f620 mi_switch() at mi_switch+0x179/frame 0xffffff8821f9f660 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8821f9f6a0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff8821f9f710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff8821f9f740 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff8821f9f7b0 tty_wait() at tty_wait+0x42/frame 0xffffff8821f9f7e0 ttydisc_read() at ttydisc_read+0x353/frame 0xffffff8821f9f840 ttydev_read() at ttydev_read+0x6d/frame 0xffffff8821f9f870 devfs_read_f() at devfs_read_f+0x7f/frame 0xffffff8821f9f8d0 dofileread() at dofileread+0x7b/frame 0xffffff8821f9f910 kern_readv() at kern_readv+0x48/frame 0xffffff8821f9f950 sys_read() at sys_read+0x63/frame 0xffffff8821f9f9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff8821f9fab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff8821f9fab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b582da, rsp = 0x7fffffffdc98, rbp = 0x7fffffffdcd0 --- Tracing command getty pid 1021 tid 100179 td 0xfffffe008a509000 sched_switch() at sched_switch+0x482/frame 0xffffff8821ee8620 mi_switch() at mi_switch+0x179/frame 0xffffff8821ee8660 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8821ee86a0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff8821ee8710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff8821ee8740 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff8821ee87b0 tty_wait() at tty_wait+0x42/frame 0xffffff8821ee87e0 ttydisc_read() at ttydisc_read+0x353/frame 0xffffff8821ee8840 ttydev_read() at ttydev_read+0x6d/frame 0xffffff8821ee8870 devfs_read_f() at devfs_read_f+0x7f/frame 0xffffff8821ee88d0 dofileread() at dofileread+0x7b/frame 0xffffff8821ee8910 kern_readv() at kern_readv+0x48/frame 0xffffff8821ee8950 sys_read() at sys_read+0x63/frame 0xffffff8821ee89a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff8821ee8ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff8821ee8ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b582da, rsp = 0x7fffffffdc98, rbp = 0x7fffffffdcd0 --- Tracing command getty pid 1020 tid 100135 td 0xfffffe005571a490 sched_switch() at sched_switch+0x482/frame 0xffffff8821e0c620 mi_switch() at mi_switch+0x179/frame 0xffffff8821e0c660 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8821e0c6a0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff8821e0c710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff8821e0c740 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff8821e0c7b0 tty_wait() at tty_wait+0x42/frame 0xffffff8821e0c7e0 ttydisc_read() at ttydisc_read+0x353/frame 0xffffff8821e0c840 ttydev_read() at ttydev_read+0x6d/frame 0xffffff8821e0c870 devfs_read_f() at devfs_read_f+0x7f/frame 0xffffff8821e0c8d0 dofileread() at dofileread+0x7b/frame 0xffffff8821e0c910 kern_readv() at kern_readv+0x48/frame 0xffffff8821e0c950 sys_read() at sys_read+0x63/frame 0xffffff8821e0c9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff8821e0cab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff8821e0cab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b582da, rsp = 0x7fffffffdc98, rbp = 0x7fffffffdcd0 --- Tracing command cron pid 959 tid 100172 td 0xfffffe0055eb2000 sched_switch() at sched_switch+0x482/frame 0xffffff8821ec5750 mi_switch() at mi_switch+0x179/frame 0xffffff8821ec5790 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8821ec57d0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff8821ec5840 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xffffff8821ec5870 _sleep() at _sleep+0x300/frame 0xffffff8821ec5900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xffffff8821ec5960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xffffff8821ec59a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff8821ec5ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff8821ec5ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800d473ba, rsp = 0x7fffffffdb28, rbp = 0x7fffffffdd00 --- Tracing command sendmail pid 955 tid 100206 td 0xfffffe0055e44920 sched_switch() at sched_switch+0x482/frame 0xffffff8821f7c760 mi_switch() at mi_switch+0x179/frame 0xffffff8821f7c7a0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8821f7c7e0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff8821f7c850 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff8821f7c880 _sleep() at _sleep+0x320/frame 0xffffff8821f7c910 kern_sigsuspend() at kern_sigsuspend+0xcd/frame 0xffffff8821f7c970 sys_sigsuspend() at sys_sigsuspend+0x31/frame 0xffffff8821f7c9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff8821f7cab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff8821f7cab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x801392c1a, rsp = 0x7fffffffc818, rbp = 0x7fffffffc830 --- Tracing command sendmail pid 952 tid 100155 td 0xfffffe0055c99490 sched_switch() at sched_switch+0x482/frame 0xffffff8821e70580 mi_switch() at mi_switch+0x179/frame 0xffffff8821e705c0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8821e70600 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff8821e70670 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xffffff8821e706a0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fe/frame 0xffffff8821e70720 seltdwait() at seltdwait+0x8b/frame 0xffffff8821e70760 kern_select() at kern_select+0x892/frame 0xffffff8821e70960 sys_select() at sys_select+0x54/frame 0xffffff8821e709a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff8821e70ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff8821e70ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80145225a, rsp = 0x7fffffffbd18, rbp = 0x7fffffffc810 --- Tracing command sshd pid 949 tid 100205 td 0xfffffe00558e5490 sched_switch() at sched_switch+0x482/frame 0xffffff8821f77590 mi_switch() at mi_switch+0x179/frame 0xffffff8821f775d0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8821f77610 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff8821f77680 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff8821f776b0 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff8821f77720 seltdwait() at seltdwait+0x78/frame 0xffffff8821f77760 kern_select() at kern_select+0x892/frame 0xffffff8821f77960 sys_select() at sys_select+0x54/frame 0xffffff8821f779a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff8821f77ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff8821f77ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80257525a, rsp = 0x7fffffffd288, rbp = 0x7fffffffdd10 --- Tracing command powerd pid 921 tid 100203 td 0xfffffe0055798490 sched_switch() at sched_switch+0x482/frame 0xffffff8821f6d580 mi_switch() at mi_switch+0x179/frame 0xffffff8821f6d5c0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8821f6d600 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff8821f6d670 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xffffff8821f6d6a0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fe/frame 0xffffff8821f6d720 seltdwait() at seltdwait+0x8b/frame 0xffffff8821f6d760 kern_select() at kern_select+0x892/frame 0xffffff8821f6d960 sys_select() at sys_select+0x54/frame 0xffffff8821f6d9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff8821f6dab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff8821f6dab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800b5625a, rsp = 0x7fffffffdb88, rbp = 0x7fffffffdd00 --- Tracing command ntpd pid 918 tid 100195 td 0xfffffe00558e5920 sched_switch() at sched_switch+0x482/frame 0xffffff8821f45590 mi_switch() at mi_switch+0x179/frame 0xffffff8821f455d0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8821f45610 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff8821f45680 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff8821f456b0 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff8821f45720 seltdwait() at seltdwait+0x78/frame 0xffffff8821f45760 kern_select() at kern_select+0x892/frame 0xffffff8821f45960 sys_select() at sys_select+0x54/frame 0xffffff8821f459a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff8821f45ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff8821f45ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8013c125a, rsp = 0x7fffffffdbc8, rbp = 0x7fffffffdc90 --- Tracing command nfsd pid 879 tid 100198 td 0xfffffe008a951920 sched_switch() at sched_switch+0x482/frame 0xffffff8821f54730 mi_switch() at mi_switch+0x179/frame 0xffffff8821f54770 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8821f547b0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff8821f54820 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xffffff8821f54850 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fe/frame 0xffffff8821f548d0 svc_run_internal() at svc_run_internal+0x9c7/frame 0xffffff8821f54a60 svc_thread_start() at svc_thread_start+0xb/frame 0xffffff8821f54a70 fork_exit() at fork_exit+0x84/frame 0xffffff8821f54ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8821f54ab0 --- trap 0xc, rip = 0x80088687a, rsp = 0x7fffffffd5d8, rbp = 0x7fffffffd880 --- Tracing command nfsd pid 879 tid 100197 td 0xfffffe0055bff920 sched_switch() at sched_switch+0x482/frame 0xffffff8821f4f730 mi_switch() at mi_switch+0x179/frame 0xffffff8821f4f770 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8821f4f7b0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff8821f4f820 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xffffff8821f4f850 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fe/frame 0xffffff8821f4f8d0 svc_run_internal() at svc_run_internal+0x9c7/frame 0xffffff8821f4fa60 svc_thread_start() at svc_thread_start+0xb/frame 0xffffff8821f4fa70 fork_exit() at fork_exit+0x84/frame 0xffffff8821f4fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8821f4fab0 --- trap 0xc, rip = 0x80088687a, rsp = 0x7fffffffd5d8, rbp = 0x7fffffffd880 --- Tracing command nfsd pid 879 tid 100196 td 0xfffffe0055c99000 sched_switch() at sched_switch+0x482/frame 0xffffff8821f4a730 mi_switch() at mi_switch+0x179/frame 0xffffff8821f4a770 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8821f4a7b0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff8821f4a820 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xffffff8821f4a850 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fe/frame 0xffffff8821f4a8d0 svc_run_internal() at svc_run_internal+0x9c7/frame 0xffffff8821f4aa60 svc_thread_start() at svc_thread_start+0xb/frame 0xffffff8821f4aa70 fork_exit() at fork_exit+0x84/frame 0xffffff8821f4aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8821f4aab0 --- trap 0xc, rip = 0x80088687a, rsp = 0x7fffffffd5d8, rbp = 0x7fffffffd880 --- Tracing command nfsd pid 879 tid 100169 td 0xfffffe0055798920 sched_switch() at sched_switch+0x482/frame 0xffffff8821eb5ea0 mi_switch() at mi_switch+0x179/frame 0xffffff8821eb5ee0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8821eb5f20 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff8821eb5f90 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xffffff8821eb5fc0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fe/frame 0xffffff8821eb6040 svc_run_internal() at svc_run_internal+0x9c7/frame 0xffffff8821eb61d0 svc_run() at svc_run+0xd4/frame 0xffffff8821eb6210 nfsrvd_nfsd() at nfsrvd_nfsd+0x194/frame 0xffffff8821eb6370 nfssvc_nfsd() at nfssvc_nfsd+0x103/frame 0xffffff8821eb6970 sys_nfssvc() at sys_nfssvc+0xd2/frame 0xffffff8821eb69a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff8821eb6ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff8821eb6ab0 --- syscall (155, FreeBSD ELF64, sys_nfssvc), rip = 0x80088687a, rsp = 0x7fffffffd5d8, rbp = 0x7fffffffd880 --- Tracing command nfsd pid 878 tid 100167 td 0xfffffe0055d8f000 sched_switch() at sched_switch+0x482/frame 0xffffff8821eac590 mi_switch() at mi_switch+0x179/frame 0xffffff8821eac5d0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8821eac610 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff8821eac680 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff8821eac6b0 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff8821eac720 seltdwait() at seltdwait+0x78/frame 0xffffff8821eac760 kern_select() at kern_select+0x892/frame 0xffffff8821eac960 sys_select() at sys_select+0x54/frame 0xffffff8821eac9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff8821eacab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff8821eacab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80094525a, rsp = 0x7fffffffd888, rbp = 0x7fffffffdce0 --- Tracing command mountd pid 872 tid 100186 td 0xfffffe005571a920 sched_switch() at sched_switch+0x482/frame 0xffffff8821f0b590 mi_switch() at mi_switch+0x179/frame 0xffffff8821f0b5d0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8821f0b610 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff8821f0b680 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff8821f0b6b0 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff8821f0b720 seltdwait() at seltdwait+0x78/frame 0xffffff8821f0b760 kern_select() at kern_select+0x892/frame 0xffffff8821f0b960 sys_select() at sys_select+0x54/frame 0xffffff8821f0b9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff8821f0bab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff8821f0bab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800b5d25a, rsp = 0x7fffffffdb88, rbp = 0x7fffffffdd00 --- Tracing command nfsuserd pid 865 tid 100194 td 0xfffffe00559d4490 sched_switch() at sched_switch+0x482/frame 0xffffff8821f40580 mi_switch() at mi_switch+0x179/frame 0xffffff8821f405c0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8821f40600 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff8821f40670 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xffffff8821f406a0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fe/frame 0xffffff8821f40720 seltdwait() at seltdwait+0x8b/frame 0xffffff8821f40760 kern_select() at kern_select+0x892/frame 0xffffff8821f40960 sys_select() at sys_select+0x54/frame 0xffffff8821f409a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff8821f40ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff8821f40ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80094425a, rsp = 0x7fffffffd9f8, rbp = 0x7fffffffdb30 --- Tracing command nfsuserd pid 864 tid 100193 td 0xfffffe00559d4920 sched_switch() at sched_switch+0x482/frame 0xffffff8821f3b580 mi_switch() at mi_switch+0x179/frame 0xffffff8821f3b5c0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8821f3b600 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff8821f3b670 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xffffff8821f3b6a0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fe/frame 0xffffff8821f3b720 seltdwait() at seltdwait+0x8b/frame 0xffffff8821f3b760 kern_select() at kern_select+0x892/frame 0xffffff8821f3b960 sys_select() at sys_select+0x54/frame 0xffffff8821f3b9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff8821f3bab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff8821f3bab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80094425a, rsp = 0x7fffffffd9f8, rbp = 0x7fffffffdb30 --- Tracing command nfsuserd pid 863 tid 100192 td 0xfffffe0055a3e000 sched_switch() at sched_switch+0x482/frame 0xffffff8821f36580 mi_switch() at mi_switch+0x179/frame 0xffffff8821f365c0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8821f36600 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff8821f36670 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xffffff8821f366a0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fe/frame 0xffffff8821f36720 seltdwait() at seltdwait+0x8b/frame 0xffffff8821f36760 kern_select() at kern_select+0x892/frame 0xffffff8821f36960 sys_select() at sys_select+0x54/frame 0xffffff8821f369a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff8821f36ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff8821f36ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80094425a, rsp = 0x7fffffffd9f8, rbp = 0x7fffffffdb30 --- Tracing command nfsuserd pid 862 tid 100163 td 0xfffffe005583b000 sched_switch() at sched_switch+0x482/frame 0xffffff8821e98580 mi_switch() at mi_switch+0x179/frame 0xffffff8821e985c0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8821e98600 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff8821e98670 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xffffff8821e986a0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fe/frame 0xffffff8821e98720 seltdwait() at seltdwait+0x8b/frame 0xffffff8821e98760 kern_select() at kern_select+0x892/frame 0xffffff8821e98960 sys_select() at sys_select+0x54/frame 0xffffff8821e989a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff8821e98ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff8821e98ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80094425a, rsp = 0x7fffffffd9f8, rbp = 0x7fffffffdb30 --- Tracing command nfsuserd pid 861 tid 100182 td 0xfffffe00558ed000 sched_switch() at sched_switch+0x482/frame 0xffffff8821ef7760 mi_switch() at mi_switch+0x179/frame 0xffffff8821ef77a0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8821ef77e0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff8821ef7850 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff8821ef7880 _sleep() at _sleep+0x320/frame 0xffffff8821ef7910 kern_sigsuspend() at kern_sigsuspend+0xcd/frame 0xffffff8821ef7970 sys_sigsuspend() at sys_sigsuspend+0x31/frame 0xffffff8821ef79a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff8821ef7ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff8821ef7ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800884c1a, rsp = 0x7fffffffdb38, rbp = 0x7fffffffdd00 --- Tracing command rpcbind pid 832 tid 100190 td 0xfffffe0055f6a490 sched_switch() at sched_switch+0x482/frame 0xffffff8821f2c620 mi_switch() at mi_switch+0x179/frame 0xffffff8821f2c660 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8821f2c6a0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff8821f2c710 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xffffff8821f2c740 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fe/frame 0xffffff8821f2c7c0 seltdwait() at seltdwait+0x8b/frame 0xffffff8821f2c800 sys_poll() at sys_poll+0x38c/frame 0xffffff8821f2c9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff8821f2cab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff8821f2cab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x800cfd6ea, rsp = 0x7fffffffba68, rbp = 0x7fffffffdc80 --- Tracing command syslogd pid 819 tid 100142 td 0xfffffe0055a3e490 sched_switch() at sched_switch+0x482/frame 0xffffff8821e2f590 mi_switch() at mi_switch+0x179/frame 0xffffff8821e2f5d0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8821e2f610 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff8821e2f680 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff8821e2f6b0 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff8821e2f720 seltdwait() at seltdwait+0x78/frame 0xffffff8821e2f760 kern_select() at kern_select+0x892/frame 0xffffff8821e2f960 sys_select() at sys_select+0x54/frame 0xffffff8821e2f9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff8821e2fab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff8821e2fab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800b5b25a, rsp = 0x7fffffffcce8, rbp = 0x7fffffffdd00 --- Tracing command devd pid 690 tid 100175 td 0xfffffe0070067000 sched_switch() at sched_switch+0x482/frame 0xffffff8821ed4580 mi_switch() at mi_switch+0x179/frame 0xffffff8821ed45c0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8821ed4600 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff8821ed4670 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xffffff8821ed46a0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fe/frame 0xffffff8821ed4720 seltdwait() at seltdwait+0x8b/frame 0xffffff8821ed4760 kern_select() at kern_select+0x892/frame 0xffffff8821ed4960 sys_select() at sys_select+0x54/frame 0xffffff8821ed49a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff8821ed4ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff8821ed4ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x44cb4a, rsp = 0x7fffffffbbb8, rbp = 0x7fffffffdd20 --- Tracing command moused pid 673 tid 100161 td 0xfffffe005571a000 sched_switch() at sched_switch+0x482/frame 0xffffff8821e8e590 mi_switch() at mi_switch+0x179/frame 0xffffff8821e8e5d0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8821e8e610 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff8821e8e680 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff8821e8e6b0 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff8821e8e720 seltdwait() at seltdwait+0x78/frame 0xffffff8821e8e760 kern_select() at kern_select+0x892/frame 0xffffff8821e8e960 sys_select() at sys_select+0x54/frame 0xffffff8821e8e9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff8821e8eab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff8821e8eab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800d8125a, rsp = 0x7fffffffd6f8, rbp = 0x7fffffffdca0 --- Tracing command softdepflush pid 17 tid 100134 td 0xfffffe00550bf920 sched_switch() at sched_switch+0x482/frame 0xffffff8821c6b8f0 mi_switch() at mi_switch+0x179/frame 0xffffff8821c6b930 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8821c6b970 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xffffff8821c6b9a0 _sleep() at _sleep+0x312/frame 0xffffff8821c6ba30 softdep_flush() at softdep_flush+0x20c/frame 0xffffff8821c6ba70 fork_exit() at fork_exit+0x84/frame 0xffffff8821c6bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8821c6bab0 --- trap 0, rip = 0, rsp = 0xffffff8821c6bb70, rbp = 0 --- Tracing command vnlru pid 16 tid 100133 td 0xfffffe0055142000 sched_switch() at sched_switch+0x482/frame 0xffffff8821c668b0 mi_switch() at mi_switch+0x179/frame 0xffffff8821c668f0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8821c66930 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xffffff8821c66960 _sleep() at _sleep+0x312/frame 0xffffff8821c669f0 vnlru_proc() at vnlru_proc+0x48/frame 0xffffff8821c66a70 fork_exit() at fork_exit+0x84/frame 0xffffff8821c66ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8821c66ab0 --- trap 0, rip = 0, rsp = 0xffffff8821c66b70, rbp = 0 --- Tracing command syncer pid 9 tid 100132 td 0xfffffe0055142490 sched_switch() at sched_switch+0x482/frame 0xffffff8821c618a0 mi_switch() at mi_switch+0x179/frame 0xffffff8821c618e0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8821c61920 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xffffff8821c61950 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x1fe/frame 0xffffff8821c619d0 sched_sync() at sched_sync+0x5cb/frame 0xffffff8821c61a70 fork_exit() at fork_exit+0x84/frame 0xffffff8821c61ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8821c61ab0 --- trap 0, rip = 0, rsp = 0xffffff8821c61b70, rbp = 0 --- Tracing command bufdaemon pid 8 tid 100131 td 0xfffffe0055142920 sched_switch() at sched_switch+0x482/frame 0xffffff8821c5c900 mi_switch() at mi_switch+0x179/frame 0xffffff8821c5c940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8821c5c980 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xffffff8821c5c9b0 _sleep() at _sleep+0x312/frame 0xffffff8821c5ca40 buf_daemon() at buf_daemon+0x68/frame 0xffffff8821c5ca70 fork_exit() at fork_exit+0x84/frame 0xffffff8821c5cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8821c5cab0 --- trap 0, rip = 0, rsp = 0xffffff8821c5cb70, rbp = 0 --- Tracing command pagezero pid 7 tid 100130 td 0xfffffe0054041920 sched_switch() at sched_switch+0x482/frame 0xffffff8821c57900 mi_switch() at mi_switch+0x179/frame 0xffffff8821c57940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8821c57980 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xffffff8821c579b0 _sleep() at _sleep+0x312/frame 0xffffff8821c57a40 vm_pagezero() at vm_pagezero+0x88/frame 0xffffff8821c57a70 fork_exit() at fork_exit+0x84/frame 0xffffff8821c57ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8821c57ab0 --- trap 0, rip = 0, rsp = 0xffffff8821c57b70, rbp = 0 --- Tracing command vmdaemon pid 6 tid 100129 td 0xfffffe00550be000 sched_switch() at sched_switch+0x482/frame 0xffffff8821c528c0 mi_switch() at mi_switch+0x179/frame 0xffffff8821c52900 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8821c52940 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff8821c52970 _sleep() at _sleep+0x33d/frame 0xffffff8821c52a00 vm_daemon() at vm_daemon+0x7e/frame 0xffffff8821c52a70 fork_exit() at fork_exit+0x84/frame 0xffffff8821c52ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8821c52ab0 --- trap 0, rip = 0, rsp = 0xffffff8821c52b70, rbp = 0 --- Tracing command pagedaemon pid 5 tid 100128 td 0xfffffe00550be490 sched_switch() at sched_switch+0x482/frame 0xffffff8821c4d840 mi_switch() at mi_switch+0x179/frame 0xffffff8821c4d880 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8821c4d8c0 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xffffff8821c4d8f0 _sleep() at _sleep+0x312/frame 0xffffff8821c4d980 vm_pageout() at vm_pageout+0x24b/frame 0xffffff8821c4da70 fork_exit() at fork_exit+0x84/frame 0xffffff8821c4dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8821c4dab0 --- trap 0, rip = 0, rsp = 0xffffff8821c4db70, rbp = 0 --- Tracing command enc_daemon0 pid 4 tid 100127 td 0xfffffe00550be920 sched_switch() at sched_switch+0x482/frame 0xffffff8821c488c0 mi_switch() at mi_switch+0x179/frame 0xffffff8821c48900 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8821c48940 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff8821c48970 _sleep() at _sleep+0x33d/frame 0xffffff8821c48a00 enc_daemon() at enc_daemon+0x109/frame 0xffffff8821c48a70 fork_exit() at fork_exit+0x84/frame 0xffffff8821c48ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8821c48ab0 --- trap 0, rip = 0, rsp = 0xffffff8821c48b70, rbp = 0 --- Tracing command xpt_thrd pid 3 tid 100126 td 0xfffffe00550bf000 sched_switch() at sched_switch+0x482/frame 0xffffff8821a83900 mi_switch() at mi_switch+0x179/frame 0xffffff8821a83940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8821a83980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff8821a839b0 _sleep() at _sleep+0x33d/frame 0xffffff8821a83a40 xpt_scanner_thread() at xpt_scanner_thread+0xdc/frame 0xffffff8821a83a70 fork_exit() at fork_exit+0x84/frame 0xffffff8821a83ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8821a83ab0 --- trap 0, rip = 0, rsp = 0xffffff8821a83b70, rbp = 0 --- Tracing command sctp_iterator pid 2 tid 100125 td 0xfffffe005401d000 sched_switch() at sched_switch+0x482/frame 0xffffff8821a7e910 mi_switch() at mi_switch+0x179/frame 0xffffff8821a7e950 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8821a7e990 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff8821a7e9c0 _sleep() at _sleep+0x33d/frame 0xffffff8821a7ea50 sctp_iterator_thread() at sctp_iterator_thread+0x59/frame 0xffffff8821a7ea70 fork_exit() at fork_exit+0x84/frame 0xffffff8821a7eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8821a7eab0 --- trap 0, rip = 0, rsp = 0xffffff8821a7eb70, rbp = 0 --- Tracing command usb pid 15 tid 100119 td 0xfffffe005190f920 sched_switch() at sched_switch+0x482/frame 0xffffff881f9db920 mi_switch() at mi_switch+0x179/frame 0xffffff881f9db960 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881f9db9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881f9db9d0 _cv_wait() at _cv_wait+0x1df/frame 0xffffff881f9dba40 usb_process() at usb_process+0xd4/frame 0xffffff881f9dba70 fork_exit() at fork_exit+0x84/frame 0xffffff881f9dbab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f9dbab0 --- trap 0, rip = 0, rsp = 0xffffff881f9dbb70, rbp = 0 --- Tracing command usb pid 15 tid 100118 td 0xfffffe0051915000 sched_switch() at sched_switch+0x482/frame 0xffffff881f9d6920 mi_switch() at mi_switch+0x179/frame 0xffffff881f9d6960 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881f9d69a0 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881f9d69d0 _cv_wait() at _cv_wait+0x1df/frame 0xffffff881f9d6a40 usb_process() at usb_process+0xd4/frame 0xffffff881f9d6a70 fork_exit() at fork_exit+0x84/frame 0xffffff881f9d6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f9d6ab0 --- trap 0, rip = 0, rsp = 0xffffff881f9d6b70, rbp = 0 --- Tracing command usb pid 15 tid 100117 td 0xfffffe0051915490 sched_switch() at sched_switch+0x482/frame 0xffffff881f9d1920 mi_switch() at mi_switch+0x179/frame 0xffffff881f9d1960 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881f9d19a0 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881f9d19d0 _cv_wait() at _cv_wait+0x1df/frame 0xffffff881f9d1a40 usb_process() at usb_process+0xd4/frame 0xffffff881f9d1a70 fork_exit() at fork_exit+0x84/frame 0xffffff881f9d1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f9d1ab0 --- trap 0, rip = 0, rsp = 0xffffff881f9d1b70, rbp = 0 --- Tracing command usb pid 15 tid 100116 td 0xfffffe0051915920 sched_switch() at sched_switch+0x482/frame 0xffffff881f9cc920 mi_switch() at mi_switch+0x179/frame 0xffffff881f9cc960 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881f9cc9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881f9cc9d0 _cv_wait() at _cv_wait+0x1df/frame 0xffffff881f9cca40 usb_process() at usb_process+0xd4/frame 0xffffff881f9cca70 fork_exit() at fork_exit+0x84/frame 0xffffff881f9ccab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f9ccab0 --- trap 0, rip = 0, rsp = 0xffffff881f9ccb70, rbp = 0 --- Tracing command usb pid 15 tid 100114 td 0xfffffe005190e000 sched_switch() at sched_switch+0x482/frame 0xffffff881f83f920 mi_switch() at mi_switch+0x179/frame 0xffffff881f83f960 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881f83f9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881f83f9d0 _cv_wait() at _cv_wait+0x1df/frame 0xffffff881f83fa40 usb_process() at usb_process+0xd4/frame 0xffffff881f83fa70 fork_exit() at fork_exit+0x84/frame 0xffffff881f83fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f83fab0 --- trap 0, rip = 0, rsp = 0xffffff881f83fb70, rbp = 0 --- Tracing command usb pid 15 tid 100113 td 0xfffffe005190e490 sched_switch() at sched_switch+0x482/frame 0xffffff881f83a920 mi_switch() at mi_switch+0x179/frame 0xffffff881f83a960 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881f83a9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881f83a9d0 _cv_wait() at _cv_wait+0x1df/frame 0xffffff881f83aa40 usb_process() at usb_process+0xd4/frame 0xffffff881f83aa70 fork_exit() at fork_exit+0x84/frame 0xffffff881f83aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f83aab0 --- trap 0, rip = 0, rsp = 0xffffff881f83ab70, rbp = 0 --- Tracing command usb pid 15 tid 100112 td 0xfffffe005190e920 sched_switch() at sched_switch+0x482/frame 0xffffff881f835920 mi_switch() at mi_switch+0x179/frame 0xffffff881f835960 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881f8359a0 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881f8359d0 _cv_wait() at _cv_wait+0x1df/frame 0xffffff881f835a40 usb_process() at usb_process+0xd4/frame 0xffffff881f835a70 fork_exit() at fork_exit+0x84/frame 0xffffff881f835ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f835ab0 --- trap 0, rip = 0, rsp = 0xffffff881f835b70, rbp = 0 --- Tracing command usb pid 15 tid 100111 td 0xfffffe005190f000 sched_switch() at sched_switch+0x482/frame 0xffffff881f830920 mi_switch() at mi_switch+0x179/frame 0xffffff881f830960 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881f8309a0 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881f8309d0 _cv_wait() at _cv_wait+0x1df/frame 0xffffff881f830a40 usb_process() at usb_process+0xd4/frame 0xffffff881f830a70 fork_exit() at fork_exit+0x84/frame 0xffffff881f830ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f830ab0 --- trap 0, rip = 0, rsp = 0xffffff881f830b70, rbp = 0 --- Tracing command usb pid 15 tid 100074 td 0xfffffe005049a920 sched_switch() at sched_switch+0x482/frame 0xffffff881f6cb920 mi_switch() at mi_switch+0x179/frame 0xffffff881f6cb960 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881f6cb9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881f6cb9d0 _cv_wait() at _cv_wait+0x1df/frame 0xffffff881f6cba40 usb_process() at usb_process+0xd4/frame 0xffffff881f6cba70 fork_exit() at fork_exit+0x84/frame 0xffffff881f6cbab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f6cbab0 --- trap 0, rip = 0, rsp = 0xffffff881f6cbb70, rbp = 0 --- Tracing command usb pid 15 tid 100073 td 0xfffffe00518c1000 sched_switch() at sched_switch+0x482/frame 0xffffff881f6c6920 mi_switch() at mi_switch+0x179/frame 0xffffff881f6c6960 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881f6c69a0 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881f6c69d0 _cv_wait() at _cv_wait+0x1df/frame 0xffffff881f6c6a40 usb_process() at usb_process+0xd4/frame 0xffffff881f6c6a70 fork_exit() at fork_exit+0x84/frame 0xffffff881f6c6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f6c6ab0 --- trap 0, rip = 0, rsp = 0xffffff881f6c6b70, rbp = 0 --- Tracing command usb pid 15 tid 100072 td 0xfffffe00518c1490 sched_switch() at sched_switch+0x482/frame 0xffffff881f6c1920 mi_switch() at mi_switch+0x179/frame 0xffffff881f6c1960 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881f6c19a0 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881f6c19d0 _cv_wait() at _cv_wait+0x1df/frame 0xffffff881f6c1a40 usb_process() at usb_process+0xd4/frame 0xffffff881f6c1a70 fork_exit() at fork_exit+0x84/frame 0xffffff881f6c1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f6c1ab0 --- trap 0, rip = 0, rsp = 0xffffff881f6c1b70, rbp = 0 --- Tracing command usb pid 15 tid 100071 td 0xfffffe00518c1920 sched_switch() at sched_switch+0x482/frame 0xffffff881f6bc920 mi_switch() at mi_switch+0x179/frame 0xffffff881f6bc960 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881f6bc9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881f6bc9d0 _cv_wait() at _cv_wait+0x1df/frame 0xffffff881f6bca40 usb_process() at usb_process+0xd4/frame 0xffffff881f6bca70 fork_exit() at fork_exit+0x84/frame 0xffffff881f6bcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f6bcab0 --- trap 0, rip = 0, rsp = 0xffffff881f6bcb70, rbp = 0 --- Tracing command yarrow pid 14 tid 100057 td 0xfffffe00502fb490 sched_switch() at sched_switch+0x482/frame 0xffffff878ea368f0 mi_switch() at mi_switch+0x179/frame 0xffffff878ea36930 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff878ea36970 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xffffff878ea369a0 msleep_spin_sbt() at msleep_spin_sbt+0x1f0/frame 0xffffff878ea36a30 random_kthread() at random_kthread+0x68/frame 0xffffff878ea36a70 fork_exit() at fork_exit+0x84/frame 0xffffff878ea36ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ea36ab0 --- trap 0, rip = 0, rsp = 0xffffff878ea36b70, rbp = 0 --- Tracing command geom pid 13 tid 100055 td 0xfffffe00502dd920 sched_switch() at sched_switch+0x482/frame 0xffffff878ea2c8d0 mi_switch() at mi_switch+0x179/frame 0xffffff878ea2c910 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff878ea2c950 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff878ea2c980 _sleep() at _sleep+0x33d/frame 0xffffff878ea2ca10 g_io_schedule_down() at g_io_schedule_down+0x4c/frame 0xffffff878ea2ca60 g_down_procbody() at g_down_procbody+0x7d/frame 0xffffff878ea2ca70 fork_exit() at fork_exit+0x84/frame 0xffffff878ea2cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ea2cab0 --- trap 0, rip = 0, rsp = 0xffffff878ea2cb70, rbp = 0 --- Tracing command geom pid 13 tid 100054 td 0xfffffe00502e6000 sched_switch() at sched_switch+0x482/frame 0xffffff878ea278f0 mi_switch() at mi_switch+0x179/frame 0xffffff878ea27930 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff878ea27970 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff878ea279a0 _sleep() at _sleep+0x33d/frame 0xffffff878ea27a30 g_io_schedule_up() at g_io_schedule_up+0xbc/frame 0xffffff878ea27a60 g_up_procbody() at g_up_procbody+0x7d/frame 0xffffff878ea27a70 fork_exit() at fork_exit+0x84/frame 0xffffff878ea27ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ea27ab0 --- trap 0, rip = 0, rsp = 0xffffff878ea27b70, rbp = 0 --- Tracing command geom pid 13 tid 100053 td 0xfffffe00502e6490 sched_switch() at sched_switch+0x482/frame 0xffffff878ea228f0 mi_switch() at mi_switch+0x179/frame 0xffffff878ea22930 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff878ea22970 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff878ea229a0 _sleep() at _sleep+0x33d/frame 0xffffff878ea22a30 g_run_events() at g_run_events+0x4f4/frame 0xffffff878ea22a70 fork_exit() at fork_exit+0x84/frame 0xffffff878ea22ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ea22ab0 --- trap 0, rip = 0, rsp = 0xffffff878ea22b70, rbp = 0 --- Tracing command intr pid 12 tid 100122 td 0xfffffe0054041000 sched_switch() at sched_switch+0x482/frame 0xffffff8821a6a9f0 mi_switch() at mi_switch+0x179/frame 0xffffff8821a6aa30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff8821a6aa70 fork_exit() at fork_exit+0x84/frame 0xffffff8821a6aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8821a6aab0 --- trap 0, rip = 0, rsp = 0xffffff8821a6ab70, rbp = 0 --- Tracing command intr pid 12 tid 100121 td 0xfffffe0054041490 sched_switch() at sched_switch+0x482/frame 0xffffff8821a629f0 mi_switch() at mi_switch+0x179/frame 0xffffff8821a62a30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff8821a62a70 fork_exit() at fork_exit+0x84/frame 0xffffff8821a62ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8821a62ab0 --- trap 0, rip = 0, rsp = 0xffffff8821a62b70, rbp = 0 --- Tracing command intr pid 12 tid 100120 td 0xfffffe005190f490 sched_switch() at sched_switch+0x482/frame 0xffffff881f9e09f0 mi_switch() at mi_switch+0x179/frame 0xffffff881f9e0a30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff881f9e0a70 fork_exit() at fork_exit+0x84/frame 0xffffff881f9e0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f9e0ab0 --- trap 0, rip = 0, rsp = 0xffffff881f9e0b70, rbp = 0 --- Tracing command intr pid 12 tid 100115 td 0xfffffe00518fa920 sched_switch() at sched_switch+0x482/frame 0xffffff881f9c79f0 mi_switch() at mi_switch+0x179/frame 0xffffff881f9c7a30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff881f9c7a70 fork_exit() at fork_exit+0x84/frame 0xffffff881f9c7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f9c7ab0 --- trap 0, rip = 0, rsp = 0xffffff881f9c7b70, rbp = 0 --- Tracing command intr pid 12 tid 100110 td 0xfffffe00518f9000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100109 td 0xfffffe00518f9490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100107 td 0xfffffe00518fa000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100105 td 0xfffffe00518f7490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100103 td 0xfffffe00518f8000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100101 td 0xfffffe00518f8920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100099 td 0xfffffe00518f6000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100097 td 0xfffffe00518f6920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100095 td 0xfffffe00518e4000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100093 td 0xfffffe00518e4920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100092 td 0xfffffe00518e9000 sched_switch() at sched_switch+0x482/frame 0xffffff881f76f9f0 mi_switch() at mi_switch+0x179/frame 0xffffff881f76fa30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff881f76fa70 fork_exit() at fork_exit+0x84/frame 0xffffff881f76fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f76fab0 --- trap 0, rip = 0, rsp = 0xffffff881f76fb70, rbp = 0 --- Tracing command intr pid 12 tid 100090 td 0xfffffe00518e2490 sched_switch() at sched_switch+0x482/frame 0xffffff881f7659f0 mi_switch() at mi_switch+0x179/frame 0xffffff881f765a30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff881f765a70 fork_exit() at fork_exit+0x84/frame 0xffffff881f765ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f765ab0 --- trap 0, rip = 0, rsp = 0xffffff881f765b70, rbp = 0 --- Tracing command intr pid 12 tid 100088 td 0xfffffe00518e3000 sched_switch() at sched_switch+0x482/frame 0xffffff881f75b9f0 mi_switch() at mi_switch+0x179/frame 0xffffff881f75ba30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff881f75ba70 fork_exit() at fork_exit+0x84/frame 0xffffff881f75bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f75bab0 --- trap 0, rip = 0, rsp = 0xffffff881f75bb70, rbp = 0 --- Tracing command intr pid 12 tid 100086 td 0xfffffe00518e3920 sched_switch() at sched_switch+0x482/frame 0xffffff881f7519f0 mi_switch() at mi_switch+0x179/frame 0xffffff881f751a30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff881f751a70 fork_exit() at fork_exit+0x84/frame 0xffffff881f751ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f751ab0 --- trap 0, rip = 0, rsp = 0xffffff881f751b70, rbp = 0 --- Tracing command intr pid 12 tid 100084 td 0xfffffe00518e1000 sched_switch() at sched_switch+0x482/frame 0xffffff881f7479f0 mi_switch() at mi_switch+0x179/frame 0xffffff881f747a30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff881f747a70 fork_exit() at fork_exit+0x84/frame 0xffffff881f747ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f747ab0 --- trap 0, rip = 0, rsp = 0xffffff881f747b70, rbp = 0 --- Tracing command intr pid 12 tid 100082 td 0xfffffe00518e1920 sched_switch() at sched_switch+0x482/frame 0xffffff881f73d9f0 mi_switch() at mi_switch+0x179/frame 0xffffff881f73da30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff881f73da70 fork_exit() at fork_exit+0x84/frame 0xffffff881f73dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f73dab0 --- trap 0, rip = 0, rsp = 0xffffff881f73db70, rbp = 0 --- Tracing command intr pid 12 tid 100080 td 0xfffffe00518df000 sched_switch() at sched_switch+0x482/frame 0xffffff881f7339f0 mi_switch() at mi_switch+0x179/frame 0xffffff881f733a30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff881f733a70 fork_exit() at fork_exit+0x84/frame 0xffffff881f733ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f733ab0 --- trap 0, rip = 0, rsp = 0xffffff881f733b70, rbp = 0 --- Tracing command intr pid 12 tid 100078 td 0xfffffe00518df920 sched_switch() at sched_switch+0x482/frame 0xffffff881f7299f0 mi_switch() at mi_switch+0x179/frame 0xffffff881f729a30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff881f729a70 fork_exit() at fork_exit+0x84/frame 0xffffff881f729ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f729ab0 --- trap 0, rip = 0, rsp = 0xffffff881f729b70, rbp = 0 --- Tracing command intr pid 12 tid 100076 td 0xfffffe00518e0490 sched_switch() at sched_switch+0x482/frame 0xffffff881f71f9f0 mi_switch() at mi_switch+0x179/frame 0xffffff881f71fa30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff881f71fa70 fork_exit() at fork_exit+0x84/frame 0xffffff881f71fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f71fab0 --- trap 0, rip = 0, rsp = 0xffffff881f71fb70, rbp = 0 --- Tracing command intr pid 12 tid 100075 td 0xfffffe005049a490 sched_switch() at sched_switch+0x482/frame 0xffffff881f6d09f0 mi_switch() at mi_switch+0x179/frame 0xffffff881f6d0a30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff881f6d0a70 fork_exit() at fork_exit+0x84/frame 0xffffff881f6d0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f6d0ab0 --- trap 0, rip = 0, rsp = 0xffffff881f6d0b70, rbp = 0 --- Tracing command intr pid 12 tid 100070 td 0xfffffe0050490920 sched_switch() at sched_switch+0x482/frame 0xffffff881f6b79f0 mi_switch() at mi_switch+0x179/frame 0xffffff881f6b7a30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff881f6b7a70 fork_exit() at fork_exit+0x84/frame 0xffffff881f6b7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f6b7ab0 --- trap 0, rip = 0, rsp = 0xffffff881f6b7b70, rbp = 0 --- Tracing command intr pid 12 tid 100069 td 0xfffffe0050499000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100068 td 0xfffffe0050499490 sched_switch() at sched_switch+0x482/frame 0xffffff878eb7d9f0 mi_switch() at mi_switch+0x179/frame 0xffffff878eb7da30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff878eb7da70 fork_exit() at fork_exit+0x84/frame 0xffffff878eb7dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878eb7dab0 --- trap 0, rip = 0, rsp = 0xffffff878eb7db70, rbp = 0 --- Tracing command intr pid 12 tid 100066 td 0xfffffe005049a000 sched_switch() at sched_switch+0x482/frame 0xffffff878ea649f0 mi_switch() at mi_switch+0x179/frame 0xffffff878ea64a30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff878ea64a70 fork_exit() at fork_exit+0x84/frame 0xffffff878ea64ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ea64ab0 --- trap 0, rip = 0, rsp = 0xffffff878ea64b70, rbp = 0 --- Tracing command intr pid 12 tid 100065 td 0xfffffe0050488000 sched_switch() at sched_switch+0x482/frame 0xffffff878ea5f9f0 mi_switch() at mi_switch+0x179/frame 0xffffff878ea5fa30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff878ea5fa70 fork_exit() at fork_exit+0x84/frame 0xffffff878ea5fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ea5fab0 --- trap 0, rip = 0, rsp = 0xffffff878ea5fb70, rbp = 0 --- Tracing command intr pid 12 tid 100060 td 0xfffffe00502e7490 sched_switch() at sched_switch+0x482/frame 0xffffff878ea469f0 mi_switch() at mi_switch+0x179/frame 0xffffff878ea46a30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff878ea46a70 fork_exit() at fork_exit+0x84/frame 0xffffff878ea46ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ea46ab0 --- trap 0, rip = 0, rsp = 0xffffff878ea46b70, rbp = 0 --- Tracing command intr pid 12 tid 100059 td 0xfffffe00502e7920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100052 td 0xfffffe00502e6920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100051 td 0xfffffe00502e7000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100050 td 0xfffffe00502dc000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100049 td 0xfffffe00502dc490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100048 td 0xfffffe00502dc920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100047 td 0xfffffe00502dd000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100046 td 0xfffffe00502dd490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100045 td 0xfffffe00502da490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100044 td 0xfffffe00502da920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100043 td 0xfffffe00502db000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100042 td 0xfffffe00502db490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100041 td 0xfffffe00502db920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100040 td 0xfffffe00502d7920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100039 td 0xfffffe00502d9000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100038 td 0xfffffe00502d9490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100037 td 0xfffffe00502d9920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100036 td 0xfffffe00502da000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100035 td 0xfffffe00502d6000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100034 td 0xfffffe00502d6490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100033 td 0xfffffe00502d6920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100032 td 0xfffffe00502d7000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100031 td 0xfffffe00502d7490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100030 td 0xfffffe00502b4490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100029 td 0xfffffe00502b4920 sched_switch() at sched_switch+0x482/frame 0xffffff80003919f0 mi_switch() at mi_switch+0x179/frame 0xffffff8000391a30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff8000391a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000391ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000391ab0 --- trap 0, rip = 0, rsp = 0xffffff8000391b70, rbp = 0 --- Tracing command intr pid 12 tid 100028 td 0xfffffe00502b5000 sched_switch() at sched_switch+0x482/frame 0xffffff800038c9f0 mi_switch() at mi_switch+0x179/frame 0xffffff800038ca30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff800038ca70 fork_exit() at fork_exit+0x84/frame 0xffffff800038cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff800038cab0 --- trap 0, rip = 0, rsp = 0xffffff800038cb70, rbp = 0 --- Tracing command intr pid 12 tid 100027 td 0xfffffe00502b5490 fork_trampoline() at fork_trampoline Tracing command idle pid 11 tid 100026 td 0xfffffe00502b5920 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff80002fece0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff80002fed00 trap() at trap+0x42/frame 0xffffff80002fef20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff80002fef20 --- trap 0x13, rip = 0xffffffff80c97ef6, rsp = 0xffffff80002fefe0, rbp = 0xffffff8000382930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff8000382930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff8000382980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff80003829a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff80003829c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff8000382a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000382ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000382ab0 --- trap 0, rip = 0, rsp = 0xffffff8000382b70, rbp = 0 --- Tracing command idle pid 11 tid 100025 td 0xfffffe00502b2920 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff80002f7ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff80002f7d00 trap() at trap+0x42/frame 0xffffff80002f7f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff80002f7f20 --- trap 0x13, rip = 0xffffffff80c97ef6, rsp = 0xffffff80002f7fe0, rbp = 0xffffff800037d930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff800037d930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff800037d980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff800037d9a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff800037d9c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff800037da70 fork_exit() at fork_exit+0x84/frame 0xffffff800037dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff800037dab0 --- trap 0, rip = 0, rsp = 0xffffff800037db70, rbp = 0 --- Tracing command idle pid 11 tid 100024 td 0xfffffe00502b3000 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff80002f0ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff80002f0d00 trap() at trap+0x42/frame 0xffffff80002f0f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff80002f0f20 --- trap 0x13, rip = 0xffffffff80c97ef6, rsp = 0xffffff80002f0fe0, rbp = 0xffffff8000378930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff8000378930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff8000378980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff80003789a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff80003789c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff8000378a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000378ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000378ab0 --- trap 0, rip = 0, rsp = 0xffffff8000378b70, rbp = 0 --- Tracing command idle pid 11 tid 100023 td 0xfffffe00502b3490 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff80002e9ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff80002e9d00 trap() at trap+0x42/frame 0xffffff80002e9f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff80002e9f20 --- trap 0x13, rip = 0xffffffff80c97ef6, rsp = 0xffffff80002e9fe0, rbp = 0xffffff8000373930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff8000373930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff8000373980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff80003739a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff80003739c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff8000373a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000373ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000373ab0 --- trap 0, rip = 0, rsp = 0xffffff8000373b70, rbp = 0 --- Tracing command idle pid 11 tid 100022 td 0xfffffe00502b3920 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff80002e2ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff80002e2d00 trap() at trap+0x42/frame 0xffffff80002e2f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff80002e2f20 --- trap 0x13, rip = 0xffffffff80c97ef6, rsp = 0xffffff80002e2fe0, rbp = 0xffffff800036e930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff800036e930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff800036e980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff800036e9a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff800036e9c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff800036ea70 fork_exit() at fork_exit+0x84/frame 0xffffff800036eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff800036eab0 --- trap 0, rip = 0, rsp = 0xffffff800036eb70, rbp = 0 --- Tracing command idle pid 11 tid 100021 td 0xfffffe00502b4000 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff80002dbce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff80002dbd00 trap() at trap+0x42/frame 0xffffff80002dbf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff80002dbf20 --- trap 0x13, rip = 0xffffffff80c97ef6, rsp = 0xffffff80002dbfe0, rbp = 0xffffff8000369930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff8000369930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff8000369980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff80003699a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff80003699c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff8000369a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000369ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000369ab0 --- trap 0, rip = 0, rsp = 0xffffff8000369b70, rbp = 0 --- Tracing command idle pid 11 tid 100020 td 0xfffffe00502b1000 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff80002d4ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff80002d4d00 trap() at trap+0x42/frame 0xffffff80002d4f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff80002d4f20 --- trap 0x13, rip = 0xffffffff80c97ef6, rsp = 0xffffff80002d4fe0, rbp = 0xffffff8000364930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff8000364930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff8000364980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff80003649a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff80003649c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff8000364a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000364ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000364ab0 --- trap 0, rip = 0, rsp = 0xffffff8000364b70, rbp = 0 --- Tracing command idle pid 11 tid 100019 td 0xfffffe00502b1490 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff80002cdce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff80002cdd00 trap() at trap+0x42/frame 0xffffff80002cdf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff80002cdf20 --- trap 0x13, rip = 0xffffffff80c97ef6, rsp = 0xffffff80002cdfe0, rbp = 0xffffff800035f930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff800035f930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff800035f980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff800035f9a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff800035f9c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff800035fa70 fork_exit() at fork_exit+0x84/frame 0xffffff800035fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff800035fab0 --- trap 0, rip = 0, rsp = 0xffffff800035fb70, rbp = 0 --- Tracing command idle pid 11 tid 100018 td 0xfffffe00502b1920 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff80002c6ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff80002c6d00 trap() at trap+0x42/frame 0xffffff80002c6f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff80002c6f20 --- trap 0x13, rip = 0xffffffff80c97ef6, rsp = 0xffffff80002c6fe0, rbp = 0xffffff800035a930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff800035a930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff800035a980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff800035a9a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff800035a9c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff800035aa70 fork_exit() at fork_exit+0x84/frame 0xffffff800035aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff800035aab0 --- trap 0, rip = 0, rsp = 0xffffff800035ab70, rbp = 0 --- Tracing command idle pid 11 tid 100017 td 0xfffffe00502b2000 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff80002bfce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff80002bfd00 trap() at trap+0x42/frame 0xffffff80002bff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff80002bff20 --- trap 0x13, rip = 0xffffffff80c97ef6, rsp = 0xffffff80002bffe0, rbp = 0xffffff8000355930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff8000355930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff8000355980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff80003559a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff80003559c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff8000355a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000355ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000355ab0 --- trap 0, rip = 0, rsp = 0xffffff8000355b70, rbp = 0 --- Tracing command idle pid 11 tid 100016 td 0xfffffe00502b2490 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff80002b8ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff80002b8d00 trap() at trap+0x42/frame 0xffffff80002b8f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff80002b8f20 --- trap 0x13, rip = 0xffffffff80c97ef6, rsp = 0xffffff80002b8fe0, rbp = 0xffffff8000350930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff8000350930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff8000350980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff80003509a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff80003509c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff8000350a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000350ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000350ab0 --- trap 0, rip = 0, rsp = 0xffffff8000350b70, rbp = 0 --- Tracing command idle pid 11 tid 100015 td 0xfffffe00502af490 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff80002b1ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff80002b1d00 trap() at trap+0x42/frame 0xffffff80002b1f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff80002b1f20 --- trap 0x13, rip = 0xffffffff80c97ef6, rsp = 0xffffff80002b1fe0, rbp = 0xffffff800034b930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff800034b930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff800034b980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff800034b9a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff800034b9c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff800034ba70 fork_exit() at fork_exit+0x84/frame 0xffffff800034bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff800034bab0 --- trap 0, rip = 0, rsp = 0xffffff800034bb70, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffffe00502af920 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff80002aace0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff80002aad00 trap() at trap+0x42/frame 0xffffff80002aaf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff80002aaf20 --- trap 0x13, rip = 0xffffffff80c97ef6, rsp = 0xffffff80002aafe0, rbp = 0xffffff8000346930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff8000346930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff8000346980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff80003469a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff80003469c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff8000346a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000346ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000346ab0 --- trap 0, rip = 0, rsp = 0xffffff8000346b70, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffffe00502b0000 sched_switch() at sched_switch+0x482/frame 0xffffff8000341960 mi_switch() at mi_switch+0x179/frame 0xffffff80003419a0 critical_exit() at critical_exit+0x8b/frame 0xffffff80003419c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff8000341a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000341ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000341ab0 --- trap 0, rip = 0, rsp = 0xffffff8000341b70, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffffe00502b0490 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff800029cce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff800029cd00 trap() at trap+0x42/frame 0xffffff800029cf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff800029cf20 --- trap 0x13, rip = 0xffffffff80c97ef6, rsp = 0xffffff800029cfe0, rbp = 0xffffff800033c930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff800033c930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff800033c980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff800033c9a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff800033c9c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff800033ca70 fork_exit() at fork_exit+0x84/frame 0xffffff800033cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff800033cab0 --- trap 0, rip = 0, rsp = 0xffffff800033cb70, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffffe00502b0920 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff8000295ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff8000295d00 trap() at trap+0x42/frame 0xffffff8000295f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff8000295f20 --- trap 0x13, rip = 0xffffffff80c97ef6, rsp = 0xffffff8000295fe0, rbp = 0xffffff8000337930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff8000337930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff8000337980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff80003379a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff80003379c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff8000337a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000337ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000337ab0 --- trap 0, rip = 0, rsp = 0xffffff8000337b70, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffffe00502a1920 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff800028ece0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff800028ed00 trap() at trap+0x42/frame 0xffffff800028ef20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff800028ef20 --- trap 0x13, rip = 0xffffffff80c97ef6, rsp = 0xffffff800028efe0, rbp = 0xffffff8000332930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff8000332930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff8000332980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff80003329a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff80003329c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff8000332a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000332ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000332ab0 --- trap 0, rip = 0, rsp = 0xffffff8000332b70, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffffe00502ae000 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff8000287ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff8000287d00 trap() at trap+0x42/frame 0xffffff8000287f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff8000287f20 --- trap 0x13, rip = 0xffffffff80c97ef6, rsp = 0xffffff8000287fe0, rbp = 0xffffff800032d930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff800032d930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff800032d980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff800032d9a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff800032d9c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff800032da70 fork_exit() at fork_exit+0x84/frame 0xffffff800032dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff800032dab0 --- trap 0, rip = 0, rsp = 0xffffff800032db70, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffffe00502ae490 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff8000280ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff8000280d00 trap() at trap+0x42/frame 0xffffff8000280f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff8000280f20 --- trap 0x13, rip = 0xffffffff80c97ef6, rsp = 0xffffff8000280fe0, rbp = 0xffffff8000328930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff8000328930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff8000328980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff80003289a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff80003289c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff8000328a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000328ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000328ab0 --- trap 0, rip = 0, rsp = 0xffffff8000328b70, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffffe00502ae920 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff8000279ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff8000279d00 trap() at trap+0x42/frame 0xffffff8000279f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff8000279f20 --- trap 0x13, rip = 0xffffffff80c97ef6, rsp = 0xffffff8000279fe0, rbp = 0xffffff8000323930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff8000323930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff8000323980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff80003239a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff80003239c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff8000323a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000323ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000323ab0 --- trap 0, rip = 0, rsp = 0xffffff8000323b70, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffffe00502af000 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff8000272ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff8000272d00 trap() at trap+0x42/frame 0xffffff8000272f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff8000272f20 --- trap 0x13, rip = 0xffffffff80c97ef6, rsp = 0xffffff8000272fe0, rbp = 0xffffff800031e930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff800031e930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff800031e980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff800031e9a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff800031e9c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff800031ea70 fork_exit() at fork_exit+0x84/frame 0xffffff800031eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff800031eab0 --- trap 0, rip = 0, rsp = 0xffffff800031eb70, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffffe005029b000 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff800026bce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff800026bd00 trap() at trap+0x42/frame 0xffffff800026bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff800026bf20 --- trap 0x13, rip = 0xffffffff80c97ef6, rsp = 0xffffff800026bfe0, rbp = 0xffffff8000319930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff8000319930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff8000319980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff80003199a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff80003199c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff8000319a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000319ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000319ab0 --- trap 0, rip = 0, rsp = 0xffffff8000319b70, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffffe005029b490 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff8000264ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff8000264d00 trap() at trap+0x42/frame 0xffffff8000264f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff8000264f20 --- trap 0x13, rip = 0xffffffff80c97ef6, rsp = 0xffffff8000264fe0, rbp = 0xffffff8000314930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff8000314930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff8000314980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff80003149a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff80003149c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff8000314a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000314ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000314ab0 --- trap 0, rip = 0, rsp = 0xffffff8000314b70, rbp = 0 --- Tracing command idle pid 11 tid 100003 td 0xfffffe005029b920 cpustop_handler() at cpustop_handler+0x28/frame 0xffffffff81591960 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffffff81591980 trap() at trap+0x42/frame 0xffffffff81591ba0 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81591ba0 --- trap 0x13, rip = 0xffffffff80c97ef6, rsp = 0xffffffff81591c60, rbp = 0xffffff800030f930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff800030f930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff800030f980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff800030f9a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff800030f9c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff800030fa70 fork_exit() at fork_exit+0x84/frame 0xffffff800030fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff800030fab0 --- trap 0, rip = 0, rsp = 0xffffff800030fb70, rbp = 0 --- Tracing command init pid 1 tid 100002 td 0xfffffe00502a1000 sched_switch() at sched_switch+0x482/frame 0xffffff800030a560 mi_switch() at mi_switch+0x179/frame 0xffffff800030a5a0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff800030a5e0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff800030a650 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff800030a680 _sleep() at _sleep+0x320/frame 0xffffff800030a710 kern_wait6() at kern_wait6+0x3e7/frame 0xffffff800030a7b0 sys_wait4() at sys_wait4+0x76/frame 0xffffff800030a9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff800030aab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff800030aab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x4131fa, rsp = 0x7fffffffd758, rbp = 0x7fffffffd7c0 --- Tracing command audit pid 10 tid 100001 td 0xfffffe00502a1490 sched_switch() at sched_switch+0x482/frame 0xffffff80003058f0 mi_switch() at mi_switch+0x179/frame 0xffffff8000305930 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8000305970 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff80003059a0 _cv_wait() at _cv_wait+0x1df/frame 0xffffff8000305a10 audit_worker() at audit_worker+0xa3/frame 0xffffff8000305a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000305ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000305ab0 --- trap 0, rip = 0, rsp = 0xffffff8000305b70, rbp = 0 --- Tracing command kernel pid 0 tid 100124 td 0xfffffe005401d490 sched_switch() at sched_switch+0x482/frame 0xffffff8821a78890 mi_switch() at mi_switch+0x179/frame 0xffffff8821a788d0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8821a78910 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xffffff8821a78940 _sleep() at _sleep+0x312/frame 0xffffff8821a789d0 pause_sbt() at pause_sbt+0x70/frame 0xffffff8821a78a20 deadlkres() at deadlkres+0x66/frame 0xffffff8821a78a70 fork_exit() at fork_exit+0x84/frame 0xffffff8821a78ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8821a78ab0 --- trap 0, rip = 0, rsp = 0xffffff8821a78b70, rbp = 0 --- Tracing command kernel pid 0 tid 100123 td 0xfffffe005401d920 sched_switch() at sched_switch+0x482/frame 0xffffff8821a73900 mi_switch() at mi_switch+0x179/frame 0xffffff8821a73940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8821a73980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff8821a739b0 msleep_spin_sbt() at msleep_spin_sbt+0x200/frame 0xffffff8821a73a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x8d/frame 0xffffff8821a73a70 fork_exit() at fork_exit+0x84/frame 0xffffff8821a73ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8821a73ab0 --- trap 0, rip = 0, rsp = 0xffffff8821a73b70, rbp = 0 --- Tracing command kernel pid 0 tid 100108 td 0xfffffe00518f9920 sched_switch() at sched_switch+0x482/frame 0xffffff881f7ff900 mi_switch() at mi_switch+0x179/frame 0xffffff881f7ff940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881f7ff980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881f7ff9b0 _sleep() at _sleep+0x33d/frame 0xffffff881f7ffa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881f7ffa70 fork_exit() at fork_exit+0x84/frame 0xffffff881f7ffab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f7ffab0 --- trap 0, rip = 0, rsp = 0xffffff881f7ffb70, rbp = 0 --- Tracing command kernel pid 0 tid 100106 td 0xfffffe00518fa490 sched_switch() at sched_switch+0x482/frame 0xffffff881f7f5900 mi_switch() at mi_switch+0x179/frame 0xffffff881f7f5940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881f7f5980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881f7f59b0 _sleep() at _sleep+0x33d/frame 0xffffff881f7f5a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881f7f5a70 fork_exit() at fork_exit+0x84/frame 0xffffff881f7f5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f7f5ab0 --- trap 0, rip = 0, rsp = 0xffffff881f7f5b70, rbp = 0 --- Tracing command kernel pid 0 tid 100104 td 0xfffffe00518f7920 sched_switch() at sched_switch+0x482/frame 0xffffff881f7eb900 mi_switch() at mi_switch+0x179/frame 0xffffff881f7eb940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881f7eb980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881f7eb9b0 _sleep() at _sleep+0x33d/frame 0xffffff881f7eba40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881f7eba70 fork_exit() at fork_exit+0x84/frame 0xffffff881f7ebab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f7ebab0 --- trap 0, rip = 0, rsp = 0xffffff881f7ebb70, rbp = 0 --- Tracing command kernel pid 0 tid 100102 td 0xfffffe00518f8490 sched_switch() at sched_switch+0x482/frame 0xffffff881f7e1900 mi_switch() at mi_switch+0x179/frame 0xffffff881f7e1940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881f7e1980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881f7e19b0 _sleep() at _sleep+0x33d/frame 0xffffff881f7e1a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881f7e1a70 fork_exit() at fork_exit+0x84/frame 0xffffff881f7e1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f7e1ab0 --- trap 0, rip = 0, rsp = 0xffffff881f7e1b70, rbp = 0 --- Tracing command kernel pid 0 tid 100100 td 0xfffffe00518e9920 sched_switch() at sched_switch+0x482/frame 0xffffff881f7d7900 mi_switch() at mi_switch+0x179/frame 0xffffff881f7d7940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881f7d7980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881f7d79b0 _sleep() at _sleep+0x33d/frame 0xffffff881f7d7a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881f7d7a70 fork_exit() at fork_exit+0x84/frame 0xffffff881f7d7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f7d7ab0 --- trap 0, rip = 0, rsp = 0xffffff881f7d7b70, rbp = 0 --- Tracing command kernel pid 0 tid 100098 td 0xfffffe00518f6490 sched_switch() at sched_switch+0x482/frame 0xffffff881f7cd900 mi_switch() at mi_switch+0x179/frame 0xffffff881f7cd940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881f7cd980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881f7cd9b0 _sleep() at _sleep+0x33d/frame 0xffffff881f7cda40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881f7cda70 fork_exit() at fork_exit+0x84/frame 0xffffff881f7cdab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f7cdab0 --- trap 0, rip = 0, rsp = 0xffffff881f7cdb70, rbp = 0 --- Tracing command kernel pid 0 tid 100096 td 0xfffffe00518f7000 sched_switch() at sched_switch+0x482/frame 0xffffff881f7c3900 mi_switch() at mi_switch+0x179/frame 0xffffff881f7c3940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881f7c3980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881f7c39b0 _sleep() at _sleep+0x33d/frame 0xffffff881f7c3a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881f7c3a70 fork_exit() at fork_exit+0x84/frame 0xffffff881f7c3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f7c3ab0 --- trap 0, rip = 0, rsp = 0xffffff881f7c3b70, rbp = 0 --- Tracing command kernel pid 0 tid 100094 td 0xfffffe00518e4490 sched_switch() at sched_switch+0x482/frame 0xffffff881f7b9900 mi_switch() at mi_switch+0x179/frame 0xffffff881f7b9940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881f7b9980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881f7b99b0 _sleep() at _sleep+0x33d/frame 0xffffff881f7b9a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881f7b9a70 fork_exit() at fork_exit+0x84/frame 0xffffff881f7b9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f7b9ab0 --- trap 0, rip = 0, rsp = 0xffffff881f7b9b70, rbp = 0 --- Tracing command kernel pid 0 tid 100091 td 0xfffffe00518e9490 sched_switch() at sched_switch+0x482/frame 0xffffff881f76a900 mi_switch() at mi_switch+0x179/frame 0xffffff881f76a940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881f76a980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881f76a9b0 _sleep() at _sleep+0x33d/frame 0xffffff881f76aa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881f76aa70 fork_exit() at fork_exit+0x84/frame 0xffffff881f76aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f76aab0 --- trap 0, rip = 0, rsp = 0xffffff881f76ab70, rbp = 0 --- Tracing command kernel pid 0 tid 100089 td 0xfffffe00518e2920 sched_switch() at sched_switch+0x482/frame 0xffffff881f760900 mi_switch() at mi_switch+0x179/frame 0xffffff881f760940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881f760980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881f7609b0 _sleep() at _sleep+0x33d/frame 0xffffff881f760a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881f760a70 fork_exit() at fork_exit+0x84/frame 0xffffff881f760ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f760ab0 --- trap 0, rip = 0, rsp = 0xffffff881f760b70, rbp = 0 --- Tracing command kernel pid 0 tid 100087 td 0xfffffe00518e3490 sched_switch() at sched_switch+0x482/frame 0xffffff881f756900 mi_switch() at mi_switch+0x179/frame 0xffffff881f756940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881f756980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881f7569b0 _sleep() at _sleep+0x33d/frame 0xffffff881f756a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881f756a70 fork_exit() at fork_exit+0x84/frame 0xffffff881f756ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f756ab0 --- trap 0, rip = 0, rsp = 0xffffff881f756b70, rbp = 0 --- Tracing command kernel pid 0 tid 100085 td 0xfffffe00518e0920 sched_switch() at sched_switch+0x482/frame 0xffffff881f74c900 mi_switch() at mi_switch+0x179/frame 0xffffff881f74c940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881f74c980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881f74c9b0 _sleep() at _sleep+0x33d/frame 0xffffff881f74ca40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881f74ca70 fork_exit() at fork_exit+0x84/frame 0xffffff881f74cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f74cab0 --- trap 0, rip = 0, rsp = 0xffffff881f74cb70, rbp = 0 --- Tracing command kernel pid 0 tid 100083 td 0xfffffe00518e1490 sched_switch() at sched_switch+0x482/frame 0xffffff881f742900 mi_switch() at mi_switch+0x179/frame 0xffffff881f742940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881f742980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881f7429b0 _sleep() at _sleep+0x33d/frame 0xffffff881f742a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881f742a70 fork_exit() at fork_exit+0x84/frame 0xffffff881f742ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f742ab0 --- trap 0, rip = 0, rsp = 0xffffff881f742b70, rbp = 0 --- Tracing command kernel pid 0 tid 100081 td 0xfffffe00518e2000 sched_switch() at sched_switch+0x482/frame 0xffffff881f738900 mi_switch() at mi_switch+0x179/frame 0xffffff881f738940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881f738980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881f7389b0 _sleep() at _sleep+0x33d/frame 0xffffff881f738a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881f738a70 fork_exit() at fork_exit+0x84/frame 0xffffff881f738ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f738ab0 --- trap 0, rip = 0, rsp = 0xffffff881f738b70, rbp = 0 --- Tracing command kernel pid 0 tid 100079 td 0xfffffe00518df490 sched_switch() at sched_switch+0x482/frame 0xffffff881f72e900 mi_switch() at mi_switch+0x179/frame 0xffffff881f72e940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881f72e980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881f72e9b0 _sleep() at _sleep+0x33d/frame 0xffffff881f72ea40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881f72ea70 fork_exit() at fork_exit+0x84/frame 0xffffff881f72eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f72eab0 --- trap 0, rip = 0, rsp = 0xffffff881f72eb70, rbp = 0 --- Tracing command kernel pid 0 tid 100077 td 0xfffffe00518e0000 sched_switch() at sched_switch+0x482/frame 0xffffff881f724900 mi_switch() at mi_switch+0x179/frame 0xffffff881f724940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881f724980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881f7249b0 _sleep() at _sleep+0x33d/frame 0xffffff881f724a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881f724a70 fork_exit() at fork_exit+0x84/frame 0xffffff881f724ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881f724ab0 --- trap 0, rip = 0, rsp = 0xffffff881f724b70, rbp = 0 --- Tracing command kernel pid 0 tid 100067 td 0xfffffe0050499920 sched_switch() at sched_switch+0x482/frame 0xffffff878ea69900 mi_switch() at mi_switch+0x179/frame 0xffffff878ea69940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff878ea69980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff878ea699b0 _sleep() at _sleep+0x33d/frame 0xffffff878ea69a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff878ea69a70 fork_exit() at fork_exit+0x84/frame 0xffffff878ea69ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ea69ab0 --- trap 0, rip = 0, rsp = 0xffffff878ea69b70, rbp = 0 --- Tracing command kernel pid 0 tid 100064 td 0xfffffe0050488490 sched_switch() at sched_switch+0x482/frame 0xffffff878ea5a900 mi_switch() at mi_switch+0x179/frame 0xffffff878ea5a940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff878ea5a980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff878ea5a9b0 _sleep() at _sleep+0x33d/frame 0xffffff878ea5aa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff878ea5aa70 fork_exit() at fork_exit+0x84/frame 0xffffff878ea5aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ea5aab0 --- trap 0, rip = 0, rsp = 0xffffff878ea5ab70, rbp = 0 --- Tracing command kernel pid 0 tid 100063 td 0xfffffe0050488920 sched_switch() at sched_switch+0x482/frame 0xffffff878ea55900 mi_switch() at mi_switch+0x179/frame 0xffffff878ea55940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff878ea55980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff878ea559b0 msleep_spin_sbt() at msleep_spin_sbt+0x200/frame 0xffffff878ea55a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x8d/frame 0xffffff878ea55a70 fork_exit() at fork_exit+0x84/frame 0xffffff878ea55ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ea55ab0 --- trap 0, rip = 0, rsp = 0xffffff878ea55b70, rbp = 0 --- Tracing command kernel pid 0 tid 100062 td 0xfffffe0050490000 sched_switch() at sched_switch+0x482/frame 0xffffff878ea50900 mi_switch() at mi_switch+0x179/frame 0xffffff878ea50940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff878ea50980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff878ea509b0 msleep_spin_sbt() at msleep_spin_sbt+0x200/frame 0xffffff878ea50a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x8d/frame 0xffffff878ea50a70 fork_exit() at fork_exit+0x84/frame 0xffffff878ea50ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ea50ab0 --- trap 0, rip = 0, rsp = 0xffffff878ea50b70, rbp = 0 --- Tracing command kernel pid 0 tid 100061 td 0xfffffe0050490490 sched_switch() at sched_switch+0x482/frame 0xffffff878ea4b900 mi_switch() at mi_switch+0x179/frame 0xffffff878ea4b940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff878ea4b980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff878ea4b9b0 msleep_spin_sbt() at msleep_spin_sbt+0x200/frame 0xffffff878ea4ba40 taskqueue_thread_loop() at taskqueue_thread_loop+0x8d/frame 0xffffff878ea4ba70 fork_exit() at fork_exit+0x84/frame 0xffffff878ea4bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ea4bab0 --- trap 0, rip = 0, rsp = 0xffffff878ea4bb70, rbp = 0 --- Tracing command kernel pid 0 tid 100058 td 0xfffffe00502fb000 sched_switch() at sched_switch+0x482/frame 0xffffff878ea3c900 mi_switch() at mi_switch+0x179/frame 0xffffff878ea3c940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff878ea3c980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff878ea3c9b0 _sleep() at _sleep+0x33d/frame 0xffffff878ea3ca40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff878ea3ca70 fork_exit() at fork_exit+0x84/frame 0xffffff878ea3cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ea3cab0 --- trap 0, rip = 0, rsp = 0xffffff878ea3cb70, rbp = 0 --- Tracing command kernel pid 0 tid 100056 td 0xfffffe00502fb920 sched_switch() at sched_switch+0x482/frame 0xffffff878ea31900 mi_switch() at mi_switch+0x179/frame 0xffffff878ea31940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff878ea31980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff878ea319b0 _sleep() at _sleep+0x33d/frame 0xffffff878ea31a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff878ea31a70 fork_exit() at fork_exit+0x84/frame 0xffffff878ea31ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ea31ab0 --- trap 0, rip = 0, rsp = 0xffffff878ea31b70, rbp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xffffffff815e1e80 sched_switch() at sched_switch+0x482/frame 0xffffffff819319c0 mi_switch() at mi_switch+0x179/frame 0xffffffff81931a00 sleepq_switch() at sleepq_switch+0x185/frame 0xffffffff81931a40 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xffffffff81931a70 _sleep() at _sleep+0x312/frame 0xffffffff81931b00 scheduler() at scheduler+0x261/frame 0xffffffff81931b50 mi_startup() at mi_startup+0x118/frame 0xffffffff81931b70 btext() at btext+0x2c db:0:allt> call doadump Dumping 2410 out of 31644 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% Dump complete = 0 db:0:doadump> reset cpu_reset: Restarting BSP cpu_reset_proxy: Stopped CPU 10 (kgdb) bt #0 doadump (textdump=0xd) at pcpu.h:236 #1 0xffffffff8033b315 in db_fncall (dummy1=, dummy2=, dummy3=, dummy4=) at ../../../ddb/db_command.c:578 #2 0xffffffff8033affd in db_command (cmd_table=) at ../../../ddb/db_command.c:449 #3 0xffffffff8033f25f in db_script_exec (scriptname=0xffffffff815dd310 "doadump", warnifnotfound=) at ../../../ddb/db_script.c:302 #4 0xffffffff8033affd in db_command (cmd_table=) at ../../../ddb/db_command.c:449 #5 0xffffffff8033ad74 in db_command_loop () at ../../../ddb/db_command.c:502 #6 0xffffffff8033d720 in db_trap (type=, code=0x0) at ../../../ddb/db_main.c:231 #7 0xffffffff808f32a3 in kdb_trap (type=0x3, code=0x0, tf=) at ../../../kern/subr_kdb.c:654 #8 0xffffffff80cb3dab in trap (frame=0xffffff8822279570) at ../../../amd64/amd64/trap.c:579 #9 0xffffffff80c9cd82 in calltrap () at ../../../amd64/amd64/exception.S:232 #10 0xffffffff808f2a7e in kdb_enter (why=0xffffffff80f7bd0b "panic", msg=) at cpufunc.h:63 #11 0xffffffff808bca46 in vpanic (fmt=, ap=) at ../../../kern/kern_shutdown.c:747 #12 0xffffffff808bc8f6 in kassert_panic (fmt=) at ../../../kern/kern_shutdown.c:642 #13 0xffffffff80b46f37 in vm_page_grab (object=0xfffffe06a7f820f0, pindex=0x0, allocflags=0x2a0) at ../../../vm/vm_page.c:2535 #14 0xffffffff8093e2d2 in kern_sendfile (td=0xfffffe03468f8000, uap=0xffffff8822279a40, hdr_uio=, trl_uio=0x0, compat=0x0) at ../../../kern/uipc_syscalls.c:2225 #15 0xffffffff8093d922 in do_sendfile (td=0xfffffe03468f8000, uap=0xffffff8822279a40, compat=0x0) at ../../../kern/uipc_syscalls.c:1922 #16 0xffffffff80cb4a12 in amd64_syscall (td=0xfffffe03468f8000, traced=0x0) at subr_syscall.c:134 #17 0xffffffff80c9d06b in Xfast_syscall () at ../../../amd64/amd64/exception.S:391 #18 0x0000000800aa783a in ?? () Previous frame inner to this frame (corrupt stack?) Current language: auto; currently minimal (kgdb) f 13 #13 0xffffffff80b46f37 in vm_page_grab (object=0xfffffe06a7f820f0, pindex=0x0, allocflags=0x2a0) at ../../../vm/vm_page.c:2535 2535 KASSERT((allocflags & VM_ALLOC_NOBUSY) == 0 || origwlock != 0, (kgdb) l 2530 2531 VM_OBJECT_ASSERT_LOCKED(object); 2532 origwlock = VM_OBJECT_WOWNED(object); 2533 KASSERT((allocflags & VM_ALLOC_RETRY) != 0, 2534 ("vm_page_grab: VM_ALLOC_RETRY is required")); 2535 KASSERT((allocflags & VM_ALLOC_NOBUSY) == 0 || origwlock != 0, 2536 ("vm_page_grab: VM_ALLOC_NOBUSY with object read lock")); 2537 retrylookup: 2538 if ((m = vm_page_lookup(object, pindex)) != NULL) { 2539 if (vm_page_sleep_if_busy(m, "pgrbwt", allocflags & (kgdb) info loc m = 0xffc origwlock = 0x0 (kgdb) p *object $1 = {lock = {lock_object = {lo_name = 0xffffffff80fbd696 "vm object", lo_flags = 0x5630000, lo_data = 0x0, lo_witness = 0xffffff80006bd780}, rw_lock = 0x11}, object_list = {tqe_next = 0xfffffe06cb5f5960, tqe_prev = 0xfffffe06a7f27110}, shadow_head = {lh_first = 0x0}, shadow_list = {le_next = 0xfffffe06cb5c6780, le_prev = 0xfffffe068f45d210}, memq = { tqh_first = 0xfffffe07f05e8b00, tqh_last = 0xfffffe07f05e8b10}, rtree = {rt_root = 0xfffffe07f05e8b01}, size = 0x1, generation = 0x1, ref_count = 0x1, shadow_count = 0x0, memattr = 0x6, type = 0x2, flags = 0x0, pg_color = 0x400, paging_in_progress = 0x0, resident_page_count = 0x1, backing_object = 0x0, backing_object_offset = 0x0, pager_object_list = { tqe_next = 0x0, tqe_prev = 0x0}, rvq = {lh_first = 0x0}, cache = {rt_root = 0x0}, handle = 0xfffffe0141cf0c30, un_pager = {vnp = { vnp_size = 0x1, writemappings = 0x0}, devp = {devp_pglist = {tqh_first = 0x1, tqh_last = 0x0}, ops = 0x0, dev = 0x0}, sgp = { sgp_pglist = {tqh_first = 0x1, tqh_last = 0x0}}, swp = {swp_tmpfs = 0x1, swp_bcount = 0x0}}, cred = 0x0, charge = 0x0} (kgdb) $ svn diff -x -p /var/tmp/vmobj-fullread/sys Index: /var/tmp/vmobj-fullread/sys/cddl/compat/opensolaris/kern/opensolaris_vm.c =================================================================== --- /var/tmp/vmobj-fullread/sys/cddl/compat/opensolaris/kern/opensolaris_vm.c (revision 253524) +++ /var/tmp/vmobj-fullread/sys/cddl/compat/opensolaris/kern/opensolaris_vm.c (working copy) @@ -42,6 +42,32 @@ const int zfs_vm_pagerret_error = VM_PAGER_ERROR; const int zfs_vm_pagerret_ok = VM_PAGER_OK; void +zfs_vmobject_assert_locked(vm_object_t object) +{ + + /* + * This is not ideal because FILE/LINE used by assertions will not + * be too helpful, but it must be an hard function for + * compatibility reasons. + */ + VM_OBJECT_ASSERT_LOCKED(object); +} + +void +zfs_vmobject_rlock(vm_object_t object) +{ + + VM_OBJECT_RLOCK(object); +} + +void +zfs_vmobject_runlock(vm_object_t object) +{ + + VM_OBJECT_RUNLOCK(object); +} + +void zfs_vmobject_assert_wlocked(vm_object_t object) { Index: /var/tmp/vmobj-fullread/sys/cddl/compat/opensolaris/sys/vm.h =================================================================== --- /var/tmp/vmobj-fullread/sys/cddl/compat/opensolaris/sys/vm.h (revision 253524) +++ /var/tmp/vmobj-fullread/sys/cddl/compat/opensolaris/sys/vm.h (working copy) @@ -35,6 +35,9 @@ extern const int zfs_vm_pagerret_bad; extern const int zfs_vm_pagerret_error; extern const int zfs_vm_pagerret_ok; +void zfs_vmobject_assert_locked(vm_object_t object); +void zfs_vmobject_rlock(vm_object_t object); +void zfs_vmobject_runlock(vm_object_t object); void zfs_vmobject_assert_wlocked(vm_object_t object); void zfs_vmobject_wlock(vm_object_t object); void zfs_vmobject_wunlock(vm_object_t object); Index: /var/tmp/vmobj-fullread/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vnops.c =================================================================== --- /var/tmp/vmobj-fullread/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vnops.c (revision 253524) +++ /var/tmp/vmobj-fullread/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vnops.c (working copy) @@ -331,15 +331,14 @@ page_busy(vnode_t *vp, int64_t start, int64_t off, vm_page_t pp; obj = vp->v_object; - zfs_vmobject_assert_wlocked(obj); + zfs_vmobject_assert_locked(obj); for (;;) { if ((pp = vm_page_lookup(obj, OFF_TO_IDX(start))) != NULL && pp->valid) { if (vm_page_sleep_if_busy(pp, "zfsmwb", - VM_ALLOC_NOBUSY, TRUE)) + VM_ALLOC_RBUSY, TRUE)) continue; - vm_page_busy_rlock(pp); } else if (pp == NULL) { if (!alloc) break; @@ -483,7 +482,7 @@ mappedread_sf(vnode_t *vp, int nbytes, uio_t *uio) ASSERT(obj != NULL); ASSERT((uio->uio_loffset & PAGEOFFSET) == 0); - zfs_vmobject_wlock(obj); + zfs_vmobject_rlock(obj); for (start = uio->uio_loffset; len > 0; start += PAGESIZE) { int bytes = MIN(PAGESIZE, len); @@ -490,7 +489,7 @@ mappedread_sf(vnode_t *vp, int nbytes, uio_t *uio) pp = vm_page_grab(obj, OFF_TO_IDX(start), VM_ALLOC_RBUSY | VM_ALLOC_NORMAL | VM_ALLOC_RETRY); if (pp->valid == 0) { - zfs_vmobject_wunlock(obj); + zfs_vmobject_runlock(obj); va = zfs_map_page(pp, &sf); error = dmu_read(os, zp->z_id, start, bytes, va, DMU_READ_PREFETCH); @@ -497,7 +496,7 @@ mappedread_sf(vnode_t *vp, int nbytes, uio_t *uio) if (bytes != PAGESIZE && error == 0) bzero(va + bytes, PAGESIZE - bytes); zfs_unmap_page(sf); - zfs_vmobject_wlock(obj); + zfs_vmobject_rlock(obj); vm_page_busy_runlock(pp); vm_page_lock(pp); if (error) { @@ -517,7 +516,7 @@ mappedread_sf(vnode_t *vp, int nbytes, uio_t *uio) uio->uio_offset += bytes; len -= bytes; } - zfs_vmobject_wunlock(obj); + zfs_vmobject_runlock(obj); return (error); } @@ -549,7 +548,7 @@ mappedread(vnode_t *vp, int nbytes, uio_t *uio) start = uio->uio_loffset; off = start & PAGEOFFSET; - zfs_vmobject_wlock(obj); + zfs_vmobject_rlock(obj); for (start &= PAGEMASK; len > 0; start += PAGESIZE) { vm_page_t pp; uint64_t bytes = MIN(PAGESIZE - off, len); @@ -558,16 +557,16 @@ mappedread(vnode_t *vp, int nbytes, uio_t *uio) struct sf_buf *sf; caddr_t va; - zfs_vmobject_wunlock(obj); + zfs_vmobject_runlock(obj); va = zfs_map_page(pp, &sf); error = uiomove(va + off, bytes, UIO_READ, uio); zfs_unmap_page(sf); - zfs_vmobject_wlock(obj); + zfs_vmobject_rlock(obj); page_unbusy(pp, FALSE); } else { - zfs_vmobject_wunlock(obj); + zfs_vmobject_runlock(obj); error = dmu_read_uio(os, zp->z_id, uio, bytes); - zfs_vmobject_wlock(obj); + zfs_vmobject_rlock(obj); } len -= bytes; off = 0; @@ -574,7 +573,7 @@ mappedread(vnode_t *vp, int nbytes, uio_t *uio) if (error) break; } - zfs_vmobject_wunlock(obj); + zfs_vmobject_runlock(obj); return (error); } Index: /var/tmp/vmobj-fullread/sys/dev/agp/agp.c =================================================================== --- /var/tmp/vmobj-fullread/sys/dev/agp/agp.c (revision 253524) +++ /var/tmp/vmobj-fullread/sys/dev/agp/agp.c (working copy) @@ -545,7 +545,7 @@ agp_generic_bind_memory(device_t dev, struct agp_m * because vm_page_grab() may sleep and we can't hold a mutex * while sleeping. */ - VM_OBJECT_WLOCK(mem->am_obj); + VM_OBJECT_RLOCK(mem->am_obj); for (i = 0; i < mem->am_size; i += PAGE_SIZE) { /* * Find a page from the object and wire it @@ -558,7 +558,7 @@ agp_generic_bind_memory(device_t dev, struct agp_m VM_ALLOC_WIRED | VM_ALLOC_ZERO | VM_ALLOC_RETRY); AGP_DPF("found page pa=%#jx\n", (uintmax_t)VM_PAGE_TO_PHYS(m)); } - VM_OBJECT_WUNLOCK(mem->am_obj); + VM_OBJECT_RUNLOCK(mem->am_obj); mtx_lock(&sc->as_lock); @@ -565,7 +565,7 @@ agp_generic_bind_memory(device_t dev, struct agp_m if (mem->am_is_bound) { device_printf(dev, "memory already bound\n"); error = EINVAL; - VM_OBJECT_WLOCK(mem->am_obj); + VM_OBJECT_RLOCK(mem->am_obj); i = 0; goto bad; } @@ -574,7 +574,7 @@ agp_generic_bind_memory(device_t dev, struct agp_m * Bind the individual pages and flush the chipset's * TLB. */ - VM_OBJECT_WLOCK(mem->am_obj); + VM_OBJECT_RLOCK(mem->am_obj); for (i = 0; i < mem->am_size; i += PAGE_SIZE) { m = vm_page_lookup(mem->am_obj, OFF_TO_IDX(i)); @@ -602,7 +602,7 @@ agp_generic_bind_memory(device_t dev, struct agp_m } vm_page_busy_wunlock(m); } - VM_OBJECT_WUNLOCK(mem->am_obj); + VM_OBJECT_RUNLOCK(mem->am_obj); /* * Flush the cpu cache since we are providing a new mapping @@ -623,7 +623,7 @@ agp_generic_bind_memory(device_t dev, struct agp_m return 0; bad: mtx_unlock(&sc->as_lock); - VM_OBJECT_ASSERT_WLOCKED(mem->am_obj); + VM_OBJECT_ASSERT_LOCKED(mem->am_obj); for (k = 0; k < mem->am_size; k += PAGE_SIZE) { m = vm_page_lookup(mem->am_obj, OFF_TO_IDX(k)); if (k >= i) @@ -632,7 +632,7 @@ bad: vm_page_unwire(m, 0); vm_page_unlock(m); } - VM_OBJECT_WUNLOCK(mem->am_obj); + VM_OBJECT_RUNLOCK(mem->am_obj); return error; } @@ -659,7 +659,7 @@ agp_generic_unbind_memory(device_t dev, struct agp */ for (i = 0; i < mem->am_size; i += AGP_PAGE_SIZE) AGP_UNBIND_PAGE(dev, mem->am_offset + i); - VM_OBJECT_WLOCK(mem->am_obj); + VM_OBJECT_RLOCK(mem->am_obj); for (i = 0; i < mem->am_size; i += PAGE_SIZE) { m = vm_page_lookup(mem->am_obj, atop(i)); vm_page_lock(m); @@ -666,7 +666,7 @@ agp_generic_unbind_memory(device_t dev, struct agp vm_page_unwire(m, 0); vm_page_unlock(m); } - VM_OBJECT_WUNLOCK(mem->am_obj); + VM_OBJECT_RUNLOCK(mem->am_obj); agp_flush_cache(); AGP_FLUSH_TLB(dev); Index: /var/tmp/vmobj-fullread/sys/dev/agp/agp_i810.c =================================================================== --- /var/tmp/vmobj-fullread/sys/dev/agp/agp_i810.c (revision 253524) +++ /var/tmp/vmobj-fullread/sys/dev/agp/agp_i810.c (working copy) @@ -2006,12 +2006,12 @@ agp_i810_free_memory(device_t dev, struct agp_memo /* * Unwire the page which we wired in alloc_memory. */ - VM_OBJECT_WLOCK(mem->am_obj); + VM_OBJECT_RLOCK(mem->am_obj); m = vm_page_lookup(mem->am_obj, 0); vm_page_lock(m); vm_page_unwire(m, 0); vm_page_unlock(m); - VM_OBJECT_WUNLOCK(mem->am_obj); + VM_OBJECT_RUNLOCK(mem->am_obj); } else { contigfree(sc->argb_cursor, mem->am_size, M_AGP); sc->argb_cursor = NULL; Index: /var/tmp/vmobj-fullread/sys/fs/tmpfs/tmpfs_vnops.c =================================================================== --- /var/tmp/vmobj-fullread/sys/fs/tmpfs/tmpfs_vnops.c (revision 253524) +++ /var/tmp/vmobj-fullread/sys/fs/tmpfs/tmpfs_vnops.c (working copy) @@ -445,7 +445,7 @@ tmpfs_nocacheread(vm_object_t tobj, vm_pindex_t id vm_page_t m; int error, rv; - VM_OBJECT_WLOCK(tobj); + VM_OBJECT_RLOCK(tobj); /* * Although the tmpfs vnode lock is held here, it is @@ -454,8 +454,17 @@ tmpfs_nocacheread(vm_object_t tobj, vm_pindex_t id * lock to page out tobj's pages because tobj is a OBJT_SWAP * type object. */ +retry: m = vm_page_grab(tobj, idx, VM_ALLOC_NORMAL | VM_ALLOC_RETRY); if (m->valid != VM_PAGE_BITS_ALL) { + if (!VM_OBJECT_LOCK_TRYUPGRADE(tobj)) { + VM_OBJECT_RUNLOCK(tobj); + VM_OBJECT_WLOCK(tobj); + vm_page_lock(m); + vm_page_free(m); + vm_page_unlock(m); + goto retry; + } if (vm_pager_has_page(tobj, idx, NULL, NULL)) { rv = vm_pager_get_pages(tobj, &m, 1, 0); m = vm_page_lookup(tobj, idx); @@ -480,11 +489,14 @@ tmpfs_nocacheread(vm_object_t tobj, vm_pindex_t id vm_page_zero_invalid(m, TRUE); } vm_page_busy_downgrade(m); - VM_OBJECT_WUNLOCK(tobj); + if (VM_OBJECT_WOWNED(tobj)) + VM_OBJECT_WUNLOCK(tobj); + else + VM_OBJECT_RUNLOCK(tobj); error = uiomove_fromphys(&m, offset, tlen, uio); - VM_OBJECT_WLOCK(tobj); + VM_OBJECT_RLOCK(tobj); vm_page_busy_runlock(m); - VM_OBJECT_WUNLOCK(tobj); + VM_OBJECT_RUNLOCK(tobj); vm_page_lock(m); if (m->queue == PQ_NONE) { vm_page_deactivate(m); @@ -567,9 +579,18 @@ tmpfs_mappedwrite(vm_object_t tobj, size_t len, st offset = addr & PAGE_MASK; tlen = MIN(PAGE_SIZE - offset, len); - VM_OBJECT_WLOCK(tobj); + VM_OBJECT_RLOCK(tobj); +retry: tpg = vm_page_grab(tobj, idx, VM_ALLOC_NORMAL | VM_ALLOC_RETRY); if (tpg->valid != VM_PAGE_BITS_ALL) { + if (!VM_OBJECT_LOCK_TRYUPGRADE(tobj)) { + VM_OBJECT_RUNLOCK(tobj); + VM_OBJECT_WLOCK(tobj); + vm_page_lock(tpg); + vm_page_free(tpg); + vm_page_unlock(tpg); + goto retry; + } if (vm_pager_has_page(tobj, idx, NULL, NULL)) { rv = vm_pager_get_pages(tobj, &tpg, 1, 0); tpg = vm_page_lookup(tobj, idx); @@ -594,7 +615,10 @@ tmpfs_mappedwrite(vm_object_t tobj, size_t len, st vm_page_zero_invalid(tpg, TRUE); } vm_page_busy_downgrade(tpg); - VM_OBJECT_WUNLOCK(tobj); + if (VM_OBJECT_WOWNED(tobj)) + VM_OBJECT_WUNLOCK(tobj); + else + VM_OBJECT_RUNLOCK(tobj); error = uiomove_fromphys(&tpg, offset, tlen, uio); VM_OBJECT_WLOCK(tobj); vm_page_busy_runlock(tpg); Index: /var/tmp/vmobj-fullread/sys/kern/subr_vmem.c =================================================================== --- /var/tmp/vmobj-fullread/sys/kern/subr_vmem.c (revision 253524) +++ /var/tmp/vmobj-fullread/sys/kern/subr_vmem.c (working copy) @@ -54,6 +54,7 @@ __FBSDID("$FreeBSD$"); #include #include #include +#include #include #include @@ -164,6 +165,9 @@ struct vmem_btag { #define BT_END(bt) ((bt)->bt_start + (bt)->bt_size - 1) #if defined(DIAGNOSTIC) +static int do_vmem_check = 1; +SYSCTL_INT(_debug, OID_AUTO, do_vmem_check, CTLFLAG_RW, + &do_vmem_check, 0, "Enable vmem check"); static void vmem_check(vmem_t *); #endif @@ -618,9 +622,11 @@ vmem_periodic(void *unused, int pending) LIST_FOREACH(vm, &vmem_list, vm_alllist) { #ifdef DIAGNOSTIC /* Convenient time to verify vmem state. */ - VMEM_LOCK(vm); - vmem_check(vm); - VMEM_UNLOCK(vm); + if (do_vmem_check == 1) { + VMEM_LOCK(vm); + vmem_check(vm); + VMEM_UNLOCK(vm); + } #endif desired = 1 << flsl(vm->vm_nbusytag); desired = MIN(MAX(desired, VMEM_HASHSIZE_MIN), Index: /var/tmp/vmobj-fullread/sys/kern/sys_process.c =================================================================== --- /var/tmp/vmobj-fullread/sys/kern/sys_process.c (revision 253524) +++ /var/tmp/vmobj-fullread/sys/kern/sys_process.c (working copy) @@ -316,9 +316,9 @@ proc_rwmem(struct proc *p, struct uio *uio) /* * Release the page. */ - VM_OBJECT_WLOCK(m->object); + VM_OBJECT_RLOCK(m->object); vm_page_busy_runlock(m); - VM_OBJECT_WUNLOCK(m->object); + VM_OBJECT_RUNLOCK(m->object); } while (error == 0 && uio->uio_resid > 0); Index: /var/tmp/vmobj-fullread/sys/kern/uipc_syscalls.c =================================================================== --- /var/tmp/vmobj-fullread/sys/kern/uipc_syscalls.c (revision 253524) +++ /var/tmp/vmobj-fullread/sys/kern/uipc_syscalls.c (working copy) @@ -2221,7 +2221,7 @@ retry_space: * if not found or wait and loop if busy. */ pindex = OFF_TO_IDX(off); - VM_OBJECT_WLOCK(obj); + VM_OBJECT_RLOCK(obj); pg = vm_page_grab(obj, pindex, VM_ALLOC_NOBUSY | VM_ALLOC_NORMAL | VM_ALLOC_WIRED | VM_ALLOC_RETRY); @@ -2233,7 +2233,7 @@ retry_space: * block. */ if (pg->valid && vm_page_is_valid(pg, pgoff, xfsize)) - VM_OBJECT_WUNLOCK(obj); + VM_OBJECT_RUNLOCK(obj); else if (m != NULL) error = EAGAIN; /* send what we already got */ else if (uap->flags & SF_NODISKIO) @@ -2241,7 +2241,7 @@ retry_space: else { ssize_t resid; - VM_OBJECT_WUNLOCK(obj); + VM_OBJECT_RUNLOCK(obj); /* * Get the page from backing store. Index: /var/tmp/vmobj-fullread/sys/kern/vfs_bio.c =================================================================== --- /var/tmp/vmobj-fullread/sys/kern/vfs_bio.c (revision 253524) +++ /var/tmp/vmobj-fullread/sys/kern/vfs_bio.c (working copy) @@ -3433,7 +3433,7 @@ allocbuf(struct buf *bp, int size) (bp->b_npages - desiredpages)); } else BUF_CHECK_UNMAPPED(bp); - VM_OBJECT_WLOCK(bp->b_bufobj->bo_object); + VM_OBJECT_RLOCK(bp->b_bufobj->bo_object); for (i = desiredpages; i < bp->b_npages; i++) { /* * the page is not freed here -- it @@ -3443,8 +3443,8 @@ allocbuf(struct buf *bp, int size) m = bp->b_pages[i]; KASSERT(m != bogus_page, ("allocbuf: bogus page found")); - while (vm_page_sleep_if_busy(m, - "biodep", VM_ALLOC_NOBUSY, FALSE)) + while (vm_page_sleep_if_busy(m, "biodep", 0, + FALSE)) continue; bp->b_pages[i] = NULL; @@ -3451,8 +3451,9 @@ allocbuf(struct buf *bp, int size) vm_page_lock(m); vm_page_unwire(m, 0); vm_page_unlock(m); + vm_page_busy_wunlock(m); } - VM_OBJECT_WUNLOCK(bp->b_bufobj->bo_object); + VM_OBJECT_RUNLOCK(bp->b_bufobj->bo_object); bp->b_npages = desiredpages; } } else if (size > bp->b_bcount) { @@ -3473,7 +3474,7 @@ allocbuf(struct buf *bp, int size) obj = bp->b_bufobj->bo_object; - VM_OBJECT_WLOCK(obj); + VM_OBJECT_RLOCK(obj); onpages = bp->b_npages; while (bp->b_npages < desiredpages) { vm_page_t m; @@ -3537,11 +3538,13 @@ allocbuf(struct buf *bp, int size) tinc = PAGE_SIZE; } while ((bp->b_npages - onpages) != 0) { + vm_page_t m; + m = bp->b_pages[onpages]; vm_page_busy_runlock(m); ++onpages; } - VM_OBJECT_WUNLOCK(obj); + VM_OBJECT_RUNLOCK(obj); /* * Step 3, fixup the KVM pmap. Index: /var/tmp/vmobj-fullread/sys/kern/vfs_cluster.c =================================================================== --- /var/tmp/vmobj-fullread/sys/kern/vfs_cluster.c (revision 253524) +++ /var/tmp/vmobj-fullread/sys/kern/vfs_cluster.c (working copy) @@ -414,13 +414,13 @@ cluster_rbuild(struct vnode *vp, u_quad_t filesize */ off = tbp->b_offset; tsize = size; - VM_OBJECT_WLOCK(tbp->b_bufobj->bo_object); + VM_OBJECT_RLOCK(tbp->b_bufobj->bo_object); for (j = 0; tsize > 0; j++) { toff = off & PAGE_MASK; tinc = tsize; if (toff + tinc > PAGE_SIZE) tinc = PAGE_SIZE - toff; - VM_OBJECT_ASSERT_WLOCKED(tbp->b_pages[j]->object); + VM_OBJECT_ASSERT_RLOCKED(tbp->b_pages[j]->object); if ((tbp->b_pages[j]->valid & vm_page_bits(toff, tinc)) != 0) break; @@ -427,7 +427,7 @@ cluster_rbuild(struct vnode *vp, u_quad_t filesize off += tinc; tsize -= tinc; } - VM_OBJECT_WUNLOCK(tbp->b_bufobj->bo_object); + VM_OBJECT_RUNLOCK(tbp->b_bufobj->bo_object); if (tsize > 0) { bqrelse(tbp); break; @@ -494,13 +494,13 @@ cluster_rbuild(struct vnode *vp, u_quad_t filesize * Fully valid pages in the cluster are already good and do not need * to be re-read from disk. Replace the page with bogus_page */ - VM_OBJECT_WLOCK(bp->b_bufobj->bo_object); + VM_OBJECT_RLOCK(bp->b_bufobj->bo_object); for (j = 0; j < bp->b_npages; j++) { - VM_OBJECT_ASSERT_WLOCKED(bp->b_pages[j]->object); + VM_OBJECT_ASSERT_RLOCKED(bp->b_pages[j]->object); if (bp->b_pages[j]->valid == VM_PAGE_BITS_ALL) bp->b_pages[j] = bogus_page; } - VM_OBJECT_WUNLOCK(bp->b_bufobj->bo_object); + VM_OBJECT_RUNLOCK(bp->b_bufobj->bo_object); if (bp->b_bufsize > bp->b_kvasize) panic("cluster_rbuild: b_bufsize(%ld) > b_kvasize(%d)\n", bp->b_bufsize, bp->b_kvasize); Index: /var/tmp/vmobj-fullread/sys/vm/vm_glue.c =================================================================== --- /var/tmp/vmobj-fullread/sys/vm/vm_glue.c (revision 253524) +++ /var/tmp/vmobj-fullread/sys/vm/vm_glue.c (working copy) @@ -239,10 +239,19 @@ vm_imgact_page_iostart(vm_object_t object, vm_ooff vm_pindex_t pindex; int rv; - VM_OBJECT_WLOCK(object); + VM_OBJECT_RLOCK(object); pindex = OFF_TO_IDX(offset); +retry: m = vm_page_grab(object, pindex, VM_ALLOC_NORMAL | VM_ALLOC_RETRY); if (m->valid != VM_PAGE_BITS_ALL) { + if (!VM_OBJECT_LOCK_TRYUPGRADE(object)) { + VM_OBJECT_RUNLOCK(object); + VM_OBJECT_WLOCK(object); + vm_page_lock(m); + vm_page_free(m); + vm_page_unlock(m); + goto retry; + } ma[0] = m; rv = vm_pager_get_pages(object, ma, 1, 0); m = vm_page_lookup(object, pindex); @@ -256,10 +265,12 @@ vm_imgact_page_iostart(vm_object_t object, vm_ooff goto out; } } - vm_page_busy_wunlock(m); - vm_page_busy_rlock(m); + vm_page_busy_downgrade(m); out: - VM_OBJECT_WUNLOCK(object); + if (VM_OBJECT_WOWNED(object)) + VM_OBJECT_WUNLOCK(object); + else + VM_OBJECT_RUNLOCK(object); return (m); } @@ -290,9 +301,9 @@ vm_imgact_unmap_page(vm_object_t object, struct sf m = sf_buf_page(sf); sf_buf_free(sf); sched_unpin(); - VM_OBJECT_WLOCK(object); + VM_OBJECT_RLOCK(object); vm_page_busy_runlock(m); - VM_OBJECT_WUNLOCK(object); + VM_OBJECT_RUNLOCK(object); } void @@ -504,7 +515,7 @@ vm_thread_swapout(struct thread *td) pages = td->td_kstack_pages; ksobj = td->td_kstack_obj; pmap_qremove(td->td_kstack, pages); - VM_OBJECT_WLOCK(ksobj); + VM_OBJECT_RLOCK(ksobj); for (i = 0; i < pages; i++) { m = vm_page_lookup(ksobj, i); if (m == NULL) @@ -514,7 +525,7 @@ vm_thread_swapout(struct thread *td) vm_page_unwire(m, 0); vm_page_unlock(m); } - VM_OBJECT_WUNLOCK(ksobj); + VM_OBJECT_RUNLOCK(ksobj); } /* Index: /var/tmp/vmobj-fullread/sys/vm/vm_kern.c =================================================================== --- /var/tmp/vmobj-fullread/sys/vm/vm_kern.c (revision 253524) +++ /var/tmp/vmobj-fullread/sys/vm/vm_kern.c (working copy) @@ -555,7 +555,7 @@ retry: /* * Loop thru pages, entering them in the pmap. */ - VM_OBJECT_WLOCK(kmem_object); + VM_OBJECT_RLOCK(kmem_object); for (i = 0; i < size; i += PAGE_SIZE) { m = vm_page_lookup(kmem_object, OFF_TO_IDX(offset + i)); /* @@ -565,7 +565,7 @@ retry: TRUE); vm_page_busy_wunlock(m); } - VM_OBJECT_WUNLOCK(kmem_object); + VM_OBJECT_RUNLOCK(kmem_object); return (KERN_SUCCESS); } Index: /var/tmp/vmobj-fullread/sys/vm/vm_object.c =================================================================== --- /var/tmp/vmobj-fullread/sys/vm/vm_object.c (revision 253524) +++ /var/tmp/vmobj-fullread/sys/vm/vm_object.c (working copy) @@ -1212,15 +1212,15 @@ vm_object_shadow( * Don't create the new object if the old object isn't shared. */ if (source != NULL) { - VM_OBJECT_WLOCK(source); + VM_OBJECT_RLOCK(source); if (source->ref_count == 1 && source->handle == NULL && (source->type == OBJT_DEFAULT || source->type == OBJT_SWAP)) { - VM_OBJECT_WUNLOCK(source); + VM_OBJECT_RUNLOCK(source); return; } - VM_OBJECT_WUNLOCK(source); + VM_OBJECT_RUNLOCK(source); } /* Index: /var/tmp/vmobj-fullread/sys/vm/vm_page.c =================================================================== --- /var/tmp/vmobj-fullread/sys/vm/vm_page.c (revision 253524) +++ /var/tmp/vmobj-fullread/sys/vm/vm_page.c (working copy) @@ -2528,7 +2528,7 @@ vm_page_grab(vm_object_t object, vm_pindex_t pinde vm_page_t m; int origwlock; - VM_OBJECT_ASSERT_WLOCKED(object); + VM_OBJECT_ASSERT_LOCKED(object); origwlock = VM_OBJECT_WOWNED(object); KASSERT((allocflags & VM_ALLOC_RETRY) != 0, ("vm_page_grab: VM_ALLOC_RETRY is required")); -- Test scenario: sendfile.sh