GENERIC HEAD from 2013-08-16 03:41:41 UTC, r254401M, vmcore.13 GDB: no debug ports present KDB: debugger backends: ddb KDB: current backend: ddb Copyright (c) 1992-2013 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 10.0-CURRENT #2 r254401M: Fri Aug 16 14:40:18 CEST 2013 pho@t1.osted.lan:/usr/src/sys/amd64/compile/PHO amd64 FreeBSD clang version 3.3 (tags/RELEASE_33/final 183502) 20130610 WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. CPU: Intel(R) Xeon(R) CPU E5-2620 0 @ 2.00GHz (1995.24-MHz K8-class CPU) Origin = "GenuineIntel" Id = 0x206d7 Family = 0x6 Model = 0x2d Stepping = 7 Features=0xbfebfbff Features2=0x1fbee3ff AMD Features=0x2c100800 AMD Features2=0x1 TSC: P-state invariant, performance statistics real memory = 68719476736 (65536 MB) avail memory = 32154877952 (30665 MB) : Trying to mount root from ufs:/dev/da0p2 [rw]... Setting hostuuid: 3141f787-07e3-e111-b968-001e6756c168. Setting hostid: 0x564ac5b6. Starting ddb. Entropy harvesting: interrupts ethernet point_to_point kickstart. Starting file system checks: /dev/da0p2: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/da0p2: clean, 89318876 free (98028 frags, 11152606 blocks, 0.1% fragmentation) /dev/da0p3: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/da0p3: clean, 24626877 free (1637 frags, 3078155 blocks, 0.0% fragmentation) Mounting local file systems:. Writing entropy file:. Setting hostname: t1.osted.lan. Starting Network: lo0 igb0 igb1. lo0: flags=8049 metric 0 mtu 16384 options=600003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x3 inet 127.0.0.1 netmask 0xff000000 nd6 options=21 igb0: flags=8843 metric 0 mtu 1500 options=401bb ether 00:1e:67:56:c1:68 inet 192.168.1.108 netmask 0xffffff00 broadcast 192.168.1.255 inet6 fe80::21e:67ff:fe56:c168%igb0 prefixlen 64 scopeid 0x1 nd6 options=29 media: Ethernet autoselect (100baseTX ) status: active igb1: flags=8c02 metric 0 mtu 1500 options=401bb ether 00:1e:67:56:c1:69 nd6 options=29 media: Ethernet autoselect status: no carrier Starting devd. Starting Network: igb1. igb1: flags=8c02 metric 0 mtu 1500 options=401bb ether 00:1e:67:56:c1:69 nd6 options=29 media: Ethernet autoselect status: no carrier Configuring keyboard: keymap. ums0: on usbus2 ums0: 3 buttons and [Z] coordinates ID=0 Starting ums0 moused. Expensive timeout(9) function: 0xffffffff80713480(0xffffffff8158d950) 0.006802879 s add net default: gateway 192.168.1.1 add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib 32-bit compatibility ldconfig path: /usr/lib32 Creating and/or trimming log files. Starting syslogd. No core dumps found. Starting rpcbind. NFS access cache time=60 rpc.umntall: 127.0.0.1: MOUNTPROG: RPC: Program not registered lock order reversal: 1st 0xffffff87860d9398 bufwait (bufwait) @ kern/vfs_bio.c:3054 2nd 0xfffffe008b6d3600 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:284 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xffffff881e07c300 kdb_backtrace() at kdb_backtrace+0x39/frame 0xffffff881e07c3b0 witness_checkorder() at witness_checkorder+0xd4f/frame 0xffffff881e07c440 _sx_xlock() at _sx_xlock+0x75/frame 0xffffff881e07c480 ufsdirhash_add() at ufsdirhash_add+0x4c/frame 0xffffff881e07c4c0 ufs_direnter() at ufs_direnter+0x688/frame 0xffffff881e07c580 ufs_mkdir() at ufs_mkdir+0x863/frame 0xffffff881e07c780 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x10e/frame 0xffffff881e07c7b0 kern_mkdirat() at kern_mkdirat+0x20e/frame 0xffffff881e07c9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e07cab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e07cab0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x800931e5a, rsp = 0x7fffffffd798, rbp = 0x7fffffffdc70 --- lock order reversal: 1st 0xfffffe0015db12d8 ufs (ufs) @ kern/vfs_subr.c:2153 2nd 0xffffff87860d9398 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:262 3rd 0xfffffe0015acf548 ufs (ufs) @ kern/vfs_subr.c:2153 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xffffff881e07bd30 kdb_backtrace() at kdb_backtrace+0x39/frame 0xffffff881e07bde0 witness_checkorder() at witness_checkorder+0xd4f/frame 0xffffff881e07be70 __lockmgr_args() at __lockmgr_args+0x6f2/frame 0xffffff881e07bfa0 ffs_lock() at ffs_lock+0x92/frame 0xffffff881e07bff0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xf5/frame 0xffffff881e07c020 _vn_lock() at _vn_lock+0xc6/frame 0xffffff881e07c090 vget() at vget+0xc9/frame 0xffffff881e07c0d0 vfs_hash_get() at vfs_hash_get+0xf5/frame 0xffffff881e07c120 ffs_vgetf() at ffs_vgetf+0x41/frame 0xffffff881e07c1b0 softdep_sync_buf() at softdep_sync_buf+0x2e4/frame 0xffffff881e07c260 ffs_syncvnode() at ffs_syncvnode+0x258/frame 0xffffff881e07c2e0 ffs_truncate() at ffs_truncate+0x5f3/frame 0xffffff881e07c4c0 ufs_direnter() at ufs_direnter+0x891/frame 0xffffff881e07c580 ufs_mkdir() at ufs_mkdir+0x863/frame 0xffffff881e07c780 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x10e/frame 0xffffff881e07c7b0 kern_mkdirat() at kern_mkdirat+0x20e/frame 0xffffff881e07c9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e07cab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e07cab0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x800931e5a, rsp = 0x7fffffffd798, rbp = 0x7fffffffdc70 --- Clearing /tmp (X related). Starting nfsuserd. Starting mountd. Starting nfsd. Updating motd:. Mounting late file systems:. Starting ntpd. Starting powerd. Configuring syscons: keymap blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting cron. Local package initialization: backup. Starting default mousedmoused: unable to open /dev/psm0: No such file or directory . Fri Aug 16 14:47:54 CEST 2013 FreeBSD/amd64 (t1.osted.lan) (console) login: Aug 16 14:52:44 t1 su: pho to root on /dev/pts/0 20130816 14:52:56 all (1/218): fullpath.sh 20130816 14:53:57 all (2/218): gbde.sh swap_pager: indefinite wait buffer: bufobj: 0, blkno: 18488, size: 4096 swap_pager: indefinite wait buffer: bufobj: 0, blkno: 18488, size: 4096 lock order reversal: 1st 0xfffffe00157a2068 ufs (ufs) @ kern/vfs_mount.c:1237 2nd 0xfffffe019d0a3068 devfs (devfs) @ ufs/ffs/ffs_softdep.c:1903 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xffffff881e61d3b0 kdb_backtrace() at kdb_backtrace+0x39/frame 0xffffff881e61d460 witness_checkorder() at witness_checkorder+0xd4f/frame 0xffffff881e61d4f0 __lockmgr_args() at __lockmgr_args+0x6f2/frame 0xffffff881e61d620 vop_stdlock() at vop_stdlock+0x3c/frame 0xffffff881e61d640 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xf5/frame 0xffffff881e61d670 _vn_lock() at _vn_lock+0xc6/frame 0xffffff881e61d6e0 softdep_flushworklist() at softdep_flushworklist+0x70/frame 0xffffff881e61d740 ffs_sync() at ffs_sync+0x29d/frame 0xffffff881e61d810 dounmount() at dounmount+0x360/frame 0xffffff881e61d890 sys_unmount() at sys_unmount+0x376/frame 0xffffff881e61d9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e61dab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e61dab0 --- syscall (22, FreeBSD ELF64, sys_unmount), rip = 0x800885dca, rsp = 0x7fffffffcf18, rbp = 0x7fffffffd030 --- 20130816 15:15:11 all (3/218): fdescfs.sh 20130816 15:15:26 all (4/218): linger3.sh 20130816 15:15:38 all (5/218): linger4.sh 20130816 15:35:00 all (6/218): sem.sh 20130816 15:35:16 all (7/218): suj12.sh GEOM_NOP: Device md5.nop created. GEOM_NOP: Device md5.nop removed. 20130816 16:03:49 all (8/218): namecache2.sh 20130816 16:05:41 all (9/218): tmpfs.sh 20130816 16:19:21 all (10/218): flock_open_close.sh lock order reversal: 1st 0xffffff8789391288 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:262 2nd 0xfffffe034bdab330 snaplk (snaplk) @ ufs/ffs/ffs_snapshot.c:2297 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xffffff881e69f240 kdb_backtrace() at kdb_backtrace+0x39/frame 0xffffff881e69f2f0 witness_checkorder() at witness_checkorder+0xd4f/frame 0xffffff881e69f380 __lockmgr_args() at __lockmgr_args+0x6f2/frame 0xffffff881e69f4b0 ffs_copyonwrite() at ffs_copyonwrite+0x17a/frame 0xffffff881e69f560 ffs_geom_strategy() at ffs_geom_strategy+0xdd/frame 0xffffff881e69f590 ufs_strategy() at ufs_strategy+0x8a/frame 0xffffff881e69f5c0 VOP_STRATEGY_APV() at VOP_STRATEGY_APV+0x119/frame 0xffffff881e69f5f0 bufstrategy() at bufstrategy+0x46/frame 0xffffff881e69f630 bufwrite() at bufwrite+0x170/frame 0xffffff881e69f680 ffs_syncvnode() at ffs_syncvnode+0x303/frame 0xffffff881e69f700 ffs_fsync() at ffs_fsync+0x20/frame 0xffffff881e69f730 VOP_FSYNC_APV() at VOP_FSYNC_APV+0x10e/frame 0xffffff881e69f760 ufs_remove() at ufs_remove+0xdc/frame 0xffffff881e69f7c0 VOP_REMOVE_APV() at VOP_REMOVE_APV+0x12d/frame 0xffffff881e69f7f0 kern_unlinkat() at kern_unlinkat+0x21c/frame 0xffffff881e69f9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e69fab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e69fab0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80093169a, rsp = 0x7fffffffd5c8, rbp = 0x7fffffffd660 --- lock order reversal: 1st 0xfffffe034bdab330 snaplk (snaplk) @ ufs/ufs/ufs_vnops.c:968 2nd 0xfffffe0436151a28 ufs (ufs) @ ufs/ffs/ffs_snapshot.c:1628 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xffffff881e69f1c0 kdb_backtrace() at kdb_backtrace+0x39/frame 0xffffff881e69f270 witness_checkorder() at witness_checkorder+0xd4f/frame 0xffffff881e69f300 __lockmgr_args() at __lockmgr_args+0x6f2/frame 0xffffff881e69f430 ffs_snapremove() at ffs_snapremove+0xfa/frame 0xffffff881e69f4a0 ffs_truncate() at ffs_truncate+0x27e/frame 0xffffff881e69f680 ufs_inactive() at ufs_inactive+0x171/frame 0xffffff881e69f6c0 VOP_INACTIVE_APV() at VOP_INACTIVE_APV+0x10e/frame 0xffffff881e69f6f0 VOP_INACTIVE() at VOP_INACTIVE+0x39/frame 0xffffff881e69f730 vinactive() at vinactive+0x174/frame 0xffffff881e69f770 vputx() at vputx+0x3b5/frame 0xffffff881e69f7d0 vput() at vput+0x1a/frame 0xffffff881e69f7f0 kern_unlinkat() at kern_unlinkat+0x256/frame 0xffffff881e69f9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e69fab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e69fab0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80093169a, rsp = 0x7fffffffd5c8, rbp = 0x7fffffffd660 --- 20130816 16:24:16 all (11/218): fpclone.sh 20130816 16:26:17 all (12/218): rename5.sh 20130816 16:26:46 all (13/218): libMicro.sh 20130816 16:26:46 all (14/218): nfs13.sh 20130816 16:26:47 all (15/218): quota1.sh 20130816 16:37:37 all (16/218): symlink2.sh 20130816 16:37:44 all (17/218): quota8.sh lock order reversal: 1st 0xfffffe07ae76e548 syncer (syncer) @ kern/vfs_subr.c:1745 2nd 0xfffffe043683f068 ufs (ufs) @ kern/vfs_subr.c:2153 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xffffff881de98400 kdb_backtrace() at kdb_backtrace+0x39/frame 0xffffff881de984b0 witness_checkorder() at witness_checkorder+0xd4f/frame 0xffffff881de98540 __lockmgr_args() at __lockmgr_args+0x6f2/frame 0xffffff881de98670 ffs_lock() at ffs_lock+0x92/frame 0xffffff881de986c0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xf5/frame 0xffffff881de986f0 _vn_lock() at _vn_lock+0xc6/frame 0xffffff881de98760 vget() at vget+0xc9/frame 0xffffff881de987a0 qsync() at qsync+0xe0/frame 0xffffff881de987e0 ffs_sync() at ffs_sync+0x4d0/frame 0xffffff881de988b0 sync_fsync() at sync_fsync+0x1a6/frame 0xffffff881de98900 VOP_FSYNC_APV() at VOP_FSYNC_APV+0x10e/frame 0xffffff881de98930 VOP_FSYNC() at VOP_FSYNC+0x42/frame 0xffffff881de98980 sync_vnode() at sync_vnode+0x17f/frame 0xffffff881de989e0 sched_sync() at sched_sync+0x2ef/frame 0xffffff881de98a70 fork_exit() at fork_exit+0x84/frame 0xffffff881de98ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881de98ab0 --- trap 0, rip = 0, rsp = 0xffffff881de98b70, rbp = 0 --- lock order reversal: 1st 0xfffffe01137d2c88 FFS (FFS Lock) @ ufs/ufs/ufs_quota.c:714 2nd 0xfffffe07bc1813c8 struct mount mtx (struct mount mtx) @ ufs/ufs/ufs_quota.c:720 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xffffff881e38a500 kdb_backtrace() at kdb_backtrace+0x39/frame 0xffffff881e38a5b0 witness_checkorder() at witness_checkorder+0xd4f/frame 0xffffff881e38a640 __mtx_lock_flags() at __mtx_lock_flags+0xa6/frame 0xffffff881e38a690 quotaoff_inchange() at quotaoff_inchange+0x83/frame 0xffffff881e38a6d0 ffs_flushfiles() at ffs_flushfiles+0x7e/frame 0xffffff881e38a740 softdep_flushfiles() at softdep_flushfiles+0x17f/frame 0xffffff881e38a7a0 ffs_unmount() at ffs_unmount+0x1a2/frame 0xffffff881e38a810 dounmount() at dounmount+0x39e/frame 0xffffff881e38a890 sys_unmount() at sys_unmount+0x376/frame 0xffffff881e38a9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e38aab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e38aab0 --- syscall (22, FreeBSD ELF64, sys_unmount), rip = 0x800885dca, rsp = 0x7fffffffceb8, rbp = 0x7fffffffcfd0 --- 20130816 16:43:53 all (18/218): fpu.sh 20130816 16:45:12 all (19/218): sendfile4.sh lock order reversal: 1st 0xfffffe008b69d1e8 so_snd_sx (so_snd_sx) @ kern/uipc_sockbuf.c:145 2nd 0xfffffe03cc861068 ufs (ufs) @ kern/uipc_syscalls.c:2192 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xffffff881e1c9390 kdb_backtrace() at kdb_backtrace+0x39/frame 0xffffff881e1c9440 witness_checkorder() at witness_checkorder+0xd4f/frame 0xffffff881e1c94d0 __lockmgr_args() at __lockmgr_args+0x456/frame 0xffffff881e1c9600 ffs_lock() at ffs_lock+0x92/frame 0xffffff881e1c9650 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xf5/frame 0xffffff881e1c9680 _vn_lock() at _vn_lock+0xc6/frame 0xffffff881e1c96f0 vn_sendfile() at vn_sendfile+0x738/frame 0xffffff881e1c9910 do_sendfile() at do_sendfile+0x116/frame 0xffffff881e1c99a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e1c9ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e1c9ab0 --- syscall (393, FreeBSD ELF64, sys_sendfile), rip = 0x80088288a, rsp = 0x7fffffffd668, rbp = 0x7fffffffd730 --- 20130816 16:45:13 all (20/218): graid3.sh GEOM_RAID3: Device raid3/data launched (3/3). GEOM_RAID3: Device data: provider raid3/data destroyed. GEOM_RAID3: Device data destroyed. 20130816 17:06:27 all (21/218): trim.sh ffs_fsync: dirty 0xfffffe0530f70000: tag ufs, type VDIR usecount 2, writecount 0, refcount 11 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffffe055bf3e900 ref 0 pages 50 lock type ufs: EXCL by thread 0xfffffe019d8be490 (pid 81718, symlink, tid 100290) #0 0xffffffff8089eda7 at __lockmgr_args+0x10b7 #1 0xffffffff80b12a62 at ffs_lock+0x92 #2 0xffffffff80d5d935 at VOP_LOCK1_APV+0xf5 #3 0xffffffff80976f26 at _vn_lock+0xc6 #4 0xffffffff80954ef7 at lookup+0x107 #5 0xffffffff80954aa4 at namei+0x4b4 #6 0xffffffff8097141b at kern_unlinkat+0xab #7 0xffffffff80cb2b62 at amd64_syscall+0x282 #8 0xffffffff80c9af2b at Xfast_syscall+0xfb ino 32772, on dev md5a 20130816 17:50:16 all (22/218): kinfo3.sh 20130816 18:05:23 all (23/218): msdos2.sh 20130816 18:05:24 all (24/218): rename10.sh lock order reversal: 1st 0xfffffe0772a472d8 tmpfs (tmpfs) @ kern/vfs_mount.c:851 2nd 0xfffffe04970b12d8 ufs (ufs) @ ufs/ffs/ffs_vfsops.c:1710 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xffffff881e1c4370 kdb_backtrace() at kdb_backtrace+0x39/frame 0xffffff881e1c4420 witness_checkorder() at witness_checkorder+0xd4f/frame 0xffffff881e1c44b0 __lockmgr_args() at __lockmgr_args+0x6f2/frame 0xffffff881e1c45e0 ffs_vgetf() at ffs_vgetf+0x143/frame 0xffffff881e1c4670 ufs_root() at ufs_root+0x4b/frame 0xffffff881e1c46b0 vfs_donmount() at vfs_donmount+0x11b5/frame 0xffffff881e1c4960 sys_nmount() at sys_nmount+0x72/frame 0xffffff881e1c49a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e1c4ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e1c4ab0 --- syscall (378, FreeBSD ELF64, sys_nmount), rip = 0x800a989ca, rsp = 0x7fffffffc718, rbp = 0x7fffffffcc80 --- lock order reversal: 1st 0xfffffe0772a472d8 tmpfs (tmpfs) @ kern/vfs_mount.c:1237 2nd 0xfffffe0229ac7a28 devfs (devfs) @ ufs/ffs/ffs_vfsops.c:1411 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xffffff881e1c43a0 kdb_backtrace() at kdb_backtrace+0x39/frame 0xffffff881e1c4450 witness_checkorder() at witness_checkorder+0xd4f/frame 0xffffff881e1c44e0 __lockmgr_args() at __lockmgr_args+0x6f2/frame 0xffffff881e1c4610 vop_stdlock() at vop_stdlock+0x3c/frame 0xffffff881e1c4630 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xf5/frame 0xffffff881e1c4660 _vn_lock() at _vn_lock+0xc6/frame 0xffffff881e1c46d0 ffs_flushfiles() at ffs_flushfiles+0x123/frame 0xffffff881e1c4740 softdep_flushfiles() at softdep_flushfiles+0x17f/frame 0xffffff881e1c47a0 ffs_unmount() at ffs_unmount+0x1a2/frame 0xffffff881e1c4810 dounmount() at dounmount+0x39e/frame 0xffffff881e1c4890 sys_unmount() at sys_unmount+0x376/frame 0xffffff881e1c49a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e1c4ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e1c4ab0 --- syscall (22, FreeBSD ELF64, sys_unmount), rip = 0x800885dca, rsp = 0x7fffffffcf08, rbp = 0x7fffffffd020 --- 20130816 18:06:33 all (25/218): alternativeFlushPath.sh 20130816 18:27:05 all (26/218): nullfs7.sh 20130816 18:27:09 all (27/218): suj13.sh Expensive timeout(9) function: 0xffffffff80b2fd60(0) 0.031062829 s Expensive timeout(9) function: 0xffffffff80b2fd60(0) 0.112695759 s 20130816 18:48:41 all (28/218): nullfs15.sh 20130816 18:48:42 all (29/218): fuse.sh fuse-freebsd: version 0.4.4, FUSE ABI 7.8 20130816 18:48:42 all (30/218): quota4.sh 20130816 18:50:01 all (31/218): lockf.sh 20130816 18:50:09 all (32/218): rot.sh 20130816 19:19:42 all (33/218): syscall5.sh 20130816 19:50:07 all (34/218): quota5.sh 20130816 19:50:07 all (35/218): truncate.sh 20130816 20:19:08 all (36/218): procfs4.sh 20130816 20:27:38 all (37/218): mac_chkexec.sh 20130816 20:27:43 all (38/218): nfs5.sh 20130816 20:29:04 all (39/218): jail4.sh 20130816 20:29:04 all (40/218): zfs3.sh ZFS filesystem version: 5 ZFS storage pool version: features support (5000) 20130816 21:00:54 all (41/218): fs.sh lock order reversal: 1st 0xfffffe0784026838 ufs_extattr_sx (ufs_extattr_sx) @ ufs/ufs/ufs_extattr.c:114 2nd 0xfffffe0681b6a548 ufs (ufs) @ ufs/ffs/ffs_vfsops.c:1710 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xffffff881e4040e0 kdb_backtrace() at kdb_backtrace+0x39/frame 0xffffff881e404190 witness_checkorder() at witness_checkorder+0xd4f/frame 0xffffff881e404220 __lockmgr_args() at __lockmgr_args+0x6f2/frame 0xffffff881e404350 ffs_vgetf() at ffs_vgetf+0x143/frame 0xffffff881e4043e0 ufs_root() at ufs_root+0x4b/frame 0xffffff881e404420 ufs_extattr_autostart() at ufs_extattr_autostart+0x79/frame 0xffffff881e404480 ffs_mount() at ffs_mount+0x1e98/frame 0xffffff881e4046b0 vfs_donmount() at vfs_donmount+0xc84/frame 0xffffff881e404960 sys_nmount() at sys_nmount+0x72/frame 0xffffff881e4049a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e404ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e404ab0 --- syscall (378, FreeBSD ELF64, sys_nmount), rip = 0x800a989ca, rsp = 0x7fffffffc728, rbp = 0x7fffffffcc90 --- Aug 16 21:12:55 t1 kernel: pid 93472 (rw), uid 1002 inumber 1922 on /mnt: filesystem full Aug 16 21:12:55 t1 kernel: pid 93495 (rw), uid 1002 inumber 647 on /mnt: filesystem full Aug 16 21:13:20 t1 kernel: pid 93497 (rw), uid 1002 inumber 249 on /mnt: filesystem full Aug 16 21:14:56 t1 kernel: pid 93555 (rw), uid 1002 inumber 644 on /mnt: filesystem full Aug 16 21:20:56 t1 kernel: pid 93736 (rw), uid 1002 inumber 1287 on /mnt: filesystem full Aug 16 21:21:47 t1 kernel: pid 93732 (creat), uid 1002 inumber 1930 on /mnt: out of inodes Aug 16 21:22:13 t1 kernel: pid 93748 (creat), uid 1002 inumber 648 on /mnt: out of inodes Aug 16 21:23:10 t1 kernel: pid 93818 (creat), uid 1002 inumber 1283 on /mnt: out of inodes Aug 16 21:23:35 t1 kernel: pid 93827 (creat), uid 1002 inumber 1963 on /mnt: out of inodes Aug 16 21:24:22 t1 kernel: pid 93802 (creat), uid 1002 inumber 1939 on /mnt: out of inodes Aug 16 21:24:29 t1 kernel: pid 93818 (creat), uid 1002 inumber 1283 on /mnt: out of inodes Aug 16 21:24:42 t1 kernel: pid 93828 (creat), uid 1002 inumber 1964 on /mnt: out of inodes Aug 16 21:24:44 t1 kernel: pid 93826 (creat), uid 1002 inumber 1962 on /mnt: out of inodes Aug 16 21:24:48 t1 kernel: pid 93802 (creat), uid 1002 inumber 1939 on /mnt: out of inodes Aug 16 21:29:07 t1 kernel: pid 94016 (mkdir), uid 1002 inumber 627 on /mnt: out of inodes Aug 16 21:29:08 t1 kernel: pid 94025 (creat), uid 1002 inumber 640 on /mnt: out of inodes Aug 16 21:29:15 t1 kernel: pid 94039 (creat), uid 1002 inumber 1287 on /mnt: out of inodes Aug 16 21:29:21 t1 kernel: pid 94037 (creat), uid 1002 inumber 642 on /mnt: out of inodes Aug 16 21:29:23 t1 kernel: pid 94019 (creat), uid 1002 inumber 1928 on /mnt: out of inodes Aug 16 21:29:24 t1 kernel: pid 94025 (creat), uid 1002 inumber 640 on /mnt: out of inodes Aug 16 21:29:28 t1 kernel: pid 94040 (creat), uid 1002 inumber 644 on /mnt: out of inodes Aug 16 21:29:35 t1 kernel: pid 94036 (mkdir), uid 1002 inumber 2419 on /mnt: out of inodes Aug 16 21:29:49 t1 kernel: pid 94027 (creat), uid 1002 inumber 641 on /mnt: out of inodes Aug 16 21:29:55 t1 kernel: pid 94043 (creat), uid 1002 inumber 1288 on /mnt: out of inodes Aug 16 21:30:03 t1 kernel: pid 94021 (creat), uid 1002 inumber 1281 on /mnt: out of inodes Aug 16 21:30:22 t1 kernel: pid 94031 (creat), uid 1002 inumber 1284 on /mnt: out of inodes Aug 16 21:30:40 t1 kernel: pid 94039 (creat), uid 1002 inumber 1287 on /mnt: out of inodes Aug 16 21:30:43 t1 kernel: pid 94041 (creat), uid 1002 inumber 645 on /mnt: out of inodes Aug 16 21:30:49 t1 kernel: pid 94039 (creat), uid 1002 inumber 1287 on /mnt: out of inodes Aug 16 21:30:52 t1 kernel: pid 94040 (creat), uid 1002 inumber 644 on /mnt: out of inodes Aug 16 21:31:55 t1 kernel: pid 94306 (creat), uid 1002 inumber 2016 on /mnt: out of inodes Aug 16 21:32:36 t1 kernel: pid 94267 (creat), uid 1002 inumber 1938 on /mnt: out of inodes Aug 16 21:32:53 t1 kernel: pid 94305 (creat), uid 1002 inumber 2013 on /mnt: out of inodes 20130816 21:33:01 all (42/218): rename3.sh panic: deadlkres: possible deadlock detected for 0xfffffe043ed5d920, blocked for 1802212 ticks cpuid = 23 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xffffff881dcac8d0 kdb_backtrace() at kdb_backtrace+0x39/frame 0xffffff881dcac980 vpanic() at vpanic+0x126/frame 0xffffff881dcac9c0 panic() at panic+0x43/frame 0xffffff881dcaca20 deadlkres() at deadlkres+0x37f/frame 0xffffff881dcaca70 fork_exit() at fork_exit+0x84/frame 0xffffff881dcacab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881dcacab0 --- trap 0, rip = 0, rsp = 0xffffff881dcacb70, rbp = 0 --- KDB: enter: panic [ thread pid 0 tid 100124 ] Stopped at kdb_enter+0x3e: movq $0,kdb_why db> run pho db:0:pho> bt Tracing pid 0 tid 100124 td 0xfffffe000c9e1490 kdb_enter() at kdb_enter+0x3e/frame 0xffffff881dcac980 vpanic() at vpanic+0x146/frame 0xffffff881dcac9c0 panic() at panic+0x43/frame 0xffffff881dcaca20 deadlkres() at deadlkres+0x37f/frame 0xffffff881dcaca70 fork_exit() at fork_exit+0x84/frame 0xffffff881dcacab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881dcacab0 --- trap 0, rip = 0, rsp = 0xffffff881dcacb70, rbp = 0 --- db:0:bt> show allpcpu Current CPU: 23 cpuid = 0 dynamic pcpu = 0x558200 curthread = 0xfffffe000b21b920: pid 11 "idle: cpu0" curpcb = 0xffffff87fc5fcb80 fpcurthread = none idlethread = 0xfffffe000b21b920: tid 100003 "idle: cpu0" curpmap = 0xffffffff815d0b88 tssp = 0xffffffff815e8090 commontssp = 0xffffffff815e8090 rsp0 = 0xffffff87fc5fcb80 gs32p = 0xffffffff815e9ae8 ldt = 0xffffffff815e9b28 tss = 0xffffffff815e9b18 spin locks held: cpuid = 1 dynamic pcpu = 0xffffff887b20d200 curthread = 0xfffffe000b21b490: pid 11 "idle: cpu1" curpcb = 0xffffff878ac2cb80 fpcurthread = none idlethread = 0xfffffe000b21b490: tid 100004 "idle: cpu1" curpmap = 0xffffffff815d0b88 tssp = 0xffffffff815e80f8 commontssp = 0xffffffff815e80f8 rsp0 = 0xffffff878ac2cb80 gs32p = 0xffffffff815e9b50 ldt = 0xffffffff815e9b90 tss = 0xffffffff815e9b80 spin locks held: cpuid = 2 dynamic pcpu = 0xffffff887b214200 curthread = 0xfffffe000b21b000: pid 11 "idle: cpu2" curpcb = 0xffffff878ac31b80 fpcurthread = none idlethread = 0xfffffe000b21b000: tid 100005 "idle: cpu2" curpmap = 0xffffffff815d0b88 tssp = 0xffffffff815e8160 commontssp = 0xffffffff815e8160 rsp0 = 0xffffff878ac31b80 gs32p = 0xffffffff815e9bb8 ldt = 0xffffffff815e9bf8 tss = 0xffffffff815e9be8 spin locks held: cpuid = 3 dynamic pcpu = 0xffffff887b21b200 curthread = 0xfffffe000b22d000: pid 11 "idle: cpu3" curpcb = 0xffffff878ac36b80 fpcurthread = none idlethread = 0xfffffe000b22d000: tid 100006 "idle: cpu3" curpmap = 0xffffffff815d0b88 tssp = 0xffffffff815e81c8 commontssp = 0xffffffff815e81c8 rsp0 = 0xffffff878ac36b80 gs32p = 0xffffffff815e9c20 ldt = 0xffffffff815e9c60 tss = 0xffffffff815e9c50 spin locks held: cpuid = 4 dynamic pcpu = 0xffffff887b222200 curthread = 0xfffffe000b22c920: pid 11 "idle: cpu4" curpcb = 0xffffff878ac3bb80 fpcurthread = none idlethread = 0xfffffe000b22c920: tid 100007 "idle: cpu4" curpmap = 0xffffffff815d0b88 tssp = 0xffffffff815e8230 commontssp = 0xffffffff815e8230 rsp0 = 0xffffff878ac3bb80 gs32p = 0xffffffff815e9c88 ldt = 0xffffffff815e9cc8 tss = 0xffffffff815e9cb8 spin locks held: cpuid = 5 dynamic pcpu = 0xffffff887b229200 curthread = 0xfffffe000b22c490: pid 11 "idle: cpu5" curpcb = 0xffffff878ac40b80 fpcurthread = none idlethread = 0xfffffe000b22c490: tid 100008 "idle: cpu5" curpmap = 0xffffffff815d0b88 tssp = 0xffffffff815e8298 commontssp = 0xffffffff815e8298 rsp0 = 0xffffff878ac40b80 gs32p = 0xffffffff815e9cf0 ldt = 0xffffffff815e9d30 tss = 0xffffffff815e9d20 spin locks held: cpuid = 6 dynamic pcpu = 0xffffff887b230200 curthread = 0xfffffe000b22c000: pid 11 "idle: cpu6" curpcb = 0xffffff878ac45b80 fpcurthread = none idlethread = 0xfffffe000b22c000: tid 100009 "idle: cpu6" curpmap = 0xffffffff815d0b88 tssp = 0xffffffff815e8300 commontssp = 0xffffffff815e8300 rsp0 = 0xffffff878ac45b80 gs32p = 0xffffffff815e9d58 ldt = 0xffffffff815e9d98 tss = 0xffffffff815e9d88 spin locks held: cpuid = 7 dynamic pcpu = 0xffffff887b237200 curthread = 0xfffffe000b21c920: pid 11 "idle: cpu7" curpcb = 0xffffff878ac4ab80 fpcurthread = none idlethread = 0xfffffe000b21c920: tid 100010 "idle: cpu7" curpmap = 0xffffffff815d0b88 tssp = 0xffffffff815e8368 commontssp = 0xffffffff815e8368 rsp0 = 0xffffff878ac4ab80 gs32p = 0xffffffff815e9dc0 ldt = 0xffffffff815e9e00 tss = 0xffffffff815e9df0 spin locks held: cpuid = 8 dynamic pcpu = 0xffffff887b23e200 curthread = 0xfffffe000b22e920: pid 11 "idle: cpu8" curpcb = 0xffffff878ac4fb80 fpcurthread = none idlethread = 0xfffffe000b22e920: tid 100011 "idle: cpu8" curpmap = 0xffffffff815d0b88 tssp = 0xffffffff815e83d0 commontssp = 0xffffffff815e83d0 rsp0 = 0xffffff878ac4fb80 gs32p = 0xffffffff815e9e28 ldt = 0xffffffff815e9e68 tss = 0xffffffff815e9e58 spin locks held: cpuid = 9 dynamic pcpu = 0xffffff887b245200 curthread = 0xfffffe000b22e490: pid 11 "idle: cpu9" curpcb = 0xffffff878ac54b80 fpcurthread = none idlethread = 0xfffffe000b22e490: tid 100012 "idle: cpu9" curpmap = 0xffffffff815d0b88 tssp = 0xffffffff815e8438 commontssp = 0xffffffff815e8438 rsp0 = 0xffffff878ac54b80 gs32p = 0xffffffff815e9e90 ldt = 0xffffffff815e9ed0 tss = 0xffffffff815e9ec0 spin locks held: cpuid = 10 dynamic pcpu = 0xffffff887b24c200 curthread = 0xfffffe000b22e000: pid 11 "idle: cpu10" curpcb = 0xffffff878ac59b80 fpcurthread = none idlethread = 0xfffffe000b22e000: tid 100013 "idle: cpu10" curpmap = 0xffffffff815d0b88 tssp = 0xffffffff815e84a0 commontssp = 0xffffffff815e84a0 rsp0 = 0xffffff878ac59b80 gs32p = 0xffffffff815e9ef8 ldt = 0xffffffff815e9f38 tss = 0xffffffff815e9f28 spin locks held: cpuid = 11 dynamic pcpu = 0xffffff887b253200 curthread = 0xfffffe000b22d920: pid 11 "idle: cpu11" curpcb = 0xffffff878ac5eb80 fpcurthread = none idlethread = 0xfffffe000b22d920: tid 100014 "idle: cpu11" curpmap = 0xffffffff815d0b88 tssp = 0xffffffff815e8508 commontssp = 0xffffffff815e8508 rsp0 = 0xffffff878ac5eb80 gs32p = 0xffffffff815e9f60 ldt = 0xffffffff815e9fa0 tss = 0xffffffff815e9f90 spin locks held: cpuid = 12 dynamic pcpu = 0xffffff887b25a200 curthread = 0xfffffe000b22d490: pid 11 "idle: cpu12" curpcb = 0xffffff878ac63b80 fpcurthread = none idlethread = 0xfffffe000b22d490: tid 100015 "idle: cpu12" curpmap = 0xffffffff815d0b88 tssp = 0xffffffff815e8570 commontssp = 0xffffffff815e8570 rsp0 = 0xffffff878ac63b80 gs32p = 0xffffffff815e9fc8 ldt = 0xffffffff815ea008 tss = 0xffffffff815e9ff8 spin locks held: cpuid = 13 dynamic pcpu = 0xffffff887b261200 curthread = 0xfffffe000b230490: pid 11 "idle: cpu13" curpcb = 0xffffff878ac68b80 fpcurthread = none idlethread = 0xfffffe000b230490: tid 100016 "idle: cpu13" curpmap = 0xffffffff815d0b88 tssp = 0xffffffff815e85d8 commontssp = 0xffffffff815e85d8 rsp0 = 0xffffff878ac68b80 gs32p = 0xffffffff815ea030 ldt = 0xffffffff815ea070 tss = 0xffffffff815ea060 spin locks held: cpuid = 14 dynamic pcpu = 0xffffff887b268200 curthread = 0xfffffe000b230000: pid 11 "idle: cpu14" curpcb = 0xffffff878ac6db80 fpcurthread = none idlethread = 0xfffffe000b230000: tid 100017 "idle: cpu14" curpmap = 0xffffffff815d0b88 tssp = 0xffffffff815e8640 commontssp = 0xffffffff815e8640 rsp0 = 0xffffff878ac6db80 gs32p = 0xffffffff815ea098 ldt = 0xffffffff815ea0d8 tss = 0xffffffff815ea0c8 spin locks held: cpuid = 15 dynamic pcpu = 0xffffff887b26f200 curthread = 0xfffffe000b22f920: pid 11 "idle: cpu15" curpcb = 0xffffff878ac72b80 fpcurthread = none idlethread = 0xfffffe000b22f920: tid 100018 "idle: cpu15" curpmap = 0xffffffff815d0b88 tssp = 0xffffffff815e86a8 commontssp = 0xffffffff815e86a8 rsp0 = 0xffffff878ac72b80 gs32p = 0xffffffff815ea100 ldt = 0xffffffff815ea140 tss = 0xffffffff815ea130 spin locks held: cpuid = 16 dynamic pcpu = 0xffffff887b276200 curthread = 0xfffffe000b22f490: pid 11 "idle: cpu16" curpcb = 0xffffff878ac77b80 fpcurthread = none idlethread = 0xfffffe000b22f490: tid 100019 "idle: cpu16" curpmap = 0xffffffff815d0b88 tssp = 0xffffffff815e8710 commontssp = 0xffffffff815e8710 rsp0 = 0xffffff878ac77b80 gs32p = 0xffffffff815ea168 ldt = 0xffffffff815ea1a8 tss = 0xffffffff815ea198 spin locks held: cpuid = 17 dynamic pcpu = 0xffffff887b27d200 curthread = 0xfffffe000b22f000: pid 11 "idle: cpu17" curpcb = 0xffffff878ac7cb80 fpcurthread = none idlethread = 0xfffffe000b22f000: tid 100020 "idle: cpu17" curpmap = 0xffffffff815d0b88 tssp = 0xffffffff815e8778 commontssp = 0xffffffff815e8778 rsp0 = 0xffffff878ac7cb80 gs32p = 0xffffffff815ea1d0 ldt = 0xffffffff815ea210 tss = 0xffffffff815ea200 spin locks held: cpuid = 18 dynamic pcpu = 0xffffff887b284200 curthread = 0xfffffe000b232000: pid 11 "idle: cpu18" curpcb = 0xffffff878ac81b80 fpcurthread = none idlethread = 0xfffffe000b232000: tid 100021 "idle: cpu18" curpmap = 0xffffffff815d0b88 tssp = 0xffffffff815e87e0 commontssp = 0xffffffff815e87e0 rsp0 = 0xffffff878ac81b80 gs32p = 0xffffffff815ea238 ldt = 0xffffffff815ea278 tss = 0xffffffff815ea268 spin locks held: cpuid = 19 dynamic pcpu = 0xffffff887b28b200 curthread = 0xfffffe000b231920: pid 11 "idle: cpu19" curpcb = 0xffffff878ac86b80 fpcurthread = none idlethread = 0xfffffe000b231920: tid 100022 "idle: cpu19" curpmap = 0xffffffff815d0b88 tssp = 0xffffffff815e8848 commontssp = 0xffffffff815e8848 rsp0 = 0xffffff878ac86b80 gs32p = 0xffffffff815ea2a0 ldt = 0xffffffff815ea2e0 tss = 0xffffffff815ea2d0 spin locks held: cpuid = 20 dynamic pcpu = 0xffffff887b292200 curthread = 0xfffffe000b231490: pid 11 "idle: cpu20" curpcb = 0xffffff878ac8bb80 fpcurthread = none idlethread = 0xfffffe000b231490: tid 100023 "idle: cpu20" curpmap = 0xffffffff815d0b88 tssp = 0xffffffff815e88b0 commontssp = 0xffffffff815e88b0 rsp0 = 0xffffff878ac8bb80 gs32p = 0xffffffff815ea308 ldt = 0xffffffff815ea348 tss = 0xffffffff815ea338 spin locks held: cpuid = 21 dynamic pcpu = 0xffffff887b299200 curthread = 0xfffffe000b231000: pid 11 "idle: cpu21" curpcb = 0xffffff878ac90b80 fpcurthread = none idlethread = 0xfffffe000b231000: tid 100024 "idle: cpu21" curpmap = 0xffffffff815d0b88 tssp = 0xffffffff815e8918 commontssp = 0xffffffff815e8918 rsp0 = 0xffffff878ac90b80 gs32p = 0xffffffff815ea370 ldt = 0xffffffff815ea3b0 tss = 0xffffffff815ea3a0 spin locks held: cpuid = 22 dynamic pcpu = 0xffffff887b2a0200 curthread = 0xfffffe000b230920: pid 11 "idle: cpu22" curpcb = 0xffffff878ac95b80 fpcurthread = none idlethread = 0xfffffe000b230920: tid 100025 "idle: cpu22" curpmap = 0xffffffff815d0b88 tssp = 0xffffffff815e8980 commontssp = 0xffffffff815e8980 rsp0 = 0xffffff878ac95b80 gs32p = 0xffffffff815ea3d8 ldt = 0xffffffff815ea418 tss = 0xffffffff815ea408 spin locks held: cpuid = 23 dynamic pcpu = 0xffffff887b2a7200 curthread = 0xfffffe000c9e1490: pid 0 "deadlkres" curpcb = 0xffffff881dcacb80 fpcurthread = none idlethread = 0xfffffe000b233920: tid 100026 "idle: cpu23" curpmap = 0xffffffff815d0b88 tssp = 0xffffffff815e89e8 commontssp = 0xffffffff815e89e8 rsp0 = 0xffffff881dcacb80 gs32p = 0xffffffff815ea440 ldt = 0xffffffff815ea480 tss = 0xffffffff815ea470 spin locks held: db:0:allpcpu> show alllocks Process 95840 (rm) thread 0xfffffe043ed5d920 (100410) shared lockmgr ufs (ufs) r = 0 (0xfffffe030d86cc98) locked @ kern/vfs_lookup.c:518 Process 17 (softdepflush) thread 0xfffffe0015082920 (100134) exclusive lockmgr bufwait (bufwait) r = 0 (0xffffff8786999cd8) locked @ ufs/ffs/ffs_vnops.c:262 exclusive lockmgr ufs (ufs) r = 0 (0xfffffe043916e7b8) locked @ kern/vfs_subr.c:2153 db:0:alllocks> show lockedvnods Locked vnodes 0xfffffe030d86cc30: tag ufs, type VDIR usecount 3, writecount 0, refcount 5 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffffe05c0c7fa00 ref 0 pages 0 lock type ufs: SHARED (count 1) with exclusive waiters pending #0 0xffffffff8089eda7 at __lockmgr_args+0x10b7 #1 0xffffffff80b12a62 at ffs_lock+0x92 #2 0xffffffff80d5d935 at VOP_LOCK1_APV+0xf5 #3 0xffffffff80976f26 at _vn_lock+0xc6 #4 0xffffffff80954ef7 at lookup+0x107 #5 0xffffffff80954aa4 at namei+0x4b4 #6 0xffffffff80971db9 at kern_statat_vnhook+0x99 #7 0xffffffff80971f30 at sys_lstat+0x30 #8 0xffffffff80cb2b62 at amd64_syscall+0x282 #9 0xffffffff80c9af2b at Xfast_syscall+0xfb ino 5617926, on dev da0p3 0xfffffe043916e750: tag ufs, type VDIR usecount 1, writecount 0, refcount 3 mountedhere 0 flags (VI_ACTIVE) lock type ufs: EXCL by thread 0xfffffe0015082920 (pid 17, softdepflush, tid 100134) with shared waiters pending #0 0xffffffff8089e699 at __lockmgr_args+0x9a9 #1 0xffffffff80b12a62 at ffs_lock+0x92 #2 0xffffffff80d5d935 at VOP_LOCK1_APV+0xf5 #3 0xffffffff80976f26 at _vn_lock+0xc6 #4 0xffffffff80961359 at vget+0xc9 #5 0xffffffff80953a85 at vfs_hash_get+0xf5 #6 0xffffffff80b0df61 at ffs_vgetf+0x41 #7 0xffffffff80af5c86 at clear_inodedeps+0x216 #8 0xffffffff80af4ab3 at softdep_process_worklist+0x93 #9 0xffffffff80b0cc84 at softdep_flush+0x104 #10 0xffffffff8088a804 at fork_exit+0x84 #11 0xffffffff80c9b17e at fork_trampoline+0xe ino 5617927, on dev da0p3 db:0:lockedvnods> show mount 0xfffffe0015691b58 /dev/da0p2 on / (ufs) 0xfffffe0015692000 devfs on /dev (devfs) 0xfffffe0015d7a3c8 /dev/da0p3 on /tmp (ufs) 0xfffffe0015dbc790 procfs on /proc (procfs) More info: show mount db:0:mount> ps pid ppid pgrp uid state wmesg wchan cmd 95840 94448 1068 0 D+ ufs 0xfffffe043916e7b8 rm 94448 1068 1068 0 S+ wait 0xfffffe0581083970 sh 70526 0 0 0 DL (threaded) [zfskern] 101938 D l2arc_fe 0xffffffff81bc7df0 [l2arc_feed_thread] 101506 D arc_recl 0xffffffff81bc0010 [arc_reclaim_thread] 19309 9486 19309 1001 S+ select 0xfffffe0015554a40 top 9486 9416 9486 1001 SWs+ wait 0xfffffe00590764b8 bash 9416 7869 7869 1001 S select 0xfffffe0015553d40 sshd 7869 960 7869 0 Ss select 0xfffffe00155bf440 sshd 1068 1065 1068 0 S+ wait 0xfffffe0015b974b8 sh 1065 1063 1065 0 SW+ wait 0xfffffe00158d44b8 bash 1063 1062 1063 0 SW+ pause 0xfffffe0059076a18 csh 1062 1058 1062 1001 SW+ wait 0xfffffe008bc1a000 su 1058 1057 1058 1001 SWs+ wait 0xfffffe008be664b8 bash 1057 1055 1055 1001 S select 0xfffffe0015a93340 sshd 1055 960 1055 0 Ss select 0xfffffe0015ba2f40 sshd 1051 1 1051 0 Ss+ ttyin 0xfffffe000b3368a8 getty 1050 1 1050 0 Ss+ ttyin 0xfffffe000b336ca8 getty 1049 1 1049 0 Ss+ ttyin 0xfffffe000b3370a8 getty 1048 1 1048 0 Ss+ ttyin 0xfffffe000b3374a8 getty 1047 1 1047 0 Ss+ ttyin 0xfffffe000b3378a8 getty 1046 1 1046 0 Ss+ ttyin 0xfffffe000b337ca8 getty 1045 1 1045 0 Ss+ ttyin 0xfffffe000b3380a8 getty 1044 1 1044 0 Ss+ ttyin 0xfffffe000b3384a8 getty 1043 1 1043 0 Ss+ ttyin 0xfffffe000b3388a8 getty 970 1 970 0 Ss nanslp 0xffffffff8137d9d4 cron 966 1 966 25 Ss pause 0xfffffe0015b92560 sendmail 963 1 963 0 Ss select 0xfffffe0015cfa4c0 sendmail 960 1 960 0 Ss select 0xfffffe008b9764c0 sshd 932 1 932 0 Ss select 0xfffffe0015b13940 powerd 929 1 929 0 Ss select 0xfffffe00158e1940 ntpd 891 889 889 0 S (threaded) nfsd 100195 S rpcsvc 0xfffffe001548a120 nfsd: service 100194 S rpcsvc 0xfffffe008b7ab5a0 nfsd: service 100193 S rpcsvc 0xfffffe008b804520 nfsd: service 100183 S rpcsvc 0xfffffe0015572220 nfsd: master 889 1 889 0 Ss select 0xfffffe0015b4b7c0 nfsd 883 1 883 0 Ss select 0xfffffe0015b139c0 mountd 876 872 872 0 S select 0xfffffe0015a422c0 nfsuserd 875 872 872 0 S select 0xfffffe0015dd81c0 nfsuserd 874 872 872 0 S select 0xfffffe0015ba3640 nfsuserd 873 872 872 0 S select 0xfffffe0015401ec0 nfsuserd 872 1 872 0 SWs pause 0xfffffe001571da18 nfsuserd 842 1 842 0 Ss select 0xfffffe000c9ebc40 rpcbind 829 1 829 0 Ss select 0xfffffe0015d31ac0 syslogd 700 1 700 0 Ss select 0xfffffe0015cfa540 devd 683 1 683 0 Ss select 0xfffffe00590a3540 moused 17 0 0 0 DL ufs 0xfffffe030d86cc98 [softdepflush] 16 0 0 0 DL vlruwt 0xfffffe00151464b8 [vnlru] 9 0 0 0 DL syncer 0xffffffff8156cdb0 [syncer] 8 0 0 0 DL psleep 0xffffffff8156c784 [bufdaemon] 7 0 0 0 DL pgzero 0xffffffff8157507c [pagezero] 6 0 0 0 DL psleep 0xffffffff815747c0 [vmdaemon] 5 0 0 0 DL psleep 0xffffffff815e7904 [pagedaemon] 4 0 0 0 DL idle 0xfffffe000b21a970 [enc_daemon0] 3 0 0 0 DL ccb_scan 0xffffffff81346c30 [xpt_thrd] 2 0 0 0 DL waiting_ 0xffffffff815db708 [sctp_iterator] 15 0 0 0 DL (threaded) [usb] 100119 D - 0xffffff8001163e18 [usbus2] 100118 D - 0xffffff8001163dc0 [usbus2] 100117 D - 0xffffff8001163d68 [usbus2] 100116 D - 0xffffff8001163d10 [usbus2] 100114 D - 0xffffff800115c1b0 [usbus1] 100113 D - 0xffffff800115c158 [usbus1] 100112 D - 0xffffff800115c100 [usbus1] 100111 D - 0xffffff800115c0a8 [usbus1] 100074 D - 0xffffff8000ea9e18 [usbus0] 100073 D - 0xffffff8000ea9dc0 [usbus0] 100072 D - 0xffffff8000ea9d68 [usbus0] 100071 D - 0xffffff8000ea9d10 [usbus0] 14 0 0 0 DL - 0xffffffff8135fe88 [yarrow] 13 0 0 0 DL (threaded) [geom] 100055 D - 0xffffffff815d0018 [g_down] 100054 D - 0xffffffff815d0010 [g_up] 100053 D - 0xffffffff815d0008 [g_event] 12 0 0 0 WL (threaded) [intr] 100122 I [swi0: uart] 100121 I [irq287: hdac1] 100120 I [irq286: ahci0] 100115 I [irq20: ehci1] 100110 I [irq285: xhci0] 100109 I [irq284: igb1:link] 100107 I [irq283: igb1:que 7] 100105 I [irq282: igb1:que 6] 100103 I [irq281: igb1:que 5] 100101 I [irq280: igb1:que 4] 100099 I [irq279: igb1:que 3] 100097 I [irq278: igb1:que 2] 100095 I [irq277: igb1:que 1] 100093 I [irq276: igb1:que 0] 100092 I [irq275: igb0:link] 100090 I [irq274: igb0:que 7] 100088 I [irq273: igb0:que 6] 100086 I [irq272: igb0:que 5] 100084 I [irq271: igb0:que 4] 100082 I [irq270: igb0:que 3] 100080 I [irq269: igb0:que 2] 100078 I [irq268: igb0:que 1] 100076 I [irq267: igb0:que 0] 100075 I [irq266: hdac0] 100070 I [irq22: ehci0] 100069 I [irq265: isci0] 100068 I [irq264: isci0] 100067 I [swi6: task queue] 100062 I [swi2: cambio] 100061 I [swi5: fast taskq] 100058 I [swi6: Giant taskq] 100052 I [swi4: clock] 100051 I [swi4: clock] 100050 I [swi4: clock] 100049 I [swi4: clock] 100048 I [swi4: clock] 100047 I [swi4: clock] 100046 I [swi4: clock] 100045 I [swi4: clock] 100044 I [swi4: clock] 100043 I [swi4: clock] 100042 I [swi4: clock] 100041 I [swi4: clock] 100040 I [swi4: clock] 100039 I [swi4: clock] 100038 I [swi4: clock] 100037 I [swi4: clock] 100036 I [swi4: clock] 100035 I [swi4: clock] 100034 I [swi4: clock] 100033 I [swi4: clock] 100032 I [swi4: clock] 100031 I [swi4: clock] 100030 I [swi4: clock] 100029 I [swi4: clock] 100028 I [swi3: vm] 100027 I [swi1: netisr 0] 11 0 0 0 RL (threaded) [idle] 100026 CanRun [idle: cpu23] 100025 Run CPU 22 [idle: cpu22] 100024 Run CPU 21 [idle: cpu21] 100023 Run CPU 20 [idle: cpu20] 100022 Run CPU 19 [idle: cpu19] 100021 Run CPU 18 [idle: cpu18] 100020 Run CPU 17 [idle: cpu17] 100019 Run CPU 16 [idle: cpu16] 100018 Run CPU 15 [idle: cpu15] 100017 Run CPU 14 [idle: cpu14] 100016 Run CPU 13 [idle: cpu13] 100015 Run CPU 12 [idle: cpu12] 100014 Run CPU 11 [idle: cpu11] 100013 Run CPU 10 [idle: cpu10] 100012 Run CPU 9 [idle: cpu9] 100011 Run CPU 8 [idle: cpu8] 100010 Run CPU 7 [idle: cpu7] 100009 Run CPU 6 [idle: cpu6] 100008 Run CPU 5 [idle: cpu5] 100007 Run CPU 4 [idle: cpu4] 100006 Run CPU 3 [idle: cpu3] 100005 Run CPU 2 [idle: cpu2] 100004 Run CPU 1 [idle: cpu1] 100003 Run CPU 0 [idle: cpu0] 1 0 1 0 SLs wait 0xfffffe000b21a000 [init] 10 0 0 0 DL audit_wo 0xffffffff815dee78 [audit] 0 0 0 0 RLs (threaded) [kernel] 101937 D - 0xfffffe00590a8500 [system_taskq_23] 101936 D - 0xfffffe00590a8500 [system_taskq_22] 101935 D - 0xfffffe00590a8500 [system_taskq_21] 101934 D - 0xfffffe00590a8500 [system_taskq_20] 101933 D - 0xfffffe00590a8500 [system_taskq_19] 101932 D - 0xfffffe00590a8500 [system_taskq_18] 101931 D - 0xfffffe00590a8500 [system_taskq_17] 101930 D - 0xfffffe00590a8500 [system_taskq_16] 101929 D - 0xfffffe00590a8500 [system_taskq_15] 101928 D - 0xfffffe00590a8500 [system_taskq_14] 101927 D - 0xfffffe00590a8500 [system_taskq_13] 101926 D - 0xfffffe00590a8500 [system_taskq_12] 101925 D - 0xfffffe00590a8500 [system_taskq_11] 101924 D - 0xfffffe00590a8500 [system_taskq_10] 101923 D - 0xfffffe00590a8500 [system_taskq_9] 101922 D - 0xfffffe00590a8500 [system_taskq_8] 101921 D - 0xfffffe00590a8500 [system_taskq_7] 101920 D - 0xfffffe00590a8500 [system_taskq_6] 101919 D - 0xfffffe00590a8500 [system_taskq_5] 101918 D - 0xfffffe00590a8500 [system_taskq_4] 101917 D - 0xfffffe00590a8500 [system_taskq_3] 101916 D - 0xfffffe00590a8500 [system_taskq_2] 101915 D - 0xfffffe00590a8500 [system_taskq_1] 101914 D - 0xfffffe00590a8500 [system_taskq_0] 100124 Run CPU 23 [deadlkres] 100123 D - 0xfffffe000c871700 [mca taskq] 100108 D - 0xfffffe000c872800 [igb1 que] 100106 D - 0xfffffe000c872b00 [igb1 que] 100104 D - 0xfffffe000c872e00 [igb1 que] 100102 D - 0xfffffe000c873200 [igb1 que] 100100 D - 0xfffffe000b214300 [igb1 que] 100098 D - 0xfffffe000b214600 [igb1 que] 100096 D - 0xfffffe000b214900 [igb1 que] 100094 D - 0xfffffe000b214c00 [igb1 que] 100091 D - 0xfffffe000b3eb100 [igb0 que] 100089 D - 0xfffffe000b3eb400 [igb0 que] 100087 D - 0xfffffe000b3eb700 [igb0 que] 100085 D - 0xfffffe000b3eba00 [igb0 que] 100083 D - 0xfffffe000b3ebd00 [igb0 que] 100081 D - 0xfffffe000b3ec100 [igb0 que] 100079 D - 0xfffffe000b3ec400 [igb0 que] 100077 D - 0xfffffe000b3ec700 [igb0 que] 100066 D - 0xfffffe000b3ed700 [acpi_task_2] 100065 D - 0xfffffe000b3ed700 [acpi_task_1] 100064 D - 0xfffffe000b3ed700 [acpi_task_0] 100063 D - 0xfffffe000b3ed900 [kqueue taskq] 100060 D - 0xfffffe000b3ede00 [ffs_trim taskq] 100059 D - 0xfffffe000b3ee100 [thread taskq] 100056 D - 0xfffffe000b210400 [firmware taskq] 100000 D swapin 0xffffffff815d0118 [swapper] db:0:ps> allt Tracing command rm pid 95840 tid 100410 td 0xfffffe043ed5d920 sched_switch() at sched_switch+0x482/frame 0xffffff881e5b2040 mi_switch() at mi_switch+0x179/frame 0xffffff881e5b2080 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e5b20c0 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881e5b20f0 sleeplk() at sleeplk+0x11a/frame 0xffffff881e5b2140 __lockmgr_args() at __lockmgr_args+0x698/frame 0xffffff881e5b2270 ffs_lock() at ffs_lock+0x92/frame 0xffffff881e5b22c0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xf5/frame 0xffffff881e5b22f0 _vn_lock() at _vn_lock+0xc6/frame 0xffffff881e5b2360 vget() at vget+0xc9/frame 0xffffff881e5b23a0 vfs_hash_get() at vfs_hash_get+0xf5/frame 0xffffff881e5b23f0 ffs_vgetf() at ffs_vgetf+0x41/frame 0xffffff881e5b2480 ufs_lookup_ino() at ufs_lookup_ino+0xcc8/frame 0xffffff881e5b2590 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0x108/frame 0xffffff881e5b25c0 vfs_cache_lookup() at vfs_cache_lookup+0xcf/frame 0xffffff881e5b2610 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x108/frame 0xffffff881e5b2640 lookup() at lookup+0x5a0/frame 0xffffff881e5b26d0 namei() at namei+0x4b4/frame 0xffffff881e5b2780 kern_statat_vnhook() at kern_statat_vnhook+0x99/frame 0xffffff881e5b2900 sys_lstat() at sys_lstat+0x30/frame 0xffffff881e5b29a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e5b2ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e5b2ab0 --- syscall (190, FreeBSD ELF64, sys_lstat), rip = 0x800933e1a, rsp = 0x7fffffffd718, rbp = 0x7fffffffd7b0 --- Tracing command sh pid 94448 tid 100500 td 0xfffffe0028829920 sched_switch() at sched_switch+0x482/frame 0xffffff881e771560 mi_switch() at mi_switch+0x179/frame 0xffffff881e7715a0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e7715e0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e771650 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff881e771680 _sleep() at _sleep+0x320/frame 0xffffff881e771710 kern_wait6() at kern_wait6+0x3e7/frame 0xffffff881e7717b0 sys_wait4() at sys_wait4+0x76/frame 0xffffff881e7719a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e771ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e771ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800d3324a, rsp = 0x7fffffffd498, rbp = 0x7fffffffd540 --- Tracing command zfskern pid 70526 tid 101938 td 0xfffffe0154d11920 sched_switch() at sched_switch+0x482/frame 0xffffff881ef99800 mi_switch() at mi_switch+0x179/frame 0xffffff881ef99840 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881ef99880 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xffffff881ef998b0 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x1fe/frame 0xffffff881ef99930 l2arc_feed_thread() at l2arc_feed_thread+0xcd7/frame 0xffffff881ef99a70 fork_exit() at fork_exit+0x84/frame 0xffffff881ef99ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881ef99ab0 --- trap 0, rip = 0, rsp = 0xffffff881ef99b70, rbp = 0 --- Tracing command zfskern pid 70526 tid 101506 td 0xfffffe008be46000 sched_switch() at sched_switch+0x482/frame 0xffffff881e8548a0 mi_switch() at mi_switch+0x179/frame 0xffffff881e8548e0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e854920 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xffffff881e854950 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x1fe/frame 0xffffff881e8549d0 arc_reclaim_thread() at arc_reclaim_thread+0x32f/frame 0xffffff881e854a70 fork_exit() at fork_exit+0x84/frame 0xffffff881e854ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881e854ab0 --- trap 0, rip = 0, rsp = 0xffffff881e854b70, rbp = 0 --- Tracing command top pid 19309 tid 100147 td 0xfffffe001598d920 sched_switch() at sched_switch+0x482/frame 0xffffff881e07c580 mi_switch() at mi_switch+0x179/frame 0xffffff881e07c5c0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e07c600 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e07c670 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xffffff881e07c6a0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fe/frame 0xffffff881e07c720 seltdwait() at seltdwait+0x8b/frame 0xffffff881e07c760 kern_select() at kern_select+0x892/frame 0xffffff881e07c960 sys_select() at sys_select+0x54/frame 0xffffff881e07c9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e07cab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e07cab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800fc82fa, rsp = 0x7fffffffd828, rbp = 0x7fffffffda10 --- Tracing command bash pid 9486 tid 100180 td 0xfffffe00590b8920 Tracing command sshd pid 9416 tid 100155 td 0xfffffe00157b4920 sched_switch() at sched_switch+0x482/frame 0xffffff881e0a4590 mi_switch() at mi_switch+0x179/frame 0xffffff881e0a45d0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e0a4610 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e0a4680 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff881e0a46b0 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff881e0a4720 seltdwait() at seltdwait+0x78/frame 0xffffff881e0a4760 kern_select() at kern_select+0x892/frame 0xffffff881e0a4960 sys_select() at sys_select+0x54/frame 0xffffff881e0a49a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e0a4ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e0a4ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8025752fa, rsp = 0x7fffffffd168, rbp = 0x7fffffffd1d0 --- Tracing command sshd pid 7869 tid 100234 td 0xfffffe008be46920 sched_switch() at sched_switch+0x482/frame 0xffffff881e240630 mi_switch() at mi_switch+0x179/frame 0xffffff881e240670 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e2406b0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e240720 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff881e240750 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff881e2407c0 seltdwait() at seltdwait+0x78/frame 0xffffff881e240800 sys_poll() at sys_poll+0x38c/frame 0xffffff881e2409a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e240ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e240ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x80250d73a, rsp = 0x7fffffffd1f8, rbp = 0x7fffffffd250 --- Tracing command sh pid 1068 tid 100146 td 0xfffffe0015b98920 sched_switch() at sched_switch+0x482/frame 0xffffff881e077560 mi_switch() at mi_switch+0x179/frame 0xffffff881e0775a0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e0775e0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e077650 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff881e077680 _sleep() at _sleep+0x320/frame 0xffffff881e077710 kern_wait6() at kern_wait6+0x3e7/frame 0xffffff881e0777b0 sys_wait4() at sys_wait4+0x76/frame 0xffffff881e0779a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e077ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e077ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800d3324a, rsp = 0x7fffffffd3f8, rbp = 0x7fffffffd4a0 --- Tracing command bash pid 1065 tid 100199 td 0xfffffe00158e3920 Tracing command csh pid 1063 tid 100179 td 0xfffffe00590a4000 Tracing command su pid 1062 tid 100212 td 0xfffffe008bc1b490 Tracing command bash pid 1058 tid 100223 td 0xfffffe008be67920 Tracing command sshd pid 1057 tid 100208 td 0xfffffe008b87c490 sched_switch() at sched_switch+0x482/frame 0xffffff881e1ba590 mi_switch() at mi_switch+0x179/frame 0xffffff881e1ba5d0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e1ba610 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e1ba680 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff881e1ba6b0 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff881e1ba720 seltdwait() at seltdwait+0x78/frame 0xffffff881e1ba760 kern_select() at kern_select+0x892/frame 0xffffff881e1ba960 sys_select() at sys_select+0x54/frame 0xffffff881e1ba9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e1baab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e1baab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8025752fa, rsp = 0x7fffffffd168, rbp = 0x7fffffffd1d0 --- Tracing command sshd pid 1055 tid 100198 td 0xfffffe00159ad920 sched_switch() at sched_switch+0x482/frame 0xffffff881e188630 mi_switch() at mi_switch+0x179/frame 0xffffff881e188670 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e1886b0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e188720 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff881e188750 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff881e1887c0 seltdwait() at seltdwait+0x78/frame 0xffffff881e188800 sys_poll() at sys_poll+0x38c/frame 0xffffff881e1889a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e188ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e188ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x80250d73a, rsp = 0x7fffffffd1f8, rbp = 0x7fffffffd250 --- Tracing command getty pid 1051 tid 100221 td 0xfffffe001579f000 sched_switch() at sched_switch+0x482/frame 0xffffff881e1fb620 mi_switch() at mi_switch+0x179/frame 0xffffff881e1fb660 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e1fb6a0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e1fb710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff881e1fb740 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff881e1fb7b0 tty_wait() at tty_wait+0x42/frame 0xffffff881e1fb7e0 ttydisc_read() at ttydisc_read+0x353/frame 0xffffff881e1fb840 ttydev_read() at ttydev_read+0x6d/frame 0xffffff881e1fb870 devfs_read_f() at devfs_read_f+0x7f/frame 0xffffff881e1fb8d0 dofileread() at dofileread+0x7b/frame 0xffffff881e1fb910 kern_readv() at kern_readv+0x48/frame 0xffffff881e1fb950 sys_read() at sys_read+0x63/frame 0xffffff881e1fb9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e1fbab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e1fbab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b5837a, rsp = 0x7fffffffdc98, rbp = 0x7fffffffdcd0 --- Tracing command getty pid 1050 tid 100220 td 0xfffffe001579f490 sched_switch() at sched_switch+0x482/frame 0xffffff881e1f6620 mi_switch() at mi_switch+0x179/frame 0xffffff881e1f6660 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e1f66a0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e1f6710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff881e1f6740 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff881e1f67b0 tty_wait() at tty_wait+0x42/frame 0xffffff881e1f67e0 ttydisc_read() at ttydisc_read+0x353/frame 0xffffff881e1f6840 ttydev_read() at ttydev_read+0x6d/frame 0xffffff881e1f6870 devfs_read_f() at devfs_read_f+0x7f/frame 0xffffff881e1f68d0 dofileread() at dofileread+0x7b/frame 0xffffff881e1f6910 kern_readv() at kern_readv+0x48/frame 0xffffff881e1f6950 sys_read() at sys_read+0x63/frame 0xffffff881e1f69a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e1f6ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e1f6ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b5837a, rsp = 0x7fffffffdc98, rbp = 0x7fffffffdcd0 --- Tracing command getty pid 1049 tid 100219 td 0xfffffe001579f920 sched_switch() at sched_switch+0x482/frame 0xffffff881e1f1620 mi_switch() at mi_switch+0x179/frame 0xffffff881e1f1660 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e1f16a0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e1f1710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff881e1f1740 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff881e1f17b0 tty_wait() at tty_wait+0x42/frame 0xffffff881e1f17e0 ttydisc_read() at ttydisc_read+0x353/frame 0xffffff881e1f1840 ttydev_read() at ttydev_read+0x6d/frame 0xffffff881e1f1870 devfs_read_f() at devfs_read_f+0x7f/frame 0xffffff881e1f18d0 dofileread() at dofileread+0x7b/frame 0xffffff881e1f1910 kern_readv() at kern_readv+0x48/frame 0xffffff881e1f1950 sys_read() at sys_read+0x63/frame 0xffffff881e1f19a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e1f1ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e1f1ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b5837a, rsp = 0x7fffffffdc98, rbp = 0x7fffffffdcd0 --- Tracing command getty pid 1048 tid 100218 td 0xfffffe0015734000 sched_switch() at sched_switch+0x482/frame 0xffffff881e1ec620 mi_switch() at mi_switch+0x179/frame 0xffffff881e1ec660 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e1ec6a0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e1ec710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff881e1ec740 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff881e1ec7b0 tty_wait() at tty_wait+0x42/frame 0xffffff881e1ec7e0 ttydisc_read() at ttydisc_read+0x353/frame 0xffffff881e1ec840 ttydev_read() at ttydev_read+0x6d/frame 0xffffff881e1ec870 devfs_read_f() at devfs_read_f+0x7f/frame 0xffffff881e1ec8d0 dofileread() at dofileread+0x7b/frame 0xffffff881e1ec910 kern_readv() at kern_readv+0x48/frame 0xffffff881e1ec950 sys_read() at sys_read+0x63/frame 0xffffff881e1ec9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e1ecab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e1ecab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b5837a, rsp = 0x7fffffffdc98, rbp = 0x7fffffffdcd0 --- Tracing command getty pid 1047 tid 100217 td 0xfffffe0015734490 sched_switch() at sched_switch+0x482/frame 0xffffff881e1e7620 mi_switch() at mi_switch+0x179/frame 0xffffff881e1e7660 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e1e76a0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e1e7710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff881e1e7740 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff881e1e77b0 tty_wait() at tty_wait+0x42/frame 0xffffff881e1e77e0 ttydisc_read() at ttydisc_read+0x353/frame 0xffffff881e1e7840 ttydev_read() at ttydev_read+0x6d/frame 0xffffff881e1e7870 devfs_read_f() at devfs_read_f+0x7f/frame 0xffffff881e1e78d0 dofileread() at dofileread+0x7b/frame 0xffffff881e1e7910 kern_readv() at kern_readv+0x48/frame 0xffffff881e1e7950 sys_read() at sys_read+0x63/frame 0xffffff881e1e79a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e1e7ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e1e7ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b5837a, rsp = 0x7fffffffdc98, rbp = 0x7fffffffdcd0 --- Tracing command getty pid 1046 tid 100216 td 0xfffffe008b5e0490 sched_switch() at sched_switch+0x482/frame 0xffffff881e1e2620 mi_switch() at mi_switch+0x179/frame 0xffffff881e1e2660 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e1e26a0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e1e2710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff881e1e2740 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff881e1e27b0 tty_wait() at tty_wait+0x42/frame 0xffffff881e1e27e0 ttydisc_read() at ttydisc_read+0x353/frame 0xffffff881e1e2840 ttydev_read() at ttydev_read+0x6d/frame 0xffffff881e1e2870 devfs_read_f() at devfs_read_f+0x7f/frame 0xffffff881e1e28d0 dofileread() at dofileread+0x7b/frame 0xffffff881e1e2910 kern_readv() at kern_readv+0x48/frame 0xffffff881e1e2950 sys_read() at sys_read+0x63/frame 0xffffff881e1e29a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e1e2ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e1e2ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b5837a, rsp = 0x7fffffffdc98, rbp = 0x7fffffffdcd0 --- Tracing command getty pid 1045 tid 100215 td 0xfffffe008b5e0920 sched_switch() at sched_switch+0x482/frame 0xffffff881e1dd620 mi_switch() at mi_switch+0x179/frame 0xffffff881e1dd660 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e1dd6a0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e1dd710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff881e1dd740 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff881e1dd7b0 tty_wait() at tty_wait+0x42/frame 0xffffff881e1dd7e0 ttydisc_read() at ttydisc_read+0x353/frame 0xffffff881e1dd840 ttydev_read() at ttydev_read+0x6d/frame 0xffffff881e1dd870 devfs_read_f() at devfs_read_f+0x7f/frame 0xffffff881e1dd8d0 dofileread() at dofileread+0x7b/frame 0xffffff881e1dd910 kern_readv() at kern_readv+0x48/frame 0xffffff881e1dd950 sys_read() at sys_read+0x63/frame 0xffffff881e1dd9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e1ddab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e1ddab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b5837a, rsp = 0x7fffffffdc98, rbp = 0x7fffffffdcd0 --- Tracing command getty pid 1044 tid 100188 td 0xfffffe008b5e0000 sched_switch() at sched_switch+0x482/frame 0xffffff881e156620 mi_switch() at mi_switch+0x179/frame 0xffffff881e156660 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e1566a0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e156710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff881e156740 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff881e1567b0 tty_wait() at tty_wait+0x42/frame 0xffffff881e1567e0 ttydisc_read() at ttydisc_read+0x353/frame 0xffffff881e156840 ttydev_read() at ttydev_read+0x6d/frame 0xffffff881e156870 devfs_read_f() at devfs_read_f+0x7f/frame 0xffffff881e1568d0 dofileread() at dofileread+0x7b/frame 0xffffff881e156910 kern_readv() at kern_readv+0x48/frame 0xffffff881e156950 sys_read() at sys_read+0x63/frame 0xffffff881e1569a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e156ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e156ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b5837a, rsp = 0x7fffffffdc98, rbp = 0x7fffffffdcd0 --- Tracing command getty pid 1043 tid 100135 td 0xfffffe001572c490 sched_switch() at sched_switch+0x482/frame 0xffffff881e040620 mi_switch() at mi_switch+0x179/frame 0xffffff881e040660 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e0406a0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e040710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff881e040740 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff881e0407b0 tty_wait() at tty_wait+0x42/frame 0xffffff881e0407e0 ttydisc_read() at ttydisc_read+0x353/frame 0xffffff881e040840 ttydev_read() at ttydev_read+0x6d/frame 0xffffff881e040870 devfs_read_f() at devfs_read_f+0x7f/frame 0xffffff881e0408d0 dofileread() at dofileread+0x7b/frame 0xffffff881e040910 kern_readv() at kern_readv+0x48/frame 0xffffff881e040950 sys_read() at sys_read+0x63/frame 0xffffff881e0409a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e040ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e040ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b5837a, rsp = 0x7fffffffdc98, rbp = 0x7fffffffdcd0 --- Tracing command cron pid 970 tid 100145 td 0xfffffe0015b16920 sched_switch() at sched_switch+0x482/frame 0xffffff881e072750 mi_switch() at mi_switch+0x179/frame 0xffffff881e072790 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e0727d0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e072840 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xffffff881e072870 _sleep() at _sleep+0x300/frame 0xffffff881e072900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xffffff881e072960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xffffff881e0729a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e072ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e072ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800d4740a, rsp = 0x7fffffffdb28, rbp = 0x7fffffffdd00 --- Tracing command sendmail pid 966 tid 100166 td 0xfffffe0015b1a920 sched_switch() at sched_switch+0x482/frame 0xffffff881e0db760 mi_switch() at mi_switch+0x179/frame 0xffffff881e0db7a0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e0db7e0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e0db850 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff881e0db880 _sleep() at _sleep+0x320/frame 0xffffff881e0db910 kern_sigsuspend() at kern_sigsuspend+0xcd/frame 0xffffff881e0db970 sys_sigsuspend() at sys_sigsuspend+0x31/frame 0xffffff881e0db9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e0dbab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e0dbab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x801392c6a, rsp = 0x7fffffffc818, rbp = 0x7fffffffc830 --- Tracing command sendmail pid 963 tid 100205 td 0xfffffe0015f36920 sched_switch() at sched_switch+0x482/frame 0xffffff881e1ab580 mi_switch() at mi_switch+0x179/frame 0xffffff881e1ab5c0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e1ab600 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e1ab670 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xffffff881e1ab6a0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fe/frame 0xffffff881e1ab720 seltdwait() at seltdwait+0x8b/frame 0xffffff881e1ab760 kern_select() at kern_select+0x892/frame 0xffffff881e1ab960 sys_select() at sys_select+0x54/frame 0xffffff881e1ab9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e1abab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e1abab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8014522fa, rsp = 0x7fffffffbd18, rbp = 0x7fffffffc810 --- Tracing command sshd pid 960 tid 100204 td 0xfffffe008b624000 sched_switch() at sched_switch+0x482/frame 0xffffff881e1a6590 mi_switch() at mi_switch+0x179/frame 0xffffff881e1a65d0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e1a6610 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e1a6680 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff881e1a66b0 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff881e1a6720 seltdwait() at seltdwait+0x78/frame 0xffffff881e1a6760 kern_select() at kern_select+0x892/frame 0xffffff881e1a6960 sys_select() at sys_select+0x54/frame 0xffffff881e1a69a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e1a6ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e1a6ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8025752fa, rsp = 0x7fffffffd288, rbp = 0x7fffffffdd10 --- Tracing command powerd pid 932 tid 100202 td 0xfffffe008b85c000 sched_switch() at sched_switch+0x482/frame 0xffffff881e19c580 mi_switch() at mi_switch+0x179/frame 0xffffff881e19c5c0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e19c600 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e19c670 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xffffff881e19c6a0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fe/frame 0xffffff881e19c720 seltdwait() at seltdwait+0x8b/frame 0xffffff881e19c760 kern_select() at kern_select+0x892/frame 0xffffff881e19c960 sys_select() at sys_select+0x54/frame 0xffffff881e19c9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e19cab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e19cab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800b562fa, rsp = 0x7fffffffdb88, rbp = 0x7fffffffdd00 --- Tracing command ntpd pid 929 tid 100200 td 0xfffffe008b88b000 sched_switch() at sched_switch+0x482/frame 0xffffff881e192590 mi_switch() at mi_switch+0x179/frame 0xffffff881e1925d0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e192610 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e192680 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff881e1926b0 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff881e192720 seltdwait() at seltdwait+0x78/frame 0xffffff881e192760 kern_select() at kern_select+0x892/frame 0xffffff881e192960 sys_select() at sys_select+0x54/frame 0xffffff881e1929a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e192ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e192ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8013c12fa, rsp = 0x7fffffffdbc8, rbp = 0x7fffffffdc90 --- Tracing command nfsd pid 891 tid 100195 td 0xfffffe0015cc1000 sched_switch() at sched_switch+0x482/frame 0xffffff881e179730 mi_switch() at mi_switch+0x179/frame 0xffffff881e179770 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e1797b0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e179820 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xffffff881e179850 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fe/frame 0xffffff881e1798d0 svc_run_internal() at svc_run_internal+0x9c7/frame 0xffffff881e179a60 svc_thread_start() at svc_thread_start+0xb/frame 0xffffff881e179a70 fork_exit() at fork_exit+0x84/frame 0xffffff881e179ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881e179ab0 --- trap 0xc, rip = 0x8008868ca, rsp = 0x7fffffffd5d8, rbp = 0x7fffffffd880 --- Tracing command nfsd pid 891 tid 100194 td 0xfffffe0015cc1490 sched_switch() at sched_switch+0x482/frame 0xffffff881e174730 mi_switch() at mi_switch+0x179/frame 0xffffff881e174770 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e1747b0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e174820 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xffffff881e174850 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fe/frame 0xffffff881e1748d0 svc_run_internal() at svc_run_internal+0x9c7/frame 0xffffff881e174a60 svc_thread_start() at svc_thread_start+0xb/frame 0xffffff881e174a70 fork_exit() at fork_exit+0x84/frame 0xffffff881e174ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881e174ab0 --- trap 0xc, rip = 0x8008868ca, rsp = 0x7fffffffd5d8, rbp = 0x7fffffffd880 --- Tracing command nfsd pid 891 tid 100193 td 0xfffffe0015cc1920 sched_switch() at sched_switch+0x482/frame 0xffffff881e16f730 mi_switch() at mi_switch+0x179/frame 0xffffff881e16f770 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e16f7b0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e16f820 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xffffff881e16f850 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fe/frame 0xffffff881e16f8d0 svc_run_internal() at svc_run_internal+0x9c7/frame 0xffffff881e16fa60 svc_thread_start() at svc_thread_start+0xb/frame 0xffffff881e16fa70 fork_exit() at fork_exit+0x84/frame 0xffffff881e16fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881e16fab0 --- trap 0xc, rip = 0x8008868ca, rsp = 0x7fffffffd5d8, rbp = 0x7fffffffd880 --- Tracing command nfsd pid 891 tid 100183 td 0xfffffe0015c00000 sched_switch() at sched_switch+0x482/frame 0xffffff881e12fea0 mi_switch() at mi_switch+0x179/frame 0xffffff881e12fee0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e12ff20 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e12ff90 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xffffff881e12ffc0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fe/frame 0xffffff881e130040 svc_run_internal() at svc_run_internal+0x9c7/frame 0xffffff881e1301d0 svc_run() at svc_run+0xd4/frame 0xffffff881e130210 nfsrvd_nfsd() at nfsrvd_nfsd+0x194/frame 0xffffff881e130370 nfssvc_nfsd() at nfssvc_nfsd+0x103/frame 0xffffff881e130970 sys_nfssvc() at sys_nfssvc+0xd2/frame 0xffffff881e1309a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e130ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e130ab0 --- syscall (155, FreeBSD ELF64, sys_nfssvc), rip = 0x8008868ca, rsp = 0x7fffffffd5d8, rbp = 0x7fffffffd880 --- Tracing command nfsd pid 889 tid 100192 td 0xfffffe008b624490 sched_switch() at sched_switch+0x482/frame 0xffffff881e16a590 mi_switch() at mi_switch+0x179/frame 0xffffff881e16a5d0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e16a610 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e16a680 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff881e16a6b0 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff881e16a720 seltdwait() at seltdwait+0x78/frame 0xffffff881e16a760 kern_select() at kern_select+0x892/frame 0xffffff881e16a960 sys_select() at sys_select+0x54/frame 0xffffff881e16a9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e16aab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e16aab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8009452fa, rsp = 0x7fffffffd888, rbp = 0x7fffffffdce0 --- Tracing command mountd pid 883 tid 100191 td 0xfffffe008b7e2920 sched_switch() at sched_switch+0x482/frame 0xffffff881e165590 mi_switch() at mi_switch+0x179/frame 0xffffff881e1655d0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e165610 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e165680 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff881e1656b0 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff881e165720 seltdwait() at seltdwait+0x78/frame 0xffffff881e165760 kern_select() at kern_select+0x892/frame 0xffffff881e165960 sys_select() at sys_select+0x54/frame 0xffffff881e1659a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e165ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e165ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800b5d2fa, rsp = 0x7fffffffdb88, rbp = 0x7fffffffdd00 --- Tracing command nfsuserd pid 876 tid 100140 td 0xfffffe00159ad000 sched_switch() at sched_switch+0x482/frame 0xffffff881e059580 mi_switch() at mi_switch+0x179/frame 0xffffff881e0595c0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e059600 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e059670 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xffffff881e0596a0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fe/frame 0xffffff881e059720 seltdwait() at seltdwait+0x8b/frame 0xffffff881e059760 kern_select() at kern_select+0x892/frame 0xffffff881e059960 sys_select() at sys_select+0x54/frame 0xffffff881e0599a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e059ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e059ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8009442fa, rsp = 0x7fffffffd9f8, rbp = 0x7fffffffdb30 --- Tracing command nfsuserd pid 875 tid 100164 td 0xfffffe0015b98000 sched_switch() at sched_switch+0x482/frame 0xffffff881e0d1580 mi_switch() at mi_switch+0x179/frame 0xffffff881e0d15c0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e0d1600 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e0d1670 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xffffff881e0d16a0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fe/frame 0xffffff881e0d1720 seltdwait() at seltdwait+0x8b/frame 0xffffff881e0d1760 kern_select() at kern_select+0x892/frame 0xffffff881e0d1960 sys_select() at sys_select+0x54/frame 0xffffff881e0d19a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e0d1ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e0d1ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8009442fa, rsp = 0x7fffffffd9f8, rbp = 0x7fffffffdb30 --- Tracing command nfsuserd pid 874 tid 100174 td 0xfffffe0015f24920 sched_switch() at sched_switch+0x482/frame 0xffffff881e103580 mi_switch() at mi_switch+0x179/frame 0xffffff881e1035c0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e103600 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e103670 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xffffff881e1036a0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fe/frame 0xffffff881e103720 seltdwait() at seltdwait+0x8b/frame 0xffffff881e103760 kern_select() at kern_select+0x892/frame 0xffffff881e103960 sys_select() at sys_select+0x54/frame 0xffffff881e1039a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e103ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e103ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8009442fa, rsp = 0x7fffffffd9f8, rbp = 0x7fffffffdb30 --- Tracing command nfsuserd pid 873 tid 100158 td 0xfffffe0015c00490 sched_switch() at sched_switch+0x482/frame 0xffffff881e0b3580 mi_switch() at mi_switch+0x179/frame 0xffffff881e0b35c0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e0b3600 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e0b3670 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xffffff881e0b36a0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fe/frame 0xffffff881e0b3720 seltdwait() at seltdwait+0x8b/frame 0xffffff881e0b3760 kern_select() at kern_select+0x892/frame 0xffffff881e0b3960 sys_select() at sys_select+0x54/frame 0xffffff881e0b39a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e0b3ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e0b3ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8009442fa, rsp = 0x7fffffffd9f8, rbp = 0x7fffffffdb30 --- Tracing command nfsuserd pid 872 tid 100171 td 0xfffffe00157b4000 Tracing command rpcbind pid 842 tid 100177 td 0xfffffe0015a33000 sched_switch() at sched_switch+0x482/frame 0xffffff881e112620 mi_switch() at mi_switch+0x179/frame 0xffffff881e112660 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e1126a0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e112710 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xffffff881e112740 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fe/frame 0xffffff881e1127c0 seltdwait() at seltdwait+0x8b/frame 0xffffff881e112800 sys_poll() at sys_poll+0x38c/frame 0xffffff881e1129a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e112ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e112ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x800cfd73a, rsp = 0x7fffffffba68, rbp = 0x7fffffffdc80 --- Tracing command syslogd pid 829 tid 100165 td 0xfffffe001572c000 sched_switch() at sched_switch+0x482/frame 0xffffff881e0d6590 mi_switch() at mi_switch+0x179/frame 0xffffff881e0d65d0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e0d6610 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e0d6680 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff881e0d66b0 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff881e0d6720 seltdwait() at seltdwait+0x78/frame 0xffffff881e0d6760 kern_select() at kern_select+0x892/frame 0xffffff881e0d6960 sys_select() at sys_select+0x54/frame 0xffffff881e0d69a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e0d6ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e0d6ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800b5b2fa, rsp = 0x7fffffffcce8, rbp = 0x7fffffffdd00 --- Tracing command devd pid 700 tid 100176 td 0xfffffe001598d000 sched_switch() at sched_switch+0x482/frame 0xffffff881e10d580 mi_switch() at mi_switch+0x179/frame 0xffffff881e10d5c0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e10d600 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e10d670 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xffffff881e10d6a0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fe/frame 0xffffff881e10d720 seltdwait() at seltdwait+0x8b/frame 0xffffff881e10d760 kern_select() at kern_select+0x892/frame 0xffffff881e10d960 sys_select() at sys_select+0x54/frame 0xffffff881e10d9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e10dab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e10dab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x44cb4a, rsp = 0x7fffffffbbb8, rbp = 0x7fffffffdd20 --- Tracing command moused pid 683 tid 100182 td 0xfffffe0015f24490 sched_switch() at sched_switch+0x482/frame 0xffffff881e12b590 mi_switch() at mi_switch+0x179/frame 0xffffff881e12b5d0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e12b610 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e12b680 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff881e12b6b0 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff881e12b720 seltdwait() at seltdwait+0x78/frame 0xffffff881e12b760 kern_select() at kern_select+0x892/frame 0xffffff881e12b960 sys_select() at sys_select+0x54/frame 0xffffff881e12b9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e12bab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e12bab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800d812fa, rsp = 0x7fffffffd6f8, rbp = 0x7fffffffdca0 --- Tracing command softdepflush pid 17 tid 100134 td 0xfffffe0015082920 sched_switch() at sched_switch+0x482/frame 0xffffff881dea2430 mi_switch() at mi_switch+0x179/frame 0xffffff881dea2470 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881dea24b0 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881dea24e0 sleeplk() at sleeplk+0x11a/frame 0xffffff881dea2530 __lockmgr_args() at __lockmgr_args+0x95c/frame 0xffffff881dea2660 ffs_lock() at ffs_lock+0x92/frame 0xffffff881dea26b0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xf5/frame 0xffffff881dea26e0 _vn_lock() at _vn_lock+0xc6/frame 0xffffff881dea2750 vget() at vget+0xc9/frame 0xffffff881dea2790 vfs_hash_get() at vfs_hash_get+0xf5/frame 0xffffff881dea27e0 ffs_vgetf() at ffs_vgetf+0x41/frame 0xffffff881dea2870 softdep_sync_buf() at softdep_sync_buf+0x8fa/frame 0xffffff881dea2920 ffs_syncvnode() at ffs_syncvnode+0x258/frame 0xffffff881dea29a0 clear_inodedeps() at clear_inodedeps+0x23c/frame 0xffffff881dea29f0 softdep_process_worklist() at softdep_process_worklist+0x93/frame 0xffffff881dea2a30 softdep_flush() at softdep_flush+0x104/frame 0xffffff881dea2a70 fork_exit() at fork_exit+0x84/frame 0xffffff881dea2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881dea2ab0 --- trap 0, rip = 0, rsp = 0xffffff881dea2b70, rbp = 0 --- Tracing command vnlru pid 16 tid 100133 td 0xfffffe0015142000 sched_switch() at sched_switch+0x482/frame 0xffffff881de9d8e0 mi_switch() at mi_switch+0x179/frame 0xffffff881de9d920 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881de9d960 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xffffff881de9d990 _sleep() at _sleep+0x312/frame 0xffffff881de9da20 vnlru_proc() at vnlru_proc+0x128/frame 0xffffff881de9da70 fork_exit() at fork_exit+0x84/frame 0xffffff881de9dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881de9dab0 --- trap 0, rip = 0, rsp = 0xffffff881de9db70, rbp = 0 --- Tracing command syncer pid 9 tid 100132 td 0xfffffe0015142490 sched_switch() at sched_switch+0x482/frame 0xffffff881de988b0 mi_switch() at mi_switch+0x179/frame 0xffffff881de988f0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881de98930 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xffffff881de98960 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x1fe/frame 0xffffff881de989e0 sched_sync() at sched_sync+0x5e6/frame 0xffffff881de98a70 fork_exit() at fork_exit+0x84/frame 0xffffff881de98ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881de98ab0 --- trap 0, rip = 0, rsp = 0xffffff881de98b70, rbp = 0 --- Tracing command bufdaemon pid 8 tid 100131 td 0xfffffe0015142920 sched_switch() at sched_switch+0x482/frame 0xffffff881de93900 mi_switch() at mi_switch+0x179/frame 0xffffff881de93940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881de93980 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xffffff881de939b0 _sleep() at _sleep+0x312/frame 0xffffff881de93a40 buf_daemon() at buf_daemon+0x68/frame 0xffffff881de93a70 fork_exit() at fork_exit+0x84/frame 0xffffff881de93ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881de93ab0 --- trap 0, rip = 0, rsp = 0xffffff881de93b70, rbp = 0 --- Tracing command pagezero pid 7 tid 100130 td 0xfffffe000c9e5920 sched_switch() at sched_switch+0x482/frame 0xffffff881de8e900 mi_switch() at mi_switch+0x179/frame 0xffffff881de8e940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881de8e980 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xffffff881de8e9b0 _sleep() at _sleep+0x312/frame 0xffffff881de8ea40 vm_pagezero() at vm_pagezero+0x88/frame 0xffffff881de8ea70 fork_exit() at fork_exit+0x84/frame 0xffffff881de8eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881de8eab0 --- trap 0, rip = 0, rsp = 0xffffff881de8eb70, rbp = 0 --- Tracing command vmdaemon pid 6 tid 100129 td 0xfffffe0015081000 sched_switch() at sched_switch+0x482/frame 0xffffff881de898c0 mi_switch() at mi_switch+0x179/frame 0xffffff881de89900 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881de89940 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881de89970 _sleep() at _sleep+0x33d/frame 0xffffff881de89a00 vm_daemon() at vm_daemon+0x7e/frame 0xffffff881de89a70 fork_exit() at fork_exit+0x84/frame 0xffffff881de89ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881de89ab0 --- trap 0, rip = 0, rsp = 0xffffff881de89b70, rbp = 0 --- Tracing command pagedaemon pid 5 tid 100128 td 0xfffffe0015081490 sched_switch() at sched_switch+0x482/frame 0xffffff881de848a0 mi_switch() at mi_switch+0x179/frame 0xffffff881de848e0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881de84920 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xffffff881de84950 _sleep() at _sleep+0x312/frame 0xffffff881de849e0 vm_pageout() at vm_pageout+0x2b7/frame 0xffffff881de84a70 fork_exit() at fork_exit+0x84/frame 0xffffff881de84ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881de84ab0 --- trap 0, rip = 0, rsp = 0xffffff881de84b70, rbp = 0 --- Tracing command enc_daemon0 pid 4 tid 100127 td 0xfffffe0015081920 sched_switch() at sched_switch+0x482/frame 0xffffff881ddfc8c0 mi_switch() at mi_switch+0x179/frame 0xffffff881ddfc900 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881ddfc940 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881ddfc970 _sleep() at _sleep+0x33d/frame 0xffffff881ddfca00 enc_daemon() at enc_daemon+0x109/frame 0xffffff881ddfca70 fork_exit() at fork_exit+0x84/frame 0xffffff881ddfcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881ddfcab0 --- trap 0, rip = 0, rsp = 0xffffff881ddfcb70, rbp = 0 --- Tracing command xpt_thrd pid 3 tid 100126 td 0xfffffe0015082000 sched_switch() at sched_switch+0x482/frame 0xffffff881dcb7900 mi_switch() at mi_switch+0x179/frame 0xffffff881dcb7940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881dcb7980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881dcb79b0 _sleep() at _sleep+0x33d/frame 0xffffff881dcb7a40 xpt_scanner_thread() at xpt_scanner_thread+0xdc/frame 0xffffff881dcb7a70 fork_exit() at fork_exit+0x84/frame 0xffffff881dcb7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881dcb7ab0 --- trap 0, rip = 0, rsp = 0xffffff881dcb7b70, rbp = 0 --- Tracing command sctp_iterator pid 2 tid 100125 td 0xfffffe000c9e1000 sched_switch() at sched_switch+0x482/frame 0xffffff881dcb2910 mi_switch() at mi_switch+0x179/frame 0xffffff881dcb2950 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881dcb2990 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881dcb29c0 _sleep() at _sleep+0x33d/frame 0xffffff881dcb2a50 sctp_iterator_thread() at sctp_iterator_thread+0x59/frame 0xffffff881dcb2a70 fork_exit() at fork_exit+0x84/frame 0xffffff881dcb2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881dcb2ab0 --- trap 0, rip = 0, rsp = 0xffffff881dcb2b70, rbp = 0 --- Tracing command usb pid 15 tid 100119 td 0xfffffe000c884920 sched_switch() at sched_switch+0x482/frame 0xffffff881bc13920 mi_switch() at mi_switch+0x179/frame 0xffffff881bc13960 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881bc139a0 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881bc139d0 _cv_wait() at _cv_wait+0x1df/frame 0xffffff881bc13a40 usb_process() at usb_process+0xd4/frame 0xffffff881bc13a70 fork_exit() at fork_exit+0x84/frame 0xffffff881bc13ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881bc13ab0 --- trap 0, rip = 0, rsp = 0xffffff881bc13b70, rbp = 0 --- Tracing command usb pid 15 tid 100118 td 0xfffffe000c895000 sched_switch() at sched_switch+0x482/frame 0xffffff881bc0e920 mi_switch() at mi_switch+0x179/frame 0xffffff881bc0e960 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881bc0e9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881bc0e9d0 _cv_wait() at _cv_wait+0x1df/frame 0xffffff881bc0ea40 usb_process() at usb_process+0xd4/frame 0xffffff881bc0ea70 fork_exit() at fork_exit+0x84/frame 0xffffff881bc0eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881bc0eab0 --- trap 0, rip = 0, rsp = 0xffffff881bc0eb70, rbp = 0 --- Tracing command usb pid 15 tid 100117 td 0xfffffe000c895490 sched_switch() at sched_switch+0x482/frame 0xffffff881bc09920 mi_switch() at mi_switch+0x179/frame 0xffffff881bc09960 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881bc099a0 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881bc099d0 _cv_wait() at _cv_wait+0x1df/frame 0xffffff881bc09a40 usb_process() at usb_process+0xd4/frame 0xffffff881bc09a70 fork_exit() at fork_exit+0x84/frame 0xffffff881bc09ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881bc09ab0 --- trap 0, rip = 0, rsp = 0xffffff881bc09b70, rbp = 0 --- Tracing command usb pid 15 tid 100116 td 0xfffffe000c895920 sched_switch() at sched_switch+0x482/frame 0xffffff881bc04920 mi_switch() at mi_switch+0x179/frame 0xffffff881bc04960 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881bc049a0 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881bc049d0 _cv_wait() at _cv_wait+0x1df/frame 0xffffff881bc04a40 usb_process() at usb_process+0xd4/frame 0xffffff881bc04a70 fork_exit() at fork_exit+0x84/frame 0xffffff881bc04ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881bc04ab0 --- trap 0, rip = 0, rsp = 0xffffff881bc04b70, rbp = 0 --- Tracing command usb pid 15 tid 100114 td 0xfffffe000c883000 sched_switch() at sched_switch+0x482/frame 0xffffff881ba73920 mi_switch() at mi_switch+0x179/frame 0xffffff881ba73960 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881ba739a0 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881ba739d0 _cv_wait() at _cv_wait+0x1df/frame 0xffffff881ba73a40 usb_process() at usb_process+0xd4/frame 0xffffff881ba73a70 fork_exit() at fork_exit+0x84/frame 0xffffff881ba73ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881ba73ab0 --- trap 0, rip = 0, rsp = 0xffffff881ba73b70, rbp = 0 --- Tracing command usb pid 15 tid 100113 td 0xfffffe000c883490 sched_switch() at sched_switch+0x482/frame 0xffffff881ba6e920 mi_switch() at mi_switch+0x179/frame 0xffffff881ba6e960 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881ba6e9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881ba6e9d0 _cv_wait() at _cv_wait+0x1df/frame 0xffffff881ba6ea40 usb_process() at usb_process+0xd4/frame 0xffffff881ba6ea70 fork_exit() at fork_exit+0x84/frame 0xffffff881ba6eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881ba6eab0 --- trap 0, rip = 0, rsp = 0xffffff881ba6eb70, rbp = 0 --- Tracing command usb pid 15 tid 100112 td 0xfffffe000c883920 sched_switch() at sched_switch+0x482/frame 0xffffff881ba69920 mi_switch() at mi_switch+0x179/frame 0xffffff881ba69960 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881ba699a0 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881ba699d0 _cv_wait() at _cv_wait+0x1df/frame 0xffffff881ba69a40 usb_process() at usb_process+0xd4/frame 0xffffff881ba69a70 fork_exit() at fork_exit+0x84/frame 0xffffff881ba69ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881ba69ab0 --- trap 0, rip = 0, rsp = 0xffffff881ba69b70, rbp = 0 --- Tracing command usb pid 15 tid 100111 td 0xfffffe000c884000 sched_switch() at sched_switch+0x482/frame 0xffffff881ba64920 mi_switch() at mi_switch+0x179/frame 0xffffff881ba64960 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881ba649a0 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881ba649d0 _cv_wait() at _cv_wait+0x1df/frame 0xffffff881ba64a40 usb_process() at usb_process+0xd4/frame 0xffffff881ba64a70 fork_exit() at fork_exit+0x84/frame 0xffffff881ba64ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881ba64ab0 --- trap 0, rip = 0, rsp = 0xffffff881ba64b70, rbp = 0 --- Tracing command usb pid 15 tid 100074 td 0xfffffe000b401920 sched_switch() at sched_switch+0x482/frame 0xffffff80002ff920 mi_switch() at mi_switch+0x179/frame 0xffffff80002ff960 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff80002ff9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff80002ff9d0 _cv_wait() at _cv_wait+0x1df/frame 0xffffff80002ffa40 usb_process() at usb_process+0xd4/frame 0xffffff80002ffa70 fork_exit() at fork_exit+0x84/frame 0xffffff80002ffab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff80002ffab0 --- trap 0, rip = 0, rsp = 0xffffff80002ffb70, rbp = 0 --- Tracing command usb pid 15 tid 100073 td 0xfffffe000c828000 sched_switch() at sched_switch+0x482/frame 0xffffff80002fa920 mi_switch() at mi_switch+0x179/frame 0xffffff80002fa960 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff80002fa9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff80002fa9d0 _cv_wait() at _cv_wait+0x1df/frame 0xffffff80002faa40 usb_process() at usb_process+0xd4/frame 0xffffff80002faa70 fork_exit() at fork_exit+0x84/frame 0xffffff80002faab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff80002faab0 --- trap 0, rip = 0, rsp = 0xffffff80002fab70, rbp = 0 --- Tracing command usb pid 15 tid 100072 td 0xfffffe000c828490 sched_switch() at sched_switch+0x482/frame 0xffffff80002f5920 mi_switch() at mi_switch+0x179/frame 0xffffff80002f5960 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff80002f59a0 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff80002f59d0 _cv_wait() at _cv_wait+0x1df/frame 0xffffff80002f5a40 usb_process() at usb_process+0xd4/frame 0xffffff80002f5a70 fork_exit() at fork_exit+0x84/frame 0xffffff80002f5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff80002f5ab0 --- trap 0, rip = 0, rsp = 0xffffff80002f5b70, rbp = 0 --- Tracing command usb pid 15 tid 100071 td 0xfffffe000c828920 sched_switch() at sched_switch+0x482/frame 0xffffff80002f0920 mi_switch() at mi_switch+0x179/frame 0xffffff80002f0960 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff80002f09a0 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff80002f09d0 _cv_wait() at _cv_wait+0x1df/frame 0xffffff80002f0a40 usb_process() at usb_process+0xd4/frame 0xffffff80002f0a70 fork_exit() at fork_exit+0x84/frame 0xffffff80002f0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff80002f0ab0 --- trap 0, rip = 0, rsp = 0xffffff80002f0b70, rbp = 0 --- Tracing command yarrow pid 14 tid 100057 td 0xfffffe000b274490 sched_switch() at sched_switch+0x482/frame 0xffffff878ad358f0 mi_switch() at mi_switch+0x179/frame 0xffffff878ad35930 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff878ad35970 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xffffff878ad359a0 msleep_spin_sbt() at msleep_spin_sbt+0x1f0/frame 0xffffff878ad35a30 random_kthread() at random_kthread+0x68/frame 0xffffff878ad35a70 fork_exit() at fork_exit+0x84/frame 0xffffff878ad35ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ad35ab0 --- trap 0, rip = 0, rsp = 0xffffff878ad35b70, rbp = 0 --- Tracing command geom pid 13 tid 100055 td 0xfffffe000b264920 sched_switch() at sched_switch+0x482/frame 0xffffff878ad2b8d0 mi_switch() at mi_switch+0x179/frame 0xffffff878ad2b910 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff878ad2b950 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff878ad2b980 _sleep() at _sleep+0x33d/frame 0xffffff878ad2ba10 g_io_schedule_down() at g_io_schedule_down+0x4c/frame 0xffffff878ad2ba60 g_down_procbody() at g_down_procbody+0x7d/frame 0xffffff878ad2ba70 fork_exit() at fork_exit+0x84/frame 0xffffff878ad2bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ad2bab0 --- trap 0, rip = 0, rsp = 0xffffff878ad2bb70, rbp = 0 --- Tracing command geom pid 13 tid 100054 td 0xfffffe000b269000 sched_switch() at sched_switch+0x482/frame 0xffffff878ad268f0 mi_switch() at mi_switch+0x179/frame 0xffffff878ad26930 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff878ad26970 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff878ad269a0 _sleep() at _sleep+0x33d/frame 0xffffff878ad26a30 g_io_schedule_up() at g_io_schedule_up+0xbc/frame 0xffffff878ad26a60 g_up_procbody() at g_up_procbody+0x7d/frame 0xffffff878ad26a70 fork_exit() at fork_exit+0x84/frame 0xffffff878ad26ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ad26ab0 --- trap 0, rip = 0, rsp = 0xffffff878ad26b70, rbp = 0 --- Tracing command geom pid 13 tid 100053 td 0xfffffe000b269490 sched_switch() at sched_switch+0x482/frame 0xffffff878ad218f0 mi_switch() at mi_switch+0x179/frame 0xffffff878ad21930 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff878ad21970 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff878ad219a0 _sleep() at _sleep+0x33d/frame 0xffffff878ad21a30 g_run_events() at g_run_events+0x4f4/frame 0xffffff878ad21a70 fork_exit() at fork_exit+0x84/frame 0xffffff878ad21ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ad21ab0 --- trap 0, rip = 0, rsp = 0xffffff878ad21b70, rbp = 0 --- Tracing command intr pid 12 tid 100122 td 0xfffffe000c9e5000 sched_switch() at sched_switch+0x482/frame 0xffffff881dc9e9f0 mi_switch() at mi_switch+0x179/frame 0xffffff881dc9ea30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff881dc9ea70 fork_exit() at fork_exit+0x84/frame 0xffffff881dc9eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881dc9eab0 --- trap 0, rip = 0, rsp = 0xffffff881dc9eb70, rbp = 0 --- Tracing command intr pid 12 tid 100121 td 0xfffffe000c9e5490 sched_switch() at sched_switch+0x482/frame 0xffffff881dc969f0 mi_switch() at mi_switch+0x179/frame 0xffffff881dc96a30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff881dc96a70 fork_exit() at fork_exit+0x84/frame 0xffffff881dc96ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881dc96ab0 --- trap 0, rip = 0, rsp = 0xffffff881dc96b70, rbp = 0 --- Tracing command intr pid 12 tid 100120 td 0xfffffe000c884490 sched_switch() at sched_switch+0x482/frame 0xffffff881bc189f0 mi_switch() at mi_switch+0x179/frame 0xffffff881bc18a30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff881bc18a70 fork_exit() at fork_exit+0x84/frame 0xffffff881bc18ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881bc18ab0 --- trap 0, rip = 0, rsp = 0xffffff881bc18b70, rbp = 0 --- Tracing command intr pid 12 tid 100115 td 0xfffffe000c875920 sched_switch() at sched_switch+0x482/frame 0xffffff881bbfb9f0 mi_switch() at mi_switch+0x179/frame 0xffffff881bbfba30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff881bbfba70 fork_exit() at fork_exit+0x84/frame 0xffffff881bbfbab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881bbfbab0 --- trap 0, rip = 0, rsp = 0xffffff881bbfbb70, rbp = 0 --- Tracing command intr pid 12 tid 100110 td 0xfffffe000c874000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100109 td 0xfffffe000c874490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100107 td 0xfffffe000c875000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100105 td 0xfffffe000c869490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100103 td 0xfffffe000c86f000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100101 td 0xfffffe000c86f920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100099 td 0xfffffe000c868000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100097 td 0xfffffe000c868920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100095 td 0xfffffe000c851000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100093 td 0xfffffe000c851920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100092 td 0xfffffe000c852000 sched_switch() at sched_switch+0x482/frame 0xffffff80003a39f0 mi_switch() at mi_switch+0x179/frame 0xffffff80003a3a30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff80003a3a70 fork_exit() at fork_exit+0x84/frame 0xffffff80003a3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff80003a3ab0 --- trap 0, rip = 0, rsp = 0xffffff80003a3b70, rbp = 0 --- Tracing command intr pid 12 tid 100090 td 0xfffffe000c84f490 sched_switch() at sched_switch+0x482/frame 0xffffff80003999f0 mi_switch() at mi_switch+0x179/frame 0xffffff8000399a30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff8000399a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000399ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000399ab0 --- trap 0, rip = 0, rsp = 0xffffff8000399b70, rbp = 0 --- Tracing command intr pid 12 tid 100088 td 0xfffffe000c850000 sched_switch() at sched_switch+0x482/frame 0xffffff800038f9f0 mi_switch() at mi_switch+0x179/frame 0xffffff800038fa30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff800038fa70 fork_exit() at fork_exit+0x84/frame 0xffffff800038fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff800038fab0 --- trap 0, rip = 0, rsp = 0xffffff800038fb70, rbp = 0 --- Tracing command intr pid 12 tid 100086 td 0xfffffe000c850920 sched_switch() at sched_switch+0x482/frame 0xffffff80003859f0 mi_switch() at mi_switch+0x179/frame 0xffffff8000385a30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff8000385a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000385ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000385ab0 --- trap 0, rip = 0, rsp = 0xffffff8000385b70, rbp = 0 --- Tracing command intr pid 12 tid 100084 td 0xfffffe000c84e000 sched_switch() at sched_switch+0x482/frame 0xffffff800037b9f0 mi_switch() at mi_switch+0x179/frame 0xffffff800037ba30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff800037ba70 fork_exit() at fork_exit+0x84/frame 0xffffff800037bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff800037bab0 --- trap 0, rip = 0, rsp = 0xffffff800037bb70, rbp = 0 --- Tracing command intr pid 12 tid 100082 td 0xfffffe000c84e920 sched_switch() at sched_switch+0x482/frame 0xffffff80003719f0 mi_switch() at mi_switch+0x179/frame 0xffffff8000371a30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff8000371a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000371ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000371ab0 --- trap 0, rip = 0, rsp = 0xffffff8000371b70, rbp = 0 --- Tracing command intr pid 12 tid 100080 td 0xfffffe000c84c000 sched_switch() at sched_switch+0x482/frame 0xffffff80003679f0 mi_switch() at mi_switch+0x179/frame 0xffffff8000367a30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff8000367a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000367ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000367ab0 --- trap 0, rip = 0, rsp = 0xffffff8000367b70, rbp = 0 --- Tracing command intr pid 12 tid 100078 td 0xfffffe000c84c920 sched_switch() at sched_switch+0x482/frame 0xffffff800035d9f0 mi_switch() at mi_switch+0x179/frame 0xffffff800035da30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff800035da70 fork_exit() at fork_exit+0x84/frame 0xffffff800035dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff800035dab0 --- trap 0, rip = 0, rsp = 0xffffff800035db70, rbp = 0 --- Tracing command intr pid 12 tid 100076 td 0xfffffe000c84d490 sched_switch() at sched_switch+0x482/frame 0xffffff80003539f0 mi_switch() at mi_switch+0x179/frame 0xffffff8000353a30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff8000353a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000353ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000353ab0 --- trap 0, rip = 0, rsp = 0xffffff8000353b70, rbp = 0 --- Tracing command intr pid 12 tid 100075 td 0xfffffe000b401490 sched_switch() at sched_switch+0x482/frame 0xffffff80003049f0 mi_switch() at mi_switch+0x179/frame 0xffffff8000304a30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff8000304a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000304ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000304ab0 --- trap 0, rip = 0, rsp = 0xffffff8000304b70, rbp = 0 --- Tracing command intr pid 12 tid 100070 td 0xfffffe000b3f3920 sched_switch() at sched_switch+0x482/frame 0xffffff80002eb9f0 mi_switch() at mi_switch+0x179/frame 0xffffff80002eba30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff80002eba70 fork_exit() at fork_exit+0x84/frame 0xffffff80002ebab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff80002ebab0 --- trap 0, rip = 0, rsp = 0xffffff80002ebb70, rbp = 0 --- Tracing command intr pid 12 tid 100069 td 0xfffffe000b400000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100068 td 0xfffffe000b400490 sched_switch() at sched_switch+0x482/frame 0xffffff878adad9f0 mi_switch() at mi_switch+0x179/frame 0xffffff878adada30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff878adada70 fork_exit() at fork_exit+0x84/frame 0xffffff878adadab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878adadab0 --- trap 0, rip = 0, rsp = 0xffffff878adadb70, rbp = 0 --- Tracing command intr pid 12 tid 100067 td 0xfffffe000b400920 sched_switch() at sched_switch+0x482/frame 0xffffff878ad679f0 mi_switch() at mi_switch+0x179/frame 0xffffff878ad67a30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff878ad67a70 fork_exit() at fork_exit+0x84/frame 0xffffff878ad67ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ad67ab0 --- trap 0, rip = 0, rsp = 0xffffff878ad67b70, rbp = 0 --- Tracing command intr pid 12 tid 100062 td 0xfffffe000b3f3000 sched_switch() at sched_switch+0x482/frame 0xffffff878ad4e9f0 mi_switch() at mi_switch+0x179/frame 0xffffff878ad4ea30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff878ad4ea70 fork_exit() at fork_exit+0x84/frame 0xffffff878ad4eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ad4eab0 --- trap 0, rip = 0, rsp = 0xffffff878ad4eb70, rbp = 0 --- Tracing command intr pid 12 tid 100061 td 0xfffffe000b3f3490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100058 td 0xfffffe000b274000 sched_switch() at sched_switch+0x482/frame 0xffffff878ad3a9f0 mi_switch() at mi_switch+0x179/frame 0xffffff878ad3aa30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff878ad3aa70 fork_exit() at fork_exit+0x84/frame 0xffffff878ad3aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ad3aab0 --- trap 0, rip = 0, rsp = 0xffffff878ad3ab70, rbp = 0 --- Tracing command intr pid 12 tid 100052 td 0xfffffe000b269920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100051 td 0xfffffe000b26a000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100050 td 0xfffffe000b263000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100049 td 0xfffffe000b263490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100048 td 0xfffffe000b263920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100047 td 0xfffffe000b264000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100046 td 0xfffffe000b264490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100045 td 0xfffffe000b25e490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100044 td 0xfffffe000b25e920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100043 td 0xfffffe000b260000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100042 td 0xfffffe000b260490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100041 td 0xfffffe000b260920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100040 td 0xfffffe000b25a920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100039 td 0xfffffe000b25d000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100038 td 0xfffffe000b25d490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100037 td 0xfffffe000b25d920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100036 td 0xfffffe000b25e000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100035 td 0xfffffe000b259000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100034 td 0xfffffe000b259490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100033 td 0xfffffe000b259920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100032 td 0xfffffe000b25a000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100031 td 0xfffffe000b25a490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100030 td 0xfffffe000b232490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100029 td 0xfffffe000b232920 sched_switch() at sched_switch+0x482/frame 0xffffff878aca99f0 mi_switch() at mi_switch+0x179/frame 0xffffff878aca9a30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff878aca9a70 fork_exit() at fork_exit+0x84/frame 0xffffff878aca9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878aca9ab0 --- trap 0, rip = 0, rsp = 0xffffff878aca9b70, rbp = 0 --- Tracing command intr pid 12 tid 100028 td 0xfffffe000b233000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100027 td 0xfffffe000b233490 sched_switch() at sched_switch+0x482/frame 0xffffff878ac9f9f0 mi_switch() at mi_switch+0x179/frame 0xffffff878ac9fa30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff878ac9fa70 fork_exit() at fork_exit+0x84/frame 0xffffff878ac9fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ac9fab0 --- trap 0, rip = 0, rsp = 0xffffff878ac9fb70, rbp = 0 --- Tracing command idle pid 11 tid 100026 td 0xfffffe000b233920 sched_switch() at sched_switch+0x482/frame 0xffffff878ac9a960 mi_switch() at mi_switch+0x179/frame 0xffffff878ac9a9a0 critical_exit() at critical_exit+0x8b/frame 0xffffff878ac9a9c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff878ac9aa70 fork_exit() at fork_exit+0x84/frame 0xffffff878ac9aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ac9aab0 --- trap 0, rip = 0, rsp = 0xffffff878ac9ab70, rbp = 0 --- Tracing command idle pid 11 tid 100025 td 0xfffffe000b230920 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff87fc5e4ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff87fc5e4d00 trap() at trap+0x42/frame 0xffffff87fc5e4f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff87fc5e4f20 --- trap 0x13, rip = 0xffffffff80c95db6, rsp = 0xffffff87fc5e4fe0, rbp = 0xffffff878ac95930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff878ac95930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff878ac95980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff878ac959a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff878ac959c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff878ac95a70 fork_exit() at fork_exit+0x84/frame 0xffffff878ac95ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ac95ab0 --- trap 0, rip = 0, rsp = 0xffffff878ac95b70, rbp = 0 --- Tracing command idle pid 11 tid 100024 td 0xfffffe000b231000 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff87fc5ddce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff87fc5ddd00 trap() at trap+0x42/frame 0xffffff87fc5ddf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff87fc5ddf20 --- trap 0x13, rip = 0xffffffff80c95db6, rsp = 0xffffff87fc5ddfe0, rbp = 0xffffff878ac90930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff878ac90930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff878ac90980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff878ac909a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff878ac909c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff878ac90a70 fork_exit() at fork_exit+0x84/frame 0xffffff878ac90ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ac90ab0 --- trap 0, rip = 0, rsp = 0xffffff878ac90b70, rbp = 0 --- Tracing command idle pid 11 tid 100023 td 0xfffffe000b231490 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff87fc5d6ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff87fc5d6d00 trap() at trap+0x42/frame 0xffffff87fc5d6f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff87fc5d6f20 --- trap 0x13, rip = 0xffffffff80c95db6, rsp = 0xffffff87fc5d6fe0, rbp = 0xffffff878ac8b930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff878ac8b930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff878ac8b980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff878ac8b9a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff878ac8b9c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff878ac8ba70 fork_exit() at fork_exit+0x84/frame 0xffffff878ac8bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ac8bab0 --- trap 0, rip = 0, rsp = 0xffffff878ac8bb70, rbp = 0 --- Tracing command idle pid 11 tid 100022 td 0xfffffe000b231920 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff87fc5cfce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff87fc5cfd00 trap() at trap+0x42/frame 0xffffff87fc5cff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff87fc5cff20 --- trap 0x13, rip = 0xffffffff80c95db6, rsp = 0xffffff87fc5cffe0, rbp = 0xffffff878ac86930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff878ac86930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff878ac86980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff878ac869a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff878ac869c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff878ac86a70 fork_exit() at fork_exit+0x84/frame 0xffffff878ac86ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ac86ab0 --- trap 0, rip = 0, rsp = 0xffffff878ac86b70, rbp = 0 --- Tracing command idle pid 11 tid 100021 td 0xfffffe000b232000 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff87fc5c8ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff87fc5c8d00 trap() at trap+0x42/frame 0xffffff87fc5c8f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff87fc5c8f20 --- trap 0x13, rip = 0xffffffff80c95db6, rsp = 0xffffff87fc5c8fe0, rbp = 0xffffff878ac81930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff878ac81930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff878ac81980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff878ac819a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff878ac819c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff878ac81a70 fork_exit() at fork_exit+0x84/frame 0xffffff878ac81ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ac81ab0 --- trap 0, rip = 0, rsp = 0xffffff878ac81b70, rbp = 0 --- Tracing command idle pid 11 tid 100020 td 0xfffffe000b22f000 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff87fc5c1ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff87fc5c1d00 trap() at trap+0x42/frame 0xffffff87fc5c1f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff87fc5c1f20 --- trap 0x13, rip = 0xffffffff80c95db6, rsp = 0xffffff87fc5c1fe0, rbp = 0xffffff878ac7c930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff878ac7c930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff878ac7c980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff878ac7c9a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff878ac7c9c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff878ac7ca70 fork_exit() at fork_exit+0x84/frame 0xffffff878ac7cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ac7cab0 --- trap 0, rip = 0, rsp = 0xffffff878ac7cb70, rbp = 0 --- Tracing command idle pid 11 tid 100019 td 0xfffffe000b22f490 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff87fc5bace0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff87fc5bad00 trap() at trap+0x42/frame 0xffffff87fc5baf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff87fc5baf20 --- trap 0x13, rip = 0xffffffff80c95db6, rsp = 0xffffff87fc5bafe0, rbp = 0xffffff878ac77930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff878ac77930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff878ac77980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff878ac779a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff878ac779c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff878ac77a70 fork_exit() at fork_exit+0x84/frame 0xffffff878ac77ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ac77ab0 --- trap 0, rip = 0, rsp = 0xffffff878ac77b70, rbp = 0 --- Tracing command idle pid 11 tid 100018 td 0xfffffe000b22f920 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff87fc5b3ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff87fc5b3d00 trap() at trap+0x42/frame 0xffffff87fc5b3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff87fc5b3f20 --- trap 0x13, rip = 0xffffffff80c95db6, rsp = 0xffffff87fc5b3fe0, rbp = 0xffffff878ac72930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff878ac72930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff878ac72980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff878ac729a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff878ac729c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff878ac72a70 fork_exit() at fork_exit+0x84/frame 0xffffff878ac72ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ac72ab0 --- trap 0, rip = 0, rsp = 0xffffff878ac72b70, rbp = 0 --- Tracing command idle pid 11 tid 100017 td 0xfffffe000b230000 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff87fc5acce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff87fc5acd00 trap() at trap+0x42/frame 0xffffff87fc5acf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff87fc5acf20 --- trap 0x13, rip = 0xffffffff80c95db6, rsp = 0xffffff87fc5acfe0, rbp = 0xffffff878ac6d930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff878ac6d930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff878ac6d980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff878ac6d9a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff878ac6d9c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff878ac6da70 fork_exit() at fork_exit+0x84/frame 0xffffff878ac6dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ac6dab0 --- trap 0, rip = 0, rsp = 0xffffff878ac6db70, rbp = 0 --- Tracing command idle pid 11 tid 100016 td 0xfffffe000b230490 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff87fc5a5ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff87fc5a5d00 trap() at trap+0x42/frame 0xffffff87fc5a5f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff87fc5a5f20 --- trap 0x13, rip = 0xffffffff80c95db6, rsp = 0xffffff87fc5a5fe0, rbp = 0xffffff878ac68930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff878ac68930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff878ac68980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff878ac689a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff878ac689c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff878ac68a70 fork_exit() at fork_exit+0x84/frame 0xffffff878ac68ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ac68ab0 --- trap 0, rip = 0, rsp = 0xffffff878ac68b70, rbp = 0 --- Tracing command idle pid 11 tid 100015 td 0xfffffe000b22d490 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff87fc59ece0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff87fc59ed00 trap() at trap+0x42/frame 0xffffff87fc59ef20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff87fc59ef20 --- trap 0x13, rip = 0xffffffff80c95db6, rsp = 0xffffff87fc59efe0, rbp = 0xffffff878ac63930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff878ac63930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff878ac63980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff878ac639a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff878ac639c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff878ac63a70 fork_exit() at fork_exit+0x84/frame 0xffffff878ac63ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ac63ab0 --- trap 0, rip = 0, rsp = 0xffffff878ac63b70, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffffe000b22d920 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff87fc597ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff87fc597d00 trap() at trap+0x42/frame 0xffffff87fc597f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff87fc597f20 --- trap 0x13, rip = 0xffffffff80c95db6, rsp = 0xffffff87fc597fe0, rbp = 0xffffff878ac5e930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff878ac5e930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff878ac5e980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff878ac5e9a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff878ac5e9c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff878ac5ea70 fork_exit() at fork_exit+0x84/frame 0xffffff878ac5eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ac5eab0 --- trap 0, rip = 0, rsp = 0xffffff878ac5eb70, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffffe000b22e000 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff87fc590ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff87fc590d00 trap() at trap+0x42/frame 0xffffff87fc590f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff87fc590f20 --- trap 0x13, rip = 0xffffffff80c95db6, rsp = 0xffffff87fc590fe0, rbp = 0xffffff878ac59930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff878ac59930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff878ac59980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff878ac599a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff878ac599c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff878ac59a70 fork_exit() at fork_exit+0x84/frame 0xffffff878ac59ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ac59ab0 --- trap 0, rip = 0, rsp = 0xffffff878ac59b70, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffffe000b22e490 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff87fc589ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff87fc589d00 trap() at trap+0x42/frame 0xffffff87fc589f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff87fc589f20 --- trap 0x13, rip = 0xffffffff80c95db6, rsp = 0xffffff87fc589fe0, rbp = 0xffffff878ac54930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff878ac54930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff878ac54980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff878ac549a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff878ac549c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff878ac54a70 fork_exit() at fork_exit+0x84/frame 0xffffff878ac54ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ac54ab0 --- trap 0, rip = 0, rsp = 0xffffff878ac54b70, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffffe000b22e920 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff87fc582ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff87fc582d00 trap() at trap+0x42/frame 0xffffff87fc582f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff87fc582f20 --- trap 0x13, rip = 0xffffffff80c95db6, rsp = 0xffffff87fc582fe0, rbp = 0xffffff878ac4f930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff878ac4f930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff878ac4f980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff878ac4f9a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff878ac4f9c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff878ac4fa70 fork_exit() at fork_exit+0x84/frame 0xffffff878ac4fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ac4fab0 --- trap 0, rip = 0, rsp = 0xffffff878ac4fb70, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffffe000b21c920 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff87fc57bce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff87fc57bd00 trap() at trap+0x42/frame 0xffffff87fc57bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff87fc57bf20 --- trap 0x13, rip = 0xffffffff80c95db6, rsp = 0xffffff87fc57bfe0, rbp = 0xffffff878ac4a930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff878ac4a930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff878ac4a980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff878ac4a9a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff878ac4a9c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff878ac4aa70 fork_exit() at fork_exit+0x84/frame 0xffffff878ac4aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ac4aab0 --- trap 0, rip = 0, rsp = 0xffffff878ac4ab70, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffffe000b22c000 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff87fc574ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff87fc574d00 trap() at trap+0x42/frame 0xffffff87fc574f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff87fc574f20 --- trap 0x13, rip = 0xffffffff80c95db6, rsp = 0xffffff87fc574fe0, rbp = 0xffffff878ac45930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff878ac45930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff878ac45980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff878ac459a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff878ac459c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff878ac45a70 fork_exit() at fork_exit+0x84/frame 0xffffff878ac45ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ac45ab0 --- trap 0, rip = 0, rsp = 0xffffff878ac45b70, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffffe000b22c490 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff87fc56dce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff87fc56dd00 trap() at trap+0x42/frame 0xffffff87fc56df20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff87fc56df20 --- trap 0x13, rip = 0xffffffff80c95db6, rsp = 0xffffff87fc56dfe0, rbp = 0xffffff878ac40930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff878ac40930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff878ac40980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff878ac409a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff878ac409c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff878ac40a70 fork_exit() at fork_exit+0x84/frame 0xffffff878ac40ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ac40ab0 --- trap 0, rip = 0, rsp = 0xffffff878ac40b70, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffffe000b22c920 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff87fc566ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff87fc566d00 trap() at trap+0x42/frame 0xffffff87fc566f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff87fc566f20 --- trap 0x13, rip = 0xffffffff80c95db6, rsp = 0xffffff87fc566fe0, rbp = 0xffffff878ac3b930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff878ac3b930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff878ac3b980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff878ac3b9a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff878ac3b9c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff878ac3ba70 fork_exit() at fork_exit+0x84/frame 0xffffff878ac3bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ac3bab0 --- trap 0, rip = 0, rsp = 0xffffff878ac3bb70, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffffe000b22d000 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff87fc55fce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff87fc55fd00 trap() at trap+0x42/frame 0xffffff87fc55ff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff87fc55ff20 --- trap 0x13, rip = 0xffffffff80c95db6, rsp = 0xffffff87fc55ffe0, rbp = 0xffffff878ac36930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff878ac36930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff878ac36980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff878ac369a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff878ac369c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff878ac36a70 fork_exit() at fork_exit+0x84/frame 0xffffff878ac36ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ac36ab0 --- trap 0, rip = 0, rsp = 0xffffff878ac36b70, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffffe000b21b000 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff87fc558ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff87fc558d00 trap() at trap+0x42/frame 0xffffff87fc558f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff87fc558f20 --- trap 0x13, rip = 0xffffffff80c95db6, rsp = 0xffffff87fc558fe0, rbp = 0xffffff878ac31930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff878ac31930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff878ac31980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff878ac319a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff878ac319c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff878ac31a70 fork_exit() at fork_exit+0x84/frame 0xffffff878ac31ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ac31ab0 --- trap 0, rip = 0, rsp = 0xffffff878ac31b70, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffffe000b21b490 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff87fc551ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff87fc551d00 trap() at trap+0x42/frame 0xffffff87fc551f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff87fc551f20 --- trap 0x13, rip = 0xffffffff80c95db6, rsp = 0xffffff87fc551fe0, rbp = 0xffffff878ac2c930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff878ac2c930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff878ac2c980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff878ac2c9a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff878ac2c9c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff878ac2ca70 fork_exit() at fork_exit+0x84/frame 0xffffff878ac2cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ac2cab0 --- trap 0, rip = 0, rsp = 0xffffff878ac2cb70, rbp = 0 --- Tracing command idle pid 11 tid 100003 td 0xfffffe000b21b920 cpustop_handler() at cpustop_handler+0x28/frame 0xffffffff81579360 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffffff81579380 trap() at trap+0x42/frame 0xffffffff815795a0 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff815795a0 --- trap 0x13, rip = 0xffffffff80c95db6, rsp = 0xffffffff81579660, rbp = 0xffffff87fc5fc930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff87fc5fc930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xffffff87fc5fc980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xffffff87fc5fc9a0 cpu_idle() at cpu_idle+0x93/frame 0xffffff87fc5fc9c0 sched_idletd() at sched_idletd+0x1e8/frame 0xffffff87fc5fca70 fork_exit() at fork_exit+0x84/frame 0xffffff87fc5fcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff87fc5fcab0 --- trap 0, rip = 0, rsp = 0xffffff87fc5fcb70, rbp = 0 --- Tracing command init pid 1 tid 100002 td 0xfffffe000b21c000 sched_switch() at sched_switch+0x482/frame 0xffffff87fc5f7560 mi_switch() at mi_switch+0x179/frame 0xffffff87fc5f75a0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff87fc5f75e0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff87fc5f7650 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff87fc5f7680 _sleep() at _sleep+0x320/frame 0xffffff87fc5f7710 kern_wait6() at kern_wait6+0x3e7/frame 0xffffff87fc5f77b0 sys_wait4() at sys_wait4+0x76/frame 0xffffff87fc5f79a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff87fc5f7ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff87fc5f7ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x4131fa, rsp = 0x7fffffffd758, rbp = 0x7fffffffd7c0 --- Tracing command audit pid 10 tid 100001 td 0xfffffe000b21c490 sched_switch() at sched_switch+0x482/frame 0xffffff87fc5f28f0 mi_switch() at mi_switch+0x179/frame 0xffffff87fc5f2930 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff87fc5f2970 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff87fc5f29a0 _cv_wait() at _cv_wait+0x1df/frame 0xffffff87fc5f2a10 audit_worker() at audit_worker+0xa3/frame 0xffffff87fc5f2a70 fork_exit() at fork_exit+0x84/frame 0xffffff87fc5f2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff87fc5f2ab0 --- trap 0, rip = 0, rsp = 0xffffff87fc5f2b70, rbp = 0 --- Tracing command kernel pid 0 tid 101937 td 0xfffffe006ced7920 sched_switch() at sched_switch+0x482/frame 0xffffff881ef94900 mi_switch() at mi_switch+0x179/frame 0xffffff881ef94940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881ef94980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881ef949b0 _sleep() at _sleep+0x33d/frame 0xffffff881ef94a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881ef94a70 fork_exit() at fork_exit+0x84/frame 0xffffff881ef94ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881ef94ab0 --- trap 0, rip = 0, rsp = 0xffffff881ef94b70, rbp = 0 --- Tracing command kernel pid 0 tid 101936 td 0xfffffe06238dd000 sched_switch() at sched_switch+0x482/frame 0xffffff881ef8f900 mi_switch() at mi_switch+0x179/frame 0xffffff881ef8f940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881ef8f980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881ef8f9b0 _sleep() at _sleep+0x33d/frame 0xffffff881ef8fa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881ef8fa70 fork_exit() at fork_exit+0x84/frame 0xffffff881ef8fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881ef8fab0 --- trap 0, rip = 0, rsp = 0xffffff881ef8fb70, rbp = 0 --- Tracing command kernel pid 0 tid 101935 td 0xfffffe04e1edd000 sched_switch() at sched_switch+0x482/frame 0xffffff881ef8a900 mi_switch() at mi_switch+0x179/frame 0xffffff881ef8a940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881ef8a980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881ef8a9b0 _sleep() at _sleep+0x33d/frame 0xffffff881ef8aa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881ef8aa70 fork_exit() at fork_exit+0x84/frame 0xffffff881ef8aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881ef8aab0 --- trap 0, rip = 0, rsp = 0xffffff881ef8ab70, rbp = 0 --- Tracing command kernel pid 0 tid 101934 td 0xfffffe04e1edd490 sched_switch() at sched_switch+0x482/frame 0xffffff881ef85900 mi_switch() at mi_switch+0x179/frame 0xffffff881ef85940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881ef85980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881ef859b0 _sleep() at _sleep+0x33d/frame 0xffffff881ef85a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881ef85a70 fork_exit() at fork_exit+0x84/frame 0xffffff881ef85ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881ef85ab0 --- trap 0, rip = 0, rsp = 0xffffff881ef85b70, rbp = 0 --- Tracing command kernel pid 0 tid 101933 td 0xfffffe04e1edd920 sched_switch() at sched_switch+0x482/frame 0xffffff881ef80900 mi_switch() at mi_switch+0x179/frame 0xffffff881ef80940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881ef80980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881ef809b0 _sleep() at _sleep+0x33d/frame 0xffffff881ef80a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881ef80a70 fork_exit() at fork_exit+0x84/frame 0xffffff881ef80ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881ef80ab0 --- trap 0, rip = 0, rsp = 0xffffff881ef80b70, rbp = 0 --- Tracing command kernel pid 0 tid 101932 td 0xfffffe018dd19000 sched_switch() at sched_switch+0x482/frame 0xffffff881ef7b900 mi_switch() at mi_switch+0x179/frame 0xffffff881ef7b940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881ef7b980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881ef7b9b0 _sleep() at _sleep+0x33d/frame 0xffffff881ef7ba40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881ef7ba70 fork_exit() at fork_exit+0x84/frame 0xffffff881ef7bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881ef7bab0 --- trap 0, rip = 0, rsp = 0xffffff881ef7bb70, rbp = 0 --- Tracing command kernel pid 0 tid 101931 td 0xfffffe018dd19490 sched_switch() at sched_switch+0x482/frame 0xffffff881ef76900 mi_switch() at mi_switch+0x179/frame 0xffffff881ef76940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881ef76980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881ef769b0 _sleep() at _sleep+0x33d/frame 0xffffff881ef76a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881ef76a70 fork_exit() at fork_exit+0x84/frame 0xffffff881ef76ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881ef76ab0 --- trap 0, rip = 0, rsp = 0xffffff881ef76b70, rbp = 0 --- Tracing command kernel pid 0 tid 101930 td 0xfffffe0338ed1490 sched_switch() at sched_switch+0x482/frame 0xffffff881ef71900 mi_switch() at mi_switch+0x179/frame 0xffffff881ef71940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881ef71980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881ef719b0 _sleep() at _sleep+0x33d/frame 0xffffff881ef71a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881ef71a70 fork_exit() at fork_exit+0x84/frame 0xffffff881ef71ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881ef71ab0 --- trap 0, rip = 0, rsp = 0xffffff881ef71b70, rbp = 0 --- Tracing command kernel pid 0 tid 101929 td 0xfffffe0338ed1920 sched_switch() at sched_switch+0x482/frame 0xffffff881ef6c900 mi_switch() at mi_switch+0x179/frame 0xffffff881ef6c940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881ef6c980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881ef6c9b0 _sleep() at _sleep+0x33d/frame 0xffffff881ef6ca40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881ef6ca70 fork_exit() at fork_exit+0x84/frame 0xffffff881ef6cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881ef6cab0 --- trap 0, rip = 0, rsp = 0xffffff881ef6cb70, rbp = 0 --- Tracing command kernel pid 0 tid 101928 td 0xfffffe01a5a61000 sched_switch() at sched_switch+0x482/frame 0xffffff881ef67900 mi_switch() at mi_switch+0x179/frame 0xffffff881ef67940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881ef67980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881ef679b0 _sleep() at _sleep+0x33d/frame 0xffffff881ef67a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881ef67a70 fork_exit() at fork_exit+0x84/frame 0xffffff881ef67ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881ef67ab0 --- trap 0, rip = 0, rsp = 0xffffff881ef67b70, rbp = 0 --- Tracing command kernel pid 0 tid 101927 td 0xfffffe01a5a61490 sched_switch() at sched_switch+0x482/frame 0xffffff881ef62900 mi_switch() at mi_switch+0x179/frame 0xffffff881ef62940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881ef62980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881ef629b0 _sleep() at _sleep+0x33d/frame 0xffffff881ef62a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881ef62a70 fork_exit() at fork_exit+0x84/frame 0xffffff881ef62ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881ef62ab0 --- trap 0, rip = 0, rsp = 0xffffff881ef62b70, rbp = 0 --- Tracing command kernel pid 0 tid 101926 td 0xfffffe01a5a61920 sched_switch() at sched_switch+0x482/frame 0xffffff881ef5d900 mi_switch() at mi_switch+0x179/frame 0xffffff881ef5d940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881ef5d980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881ef5d9b0 _sleep() at _sleep+0x33d/frame 0xffffff881ef5da40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881ef5da70 fork_exit() at fork_exit+0x84/frame 0xffffff881ef5dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881ef5dab0 --- trap 0, rip = 0, rsp = 0xffffff881ef5db70, rbp = 0 --- Tracing command kernel pid 0 tid 101925 td 0xfffffe02a5f75920 sched_switch() at sched_switch+0x482/frame 0xffffff881ef58900 mi_switch() at mi_switch+0x179/frame 0xffffff881ef58940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881ef58980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881ef589b0 _sleep() at _sleep+0x33d/frame 0xffffff881ef58a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881ef58a70 fork_exit() at fork_exit+0x84/frame 0xffffff881ef58ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881ef58ab0 --- trap 0, rip = 0, rsp = 0xffffff881ef58b70, rbp = 0 --- Tracing command kernel pid 0 tid 101924 td 0xfffffe01e1f01000 sched_switch() at sched_switch+0x482/frame 0xffffff881ef53900 mi_switch() at mi_switch+0x179/frame 0xffffff881ef53940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881ef53980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881ef539b0 _sleep() at _sleep+0x33d/frame 0xffffff881ef53a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881ef53a70 fork_exit() at fork_exit+0x84/frame 0xffffff881ef53ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881ef53ab0 --- trap 0, rip = 0, rsp = 0xffffff881ef53b70, rbp = 0 --- Tracing command kernel pid 0 tid 101923 td 0xfffffe01e1f01490 sched_switch() at sched_switch+0x482/frame 0xffffff881ef4e900 mi_switch() at mi_switch+0x179/frame 0xffffff881ef4e940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881ef4e980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881ef4e9b0 _sleep() at _sleep+0x33d/frame 0xffffff881ef4ea40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881ef4ea70 fork_exit() at fork_exit+0x84/frame 0xffffff881ef4eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881ef4eab0 --- trap 0, rip = 0, rsp = 0xffffff881ef4eb70, rbp = 0 --- Tracing command kernel pid 0 tid 101922 td 0xfffffe01e1f01920 sched_switch() at sched_switch+0x482/frame 0xffffff881ef49900 mi_switch() at mi_switch+0x179/frame 0xffffff881ef49940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881ef49980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881ef499b0 _sleep() at _sleep+0x33d/frame 0xffffff881ef49a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881ef49a70 fork_exit() at fork_exit+0x84/frame 0xffffff881ef49ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881ef49ab0 --- trap 0, rip = 0, rsp = 0xffffff881ef49b70, rbp = 0 --- Tracing command kernel pid 0 tid 101921 td 0xfffffe0338ed1000 sched_switch() at sched_switch+0x482/frame 0xffffff881ef44900 mi_switch() at mi_switch+0x179/frame 0xffffff881ef44940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881ef44980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881ef449b0 _sleep() at _sleep+0x33d/frame 0xffffff881ef44a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881ef44a70 fork_exit() at fork_exit+0x84/frame 0xffffff881ef44ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881ef44ab0 --- trap 0, rip = 0, rsp = 0xffffff881ef44b70, rbp = 0 --- Tracing command kernel pid 0 tid 101920 td 0xfffffe026aebd000 sched_switch() at sched_switch+0x482/frame 0xffffff881ef3f900 mi_switch() at mi_switch+0x179/frame 0xffffff881ef3f940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881ef3f980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881ef3f9b0 _sleep() at _sleep+0x33d/frame 0xffffff881ef3fa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881ef3fa70 fork_exit() at fork_exit+0x84/frame 0xffffff881ef3fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881ef3fab0 --- trap 0, rip = 0, rsp = 0xffffff881ef3fb70, rbp = 0 --- Tracing command kernel pid 0 tid 101919 td 0xfffffe026aebd490 sched_switch() at sched_switch+0x482/frame 0xffffff881ef3a900 mi_switch() at mi_switch+0x179/frame 0xffffff881ef3a940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881ef3a980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881ef3a9b0 _sleep() at _sleep+0x33d/frame 0xffffff881ef3aa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881ef3aa70 fork_exit() at fork_exit+0x84/frame 0xffffff881ef3aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881ef3aab0 --- trap 0, rip = 0, rsp = 0xffffff881ef3ab70, rbp = 0 --- Tracing command kernel pid 0 tid 101918 td 0xfffffe026aebd920 sched_switch() at sched_switch+0x482/frame 0xffffff881ef35900 mi_switch() at mi_switch+0x179/frame 0xffffff881ef35940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881ef35980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881ef359b0 _sleep() at _sleep+0x33d/frame 0xffffff881ef35a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881ef35a70 fork_exit() at fork_exit+0x84/frame 0xffffff881ef35ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881ef35ab0 --- trap 0, rip = 0, rsp = 0xffffff881ef35b70, rbp = 0 --- Tracing command kernel pid 0 tid 101917 td 0xfffffe02a5f75000 sched_switch() at sched_switch+0x482/frame 0xffffff881ef30900 mi_switch() at mi_switch+0x179/frame 0xffffff881ef30940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881ef30980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881ef309b0 _sleep() at _sleep+0x33d/frame 0xffffff881ef30a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881ef30a70 fork_exit() at fork_exit+0x84/frame 0xffffff881ef30ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881ef30ab0 --- trap 0, rip = 0, rsp = 0xffffff881ef30b70, rbp = 0 --- Tracing command kernel pid 0 tid 101916 td 0xfffffe02a5f75490 sched_switch() at sched_switch+0x482/frame 0xffffff881ef2b900 mi_switch() at mi_switch+0x179/frame 0xffffff881ef2b940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881ef2b980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881ef2b9b0 _sleep() at _sleep+0x33d/frame 0xffffff881ef2ba40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881ef2ba70 fork_exit() at fork_exit+0x84/frame 0xffffff881ef2bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881ef2bab0 --- trap 0, rip = 0, rsp = 0xffffff881ef2bb70, rbp = 0 --- Tracing command kernel pid 0 tid 101915 td 0xfffffe051425f490 sched_switch() at sched_switch+0x482/frame 0xffffff881ef26900 mi_switch() at mi_switch+0x179/frame 0xffffff881ef26940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881ef26980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881ef269b0 _sleep() at _sleep+0x33d/frame 0xffffff881ef26a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881ef26a70 fork_exit() at fork_exit+0x84/frame 0xffffff881ef26ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881ef26ab0 --- trap 0, rip = 0, rsp = 0xffffff881ef26b70, rbp = 0 --- Tracing command kernel pid 0 tid 101914 td 0xfffffe051425f920 sched_switch() at sched_switch+0x482/frame 0xffffff881ef21900 mi_switch() at mi_switch+0x179/frame 0xffffff881ef21940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881ef21980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881ef219b0 _sleep() at _sleep+0x33d/frame 0xffffff881ef21a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881ef21a70 fork_exit() at fork_exit+0x84/frame 0xffffff881ef21ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881ef21ab0 --- trap 0, rip = 0, rsp = 0xffffff881ef21b70, rbp = 0 --- Tracing command kernel pid 0 tid 100124 td 0xfffffe000c9e1490 kdb_enter() at kdb_enter+0x3e/frame 0xffffff881dcac980 vpanic() at vpanic+0x146/frame 0xffffff881dcac9c0 panic() at panic+0x43/frame 0xffffff881dcaca20 deadlkres() at deadlkres+0x37f/frame 0xffffff881dcaca70 fork_exit() at fork_exit+0x84/frame 0xffffff881dcacab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881dcacab0 --- trap 0, rip = 0, rsp = 0xffffff881dcacb70, rbp = 0 --- Tracing command kernel pid 0 tid 100123 td 0xfffffe000c9e1920 sched_switch() at sched_switch+0x482/frame 0xffffff881dca7900 mi_switch() at mi_switch+0x179/frame 0xffffff881dca7940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881dca7980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881dca79b0 msleep_spin_sbt() at msleep_spin_sbt+0x200/frame 0xffffff881dca7a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x8d/frame 0xffffff881dca7a70 fork_exit() at fork_exit+0x84/frame 0xffffff881dca7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881dca7ab0 --- trap 0, rip = 0, rsp = 0xffffff881dca7b70, rbp = 0 --- Tracing command kernel pid 0 tid 100108 td 0xfffffe000c874920 sched_switch() at sched_switch+0x482/frame 0xffffff881ba36900 mi_switch() at mi_switch+0x179/frame 0xffffff881ba36940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881ba36980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881ba369b0 _sleep() at _sleep+0x33d/frame 0xffffff881ba36a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881ba36a70 fork_exit() at fork_exit+0x84/frame 0xffffff881ba36ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881ba36ab0 --- trap 0, rip = 0, rsp = 0xffffff881ba36b70, rbp = 0 --- Tracing command kernel pid 0 tid 100106 td 0xfffffe000c875490 sched_switch() at sched_switch+0x482/frame 0xffffff881ba2c900 mi_switch() at mi_switch+0x179/frame 0xffffff881ba2c940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881ba2c980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881ba2c9b0 _sleep() at _sleep+0x33d/frame 0xffffff881ba2ca40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881ba2ca70 fork_exit() at fork_exit+0x84/frame 0xffffff881ba2cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881ba2cab0 --- trap 0, rip = 0, rsp = 0xffffff881ba2cb70, rbp = 0 --- Tracing command kernel pid 0 tid 100104 td 0xfffffe000c869920 sched_switch() at sched_switch+0x482/frame 0xffffff881ba22900 mi_switch() at mi_switch+0x179/frame 0xffffff881ba22940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881ba22980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881ba229b0 _sleep() at _sleep+0x33d/frame 0xffffff881ba22a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881ba22a70 fork_exit() at fork_exit+0x84/frame 0xffffff881ba22ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881ba22ab0 --- trap 0, rip = 0, rsp = 0xffffff881ba22b70, rbp = 0 --- Tracing command kernel pid 0 tid 100102 td 0xfffffe000c86f490 sched_switch() at sched_switch+0x482/frame 0xffffff881ba18900 mi_switch() at mi_switch+0x179/frame 0xffffff881ba18940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881ba18980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881ba189b0 _sleep() at _sleep+0x33d/frame 0xffffff881ba18a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881ba18a70 fork_exit() at fork_exit+0x84/frame 0xffffff881ba18ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881ba18ab0 --- trap 0, rip = 0, rsp = 0xffffff881ba18b70, rbp = 0 --- Tracing command kernel pid 0 tid 100100 td 0xfffffe000c852920 sched_switch() at sched_switch+0x482/frame 0xffffff881ba0e900 mi_switch() at mi_switch+0x179/frame 0xffffff881ba0e940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881ba0e980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881ba0e9b0 _sleep() at _sleep+0x33d/frame 0xffffff881ba0ea40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881ba0ea70 fork_exit() at fork_exit+0x84/frame 0xffffff881ba0eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881ba0eab0 --- trap 0, rip = 0, rsp = 0xffffff881ba0eb70, rbp = 0 --- Tracing command kernel pid 0 tid 100098 td 0xfffffe000c868490 sched_switch() at sched_switch+0x482/frame 0xffffff881ba04900 mi_switch() at mi_switch+0x179/frame 0xffffff881ba04940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881ba04980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881ba049b0 _sleep() at _sleep+0x33d/frame 0xffffff881ba04a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881ba04a70 fork_exit() at fork_exit+0x84/frame 0xffffff881ba04ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881ba04ab0 --- trap 0, rip = 0, rsp = 0xffffff881ba04b70, rbp = 0 --- Tracing command kernel pid 0 tid 100096 td 0xfffffe000c869000 sched_switch() at sched_switch+0x482/frame 0xffffff80003f7900 mi_switch() at mi_switch+0x179/frame 0xffffff80003f7940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff80003f7980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff80003f79b0 _sleep() at _sleep+0x33d/frame 0xffffff80003f7a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff80003f7a70 fork_exit() at fork_exit+0x84/frame 0xffffff80003f7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff80003f7ab0 --- trap 0, rip = 0, rsp = 0xffffff80003f7b70, rbp = 0 --- Tracing command kernel pid 0 tid 100094 td 0xfffffe000c851490 sched_switch() at sched_switch+0x482/frame 0xffffff80003ed900 mi_switch() at mi_switch+0x179/frame 0xffffff80003ed940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff80003ed980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff80003ed9b0 _sleep() at _sleep+0x33d/frame 0xffffff80003eda40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff80003eda70 fork_exit() at fork_exit+0x84/frame 0xffffff80003edab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff80003edab0 --- trap 0, rip = 0, rsp = 0xffffff80003edb70, rbp = 0 --- Tracing command kernel pid 0 tid 100091 td 0xfffffe000c852490 sched_switch() at sched_switch+0x482/frame 0xffffff800039e900 mi_switch() at mi_switch+0x179/frame 0xffffff800039e940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff800039e980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff800039e9b0 _sleep() at _sleep+0x33d/frame 0xffffff800039ea40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff800039ea70 fork_exit() at fork_exit+0x84/frame 0xffffff800039eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff800039eab0 --- trap 0, rip = 0, rsp = 0xffffff800039eb70, rbp = 0 --- Tracing command kernel pid 0 tid 100089 td 0xfffffe000c84f920 sched_switch() at sched_switch+0x482/frame 0xffffff8000394900 mi_switch() at mi_switch+0x179/frame 0xffffff8000394940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8000394980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff80003949b0 _sleep() at _sleep+0x33d/frame 0xffffff8000394a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff8000394a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000394ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000394ab0 --- trap 0, rip = 0, rsp = 0xffffff8000394b70, rbp = 0 --- Tracing command kernel pid 0 tid 100087 td 0xfffffe000c850490 sched_switch() at sched_switch+0x482/frame 0xffffff800038a900 mi_switch() at mi_switch+0x179/frame 0xffffff800038a940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff800038a980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff800038a9b0 _sleep() at _sleep+0x33d/frame 0xffffff800038aa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff800038aa70 fork_exit() at fork_exit+0x84/frame 0xffffff800038aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff800038aab0 --- trap 0, rip = 0, rsp = 0xffffff800038ab70, rbp = 0 --- Tracing command kernel pid 0 tid 100085 td 0xfffffe000c84d920 sched_switch() at sched_switch+0x482/frame 0xffffff8000380900 mi_switch() at mi_switch+0x179/frame 0xffffff8000380940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8000380980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff80003809b0 _sleep() at _sleep+0x33d/frame 0xffffff8000380a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff8000380a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000380ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000380ab0 --- trap 0, rip = 0, rsp = 0xffffff8000380b70, rbp = 0 --- Tracing command kernel pid 0 tid 100083 td 0xfffffe000c84e490 sched_switch() at sched_switch+0x482/frame 0xffffff8000376900 mi_switch() at mi_switch+0x179/frame 0xffffff8000376940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8000376980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff80003769b0 _sleep() at _sleep+0x33d/frame 0xffffff8000376a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff8000376a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000376ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000376ab0 --- trap 0, rip = 0, rsp = 0xffffff8000376b70, rbp = 0 --- Tracing command kernel pid 0 tid 100081 td 0xfffffe000c84f000 sched_switch() at sched_switch+0x482/frame 0xffffff800036c900 mi_switch() at mi_switch+0x179/frame 0xffffff800036c940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff800036c980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff800036c9b0 _sleep() at _sleep+0x33d/frame 0xffffff800036ca40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff800036ca70 fork_exit() at fork_exit+0x84/frame 0xffffff800036cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff800036cab0 --- trap 0, rip = 0, rsp = 0xffffff800036cb70, rbp = 0 --- Tracing command kernel pid 0 tid 100079 td 0xfffffe000c84c490 sched_switch() at sched_switch+0x482/frame 0xffffff8000362900 mi_switch() at mi_switch+0x179/frame 0xffffff8000362940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8000362980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff80003629b0 _sleep() at _sleep+0x33d/frame 0xffffff8000362a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff8000362a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000362ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000362ab0 --- trap 0, rip = 0, rsp = 0xffffff8000362b70, rbp = 0 --- Tracing command kernel pid 0 tid 100077 td 0xfffffe000c84d000 sched_switch() at sched_switch+0x482/frame 0xffffff8000358900 mi_switch() at mi_switch+0x179/frame 0xffffff8000358940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8000358980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff80003589b0 _sleep() at _sleep+0x33d/frame 0xffffff8000358a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff8000358a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000358ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000358ab0 --- trap 0, rip = 0, rsp = 0xffffff8000358b70, rbp = 0 --- Tracing command kernel pid 0 tid 100066 td 0xfffffe000b401000 sched_switch() at sched_switch+0x482/frame 0xffffff878ad62900 mi_switch() at mi_switch+0x179/frame 0xffffff878ad62940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff878ad62980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff878ad629b0 msleep_spin_sbt() at msleep_spin_sbt+0x200/frame 0xffffff878ad62a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x8d/frame 0xffffff878ad62a70 fork_exit() at fork_exit+0x84/frame 0xffffff878ad62ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ad62ab0 --- trap 0, rip = 0, rsp = 0xffffff878ad62b70, rbp = 0 --- Tracing command kernel pid 0 tid 100065 td 0xfffffe000b3ef000 sched_switch() at sched_switch+0x482/frame 0xffffff878ad5d900 mi_switch() at mi_switch+0x179/frame 0xffffff878ad5d940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff878ad5d980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff878ad5d9b0 msleep_spin_sbt() at msleep_spin_sbt+0x200/frame 0xffffff878ad5da40 taskqueue_thread_loop() at taskqueue_thread_loop+0x8d/frame 0xffffff878ad5da70 fork_exit() at fork_exit+0x84/frame 0xffffff878ad5dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ad5dab0 --- trap 0, rip = 0, rsp = 0xffffff878ad5db70, rbp = 0 --- Tracing command kernel pid 0 tid 100064 td 0xfffffe000b3ef490 sched_switch() at sched_switch+0x482/frame 0xffffff878ad58900 mi_switch() at mi_switch+0x179/frame 0xffffff878ad58940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff878ad58980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff878ad589b0 msleep_spin_sbt() at msleep_spin_sbt+0x200/frame 0xffffff878ad58a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x8d/frame 0xffffff878ad58a70 fork_exit() at fork_exit+0x84/frame 0xffffff878ad58ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ad58ab0 --- trap 0, rip = 0, rsp = 0xffffff878ad58b70, rbp = 0 --- Tracing command kernel pid 0 tid 100063 td 0xfffffe000b3ef920 sched_switch() at sched_switch+0x482/frame 0xffffff878ad53900 mi_switch() at mi_switch+0x179/frame 0xffffff878ad53940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff878ad53980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff878ad539b0 _sleep() at _sleep+0x33d/frame 0xffffff878ad53a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff878ad53a70 fork_exit() at fork_exit+0x84/frame 0xffffff878ad53ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ad53ab0 --- trap 0, rip = 0, rsp = 0xffffff878ad53b70, rbp = 0 --- Tracing command kernel pid 0 tid 100060 td 0xfffffe000b26a490 sched_switch() at sched_switch+0x482/frame 0xffffff878ad44900 mi_switch() at mi_switch+0x179/frame 0xffffff878ad44940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff878ad44980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff878ad449b0 _sleep() at _sleep+0x33d/frame 0xffffff878ad44a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff878ad44a70 fork_exit() at fork_exit+0x84/frame 0xffffff878ad44ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ad44ab0 --- trap 0, rip = 0, rsp = 0xffffff878ad44b70, rbp = 0 --- Tracing command kernel pid 0 tid 100059 td 0xfffffe000b26a920 sched_switch() at sched_switch+0x482/frame 0xffffff878ad3f900 mi_switch() at mi_switch+0x179/frame 0xffffff878ad3f940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff878ad3f980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff878ad3f9b0 _sleep() at _sleep+0x33d/frame 0xffffff878ad3fa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff878ad3fa70 fork_exit() at fork_exit+0x84/frame 0xffffff878ad3fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ad3fab0 --- trap 0, rip = 0, rsp = 0xffffff878ad3fb70, rbp = 0 --- Tracing command kernel pid 0 tid 100056 td 0xfffffe000b274920 sched_switch() at sched_switch+0x482/frame 0xffffff878ad30900 mi_switch() at mi_switch+0x179/frame 0xffffff878ad30940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff878ad30980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff878ad309b0 _sleep() at _sleep+0x33d/frame 0xffffff878ad30a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff878ad30a70 fork_exit() at fork_exit+0x84/frame 0xffffff878ad30ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff878ad30ab0 --- trap 0, rip = 0, rsp = 0xffffff878ad30b70, rbp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xffffffff815d05e0 sched_switch() at sched_switch+0x482/frame 0xffffffff8189c9e0 mi_switch() at mi_switch+0x179/frame 0xffffffff8189ca20 sleepq_switch() at sleepq_switch+0x185/frame 0xffffffff8189ca60 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xffffffff8189ca90 _sleep() at _sleep+0x312/frame 0xffffffff8189cb20 swapper() at swapper+0x211/frame 0xffffffff8189cb70 btext() at btext+0x2c db:0:allt> call doadump Dumping 2729 out of 31644 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% Dump complete = 0 db:0:doadump> reset cpu_reset: Restarting BSP cpu_reset_proxy: Stopped CPU 23 (kgdb) proc 95840 [Switching to thread 204 (Thread 100410)]#0 sched_switch (td=0xfffffe043ed5d920, newtd=, flags=) at ../../../kern/sched_ule.c:1954 1954 cpuid = PCPU_GET(cpuid); (kgdb) bt #0 sched_switch (td=0xfffffe043ed5d920, newtd=, flags=) at ../../../kern/sched_ule.c:1954 #1 0xffffffff808c4079 in mi_switch (flags=0x104, newtd=0x0) at ../../../kern/kern_synch.c:493 #2 0xffffffff808fe235 in sleepq_switch (wchan=, pri=) at ../../../kern/subr_sleepqueue.c:541 #3 0xffffffff808fe063 in sleepq_wait (wchan=0xfffffe043916e7b8, pri=0x60) at ../../../kern/subr_sleepqueue.c:620 #4 0xffffffff8089f07a in sleeplk (lk=, flags=, ilk=, wmesg=0xffffffff80f67d86 "ufs", pri=, timo=) at ../../../kern/kern_lock.c:226 #5 0xffffffff8089e388 in __lockmgr_args (lk=0xfffffe043916e7b8, flags=, ilk=0xfffffe043916e880, wmesg=0xffffffff80f67d86 "ufs", pri=0x60, timo=0x33, file=0xa3812e75b8
, line=) at ../../../kern/kern_lock.c:672 #6 0xffffffff80b12a62 in ffs_lock (ap=0xffffff881e5b2310) at lockmgr.h:97 #7 0xffffffff80d5d935 in VOP_LOCK1_APV (vop=, a=) at vnode_if.c:2084 #8 0xffffffff80976f26 in _vn_lock (vp=0xfffffe043916e750, flags=, file=0xffffffff80f8aaf9 "../../../kern/vfs_subr.c", line=0x869) at vnode_if.h:859 #9 0xffffffff80961359 in vget (vp=0xfffffe043916e750, flags=0x200100, td=0xfffffe043ed5d920) at ../../../kern/vfs_subr.c:2153 #10 0xffffffff80953a85 in vfs_hash_get (mp=0xfffffe0015d7a3c8, hash=0x55b907, flags=, td=0xfffffe043ed5d920, vpp=0xffffff881e5b2520, fn=0, arg=) at ../../../kern/vfs_hash.c:88 #11 0xffffffff80b0df61 in ffs_vgetf (mp=0xfffffe0015d7a3c8, ino=0x55b907, flags=0x200000, vpp=0xffffff881e5b2520, ffs_flags=0x0) at ../../../ufs/ffs/ffs_vfsops.c:1672 #12 0xffffffff80b1b818 in ufs_lookup_ino (vdp=0xfffffe030d86cc30, vpp=0xffffff881e5b2868, cnp=0xffffff881e5b2890, dd_ino=0x0) at ../../../ufs/ufs/ufs_lookup.c:749 #13 0xffffffff80d5aaf8 in VOP_CACHEDLOOKUP_APV (vop=, a=) at vnode_if.c:197 #14 0xffffffff8094cf5f in vfs_cache_lookup (ap=) at vnode_if.h:80 #15 0xffffffff80d5a948 in VOP_LOOKUP_APV (vop=, a=) at vnode_if.c:129 #16 0xffffffff80955390 in lookup (ndp=0xffffff881e5b2810) at vnode_if.h:54 #17 0xffffffff80954aa4 in namei (ndp=0xffffff881e5b2810) at ../../../kern/vfs_lookup.c:293 #18 0xffffffff80971db9 in kern_statat_vnhook (td=0xfffffe043ed5d920, flag=, fd=0x0, path=0x80101eb08
, pathseg=UIO_USERSPACE, sbp=0xffffff881e5b2920, hook=) at ../../../kern/vfs_syscalls.c:2318 #19 0xffffffff80971f30 in sys_lstat (td=0x0, uap=0xffffff881e5b2a40) at ../../../kern/vfs_syscalls.c:2299 #20 0xffffffff80cb2b62 in amd64_syscall (td=0xfffffe043ed5d920, traced=0x0) at subr_syscall.c:134 #21 0xffffffff80c9af2b in Xfast_syscall () at ../../../amd64/amd64/exception.S:391 #22 0x0000000800933e1a in ?? () Previous frame inner to this frame (corrupt stack?) (kgdb) f 9 #9 0xffffffff80961359 in vget (vp=0xfffffe043916e750, flags=0x200100, td=0xfffffe043ed5d920) at ../../../kern/vfs_subr.c:2153 2153 if ((error = vn_lock(vp, flags | LK_INTERLOCK)) != 0) { (kgdb) l 2148 CTR3(KTR_VFS, "%s: vp %p with flags %d", __func__, vp, flags); 2149 2150 if ((flags & LK_INTERLOCK) == 0) 2151 VI_LOCK(vp); 2152 vholdl(vp); 2153 if ((error = vn_lock(vp, flags | LK_INTERLOCK)) != 0) { 2154 vdrop(vp); 2155 CTR2(KTR_VFS, "%s: impossible to lock vnode %p", __func__, 2156 vp); 2157 return (error); (kgdb) p *vp $1 = {v_tag = 0xffffffff80f67d86 "ufs", v_op = 0xffffffff81322de0, v_data = 0xfffffe04680943f0, v_mount = 0xfffffe0015d7a3c8, v_nmntvnodes = {tqe_next = 0x0, tqe_prev = 0xfffffe030d86cc50}, v_un = {vu_mount = 0x0, vu_socket = 0x0, vu_cdev = 0x0, vu_fifoinfo = 0x0}, v_hashlist = {le_next = 0x0, le_prev = 0xffffff80013a83d0}, v_cache_src = {lh_first = 0x0}, v_cache_dst = {tqh_first = 0x0, tqh_last = 0xfffffe043916e7a0}, v_cache_dd = 0x0, v_lock = {lock_object = {lo_name = 0xffffffff80f67d86 "ufs", lo_flags = 0x6fb0000, lo_data = 0x0, lo_witness = 0xffffff80006d8080}, lk_lock = 0xfffffe0015082922, lk_exslpfail = 0x0, lk_timo = 0x33, lk_pri = 0x60, lk_stack = {depth = 0xc, pcs = {0xffffffff8089e699, 0xffffffff80b12a62, 0xffffffff80d5d935, 0xffffffff80976f26, 0xffffffff80961359, 0xffffffff80953a85, 0xffffffff80b0df61, 0xffffffff80af5c86, 0xffffffff80af4ab3, 0xffffffff80b0cc84, 0xffffffff8088a804, 0xffffffff80c9b17e, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0}}}, v_interlock = {lock_object = { lo_name = 0xffffffff80f82799 "vnode interlock", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xffffff80006bd600}, mtx_lock = 0x4}, v_vnlock = 0xfffffe043916e7b8, v_actfreelist = {tqe_next = 0xfffffe0362ec59c0, tqe_prev = 0xfffffe030d86cd88}, v_bufobj = {bo_lock = {lock_object = { lo_name = 0xffffffff80f8ab63 "bufobj interlock", lo_flags = 0x5230000, lo_data = 0x0, lo_witness = 0xffffff80006c6480}, rw_lock = 0x1}, bo_ops = 0xffffffff812f38a0, bo_object = 0x0, bo_synclist = {le_next = 0x0, le_prev = 0xfffffe030d86cdc8}, bo_private = 0xfffffe043916e750, __bo_vnode = 0xfffffe043916e750, bo_clean = {bv_hd = {tqh_first = 0x0, tqh_last = 0xfffffe043916e908}, bv_root = {pt_root = 0x0}, bv_cnt = 0x0}, bo_dirty = {bv_hd = {tqh_first = 0xffffff8786999c50, tqh_last = 0xffffff8786999ca0}, bv_root = {pt_root = 0xffffff8786999dc9}, bv_cnt = 0x1}, bo_numoutput = 0x0, bo_flag = 0x1, bo_bsize = 0x8000}, v_pollinfo = 0x0, v_label = 0x0, v_lockf = 0x0, v_rl = {rl_waiters = {tqh_first = 0x0, tqh_last = 0xfffffe043916e970}, rl_currdep = 0x0}, v_cstart = 0x0, v_lasta = 0x0, v_lastw = 0x0, v_clen = 0x0, v_holdcnt = 0x3, v_usecount = 0x1, v_iflag = 0x200, v_vflag = 0x0, v_writecount = 0x0, v_hash = 0x55b907, v_type = VDIR} (kgdb) (kgdb) proc 17 [Switching to thread 159 (Thread 100134)]#0 sched_switch (td=0xfffffe0015082920, newtd=, flags=) at ../../../kern/sched_ule.c:1954 1954 cpuid = PCPU_GET(cpuid); (kgdb) bt #0 sched_switch (td=0xfffffe0015082920, newtd=, flags=) at ../../../kern/sched_ule.c:1954 #1 0xffffffff808c4079 in mi_switch (flags=0x104, newtd=0x0) at ../../../kern/kern_synch.c:493 #2 0xffffffff808fe235 in sleepq_switch (wchan=, pri=) at ../../../kern/subr_sleepqueue.c:541 #3 0xffffffff808fe063 in sleepq_wait (wchan=0xfffffe030d86cc98, pri=0x60) at ../../../kern/subr_sleepqueue.c:620 #4 0xffffffff8089f07a in sleeplk (lk=, flags=, ilk=, wmesg=0xffffffff80f67d86 "ufs", pri=, timo=) at ../../../kern/kern_lock.c:226 #5 0xffffffff8089e64c in __lockmgr_args (lk=0xfffffe030d86cc98, flags=, ilk=0xfffffe030d86cd60, wmesg=0xffffffff80f67d86 "ufs", pri=0x60, timo=0x33, file=0xffffffff815162c8 "`Í\206\r\003þÿÿù\234ø\200ÿÿÿÿV", line=) at ../../../kern/kern_lock.c:919 #6 0xffffffff80b12a62 in ffs_lock (ap=0xffffff881dea2700) at lockmgr.h:97 #7 0xffffffff80d5d935 in VOP_LOCK1_APV (vop=, a=) at vnode_if.c:2084 #8 0xffffffff80976f26 in _vn_lock (vp=0xfffffe030d86cc30, flags=, file=0xffffffff80f8aaf9 "../../../kern/vfs_subr.c", line=0x869) at vnode_if.h:859 #9 0xffffffff80961359 in vget (vp=0xfffffe030d86cc30, flags=0x80100, td=0xfffffe0015082920) at ../../../kern/vfs_subr.c:2153 #10 0xffffffff80953a85 in vfs_hash_get (mp=0xfffffe0015d7a3c8, hash=0x55b906, flags=, td=0xfffffe0015082920, vpp=0xffffff881dea28f0, fn=0, arg=) at ../../../kern/vfs_hash.c:88 #11 0xffffffff80b0df61 in ffs_vgetf (mp=0xfffffe0015d7a3c8, ino=0x55b906, flags=0x80000, vpp=0xffffff881dea28f0, ffs_flags=0x1) at ../../../ufs/ffs/ffs_vfsops.c:1672 #12 0xffffffff80b0750a in softdep_sync_buf (vp=0xfffffe043916e750, bp=0xffffff8786999c50, waitfor=0x1) at ../../../ufs/ffs/ffs_softdep.c:12725 #13 0xffffffff80b137d8 in ffs_syncvnode (vp=0xfffffe043916e750, waitfor=0x1, flags=0x0) at ../../../ufs/ffs/ffs_vnops.c:271 #14 0xffffffff80af5cac in clear_inodedeps () at ../../../ufs/ffs/ffs_softdep.c:13177 #15 0xffffffff80af4ab3 in softdep_process_worklist (mp=0xfffffe0015d7a3c8, full=0x0) at ../../../ufs/ffs/ffs_softdep.c:1594 #16 0xffffffff80b0cc84 in softdep_flush () at ../../../ufs/ffs/ffs_softdep.c:1444 #17 0xffffffff8088a804 in fork_exit (callout=0xffffffff80b0cb80 , arg=0x0, frame=0xffffff881dea2ac0) at ../../../kern/kern_fork.c:989 #18 0xffffffff80c9b17e in fork_trampoline () at ../../../amd64/amd64/exception.S:606 #19 0x0000000000000000 in ?? () (kgdb) f 5 #5 0xffffffff8089e64c in __lockmgr_args (lk=0xfffffe030d86cc98, flags=, ilk=0xfffffe030d86cd60, wmesg=0xffffffff80f67d86 "ufs", pri=0x60, timo=0x33, file=0xffffffff815162c8 "`Í\206\r\003þÿÿù\234ø\200ÿÿÿÿV", line=) at ../../../kern/kern_lock.c:919 919 error = sleeplk(lk, flags, ilk, iwmesg, ipri, itimo, (kgdb) p *lk $2 = {lock_object = {lo_name = 0xffffffff80f67d86 "ufs", lo_flags = 0x6fb0000, lo_data = 0x0, lo_witness = 0xffffff80006d8080}, lk_lock = 0x15, lk_exslpfail = 0x0, lk_timo = 0x33, lk_pri = 0x60, lk_stack = {depth = 0xa, pcs = {0xffffffff8089eda7, 0xffffffff80b12a62, 0xffffffff80d5d935, 0xffffffff80976f26, 0xffffffff80954ef7, 0xffffffff80954aa4, 0xffffffff80971db9, 0xffffffff80971f30, 0xffffffff80cb2b62, 0xffffffff80c9af2b, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0}}} (kgdb) l *0xffffffff8089eda7 0xffffffff8089eda7 is in __lockmgr_args (../../../kern/kern_lock.c:693). 688 line); 689 WITNESS_LOCK(&lk->lock_object, LK_TRYWIT(flags), file, 690 line); 691 TD_LOCKS_INC(curthread); 692 TD_SLOCKS_INC(curthread); 693 STACK_SAVE(lk); 694 } 695 break; 696 case LK_UPGRADE: 697 _lockmgr_assert(lk, KA_SLOCKED, file, line); (kgdb) l *0xffffffff80b12a62 0xffffffff80b12a62 is in ffs_lock (../../../ufs/ffs/ffs_vnops.c:375). 370 for (;;) { 371 #ifdef DEBUG_VFS_LOCKS 372 KASSERT(vp->v_holdcnt != 0, 373 ("ffs_lock %p: zero hold count", vp)); 374 #endif 375 lkp = vp->v_vnlock; 376 result = _lockmgr_args(lkp, flags, VI_MTX(vp), 377 LK_WMESG_DEFAULT, LK_PRIO_DEFAULT, LK_TIMO_DEFAULT, 378 ap->a_file, ap->a_line); 379 if (lkp == vp->v_vnlock || result != 0) (kgdb) l *0xffffffff80d5d935 0xffffffff80d5d935 is in VOP_LOCK1_APV (vnode_if.c:2084). 2079 KTR_START4(KTR_VOP, "VOP", "VOP_LOCK1", (uintptr_t)a, 2080 "vp:0x%jX", (uintptr_t)a->a_vp, "flags:0x%jX", a->a_flags, "file:0x%jX", a->a_file, "line:0x%jX", a->a_line); 2081 vop_lock_pre(a); 2082 VFS_PROLOGUE(a->a_vp->v_mount); 2083 if (vop->vop_lock1 != NULL) 2084 rc = vop->vop_lock1(a); 2085 else 2086 rc = vop->vop_bypass(&a->a_gen); 2087 VFS_EPILOGUE(a->a_vp->v_mount); 2088 SDT_PROBE(vfs, vop, vop_lock1, return, a->a_vp, a, rc, 0, 0); (kgdb) l *0xffffffff80976f26 0xffffffff80976f26 is in _vn_lock (vnode_if.h:859). 854 a.a_gen.a_desc = &vop_lock1_desc; 855 a.a_vp = vp; 856 a.a_flags = flags; 857 a.a_file = file; 858 a.a_line = line; 859 return (VOP_LOCK1_APV(vp->v_op, &a)); 860 } 861 862 struct vop_unlock_args { 863 struct vop_generic_args a_gen; (kgdb) l *0xffffffff80954ef7 0xffffffff80954ef7 is in lookup (../../../kern/vfs_lookup.c:659). 654 dp == rootvnode || 655 pr != NULL || 656 ((dp->v_vflag & VV_ROOT) != 0 && 657 (cnp->cn_flags & NOCROSSMOUNT) != 0)) { 658 ndp->ni_dvp = dp; 659 ndp->ni_vp = dp; 660 VREF(dp); 661 goto nextname; 662 } 663 if ((dp->v_vflag & VV_ROOT) == 0) (kgdb) l *0xffffffff80954aa4 0xffffffff80954aa4 is in namei (../../../kern/vfs_lookup.c:293). 288 } 289 dp = ndp->ni_rootdir; 290 VREF(dp); 291 } 292 ndp->ni_startdir = dp; 293 error = lookup(ndp); 294 if (error) { 295 uma_zfree(namei_zone, cnp->cn_pnbuf); 296 #ifdef DIAGNOSTIC 297 cnp->cn_pnbuf = NULL; (kgdb) l *0xffffffff80971db9 0xffffffff80971db9 is in kern_statat_vnhook (../../../kern/vfs_syscalls.c:2318). 2313 2314 NDINIT_ATRIGHTS(&nd, LOOKUP, ((flag & AT_SYMLINK_NOFOLLOW) ? NOFOLLOW : 2315 FOLLOW) | LOCKSHARED | LOCKLEAF | AUDITVNODE1, pathseg, path, fd, 2316 CAP_FSTAT, td); 2317 2318 if ((error = namei(&nd)) != 0) 2319 return (error); 2320 error = vn_stat(nd.ni_vp, &sb, td->td_ucred, NOCRED, td); 2321 if (!error) { 2322 SDT_PROBE(vfs, , stat, mode, path, sb.st_mode, 0, 0, 0); (kgdb) l *0xffffffff80971f30 0xffffffff80971f30 is in sys_lstat (../../../kern/vfs_syscalls.c:2299). 2294 int 2295 kern_statat(struct thread *td, int flag, int fd, char *path, 2296 enum uio_seg pathseg, struct stat *sbp) 2297 { 2298 2299 return (kern_statat_vnhook(td, flag, fd, path, pathseg, sbp, NULL)); 2300 } 2301 2302 int 2303 kern_statat_vnhook(struct thread *td, int flag, int fd, char *path, (kgdb) $ svn diff -x -p /usr/src/sys Index: /usr/src/sys/amd64/amd64/pmap.c =================================================================== --- /usr/src/sys/amd64/amd64/pmap.c (revision 254401) +++ /usr/src/sys/amd64/amd64/pmap.c (working copy) @@ -1938,6 +1938,9 @@ pmap_release(pmap_t pmap) KASSERT(vm_radix_is_empty(&pmap->pm_root), ("pmap_release: pmap has reserved page table page(s)")); + rw_wlock(&pvh_global_lock); + rw_wunlock(&pvh_global_lock); + m = PHYS_TO_VM_PAGE(pmap->pm_pml4[PML4PML4I] & PG_FRAME); pmap->pm_pml4[KPML4I] = 0; /* KVA */ Index: /usr/src/sys/kern/subr_vmem.c =================================================================== --- /usr/src/sys/kern/subr_vmem.c (revision 254401) +++ /usr/src/sys/kern/subr_vmem.c (working copy) @@ -54,6 +54,7 @@ __FBSDID("$FreeBSD$"); #include #include #include +#include #include #include @@ -167,6 +168,9 @@ struct vmem_btag { #define BT_END(bt) ((bt)->bt_start + (bt)->bt_size - 1) #if defined(DIAGNOSTIC) +static int do_vmem_check = 1; +SYSCTL_INT(_debug, OID_AUTO, do_vmem_check, CTLFLAG_RW, + &do_vmem_check, 0, "Enable vmem check"); static void vmem_check(vmem_t *); #endif @@ -720,9 +724,11 @@ vmem_periodic(void *unused, int pending) LIST_FOREACH(vm, &vmem_list, vm_alllist) { #ifdef DIAGNOSTIC /* Convenient time to verify vmem state. */ - VMEM_LOCK(vm); - vmem_check(vm); - VMEM_UNLOCK(vm); + if (do_vmem_check == 1) { + VMEM_LOCK(vm); + vmem_check(vm); + VMEM_UNLOCK(vm); + } #endif desired = 1 << flsl(vm->vm_nbusytag); desired = MIN(MAX(desired, VMEM_HASHSIZE_MIN), Index: /usr/src/sys/kern/vfs_subr.c =================================================================== --- /usr/src/sys/kern/vfs_subr.c (revision 254401) +++ /usr/src/sys/kern/vfs_subr.c (working copy) @@ -136,9 +136,29 @@ int vttoif_tab[10] = { }; /* - * List of vnodes that are ready for recycling. + * There are two free lists of vnodes that are ready for recycling. + * + * The vnode_nopages_free_list contains vnodes that have no pages + * associated with them in the virtual-memory cache. These vnodes + * can be freed in the context of the process running getnewvnode + * as they do not do any operations that could deadlock. + * + * The vnode_haspages_free_list contains vnodes that have one or more + * pages associated with them in the virtual-memory cache. These vnodes + * can only be freed in a separate context that can block for locks, + * resource allocation, and I/O operations. + * + * The vnodes not on one of these two lists are active and are held on + * a list headed by the mount structure of the filesystem with which + * they are associated. + * + * When we need to reclaim vnodes, we prefer to recycle those with no + * associated pages since recycling a vnode that has pages will cause + * the identity of all of those pages to be lost. */ -static TAILQ_HEAD(freelst, vnode) vnode_free_list; +TAILQ_HEAD(freelst, vnode); +static struct freelst vnode_haspages_free_list; +static struct freelst vnode_nopages_free_list; /* * Free vnode target. Free vnodes may simply be files which have been stat'd @@ -147,7 +167,7 @@ int vttoif_tab[10] = { */ static u_long wantfreevnodes; SYSCTL_ULONG(_vfs, OID_AUTO, wantfreevnodes, CTLFLAG_RW, &wantfreevnodes, 0, ""); -/* Number of vnodes in the free list. */ +/* Number of vnodes in the nopages free list. */ static u_long freevnodes; SYSCTL_ULONG(_vfs, OID_AUTO, freevnodes, CTLFLAG_RD, &freevnodes, 0, "Number of vnodes in the free list"); @@ -176,7 +196,9 @@ static struct mtx mntid_mtx; /* * Lock for any access to the following: - * vnode_free_list + * mount structure mnt_activevnodelist + * vnode_haspages_free_list + * vnode_nopages_free_list * numvnodes * freevnodes */ @@ -275,14 +297,6 @@ static int vnlru_nowhere; SYSCTL_INT(_debug, OID_AUTO, vnlru_nowhere, CTLFLAG_RW, &vnlru_nowhere, 0, "Number of times the vnlru process ran without success"); -/* - * Macros to control when a vnode is freed and recycled. All require - * the vnode interlock. - */ -#define VCANRECYCLE(vp) (((vp)->v_iflag & VI_FREE) && !(vp)->v_holdcnt) -#define VSHOULDFREE(vp) (!((vp)->v_iflag & VI_FREE) && !(vp)->v_holdcnt) -#define VSHOULDBUSY(vp) (((vp)->v_iflag & VI_FREE) && (vp)->v_holdcnt) - /* Shift count for (uintptr_t)vp to initialize vp->v_hash. */ static int vnsz2log; @@ -343,7 +357,8 @@ vntblinit(void *dummy __unused) } wantfreevnodes = desiredvnodes / 4; mtx_init(&mntid_mtx, "mntid", NULL, MTX_DEF); - TAILQ_INIT(&vnode_free_list); + TAILQ_INIT(&vnode_nopages_free_list); + TAILQ_INIT(&vnode_haspages_free_list); mtx_init(&vnode_free_list_mtx, "vnode_free_list", NULL, MTX_DEF); vnode_zone = uma_zcreate("VNODE", sizeof (struct vnode), NULL, NULL, NULL, NULL, UMA_ALIGN_PTR, 0); @@ -676,13 +691,13 @@ vattr_null(struct vattr *vap) /* * This routine is called when we have too many vnodes. It attempts - * to free vnodes and will potentially free vnodes that still + * to free vnodes and will potentially free vnodes that still * have VM backing store (VM backing store is typically the cause * of a vnode blowout so we want to do this). Therefore, this operation * is not considered cheap. * * A number of conditions may prevent a vnode from being reclaimed. - * the buffer cache may have references on the vnode, a directory + * The buffer cache may have references on the vnode, a directory * vnode may still have references due to the namei cache representing * underlying files, or the vnode may be in active use. It is not * desireable to reuse such vnodes. These conditions may cause the @@ -690,13 +705,13 @@ vattr_null(struct vattr *vap) * you set kern.maxvnodes to. Do not set kern.maxvnodes too low. */ static int -vlrureclaim(struct mount *mp) +vlrureclaim(int wantfreed) { struct vnode *vp; + struct mount *mp; int done; int trigger; int usevnodes; - int count; /* * Calculate the trigger point, don't allow user @@ -710,20 +725,33 @@ static int usevnodes = 1; trigger = cnt.v_page_count * 2 / usevnodes; done = 0; - vn_start_write(NULL, &mp, V_WAIT); - MNT_ILOCK(mp); - count = mp->mnt_nvnodelistsize / 10 + 1; - while (count != 0) { - vp = TAILQ_FIRST(&mp->mnt_nvnodelist); - while (vp != NULL && vp->v_type == VMARKER) - vp = TAILQ_NEXT(vp, v_nmntvnodes); - if (vp == NULL) + while (wantfreed > done) { + if (should_yield()) + kern_yield(PRI_USER); + mtx_lock(&vnode_free_list_mtx); + vp = TAILQ_FIRST(&vnode_haspages_free_list); + /* + * The list can be modified while the free_list_mtx + * has been dropped and vp could be NULL here. + */ + if (vp == NULL) { + mtx_unlock(&vnode_free_list_mtx); break; - TAILQ_REMOVE(&mp->mnt_nvnodelist, vp, v_nmntvnodes); - TAILQ_INSERT_TAIL(&mp->mnt_nvnodelist, vp, v_nmntvnodes); - --count; + } + VNASSERT(vp->v_op != NULL, vp, + ("vnlru_free: vnode already reclaimed.")); + KASSERT((vp->v_iflag & VI_FREE_HASPAGES) != 0, + ("Removing vnode not on freelist")); + KASSERT((vp->v_iflag & VI_ACTIVE) == 0, + ("Mangling active vnode")); + TAILQ_REMOVE(&vnode_haspages_free_list, vp, v_actfreelist); + TAILQ_INSERT_TAIL(&vnode_haspages_free_list, vp, v_actfreelist); + mtx_unlock(&vnode_free_list_mtx); + /* + * Don't recycle if we can't get the interlock. + */ if (!VI_TRYLOCK(vp)) - goto next_iter; + continue; /* * If it's been deconstructed already, it's still * referenced, or it exceeds the trigger, skip it. @@ -734,14 +762,23 @@ static int (vp->v_iflag & VI_DOOMED) != 0 || (vp->v_object != NULL && vp->v_object->resident_page_count > trigger)) { VI_UNLOCK(vp); - goto next_iter; + continue; } - MNT_IUNLOCK(mp); vholdl(vp); if (VOP_LOCK(vp, LK_INTERLOCK|LK_EXCLUSIVE|LK_NOWAIT)) { vdrop(vp); - goto next_iter_mntunlocked; + continue; } + /* + * We have to do the vn_start_write before acquiring the + * vnode interlock. Otherwise, we would do it only after + * checking the resident_page_count > trigger below. + */ + if (vn_start_write(vp, &mp, V_NOWAIT) != 0) { + VOP_UNLOCK(vp, LK_INTERLOCK); + vdrop(vp); + continue; + } VI_LOCK(vp); /* * v_usecount may have been bumped after VOP_LOCK() dropped @@ -760,9 +797,10 @@ static int !LIST_EMPTY(&(vp)->v_cache_src)) || (vp->v_object != NULL && vp->v_object->resident_page_count > trigger)) { + vn_finished_write(mp); VOP_UNLOCK(vp, LK_INTERLOCK); vdrop(vp); - goto next_iter_mntunlocked; + continue; } KASSERT((vp->v_iflag & VI_DOOMED) == 0, ("VI_DOOMED unexpectedly detected in vlrureclaim()")); @@ -770,22 +808,9 @@ static int VOP_UNLOCK(vp, 0); vdropl(vp); done++; -next_iter_mntunlocked: - if (!should_yield()) - goto relock_mnt; - goto yield; -next_iter: - if (!should_yield()) - continue; - MNT_IUNLOCK(mp); -yield: - kern_yield(PRI_USER); -relock_mnt: - MNT_ILOCK(mp); + vn_finished_write(mp); } - MNT_IUNLOCK(mp); - vn_finished_write(mp); - return done; + return (done); } /* @@ -798,7 +823,7 @@ vnlru_free(int count) mtx_assert(&vnode_free_list_mtx, MA_OWNED); for (; count > 0; count--) { - vp = TAILQ_FIRST(&vnode_free_list); + vp = TAILQ_FIRST(&vnode_nopages_free_list); /* * The list can be modified while the free_list_mtx * has been dropped and vp could be NULL here. @@ -807,22 +832,28 @@ vnlru_free(int count) break; VNASSERT(vp->v_op != NULL, vp, ("vnlru_free: vnode already reclaimed.")); - KASSERT((vp->v_iflag & VI_FREE) != 0, - ("Removing vnode not on freelist")); - KASSERT((vp->v_iflag & VI_ACTIVE) == 0, + KASSERT((vp->v_iflag & VI_FREE_NOPAGES) != 0, + ("Removing vnode not on nopages freelist")); + KASSERT((vp->v_iflag & (VI_ACTIVE|VI_FREE_HASPAGES)) == 0, ("Mangling active vnode")); - TAILQ_REMOVE(&vnode_free_list, vp, v_actfreelist); + TAILQ_REMOVE(&vnode_nopages_free_list, vp, v_actfreelist); /* * Don't recycle if we can't get the interlock. */ if (!VI_TRYLOCK(vp)) { - TAILQ_INSERT_TAIL(&vnode_free_list, vp, v_actfreelist); + TAILQ_INSERT_TAIL(&vnode_nopages_free_list, vp, + v_actfreelist); continue; } - VNASSERT(VCANRECYCLE(vp), vp, - ("vp inconsistent on freelist")); + VNASSERT(vp->v_holdcnt == 0, vp, + ("vp inconsistent on nopages freelist")); freevnodes--; - vp->v_iflag &= ~VI_FREE; + /* + * We have removed the vnode from the nopages freelist and + * clear the flag indicating that it is there so that the + * vholdl below will not move it to the haspages freelist. + */ + vp->v_iflag &= ~VI_FREE_NOPAGES; vholdl(vp); mtx_unlock(&vnode_free_list_mtx); VI_UNLOCK(vp); @@ -829,8 +860,10 @@ vnlru_free(int count) vtryrecycle(vp); /* * If the recycled succeeded this vdrop will actually free - * the vnode. If not it will simply place it back on - * the free list. + * the vnode. If it failed because it was activated via vget + * then it will be on an active list and vdrop will leave it + * there. Otherwise vdrop will place it back on the nopages + * freelist. */ vdrop(vp); mtx_lock(&vnode_free_list_mtx); @@ -847,8 +880,7 @@ static int vnlruproc_sig; static void vnlru_proc(void) { - struct mount *mp, *nmp; - int done; + int wantfreed, done; struct proc *p = vnlruproc; EVENTHANDLER_REGISTER(shutdown_pre_sync, kproc_shutdown, p, @@ -859,7 +891,8 @@ vnlru_proc(void) mtx_lock(&vnode_free_list_mtx); if (freevnodes > wantfreevnodes) vnlru_free(freevnodes - wantfreevnodes); - if (numvnodes <= desiredvnodes * 9 / 10) { + wantfreed = numvnodes - (desiredvnodes * 9 / 10); + if (wantfreed <= 0) { vnlruproc_sig = 0; wakeup(&vnlruproc_sig); msleep(vnlruproc, &vnode_free_list_mtx, @@ -867,19 +900,7 @@ vnlru_proc(void) continue; } mtx_unlock(&vnode_free_list_mtx); - done = 0; - mtx_lock(&mountlist_mtx); - for (mp = TAILQ_FIRST(&mountlist); mp != NULL; mp = nmp) { - if (vfs_busy(mp, MBF_NOWAIT | MBF_MNTLSTLOCK)) { - nmp = TAILQ_NEXT(mp, mnt_list); - continue; - } - done += vlrureclaim(mp); - mtx_lock(&mountlist_mtx); - nmp = TAILQ_NEXT(mp, mnt_list); - vfs_unbusy(mp); - } - mtx_unlock(&mountlist_mtx); + done = vlrureclaim(wantfreed); if (done == 0) { #if 0 /* These messages are temporary debugging aids */ @@ -922,7 +943,7 @@ vtryrecycle(struct vnode *vp) VNASSERT(vp->v_holdcnt, vp, ("vtryrecycle: Recycling vp %p without a reference.", vp)); /* - * This vnode may found and locked via some other list, if so we + * This vnode may be found and locked via some other list, if so we * can't recycle it yet. */ if (VOP_LOCK(vp, LK_EXCLUSIVE | LK_NOWAIT) != 0) { @@ -1124,7 +1145,6 @@ static void delmntque(struct vnode *vp) { struct mount *mp; - int active; mp = vp->v_mount; if (mp == NULL) @@ -1134,13 +1154,20 @@ delmntque(struct vnode *vp) KASSERT(mp->mnt_activevnodelistsize <= mp->mnt_nvnodelistsize, ("Active vnode list size %d > Vnode list size %d", mp->mnt_activevnodelistsize, mp->mnt_nvnodelistsize)); - active = vp->v_iflag & VI_ACTIVE; - vp->v_iflag &= ~VI_ACTIVE; - if (active) { + /* + * Delete from active or haspages freelist if on either. + */ + if (vp->v_iflag & VI_ACTIVE) { mtx_lock(&vnode_free_list_mtx); + vp->v_iflag &= ~VI_ACTIVE; TAILQ_REMOVE(&mp->mnt_activevnodelist, vp, v_actfreelist); mp->mnt_activevnodelistsize--; mtx_unlock(&vnode_free_list_mtx); + } else if (vp->v_iflag & VI_FREE_HASPAGES) { + mtx_lock(&vnode_free_list_mtx); + vp->v_iflag &= ~VI_FREE_HASPAGES; + TAILQ_REMOVE(&vnode_haspages_free_list, vp, v_actfreelist); + mtx_unlock(&vnode_free_list_mtx); } vp->v_mount = NULL; VI_UNLOCK(vp); @@ -2022,8 +2049,12 @@ v_incr_usecount(struct vnode *vp) static void v_upgrade_usecount(struct vnode *vp) { + struct mount *mp; CTR2(KTR_VFS, "%s: vp %p", __func__, vp); + ASSERT_VI_LOCKED(vp, "v_upgrade_usecount"); + VNASSERT((vp->v_iflag & VI_FREE_NOPAGES) == 0, vp, + ("vnode on nopages list with v_holdcnt > 0")); vp->v_usecount++; if (vp->v_type == VCHR && vp->v_rdev != NULL) { dev_lock(); @@ -2030,6 +2061,29 @@ v_upgrade_usecount(struct vnode *vp) vp->v_rdev->si_usecount++; dev_unlock(); } + /* + * If the vnode is already active, nothing more to do. + */ + if (vp->v_iflag & VI_ACTIVE) + return; + /* + * Remove the vnode from the haspages free list and put + * it on the active list. If vnlru_free is trying to free + * the vnode, it will have removed it from the nopages freelist, + * so the bump in holdcnt will not have moved it to haspages. + * Our activating it here will cause vnlru_free's attempt + * to free it to fail and it will leave it on the active list. + */ + mtx_lock(&vnode_free_list_mtx); + if (vp->v_iflag & VI_FREE_HASPAGES) { + vp->v_iflag &= ~VI_FREE_HASPAGES; + TAILQ_REMOVE(&vnode_haspages_free_list, vp, v_actfreelist); + } + vp->v_iflag |= VI_ACTIVE; + mp = vp->v_mount; + TAILQ_INSERT_HEAD(&mp->mnt_activevnodelist, vp, v_actfreelist); + mp->mnt_activevnodelistsize++; + mtx_unlock(&vnode_free_list_mtx); } /* @@ -2279,7 +2333,8 @@ vhold(struct vnode *vp) } /* - * Increase the hold count and activate if this is the first reference. + * Increase the hold count and promote to haspages free list or active list + * if this is the first reference. */ void vholdl(struct vnode *vp) @@ -2288,25 +2343,58 @@ vholdl(struct vnode *vp) CTR2(KTR_VFS, "%s: vp %p", __func__, vp); vp->v_holdcnt++; - if (!VSHOULDBUSY(vp)) + /* + * If not yet on any list, this is either a vnode being freed + * by vnlru_free or it is a new vnode that will be put onto the + * active list by insmntque(). + */ + if ((vp->v_iflag & (VI_ACTIVE|VI_FREE_HASPAGES|VI_FREE_NOPAGES)) == 0) return; + /* + * If already active, nothing to do. + */ + if (vp->v_iflag & VI_ACTIVE) + return; ASSERT_VI_LOCKED(vp, "vholdl"); - VNASSERT((vp->v_iflag & VI_FREE) != 0, vp, ("vnode not free")); VNASSERT(vp->v_op != NULL, vp, ("vholdl: vnode already reclaimed.")); /* - * Remove a vnode from the free list, mark it as in use, - * and put it on the active list. + * If we already have pages, then just check to see if v_usecount > 0 + * should cause us to upgrade to active. */ + if (vp->v_iflag & VI_FREE_HASPAGES) { + if (vp->v_usecount == 0) + return; + /* + * Remove a vnode from the haspages free list and put + * it on the active list. + */ + mtx_lock(&vnode_free_list_mtx); + vp->v_iflag &= ~VI_FREE_HASPAGES; + TAILQ_REMOVE(&vnode_haspages_free_list, vp, v_actfreelist); + vp->v_iflag |= VI_ACTIVE; + mp = vp->v_mount; + TAILQ_INSERT_HEAD(&mp->mnt_activevnodelist, vp, v_actfreelist); + mp->mnt_activevnodelistsize++; + mtx_unlock(&vnode_free_list_mtx); + return; + } + /* + * Remove a vnode from the nopages free list and put + * it on the haspages free list or the active list. + */ mtx_lock(&vnode_free_list_mtx); - TAILQ_REMOVE(&vnode_free_list, vp, v_actfreelist); + vp->v_iflag &= ~VI_FREE_NOPAGES; + TAILQ_REMOVE(&vnode_nopages_free_list, vp, v_actfreelist); freevnodes--; - vp->v_iflag &= ~(VI_FREE|VI_AGE); - KASSERT((vp->v_iflag & VI_ACTIVE) == 0, - ("Activating already active vnode")); - vp->v_iflag |= VI_ACTIVE; - mp = vp->v_mount; - TAILQ_INSERT_HEAD(&mp->mnt_activevnodelist, vp, v_actfreelist); - mp->mnt_activevnodelistsize++; + if (vp->v_usecount == 0) { + vp->v_iflag |= VI_FREE_HASPAGES; + TAILQ_INSERT_TAIL(&vnode_haspages_free_list, vp, v_actfreelist); + } else { + vp->v_iflag |= VI_ACTIVE; + mp = vp->v_mount; + TAILQ_INSERT_HEAD(&mp->mnt_activevnodelist, vp, v_actfreelist); + mp->mnt_activevnodelistsize++; + } mtx_unlock(&vnode_free_list_mtx); } @@ -2324,8 +2412,8 @@ vdrop(struct vnode *vp) /* * Drop the hold count of the vnode. If this is the last reference to - * the vnode we place it on the free list unless it has been vgone'd - * (marked VI_DOOMED) in which case we will free it. + * the vnode we place it on the nopages freelist unless it has been + * vgone'd (marked VI_DOOMED) in which case we will free it. */ void vdropl(struct vnode *vp) @@ -2332,7 +2420,6 @@ vdropl(struct vnode *vp) { struct bufobj *bo; struct mount *mp; - int active; ASSERT_VI_LOCKED(vp, "vdropl"); CTR2(KTR_VFS, "%s: vp %p", __func__, vp); @@ -2340,37 +2427,66 @@ vdropl(struct vnode *vp) panic("vdrop: holdcnt %d", vp->v_holdcnt); vp->v_holdcnt--; if (vp->v_holdcnt > 0) { + /* + * If not on any list, this is a dummy vnode such as the + * crossmp or a marker and no list moving is necessary. + * If it is active and v_usecount > 0 or it is already on + * the haspages free list then there is nothing more to do. + */ + if ((vp->v_iflag & + (VI_ACTIVE|VI_FREE_HASPAGES|VI_FREE_NOPAGES)) == 0 || + ((vp->v_iflag & VI_ACTIVE) && vp->v_usecount > 0) || + (vp->v_iflag & VI_FREE_HASPAGES)) { + VI_UNLOCK(vp); + return; + } + /* + * Move from the active list to the haspages free list. + */ + mtx_lock(&vnode_free_list_mtx); + vp->v_iflag &= ~VI_ACTIVE; + mp = vp->v_mount; + TAILQ_REMOVE(&mp->mnt_activevnodelist, vp, v_actfreelist); + mp->mnt_activevnodelistsize--; + vp->v_iflag |= VI_FREE_HASPAGES; + TAILQ_INSERT_TAIL(&vnode_haspages_free_list, vp, v_actfreelist); + mtx_unlock(&vnode_free_list_mtx); VI_UNLOCK(vp); return; } if ((vp->v_iflag & VI_DOOMED) == 0) { /* - * Mark a vnode as free: remove it from its active list - * and put it up for recycling on the freelist. + * Mark a vnode as having no pages. Move it from its active + * list or haspages freelist to the nopages freelist. If + * called from vnlru_free then it will be on no list, so + * just add it back to the nopages list. */ VNASSERT(vp->v_op != NULL, vp, ("vdropl: vnode already reclaimed.")); - VNASSERT((vp->v_iflag & VI_FREE) == 0, vp, + VNASSERT((vp->v_iflag & VI_FREE_NOPAGES) == 0, vp, ("vnode already free")); - VNASSERT(VSHOULDFREE(vp), vp, - ("vdropl: freeing when we shouldn't")); - active = vp->v_iflag & VI_ACTIVE; - vp->v_iflag &= ~VI_ACTIVE; - mp = vp->v_mount; mtx_lock(&vnode_free_list_mtx); - if (active) { + if (vp->v_iflag & VI_ACTIVE) { + vp->v_iflag &= ~VI_ACTIVE; + mp = vp->v_mount; TAILQ_REMOVE(&mp->mnt_activevnodelist, vp, v_actfreelist); mp->mnt_activevnodelistsize--; + } else if (vp->v_iflag & VI_FREE_HASPAGES) { + vp->v_iflag &= ~VI_FREE_HASPAGES; + TAILQ_REMOVE(&vnode_haspages_free_list, vp, + v_actfreelist); } + vp->v_iflag |= VI_FREE_NOPAGES; if (vp->v_iflag & VI_AGE) { - TAILQ_INSERT_HEAD(&vnode_free_list, vp, v_actfreelist); + TAILQ_INSERT_HEAD(&vnode_nopages_free_list, vp, + v_actfreelist); } else { - TAILQ_INSERT_TAIL(&vnode_free_list, vp, v_actfreelist); + TAILQ_INSERT_TAIL(&vnode_nopages_free_list, vp, + v_actfreelist); } freevnodes++; vp->v_iflag &= ~VI_AGE; - vp->v_iflag |= VI_FREE; mtx_unlock(&vnode_free_list_mtx); VI_UNLOCK(vp); return; @@ -2383,8 +2499,12 @@ vdropl(struct vnode *vp) numvnodes--; mtx_unlock(&vnode_free_list_mtx); bo = &vp->v_bufobj; - VNASSERT((vp->v_iflag & VI_FREE) == 0, vp, - ("cleaned vnode still on the free list.")); + VNASSERT((vp->v_iflag & VI_FREE_NOPAGES) == 0, vp, + ("cleaned vnode still on the nopages free list.")); + VNASSERT((vp->v_iflag & VI_FREE_HASPAGES) == 0, vp, + ("cleaned vnode still on the haspages free list.")); + VNASSERT((vp->v_iflag & VI_ACTIVE) == 0, vp, + ("cleaned vnode still on the active list.")); VNASSERT(vp->v_data == NULL, vp, ("cleaned vnode isn't")); VNASSERT(vp->v_holdcnt == 0, vp, ("Non-zero hold count")); VNASSERT(vp->v_usecount == 0, vp, ("Non-zero use count")); @@ -2872,8 +2992,10 @@ vn_printf(struct vnode *vp, const char *fmt, ...) strlcat(buf, "|VI_AGE", sizeof(buf)); if (vp->v_iflag & VI_DOOMED) strlcat(buf, "|VI_DOOMED", sizeof(buf)); - if (vp->v_iflag & VI_FREE) - strlcat(buf, "|VI_FREE", sizeof(buf)); + if (vp->v_iflag & VI_FREE_NOPAGES) + strlcat(buf, "|VI_FREE_NOPAGES", sizeof(buf)); + if (vp->v_iflag & VI_FREE_HASPAGES) + strlcat(buf, "|VI_FREE_HASPAGES", sizeof(buf)); if (vp->v_iflag & VI_ACTIVE) strlcat(buf, "|VI_ACTIVE", sizeof(buf)); if (vp->v_iflag & VI_DOINGINACT) @@ -2880,8 +3002,8 @@ vn_printf(struct vnode *vp, const char *fmt, ...) strlcat(buf, "|VI_DOINGINACT", sizeof(buf)); if (vp->v_iflag & VI_OWEINACT) strlcat(buf, "|VI_OWEINACT", sizeof(buf)); - flags = vp->v_iflag & ~(VI_MOUNT | VI_AGE | VI_DOOMED | VI_FREE | - VI_ACTIVE | VI_DOINGINACT | VI_OWEINACT); + flags = vp->v_iflag & ~(VI_MOUNT | VI_AGE | VI_DOOMED | VI_ACTIVE | + VI_FREE_HASPAGES | VI_FREE_NOPAGES | VI_DOINGINACT | VI_OWEINACT); if (flags != 0) { snprintf(buf2, sizeof(buf2), "|VI(0x%lx)", flags); strlcat(buf, buf2, sizeof(buf)); Index: /usr/src/sys/sys/vnode.h =================================================================== --- /usr/src/sys/sys/vnode.h (revision 254401) +++ /usr/src/sys/sys/vnode.h (working copy) @@ -233,10 +233,11 @@ struct xvnode { * are required for writing but the status may be checked with either. */ #define VI_MOUNT 0x0020 /* Mount in progress */ -#define VI_AGE 0x0040 /* Insert vnode at head of free list */ -#define VI_DOOMED 0x0080 /* This vnode is being recycled */ -#define VI_FREE 0x0100 /* This vnode is on the freelist */ +#define VI_DOOMED 0x0040 /* This vnode is being recycled */ +#define VI_FREE_NOPAGES 0x0080 /* This vnode is on the nopages freelist */ +#define VI_FREE_HASPAGES 0x100 /* This vnode is on the haspages freelist */ #define VI_ACTIVE 0x0200 /* This vnode is on the active list */ +#define VI_AGE 0x0400 /* Insert vnode at head of free list */ #define VI_DOINGINACT 0x0800 /* VOP_INACTIVE is in progress */ #define VI_OWEINACT 0x1000 /* Need to call inactive */ -- Test scenario: rename3.sh