GENERIC HEAD from 2015-01-27 07:20:00 UTC, r277792, vmcore.290 GDB: no debug ports present KDB: debugger backends: ddb KDB: current backend: ddb Copyright (c) 1992-2015 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 11.0-CURRENT #1 r277792: Tue Jan 27 10:09:14 CET 2015 pho@t1.osted.lan:/usr/src/sys/amd64/compile/NOQUOTA amd64 FreeBSD clang version 3.5.1 (tags/RELEASE_351/final 225668) 20150115 WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. VT: running with driver "vga". CPU: Intel(R) Xeon(R) CPU E5-2620 0 @ 2.00GHz (1995.24-MHz K8-class CPU) Origin="GenuineIntel" Id=0x206d7 Family=0x6 Model=0x2d Stepping=7 Features=0xbfebfbff Features2=0x1fbee3ff AMD Features=0x2c100800 AMD Features2=0x1 XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID TSC: P-state invariant, performance statistics real memory = 68719476736 (65536 MB) avail memory = 32143908864 (30654 MB) : Trying to mount root from ufs:/dev/da0p2 [rw]... Setting hostuuid: 3141f787-07e3-e111-b968-001e6756c168. Setting hostid: 0x564ac5b6. Starting ddb. Starting file system checks: /dev/da0p2: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/da0p2: clean, 66723426 free (449266 frags, 8284270 blocks, 0.5% fragmentation) /dev/da0p3: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/da0p3: clean, 21550353 free (1409 frags, 2693618 blocks, 0.0% fragmentation) Mounting local file systems:. Setting hostname: t1.osted.lan. Feeding entropy:. Starting Network: lo0 igb0 igb1. lo0: flags=8049 metric 0 mtu 16384 options=600003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x3 inet 127.0.0.1 netmask 0xff000000 nd6 options=21 groups: lo igb0: flags=8843 metric 0 mtu 1500 options=403bb ether 00:1e:67:56:c1:68 inet 192.168.1.108 netmask 0xffffff00 broadcast 192.168.1.255 inet6 fe80::21e:67ff:fe56:c168%igb0 prefixlen 64 scopeid 0x1 nd6 options=23 media: Ethernet autoselect (1000baseT ) status: active igb1: flags=8c02 metric 0 mtu 1500 options=403bb ether 00:1e:67:56:c1:69 nd6 options=29 media: Ethernet autoselect status: no carrier Starting devd. Starting Network: igb1. igb1: flags=8c02 metric 0 mtu 1500 options=403bb ether 00:1e:67:56:c1:69 nd6 options=29 media: Ethernet autoselect status: no carrier Configuring vt: keymap. ums0: on usbus2 ums0: 3 buttons and [Z] coordinates ID=0 Starting ums0 moused. Starting pflogd: add net default: gateway 192.168.1.1 add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Starting rtsold. ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat /usr/local/lib/gcc46 /usr/local/lib/gcc47 /usr/local/lib/gcc48 /usr/local/lib/gcc49 /usr/local/lib/nss /usr/local/lib/qt4 32-bit compatibility ldconfig path: /usr/lib32 /usr/local/lib32/compat Creating and/or trimming log files. Starting syslogd. No core dumps found. Starting rpcbind. NFS access cache time=60 Starting casperd. lock order reversal: 1st 0xfffffe0785c76710 bufwait (bufwait) @ kern/vfs_bio.c:3097 2nd 0xfffff8004f72b800 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:285 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe081db9b380 witness_checkorder() at witness_checkorder+0xe50/frame 0xfffffe081db9b410 _sx_xlock() at _sx_xlock+0x75/frame 0xfffffe081db9b450 ufsdirhash_add() at ufsdirhash_add+0x4a/frame 0xfffffe081db9b490 ufs_direnter() at ufs_direnter+0x6c3/frame 0xfffffe081db9b550 ufs_mkdir() at ufs_mkdir+0x7c2/frame 0xfffffe081db9b740 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x115/frame 0xfffffe081db9b770 kern_mkdirat() at kern_mkdirat+0x1fd/frame 0xfffffe081db9b9a0 amd64_syscall() at amd64_syscall+0x276/frame 0xfffffe081db9bab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081db9bab0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x80094f5fa, rsp = 0x7fffffffe788, rbp = 0x7fffffffec70 --- Clearing /tmp (X related). Starting nfsuserd. Starting mountd. Starting nfsd. Recovering vi editor sessions:. Updating motd:. Mounting late file systems:. Starting ntpd. Starting powerd. Starting saslauthd. Starting default mousedmoused: unable to open /dev/psm0: No such file or directory . Configuring vt: keymap blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting sendmail_submit. Starting sendmail_msp_queue. Starting cron. Local package initialization:Jan 27 10:19:51 t1 su: pho to root on /dev/pts/0 backup. Starting inetd. Tue Jan 27 10:19:56 CET 2015 FreeBSD/amd64 (t1.osted.lan) (ttyu1) login: lock order reversal: 1st 0xfffffe0785c19b90 bufwait (bufwait) @ vm/vm_pager.c:335 2nd 0xfffff80119e02548 ufs (ufs) @ dev/md/md.c:778 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe081e08b6c0 witness_checkorder() at witness_checkorder+0xe50/frame 0xfffffe081e08b750 __lockmgr_args() at __lockmgr_args+0xadb/frame 0xfffffe081e08b880 ffs_lock() at ffs_lock+0x92/frame 0xfffffe081e08b8d0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xfc/frame 0xfffffe081e08b900 _vn_lock() at _vn_lock+0xa2/frame 0xfffffe081e08b970 mdstart_vnode() at mdstart_vnode+0x2ff/frame 0xfffffe081e08ba20 md_kthread() at md_kthread+0x18d/frame 0xfffffe081e08ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe081e08bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081e08bab0 --- trap 0, rip = 0, rsp = 0xfffffe081e08bb70, rbp = 0 --- Stopping inetd. Waiting for PIDS: 899. Shutting down local packages:. Stopping cron. Waiting for PIDS: 791. Stopping sshd. Waiting for PIDS: 781. Stopping saslauthd. Waiting for PIDS: 728. Stopping powerd. Waiting for PIDS: 712. Stopping ntpd. Waiting for PIDS: 709. Stopping nfsd. Waiting for PIDS: 671 673, 673. Stopping mountd. Waiting for PIDS: 665. Stopping nfsuserd. Waiting for PIDS: 654 655 656 657 659. Stopping casperd. Waiting for PIDS: 637. Stopping rpcbind. Waiting for PIDS: 622. Stopping rtsold. Waiting for PIDS: 480. Stopping devd. Waiting for PIDS: 444. Writing entropy file:. . Terminated Jan 27 10:20:50 t1 syslogd: exiting on signal 15 Jan 27 10:21:10 init: some processes would not die; ps axl advised Enter full pathname of shell or RETURN for /bin/sh: # ps -l UID PID PPID CPU PRI NI VSZ RSS MWCHAN STAT TT TIME COMMAND 0 1328 1 0 20 0 17116 3456 wait Ss u1 0:00.01 -sh (sh) 0 1329 1328 0 20 0 18700 2308 - R+ u1 0:00.00 ps -l 0 1037 1 0 20 0 12308 1984 mount dr D 0- 0:00.01 umount /mnt # KDB: enter: Break to debugger [ thread pid 11 tid 100004 ] Stopped at kdb_alt_break_internal+0x197: movq $0,kdb_why db> show mount 0xfffff8001257cb58 /dev/da0p2 on / (ufs) 0xfffff8001257d000 devfs on /dev (devfs) 0xfffff800220033c8 /dev/da0p3 on /tmp (ufs) 0xfffff80012f91790 procfs on /proc (procfs) 0xfffff8011b0e0000 /dev/md5a on /mnt (ufs) More info: show mount db> show mount 0xfffff8011b0e0000 0xfffff8011b0e0000 /dev/md5a on /mnt (ufs) mnt_flag = SOFTDEP, EXPORTED, DEFEXPORTED, LOCAL mnt_kern_flag = SOFTDEP, NOINSMNTQ, DRAINING, EXTENDED_SHARED, NO_IOPF, NOASYNC, UNMOUNT, LOOKUP_SHARED, 0x20002000 mnt_opt = rw, fstype, fspath, from, errmsg mnt_stat = { version=537068824 type=53 flags=0x0000000000201300 bsize=4096 iosize=32768 blocks=12293 bfree=6970 bavail=5987 files=6654 ffree=6630 syncwrites=2 asyncwrites=209 syncreads=6 asyncreads=0 namemax=255 owner=0 fsid=[1422350397, -47415575] } mnt_cred = { uid=0 ruid=0 } mnt_ref = 26 mnt_gen = 1 mnt_nvnodelistsize = 24 mnt_activevnodelistsize = 24 mnt_writeopcount = 1 mnt_maxsymlinklen = 120 mnt_iosize_max = 131072 mnt_hashseed = 4076196553 mnt_secondary_writes = 0 mnt_secondary_accwrites = 51 mnt_gjprovider = NULL List of active vnodes vnode 0xfffff8011aa279c0: tag ufs, type VREG usecount 0, writecount 0, refcount 34 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff80119fbd600 ref 0 pages 264 cleanbuf 0 dirtybuf 33 lock type ufs: UNLOCKED #0 0xffffffff809327f6 at __lockmgr_args+0xde6 #1 0xffffffff80bc5b42 at ffs_lock+0x92 #2 0xffffffff80eaa95c at VOP_LOCK1_APV+0xfc #3 0xffffffff80a15172 at _vn_lock+0xa2 #4 0xffffffff80a04737 at vget+0x67 #5 0xffffffff80bc4587 at ffs_sync+0x2a7 #6 0xffffffff80a0c2e4 at sys_sync+0x104 #7 0xffffffff80d768f6 at amd64_syscall+0x276 #8 0xffffffff80d5505b at Xfast_syscall+0xfb ino 3348, on dev md5a vnode 0xfffff800955f6750: tag ufs, type VREG usecount 0, writecount 0, refcount 34 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff80119dc3b00 ref 0 pages 264 cleanbuf 0 dirtybuf 33 lock type ufs: UNLOCKED #0 0xffffffff809327f6 at __lockmgr_args+0xde6 #1 0xffffffff80bc5b42 at ffs_lock+0x92 #2 0xffffffff80eaa95c at VOP_LOCK1_APV+0xfc #3 0xffffffff80a15172 at _vn_lock+0xa2 #4 0xffffffff80a04737 at vget+0x67 #5 0xffffffff80bc4587 at ffs_sync+0x2a7 #6 0xffffffff80a0c2e4 at sys_sync+0x104 #7 0xffffffff80d768f6 at amd64_syscall+0x276 #8 0xffffffff80d5505b at Xfast_syscall+0xfb ino 3347, on dev md5a vnode 0xfffff8011ae96270: tag ufs, type VREG usecount 0, writecount 0, refcount 34 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff8011a65da00 ref 0 pages 264 cleanbuf 0 dirtybuf 33 lock type ufs: UNLOCKED #0 0xffffffff809327f6 at __lockmgr_args+0xde6 #1 0xffffffff80bc5b42 at ffs_lock+0x92 #2 0xffffffff80eaa95c at VOP_LOCK1_APV+0xfc #3 0xffffffff80a15172 at _vn_lock+0xa2 #4 0xffffffff80a04737 at vget+0x67 #5 0xffffffff80bc4587 at ffs_sync+0x2a7 #6 0xffffffff80a0c2e4 at sys_sync+0x104 #7 0xffffffff80d768f6 at amd64_syscall+0x276 #8 0xffffffff80d5505b at Xfast_syscall+0xfb ino 3346, on dev md5a vnode 0xfffff8011aa28000: tag ufs, type VREG usecount 0, writecount 0, refcount 34 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff80119fbd900 ref 0 pages 264 cleanbuf 0 dirtybuf 33 lock type ufs: UNLOCKED #0 0xffffffff809327f6 at __lockmgr_args+0xde6 #1 0xffffffff80bc5b42 at ffs_lock+0x92 #2 0xffffffff80eaa95c at VOP_LOCK1_APV+0xfc #3 0xffffffff80a15172 at _vn_lock+0xa2 #4 0xffffffff80a04737 at vget+0x67 #5 0xffffffff80bc4587 at ffs_sync+0x2a7 #6 0xffffffff80a0c2e4 at sys_sync+0x104 #7 0xffffffff80d768f6 at amd64_syscall+0x276 #8 0xffffffff80d5505b at Xfast_syscall+0xfb ino 3345, on dev md5a vnode 0xfffff80118e8dc30: tag ufs, type VREG usecount 0, writecount 0, refcount 34 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff8009589ee00 ref 0 pages 264 cleanbuf 0 dirtybuf 33 lock type ufs: UNLOCKED #0 0xffffffff809327f6 at __lockmgr_args+0xde6 #1 0xffffffff80bc5b42 at ffs_lock+0x92 #2 0xffffffff80eaa95c at VOP_LOCK1_APV+0xfc #3 0xffffffff80a15172 at _vn_lock+0xa2 #4 0xffffffff80a04737 at vget+0x67 #5 0xffffffff80bc4587 at ffs_sync+0x2a7 #6 0xffffffff80a0c2e4 at sys_sync+0x104 #7 0xffffffff80d768f6 at amd64_syscall+0x276 #8 0xffffffff80d5505b at Xfast_syscall+0xfb ino 3344, on dev md5a vnode 0xfffff8011aa03000: tag ufs, type VREG usecount 0, writecount 0, refcount 34 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff8011a65d900 ref 0 pages 264 cleanbuf 0 dirtybuf 33 lock type ufs: UNLOCKED #0 0xffffffff809327f6 at __lockmgr_args+0xde6 #1 0xffffffff80bc5b42 at ffs_lock+0x92 #2 0xffffffff80eaa95c at VOP_LOCK1_APV+0xfc #3 0xffffffff80a15172 at _vn_lock+0xa2 #4 0xffffffff80a04737 at vget+0x67 #5 0xffffffff80bc4587 at ffs_sync+0x2a7 #6 0xffffffff80a0c2e4 at sys_sync+0x104 #7 0xffffffff80d768f6 at amd64_syscall+0x276 #8 0xffffffff80d5505b at Xfast_syscall+0xfb ino 3343, on dev md5a vnode 0xfffff8011aeb79c0: tag ufs, type VREG usecount 0, writecount 0, refcount 34 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff8011a96f800 ref 0 pages 264 cleanbuf 0 dirtybuf 33 lock type ufs: UNLOCKED #0 0xffffffff809327f6 at __lockmgr_args+0xde6 #1 0xffffffff80bc5b42 at ffs_lock+0x92 #2 0xffffffff80eaa95c at VOP_LOCK1_APV+0xfc #3 0xffffffff80a15172 at _vn_lock+0xa2 #4 0xffffffff80a04737 at vget+0x67 #5 0xffffffff80bc4587 at ffs_sync+0x2a7 #6 0xffffffff80a0c2e4 at sys_sync+0x104 #7 0xffffffff80d768f6 at amd64_syscall+0x276 #8 0xffffffff80d5505b at Xfast_syscall+0xfb ino 3342, on dev md5a vnode 0xfffff801190dc4e0: tag ufs, type VREG usecount 0, writecount 0, refcount 34 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff8011a601c00 ref 0 pages 264 cleanbuf 0 dirtybuf 33 lock type ufs: UNLOCKED #0 0xffffffff809327f6 at __lockmgr_args+0xde6 #1 0xffffffff80bc5b42 at ffs_lock+0x92 #2 0xffffffff80eaa95c at VOP_LOCK1_APV+0xfc #3 0xffffffff80a15172 at _vn_lock+0xa2 #4 0xffffffff80a04737 at vget+0x67 #5 0xffffffff80bc4587 at ffs_sync+0x2a7 #6 0xffffffff80a0c2e4 at sys_sync+0x104 #7 0xffffffff80d768f6 at amd64_syscall+0x276 #8 0xffffffff80d5505b at Xfast_syscall+0xfb ino 3341, on dev md5a vnode 0xfffff8011acdb270: tag ufs, type VREG usecount 0, writecount 0, refcount 34 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff8011a96e000 ref 0 pages 264 cleanbuf 0 dirtybuf 33 lock type ufs: UNLOCKED #0 0xffffffff809327f6 at __lockmgr_args+0xde6 #1 0xffffffff80bc5b42 at ffs_lock+0x92 #2 0xffffffff80eaa95c at VOP_LOCK1_APV+0xfc #3 0xffffffff80a15172 at _vn_lock+0xa2 #4 0xffffffff80a04737 at vget+0x67 #5 0xffffffff80bc4587 at ffs_sync+0x2a7 #6 0xffffffff80a0c2e4 at sys_sync+0x104 #7 0xffffffff80d768f6 at amd64_syscall+0x276 #8 0xffffffff80d5505b at Xfast_syscall+0xfb ino 3340, on dev md5a vnode 0xfffff8011ad214e0: tag ufs, type VREG usecount 0, writecount 0, refcount 34 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff80119dc1900 ref 0 pages 264 cleanbuf 0 dirtybuf 33 lock type ufs: UNLOCKED #0 0xffffffff809327f6 at __lockmgr_args+0xde6 #1 0xffffffff80bc5b42 at ffs_lock+0x92 #2 0xffffffff80eaa95c at VOP_LOCK1_APV+0xfc #3 0xffffffff80a15172 at _vn_lock+0xa2 #4 0xffffffff80a04737 at vget+0x67 #5 0xffffffff80bc4587 at ffs_sync+0x2a7 #6 0xffffffff80a0c2e4 at sys_sync+0x104 #7 0xffffffff80d768f6 at amd64_syscall+0x276 #8 0xffffffff80d5505b at Xfast_syscall+0xfb ino 3339, on dev md5a vnode 0xfffff8011ad21000: tag ufs, type VREG usecount 0, writecount 0, refcount 34 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff80119504b00 ref 0 pages 264 cleanbuf 0 dirtybuf 33 lock type ufs: UNLOCKED #0 0xffffffff809327f6 at __lockmgr_args+0xde6 #1 0xffffffff80bc5b42 at ffs_lock+0x92 #2 0xffffffff80eaa95c at VOP_LOCK1_APV+0xfc #3 0xffffffff80a15172 at _vn_lock+0xa2 #4 0xffffffff80a04737 at vget+0x67 #5 0xffffffff80bc4587 at ffs_sync+0x2a7 #6 0xffffffff80a0c2e4 at sys_sync+0x104 #7 0xffffffff80d768f6 at amd64_syscall+0x276 #8 0xffffffff80d5505b at Xfast_syscall+0xfb ino 3338, on dev md5a vnode 0xfffff8011acdb750: tag ufs, type VREG usecount 0, writecount 0, refcount 34 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff80119dc2800 ref 0 pages 264 cleanbuf 0 dirtybuf 33 lock type ufs: UNLOCKED #0 0xffffffff809327f6 at __lockmgr_args+0xde6 #1 0xffffffff80bc5b42 at ffs_lock+0x92 #2 0xffffffff80eaa95c at VOP_LOCK1_APV+0xfc #3 0xffffffff80a15172 at _vn_lock+0xa2 #4 0xffffffff80a04737 at vget+0x67 #5 0xffffffff80bc4587 at ffs_sync+0x2a7 #6 0xffffffff80a0c2e4 at sys_sync+0x104 #7 0xffffffff80d768f6 at amd64_syscall+0x276 #8 0xffffffff80d5505b at Xfast_syscall+0xfb ino 3337, on dev md5a vnode 0xfffff8011aeb8000: tag ufs, type VREG usecount 0, writecount 0, refcount 34 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff801177f4200 ref 0 pages 264 cleanbuf 0 dirtybuf 33 lock type ufs: UNLOCKED #0 0xffffffff809327f6 at __lockmgr_args+0xde6 #1 0xffffffff80bc5b42 at ffs_lock+0x92 #2 0xffffffff80eaa95c at VOP_LOCK1_APV+0xfc #3 0xffffffff80a15172 at _vn_lock+0xa2 #4 0xffffffff80a04737 at vget+0x67 #5 0xffffffff80bc4587 at ffs_sync+0x2a7 #6 0xffffffff80a0c2e4 at sys_sync+0x104 #7 0xffffffff80d768f6 at amd64_syscall+0x276 #8 0xffffffff80d5505b at Xfast_syscall+0xfb ino 3336, on dev md5a vnode 0xfffff8011ad16000: tag ufs, type VREG usecount 0, writecount 0, refcount 34 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff8011a970c00 ref 0 pages 264 cleanbuf 0 dirtybuf 33 lock type ufs: UNLOCKED #0 0xffffffff809327f6 at __lockmgr_args+0xde6 #1 0xffffffff80bc5b42 at ffs_lock+0x92 #2 0xffffffff80eaa95c at VOP_LOCK1_APV+0xfc #3 0xffffffff80a15172 at _vn_lock+0xa2 #4 0xffffffff80a04737 at vget+0x67 #5 0xffffffff80bc4587 at ffs_sync+0x2a7 #6 0xffffffff80a0c2e4 at sys_sync+0x104 #7 0xffffffff80d768f6 at amd64_syscall+0x276 #8 0xffffffff80d5505b at Xfast_syscall+0xfb ino 3335, on dev md5a vnode 0xfffff801190954e0: tag ufs, type VREG usecount 0, writecount 0, refcount 34 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff8011a7e3700 ref 0 pages 264 cleanbuf 0 dirtybuf 33 lock type ufs: UNLOCKED #0 0xffffffff809327f6 at __lockmgr_args+0xde6 #1 0xffffffff80bc5b42 at ffs_lock+0x92 #2 0xffffffff80eaa95c at VOP_LOCK1_APV+0xfc #3 0xffffffff80a15172 at _vn_lock+0xa2 #4 0xffffffff80a04737 at vget+0x67 #5 0xffffffff80bc4587 at ffs_sync+0x2a7 #6 0xffffffff80a0c2e4 at sys_sync+0x104 #7 0xffffffff80d768f6 at amd64_syscall+0x276 #8 0xffffffff80d5505b at Xfast_syscall+0xfb ino 3334, on dev md5a vnode 0xfffff8011acdbc30: tag ufs, type VREG usecount 0, writecount 0, refcount 34 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff80119fbe200 ref 0 pages 264 cleanbuf 0 dirtybuf 33 lock type ufs: UNLOCKED #0 0xffffffff809327f6 at __lockmgr_args+0xde6 #1 0xffffffff80bc5b42 at ffs_lock+0x92 #2 0xffffffff80eaa95c at VOP_LOCK1_APV+0xfc #3 0xffffffff80a15172 at _vn_lock+0xa2 #4 0xffffffff80a04737 at vget+0x67 #5 0xffffffff80bc4587 at ffs_sync+0x2a7 #6 0xffffffff80a0c2e4 at sys_sync+0x104 #7 0xffffffff80d768f6 at amd64_syscall+0x276 #8 0xffffffff80d5505b at Xfast_syscall+0xfb ino 3333, on dev md5a vnode 0xfffff8011a98bc30: tag ufs, type VREG usecount 0, writecount 0, refcount 34 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff8011a96e600 ref 0 pages 264 cleanbuf 0 dirtybuf 33 lock type ufs: UNLOCKED #0 0xffffffff809327f6 at __lockmgr_args+0xde6 #1 0xffffffff80bc5b42 at ffs_lock+0x92 #2 0xffffffff80eaa95c at VOP_LOCK1_APV+0xfc #3 0xffffffff80a15172 at _vn_lock+0xa2 #4 0xffffffff80a04737 at vget+0x67 #5 0xffffffff80bc4587 at ffs_sync+0x2a7 #6 0xffffffff80a0c2e4 at sys_sync+0x104 #7 0xffffffff80d768f6 at amd64_syscall+0x276 #8 0xffffffff80d5505b at Xfast_syscall+0xfb ino 3332, on dev md5a vnode 0xfffff801190dc000: tag ufs, type VREG usecount 0, writecount 0, refcount 34 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff80118d83a00 ref 0 pages 264 cleanbuf 0 dirtybuf 33 lock type ufs: UNLOCKED #0 0xffffffff809327f6 at __lockmgr_args+0xde6 #1 0xffffffff80bc5b42 at ffs_lock+0x92 #2 0xffffffff80eaa95c at VOP_LOCK1_APV+0xfc #3 0xffffffff80a15172 at _vn_lock+0xa2 #4 0xffffffff80a04737 at vget+0x67 #5 0xffffffff80bc4587 at ffs_sync+0x2a7 #6 0xffffffff80a0c2e4 at sys_sync+0x104 #7 0xffffffff80d768f6 at amd64_syscall+0x276 #8 0xffffffff80d5505b at Xfast_syscall+0xfb ino 3331, on dev md5a vnode 0xfffff80012d659c0: tag ufs, type VREG usecount 0, writecount 0, refcount 34 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff80012bfa800 ref 0 pages 264 cleanbuf 0 dirtybuf 33 lock type ufs: UNLOCKED #0 0xffffffff809327f6 at __lockmgr_args+0xde6 #1 0xffffffff80bc5b42 at ffs_lock+0x92 #2 0xffffffff80eaa95c at VOP_LOCK1_APV+0xfc #3 0xffffffff80a15172 at _vn_lock+0xa2 #4 0xffffffff80a04737 at vget+0x67 #5 0xffffffff80bc4587 at ffs_sync+0x2a7 #6 0xffffffff80a0c2e4 at sys_sync+0x104 #7 0xffffffff80d768f6 at amd64_syscall+0x276 #8 0xffffffff80d5505b at Xfast_syscall+0xfb ino 3330, on dev md5a vnode 0xfffff800221f3750: tag ufs, type VREG usecount 0, writecount 0, refcount 34 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff8004fc96400 ref 0 pages 264 cleanbuf 0 dirtybuf 33 lock type ufs: UNLOCKED #0 0xffffffff809327f6 at __lockmgr_args+0xde6 #1 0xffffffff80bc5b42 at ffs_lock+0x92 #2 0xffffffff80eaa95c at VOP_LOCK1_APV+0xfc #3 0xffffffff80a15172 at _vn_lock+0xa2 #4 0xffffffff80a04737 at vget+0x67 #5 0xffffffff80bc4587 at ffs_sync+0x2a7 #6 0xffffffff80a0c2e4 at sys_sync+0x104 #7 0xffffffff80d768f6 at amd64_syscall+0x276 #8 0xffffffff80d5505b at Xfast_syscall+0xfb ino 3329, on dev md5a vnode 0xfffff8011ae919c0: tag ufs, type VREG usecount 0, writecount 0, refcount 3 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff8011a96ed00 ref 0 pages 16 cleanbuf 0 dirtybuf 2 lock type ufs: UNLOCKED #0 0xffffffff809327f6 at __lockmgr_args+0xde6 #1 0xffffffff80bc5b42 at ffs_lock+0x92 #2 0xffffffff80eaa95c at VOP_LOCK1_APV+0xfc #3 0xffffffff80a15172 at _vn_lock+0xa2 #4 0xffffffff80a04737 at vget+0x67 #5 0xffffffff80bc4587 at ffs_sync+0x2a7 #6 0xffffffff80a0c2e4 at sys_sync+0x104 #7 0xffffffff80d768f6 at amd64_syscall+0x276 #8 0xffffffff80d5505b at Xfast_syscall+0xfb ino 4, on dev md5a vnode 0xfffff8011ad28000: tag ufs, type VDIR usecount 0, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff80095b1b600 ref 0 pages 0 cleanbuf 0 dirtybuf 1 lock type ufs: UNLOCKED #0 0xffffffff809327f6 at __lockmgr_args+0xde6 #1 0xffffffff80bc5b42 at ffs_lock+0x92 #2 0xffffffff80eaa95c at VOP_LOCK1_APV+0xfc #3 0xffffffff80a15172 at _vn_lock+0xa2 #4 0xffffffff80a0b6ed at sched_sync+0x3bd #5 0xffffffff8091d8f4 at fork_exit+0x84 #6 0xffffffff80d552ae at fork_trampoline+0xe ino 3328, on dev md5a vnode 0xfffff80119e02270: tag ufs, type VDIR usecount 0, writecount 0, refcount 3 mountedhere 0 flags (VV_ROOT|VI_ACTIVE) v_object 0xfffff8011a6dc200 ref 0 pages 1 cleanbuf 0 dirtybuf 1 lock type ufs: UNLOCKED #0 0xffffffff809327f6 at __lockmgr_args+0xde6 #1 0xffffffff80bc5b42 at ffs_lock+0x92 #2 0xffffffff80eaa95c at VOP_LOCK1_APV+0xfc #3 0xffffffff80a15172 at _vn_lock+0xa2 #4 0xffffffff80a0b6ed at sched_sync+0x3bd #5 0xffffffff8091d8f4 at fork_exit+0x84 #6 0xffffffff80d552ae at fork_trampoline+0xe ino 2, on dev md5a vnode 0xfffff80119e02000: tag syncer, type VNON usecount 1, writecount 0, refcount 1 mountedhere 0 flags (VI_ACTIVE) lock type syncer: UNLOCKED #0 0xffffffff809327f6 at __lockmgr_args+0xde6 #1 0xffffffff809f158c at vop_stdlock+0x3c #2 0xffffffff80eaa95c at VOP_LOCK1_APV+0xfc #3 0xffffffff80a15172 at _vn_lock+0xa2 #4 0xffffffff80a0b6ed at sched_sync+0x3bd #5 0xffffffff8091d8f4 at fork_exit+0x84 #6 0xffffffff80d552ae at fork_trampoline+0xe List of inactive vnodes db> run pho db:0:pho> bt Tracing pid 11 tid 100004 td 0xfffff80006563940 kdb_alt_break_internal() at kdb_alt_break_internal+0x197/frame 0xfffffe078a6a16e0 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe078a6a16f0 uart_intr_rxready() at uart_intr_rxready+0x99/frame 0xfffffe078a6a1720 uart_intr() at uart_intr+0x111/frame 0xfffffe078a6a1760 intr_event_handle() at intr_event_handle+0x9c/frame 0xfffffe078a6a17b0 intr_execute_handlers() at intr_execute_handlers+0x48/frame 0xfffffe078a6a17e0 lapic_handle_intr() at lapic_handle_intr+0x63/frame 0xfffffe078a6a1810 Xapic_isr1() at Xapic_isr1+0xa4/frame 0xfffffe078a6a1810 --- interrupt, rip = 0xffffffff803709f7, rsp = 0xfffffe078a6a18d0, rbp = 0xfffffe078a6a1920 --- acpi_cpu_idle() at acpi_cpu_idle+0x2b7/frame 0xfffffe078a6a1920 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078a6a1940 cpu_idle() at cpu_idle+0x90/frame 0xfffffe078a6a1960 sched_idletd() at sched_idletd+0x4e0/frame 0xfffffe078a6a1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a6a1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a6a1ab0 --- trap 0, rip = 0, rsp = 0xfffffe078a6a1b70, rbp = 0 --- db:0:bt> show allpcpu Current CPU: 1 cpuid = 0 dynamic pcpu = 0x6ac880 curthread = 0xfffff80006564000: pid 11 "idle: cpu0" curpcb = 0xfffffe078a69cb80 fpcurthread = none idlethread = 0xfffff80006564000: tid 100003 "idle: cpu0" curpmap = 0xffffffff8186bc40 tssp = 0xffffffff8189f390 commontssp = 0xffffffff8189f390 rsp0 = 0xfffffe078a69cb80 gs32p = 0xffffffff818a5be8 ldt = 0xffffffff818a5c28 tss = 0xffffffff818a5c18 spin locks held: cpuid = 1 dynamic pcpu = 0xfffffe087a9f9880 curthread = 0xfffff80006563940: pid 11 "idle: cpu1" curpcb = 0xfffffe078a6a1b80 fpcurthread = none idlethread = 0xfffff80006563940: tid 100004 "idle: cpu1" curpmap = 0xffffffff8186bc40 tssp = 0xffffffff8189f3f8 commontssp = 0xffffffff8189f3f8 rsp0 = 0xfffffe078a6a1b80 gs32p = 0xffffffff818a5c50 ldt = 0xffffffff818a5c90 tss = 0xffffffff818a5c80 spin locks held: cpuid = 2 dynamic pcpu = 0xfffffe087aa01880 curthread = 0xfffff800065634a0: pid 11 "idle: cpu2" curpcb = 0xfffffe078a6a6b80 fpcurthread = none idlethread = 0xfffff800065634a0: tid 100005 "idle: cpu2" curpmap = 0xffffffff8186bc40 tssp = 0xffffffff8189f460 commontssp = 0xffffffff8189f460 rsp0 = 0xfffffe078a6a6b80 gs32p = 0xffffffff818a5cb8 ldt = 0xffffffff818a5cf8 tss = 0xffffffff818a5ce8 spin locks held: cpuid = 3 dynamic pcpu = 0xfffffe087aa09880 curthread = 0xfffff80006563000: pid 11 "idle: cpu3" curpcb = 0xfffffe078a6abb80 fpcurthread = none idlethread = 0xfffff80006563000: tid 100006 "idle: cpu3" curpmap = 0xffffffff8186bc40 tssp = 0xffffffff8189f4c8 commontssp = 0xffffffff8189f4c8 rsp0 = 0xfffffe078a6abb80 gs32p = 0xffffffff818a5d20 ldt = 0xffffffff818a5d60 tss = 0xffffffff818a5d50 spin locks held: cpuid = 4 dynamic pcpu = 0xfffffe087aa11880 curthread = 0xfffff8000655d940: pid 11 "idle: cpu4" curpcb = 0xfffffe078a6b0b80 fpcurthread = none idlethread = 0xfffff8000655d940: tid 100007 "idle: cpu4" curpmap = 0xffffffff8186bc40 tssp = 0xffffffff8189f530 commontssp = 0xffffffff8189f530 rsp0 = 0xfffffe078a6b0b80 gs32p = 0xffffffff818a5d88 ldt = 0xffffffff818a5dc8 tss = 0xffffffff818a5db8 spin locks held: cpuid = 5 dynamic pcpu = 0xfffffe087aa19880 curthread = 0xfffff8000655d4a0: pid 11 "idle: cpu5" curpcb = 0xfffffe078a6b5b80 fpcurthread = none idlethread = 0xfffff8000655d4a0: tid 100008 "idle: cpu5" curpmap = 0xffffffff8186bc40 tssp = 0xffffffff8189f598 commontssp = 0xffffffff8189f598 rsp0 = 0xfffffe078a6b5b80 gs32p = 0xffffffff818a5df0 ldt = 0xffffffff818a5e30 tss = 0xffffffff818a5e20 spin locks held: cpuid = 6 dynamic pcpu = 0xfffffe087aa21880 curthread = 0xfffff8000655d000: pid 11 "idle: cpu6" curpcb = 0xfffffe078a6bab80 fpcurthread = none idlethread = 0xfffff8000655d000: tid 100009 "idle: cpu6" curpmap = 0xffffffff8186bc40 tssp = 0xffffffff8189f600 commontssp = 0xffffffff8189f600 rsp0 = 0xfffffe078a6bab80 gs32p = 0xffffffff818a5e58 ldt = 0xffffffff818a5e98 tss = 0xffffffff818a5e88 spin locks held: cpuid = 7 dynamic pcpu = 0xfffffe087aa29880 curthread = 0xfffff80006575940: pid 11 "idle: cpu7" curpcb = 0xfffffe078a6bfb80 fpcurthread = none idlethread = 0xfffff80006575940: tid 100010 "idle: cpu7" curpmap = 0xffffffff8186bc40 tssp = 0xffffffff8189f668 commontssp = 0xffffffff8189f668 rsp0 = 0xfffffe078a6bfb80 gs32p = 0xffffffff818a5ec0 ldt = 0xffffffff818a5f00 tss = 0xffffffff818a5ef0 spin locks held: cpuid = 8 dynamic pcpu = 0xfffffe087aa31880 curthread = 0xfffff800065754a0: pid 11 "idle: cpu8" curpcb = 0xfffffe078a6c4b80 fpcurthread = none idlethread = 0xfffff800065754a0: tid 100011 "idle: cpu8" curpmap = 0xffffffff8186bc40 tssp = 0xffffffff8189f6d0 commontssp = 0xffffffff8189f6d0 rsp0 = 0xfffffe078a6c4b80 gs32p = 0xffffffff818a5f28 ldt = 0xffffffff818a5f68 tss = 0xffffffff818a5f58 spin locks held: cpuid = 9 dynamic pcpu = 0xfffffe087aa39880 curthread = 0xfffff80006575000: pid 11 "idle: cpu9" curpcb = 0xfffffe078a6c9b80 fpcurthread = none idlethread = 0xfffff80006575000: tid 100012 "idle: cpu9" curpmap = 0xffffffff8186bc40 tssp = 0xffffffff8189f738 commontssp = 0xffffffff8189f738 rsp0 = 0xfffffe078a6c9b80 gs32p = 0xffffffff818a5f90 ldt = 0xffffffff818a5fd0 tss = 0xffffffff818a5fc0 spin locks held: cpuid = 10 dynamic pcpu = 0xfffffe087aa41880 curthread = 0xfffff80006574940: pid 11 "idle: cpu10" curpcb = 0xfffffe078a6ceb80 fpcurthread = none idlethread = 0xfffff80006574940: tid 100013 "idle: cpu10" curpmap = 0xffffffff8186bc40 tssp = 0xffffffff8189f7a0 commontssp = 0xffffffff8189f7a0 rsp0 = 0xfffffe078a6ceb80 gs32p = 0xffffffff818a5ff8 ldt = 0xffffffff818a6038 tss = 0xffffffff818a6028 spin locks held: cpuid = 11 dynamic pcpu = 0xfffffe087aa49880 curthread = 0xfffff800065744a0: pid 11 "idle: cpu11" curpcb = 0xfffffe078a6d3b80 fpcurthread = none idlethread = 0xfffff800065744a0: tid 100014 "idle: cpu11" curpmap = 0xffffffff8186bc40 tssp = 0xffffffff8189f808 commontssp = 0xffffffff8189f808 rsp0 = 0xfffffe078a6d3b80 gs32p = 0xffffffff818a6060 ldt = 0xffffffff818a60a0 tss = 0xffffffff818a6090 spin locks held: cpuid = 12 dynamic pcpu = 0xfffffe087aa51880 curthread = 0xfffff80006574000: pid 11 "idle: cpu12" curpcb = 0xfffffe078a6d8b80 fpcurthread = none idlethread = 0xfffff80006574000: tid 100015 "idle: cpu12" curpmap = 0xffffffff8186bc40 tssp = 0xffffffff8189f870 commontssp = 0xffffffff8189f870 rsp0 = 0xfffffe078a6d8b80 gs32p = 0xffffffff818a60c8 ldt = 0xffffffff818a6108 tss = 0xffffffff818a60f8 spin locks held: cpuid = 13 dynamic pcpu = 0xfffffe087aa59880 curthread = 0xfffff80006573940: pid 11 "idle: cpu13" curpcb = 0xfffffe078a6ddb80 fpcurthread = none idlethread = 0xfffff80006573940: tid 100016 "idle: cpu13" curpmap = 0xffffffff8186bc40 tssp = 0xffffffff8189f8d8 commontssp = 0xffffffff8189f8d8 rsp0 = 0xfffffe078a6ddb80 gs32p = 0xffffffff818a6130 ldt = 0xffffffff818a6170 tss = 0xffffffff818a6160 spin locks held: cpuid = 14 dynamic pcpu = 0xfffffe087aa61880 curthread = 0xfffff800065734a0: pid 11 "idle: cpu14" curpcb = 0xfffffe078a6e2b80 fpcurthread = none idlethread = 0xfffff800065734a0: tid 100017 "idle: cpu14" curpmap = 0xffffffff8186bc40 tssp = 0xffffffff8189f940 commontssp = 0xffffffff8189f940 rsp0 = 0xfffffe078a6e2b80 gs32p = 0xffffffff818a6198 ldt = 0xffffffff818a61d8 tss = 0xffffffff818a61c8 spin locks held: cpuid = 15 dynamic pcpu = 0xfffffe087aa69880 curthread = 0xfffff80006573000: pid 11 "idle: cpu15" curpcb = 0xfffffe078a6e7b80 fpcurthread = none idlethread = 0xfffff80006573000: tid 100018 "idle: cpu15" curpmap = 0xffffffff8186bc40 tssp = 0xffffffff8189f9a8 commontssp = 0xffffffff8189f9a8 rsp0 = 0xfffffe078a6e7b80 gs32p = 0xffffffff818a6200 ldt = 0xffffffff818a6240 tss = 0xffffffff818a6230 spin locks held: cpuid = 16 dynamic pcpu = 0xfffffe087aa71880 curthread = 0xfffff80006578940: pid 11 "idle: cpu16" curpcb = 0xfffffe078a6ecb80 fpcurthread = none idlethread = 0xfffff80006578940: tid 100019 "idle: cpu16" curpmap = 0xffffffff8186bc40 tssp = 0xffffffff8189fa10 commontssp = 0xffffffff8189fa10 rsp0 = 0xfffffe078a6ecb80 gs32p = 0xffffffff818a6268 ldt = 0xffffffff818a62a8 tss = 0xffffffff818a6298 spin locks held: cpuid = 17 dynamic pcpu = 0xfffffe087aa79880 curthread = 0xfffff800065784a0: pid 11 "idle: cpu17" curpcb = 0xfffffe078a6f1b80 fpcurthread = none idlethread = 0xfffff800065784a0: tid 100020 "idle: cpu17" curpmap = 0xffffffff8186bc40 tssp = 0xffffffff8189fa78 commontssp = 0xffffffff8189fa78 rsp0 = 0xfffffe078a6f1b80 gs32p = 0xffffffff818a62d0 ldt = 0xffffffff818a6310 tss = 0xffffffff818a6300 spin locks held: cpuid = 18 dynamic pcpu = 0xfffffe087aa81880 curthread = 0xfffff80006578000: pid 11 "idle: cpu18" curpcb = 0xfffffe078a6f6b80 fpcurthread = none idlethread = 0xfffff80006578000: tid 100021 "idle: cpu18" curpmap = 0xffffffff8186bc40 tssp = 0xffffffff8189fae0 commontssp = 0xffffffff8189fae0 rsp0 = 0xfffffe078a6f6b80 gs32p = 0xffffffff818a6338 ldt = 0xffffffff818a6378 tss = 0xffffffff818a6368 spin locks held: cpuid = 19 dynamic pcpu = 0xfffffe087aa89880 curthread = 0xfffff80006577940: pid 11 "idle: cpu19" curpcb = 0xfffffe078a6fbb80 fpcurthread = none idlethread = 0xfffff80006577940: tid 100022 "idle: cpu19" curpmap = 0xffffffff8186bc40 tssp = 0xffffffff8189fb48 commontssp = 0xffffffff8189fb48 rsp0 = 0xfffffe078a6fbb80 gs32p = 0xffffffff818a63a0 ldt = 0xffffffff818a63e0 tss = 0xffffffff818a63d0 spin locks held: cpuid = 20 dynamic pcpu = 0xfffffe087aa91880 curthread = 0xfffff800065774a0: pid 11 "idle: cpu20" curpcb = 0xfffffe078a700b80 fpcurthread = none idlethread = 0xfffff800065774a0: tid 100023 "idle: cpu20" curpmap = 0xffffffff8186bc40 tssp = 0xffffffff8189fbb0 commontssp = 0xffffffff8189fbb0 rsp0 = 0xfffffe078a700b80 gs32p = 0xffffffff818a6408 ldt = 0xffffffff818a6448 tss = 0xffffffff818a6438 spin locks held: cpuid = 21 dynamic pcpu = 0xfffffe087aa99880 curthread = 0xfffff80006577000: pid 11 "idle: cpu21" curpcb = 0xfffffe078a705b80 fpcurthread = none idlethread = 0xfffff80006577000: tid 100024 "idle: cpu21" curpmap = 0xffffffff8186bc40 tssp = 0xffffffff8189fc18 commontssp = 0xffffffff8189fc18 rsp0 = 0xfffffe078a705b80 gs32p = 0xffffffff818a6470 ldt = 0xffffffff818a64b0 tss = 0xffffffff818a64a0 spin locks held: cpuid = 22 dynamic pcpu = 0xfffffe087aaa1880 curthread = 0xfffff80006576940: pid 11 "idle: cpu22" curpcb = 0xfffffe078a70ab80 fpcurthread = none idlethread = 0xfffff80006576940: tid 100025 "idle: cpu22" curpmap = 0xffffffff8186bc40 tssp = 0xffffffff8189fc80 commontssp = 0xffffffff8189fc80 rsp0 = 0xfffffe078a70ab80 gs32p = 0xffffffff818a64d8 ldt = 0xffffffff818a6518 tss = 0xffffffff818a6508 spin locks held: cpuid = 23 dynamic pcpu = 0xfffffe0809132880 curthread = 0xfffff800065764a0: pid 11 "idle: cpu23" curpcb = 0xfffffe078a70fb80 fpcurthread = none idlethread = 0xfffff800065764a0: tid 100026 "idle: cpu23" curpmap = 0xffffffff8186bc40 tssp = 0xffffffff8189fce8 commontssp = 0xffffffff8189fce8 rsp0 = 0xfffffe078a70fb80 gs32p = 0xffffffff818a6540 ldt = 0xffffffff818a6580 tss = 0xffffffff818a6570 spin locks held: db:0:allpcpu> show alllocks Process 1037 (umount) thread 0xfffff8004fd5f000 (100439) exclusive lockmgr ufs (ufs) r = 0 (0xfffff8004fa432d8) locked @ kern/vfs_mount.c:1223 db:0:alllocks> show lockedvnods Locked vnodes 0xfffff8004fa43270: tag ufs, type VDIR usecount 1, writecount 0, refcount 1 mountedhere 0xfffff8011b0e0000 flags (VI_ACTIVE) lock type ufs: EXCL by thread 0xfffff8004fd5f000 (pid 1037, umount, tid 100439) #0 0xffffffff809327f6 at __lockmgr_args+0xde6 #1 0xffffffff80bc5b42 at ffs_lock+0x92 #2 0xffffffff80eaa95c at VOP_LOCK1_APV+0xfc #3 0xffffffff80a15172 at _vn_lock+0xa2 #4 0xffffffff809fa806 at dounmount+0xa6 #5 0xffffffff809fa734 at sys_unmount+0x554 #6 0xffffffff80d768f6 at amd64_syscall+0x276 #7 0xffffffff80d5505b at Xfast_syscall+0xfb ino 31380096, on dev da0p2 db:0:lockedvnods> show mount 0xfffff8001257cb58 /dev/da0p2 on / (ufs) 0xfffff8001257d000 devfs on /dev (devfs) 0xfffff800220033c8 /dev/da0p3 on /tmp (ufs) 0xfffff80012f91790 procfs on /proc (procfs) 0xfffff8011b0e0000 /dev/md5a on /mnt (ufs) More info: show mount db:0:mount> ps pid ppid pgrp uid state wmesg wchan cmd 1328 1 1328 0 Ss+ ttyin 0xfffff8000e1930a8 sh 1037 1 927 0 D+ mount dr 0xfffff8011b0e02c4 umount 943 0 0 0 DL mdwait 0xfffff8011b02f800 [md5] 810 0 0 0 SL - 0xffffffff81860c14 [newnfs 1] 809 0 0 0 SL - 0xffffffff81860c10 [newnfs 0] 16 0 0 0 DL vlruwt 0xfffff8001212ca70 [vnlru] 9 0 0 0 DL syncer 0xffffffff817cb390 [syncer] 8 0 0 0 DL (threaded) [bufdaemon] 100136 D psleep 0xffffffff817ca584 [bufdaemon] 100152 D sdflush 0xfffff80012f1e2e8 [/ worker] 100159 D sdflush 0xfffff80012fc14e8 [/tmp worker] 100457 D sdflush 0xfffff80095609ae8 [/mnt worker] 7 0 0 0 DL pgzero 0xffffffff817d3adc [pagezero] 6 0 0 0 DL psleep 0xffffffff817d2f28 [vmdaemon] 5 0 0 0 DL psleep 0xffffffff8189e704 [pagedaemon] 4 0 0 0 DL idle 0xfffff8001212ea70 [enc_daemon0] 3 0 0 0 DL waiting_ 0xffffffff81892508 [sctp_iterator] 15 0 0 0 DL (threaded) [usb] 100075 D - 0xfffffe00012f1d10 [usbus0] 100076 D - 0xfffffe00012f1d68 [usbus0] 100077 D - 0xfffffe00012f1dc0 [usbus0] 100078 D - 0xfffffe00012f1e18 [usbus0] 100115 D - 0xfffffe00016e6560 [usbus1] 100116 D - 0xfffffe00016e65b8 [usbus1] 100117 D - 0xfffffe00016e6610 [usbus1] 100118 D - 0xfffffe00016e6668 [usbus1] 100120 D - 0xfffffe0001354d10 [usbus2] 100121 D - 0xfffffe0001354d68 [usbus2] 100122 D - 0xfffffe0001354dc0 [usbus2] 100123 D - 0xfffffe0001354e18 [usbus2] 2 0 0 0 DL (threaded) [cam] 100058 D - 0xffffffff8155ab00 [doneq0] 100059 D - 0xffffffff8155ac00 [doneq1] 100060 D - 0xffffffff8155ad00 [doneq2] 100061 D - 0xffffffff8155ae00 [doneq3] 100062 D - 0xffffffff8155af00 [doneq4] 100131 D - 0xffffffff8155a948 [scanner] 14 0 0 0 DL - 0xffffffff81587d30 [rand_harvestq] 13 0 0 0 DL (threaded) [geom] 100053 D - 0xffffffff8186b110 [g_event] 100054 D - 0xffffffff8186b118 [g_up] 100055 D - 0xffffffff8186b120 [g_down] 12 0 0 0 WL (threaded) [intr] 100027 I [swi1: netisr 0] 100028 I [swi4: clock (0)] 100029 I [swi4: clock (1)] 100030 I [swi4: clock (2)] 100031 I [swi4: clock (3)] 100032 I [swi4: clock (4)] 100033 I [swi4: clock (5)] 100034 I [swi4: clock (6)] 100035 I [swi4: clock (7)] 100036 I [swi4: clock (8)] 100037 I [swi4: clock (9)] 100038 I [swi4: clock (10)] 100039 I [swi4: clock (11)] 100040 I [swi4: clock (12)] 100041 I [swi4: clock (13)] 100042 I [swi4: clock (14)] 100043 I [swi4: clock (15)] 100044 I [swi4: clock (16)] 100045 I [swi4: clock (17)] 100046 I [swi4: clock (18)] 100047 I [swi4: clock (19)] 100048 I [swi4: clock (20)] 100049 I [swi4: clock (21)] 100050 I [swi4: clock (22)] 100051 I [swi4: clock (23)] 100052 I [swi3: vm] 100064 I [swi6: task queue] 100065 I [swi6: Giant taskq] 100067 I [swi5: fast taskq] 100072 I [irq264: isci0] 100073 I [irq265: isci0] 100074 I [irq22: ehci0] 100079 I [irq266: hdac0] 100080 I [irq267: igb0:que 0] 100082 I [irq268: igb0:que 1] 100084 I [irq269: igb0:que 2] 100086 I [irq270: igb0:que 3] 100088 I [irq271: igb0:que 4] 100090 I [irq272: igb0:que 5] 100092 I [irq273: igb0:que 6] 100094 I [irq274: igb0:que 7] 100096 I [irq275: igb0:link] 100097 I [irq276: igb1:que 0] 100099 I [irq277: igb1:que 1] 100101 I [irq278: igb1:que 2] 100103 I [irq279: igb1:que 3] 100105 I [irq280: igb1:que 4] 100107 I [irq281: igb1:que 5] 100109 I [irq282: igb1:que 6] 100111 I [irq283: igb1:que 7] 100113 I [irq284: igb1:link] 100114 I [irq285: xhci0] 100119 I [irq20: ehci1] 100124 I [irq286: ahci0] 100125 I [irq287: hdac1] 100126 I [swi0: uart] 11 0 0 0 RL (threaded) [idle] 100003 Run CPU 0 [idle: cpu0] 100004 Run CPU 1 [idle: cpu1] 100005 Run CPU 2 [idle: cpu2] 100006 Run CPU 3 [idle: cpu3] 100007 Run CPU 4 [idle: cpu4] 100008 Run CPU 5 [idle: cpu5] 100009 Run CPU 6 [idle: cpu6] 100010 Run CPU 7 [idle: cpu7] 100011 Run CPU 8 [idle: cpu8] 100012 Run CPU 9 [idle: cpu9] 100013 Run CPU 10 [idle: cpu10] 100014 Run CPU 11 [idle: cpu11] 100015 Run CPU 12 [idle: cpu12] 100016 Run CPU 13 [idle: cpu13] 100017 Run CPU 14 [idle: cpu14] 100018 Run CPU 15 [idle: cpu15] 100019 Run CPU 16 [idle: cpu16] 100020 Run CPU 17 [idle: cpu17] 100021 Run CPU 18 [idle: cpu18] 100022 Run CPU 19 [idle: cpu19] 100023 Run CPU 20 [idle: cpu20] 100024 Run CPU 21 [idle: cpu21] 100025 Run CPU 22 [idle: cpu22] 100026 Run CPU 23 [idle: cpu23] 1 0 1 0 SLs wait 0xfffff8000655c538 [init] 10 0 0 0 DL audit_wo 0xffffffff81895cf8 [audit] 0 0 0 0 DLs (threaded) [kernel] 100000 D swapin 0xffffffff8186b148 [swapper] 100056 D - 0xfffff80006549e00 [firmware taskq] 100063 D - 0xfffff80006549c00 [ffs_trim taskq] 100066 D - 0xfffff80006549900 [thread taskq] 100068 D - 0xfffff80006549700 [acpi_task_0] 100069 D - 0xfffff80006549700 [acpi_task_1] 100070 D - 0xfffff80006549700 [acpi_task_2] 100071 D - 0xfffff80006549600 [kqueue taskq] 100081 D - 0xfffff80006549500 [igb0 que (qid 0)] 100083 D - 0xfffff80006549400 [igb0 que (qid 1)] 100085 D - 0xfffff80006549300 [igb0 que (qid 2)] 100087 D - 0xfffff80006549200 [igb0 que (qid 3)] 100089 D - 0xfffff80006549100 [igb0 que (qid 4)] 100091 D - 0xfffff80006549000 [igb0 que (qid 5)] 100093 D - 0xfffff80006548e00 [igb0 que (qid 6)] 100095 D - 0xfffff80006548d00 [igb0 que (qid 7)] 100098 D - 0xfffff80006548c00 [igb1 que (qid 8)] 100100 D - 0xfffff80006548b00 [igb1 que (qid 9)] 100102 D - 0xfffff80006548a00 [igb1 que (qid 10)] 100104 D - 0xfffff80006548900 [igb1 que (qid 11)] 100106 D - 0xfffff80006548800 [igb1 que (qid 12)] 100108 D - 0xfffff80006548700 [igb1 que (qid 13)] 100110 D - 0xfffff80006548600 [igb1 que (qid 14)] 100112 D - 0xfffff80006548500 [igb1 que (qid 15)] 100127 D - 0xfffff80006548400 [mca taskq] 100128 D - 0xffffffff8163a976 [deadlkres] 100130 D - 0xfffff80006549d00 [CAM taskq] db:0:ps> allt Tracing command sh pid 1328 tid 100183 td 0xfffff80012f61940 sched_switch() at sched_switch+0x4cd/frame 0xfffffe081db55570 mi_switch() at mi_switch+0x3dc/frame 0xfffffe081db55640 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081db55680 sleepq_catch_signals() at sleepq_catch_signals+0x30c/frame 0xfffffe081db556f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe081db55720 _cv_wait_sig() at _cv_wait_sig+0x1f0/frame 0xfffffe081db55790 tty_wait() at tty_wait+0x42/frame 0xfffffe081db557c0 ttydisc_read() at ttydisc_read+0x348/frame 0xfffffe081db55820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe081db55850 devfs_read_f() at devfs_read_f+0xca/frame 0xfffffe081db558b0 dofileread() at dofileread+0x95/frame 0xfffffe081db55900 kern_readv() at kern_readv+0x68/frame 0xfffffe081db55950 sys_read() at sys_read+0x63/frame 0xfffffe081db559a0 amd64_syscall() at amd64_syscall+0x276/frame 0xfffffe081db55ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081db55ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800bba67a, rsp = 0x7fffffffeae8, rbp = 0x7fffffffeb40 --- Tracing command umount pid 1037 tid 100439 td 0xfffff8004fd5f000 sched_switch() at sched_switch+0x4cd/frame 0xfffffe081e068340 mi_switch() at mi_switch+0x3dc/frame 0xfffffe081e068410 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081e068450 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081e068480 _sleep() at _sleep+0x6ce/frame 0xfffffe081e0685c0 dounmount() at dounmount+0x481/frame 0xfffffe081e068800 sys_unmount() at sys_unmount+0x554/frame 0xfffffe081e0689a0 amd64_syscall() at amd64_syscall+0x276/frame 0xfffffe081e068ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081e068ab0 --- syscall (22, FreeBSD ELF64, sys_unmount), rip = 0x80089895a, rsp = 0x7fffffffde48, rbp = 0x7fffffffdf60 --- Tracing command md5 pid 943 tid 100446 td 0xfffff8011af86940 sched_switch() at sched_switch+0x4cd/frame 0xfffffe081e08b7a0 mi_switch() at mi_switch+0x3dc/frame 0xfffffe081e08b870 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081e08b8b0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081e08b8e0 _sleep() at _sleep+0x6ce/frame 0xfffffe081e08ba20 md_kthread() at md_kthread+0x175/frame 0xfffffe081e08ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe081e08bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081e08bab0 --- trap 0, rip = 0, rsp = 0xfffffe081e08bb70, rbp = 0 --- Tracing command newnfs 1 pid 810 tid 100427 td 0xfffff80012b80000 sched_switch() at sched_switch+0x4cd/frame 0xfffffe081e02c740 mi_switch() at mi_switch+0x3dc/frame 0xfffffe081e02c810 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081e02c850 sleepq_catch_signals() at sleepq_catch_signals+0x30c/frame 0xfffffe081e02c8c0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe081e02c8f0 _sleep() at _sleep+0x677/frame 0xfffffe081e02ca30 nfssvc_iod() at nfssvc_iod+0x101/frame 0xfffffe081e02ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe081e02cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081e02cab0 --- trap 0, rip = 0, rsp = 0xfffffe081e02cb70, rbp = 0 --- Tracing command newnfs 0 pid 809 tid 100191 td 0xfffff80012b80940 sched_switch() at sched_switch+0x4cd/frame 0xfffffe081db7d740 mi_switch() at mi_switch+0x3dc/frame 0xfffffe081db7d810 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081db7d850 sleepq_catch_signals() at sleepq_catch_signals+0x30c/frame 0xfffffe081db7d8c0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe081db7d8f0 _sleep() at _sleep+0x677/frame 0xfffffe081db7da30 nfssvc_iod() at nfssvc_iod+0x101/frame 0xfffffe081db7da70 fork_exit() at fork_exit+0x84/frame 0xfffffe081db7dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081db7dab0 --- trap 0, rip = 0, rsp = 0xfffffe081db7db70, rbp = 0 --- Tracing command vnlru pid 16 tid 100138 td 0xfffff80012157000 sched_switch() at sched_switch+0x4cd/frame 0xfffffe081d7eb770 mi_switch() at mi_switch+0x3dc/frame 0xfffffe081d7eb840 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081d7eb880 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe081d7eb8b0 _sleep() at _sleep+0x699/frame 0xfffffe081d7eb9f0 vnlru_proc() at vnlru_proc+0x48/frame 0xfffffe081d7eba70 fork_exit() at fork_exit+0x84/frame 0xfffffe081d7ebab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081d7ebab0 --- trap 0, rip = 0, rsp = 0xfffffe081d7ebb70, rbp = 0 --- Tracing command syncer pid 9 tid 100137 td 0xfffff800121574a0 sched_switch() at sched_switch+0x4cd/frame 0xfffffe081d7e6810 mi_switch() at mi_switch+0x3dc/frame 0xfffffe081d7e68e0 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081d7e6920 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe081d7e6950 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x202/frame 0xfffffe081d7e69d0 sched_sync() at sched_sync+0x5da/frame 0xfffffe081d7e6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081d7e6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081d7e6ab0 --- trap 0, rip = 0, rsp = 0xfffffe081d7e6b70, rbp = 0 --- Tracing command bufdaemon pid 8 tid 100136 td 0xfffff80012157940 sched_switch() at sched_switch+0x4cd/frame 0xfffffe081d7e17c0 mi_switch() at mi_switch+0x3dc/frame 0xfffffe081d7e1890 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081d7e18d0 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe081d7e1900 _sleep() at _sleep+0x699/frame 0xfffffe081d7e1a40 buf_daemon() at buf_daemon+0x68/frame 0xfffffe081d7e1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081d7e1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081d7e1ab0 --- trap 0, rip = 0, rsp = 0xfffffe081d7e1b70, rbp = 0 --- Tracing command bufdaemon pid 8 tid 100152 td 0xfffff80012dce4a0 sched_switch() at sched_switch+0x4cd/frame 0xfffffe081daba7c0 mi_switch() at mi_switch+0x3dc/frame 0xfffffe081daba890 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081daba8d0 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe081daba900 _sleep() at _sleep+0x699/frame 0xfffffe081dabaa40 softdep_flush() at softdep_flush+0x12f/frame 0xfffffe081dabaa70 fork_exit() at fork_exit+0x84/frame 0xfffffe081dabaab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081dabaab0 --- trap 0, rip = 0, rsp = 0xfffffe081dabab70, rbp = 0 --- Tracing command bufdaemon pid 8 tid 100159 td 0xfffff80012b814a0 sched_switch() at sched_switch+0x4cd/frame 0xfffffe081dadd7c0 mi_switch() at mi_switch+0x3dc/frame 0xfffffe081dadd890 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081dadd8d0 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe081dadd900 _sleep() at _sleep+0x699/frame 0xfffffe081dadda40 softdep_flush() at softdep_flush+0x12f/frame 0xfffffe081dadda70 fork_exit() at fork_exit+0x84/frame 0xfffffe081daddab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081daddab0 --- trap 0, rip = 0, rsp = 0xfffffe081daddb70, rbp = 0 --- Tracing command bufdaemon pid 8 tid 100457 td 0xfffff80012cdc940 sched_switch() at sched_switch+0x4cd/frame 0xfffffe081e0c27c0 mi_switch() at mi_switch+0x3dc/frame 0xfffffe081e0c2890 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081e0c28d0 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe081e0c2900 _sleep() at _sleep+0x699/frame 0xfffffe081e0c2a40 softdep_flush() at softdep_flush+0x12f/frame 0xfffffe081e0c2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081e0c2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081e0c2ab0 --- trap 0, rip = 0, rsp = 0xfffffe081e0c2b70, rbp = 0 --- Tracing command pagezero pid 7 tid 100135 td 0xfffff80010008000 sched_switch() at sched_switch+0x4cd/frame 0xfffffe081d7dc7c0 mi_switch() at mi_switch+0x3dc/frame 0xfffffe081d7dc890 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081d7dc8d0 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe081d7dc900 _sleep() at _sleep+0x699/frame 0xfffffe081d7dca40 vm_pagezero() at vm_pagezero+0x85/frame 0xfffffe081d7dca70 fork_exit() at fork_exit+0x84/frame 0xfffffe081d7dcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081d7dcab0 --- trap 0, rip = 0, rsp = 0xfffffe081d7dcb70, rbp = 0 --- Tracing command vmdaemon pid 6 tid 100134 td 0xfffff800100084a0 sched_switch() at sched_switch+0x4cd/frame 0xfffffe081d7d7780 mi_switch() at mi_switch+0x3dc/frame 0xfffffe081d7d7850 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081d7d7890 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081d7d78c0 _sleep() at _sleep+0x6ce/frame 0xfffffe081d7d7a00 vm_daemon() at vm_daemon+0x7e/frame 0xfffffe081d7d7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081d7d7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081d7d7ab0 --- trap 0, rip = 0, rsp = 0xfffffe081d7d7b70, rbp = 0 --- Tracing command pagedaemon pid 5 tid 100133 td 0xfffff80010008940 sched_switch() at sched_switch+0x4cd/frame 0xfffffe081d7d2770 mi_switch() at mi_switch+0x3dc/frame 0xfffffe081d7d2840 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081d7d2880 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe081d7d28b0 _sleep() at _sleep+0x699/frame 0xfffffe081d7d29f0 vm_pageout() at vm_pageout+0x155/frame 0xfffffe081d7d2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081d7d2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081d7d2ab0 --- trap 0, rip = 0, rsp = 0xfffffe081d7d2b70, rbp = 0 --- Tracing command enc_daemon0 pid 4 tid 100132 td 0xfffff80010009000 sched_switch() at sched_switch+0x4cd/frame 0xfffffe081d7cd780 mi_switch() at mi_switch+0x3dc/frame 0xfffffe081d7cd850 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081d7cd890 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081d7cd8c0 _sleep() at _sleep+0x6ce/frame 0xfffffe081d7cda00 enc_daemon() at enc_daemon+0x25d/frame 0xfffffe081d7cda70 fork_exit() at fork_exit+0x84/frame 0xfffffe081d7cdab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081d7cdab0 --- trap 0, rip = 0, rsp = 0xfffffe081d7cdb70, rbp = 0 --- Tracing command sctp_iterator pid 3 tid 100129 td 0xfffff8001000a000 sched_switch() at sched_switch+0x4cd/frame 0xfffffe081d6be7d0 mi_switch() at mi_switch+0x3dc/frame 0xfffffe081d6be8a0 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081d6be8e0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081d6be910 _sleep() at _sleep+0x6ce/frame 0xfffffe081d6bea50 sctp_iterator_thread() at sctp_iterator_thread+0x59/frame 0xfffffe081d6bea70 fork_exit() at fork_exit+0x84/frame 0xfffffe081d6beab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081d6beab0 --- trap 0, rip = 0, rsp = 0xfffffe081d6beb70, rbp = 0 --- Tracing command usb pid 15 tid 100075 td 0xfffff8000db89000 sched_switch() at sched_switch+0x4cd/frame 0xfffffe00002fc890 mi_switch() at mi_switch+0x3dc/frame 0xfffffe00002fc960 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe00002fc9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00002fc9d0 _cv_wait() at _cv_wait+0x1da/frame 0xfffffe00002fca40 usb_process() at usb_process+0x13b/frame 0xfffffe00002fca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00002fcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00002fcab0 --- trap 0, rip = 0, rsp = 0xfffffe00002fcb70, rbp = 0 --- Tracing command usb pid 15 tid 100076 td 0xfffff8000db88940 sched_switch() at sched_switch+0x4cd/frame 0xfffffe0000301890 mi_switch() at mi_switch+0x3dc/frame 0xfffffe0000301960 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe00003019a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00003019d0 _cv_wait() at _cv_wait+0x1da/frame 0xfffffe0000301a40 usb_process() at usb_process+0x13b/frame 0xfffffe0000301a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000301ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000301ab0 --- trap 0, rip = 0, rsp = 0xfffffe0000301b70, rbp = 0 --- Tracing command usb pid 15 tid 100077 td 0xfffff8000db884a0 sched_switch() at sched_switch+0x4cd/frame 0xfffffe0000306890 mi_switch() at mi_switch+0x3dc/frame 0xfffffe0000306960 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe00003069a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00003069d0 _cv_wait() at _cv_wait+0x1da/frame 0xfffffe0000306a40 usb_process() at usb_process+0x13b/frame 0xfffffe0000306a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000306ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000306ab0 --- trap 0, rip = 0, rsp = 0xfffffe0000306b70, rbp = 0 --- Tracing command usb pid 15 tid 100078 td 0xfffff8000db88000 sched_switch() at sched_switch+0x4cd/frame 0xfffffe000030b890 mi_switch() at mi_switch+0x3dc/frame 0xfffffe000030b960 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe000030b9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000030b9d0 _cv_wait() at _cv_wait+0x1da/frame 0xfffffe000030ba40 usb_process() at usb_process+0x13b/frame 0xfffffe000030ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe000030bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000030bab0 --- trap 0, rip = 0, rsp = 0xfffffe000030bb70, rbp = 0 --- Tracing command usb pid 15 tid 100115 td 0xfffff8000dbe2940 sched_switch() at sched_switch+0x4cd/frame 0xfffffe081b470890 mi_switch() at mi_switch+0x3dc/frame 0xfffffe081b470960 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081b4709a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081b4709d0 _cv_wait() at _cv_wait+0x1da/frame 0xfffffe081b470a40 usb_process() at usb_process+0x13b/frame 0xfffffe081b470a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b470ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b470ab0 --- trap 0, rip = 0, rsp = 0xfffffe081b470b70, rbp = 0 --- Tracing command usb pid 15 tid 100116 td 0xfffff8000dbe24a0 sched_switch() at sched_switch+0x4cd/frame 0xfffffe081b475890 mi_switch() at mi_switch+0x3dc/frame 0xfffffe081b475960 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081b4759a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081b4759d0 _cv_wait() at _cv_wait+0x1da/frame 0xfffffe081b475a40 usb_process() at usb_process+0x13b/frame 0xfffffe081b475a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b475ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b475ab0 --- trap 0, rip = 0, rsp = 0xfffffe081b475b70, rbp = 0 --- Tracing command usb pid 15 tid 100117 td 0xfffff8000dbe2000 sched_switch() at sched_switch+0x4cd/frame 0xfffffe081b47a890 mi_switch() at mi_switch+0x3dc/frame 0xfffffe081b47a960 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081b47a9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081b47a9d0 _cv_wait() at _cv_wait+0x1da/frame 0xfffffe081b47aa40 usb_process() at usb_process+0x13b/frame 0xfffffe081b47aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b47aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b47aab0 --- trap 0, rip = 0, rsp = 0xfffffe081b47ab70, rbp = 0 --- Tracing command usb pid 15 tid 100118 td 0xfffff8000dbf8940 sched_switch() at sched_switch+0x4cd/frame 0xfffffe081b47f890 mi_switch() at mi_switch+0x3dc/frame 0xfffffe081b47f960 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081b47f9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081b47f9d0 _cv_wait() at _cv_wait+0x1da/frame 0xfffffe081b47fa40 usb_process() at usb_process+0x13b/frame 0xfffffe081b47fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b47fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b47fab0 --- trap 0, rip = 0, rsp = 0xfffffe081b47fb70, rbp = 0 --- Tracing command usb pid 15 tid 100120 td 0xfffff8000dbf8000 sched_switch() at sched_switch+0x4cd/frame 0xfffffe081b60c890 mi_switch() at mi_switch+0x3dc/frame 0xfffffe081b60c960 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081b60c9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081b60c9d0 _cv_wait() at _cv_wait+0x1da/frame 0xfffffe081b60ca40 usb_process() at usb_process+0x13b/frame 0xfffffe081b60ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b60cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b60cab0 --- trap 0, rip = 0, rsp = 0xfffffe081b60cb70, rbp = 0 --- Tracing command usb pid 15 tid 100121 td 0xfffff8000dbf4940 sched_switch() at sched_switch+0x4cd/frame 0xfffffe081b611890 mi_switch() at mi_switch+0x3dc/frame 0xfffffe081b611960 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081b6119a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081b6119d0 _cv_wait() at _cv_wait+0x1da/frame 0xfffffe081b611a40 usb_process() at usb_process+0x13b/frame 0xfffffe081b611a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b611ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b611ab0 --- trap 0, rip = 0, rsp = 0xfffffe081b611b70, rbp = 0 --- Tracing command usb pid 15 tid 100122 td 0xfffff8000dbf44a0 sched_switch() at sched_switch+0x4cd/frame 0xfffffe081b616890 mi_switch() at mi_switch+0x3dc/frame 0xfffffe081b616960 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081b6169a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081b6169d0 _cv_wait() at _cv_wait+0x1da/frame 0xfffffe081b616a40 usb_process() at usb_process+0x13b/frame 0xfffffe081b616a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b616ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b616ab0 --- trap 0, rip = 0, rsp = 0xfffffe081b616b70, rbp = 0 --- Tracing command usb pid 15 tid 100123 td 0xfffff8000dbf4000 sched_switch() at sched_switch+0x4cd/frame 0xfffffe081b61b890 mi_switch() at mi_switch+0x3dc/frame 0xfffffe081b61b960 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081b61b9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081b61b9d0 _cv_wait() at _cv_wait+0x1da/frame 0xfffffe081b61ba40 usb_process() at usb_process+0x13b/frame 0xfffffe081b61ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b61bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b61bab0 --- trap 0, rip = 0, rsp = 0xfffffe081b61bb70, rbp = 0 --- Tracing command cam pid 2 tid 100058 td 0xfffff800065b1940 sched_switch() at sched_switch+0x4cd/frame 0xfffffe078a7af7a0 mi_switch() at mi_switch+0x3dc/frame 0xfffffe078a7af870 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe078a7af8b0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe078a7af8e0 _sleep() at _sleep+0x6ce/frame 0xfffffe078a7afa20 xpt_done_td() at xpt_done_td+0x13f/frame 0xfffffe078a7afa70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a7afab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a7afab0 --- trap 0, rip = 0, rsp = 0xfffffe078a7afb70, rbp = 0 --- Tracing command cam pid 2 tid 100059 td 0xfffff800065b14a0 sched_switch() at sched_switch+0x4cd/frame 0xfffffe078a7b47a0 mi_switch() at mi_switch+0x3dc/frame 0xfffffe078a7b4870 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe078a7b48b0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe078a7b48e0 _sleep() at _sleep+0x6ce/frame 0xfffffe078a7b4a20 xpt_done_td() at xpt_done_td+0x13f/frame 0xfffffe078a7b4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a7b4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a7b4ab0 --- trap 0, rip = 0, rsp = 0xfffffe078a7b4b70, rbp = 0 --- Tracing command cam pid 2 tid 100060 td 0xfffff800065b1000 sched_switch() at sched_switch+0x4cd/frame 0xfffffe078a7b97a0 mi_switch() at mi_switch+0x3dc/frame 0xfffffe078a7b9870 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe078a7b98b0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe078a7b98e0 _sleep() at _sleep+0x6ce/frame 0xfffffe078a7b9a20 xpt_done_td() at xpt_done_td+0x13f/frame 0xfffffe078a7b9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a7b9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a7b9ab0 --- trap 0, rip = 0, rsp = 0xfffffe078a7b9b70, rbp = 0 --- Tracing command cam pid 2 tid 100061 td 0xfffff800065b0940 sched_switch() at sched_switch+0x4cd/frame 0xfffffe078a7be7a0 mi_switch() at mi_switch+0x3dc/frame 0xfffffe078a7be870 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe078a7be8b0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe078a7be8e0 _sleep() at _sleep+0x6ce/frame 0xfffffe078a7bea20 xpt_done_td() at xpt_done_td+0x13f/frame 0xfffffe078a7bea70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a7beab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a7beab0 --- trap 0, rip = 0, rsp = 0xfffffe078a7beb70, rbp = 0 --- Tracing command cam pid 2 tid 100062 td 0xfffff800065b04a0 sched_switch() at sched_switch+0x4cd/frame 0xfffffe078a7c37a0 mi_switch() at mi_switch+0x3dc/frame 0xfffffe078a7c3870 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe078a7c38b0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe078a7c38e0 _sleep() at _sleep+0x6ce/frame 0xfffffe078a7c3a20 xpt_done_td() at xpt_done_td+0x13f/frame 0xfffffe078a7c3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a7c3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a7c3ab0 --- trap 0, rip = 0, rsp = 0xfffffe078a7c3b70, rbp = 0 --- Tracing command cam pid 2 tid 100131 td 0xfffff800100094a0 sched_switch() at sched_switch+0x4cd/frame 0xfffffe081d6c8790 mi_switch() at mi_switch+0x3dc/frame 0xfffffe081d6c8860 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081d6c88a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081d6c88d0 _sleep() at _sleep+0x6ce/frame 0xfffffe081d6c8a10 xpt_scanner_thread() at xpt_scanner_thread+0x5c/frame 0xfffffe081d6c8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081d6c8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081d6c8ab0 --- trap 0, rip = 0, rsp = 0xfffffe081d6c8b70, rbp = 0 --- Tracing command rand_harvestq pid 14 tid 100057 td 0xfffff800065b2000 sched_switch() at sched_switch+0x4cd/frame 0xfffffe078a7aa7d0 mi_switch() at mi_switch+0x3dc/frame 0xfffffe078a7aa8a0 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe078a7aa8e0 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe078a7aa910 _sleep() at _sleep+0x699/frame 0xfffffe078a7aaa50 random_kthread() at random_kthread+0x37/frame 0xfffffe078a7aaa70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a7aaab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a7aaab0 --- trap 0, rip = 0, rsp = 0xfffffe078a7aab70, rbp = 0 --- Tracing command geom pid 13 tid 100053 td 0xfffff800065a44a0 sched_switch() at sched_switch+0x4cd/frame 0xfffffe078a7967b0 mi_switch() at mi_switch+0x3dc/frame 0xfffffe078a796880 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe078a7968c0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe078a7968f0 _sleep() at _sleep+0x6ce/frame 0xfffffe078a796a30 g_run_events() at g_run_events+0x4d/frame 0xfffffe078a796a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a796ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a796ab0 --- trap 0, rip = 0, rsp = 0xfffffe078a796b70, rbp = 0 --- Tracing command geom pid 13 tid 100054 td 0xfffff800065a4000 sched_switch() at sched_switch+0x4cd/frame 0xfffffe078a79b7b0 mi_switch() at mi_switch+0x3dc/frame 0xfffffe078a79b880 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe078a79b8c0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe078a79b8f0 _sleep() at _sleep+0x6ce/frame 0xfffffe078a79ba30 g_io_schedule_up() at g_io_schedule_up+0xf7/frame 0xfffffe078a79ba60 g_up_procbody() at g_up_procbody+0x7d/frame 0xfffffe078a79ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a79bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a79bab0 --- trap 0, rip = 0, rsp = 0xfffffe078a79bb70, rbp = 0 --- Tracing command geom pid 13 tid 100055 td 0xfffff800065b2940 sched_switch() at sched_switch+0x4cd/frame 0xfffffe078a7a07b0 mi_switch() at mi_switch+0x3dc/frame 0xfffffe078a7a0880 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe078a7a08c0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe078a7a08f0 _sleep() at _sleep+0x6ce/frame 0xfffffe078a7a0a30 g_io_schedule_down() at g_io_schedule_down+0x12c/frame 0xfffffe078a7a0a60 g_down_procbody() at g_down_procbody+0x7d/frame 0xfffffe078a7a0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a7a0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a7a0ab0 --- trap 0, rip = 0, rsp = 0xfffffe078a7a0b70, rbp = 0 --- Tracing command intr pid 12 tid 100027 td 0xfffff80006576000 sched_switch() at sched_switch+0x4cd/frame 0xfffffe078a714960 mi_switch() at mi_switch+0x3dc/frame 0xfffffe078a714a30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe078a714a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a714ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a714ab0 --- trap 0, rip = 0, rsp = 0xfffffe078a714b70, rbp = 0 --- Tracing command intr pid 12 tid 100028 td 0xfffff8000659d940 sched_switch() at sched_switch+0x4cd/frame 0xfffffe078a719960 mi_switch() at mi_switch+0x3dc/frame 0xfffffe078a719a30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe078a719a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a719ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a719ab0 --- trap 0, rip = 0, rsp = 0xfffffe078a719b70, rbp = 0 --- Tracing command intr pid 12 tid 100029 td 0xfffff8000659d4a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100030 td 0xfffff8000659d000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100031 td 0xfffff8000659c940 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100032 td 0xfffff8000659c4a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100033 td 0xfffff8000659c000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100034 td 0xfffff8000659b940 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100035 td 0xfffff8000659b4a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100036 td 0xfffff8000659b000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100037 td 0xfffff800065a0940 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100038 td 0xfffff800065a04a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100039 td 0xfffff800065a0000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100040 td 0xfffff8000659f940 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100041 td 0xfffff8000659f4a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100042 td 0xfffff8000659f000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100043 td 0xfffff8000659e940 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100044 td 0xfffff8000659e4a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100045 td 0xfffff8000659e000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100046 td 0xfffff800065a6940 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100047 td 0xfffff800065a64a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100048 td 0xfffff800065a6000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100049 td 0xfffff800065a5940 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100050 td 0xfffff800065a54a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100051 td 0xfffff800065a5000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100052 td 0xfffff800065a4940 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100064 td 0xfffff80006760940 sched_switch() at sched_switch+0x4cd/frame 0xfffffe078a7cd960 mi_switch() at mi_switch+0x3dc/frame 0xfffffe078a7cda30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe078a7cda70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a7cdab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a7cdab0 --- trap 0, rip = 0, rsp = 0xfffffe078a7cdb70, rbp = 0 --- Tracing command intr pid 12 tid 100065 td 0xfffff800067604a0 sched_switch() at sched_switch+0x4cd/frame 0xfffffe078a7d2960 mi_switch() at mi_switch+0x3dc/frame 0xfffffe078a7d2a30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe078a7d2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a7d2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a7d2ab0 --- trap 0, rip = 0, rsp = 0xfffffe078a7d2b70, rbp = 0 --- Tracing command intr pid 12 tid 100067 td 0xfffff8000675f940 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100072 td 0xfffff8000675e000 sched_switch() at sched_switch+0x4cd/frame 0xfffffe078a7f7960 mi_switch() at mi_switch+0x3dc/frame 0xfffffe078a7f7a30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe078a7f7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a7f7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a7f7ab0 --- trap 0, rip = 0, rsp = 0xfffffe078a7f7b70, rbp = 0 --- Tracing command intr pid 12 tid 100073 td 0xfffff8000db89940 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100074 td 0xfffff8000db894a0 sched_switch() at sched_switch+0x4cd/frame 0xfffffe00002f7960 mi_switch() at mi_switch+0x3dc/frame 0xfffffe00002f7a30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe00002f7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00002f7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00002f7ab0 --- trap 0, rip = 0, rsp = 0xfffffe00002f7b70, rbp = 0 --- Tracing command intr pid 12 tid 100079 td 0xfffff8000db87940 sched_switch() at sched_switch+0x4cd/frame 0xfffffe0000310960 mi_switch() at mi_switch+0x3dc/frame 0xfffffe0000310a30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe0000310a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000310ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000310ab0 --- trap 0, rip = 0, rsp = 0xfffffe0000310b70, rbp = 0 --- Tracing command intr pid 12 tid 100080 td 0xfffff8000db874a0 sched_switch() at sched_switch+0x4cd/frame 0xfffffe000035f960 mi_switch() at mi_switch+0x3dc/frame 0xfffffe000035fa30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe000035fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000035fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000035fab0 --- trap 0, rip = 0, rsp = 0xfffffe000035fb70, rbp = 0 --- Tracing command intr pid 12 tid 100082 td 0xfffff8000dbbe940 sched_switch() at sched_switch+0x4cd/frame 0xfffffe0000369960 mi_switch() at mi_switch+0x3dc/frame 0xfffffe0000369a30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe0000369a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000369ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000369ab0 --- trap 0, rip = 0, rsp = 0xfffffe0000369b70, rbp = 0 --- Tracing command intr pid 12 tid 100084 td 0xfffff8000dbbe000 sched_switch() at sched_switch+0x4cd/frame 0xfffffe0000373960 mi_switch() at mi_switch+0x3dc/frame 0xfffffe0000373a30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe0000373a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000373ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000373ab0 --- trap 0, rip = 0, rsp = 0xfffffe0000373b70, rbp = 0 --- Tracing command intr pid 12 tid 100086 td 0xfffff8000dbbd4a0 sched_switch() at sched_switch+0x4cd/frame 0xfffffe000037d960 mi_switch() at mi_switch+0x3dc/frame 0xfffffe000037da30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe000037da70 fork_exit() at fork_exit+0x84/frame 0xfffffe000037dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000037dab0 --- trap 0, rip = 0, rsp = 0xfffffe000037db70, rbp = 0 --- Tracing command intr pid 12 tid 100088 td 0xfffff8000dbbc940 sched_switch() at sched_switch+0x4cd/frame 0xfffffe0000387960 mi_switch() at mi_switch+0x3dc/frame 0xfffffe0000387a30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe0000387a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000387ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000387ab0 --- trap 0, rip = 0, rsp = 0xfffffe0000387b70, rbp = 0 --- Tracing command intr pid 12 tid 100090 td 0xfffff8000dbbc000 sched_switch() at sched_switch+0x4cd/frame 0xfffffe0000391960 mi_switch() at mi_switch+0x3dc/frame 0xfffffe0000391a30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe0000391a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000391ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000391ab0 --- trap 0, rip = 0, rsp = 0xfffffe0000391b70, rbp = 0 --- Tracing command intr pid 12 tid 100092 td 0xfffff8000dbc14a0 sched_switch() at sched_switch+0x4cd/frame 0xfffffe000039b960 mi_switch() at mi_switch+0x3dc/frame 0xfffffe000039ba30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe000039ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe000039bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000039bab0 --- trap 0, rip = 0, rsp = 0xfffffe000039bb70, rbp = 0 --- Tracing command intr pid 12 tid 100094 td 0xfffff8000dbc0940 sched_switch() at sched_switch+0x4cd/frame 0xfffffe00003a5960 mi_switch() at mi_switch+0x3dc/frame 0xfffffe00003a5a30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe00003a5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00003a5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00003a5ab0 --- trap 0, rip = 0, rsp = 0xfffffe00003a5b70, rbp = 0 --- Tracing command intr pid 12 tid 100096 td 0xfffff8000dbc0000 sched_switch() at sched_switch+0x4cd/frame 0xfffffe00003af960 mi_switch() at mi_switch+0x3dc/frame 0xfffffe00003afa30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe00003afa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00003afab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00003afab0 --- trap 0, rip = 0, rsp = 0xfffffe00003afb70, rbp = 0 --- Tracing command intr pid 12 tid 100097 td 0xfffff8000dbbf940 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100099 td 0xfffff8000dbbf000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100101 td 0xfffff8000dbe04a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100103 td 0xfffff8000dbdf940 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100105 td 0xfffff8000dbdf000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100107 td 0xfffff8000dbde4a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100109 td 0xfffff8000dbe8940 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100111 td 0xfffff8000dbe8000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100113 td 0xfffff8000dbe74a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100114 td 0xfffff8000dbe7000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100119 td 0xfffff8000dbf84a0 sched_switch() at sched_switch+0x4cd/frame 0xfffffe081b607960 mi_switch() at mi_switch+0x3dc/frame 0xfffffe081b607a30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe081b607a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b607ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b607ab0 --- trap 0, rip = 0, rsp = 0xfffffe081b607b70, rbp = 0 --- Tracing command intr pid 12 tid 100124 td 0xfffff8000dbf3940 sched_switch() at sched_switch+0x4cd/frame 0xfffffe081b620960 mi_switch() at mi_switch+0x3dc/frame 0xfffffe081b620a30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe081b620a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b620ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b620ab0 --- trap 0, rip = 0, rsp = 0xfffffe081b620b70, rbp = 0 --- Tracing command intr pid 12 tid 100125 td 0xfffff8000dbf34a0 sched_switch() at sched_switch+0x4cd/frame 0xfffffe081d6a2960 mi_switch() at mi_switch+0x3dc/frame 0xfffffe081d6a2a30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe081d6a2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081d6a2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081d6a2ab0 --- trap 0, rip = 0, rsp = 0xfffffe081d6a2b70, rbp = 0 --- Tracing command intr pid 12 tid 100126 td 0xfffff8000dbf3000 sched_switch() at sched_switch+0x4cd/frame 0xfffffe081d6aa960 mi_switch() at mi_switch+0x3dc/frame 0xfffffe081d6aaa30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe081d6aaa70 fork_exit() at fork_exit+0x84/frame 0xfffffe081d6aaab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081d6aaab0 --- trap 0, rip = 0, rsp = 0xfffffe081d6aab70, rbp = 0 --- Tracing command idle pid 11 tid 100003 td 0xfffff80006564000 cpustop_handler() at cpustop_handler+0x28/frame 0xffffffff817d7d00 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xffffffff817d7d20 trap() at trap+0x3a/frame 0xffffffff817d7f30 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff817d7f30 --- trap 0x13, rip = 0xffffffff80370958, rsp = 0xffffffff817d7ff0, rbp = 0xfffffe078a69c920 --- acpi_cpu_idle() at acpi_cpu_idle+0x218/frame 0xfffffe078a69c920 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078a69c940 cpu_idle() at cpu_idle+0x90/frame 0xfffffe078a69c960 sched_idletd() at sched_idletd+0x4e0/frame 0xfffffe078a69ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a69cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a69cab0 --- trap 0, rip = 0, rsp = 0xfffffe078a69cb70, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffff80006563940 kdb_alt_break_internal() at kdb_alt_break_internal+0x197/frame 0xfffffe078a6a16e0 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe078a6a16f0 uart_intr_rxready() at uart_intr_rxready+0x99/frame 0xfffffe078a6a1720 uart_intr() at uart_intr+0x111/frame 0xfffffe078a6a1760 intr_event_handle() at intr_event_handle+0x9c/frame 0xfffffe078a6a17b0 intr_execute_handlers() at intr_execute_handlers+0x48/frame 0xfffffe078a6a17e0 lapic_handle_intr() at lapic_handle_intr+0x63/frame 0xfffffe078a6a1810 Xapic_isr1() at Xapic_isr1+0xa4/frame 0xfffffe078a6a1810 --- interrupt, rip = 0xffffffff803709f7, rsp = 0xfffffe078a6a18d0, rbp = 0xfffffe078a6a1920 --- acpi_cpu_idle() at acpi_cpu_idle+0x2b7/frame 0xfffffe078a6a1920 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078a6a1940 cpu_idle() at cpu_idle+0x90/frame 0xfffffe078a6a1960 sched_idletd() at sched_idletd+0x4e0/frame 0xfffffe078a6a1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a6a1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a6a1ab0 --- trap 0, rip = 0, rsp = 0xfffffe078a6a1b70, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffff800065634a0 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fbf59cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fbf59d10 trap() at trap+0x3a/frame 0xfffffe07fbf59f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fbf59f20 --- trap 0x13, rip = 0xffffffff80370958, rsp = 0xfffffe07fbf59fe0, rbp = 0xfffffe078a6a6920 --- acpi_cpu_idle() at acpi_cpu_idle+0x218/frame 0xfffffe078a6a6920 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078a6a6940 cpu_idle() at cpu_idle+0x90/frame 0xfffffe078a6a6960 sched_idletd() at sched_idletd+0x4e0/frame 0xfffffe078a6a6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a6a6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a6a6ab0 --- trap 0, rip = 0, rsp = 0xfffffe078a6a6b70, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffff80006563000 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fbf61cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fbf61d10 trap() at trap+0x3a/frame 0xfffffe07fbf61f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fbf61f20 --- trap 0x13, rip = 0xffffffff80370958, rsp = 0xfffffe07fbf61fe0, rbp = 0xfffffe078a6ab920 --- acpi_cpu_idle() at acpi_cpu_idle+0x218/frame 0xfffffe078a6ab920 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078a6ab940 cpu_idle() at cpu_idle+0x90/frame 0xfffffe078a6ab960 sched_idletd() at sched_idletd+0x4e0/frame 0xfffffe078a6aba70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a6abab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a6abab0 --- trap 0, rip = 0, rsp = 0xfffffe078a6abb70, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffff8000655d940 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fbf69cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fbf69d10 trap() at trap+0x3a/frame 0xfffffe07fbf69f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fbf69f20 --- trap 0x13, rip = 0xffffffff80370958, rsp = 0xfffffe07fbf69fe0, rbp = 0xfffffe078a6b0920 --- acpi_cpu_idle() at acpi_cpu_idle+0x218/frame 0xfffffe078a6b0920 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078a6b0940 cpu_idle() at cpu_idle+0x90/frame 0xfffffe078a6b0960 sched_idletd() at sched_idletd+0x4e0/frame 0xfffffe078a6b0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a6b0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a6b0ab0 --- trap 0, rip = 0, rsp = 0xfffffe078a6b0b70, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffff8000655d4a0 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fbf71cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fbf71d10 trap() at trap+0x3a/frame 0xfffffe07fbf71f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fbf71f20 --- trap 0x13, rip = 0xffffffff80370958, rsp = 0xfffffe07fbf71fe0, rbp = 0xfffffe078a6b5920 --- acpi_cpu_idle() at acpi_cpu_idle+0x218/frame 0xfffffe078a6b5920 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078a6b5940 cpu_idle() at cpu_idle+0x90/frame 0xfffffe078a6b5960 sched_idletd() at sched_idletd+0x4e0/frame 0xfffffe078a6b5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a6b5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a6b5ab0 --- trap 0, rip = 0, rsp = 0xfffffe078a6b5b70, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffff8000655d000 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fbf79cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fbf79d10 trap() at trap+0x3a/frame 0xfffffe07fbf79f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fbf79f20 --- trap 0x13, rip = 0xffffffff80370958, rsp = 0xfffffe07fbf79fe0, rbp = 0xfffffe078a6ba920 --- acpi_cpu_idle() at acpi_cpu_idle+0x218/frame 0xfffffe078a6ba920 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078a6ba940 cpu_idle() at cpu_idle+0x90/frame 0xfffffe078a6ba960 sched_idletd() at sched_idletd+0x4e0/frame 0xfffffe078a6baa70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a6baab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a6baab0 --- trap 0, rip = 0, rsp = 0xfffffe078a6bab70, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffff80006575940 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fbf81cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fbf81d10 trap() at trap+0x3a/frame 0xfffffe07fbf81f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fbf81f20 --- trap 0x13, rip = 0xffffffff80370958, rsp = 0xfffffe07fbf81fe0, rbp = 0xfffffe078a6bf920 --- acpi_cpu_idle() at acpi_cpu_idle+0x218/frame 0xfffffe078a6bf920 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078a6bf940 cpu_idle() at cpu_idle+0x90/frame 0xfffffe078a6bf960 sched_idletd() at sched_idletd+0x4e0/frame 0xfffffe078a6bfa70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a6bfab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a6bfab0 --- trap 0, rip = 0, rsp = 0xfffffe078a6bfb70, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffff800065754a0 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fbf89cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fbf89d10 trap() at trap+0x3a/frame 0xfffffe07fbf89f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fbf89f20 --- trap 0x13, rip = 0xffffffff80370958, rsp = 0xfffffe07fbf89fe0, rbp = 0xfffffe078a6c4920 --- acpi_cpu_idle() at acpi_cpu_idle+0x218/frame 0xfffffe078a6c4920 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078a6c4940 cpu_idle() at cpu_idle+0x90/frame 0xfffffe078a6c4960 sched_idletd() at sched_idletd+0x4e0/frame 0xfffffe078a6c4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a6c4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a6c4ab0 --- trap 0, rip = 0, rsp = 0xfffffe078a6c4b70, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffff80006575000 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fbf91cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fbf91d10 trap() at trap+0x3a/frame 0xfffffe07fbf91f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fbf91f20 --- trap 0x13, rip = 0xffffffff80370958, rsp = 0xfffffe07fbf91fe0, rbp = 0xfffffe078a6c9920 --- acpi_cpu_idle() at acpi_cpu_idle+0x218/frame 0xfffffe078a6c9920 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078a6c9940 cpu_idle() at cpu_idle+0x90/frame 0xfffffe078a6c9960 sched_idletd() at sched_idletd+0x4e0/frame 0xfffffe078a6c9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a6c9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a6c9ab0 --- trap 0, rip = 0, rsp = 0xfffffe078a6c9b70, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffff80006574940 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fbf99cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fbf99d10 trap() at trap+0x3a/frame 0xfffffe07fbf99f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fbf99f20 --- trap 0x13, rip = 0xffffffff80370958, rsp = 0xfffffe07fbf99fe0, rbp = 0xfffffe078a6ce920 --- acpi_cpu_idle() at acpi_cpu_idle+0x218/frame 0xfffffe078a6ce920 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078a6ce940 cpu_idle() at cpu_idle+0x90/frame 0xfffffe078a6ce960 sched_idletd() at sched_idletd+0x4e0/frame 0xfffffe078a6cea70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a6ceab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a6ceab0 --- trap 0, rip = 0, rsp = 0xfffffe078a6ceb70, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffff800065744a0 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fbfa1cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fbfa1d10 trap() at trap+0x3a/frame 0xfffffe07fbfa1f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fbfa1f20 --- trap 0x13, rip = 0xffffffff80370958, rsp = 0xfffffe07fbfa1fe0, rbp = 0xfffffe078a6d3920 --- acpi_cpu_idle() at acpi_cpu_idle+0x218/frame 0xfffffe078a6d3920 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078a6d3940 cpu_idle() at cpu_idle+0x90/frame 0xfffffe078a6d3960 sched_idletd() at sched_idletd+0x4e0/frame 0xfffffe078a6d3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a6d3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a6d3ab0 --- trap 0, rip = 0, rsp = 0xfffffe078a6d3b70, rbp = 0 --- Tracing command idle pid 11 tid 100015 td 0xfffff80006574000 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fbfa9cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fbfa9d10 trap() at trap+0x3a/frame 0xfffffe07fbfa9f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fbfa9f20 --- trap 0x13, rip = 0xffffffff80370958, rsp = 0xfffffe07fbfa9fe0, rbp = 0xfffffe078a6d8920 --- acpi_cpu_idle() at acpi_cpu_idle+0x218/frame 0xfffffe078a6d8920 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078a6d8940 cpu_idle() at cpu_idle+0x90/frame 0xfffffe078a6d8960 sched_idletd() at sched_idletd+0x4e0/frame 0xfffffe078a6d8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a6d8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a6d8ab0 --- trap 0, rip = 0, rsp = 0xfffffe078a6d8b70, rbp = 0 --- Tracing command idle pid 11 tid 100016 td 0xfffff80006573940 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fbfb1cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fbfb1d10 trap() at trap+0x3a/frame 0xfffffe07fbfb1f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fbfb1f20 --- trap 0x13, rip = 0xffffffff80370958, rsp = 0xfffffe07fbfb1fe0, rbp = 0xfffffe078a6dd920 --- acpi_cpu_idle() at acpi_cpu_idle+0x218/frame 0xfffffe078a6dd920 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078a6dd940 cpu_idle() at cpu_idle+0x90/frame 0xfffffe078a6dd960 sched_idletd() at sched_idletd+0x4e0/frame 0xfffffe078a6dda70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a6ddab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a6ddab0 --- trap 0, rip = 0, rsp = 0xfffffe078a6ddb70, rbp = 0 --- Tracing command idle pid 11 tid 100017 td 0xfffff800065734a0 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fbfb9cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fbfb9d10 trap() at trap+0x3a/frame 0xfffffe07fbfb9f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fbfb9f20 --- trap 0x13, rip = 0xffffffff80370958, rsp = 0xfffffe07fbfb9fe0, rbp = 0xfffffe078a6e2920 --- acpi_cpu_idle() at acpi_cpu_idle+0x218/frame 0xfffffe078a6e2920 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078a6e2940 cpu_idle() at cpu_idle+0x90/frame 0xfffffe078a6e2960 sched_idletd() at sched_idletd+0x4e0/frame 0xfffffe078a6e2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a6e2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a6e2ab0 --- trap 0, rip = 0, rsp = 0xfffffe078a6e2b70, rbp = 0 --- Tracing command idle pid 11 tid 100018 td 0xfffff80006573000 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fbfc1cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fbfc1d10 trap() at trap+0x3a/frame 0xfffffe07fbfc1f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fbfc1f20 --- trap 0x13, rip = 0xffffffff80370958, rsp = 0xfffffe07fbfc1fe0, rbp = 0xfffffe078a6e7920 --- acpi_cpu_idle() at acpi_cpu_idle+0x218/frame 0xfffffe078a6e7920 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078a6e7940 cpu_idle() at cpu_idle+0x90/frame 0xfffffe078a6e7960 sched_idletd() at sched_idletd+0x4e0/frame 0xfffffe078a6e7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a6e7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a6e7ab0 --- trap 0, rip = 0, rsp = 0xfffffe078a6e7b70, rbp = 0 --- Tracing command idle pid 11 tid 100019 td 0xfffff80006578940 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fbfc9cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fbfc9d10 trap() at trap+0x3a/frame 0xfffffe07fbfc9f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fbfc9f20 --- trap 0x13, rip = 0xffffffff80370958, rsp = 0xfffffe07fbfc9fe0, rbp = 0xfffffe078a6ec920 --- acpi_cpu_idle() at acpi_cpu_idle+0x218/frame 0xfffffe078a6ec920 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078a6ec940 cpu_idle() at cpu_idle+0x90/frame 0xfffffe078a6ec960 sched_idletd() at sched_idletd+0x4e0/frame 0xfffffe078a6eca70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a6ecab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a6ecab0 --- trap 0, rip = 0, rsp = 0xfffffe078a6ecb70, rbp = 0 --- Tracing command idle pid 11 tid 100020 td 0xfffff800065784a0 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fbfd1cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fbfd1d10 trap() at trap+0x3a/frame 0xfffffe07fbfd1f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fbfd1f20 --- trap 0x13, rip = 0xffffffff80370958, rsp = 0xfffffe07fbfd1fe0, rbp = 0xfffffe078a6f1920 --- acpi_cpu_idle() at acpi_cpu_idle+0x218/frame 0xfffffe078a6f1920 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078a6f1940 cpu_idle() at cpu_idle+0x90/frame 0xfffffe078a6f1960 sched_idletd() at sched_idletd+0x4e0/frame 0xfffffe078a6f1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a6f1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a6f1ab0 --- trap 0, rip = 0, rsp = 0xfffffe078a6f1b70, rbp = 0 --- Tracing command idle pid 11 tid 100021 td 0xfffff80006578000 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fbfd9cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fbfd9d10 trap() at trap+0x3a/frame 0xfffffe07fbfd9f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fbfd9f20 --- trap 0x13, rip = 0xffffffff80370958, rsp = 0xfffffe07fbfd9fe0, rbp = 0xfffffe078a6f6920 --- acpi_cpu_idle() at acpi_cpu_idle+0x218/frame 0xfffffe078a6f6920 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078a6f6940 cpu_idle() at cpu_idle+0x90/frame 0xfffffe078a6f6960 sched_idletd() at sched_idletd+0x4e0/frame 0xfffffe078a6f6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a6f6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a6f6ab0 --- trap 0, rip = 0, rsp = 0xfffffe078a6f6b70, rbp = 0 --- Tracing command idle pid 11 tid 100022 td 0xfffff80006577940 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fbfe1cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fbfe1d10 trap() at trap+0x3a/frame 0xfffffe07fbfe1f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fbfe1f20 --- trap 0x13, rip = 0xffffffff80370958, rsp = 0xfffffe07fbfe1fe0, rbp = 0xfffffe078a6fb920 --- acpi_cpu_idle() at acpi_cpu_idle+0x218/frame 0xfffffe078a6fb920 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078a6fb940 cpu_idle() at cpu_idle+0x90/frame 0xfffffe078a6fb960 sched_idletd() at sched_idletd+0x4e0/frame 0xfffffe078a6fba70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a6fbab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a6fbab0 --- trap 0, rip = 0, rsp = 0xfffffe078a6fbb70, rbp = 0 --- Tracing command idle pid 11 tid 100023 td 0xfffff800065774a0 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fbfe9cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fbfe9d10 trap() at trap+0x3a/frame 0xfffffe07fbfe9f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fbfe9f20 --- trap 0x13, rip = 0xffffffff80370958, rsp = 0xfffffe07fbfe9fe0, rbp = 0xfffffe078a700920 --- acpi_cpu_idle() at acpi_cpu_idle+0x218/frame 0xfffffe078a700920 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078a700940 cpu_idle() at cpu_idle+0x90/frame 0xfffffe078a700960 sched_idletd() at sched_idletd+0x4e0/frame 0xfffffe078a700a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a700ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a700ab0 --- trap 0, rip = 0, rsp = 0xfffffe078a700b70, rbp = 0 --- Tracing command idle pid 11 tid 100024 td 0xfffff80006577000 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fbff1cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fbff1d10 trap() at trap+0x3a/frame 0xfffffe07fbff1f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fbff1f20 --- trap 0x13, rip = 0xffffffff80370958, rsp = 0xfffffe07fbff1fe0, rbp = 0xfffffe078a705920 --- acpi_cpu_idle() at acpi_cpu_idle+0x218/frame 0xfffffe078a705920 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078a705940 cpu_idle() at cpu_idle+0x90/frame 0xfffffe078a705960 sched_idletd() at sched_idletd+0x4e0/frame 0xfffffe078a705a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a705ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a705ab0 --- trap 0, rip = 0, rsp = 0xfffffe078a705b70, rbp = 0 --- Tracing command idle pid 11 tid 100025 td 0xfffff80006576940 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fbff9cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fbff9d10 trap() at trap+0x3a/frame 0xfffffe07fbff9f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fbff9f20 --- trap 0x13, rip = 0xffffffff80370958, rsp = 0xfffffe07fbff9fe0, rbp = 0xfffffe078a70a920 --- acpi_cpu_idle() at acpi_cpu_idle+0x218/frame 0xfffffe078a70a920 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078a70a940 cpu_idle() at cpu_idle+0x90/frame 0xfffffe078a70a960 sched_idletd() at sched_idletd+0x4e0/frame 0xfffffe078a70aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a70aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a70aab0 --- trap 0, rip = 0, rsp = 0xfffffe078a70ab70, rbp = 0 --- Tracing command idle pid 11 tid 100026 td 0xfffff800065764a0 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe078a68acf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe078a68ad10 trap() at trap+0x3a/frame 0xfffffe078a68af20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe078a68af20 --- trap 0x13, rip = 0xffffffff80370958, rsp = 0xfffffe078a68afe0, rbp = 0xfffffe078a70f920 --- acpi_cpu_idle() at acpi_cpu_idle+0x218/frame 0xfffffe078a70f920 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078a70f940 cpu_idle() at cpu_idle+0x90/frame 0xfffffe078a70f960 sched_idletd() at sched_idletd+0x4e0/frame 0xfffffe078a70fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a70fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a70fab0 --- trap 0, rip = 0, rsp = 0xfffffe078a70fb70, rbp = 0 --- Tracing command init pid 1 tid 100002 td 0xfffff800065644a0 sched_switch() at sched_switch+0x4cd/frame 0xfffffe078a697420 mi_switch() at mi_switch+0x3dc/frame 0xfffffe078a6974f0 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe078a697530 sleepq_catch_signals() at sleepq_catch_signals+0x30c/frame 0xfffffe078a6975a0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe078a6975d0 _sleep() at _sleep+0x6ba/frame 0xfffffe078a697710 kern_wait6() at kern_wait6+0x405/frame 0xfffffe078a6977b0 sys_wait4() at sys_wait4+0x73/frame 0xfffffe078a6979a0 amd64_syscall() at amd64_syscall+0x276/frame 0xfffffe078a697ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe078a697ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x419b5a, rsp = 0x7fffffffe6d8, rbp = 0x7fffffffe7d0 --- Tracing command audit pid 10 tid 100001 td 0xfffff80006564940 sched_switch() at sched_switch+0x4cd/frame 0xfffffe078a692860 mi_switch() at mi_switch+0x3dc/frame 0xfffffe078a692930 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe078a692970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe078a6929a0 _cv_wait() at _cv_wait+0x1da/frame 0xfffffe078a692a10 audit_worker() at audit_worker+0xa3/frame 0xfffffe078a692a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a692ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a692ab0 --- trap 0, rip = 0, rsp = 0xfffffe078a692b70, rbp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xffffffff8186b690 sched_switch() at sched_switch+0x4cd/frame 0xffffffff81c048a0 mi_switch() at mi_switch+0x3dc/frame 0xffffffff81c04970 sleepq_switch() at sleepq_switch+0x152/frame 0xffffffff81c049b0 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xffffffff81c049e0 _sleep() at _sleep+0x699/frame 0xffffffff81c04b20 swapper() at swapper+0x246/frame 0xffffffff81c04b70 btext() at btext+0x2c Tracing command kernel pid 0 tid 100056 td 0xfffff800065b24a0 sched_switch() at sched_switch+0x4cd/frame 0xfffffe078a7a57c0 mi_switch() at mi_switch+0x3dc/frame 0xfffffe078a7a5890 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe078a7a58d0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe078a7a5900 _sleep() at _sleep+0x6ce/frame 0xfffffe078a7a5a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe078a7a5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a7a5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a7a5ab0 --- trap 0, rip = 0, rsp = 0xfffffe078a7a5b70, rbp = 0 --- Tracing command kernel pid 0 tid 100063 td 0xfffff800065b0000 sched_switch() at sched_switch+0x4cd/frame 0xfffffe078a7c87c0 mi_switch() at mi_switch+0x3dc/frame 0xfffffe078a7c8890 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe078a7c88d0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe078a7c8900 _sleep() at _sleep+0x6ce/frame 0xfffffe078a7c8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe078a7c8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a7c8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a7c8ab0 --- trap 0, rip = 0, rsp = 0xfffffe078a7c8b70, rbp = 0 --- Tracing command kernel pid 0 tid 100066 td 0xfffff80006760000 sched_switch() at sched_switch+0x4cd/frame 0xfffffe078a7d77c0 mi_switch() at mi_switch+0x3dc/frame 0xfffffe078a7d7890 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe078a7d78d0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe078a7d7900 _sleep() at _sleep+0x6ce/frame 0xfffffe078a7d7a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe078a7d7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a7d7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a7d7ab0 --- trap 0, rip = 0, rsp = 0xfffffe078a7d7b70, rbp = 0 --- Tracing command kernel pid 0 tid 100068 td 0xfffff8000675f4a0 sched_switch() at sched_switch+0x4cd/frame 0xfffffe078a7e1800 mi_switch() at mi_switch+0x3dc/frame 0xfffffe078a7e18d0 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe078a7e1910 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe078a7e1940 msleep_spin_sbt() at msleep_spin_sbt+0x423/frame 0xfffffe078a7e1a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x8d/frame 0xfffffe078a7e1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a7e1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a7e1ab0 --- trap 0, rip = 0, rsp = 0xfffffe078a7e1b70, rbp = 0 --- Tracing command kernel pid 0 tid 100069 td 0xfffff8000675f000 sched_switch() at sched_switch+0x4cd/frame 0xfffffe078a7e6800 mi_switch() at mi_switch+0x3dc/frame 0xfffffe078a7e68d0 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe078a7e6910 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe078a7e6940 msleep_spin_sbt() at msleep_spin_sbt+0x423/frame 0xfffffe078a7e6a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x8d/frame 0xfffffe078a7e6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a7e6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a7e6ab0 --- trap 0, rip = 0, rsp = 0xfffffe078a7e6b70, rbp = 0 --- Tracing command kernel pid 0 tid 100070 td 0xfffff8000675e940 sched_switch() at sched_switch+0x4cd/frame 0xfffffe078a7eb800 mi_switch() at mi_switch+0x3dc/frame 0xfffffe078a7eb8d0 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe078a7eb910 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe078a7eb940 msleep_spin_sbt() at msleep_spin_sbt+0x423/frame 0xfffffe078a7eba40 taskqueue_thread_loop() at taskqueue_thread_loop+0x8d/frame 0xfffffe078a7eba70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a7ebab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a7ebab0 --- trap 0, rip = 0, rsp = 0xfffffe078a7ebb70, rbp = 0 --- Tracing command kernel pid 0 tid 100071 td 0xfffff8000675e4a0 sched_switch() at sched_switch+0x4cd/frame 0xfffffe078a7f07c0 mi_switch() at mi_switch+0x3dc/frame 0xfffffe078a7f0890 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe078a7f08d0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe078a7f0900 _sleep() at _sleep+0x6ce/frame 0xfffffe078a7f0a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe078a7f0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a7f0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a7f0ab0 --- trap 0, rip = 0, rsp = 0xfffffe078a7f0b70, rbp = 0 --- Tracing command kernel pid 0 tid 100081 td 0xfffff8000db87000 sched_switch() at sched_switch+0x4cd/frame 0xfffffe00003647c0 mi_switch() at mi_switch+0x3dc/frame 0xfffffe0000364890 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe00003648d0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000364900 _sleep() at _sleep+0x6ce/frame 0xfffffe0000364a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe0000364a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000364ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000364ab0 --- trap 0, rip = 0, rsp = 0xfffffe0000364b70, rbp = 0 --- Tracing command kernel pid 0 tid 100083 td 0xfffff8000dbbe4a0 sched_switch() at sched_switch+0x4cd/frame 0xfffffe000036e7c0 mi_switch() at mi_switch+0x3dc/frame 0xfffffe000036e890 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe000036e8d0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000036e900 _sleep() at _sleep+0x6ce/frame 0xfffffe000036ea40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe000036ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe000036eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000036eab0 --- trap 0, rip = 0, rsp = 0xfffffe000036eb70, rbp = 0 --- Tracing command kernel pid 0 tid 100085 td 0xfffff8000dbbd940 sched_switch() at sched_switch+0x4cd/frame 0xfffffe00003787c0 mi_switch() at mi_switch+0x3dc/frame 0xfffffe0000378890 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe00003788d0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000378900 _sleep() at _sleep+0x6ce/frame 0xfffffe0000378a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe0000378a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000378ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000378ab0 --- trap 0, rip = 0, rsp = 0xfffffe0000378b70, rbp = 0 --- Tracing command kernel pid 0 tid 100087 td 0xfffff8000dbbd000 sched_switch() at sched_switch+0x4cd/frame 0xfffffe00003827c0 mi_switch() at mi_switch+0x3dc/frame 0xfffffe0000382890 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe00003828d0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000382900 _sleep() at _sleep+0x6ce/frame 0xfffffe0000382a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe0000382a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000382ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000382ab0 --- trap 0, rip = 0, rsp = 0xfffffe0000382b70, rbp = 0 --- Tracing command kernel pid 0 tid 100089 td 0xfffff8000dbbc4a0 sched_switch() at sched_switch+0x4cd/frame 0xfffffe000038c7c0 mi_switch() at mi_switch+0x3dc/frame 0xfffffe000038c890 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe000038c8d0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000038c900 _sleep() at _sleep+0x6ce/frame 0xfffffe000038ca40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe000038ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe000038cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000038cab0 --- trap 0, rip = 0, rsp = 0xfffffe000038cb70, rbp = 0 --- Tracing command kernel pid 0 tid 100091 td 0xfffff8000dbc1940 sched_switch() at sched_switch+0x4cd/frame 0xfffffe00003967c0 mi_switch() at mi_switch+0x3dc/frame 0xfffffe0000396890 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe00003968d0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000396900 _sleep() at _sleep+0x6ce/frame 0xfffffe0000396a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe0000396a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000396ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000396ab0 --- trap 0, rip = 0, rsp = 0xfffffe0000396b70, rbp = 0 --- Tracing command kernel pid 0 tid 100093 td 0xfffff8000dbc1000 sched_switch() at sched_switch+0x4cd/frame 0xfffffe00003a07c0 mi_switch() at mi_switch+0x3dc/frame 0xfffffe00003a0890 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe00003a08d0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00003a0900 _sleep() at _sleep+0x6ce/frame 0xfffffe00003a0a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe00003a0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00003a0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00003a0ab0 --- trap 0, rip = 0, rsp = 0xfffffe00003a0b70, rbp = 0 --- Tracing command kernel pid 0 tid 100095 td 0xfffff8000dbc04a0 sched_switch() at sched_switch+0x4cd/frame 0xfffffe00003aa7c0 mi_switch() at mi_switch+0x3dc/frame 0xfffffe00003aa890 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe00003aa8d0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00003aa900 _sleep() at _sleep+0x6ce/frame 0xfffffe00003aaa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe00003aaa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00003aaab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00003aaab0 --- trap 0, rip = 0, rsp = 0xfffffe00003aab70, rbp = 0 --- Tracing command kernel pid 0 tid 100098 td 0xfffff8000dbbf4a0 sched_switch() at sched_switch+0x4cd/frame 0xfffffe00003f97c0 mi_switch() at mi_switch+0x3dc/frame 0xfffffe00003f9890 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe00003f98d0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00003f9900 _sleep() at _sleep+0x6ce/frame 0xfffffe00003f9a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe00003f9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00003f9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00003f9ab0 --- trap 0, rip = 0, rsp = 0xfffffe00003f9b70, rbp = 0 --- Tracing command kernel pid 0 tid 100100 td 0xfffff8000dbe0940 sched_switch() at sched_switch+0x4cd/frame 0xfffffe081b4047c0 mi_switch() at mi_switch+0x3dc/frame 0xfffffe081b404890 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081b4048d0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081b404900 _sleep() at _sleep+0x6ce/frame 0xfffffe081b404a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe081b404a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b404ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b404ab0 --- trap 0, rip = 0, rsp = 0xfffffe081b404b70, rbp = 0 --- Tracing command kernel pid 0 tid 100102 td 0xfffff8000dbe0000 sched_switch() at sched_switch+0x4cd/frame 0xfffffe081b40e7c0 mi_switch() at mi_switch+0x3dc/frame 0xfffffe081b40e890 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081b40e8d0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081b40e900 _sleep() at _sleep+0x6ce/frame 0xfffffe081b40ea40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe081b40ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b40eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b40eab0 --- trap 0, rip = 0, rsp = 0xfffffe081b40eb70, rbp = 0 --- Tracing command kernel pid 0 tid 100104 td 0xfffff8000dbdf4a0 sched_switch() at sched_switch+0x4cd/frame 0xfffffe081b4187c0 mi_switch() at mi_switch+0x3dc/frame 0xfffffe081b418890 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081b4188d0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081b418900 _sleep() at _sleep+0x6ce/frame 0xfffffe081b418a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe081b418a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b418ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b418ab0 --- trap 0, rip = 0, rsp = 0xfffffe081b418b70, rbp = 0 --- Tracing command kernel pid 0 tid 100106 td 0xfffff8000dbde940 sched_switch() at sched_switch+0x4cd/frame 0xfffffe081b4227c0 mi_switch() at mi_switch+0x3dc/frame 0xfffffe081b422890 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081b4228d0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081b422900 _sleep() at _sleep+0x6ce/frame 0xfffffe081b422a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe081b422a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b422ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b422ab0 --- trap 0, rip = 0, rsp = 0xfffffe081b422b70, rbp = 0 --- Tracing command kernel pid 0 tid 100108 td 0xfffff8000dbde000 sched_switch() at sched_switch+0x4cd/frame 0xfffffe081b42c7c0 mi_switch() at mi_switch+0x3dc/frame 0xfffffe081b42c890 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081b42c8d0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081b42c900 _sleep() at _sleep+0x6ce/frame 0xfffffe081b42ca40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe081b42ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b42cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b42cab0 --- trap 0, rip = 0, rsp = 0xfffffe081b42cb70, rbp = 0 --- Tracing command kernel pid 0 tid 100110 td 0xfffff8000dbe84a0 sched_switch() at sched_switch+0x4cd/frame 0xfffffe081b4367c0 mi_switch() at mi_switch+0x3dc/frame 0xfffffe081b436890 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081b4368d0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081b436900 _sleep() at _sleep+0x6ce/frame 0xfffffe081b436a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe081b436a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b436ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b436ab0 --- trap 0, rip = 0, rsp = 0xfffffe081b436b70, rbp = 0 --- Tracing command kernel pid 0 tid 100112 td 0xfffff8000dbe7940 sched_switch() at sched_switch+0x4cd/frame 0xfffffe081b4407c0 mi_switch() at mi_switch+0x3dc/frame 0xfffffe081b440890 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081b4408d0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081b440900 _sleep() at _sleep+0x6ce/frame 0xfffffe081b440a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe081b440a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b440ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b440ab0 --- trap 0, rip = 0, rsp = 0xfffffe081b440b70, rbp = 0 --- Tracing command kernel pid 0 tid 100127 td 0xfffff8001000a940 sched_switch() at sched_switch+0x4cd/frame 0xfffffe081d6b3800 mi_switch() at mi_switch+0x3dc/frame 0xfffffe081d6b38d0 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081d6b3910 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081d6b3940 msleep_spin_sbt() at msleep_spin_sbt+0x423/frame 0xfffffe081d6b3a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x8d/frame 0xfffffe081d6b3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081d6b3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081d6b3ab0 --- trap 0, rip = 0, rsp = 0xfffffe081d6b3b70, rbp = 0 --- Tracing command kernel pid 0 tid 100128 td 0xfffff8001000a4a0 sched_switch() at sched_switch+0x4cd/frame 0xfffffe081d6b8730 mi_switch() at mi_switch+0x3dc/frame 0xfffffe081d6b8800 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081d6b8840 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe081d6b8870 _sleep() at _sleep+0x699/frame 0xfffffe081d6b89b0 pause_sbt() at pause_sbt+0x18a/frame 0xfffffe081d6b8a20 deadlkres() at deadlkres+0x2c/frame 0xfffffe081d6b8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081d6b8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081d6b8ab0 --- trap 0, rip = 0, rsp = 0xfffffe081d6b8b70, rbp = 0 --- Tracing command kernel pid 0 tid 100130 td 0xfffff80010009940 sched_switch() at sched_switch+0x4cd/frame 0xfffffe081d6c37c0 mi_switch() at mi_switch+0x3dc/frame 0xfffffe081d6c3890 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081d6c38d0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081d6c3900 _sleep() at _sleep+0x6ce/frame 0xfffffe081d6c3a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe081d6c3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081d6c3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081d6c3ab0 --- trap 0, rip = 0, rsp = 0xfffffe081d6c3b70, rbp = 0 --- db:0:allt> call doadump Dumping 1358 out of 31641 MB:..2%..11%..21%..31%..41%..51%..61%..71%..81%..91% Dump complete = 0 db:0:doadump> reset cpu_reset: Restarting BSP cpu_reset_proxy: Stopped CPU 1 (kgdb) proc 1037 [Switching to thread 146 (Thread 100439)]#0 sched_switch (td=0xfffff8004fd5f000, newtd=, flags=0x817231a8) at ../../../kern/sched_ule.c:1940 1940 cpuid = PCPU_GET(cpuid); Current language: auto; currently minimal (kgdb) bt #0 sched_switch (td=0xfffff8004fd5f000, newtd=, flags=0x817231a8) at ../../../kern/sched_ule.c:1940 #1 0xffffffff8095b17c in mi_switch (flags=0x104, newtd=0x0) at ../../../kern/kern_synch.c:492 #2 0xffffffff8099ab62 in sleepq_switch (wchan=, pri=) at ../../../kern/subr_sleepqueue.c:552 #3 0xffffffff8099a9c3 in sleepq_wait (wchan=0xfffff8011b0e02c4, pri=Unhandled dwarf expression opcode 0x93 ) at ../../../kern/subr_sleepqueue.c:631 #4 0xffffffff8095a42e in _sleep (ident=0xfffff8011b0e02c4, lock=0xfffff8011b0e0000, priority=0x60, wmesg=0xffffffff81020534 "mount drain", sbt=0x0, pr=0x0, flags=0x100) at ../../../kern/kern_synch.c:254 #5 0xffffffff809fabe1 in dounmount (mp=0xfffff8011b0e0000, flags=0x8000000, td=0xfffff8004fd5f000) at ../../../kern/vfs_mount.c:1271 #6 0xffffffff809fa734 in sys_unmount (td=0xfffff8004fd5f000, uap=0xfffffe081e068a40) at ../../../kern/vfs_mount.c:1201 #7 0xffffffff80d768f6 in amd64_syscall (td=0xfffff8004fd5f000, traced=0x0) at subr_syscall.c:133 #8 0xffffffff80d5505b in Xfast_syscall () at ../../../amd64/amd64/exception.S:395 #9 0x000000080089895a in ?? () Previous frame inner to this frame (corrupt stack?) (kgdb) f 5 #5 0xffffffff809fabe1 in dounmount (mp=0xfffff8011b0e0000, flags=0x8000000, td=0xfffff8004fd5f000) at ../../../kern/vfs_mount.c:1271 1271 error = msleep(&mp->mnt_lockref, MNT_MTX(mp), PVFS, (kgdb) l 1266 MNT_ILOCK(mp); 1267 } 1268 error = 0; 1269 if (mp->mnt_lockref) { 1270 mp->mnt_kern_flag |= MNTK_DRAINING; 1271 error = msleep(&mp->mnt_lockref, MNT_MTX(mp), PVFS, 1272 "mount drain", 0); 1273 } 1274 MNT_IUNLOCK(mp); 1275 KASSERT(mp->mnt_lockref == 0, (kgdb) info loc coveredvp = (struct vnode *) 0xfffff8004fa43270 fsrootvp = (struct vnode *) 0x1b0e0000 error = 0x0 async_flag = 0xfffffe081e068800 mnt_gen_r = 0x1 (kgdb) p *mp $1 = {mnt_mtx = {lock_object = {lo_name = 0xffffffff810189ca "struct mount mtx", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xfffffe0000b10a00}, mtx_lock = 0x4}, mnt_gen = 0x1, mnt_list = {tqe_next = 0x0, tqe_prev = 0xfffff80012f917b8}, mnt_op = 0xffffffff81532ab0, mnt_vfc = 0xffffffff81532bd0, mnt_vnodecovered = 0xfffff8004fa43270, mnt_syncer = 0xfffff80119e02000, mnt_ref = 0x1a, mnt_nvnodelist = {tqh_first = 0xfffff80119e02270, tqh_last = 0xfffff8011aa279e0}, mnt_nvnodelistsize = 0x18, mnt_activevnodelist = {tqh_first = 0xfffff8011aa279c0, tqh_last = 0xfffff80119e02158}, mnt_activevnodelistsize = 0x18, mnt_writeopcount = 0x1, mnt_kern_flag = 0x6180215c, mnt_flag = 0x201300, mnt_opt = 0xfffff80012f8e330, mnt_optnew = 0x0, mnt_maxsymlinklen = 0x78, mnt_stat = {f_version = 0x20030518, f_type = 0x35, f_flags = 0x201300, f_bsize = 0x1000, f_iosize = 0x8000, f_blocks = 0x3005, f_bfree = 0x1b3a, f_bavail = 0x1763, f_files = 0x19fe, f_ffree = 0x19e6, f_syncwrites = 0x2, f_asyncwrites = 0xd1, f_syncreads = 0x6, f_asyncreads = 0x0, f_spare = {0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0}, f_namemax = 0xff, f_owner = 0x0, f_fsid = {val = {0x54c7583d, 0xfd2c7ee9}}, f_charspare = '\0' , f_fstypename = "ufs", '\0' , f_mntfromname = "/dev/md5a", '\0' , f_mntonname = "/mnt", '\0' }, mnt_cred = 0xfffff80095b4fe00, mnt_data = 0xfffff8011b0f0800, mnt_time = 0x0, mnt_iosize_max = 0x20000, mnt_export = 0xfffff8001225c400, mnt_label = 0x0, mnt_hashseed = 0xf2f5d2c9, mnt_lockref = 0x1, mnt_secondary_writes = 0x0, mnt_secondary_accwrites = 0x33, mnt_susp_owner = 0x0, mnt_gjprovider = 0x0, mnt_explock = {lock_object = {lo_name = 0xffffffff80ff916b "explock", lo_flags = 0x6730000, lo_data = 0x0, lo_witness = 0xfffffe0000b1c080}, lk_lock = 0x1, lk_exslpfail = 0x0, lk_timo = 0x0, lk_pri = 0x60, lk_stack = {depth = 0x8, pcs = {0xffffffff809327f6, 0xffffffff809f2e39, 0xffffffff809fe38a, 0xffffffff809f9d01, 0xffffffff809f8da6, 0xffffffff809f8458, 0xffffffff80d768f6, 0xffffffff80d5505b, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0}}}, mnt_upper_link = {tqe_next = 0x0, tqe_prev = 0x0}, mnt_uppers = {tqh_first = 0x0, tqh_last = 0xfffff8011b0e03b8}} (kgdb) $ svn diff -x -p /usr/src/sys -- Test scenario: misc/quota9.sh with "nooptions QUOTA"