GENERIC HEAD from 2015-03-16 01:15:08 UTC, r280133M, vmcore.324 GDB: no debug ports present KDB: debugger backends: ddb KDB: current backend: ddb Copyright (c) 1992-2015 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 11.0-CURRENT #3 r280133M: Tue Mar 17 13:23:33 CET 2015 pho@t1.osted.lan:/usr/src/sys/amd64/compile/PHO amd64 FreeBSD clang version 3.5.1 (tags/RELEASE_351/final 225668) 20150115 WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. VT: running with driver "vga". CPU: Intel(R) Xeon(R) CPU E5-2620 0 @ 2.00GHz (1995.24-MHz K8-class CPU) Origin="GenuineIntel" Id=0x206d7 Family=0x6 Model=0x2d Stepping=7 Features=0xbfebfbff Features2=0x1fbee3ff AMD Features=0x2c100800 AMD Features2=0x1 XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID TSC: P-state invariant, performance statistics real memory = 68719476736 (65536 MB) avail memory = 32143613952 (30654 MB) : Trying to mount root from ufs:/dev/da0p2 [rw]... Setting hostuuid: 3141f787-07e3-e111-b968-001e6756c168. Setting hostid: 0x564ac5b6. Starting ddb. Starting file system checks: /dev/da0p2: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/da0p2: clean, 62479357 free (504125 frags, 7746904 blocks, 0.5% fragmentation) /dev/da0p3: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/da0p3: clean, 21439862 free (1230 frags, 2679829 blocks, 0.0% fragmentation) Mounting local file systems:. Setting hostname: t1.osted.lan. Feeding entropy:. Starting Network: lo0 igb0 igb1. lo0: flags=8049 metric 0 mtu 16384 options=600003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x3 inet 127.0.0.1 netmask 0xff000000 nd6 options=21 groups: lo igb0: flags=8843 metric 0 mtu 1500 options=403bb ether 00:1e:67:56:c1:68 inet 192.168.1.108 netmask 0xffffff00 broadcast 192.168.1.255 inet6 fe80::21e:67ff:fe56:c168%igb0 prefixlen 64 scopeid 0x1 nd6 options=23 media: Ethernet autoselect (1000baseT ) status: active igb1: flags=8c02 metric 0 mtu 1500 options=403bb ether 00:1e:67:56:c1:69 nd6 options=29 media: Ethernet autoselect status: no carrier Starting devd. Starting Network: igb1. igb1: flags=8c02 metric 0 mtu 1500 options=403bb ether 00:1e:67:56:c1:69 nd6 options=29 media: Ethernet autoselect status: no carrier Configuring vt: keymap. ums0: on usbus2 ums0: 3 buttons and [Z] coordinates ID=0 Starting ums0 moused. Starting pflogd: add net default: gateway 192.168.1.1 add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Starting rtsold. ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat /usr/local/lib/gcc46 /usr/local/lib/gcc47 /usr/local/lib/gcc48 /usr/local/lib/gcc49 /usr/local/lib/nss /usr/local/lib/qt4 32-bit compatibility ldconfig path: /usr/lib32 /usr/local/lib32/compat Creating and/or trimming log files. Starting syslogd. No core dumps found. Starting rpcbind. NFS access cache time=60 Starting casperd. lock order reversal: 1st 0xfffffe0785a780f0 bufwait (bufwait) @ kern/vfs_bio.c:3097 2nd 0xfffff80052b6ac00 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:285 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe081db5f380 witness_checkorder() at witness_checkorder+0xe45/frame 0xfffffe081db5f410 _sx_xlock() at _sx_xlock+0x75/frame 0xfffffe081db5f450 ufsdirhash_add() at ufsdirhash_add+0x4a/frame 0xfffffe081db5f490 ufs_direnter() at ufs_direnter+0x641/frame 0xfffffe081db5f550 ufs_mkdir() at ufs_mkdir+0x8c0/frame 0xfffffe081db5f740 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x115/frame 0xfffffe081db5f770 kern_mkdirat() at kern_mkdirat+0x1fd/frame 0xfffffe081db5f9a0 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe081db5fab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081db5fab0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x80095214a, rsp = 0x7fffffffe788, rbp = 0x7fffffffec70 --- Clearing /tmp (X related). Starting nfsuserd. Starting mountd. Starting nfsd. Recovering vi editor sessions:. Updating motd:. Mounting late file systems:. Starting ntpd. Starting powerd. Starting saslauthd. Starting default mousedmoused: unable to open /dev/psm0: No such file or directory . Configuring vt: keymap blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting sendmail_submit. Starting sendmail_msp_queue. Starting cron. Local package initialization: backup init.sh+ mount + grep ' / ' /dev/da0p2 on / (ufs, NFS exported, local, soft-updates) + ls -il /sbin/init 6821765 -r-xr-xr-x 1 root wheel 948296 Mar 14 13:03 /sbin/init + chflags noschg /sbin/init + cp -Rp /sbin/init /sbin/init2 + rm -f /sbin/init + mv /sbin/init2 /sbin/init + chflags schg /sbin/init + ls -il /sbin/init 6821763 -r-xr-xr-x 1 root wheel 948296 Mar 14 13:03 /sbin/init + reboot Mar 17 13:45:49 t1 reboot: rebooted by root Mar 17 13:45:49 t1 syslogd: exiting on signal 15 Waiting (max 60 seconds) for system process `vnlru' to stop...done Waiting (max 60 seconds) for system process `bufdaemon' to stop...done Waiting (max 60 seconds) for system process `syncer' to stop... Syncing disks, vnodes remaining...7 7 3 2 1 0 0 done All buffers synced. lock order reversal: 1st 0xfffff80012d5e548 ufs (ufs) @ kern/vfs_mount.c:1229 2nd 0xfffff80012dd3c98 devfs (devfs) @ ufs/ffs/ffs_vfsops.c:1375 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe081e022480 witness_checkorder() at witness_checkorder+0xe45/frame 0xfffffe081e022510 __lockmgr_args() at __lockmgr_args+0xadb/frame 0xfffffe081e022640 vop_stdlock() at vop_stdlock+0x3c/frame 0xfffffe081e022660 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xfc/frame 0xfffffe081e022690 _vn_lock() at _vn_lock+0xa2/frame 0xfffffe081e022700 ffs_flushfiles() at ffs_flushfiles+0x11f/frame 0xfffffe081e022770 softdep_flushfiles() at softdep_flushfiles+0xdd/frame 0xfffffe081e0227f0 ffs_unmount() at ffs_unmount+0xe3/frame 0xfffffe081e022850 dounmount() at dounmount+0x42c/frame 0xfffffe081e0228d0 vfs_unmountall() at vfs_unmountall+0x61/frame 0xfffffe081e022900 kern_reboot() at kern_reboot+0x4f6/frame 0xfffffe081e022980 sys_reboot() at sys_reboot+0x58/frame 0xfffffe081e0229a0 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe081e022ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081e022ab0 --- syscall (55, FreeBSD ELF64, sys_reboot), rip = 0x80086b5ec, rsp = 0x7fffffffeba8, rbp = 0x7fffffffed10 --- panic: softdep_waitidle: Failed to flush worklist for 0xfffff80012747b58 cpuid = 0 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe081e022610 vpanic() at vpanic+0x189/frame 0xfffffe081e022690 panic() at panic+0x43/frame 0xfffffe081e0226f0 softdep_waitidle() at softdep_waitidle+0x291/frame 0xfffffe081e022770 softdep_flushfiles() at softdep_flushfiles+0x199/frame 0xfffffe081e0227f0 ffs_unmount() at ffs_unmount+0xe3/frame 0xfffffe081e022850 dounmount() at dounmount+0x42c/frame 0xfffffe081e0228d0 vfs_unmountall() at vfs_unmountall+0x61/frame 0xfffffe081e022900 kern_reboot() at kern_reboot+0x4f6/frame 0xfffffe081e022980 sys_reboot() at sys_reboot+0x58/frame 0xfffffe081e0229a0 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe081e022ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081e022ab0 --- syscall (55, FreeBSD ELF64, sys_reboot), rip = 0x80086b5ec, rsp = 0x7fffffffeba8, rbp = 0x7fffffffed10 --- KDB: enter: panic [ thread pid 871 tid 100443 ] Stopped at kdb_enter+0x3e: movq $0,kdb_why db> set $lines 0 db> show mount 0xfffff80012747b58 /dev/da0p2 on / (ufs) More info: show mount db> show ffs 0xfffff80012747b58 mp 0xfffff80012747b58 / devvp 0xfffff8001274dc30 fs 0xfffff8001277d000 su_wl 0 su_deps 14 su_req 0 ump = 0xfffff8001277a000 db> show inodedeps 0xfffff8001277a000 db> run pho db:0:pho> bt Tracing pid 871 tid 100443 td 0xfffff800a7337000 kdb_enter() at kdb_enter+0x3e/frame 0xfffffe081e022610 vpanic() at vpanic+0x1a9/frame 0xfffffe081e022690 panic() at panic+0x43/frame 0xfffffe081e0226f0 softdep_waitidle() at softdep_waitidle+0x291/frame 0xfffffe081e022770 softdep_flushfiles() at softdep_flushfiles+0x199/frame 0xfffffe081e0227f0 ffs_unmount() at ffs_unmount+0xe3/frame 0xfffffe081e022850 dounmount() at dounmount+0x42c/frame 0xfffffe081e0228d0 vfs_unmountall() at vfs_unmountall+0x61/frame 0xfffffe081e022900 kern_reboot() at kern_reboot+0x4f6/frame 0xfffffe081e022980 sys_reboot() at sys_reboot+0x58/frame 0xfffffe081e0229a0 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe081e022ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081e022ab0 --- syscall (55, FreeBSD ELF64, sys_reboot), rip = 0x80086b5ec, rsp = 0x7fffffffeba8, rbp = 0x7fffffffed10 --- db:0:bt> show allpcpu Current CPU: 0 cpuid = 0 dynamic pcpu = 0x6b2d80 curthread = 0xfffff800a7337000: pid 871 "reboot" curpcb = 0xfffffe081e022b80 fpcurthread = none idlethread = 0xfffff80006567000: tid 100003 "idle: cpu0" curpmap = 0xfffff80012b55708 tssp = 0xffffffff818d2d90 commontssp = 0xffffffff818d2d90 rsp0 = 0xfffffe081e022b80 gs32p = 0xffffffff818d95e8 ldt = 0xffffffff818d9628 tss = 0xffffffff818d9618 spin locks held: cpuid = 1 dynamic pcpu = 0xfffffe087a7a5d80 curthread = 0xfffff80006566940: pid 11 "idle: cpu1" curpcb = 0xfffffe07fbdf8b80 fpcurthread = none idlethread = 0xfffff80006566940: tid 100004 "idle: cpu1" curpmap = 0xffffffff8189f650 tssp = 0xffffffff818d2df8 commontssp = 0xffffffff818d2df8 rsp0 = 0xfffffe07fbdf8b80 gs32p = 0xffffffff818d9650 ldt = 0xffffffff818d9690 tss = 0xffffffff818d9680 spin locks held: cpuid = 2 dynamic pcpu = 0xfffffe087a7add80 curthread = 0xfffff800065664a0: pid 11 "idle: cpu2" curpcb = 0xfffffe07fbdfdb80 fpcurthread = none idlethread = 0xfffff800065664a0: tid 100005 "idle: cpu2" curpmap = 0xffffffff8189f650 tssp = 0xffffffff818d2e60 commontssp = 0xffffffff818d2e60 rsp0 = 0xfffffe07fbdfdb80 gs32p = 0xffffffff818d96b8 ldt = 0xffffffff818d96f8 tss = 0xffffffff818d96e8 spin locks held: cpuid = 3 dynamic pcpu = 0xfffffe087a7b5d80 curthread = 0xfffff80006566000: pid 11 "idle: cpu3" curpcb = 0xfffffe078a48db80 fpcurthread = none idlethread = 0xfffff80006566000: tid 100006 "idle: cpu3" curpmap = 0xffffffff8189f650 tssp = 0xffffffff818d2ec8 commontssp = 0xffffffff818d2ec8 rsp0 = 0xfffffe078a48db80 gs32p = 0xffffffff818d9720 ldt = 0xffffffff818d9760 tss = 0xffffffff818d9750 spin locks held: cpuid = 4 dynamic pcpu = 0xfffffe087a7bdd80 curthread = 0xfffff80006565940: pid 11 "idle: cpu4" curpcb = 0xfffffe078a492b80 fpcurthread = none idlethread = 0xfffff80006565940: tid 100007 "idle: cpu4" curpmap = 0xffffffff8189f650 tssp = 0xffffffff818d2f30 commontssp = 0xffffffff818d2f30 rsp0 = 0xfffffe078a492b80 gs32p = 0xffffffff818d9788 ldt = 0xffffffff818d97c8 tss = 0xffffffff818d97b8 spin locks held: cpuid = 5 dynamic pcpu = 0xfffffe087a7c5d80 curthread = 0xfffff800065654a0: pid 11 "idle: cpu5" curpcb = 0xfffffe078a497b80 fpcurthread = none idlethread = 0xfffff800065654a0: tid 100008 "idle: cpu5" curpmap = 0xffffffff8189f650 tssp = 0xffffffff818d2f98 commontssp = 0xffffffff818d2f98 rsp0 = 0xfffffe078a497b80 gs32p = 0xffffffff818d97f0 ldt = 0xffffffff818d9830 tss = 0xffffffff818d9820 spin locks held: cpuid = 6 dynamic pcpu = 0xfffffe087a7cdd80 curthread = 0xfffff80006565000: pid 11 "idle: cpu6" curpcb = 0xfffffe078a49cb80 fpcurthread = none idlethread = 0xfffff80006565000: tid 100009 "idle: cpu6" curpmap = 0xffffffff8189f650 tssp = 0xffffffff818d3000 commontssp = 0xffffffff818d3000 rsp0 = 0xfffffe078a49cb80 gs32p = 0xffffffff818d9858 ldt = 0xffffffff818d9898 tss = 0xffffffff818d9888 spin locks held: cpuid = 7 dynamic pcpu = 0xfffffe087a7d5d80 curthread = 0xfffff80006578940: pid 11 "idle: cpu7" curpcb = 0xfffffe078a4a1b80 fpcurthread = none idlethread = 0xfffff80006578940: tid 100010 "idle: cpu7" curpmap = 0xffffffff8189f650 tssp = 0xffffffff818d3068 commontssp = 0xffffffff818d3068 rsp0 = 0xfffffe078a4a1b80 gs32p = 0xffffffff818d98c0 ldt = 0xffffffff818d9900 tss = 0xffffffff818d98f0 spin locks held: cpuid = 8 dynamic pcpu = 0xfffffe087a7ddd80 curthread = 0xfffff800065784a0: pid 11 "idle: cpu8" curpcb = 0xfffffe078a4a6b80 fpcurthread = none idlethread = 0xfffff800065784a0: tid 100011 "idle: cpu8" curpmap = 0xffffffff8189f650 tssp = 0xffffffff818d30d0 commontssp = 0xffffffff818d30d0 rsp0 = 0xfffffe078a4a6b80 gs32p = 0xffffffff818d9928 ldt = 0xffffffff818d9968 tss = 0xffffffff818d9958 spin locks held: cpuid = 9 dynamic pcpu = 0xfffffe087a7e5d80 curthread = 0xfffff80006578000: pid 11 "idle: cpu9" curpcb = 0xfffffe078a4abb80 fpcurthread = none idlethread = 0xfffff80006578000: tid 100012 "idle: cpu9" curpmap = 0xffffffff8189f650 tssp = 0xffffffff818d3138 commontssp = 0xffffffff818d3138 rsp0 = 0xfffffe078a4abb80 gs32p = 0xffffffff818d9990 ldt = 0xffffffff818d99d0 tss = 0xffffffff818d99c0 spin locks held: cpuid = 10 dynamic pcpu = 0xfffffe087a7edd80 curthread = 0xfffff80006577940: pid 11 "idle: cpu10" curpcb = 0xfffffe078a4b0b80 fpcurthread = none idlethread = 0xfffff80006577940: tid 100013 "idle: cpu10" curpmap = 0xffffffff8189f650 tssp = 0xffffffff818d31a0 commontssp = 0xffffffff818d31a0 rsp0 = 0xfffffe078a4b0b80 gs32p = 0xffffffff818d99f8 ldt = 0xffffffff818d9a38 tss = 0xffffffff818d9a28 spin locks held: cpuid = 11 dynamic pcpu = 0xfffffe087a7f5d80 curthread = 0xfffff800065774a0: pid 11 "idle: cpu11" curpcb = 0xfffffe078a4b5b80 fpcurthread = none idlethread = 0xfffff800065774a0: tid 100014 "idle: cpu11" curpmap = 0xffffffff8189f650 tssp = 0xffffffff818d3208 commontssp = 0xffffffff818d3208 rsp0 = 0xfffffe078a4b5b80 gs32p = 0xffffffff818d9a60 ldt = 0xffffffff818d9aa0 tss = 0xffffffff818d9a90 spin locks held: cpuid = 12 dynamic pcpu = 0xfffffe087a7fdd80 curthread = 0xfffff80006577000: pid 11 "idle: cpu12" curpcb = 0xfffffe078a4bab80 fpcurthread = none idlethread = 0xfffff80006577000: tid 100015 "idle: cpu12" curpmap = 0xffffffff8189f650 tssp = 0xffffffff818d3270 commontssp = 0xffffffff818d3270 rsp0 = 0xfffffe078a4bab80 gs32p = 0xffffffff818d9ac8 ldt = 0xffffffff818d9b08 tss = 0xffffffff818d9af8 spin locks held: cpuid = 13 dynamic pcpu = 0xfffffe087a805d80 curthread = 0xfffff80006576940: pid 11 "idle: cpu13" curpcb = 0xfffffe078a4bfb80 fpcurthread = none idlethread = 0xfffff80006576940: tid 100016 "idle: cpu13" curpmap = 0xffffffff8189f650 tssp = 0xffffffff818d32d8 commontssp = 0xffffffff818d32d8 rsp0 = 0xfffffe078a4bfb80 gs32p = 0xffffffff818d9b30 ldt = 0xffffffff818d9b70 tss = 0xffffffff818d9b60 spin locks held: cpuid = 14 dynamic pcpu = 0xfffffe087a80dd80 curthread = 0xfffff800065764a0: pid 11 "idle: cpu14" curpcb = 0xfffffe078a4c4b80 fpcurthread = none idlethread = 0xfffff800065764a0: tid 100017 "idle: cpu14" curpmap = 0xffffffff8189f650 tssp = 0xffffffff818d3340 commontssp = 0xffffffff818d3340 rsp0 = 0xfffffe078a4c4b80 gs32p = 0xffffffff818d9b98 ldt = 0xffffffff818d9bd8 tss = 0xffffffff818d9bc8 spin locks held: cpuid = 15 dynamic pcpu = 0xfffffe087a815d80 curthread = 0xfffff80006576000: pid 11 "idle: cpu15" curpcb = 0xfffffe078a4c9b80 fpcurthread = none idlethread = 0xfffff80006576000: tid 100018 "idle: cpu15" curpmap = 0xffffffff8189f650 tssp = 0xffffffff818d33a8 commontssp = 0xffffffff818d33a8 rsp0 = 0xfffffe078a4c9b80 gs32p = 0xffffffff818d9c00 ldt = 0xffffffff818d9c40 tss = 0xffffffff818d9c30 spin locks held: cpuid = 16 dynamic pcpu = 0xfffffe087a81dd80 curthread = 0xfffff8000657d940: pid 11 "idle: cpu16" curpcb = 0xfffffe078a4ceb80 fpcurthread = none idlethread = 0xfffff8000657d940: tid 100019 "idle: cpu16" curpmap = 0xffffffff8189f650 tssp = 0xffffffff818d3410 commontssp = 0xffffffff818d3410 rsp0 = 0xfffffe078a4ceb80 gs32p = 0xffffffff818d9c68 ldt = 0xffffffff818d9ca8 tss = 0xffffffff818d9c98 spin locks held: cpuid = 17 dynamic pcpu = 0xfffffe087a825d80 curthread = 0xfffff8000657d4a0: pid 11 "idle: cpu17" curpcb = 0xfffffe078a4d3b80 fpcurthread = none idlethread = 0xfffff8000657d4a0: tid 100020 "idle: cpu17" curpmap = 0xffffffff8189f650 tssp = 0xffffffff818d3478 commontssp = 0xffffffff818d3478 rsp0 = 0xfffffe078a4d3b80 gs32p = 0xffffffff818d9cd0 ldt = 0xffffffff818d9d10 tss = 0xffffffff818d9d00 spin locks held: cpuid = 18 dynamic pcpu = 0xfffffe087a82dd80 curthread = 0xfffff8000657d000: pid 11 "idle: cpu18" curpcb = 0xfffffe078a4d8b80 fpcurthread = none idlethread = 0xfffff8000657d000: tid 100021 "idle: cpu18" curpmap = 0xffffffff8189f650 tssp = 0xffffffff818d34e0 commontssp = 0xffffffff818d34e0 rsp0 = 0xfffffe078a4d8b80 gs32p = 0xffffffff818d9d38 ldt = 0xffffffff818d9d78 tss = 0xffffffff818d9d68 spin locks held: cpuid = 19 dynamic pcpu = 0xfffffe087a835d80 curthread = 0xfffff8000657c940: pid 11 "idle: cpu19" curpcb = 0xfffffe078a4ddb80 fpcurthread = none idlethread = 0xfffff8000657c940: tid 100022 "idle: cpu19" curpmap = 0xffffffff8189f650 tssp = 0xffffffff818d3548 commontssp = 0xffffffff818d3548 rsp0 = 0xfffffe078a4ddb80 gs32p = 0xffffffff818d9da0 ldt = 0xffffffff818d9de0 tss = 0xffffffff818d9dd0 spin locks held: cpuid = 20 dynamic pcpu = 0xfffffe087a83dd80 curthread = 0xfffff8000657c4a0: pid 11 "idle: cpu20" curpcb = 0xfffffe078a4e2b80 fpcurthread = none idlethread = 0xfffff8000657c4a0: tid 100023 "idle: cpu20" curpmap = 0xffffffff8189f650 tssp = 0xffffffff818d35b0 commontssp = 0xffffffff818d35b0 rsp0 = 0xfffffe078a4e2b80 gs32p = 0xffffffff818d9e08 ldt = 0xffffffff818d9e48 tss = 0xffffffff818d9e38 spin locks held: cpuid = 21 dynamic pcpu = 0xfffffe087a845d80 curthread = 0xfffff8000657c000: pid 11 "idle: cpu21" curpcb = 0xfffffe078a4e7b80 fpcurthread = none idlethread = 0xfffff8000657c000: tid 100024 "idle: cpu21" curpmap = 0xffffffff8189f650 tssp = 0xffffffff818d3618 commontssp = 0xffffffff818d3618 rsp0 = 0xfffffe078a4e7b80 gs32p = 0xffffffff818d9e70 ldt = 0xffffffff818d9eb0 tss = 0xffffffff818d9ea0 spin locks held: cpuid = 22 dynamic pcpu = 0xfffffe087a84dd80 curthread = 0xfffff8000657b940: pid 11 "idle: cpu22" curpcb = 0xfffffe078a4ecb80 fpcurthread = none idlethread = 0xfffff8000657b940: tid 100025 "idle: cpu22" curpmap = 0xffffffff8189f650 tssp = 0xffffffff818d3680 commontssp = 0xffffffff818d3680 rsp0 = 0xfffffe078a4ecb80 gs32p = 0xffffffff818d9ed8 ldt = 0xffffffff818d9f18 tss = 0xffffffff818d9f08 spin locks held: cpuid = 23 dynamic pcpu = 0xfffffe087a855d80 curthread = 0xfffff8000657b4a0: pid 11 "idle: cpu23" curpcb = 0xfffffe078a4f1b80 fpcurthread = none idlethread = 0xfffff8000657b4a0: tid 100026 "idle: cpu23" curpmap = 0xffffffff8189f650 tssp = 0xffffffff818d36e8 commontssp = 0xffffffff818d36e8 rsp0 = 0xfffffe078a4f1b80 gs32p = 0xffffffff818d9f40 ldt = 0xffffffff818d9f80 tss = 0xffffffff818d9f70 spin locks held: db:0:allpcpu> show alllocks Process 871 (reboot) thread 0xfffff800a7337000 (100443) exclusive rw Per-Filesystem Softdep Lock (Per-Filesystem Softdep Lock) r = 0 (0xfffff80012e28000) locked @ ufs/ffs/ffs_softdep.c:1939 exclusive sleep mutex Giant (Giant) r = 0 (0xffffffff8189faf0) locked @ kern/kern_shutdown.c:192 Process 8 (bufdaemon) thread 0xfffff80012b94000 (100152) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0785fed7d0) locked @ kern/vfs_bio.c:2360 db:0:alllocks> show lockedvnods Locked vnodes db:0:lockedvnods> show mount 0xfffff80012747b58 /dev/da0p2 on / (ufs) More info: show mount db:0:mount> ps pid ppid pgrp uid state wmesg wchan cmd 871 1 17 0 R+ CPU 0 reboot 811 0 0 0 SL - 0xffffffff81894620 [newnfs 0] 16 0 0 0 DL kpsusp 0xfffff8001210dc18 [vnlru] 9 0 0 0 DL kpsusp 0xfffff8001210e1a8 [syncer] 8 0 0 0 DL (threaded) [bufdaemon] 100136 D kpsusp 0xfffff8001210e6e0 [bufdaemon] 100152 D biord 0xfffffe0785fed760 [/ worker] 7 0 0 0 DL pgzero 0xffffffff8180755c [pagezero] 6 0 0 0 DL psleep 0xffffffff818069a8 [vmdaemon] 5 0 0 0 DL psleep 0xffffffff818d2104 [pagedaemon] 4 0 0 0 DL idle 0xfffff8001210fa70 [enc_daemon0] 3 0 0 0 DL waiting_ 0xffffffff818c5f08 [sctp_iterator] 15 0 0 0 DL (threaded) [usb] 100075 D - 0xfffffe0001300d10 [usbus0] 100076 D - 0xfffffe0001300d68 [usbus0] 100077 D - 0xfffffe0001300dc0 [usbus0] 100078 D - 0xfffffe0001300e18 [usbus0] 100115 D - 0xfffffe00016f5560 [usbus1] 100116 D - 0xfffffe00016f55b8 [usbus1] 100117 D - 0xfffffe00016f5610 [usbus1] 100118 D - 0xfffffe00016f5668 [usbus1] 100120 D - 0xfffffe000155fd10 [usbus2] 100121 D - 0xfffffe000155fd68 [usbus2] 100122 D - 0xfffffe000155fdc0 [usbus2] 100123 D - 0xfffffe000155fe18 [usbus2] 2 0 0 0 DL (threaded) [cam] 100067 D - 0xffffffff8158e600 [doneq0] 100068 D - 0xffffffff8158e700 [doneq1] 100069 D - 0xffffffff8158e800 [doneq2] 100070 D - 0xffffffff8158e900 [doneq3] 100071 D - 0xffffffff8158ea00 [doneq4] 100131 D - 0xffffffff8158e448 [scanner] 14 0 0 0 DL - 0xffffffff815bb828 [rand_harvestq] 13 0 0 0 DL (threaded) [geom] 100053 D - 0xffffffff8189eb20 [g_event] 100054 D - 0xffffffff8189eb28 [g_up] 100055 D - 0xffffffff8189eb30 [g_down] 12 0 0 0 WL (threaded) [intr] 100027 I [swi4: clock (0)] 100028 I [swi4: clock (1)] 100029 I [swi4: clock (2)] 100030 I [swi4: clock (3)] 100031 I [swi4: clock (4)] 100032 I [swi4: clock (5)] 100033 I [swi4: clock (6)] 100034 I [swi4: clock (7)] 100035 I [swi4: clock (8)] 100036 I [swi4: clock (9)] 100037 I [swi4: clock (10)] 100038 I [swi4: clock (11)] 100039 I [swi4: clock (12)] 100040 I [swi4: clock (13)] 100041 I [swi4: clock (14)] 100042 I [swi4: clock (15)] 100043 I [swi4: clock (16)] 100044 I [swi4: clock (17)] 100045 I [swi4: clock (18)] 100046 I [swi4: clock (19)] 100047 I [swi4: clock (20)] 100048 I [swi4: clock (21)] 100049 I [swi4: clock (22)] 100050 I [swi4: clock (23)] 100051 I [swi1: netisr 0] 100052 I [swi3: vm] 100059 I [swi6: task queue] 100060 I [swi6: Giant taskq] 100062 I [swi5: fast taskq] 100072 I [irq264: isci0] 100073 I [irq265: isci0] 100074 I [irq22: ehci0] 100079 I [irq266: hdac0] 100080 I [irq267: igb0:que 0] 100082 I [irq268: igb0:que 1] 100084 I [irq269: igb0:que 2] 100086 I [irq270: igb0:que 3] 100088 I [irq271: igb0:que 4] 100090 I [irq272: igb0:que 5] 100092 I [irq273: igb0:que 6] 100094 I [irq274: igb0:que 7] 100096 I [irq275: igb0:link] 100097 I [irq276: igb1:que 0] 100099 I [irq277: igb1:que 1] 100101 I [irq278: igb1:que 2] 100103 I [irq279: igb1:que 3] 100105 I [irq280: igb1:que 4] 100107 I [irq281: igb1:que 5] 100109 I [irq282: igb1:que 6] 100111 I [irq283: igb1:que 7] 100113 I [irq284: igb1:link] 100114 I [irq285: xhci0] 100119 I [irq20: ehci1] 100124 I [irq286: ahci0] 100125 I [irq287: hdac1] 100126 I [swi0: uart] 11 0 0 0 RL (threaded) [idle] 100003 CanRun [idle: cpu0] 100004 Run CPU 1 [idle: cpu1] 100005 Run CPU 2 [idle: cpu2] 100006 Run CPU 3 [idle: cpu3] 100007 Run CPU 4 [idle: cpu4] 100008 Run CPU 5 [idle: cpu5] 100009 Run CPU 6 [idle: cpu6] 100010 Run CPU 7 [idle: cpu7] 100011 Run CPU 8 [idle: cpu8] 100012 Run CPU 9 [idle: cpu9] 100013 Run CPU 10 [idle: cpu10] 100014 Run CPU 11 [idle: cpu11] 100015 Run CPU 12 [idle: cpu12] 100016 Run CPU 13 [idle: cpu13] 100017 Run CPU 14 [idle: cpu14] 100018 Run CPU 15 [idle: cpu15] 100019 Run CPU 16 [idle: cpu16] 100020 Run CPU 17 [idle: cpu17] 100021 Run CPU 18 [idle: cpu18] 100022 Run CPU 19 [idle: cpu19] 100023 Run CPU 20 [idle: cpu20] 100024 Run CPU 21 [idle: cpu21] 100025 Run CPU 22 [idle: cpu22] 100026 Run CPU 23 [idle: cpu23] 1 0 1 0 SLs pause 0xfffff800065645e0 [init] 10 0 0 0 DL audit_wo 0xffffffff818c96f8 [audit] 0 0 0 0 DLs (threaded) [kernel] 100000 D swapin 0xffffffff8189eb58 [swapper] 100056 D - 0xfffff800065cf000 [firmware taskq] 100058 D - 0xfffff800065cee00 [ffs_trim taskq] 100061 D - 0xfffff800065ceb00 [thread taskq] 100063 D - 0xfffff800065ce900 [kqueue taskq] 100064 D - 0xfffff800065ce800 [acpi_task_0] 100065 D - 0xfffff800065ce800 [acpi_task_1] 100066 D - 0xfffff800065ce800 [acpi_task_2] 100081 D - 0xfffff800065ce400 [igb0 que (qid 0)] 100083 D - 0xfffff800065ce300 [igb0 que (qid 1)] 100085 D - 0xfffff800065ce200 [igb0 que (qid 2)] 100087 D - 0xfffff800065ce100 [igb0 que (qid 3)] 100089 D - 0xfffff800065ce000 [igb0 que (qid 4)] 100091 D - 0xfffff800065cde00 [igb0 que (qid 5)] 100093 D - 0xfffff800065cdd00 [igb0 que (qid 6)] 100095 D - 0xfffff800065cdc00 [igb0 que (qid 7)] 100098 D - 0xfffff800065cdb00 [igb1 que (qid 8)] 100100 D - 0xfffff800065cda00 [igb1 que (qid 9)] 100102 D - 0xfffff800065cd900 [igb1 que (qid 10)] 100104 D - 0xfffff800065cd800 [igb1 que (qid 11)] 100106 D - 0xfffff800065cd700 [igb1 que (qid 12)] 100108 D - 0xfffff800065cd600 [igb1 que (qid 13)] 100110 D - 0xfffff800065cd500 [igb1 que (qid 14)] 100112 D - 0xfffff800065cd400 [igb1 que (qid 15)] 100127 D - 0xfffff800065ccb00 [mca taskq] 100128 D - 0xffffffff8166e45c [deadlkres] 100130 D - 0xfffff800065ce700 [CAM taskq] 672 1 672 0 Z nfsd 674 1 672 0 Z nfsd: master 657 1 655 0 Z nfsuserd 658 1 655 0 Z nfsuserd 659 1 655 0 Z nfsuserd 655 1 655 0 Z nfsuserd 656 1 655 0 Z nfsuserd 666 1 666 0 Z mountd 785 1 785 0 Z sendmail 782 1 782 0 Z sshd 729 1 729 0 Z saslauthd 608 1 608 0 Z syslogd 788 1 788 25 Z sendmail 713 1 713 0 Z powerd 445 1 445 0 Z devd db:0:ps> allt Tracing command reboot pid 871 tid 100443 td 0xfffff800a7337000 kdb_enter() at kdb_enter+0x3e/frame 0xfffffe081e022610 vpanic() at vpanic+0x1a9/frame 0xfffffe081e022690 panic() at panic+0x43/frame 0xfffffe081e0226f0 softdep_waitidle() at softdep_waitidle+0x291/frame 0xfffffe081e022770 softdep_flushfiles() at softdep_flushfiles+0x199/frame 0xfffffe081e0227f0 ffs_unmount() at ffs_unmount+0xe3/frame 0xfffffe081e022850 dounmount() at dounmount+0x42c/frame 0xfffffe081e0228d0 vfs_unmountall() at vfs_unmountall+0x61/frame 0xfffffe081e022900 kern_reboot() at kern_reboot+0x4f6/frame 0xfffffe081e022980 sys_reboot() at sys_reboot+0x58/frame 0xfffffe081e0229a0 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe081e022ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081e022ab0 --- syscall (55, FreeBSD ELF64, sys_reboot), rip = 0x80086b5ec, rsp = 0x7fffffffeba8, rbp = 0x7fffffffed10 --- Tracing command newnfs 0 pid 811 tid 100408 td 0xfffff800127c54a0 sched_switch() at sched_switch+0x4cf/frame 0xfffffe081df71870 mi_switch() at mi_switch+0x179/frame 0xfffffe081df718b0 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081df718f0 sleepq_catch_signals() at sleepq_catch_signals+0x30c/frame 0xfffffe081df71960 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe081df71990 _sleep() at _sleep+0x2fc/frame 0xfffffe081df71a30 nfssvc_iod() at nfssvc_iod+0x101/frame 0xfffffe081df71a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081df71ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081df71ab0 --- trap 0, rip = 0, rsp = 0xfffffe081df71b70, rbp = 0 --- Tracing command vnlru pid 16 tid 100138 td 0xfffff80012136000 sched_switch() at sched_switch+0x4cf/frame 0xfffffe081d7f1870 mi_switch() at mi_switch+0x179/frame 0xfffffe081d7f18b0 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081d7f18f0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081d7f1920 _sleep() at _sleep+0x367/frame 0xfffffe081d7f19c0 kproc_suspend_check() at kproc_suspend_check+0x7c/frame 0xfffffe081d7f19f0 vnlru_proc() at vnlru_proc+0x50/frame 0xfffffe081d7f1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081d7f1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081d7f1ab0 --- trap 0, rip = 0, rsp = 0xfffffe081d7f1b70, rbp = 0 --- Tracing command syncer pid 9 tid 100137 td 0xfffff800121364a0 sched_switch() at sched_switch+0x4cf/frame 0xfffffe081d7ec850 mi_switch() at mi_switch+0x179/frame 0xfffffe081d7ec890 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081d7ec8d0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081d7ec900 _sleep() at _sleep+0x367/frame 0xfffffe081d7ec9a0 kproc_suspend_check() at kproc_suspend_check+0x7c/frame 0xfffffe081d7ec9d0 sched_sync() at sched_sync+0xc1/frame 0xfffffe081d7eca70 fork_exit() at fork_exit+0x84/frame 0xfffffe081d7ecab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081d7ecab0 --- trap 0, rip = 0, rsp = 0xfffffe081d7ecb70, rbp = 0 --- Tracing command bufdaemon pid 8 tid 100136 td 0xfffff80012136940 sched_switch() at sched_switch+0x4cf/frame 0xfffffe081d7e78c0 mi_switch() at mi_switch+0x179/frame 0xfffffe081d7e7900 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081d7e7940 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081d7e7970 _sleep() at _sleep+0x367/frame 0xfffffe081d7e7a10 kproc_suspend_check() at kproc_suspend_check+0x7c/frame 0xfffffe081d7e7a40 buf_daemon() at buf_daemon+0x9a/frame 0xfffffe081d7e7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081d7e7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081d7e7ab0 --- trap 0, rip = 0, rsp = 0xfffffe081d7e7b70, rbp = 0 --- Tracing command bufdaemon pid 8 tid 100152 td 0xfffff80012b94000 sched_switch() at sched_switch+0x4cf/frame 0xfffffe081da604d0 mi_switch() at mi_switch+0x179/frame 0xfffffe081da60510 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081da60550 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081da60580 _sleep() at _sleep+0x367/frame 0xfffffe081da60620 bwait() at bwait+0x6e/frame 0xfffffe081da60660 breadn_flags() at breadn_flags+0x124/frame 0xfffffe081da606a0 indir_trunc() at indir_trunc+0x1c3/frame 0xfffffe081da607e0 handle_workitem_indirblk() at handle_workitem_indirblk+0xf7/frame 0xfffffe081da60810 handle_workitem_freeblocks() at handle_workitem_freeblocks+0x2bd/frame 0xfffffe081da608a0 process_worklist_item() at process_worklist_item+0x5dd/frame 0xfffffe081da60990 softdep_process_worklist() at softdep_process_worklist+0x14b/frame 0xfffffe081da60a00 softdep_flush() at softdep_flush+0x15c/frame 0xfffffe081da60a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081da60ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081da60ab0 --- trap 0, rip = 0, rsp = 0xfffffe081da60b70, rbp = 0 --- Tracing command pagezero pid 7 tid 100135 td 0xfffff8000e1fb000 sched_switch() at sched_switch+0x4cf/frame 0xfffffe081d7e28f0 mi_switch() at mi_switch+0x179/frame 0xfffffe081d7e2930 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081d7e2970 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe081d7e29a0 _sleep() at _sleep+0x311/frame 0xfffffe081d7e2a40 vm_pagezero() at vm_pagezero+0x85/frame 0xfffffe081d7e2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081d7e2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081d7e2ab0 --- trap 0, rip = 0, rsp = 0xfffffe081d7e2b70, rbp = 0 --- Tracing command vmdaemon pid 6 tid 100134 td 0xfffff8000e1fb4a0 sched_switch() at sched_switch+0x4cf/frame 0xfffffe081d7dd8b0 mi_switch() at mi_switch+0x179/frame 0xfffffe081d7dd8f0 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081d7dd930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081d7dd960 _sleep() at _sleep+0x367/frame 0xfffffe081d7dda00 vm_daemon() at vm_daemon+0x7e/frame 0xfffffe081d7dda70 fork_exit() at fork_exit+0x84/frame 0xfffffe081d7ddab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081d7ddab0 --- trap 0, rip = 0, rsp = 0xfffffe081d7ddb70, rbp = 0 --- Tracing command pagedaemon pid 5 tid 100133 td 0xfffff8000e1fb940 sched_switch() at sched_switch+0x4cf/frame 0xfffffe081d7d88a0 mi_switch() at mi_switch+0x179/frame 0xfffffe081d7d88e0 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081d7d8920 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe081d7d8950 _sleep() at _sleep+0x311/frame 0xfffffe081d7d89f0 vm_pageout() at vm_pageout+0x155/frame 0xfffffe081d7d8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081d7d8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081d7d8ab0 --- trap 0, rip = 0, rsp = 0xfffffe081d7d8b70, rbp = 0 --- Tracing command enc_daemon0 pid 4 tid 100132 td 0xfffff8000e1fc000 sched_switch() at sched_switch+0x4cf/frame 0xfffffe081d7d38b0 mi_switch() at mi_switch+0x179/frame 0xfffffe081d7d38f0 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081d7d3930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081d7d3960 _sleep() at _sleep+0x367/frame 0xfffffe081d7d3a00 enc_daemon() at enc_daemon+0x25d/frame 0xfffffe081d7d3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081d7d3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081d7d3ab0 --- trap 0, rip = 0, rsp = 0xfffffe081d7d3b70, rbp = 0 --- Tracing command sctp_iterator pid 3 tid 100129 td 0xfffff8000e1fd000 sched_switch() at sched_switch+0x4cf/frame 0xfffffe081d684900 mi_switch() at mi_switch+0x179/frame 0xfffffe081d684940 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081d684980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081d6849b0 _sleep() at _sleep+0x367/frame 0xfffffe081d684a50 sctp_iterator_thread() at sctp_iterator_thread+0x59/frame 0xfffffe081d684a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081d684ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081d684ab0 --- trap 0, rip = 0, rsp = 0xfffffe081d684b70, rbp = 0 --- Tracing command usb pid 15 tid 100075 td 0xfffff8000db7a000 sched_switch() at sched_switch+0x4cf/frame 0xfffffe081b2c2920 mi_switch() at mi_switch+0x179/frame 0xfffffe081b2c2960 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081b2c29a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081b2c29d0 _cv_wait() at _cv_wait+0x1da/frame 0xfffffe081b2c2a40 usb_process() at usb_process+0x13b/frame 0xfffffe081b2c2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b2c2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b2c2ab0 --- trap 0, rip = 0, rsp = 0xfffffe081b2c2b70, rbp = 0 --- Tracing command usb pid 15 tid 100076 td 0xfffff8000db79940 sched_switch() at sched_switch+0x4cf/frame 0xfffffe081b2c7920 mi_switch() at mi_switch+0x179/frame 0xfffffe081b2c7960 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081b2c79a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081b2c79d0 _cv_wait() at _cv_wait+0x1da/frame 0xfffffe081b2c7a40 usb_process() at usb_process+0x13b/frame 0xfffffe081b2c7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b2c7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b2c7ab0 --- trap 0, rip = 0, rsp = 0xfffffe081b2c7b70, rbp = 0 --- Tracing command usb pid 15 tid 100077 td 0xfffff8000db794a0 sched_switch() at sched_switch+0x4cf/frame 0xfffffe081b2cc920 mi_switch() at mi_switch+0x179/frame 0xfffffe081b2cc960 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081b2cc9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081b2cc9d0 _cv_wait() at _cv_wait+0x1da/frame 0xfffffe081b2cca40 usb_process() at usb_process+0x13b/frame 0xfffffe081b2cca70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b2ccab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b2ccab0 --- trap 0, rip = 0, rsp = 0xfffffe081b2ccb70, rbp = 0 --- Tracing command usb pid 15 tid 100078 td 0xfffff8000db79000 sched_switch() at sched_switch+0x4cf/frame 0xfffffe081b2d1920 mi_switch() at mi_switch+0x179/frame 0xfffffe081b2d1960 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081b2d19a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081b2d19d0 _cv_wait() at _cv_wait+0x1da/frame 0xfffffe081b2d1a40 usb_process() at usb_process+0x13b/frame 0xfffffe081b2d1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b2d1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b2d1ab0 --- trap 0, rip = 0, rsp = 0xfffffe081b2d1b70, rbp = 0 --- Tracing command usb pid 15 tid 100115 td 0xfffff8000dbce940 sched_switch() at sched_switch+0x4cf/frame 0xfffffe081b436920 mi_switch() at mi_switch+0x179/frame 0xfffffe081b436960 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081b4369a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081b4369d0 _cv_wait() at _cv_wait+0x1da/frame 0xfffffe081b436a40 usb_process() at usb_process+0x13b/frame 0xfffffe081b436a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b436ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b436ab0 --- trap 0, rip = 0, rsp = 0xfffffe081b436b70, rbp = 0 --- Tracing command usb pid 15 tid 100116 td 0xfffff8000dbce4a0 sched_switch() at sched_switch+0x4cf/frame 0xfffffe081b43b920 mi_switch() at mi_switch+0x179/frame 0xfffffe081b43b960 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081b43b9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081b43b9d0 _cv_wait() at _cv_wait+0x1da/frame 0xfffffe081b43ba40 usb_process() at usb_process+0x13b/frame 0xfffffe081b43ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b43bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b43bab0 --- trap 0, rip = 0, rsp = 0xfffffe081b43bb70, rbp = 0 --- Tracing command usb pid 15 tid 100117 td 0xfffff8000dbce000 sched_switch() at sched_switch+0x4cf/frame 0xfffffe081b440920 mi_switch() at mi_switch+0x179/frame 0xfffffe081b440960 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081b4409a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081b4409d0 _cv_wait() at _cv_wait+0x1da/frame 0xfffffe081b440a40 usb_process() at usb_process+0x13b/frame 0xfffffe081b440a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b440ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b440ab0 --- trap 0, rip = 0, rsp = 0xfffffe081b440b70, rbp = 0 --- Tracing command usb pid 15 tid 100118 td 0xfffff8000dbec940 sched_switch() at sched_switch+0x4cf/frame 0xfffffe081b445920 mi_switch() at mi_switch+0x179/frame 0xfffffe081b445960 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081b4459a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081b4459d0 _cv_wait() at _cv_wait+0x1da/frame 0xfffffe081b445a40 usb_process() at usb_process+0x13b/frame 0xfffffe081b445a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b445ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b445ab0 --- trap 0, rip = 0, rsp = 0xfffffe081b445b70, rbp = 0 --- Tracing command usb pid 15 tid 100120 td 0xfffff8000dbec000 sched_switch() at sched_switch+0x4cf/frame 0xfffffe081b5d2920 mi_switch() at mi_switch+0x179/frame 0xfffffe081b5d2960 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081b5d29a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081b5d29d0 _cv_wait() at _cv_wait+0x1da/frame 0xfffffe081b5d2a40 usb_process() at usb_process+0x13b/frame 0xfffffe081b5d2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b5d2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b5d2ab0 --- trap 0, rip = 0, rsp = 0xfffffe081b5d2b70, rbp = 0 --- Tracing command usb pid 15 tid 100121 td 0xfffff8000dbe8940 sched_switch() at sched_switch+0x4cf/frame 0xfffffe081b5d7920 mi_switch() at mi_switch+0x179/frame 0xfffffe081b5d7960 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081b5d79a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081b5d79d0 _cv_wait() at _cv_wait+0x1da/frame 0xfffffe081b5d7a40 usb_process() at usb_process+0x13b/frame 0xfffffe081b5d7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b5d7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b5d7ab0 --- trap 0, rip = 0, rsp = 0xfffffe081b5d7b70, rbp = 0 --- Tracing command usb pid 15 tid 100122 td 0xfffff8000dbe84a0 sched_switch() at sched_switch+0x4cf/frame 0xfffffe081b5dc920 mi_switch() at mi_switch+0x179/frame 0xfffffe081b5dc960 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081b5dc9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081b5dc9d0 _cv_wait() at _cv_wait+0x1da/frame 0xfffffe081b5dca40 usb_process() at usb_process+0x13b/frame 0xfffffe081b5dca70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b5dcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b5dcab0 --- trap 0, rip = 0, rsp = 0xfffffe081b5dcb70, rbp = 0 --- Tracing command usb pid 15 tid 100123 td 0xfffff8000dbe8000 sched_switch() at sched_switch+0x4cf/frame 0xfffffe081b5e1920 mi_switch() at mi_switch+0x179/frame 0xfffffe081b5e1960 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081b5e19a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081b5e19d0 _cv_wait() at _cv_wait+0x1da/frame 0xfffffe081b5e1a40 usb_process() at usb_process+0x13b/frame 0xfffffe081b5e1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b5e1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b5e1ab0 --- trap 0, rip = 0, rsp = 0xfffffe081b5e1b70, rbp = 0 --- Tracing command cam pid 2 tid 100067 td 0xfffff80006749940 sched_switch() at sched_switch+0x4cf/frame 0xfffffe078a5be8d0 mi_switch() at mi_switch+0x179/frame 0xfffffe078a5be910 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe078a5be950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe078a5be980 _sleep() at _sleep+0x367/frame 0xfffffe078a5bea20 xpt_done_td() at xpt_done_td+0x13f/frame 0xfffffe078a5bea70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a5beab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a5beab0 --- trap 0, rip = 0, rsp = 0xfffffe078a5beb70, rbp = 0 --- Tracing command cam pid 2 tid 100068 td 0xfffff800067494a0 sched_switch() at sched_switch+0x4cf/frame 0xfffffe078a5c38d0 mi_switch() at mi_switch+0x179/frame 0xfffffe078a5c3910 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe078a5c3950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe078a5c3980 _sleep() at _sleep+0x367/frame 0xfffffe078a5c3a20 xpt_done_td() at xpt_done_td+0x13f/frame 0xfffffe078a5c3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a5c3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a5c3ab0 --- trap 0, rip = 0, rsp = 0xfffffe078a5c3b70, rbp = 0 --- Tracing command cam pid 2 tid 100069 td 0xfffff80006749000 sched_switch() at sched_switch+0x4cf/frame 0xfffffe078a5c88d0 mi_switch() at mi_switch+0x179/frame 0xfffffe078a5c8910 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe078a5c8950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe078a5c8980 _sleep() at _sleep+0x367/frame 0xfffffe078a5c8a20 xpt_done_td() at xpt_done_td+0x13f/frame 0xfffffe078a5c8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a5c8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a5c8ab0 --- trap 0, rip = 0, rsp = 0xfffffe078a5c8b70, rbp = 0 --- Tracing command cam pid 2 tid 100070 td 0xfffff80006748940 sched_switch() at sched_switch+0x4cf/frame 0xfffffe078a5cd8d0 mi_switch() at mi_switch+0x179/frame 0xfffffe078a5cd910 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe078a5cd950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe078a5cd980 _sleep() at _sleep+0x367/frame 0xfffffe078a5cda20 xpt_done_td() at xpt_done_td+0x13f/frame 0xfffffe078a5cda70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a5cdab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a5cdab0 --- trap 0, rip = 0, rsp = 0xfffffe078a5cdb70, rbp = 0 --- Tracing command cam pid 2 tid 100071 td 0xfffff800067484a0 sched_switch() at sched_switch+0x4cf/frame 0xfffffe078a5d28d0 mi_switch() at mi_switch+0x179/frame 0xfffffe078a5d2910 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe078a5d2950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe078a5d2980 _sleep() at _sleep+0x367/frame 0xfffffe078a5d2a20 xpt_done_td() at xpt_done_td+0x13f/frame 0xfffffe078a5d2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a5d2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a5d2ab0 --- trap 0, rip = 0, rsp = 0xfffffe078a5d2b70, rbp = 0 --- Tracing command cam pid 2 tid 100131 td 0xfffff8000e1fc4a0 sched_switch() at sched_switch+0x4cf/frame 0xfffffe081d68e8c0 mi_switch() at mi_switch+0x179/frame 0xfffffe081d68e900 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081d68e940 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081d68e970 _sleep() at _sleep+0x367/frame 0xfffffe081d68ea10 xpt_scanner_thread() at xpt_scanner_thread+0x5c/frame 0xfffffe081d68ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe081d68eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081d68eab0 --- trap 0, rip = 0, rsp = 0xfffffe081d68eb70, rbp = 0 --- Tracing command rand_harvestq pid 14 tid 100057 td 0xfffff800065b8000 sched_switch() at sched_switch+0x4cf/frame 0xfffffe078a58c900 mi_switch() at mi_switch+0x179/frame 0xfffffe078a58c940 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe078a58c980 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe078a58c9b0 _sleep() at _sleep+0x311/frame 0xfffffe078a58ca50 random_kthread() at random_kthread+0x37/frame 0xfffffe078a58ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a58cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a58cab0 --- trap 0, rip = 0, rsp = 0xfffffe078a58cb70, rbp = 0 --- Tracing command geom pid 13 tid 100053 td 0xfffff800065ae4a0 sched_switch() at sched_switch+0x4cf/frame 0xfffffe078a5788e0 mi_switch() at mi_switch+0x179/frame 0xfffffe078a578920 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe078a578960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe078a578990 _sleep() at _sleep+0x367/frame 0xfffffe078a578a30 g_run_events() at g_run_events+0x4d/frame 0xfffffe078a578a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a578ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a578ab0 --- trap 0, rip = 0, rsp = 0xfffffe078a578b70, rbp = 0 --- Tracing command geom pid 13 tid 100054 td 0xfffff800065ae000 sched_switch() at sched_switch+0x4cf/frame 0xfffffe078a57d8e0 mi_switch() at mi_switch+0x179/frame 0xfffffe078a57d920 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe078a57d960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe078a57d990 _sleep() at _sleep+0x367/frame 0xfffffe078a57da30 g_io_schedule_up() at g_io_schedule_up+0xf7/frame 0xfffffe078a57da60 g_up_procbody() at g_up_procbody+0x7d/frame 0xfffffe078a57da70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a57dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a57dab0 --- trap 0, rip = 0, rsp = 0xfffffe078a57db70, rbp = 0 --- Tracing command geom pid 13 tid 100055 td 0xfffff800065b8940 sched_switch() at sched_switch+0x4cf/frame 0xfffffe078a5828e0 mi_switch() at mi_switch+0x179/frame 0xfffffe078a582920 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe078a582960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe078a582990 _sleep() at _sleep+0x367/frame 0xfffffe078a582a30 g_io_schedule_down() at g_io_schedule_down+0x12c/frame 0xfffffe078a582a60 g_down_procbody() at g_down_procbody+0x7d/frame 0xfffffe078a582a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a582ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a582ab0 --- trap 0, rip = 0, rsp = 0xfffffe078a582b70, rbp = 0 --- Tracing command intr pid 12 tid 100027 td 0xfffff8000657b000 sched_switch() at sched_switch+0x4cf/frame 0xfffffe078a4f69f0 mi_switch() at mi_switch+0x179/frame 0xfffffe078a4f6a30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe078a4f6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a4f6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a4f6ab0 --- trap 0, rip = 0, rsp = 0xfffffe078a4f6b70, rbp = 0 --- Tracing command intr pid 12 tid 100028 td 0xfffff8000659f940 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100029 td 0xfffff8000659f4a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100030 td 0xfffff8000659f000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100031 td 0xfffff8000659e940 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100032 td 0xfffff8000659e4a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100033 td 0xfffff8000659e000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100034 td 0xfffff8000659d940 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100035 td 0xfffff8000659d4a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100036 td 0xfffff8000659d000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100037 td 0xfffff800065a5940 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100038 td 0xfffff800065a54a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100039 td 0xfffff800065a5000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100040 td 0xfffff800065a4940 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100041 td 0xfffff800065a44a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100042 td 0xfffff800065a4000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100043 td 0xfffff800065a3940 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100044 td 0xfffff800065a34a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100045 td 0xfffff800065a3000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100046 td 0xfffff800065b0940 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100047 td 0xfffff800065b04a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100048 td 0xfffff800065b0000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100049 td 0xfffff800065af940 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100050 td 0xfffff800065af4a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100051 td 0xfffff800065af000 sched_switch() at sched_switch+0x4cf/frame 0xfffffe078a56e9f0 mi_switch() at mi_switch+0x179/frame 0xfffffe078a56ea30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe078a56ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a56eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a56eab0 --- trap 0, rip = 0, rsp = 0xfffffe078a56eb70, rbp = 0 --- Tracing command intr pid 12 tid 100052 td 0xfffff800065ae940 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100059 td 0xfffff800065b74a0 sched_switch() at sched_switch+0x4cf/frame 0xfffffe078a5969f0 mi_switch() at mi_switch+0x179/frame 0xfffffe078a596a30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe078a596a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a596ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a596ab0 --- trap 0, rip = 0, rsp = 0xfffffe078a596b70, rbp = 0 --- Tracing command intr pid 12 tid 100060 td 0xfffff800065b7000 sched_switch() at sched_switch+0x4cf/frame 0xfffffe078a59b9f0 mi_switch() at mi_switch+0x179/frame 0xfffffe078a59ba30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe078a59ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a59bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a59bab0 --- trap 0, rip = 0, rsp = 0xfffffe078a59bb70, rbp = 0 --- Tracing command intr pid 12 tid 100062 td 0xfffff800065b64a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100072 td 0xfffff80006748000 sched_switch() at sched_switch+0x4cf/frame 0xfffffe078a5d79f0 mi_switch() at mi_switch+0x179/frame 0xfffffe078a5d7a30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe078a5d7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a5d7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a5d7ab0 --- trap 0, rip = 0, rsp = 0xfffffe078a5d7b70, rbp = 0 --- Tracing command intr pid 12 tid 100073 td 0xfffff8000db7a940 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100074 td 0xfffff8000db7a4a0 sched_switch() at sched_switch+0x4cf/frame 0xfffffe081b2bd9f0 mi_switch() at mi_switch+0x179/frame 0xfffffe081b2bda30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe081b2bda70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b2bdab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b2bdab0 --- trap 0, rip = 0, rsp = 0xfffffe081b2bdb70, rbp = 0 --- Tracing command intr pid 12 tid 100079 td 0xfffff8000db78940 sched_switch() at sched_switch+0x4cf/frame 0xfffffe081b2d69f0 mi_switch() at mi_switch+0x179/frame 0xfffffe081b2d6a30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe081b2d6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b2d6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b2d6ab0 --- trap 0, rip = 0, rsp = 0xfffffe081b2d6b70, rbp = 0 --- Tracing command intr pid 12 tid 100080 td 0xfffff8000db784a0 sched_switch() at sched_switch+0x4cf/frame 0xfffffe081b3259f0 mi_switch() at mi_switch+0x179/frame 0xfffffe081b325a30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe081b325a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b325ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b325ab0 --- trap 0, rip = 0, rsp = 0xfffffe081b325b70, rbp = 0 --- Tracing command intr pid 12 tid 100082 td 0xfffff8000dbae940 sched_switch() at sched_switch+0x4cf/frame 0xfffffe081b32f9f0 mi_switch() at mi_switch+0x179/frame 0xfffffe081b32fa30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe081b32fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b32fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b32fab0 --- trap 0, rip = 0, rsp = 0xfffffe081b32fb70, rbp = 0 --- Tracing command intr pid 12 tid 100084 td 0xfffff8000dbae000 sched_switch() at sched_switch+0x4cf/frame 0xfffffe081b3399f0 mi_switch() at mi_switch+0x179/frame 0xfffffe081b339a30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe081b339a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b339ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b339ab0 --- trap 0, rip = 0, rsp = 0xfffffe081b339b70, rbp = 0 --- Tracing command intr pid 12 tid 100086 td 0xfffff8000dbad4a0 sched_switch() at sched_switch+0x4cf/frame 0xfffffe081b3439f0 mi_switch() at mi_switch+0x179/frame 0xfffffe081b343a30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe081b343a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b343ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b343ab0 --- trap 0, rip = 0, rsp = 0xfffffe081b343b70, rbp = 0 --- Tracing command intr pid 12 tid 100088 td 0xfffff8000dbac940 sched_switch() at sched_switch+0x4cf/frame 0xfffffe081b34d9f0 mi_switch() at mi_switch+0x179/frame 0xfffffe081b34da30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe081b34da70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b34dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b34dab0 --- trap 0, rip = 0, rsp = 0xfffffe081b34db70, rbp = 0 --- Tracing command intr pid 12 tid 100090 td 0xfffff8000dbac000 sched_switch() at sched_switch+0x4cf/frame 0xfffffe081b3579f0 mi_switch() at mi_switch+0x179/frame 0xfffffe081b357a30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe081b357a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b357ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b357ab0 --- trap 0, rip = 0, rsp = 0xfffffe081b357b70, rbp = 0 --- Tracing command intr pid 12 tid 100092 td 0xfffff8000dbb54a0 sched_switch() at sched_switch+0x4cf/frame 0xfffffe081b3619f0 mi_switch() at mi_switch+0x179/frame 0xfffffe081b361a30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe081b361a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b361ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b361ab0 --- trap 0, rip = 0, rsp = 0xfffffe081b361b70, rbp = 0 --- Tracing command intr pid 12 tid 100094 td 0xfffff8000dbb4940 sched_switch() at sched_switch+0x4cf/frame 0xfffffe081b36b9f0 mi_switch() at mi_switch+0x179/frame 0xfffffe081b36ba30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe081b36ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b36bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b36bab0 --- trap 0, rip = 0, rsp = 0xfffffe081b36bb70, rbp = 0 --- Tracing command intr pid 12 tid 100096 td 0xfffff8000dbb4000 sched_switch() at sched_switch+0x4cf/frame 0xfffffe081b3759f0 mi_switch() at mi_switch+0x179/frame 0xfffffe081b375a30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe081b375a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b375ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b375ab0 --- trap 0, rip = 0, rsp = 0xfffffe081b375b70, rbp = 0 --- Tracing command intr pid 12 tid 100097 td 0xfffff8000dbaf940 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100099 td 0xfffff8000dbaf000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100101 td 0xfffff8000dbcd4a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100103 td 0xfffff8000dbcc940 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100105 td 0xfffff8000dbcc000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100107 td 0xfffff8000dbcb4a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100109 td 0xfffff8000dbd0940 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100111 td 0xfffff8000dbd0000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100113 td 0xfffff8000dbcf4a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100114 td 0xfffff8000dbcf000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100119 td 0xfffff8000dbec4a0 sched_switch() at sched_switch+0x4cf/frame 0xfffffe081b5cd9f0 mi_switch() at mi_switch+0x179/frame 0xfffffe081b5cda30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe081b5cda70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b5cdab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b5cdab0 --- trap 0, rip = 0, rsp = 0xfffffe081b5cdb70, rbp = 0 --- Tracing command intr pid 12 tid 100124 td 0xfffff8000dbe7940 sched_switch() at sched_switch+0x4cf/frame 0xfffffe081b5e69f0 mi_switch() at mi_switch+0x179/frame 0xfffffe081b5e6a30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe081b5e6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b5e6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b5e6ab0 --- trap 0, rip = 0, rsp = 0xfffffe081b5e6b70, rbp = 0 --- Tracing command intr pid 12 tid 100125 td 0xfffff8000dbe74a0 sched_switch() at sched_switch+0x4cf/frame 0xfffffe081d6689f0 mi_switch() at mi_switch+0x179/frame 0xfffffe081d668a30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe081d668a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081d668ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081d668ab0 --- trap 0, rip = 0, rsp = 0xfffffe081d668b70, rbp = 0 --- Tracing command intr pid 12 tid 100126 td 0xfffff8000dbe7000 sched_switch() at sched_switch+0x4cf/frame 0xfffffe081d6709f0 mi_switch() at mi_switch+0x179/frame 0xfffffe081d670a30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe081d670a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081d670ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081d670ab0 --- trap 0, rip = 0, rsp = 0xfffffe081d670b70, rbp = 0 --- Tracing command idle pid 11 tid 100003 td 0xfffff80006567000 sched_switch() at sched_switch+0x4cf/frame 0xfffffe07fbdf3910 mi_switch() at mi_switch+0x179/frame 0xfffffe07fbdf3950 critical_exit() at critical_exit+0x8b/frame 0xfffffe07fbdf3970 sched_idletd() at sched_idletd+0x4e1/frame 0xfffffe07fbdf3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe07fbdf3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe07fbdf3ab0 --- trap 0, rip = 0, rsp = 0xfffffe07fbdf3b70, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffff80006566940 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fbd31cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fbd31d10 trap() at trap+0x3a/frame 0xfffffe07fbd31f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fbd31f20 --- trap 0x13, rip = 0xffffffff803783d5, rsp = 0xfffffe07fbd31fe0, rbp = 0xfffffe07fbdf8930 --- acpi_cpu_idle() at acpi_cpu_idle+0x215/frame 0xfffffe07fbdf8930 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe07fbdf8950 cpu_idle() at cpu_idle+0x90/frame 0xfffffe07fbdf8970 sched_idletd() at sched_idletd+0x4e1/frame 0xfffffe07fbdf8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe07fbdf8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe07fbdf8ab0 --- trap 0, rip = 0, rsp = 0xfffffe07fbdf8b70, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffff800065664a0 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fbd39cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fbd39d10 trap() at trap+0x3a/frame 0xfffffe07fbd39f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fbd39f20 --- trap 0x13, rip = 0xffffffff803783d5, rsp = 0xfffffe07fbd39fe0, rbp = 0xfffffe07fbdfd930 --- acpi_cpu_idle() at acpi_cpu_idle+0x215/frame 0xfffffe07fbdfd930 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe07fbdfd950 cpu_idle() at cpu_idle+0x90/frame 0xfffffe07fbdfd970 sched_idletd() at sched_idletd+0x4e1/frame 0xfffffe07fbdfda70 fork_exit() at fork_exit+0x84/frame 0xfffffe07fbdfdab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe07fbdfdab0 --- trap 0, rip = 0, rsp = 0xfffffe07fbdfdb70, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffff80006566000 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fbd41cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fbd41d10 trap() at trap+0x3a/frame 0xfffffe07fbd41f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fbd41f20 --- trap 0x13, rip = 0xffffffff80d79296, rsp = 0xfffffe07fbd41fe0, rbp = 0xfffffe078a48d8e0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe078a48d8e0 acpi_cpu_idle() at acpi_cpu_idle+0x15a/frame 0xfffffe078a48d930 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078a48d950 cpu_idle() at cpu_idle+0x90/frame 0xfffffe078a48d970 sched_idletd() at sched_idletd+0x4e1/frame 0xfffffe078a48da70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a48dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a48dab0 --- trap 0, rip = 0, rsp = 0xfffffe078a48db70, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffff80006565940 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fbd49cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fbd49d10 trap() at trap+0x3a/frame 0xfffffe07fbd49f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fbd49f20 --- trap 0x13, rip = 0xffffffff803783d5, rsp = 0xfffffe07fbd49fe0, rbp = 0xfffffe078a492930 --- acpi_cpu_idle() at acpi_cpu_idle+0x215/frame 0xfffffe078a492930 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078a492950 cpu_idle() at cpu_idle+0x90/frame 0xfffffe078a492970 sched_idletd() at sched_idletd+0x4e1/frame 0xfffffe078a492a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a492ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a492ab0 --- trap 0, rip = 0, rsp = 0xfffffe078a492b70, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffff800065654a0 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fbd51cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fbd51d10 trap() at trap+0x3a/frame 0xfffffe07fbd51f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fbd51f20 --- trap 0x13, rip = 0xffffffff803783d5, rsp = 0xfffffe07fbd51fe0, rbp = 0xfffffe078a497930 --- acpi_cpu_idle() at acpi_cpu_idle+0x215/frame 0xfffffe078a497930 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078a497950 cpu_idle() at cpu_idle+0x90/frame 0xfffffe078a497970 sched_idletd() at sched_idletd+0x4e1/frame 0xfffffe078a497a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a497ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a497ab0 --- trap 0, rip = 0, rsp = 0xfffffe078a497b70, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffff80006565000 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fbd59cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fbd59d10 trap() at trap+0x3a/frame 0xfffffe07fbd59f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fbd59f20 --- trap 0x13, rip = 0xffffffff80d79296, rsp = 0xfffffe07fbd59fe0, rbp = 0xfffffe078a49c8e0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe078a49c8e0 acpi_cpu_idle() at acpi_cpu_idle+0x15a/frame 0xfffffe078a49c930 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078a49c950 cpu_idle() at cpu_idle+0x90/frame 0xfffffe078a49c970 sched_idletd() at sched_idletd+0x4e1/frame 0xfffffe078a49ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a49cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a49cab0 --- trap 0, rip = 0, rsp = 0xfffffe078a49cb70, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffff80006578940 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fbd61cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fbd61d10 trap() at trap+0x3a/frame 0xfffffe07fbd61f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fbd61f20 --- trap 0x13, rip = 0xffffffff803783d5, rsp = 0xfffffe07fbd61fe0, rbp = 0xfffffe078a4a1930 --- acpi_cpu_idle() at acpi_cpu_idle+0x215/frame 0xfffffe078a4a1930 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078a4a1950 cpu_idle() at cpu_idle+0x90/frame 0xfffffe078a4a1970 sched_idletd() at sched_idletd+0x4e1/frame 0xfffffe078a4a1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a4a1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a4a1ab0 --- trap 0, rip = 0, rsp = 0xfffffe078a4a1b70, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffff800065784a0 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fbd69cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fbd69d10 trap() at trap+0x3a/frame 0xfffffe07fbd69f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fbd69f20 --- trap 0x13, rip = 0xffffffff80d79296, rsp = 0xfffffe07fbd69fe0, rbp = 0xfffffe078a4a68e0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe078a4a68e0 acpi_cpu_idle() at acpi_cpu_idle+0x15a/frame 0xfffffe078a4a6930 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078a4a6950 cpu_idle() at cpu_idle+0x90/frame 0xfffffe078a4a6970 sched_idletd() at sched_idletd+0x4e1/frame 0xfffffe078a4a6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a4a6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a4a6ab0 --- trap 0, rip = 0, rsp = 0xfffffe078a4a6b70, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffff80006578000 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fbd71cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fbd71d10 trap() at trap+0x3a/frame 0xfffffe07fbd71f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fbd71f20 --- trap 0x13, rip = 0xffffffff803783d5, rsp = 0xfffffe07fbd71fe0, rbp = 0xfffffe078a4ab930 --- acpi_cpu_idle() at acpi_cpu_idle+0x215/frame 0xfffffe078a4ab930 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078a4ab950 cpu_idle() at cpu_idle+0x90/frame 0xfffffe078a4ab970 sched_idletd() at sched_idletd+0x4e1/frame 0xfffffe078a4aba70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a4abab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a4abab0 --- trap 0, rip = 0, rsp = 0xfffffe078a4abb70, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffff80006577940 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fbd79cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fbd79d10 trap() at trap+0x3a/frame 0xfffffe07fbd79f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fbd79f20 --- trap 0x13, rip = 0xffffffff803783d5, rsp = 0xfffffe07fbd79fe0, rbp = 0xfffffe078a4b0930 --- acpi_cpu_idle() at acpi_cpu_idle+0x215/frame 0xfffffe078a4b0930 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078a4b0950 cpu_idle() at cpu_idle+0x90/frame 0xfffffe078a4b0970 sched_idletd() at sched_idletd+0x4e1/frame 0xfffffe078a4b0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a4b0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a4b0ab0 --- trap 0, rip = 0, rsp = 0xfffffe078a4b0b70, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffff800065774a0 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fbd81cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fbd81d10 trap() at trap+0x3a/frame 0xfffffe07fbd81f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fbd81f20 --- trap 0x13, rip = 0xffffffff803783d5, rsp = 0xfffffe07fbd81fe0, rbp = 0xfffffe078a4b5930 --- acpi_cpu_idle() at acpi_cpu_idle+0x215/frame 0xfffffe078a4b5930 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078a4b5950 cpu_idle() at cpu_idle+0x90/frame 0xfffffe078a4b5970 sched_idletd() at sched_idletd+0x4e1/frame 0xfffffe078a4b5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a4b5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a4b5ab0 --- trap 0, rip = 0, rsp = 0xfffffe078a4b5b70, rbp = 0 --- Tracing command idle pid 11 tid 100015 td 0xfffff80006577000 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fbd89cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fbd89d10 trap() at trap+0x3a/frame 0xfffffe07fbd89f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fbd89f20 --- trap 0x13, rip = 0xffffffff803783d5, rsp = 0xfffffe07fbd89fe0, rbp = 0xfffffe078a4ba930 --- acpi_cpu_idle() at acpi_cpu_idle+0x215/frame 0xfffffe078a4ba930 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078a4ba950 cpu_idle() at cpu_idle+0x90/frame 0xfffffe078a4ba970 sched_idletd() at sched_idletd+0x4e1/frame 0xfffffe078a4baa70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a4baab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a4baab0 --- trap 0, rip = 0, rsp = 0xfffffe078a4bab70, rbp = 0 --- Tracing command idle pid 11 tid 100016 td 0xfffff80006576940 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fbd91cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fbd91d10 trap() at trap+0x3a/frame 0xfffffe07fbd91f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fbd91f20 --- trap 0x13, rip = 0xffffffff80d79296, rsp = 0xfffffe07fbd91fe0, rbp = 0xfffffe078a4bf8e0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe078a4bf8e0 acpi_cpu_idle() at acpi_cpu_idle+0x15a/frame 0xfffffe078a4bf930 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078a4bf950 cpu_idle() at cpu_idle+0x90/frame 0xfffffe078a4bf970 sched_idletd() at sched_idletd+0x4e1/frame 0xfffffe078a4bfa70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a4bfab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a4bfab0 --- trap 0, rip = 0, rsp = 0xfffffe078a4bfb70, rbp = 0 --- Tracing command idle pid 11 tid 100017 td 0xfffff800065764a0 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fbd99cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fbd99d10 trap() at trap+0x3a/frame 0xfffffe07fbd99f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fbd99f20 --- trap 0x13, rip = 0xffffffff803783d5, rsp = 0xfffffe07fbd99fe0, rbp = 0xfffffe078a4c4930 --- acpi_cpu_idle() at acpi_cpu_idle+0x215/frame 0xfffffe078a4c4930 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078a4c4950 cpu_idle() at cpu_idle+0x90/frame 0xfffffe078a4c4970 sched_idletd() at sched_idletd+0x4e1/frame 0xfffffe078a4c4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a4c4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a4c4ab0 --- trap 0, rip = 0, rsp = 0xfffffe078a4c4b70, rbp = 0 --- Tracing command idle pid 11 tid 100018 td 0xfffff80006576000 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fbda1cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fbda1d10 trap() at trap+0x3a/frame 0xfffffe07fbda1f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fbda1f20 --- trap 0x13, rip = 0xffffffff803783d5, rsp = 0xfffffe07fbda1fe0, rbp = 0xfffffe078a4c9930 --- acpi_cpu_idle() at acpi_cpu_idle+0x215/frame 0xfffffe078a4c9930 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078a4c9950 cpu_idle() at cpu_idle+0x90/frame 0xfffffe078a4c9970 sched_idletd() at sched_idletd+0x4e1/frame 0xfffffe078a4c9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a4c9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a4c9ab0 --- trap 0, rip = 0, rsp = 0xfffffe078a4c9b70, rbp = 0 --- Tracing command idle pid 11 tid 100019 td 0xfffff8000657d940 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fbda9cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fbda9d10 trap() at trap+0x3a/frame 0xfffffe07fbda9f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fbda9f20 --- trap 0x13, rip = 0xffffffff803783d5, rsp = 0xfffffe07fbda9fe0, rbp = 0xfffffe078a4ce930 --- acpi_cpu_idle() at acpi_cpu_idle+0x215/frame 0xfffffe078a4ce930 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078a4ce950 cpu_idle() at cpu_idle+0x90/frame 0xfffffe078a4ce970 sched_idletd() at sched_idletd+0x4e1/frame 0xfffffe078a4cea70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a4ceab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a4ceab0 --- trap 0, rip = 0, rsp = 0xfffffe078a4ceb70, rbp = 0 --- Tracing command idle pid 11 tid 100020 td 0xfffff8000657d4a0 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fbdb1cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fbdb1d10 trap() at trap+0x3a/frame 0xfffffe07fbdb1f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fbdb1f20 --- trap 0x13, rip = 0xffffffff803783d5, rsp = 0xfffffe07fbdb1fe0, rbp = 0xfffffe078a4d3930 --- acpi_cpu_idle() at acpi_cpu_idle+0x215/frame 0xfffffe078a4d3930 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078a4d3950 cpu_idle() at cpu_idle+0x90/frame 0xfffffe078a4d3970 sched_idletd() at sched_idletd+0x4e1/frame 0xfffffe078a4d3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a4d3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a4d3ab0 --- trap 0, rip = 0, rsp = 0xfffffe078a4d3b70, rbp = 0 --- Tracing command idle pid 11 tid 100021 td 0xfffff8000657d000 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fbdb9cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fbdb9d10 trap() at trap+0x3a/frame 0xfffffe07fbdb9f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fbdb9f20 --- trap 0x13, rip = 0xffffffff803783d5, rsp = 0xfffffe07fbdb9fe0, rbp = 0xfffffe078a4d8930 --- acpi_cpu_idle() at acpi_cpu_idle+0x215/frame 0xfffffe078a4d8930 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078a4d8950 cpu_idle() at cpu_idle+0x90/frame 0xfffffe078a4d8970 sched_idletd() at sched_idletd+0x4e1/frame 0xfffffe078a4d8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a4d8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a4d8ab0 --- trap 0, rip = 0, rsp = 0xfffffe078a4d8b70, rbp = 0 --- Tracing command idle pid 11 tid 100022 td 0xfffff8000657c940 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fbdc1cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fbdc1d10 trap() at trap+0x3a/frame 0xfffffe07fbdc1f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fbdc1f20 --- trap 0x13, rip = 0xffffffff803783d5, rsp = 0xfffffe07fbdc1fe0, rbp = 0xfffffe078a4dd930 --- acpi_cpu_idle() at acpi_cpu_idle+0x215/frame 0xfffffe078a4dd930 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078a4dd950 cpu_idle() at cpu_idle+0x90/frame 0xfffffe078a4dd970 sched_idletd() at sched_idletd+0x4e1/frame 0xfffffe078a4dda70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a4ddab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a4ddab0 --- trap 0, rip = 0, rsp = 0xfffffe078a4ddb70, rbp = 0 --- Tracing command idle pid 11 tid 100023 td 0xfffff8000657c4a0 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fbdc9cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fbdc9d10 trap() at trap+0x3a/frame 0xfffffe07fbdc9f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fbdc9f20 --- trap 0x13, rip = 0xffffffff803783d5, rsp = 0xfffffe07fbdc9fe0, rbp = 0xfffffe078a4e2930 --- acpi_cpu_idle() at acpi_cpu_idle+0x215/frame 0xfffffe078a4e2930 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078a4e2950 cpu_idle() at cpu_idle+0x90/frame 0xfffffe078a4e2970 sched_idletd() at sched_idletd+0x4e1/frame 0xfffffe078a4e2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a4e2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a4e2ab0 --- trap 0, rip = 0, rsp = 0xfffffe078a4e2b70, rbp = 0 --- Tracing command idle pid 11 tid 100024 td 0xfffff8000657c000 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fbdd1cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fbdd1d10 trap() at trap+0x3a/frame 0xfffffe07fbdd1f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fbdd1f20 --- trap 0x13, rip = 0xffffffff803783d5, rsp = 0xfffffe07fbdd1fe0, rbp = 0xfffffe078a4e7930 --- acpi_cpu_idle() at acpi_cpu_idle+0x215/frame 0xfffffe078a4e7930 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078a4e7950 cpu_idle() at cpu_idle+0x90/frame 0xfffffe078a4e7970 sched_idletd() at sched_idletd+0x4e1/frame 0xfffffe078a4e7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a4e7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a4e7ab0 --- trap 0, rip = 0, rsp = 0xfffffe078a4e7b70, rbp = 0 --- Tracing command idle pid 11 tid 100025 td 0xfffff8000657b940 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fbdd9cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fbdd9d10 trap() at trap+0x3a/frame 0xfffffe07fbdd9f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fbdd9f20 --- trap 0x13, rip = 0xffffffff803783d5, rsp = 0xfffffe07fbdd9fe0, rbp = 0xfffffe078a4ec930 --- acpi_cpu_idle() at acpi_cpu_idle+0x215/frame 0xfffffe078a4ec930 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078a4ec950 cpu_idle() at cpu_idle+0x90/frame 0xfffffe078a4ec970 sched_idletd() at sched_idletd+0x4e1/frame 0xfffffe078a4eca70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a4ecab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a4ecab0 --- trap 0, rip = 0, rsp = 0xfffffe078a4ecb70, rbp = 0 --- Tracing command idle pid 11 tid 100026 td 0xfffff8000657b4a0 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fbde1cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fbde1d10 trap() at trap+0x3a/frame 0xfffffe07fbde1f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fbde1f20 --- trap 0x13, rip = 0xffffffff80d79296, rsp = 0xfffffe07fbde1fe0, rbp = 0xfffffe078a4f18e0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe078a4f18e0 acpi_cpu_idle() at acpi_cpu_idle+0x15a/frame 0xfffffe078a4f1930 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078a4f1950 cpu_idle() at cpu_idle+0x90/frame 0xfffffe078a4f1970 sched_idletd() at sched_idletd+0x4e1/frame 0xfffffe078a4f1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a4f1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a4f1ab0 --- trap 0, rip = 0, rsp = 0xfffffe078a4f1b70, rbp = 0 --- Tracing command init pid 1 tid 100002 td 0xfffff800065674a0 sched_switch() at sched_switch+0x4cf/frame 0xfffffe07fbdee750 mi_switch() at mi_switch+0x179/frame 0xfffffe07fbdee790 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe07fbdee7d0 sleepq_catch_signals() at sleepq_catch_signals+0x30c/frame 0xfffffe07fbdee840 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe07fbdee870 _sleep() at _sleep+0x324/frame 0xfffffe07fbdee910 kern_sigsuspend() at kern_sigsuspend+0xd4/frame 0xfffffe07fbdee970 sys_sigsuspend() at sys_sigsuspend+0x31/frame 0xfffffe07fbdee9a0 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe07fbdeeab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe07fbdeeab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x419c0a, rsp = 0x7fffffffe708, rbp = 0x7fffffffe7c0 --- Tracing command audit pid 10 tid 100001 td 0xfffff80006567940 sched_switch() at sched_switch+0x4cf/frame 0xfffffe07fbde98f0 mi_switch() at mi_switch+0x179/frame 0xfffffe07fbde9930 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe07fbde9970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe07fbde99a0 _cv_wait() at _cv_wait+0x1da/frame 0xfffffe07fbde9a10 audit_worker() at audit_worker+0xa3/frame 0xfffffe07fbde9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe07fbde9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe07fbde9ab0 --- trap 0, rip = 0, rsp = 0xfffffe07fbde9b70, rbp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xffffffff8189f0a0 sched_switch() at sched_switch+0x4cf/frame 0xffffffff81c3e9d0 mi_switch() at mi_switch+0x179/frame 0xffffffff81c3ea10 sleepq_switch() at sleepq_switch+0x152/frame 0xffffffff81c3ea50 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xffffffff81c3ea80 _sleep() at _sleep+0x311/frame 0xffffffff81c3eb20 swapper() at swapper+0x246/frame 0xffffffff81c3eb70 btext() at btext+0x2c Tracing command kernel pid 0 tid 100056 td 0xfffff800065b84a0 sched_switch() at sched_switch+0x4cf/frame 0xfffffe078a5878f0 mi_switch() at mi_switch+0x179/frame 0xfffffe078a587930 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe078a587970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe078a5879a0 _sleep() at _sleep+0x367/frame 0xfffffe078a587a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe078a587a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a587ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a587ab0 --- trap 0, rip = 0, rsp = 0xfffffe078a587b70, rbp = 0 --- Tracing command kernel pid 0 tid 100058 td 0xfffff800065b7940 sched_switch() at sched_switch+0x4cf/frame 0xfffffe078a5918f0 mi_switch() at mi_switch+0x179/frame 0xfffffe078a591930 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe078a591970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe078a5919a0 _sleep() at _sleep+0x367/frame 0xfffffe078a591a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe078a591a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a591ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a591ab0 --- trap 0, rip = 0, rsp = 0xfffffe078a591b70, rbp = 0 --- Tracing command kernel pid 0 tid 100061 td 0xfffff800065b6940 sched_switch() at sched_switch+0x4cf/frame 0xfffffe078a5a08f0 mi_switch() at mi_switch+0x179/frame 0xfffffe078a5a0930 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe078a5a0970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe078a5a09a0 _sleep() at _sleep+0x367/frame 0xfffffe078a5a0a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe078a5a0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a5a0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a5a0ab0 --- trap 0, rip = 0, rsp = 0xfffffe078a5a0b70, rbp = 0 --- Tracing command kernel pid 0 tid 100063 td 0xfffff800065b6000 sched_switch() at sched_switch+0x4cf/frame 0xfffffe078a5aa8f0 mi_switch() at mi_switch+0x179/frame 0xfffffe078a5aa930 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe078a5aa970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe078a5aa9a0 _sleep() at _sleep+0x367/frame 0xfffffe078a5aaa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe078a5aaa70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a5aaab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a5aaab0 --- trap 0, rip = 0, rsp = 0xfffffe078a5aab70, rbp = 0 --- Tracing command kernel pid 0 tid 100064 td 0xfffff8000674a940 sched_switch() at sched_switch+0x4cf/frame 0xfffffe078a5af900 mi_switch() at mi_switch+0x179/frame 0xfffffe078a5af940 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe078a5af980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe078a5af9b0 msleep_spin_sbt() at msleep_spin_sbt+0x1eb/frame 0xfffffe078a5afa40 taskqueue_thread_loop() at taskqueue_thread_loop+0x8d/frame 0xfffffe078a5afa70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a5afab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a5afab0 --- trap 0, rip = 0, rsp = 0xfffffe078a5afb70, rbp = 0 --- Tracing command kernel pid 0 tid 100065 td 0xfffff8000674a4a0 sched_switch() at sched_switch+0x4cf/frame 0xfffffe078a5b4900 mi_switch() at mi_switch+0x179/frame 0xfffffe078a5b4940 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe078a5b4980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe078a5b49b0 msleep_spin_sbt() at msleep_spin_sbt+0x1eb/frame 0xfffffe078a5b4a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x8d/frame 0xfffffe078a5b4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a5b4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a5b4ab0 --- trap 0, rip = 0, rsp = 0xfffffe078a5b4b70, rbp = 0 --- Tracing command kernel pid 0 tid 100066 td 0xfffff8000674a000 sched_switch() at sched_switch+0x4cf/frame 0xfffffe078a5b9900 mi_switch() at mi_switch+0x179/frame 0xfffffe078a5b9940 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe078a5b9980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe078a5b99b0 msleep_spin_sbt() at msleep_spin_sbt+0x1eb/frame 0xfffffe078a5b9a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x8d/frame 0xfffffe078a5b9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078a5b9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078a5b9ab0 --- trap 0, rip = 0, rsp = 0xfffffe078a5b9b70, rbp = 0 --- Tracing command kernel pid 0 tid 100081 td 0xfffff8000db78000 sched_switch() at sched_switch+0x4cf/frame 0xfffffe081b32a8f0 mi_switch() at mi_switch+0x179/frame 0xfffffe081b32a930 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081b32a970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081b32a9a0 _sleep() at _sleep+0x367/frame 0xfffffe081b32aa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe081b32aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b32aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b32aab0 --- trap 0, rip = 0, rsp = 0xfffffe081b32ab70, rbp = 0 --- Tracing command kernel pid 0 tid 100083 td 0xfffff8000dbae4a0 sched_switch() at sched_switch+0x4cf/frame 0xfffffe081b3348f0 mi_switch() at mi_switch+0x179/frame 0xfffffe081b334930 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081b334970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081b3349a0 _sleep() at _sleep+0x367/frame 0xfffffe081b334a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe081b334a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b334ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b334ab0 --- trap 0, rip = 0, rsp = 0xfffffe081b334b70, rbp = 0 --- Tracing command kernel pid 0 tid 100085 td 0xfffff8000dbad940 sched_switch() at sched_switch+0x4cf/frame 0xfffffe081b33e8f0 mi_switch() at mi_switch+0x179/frame 0xfffffe081b33e930 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081b33e970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081b33e9a0 _sleep() at _sleep+0x367/frame 0xfffffe081b33ea40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe081b33ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b33eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b33eab0 --- trap 0, rip = 0, rsp = 0xfffffe081b33eb70, rbp = 0 --- Tracing command kernel pid 0 tid 100087 td 0xfffff8000dbad000 sched_switch() at sched_switch+0x4cf/frame 0xfffffe081b3488f0 mi_switch() at mi_switch+0x179/frame 0xfffffe081b348930 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081b348970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081b3489a0 _sleep() at _sleep+0x367/frame 0xfffffe081b348a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe081b348a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b348ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b348ab0 --- trap 0, rip = 0, rsp = 0xfffffe081b348b70, rbp = 0 --- Tracing command kernel pid 0 tid 100089 td 0xfffff8000dbac4a0 sched_switch() at sched_switch+0x4cf/frame 0xfffffe081b3528f0 mi_switch() at mi_switch+0x179/frame 0xfffffe081b352930 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081b352970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081b3529a0 _sleep() at _sleep+0x367/frame 0xfffffe081b352a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe081b352a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b352ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b352ab0 --- trap 0, rip = 0, rsp = 0xfffffe081b352b70, rbp = 0 --- Tracing command kernel pid 0 tid 100091 td 0xfffff8000dbb5940 sched_switch() at sched_switch+0x4cf/frame 0xfffffe081b35c8f0 mi_switch() at mi_switch+0x179/frame 0xfffffe081b35c930 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081b35c970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081b35c9a0 _sleep() at _sleep+0x367/frame 0xfffffe081b35ca40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe081b35ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b35cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b35cab0 --- trap 0, rip = 0, rsp = 0xfffffe081b35cb70, rbp = 0 --- Tracing command kernel pid 0 tid 100093 td 0xfffff8000dbb5000 sched_switch() at sched_switch+0x4cf/frame 0xfffffe081b3668f0 mi_switch() at mi_switch+0x179/frame 0xfffffe081b366930 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081b366970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081b3669a0 _sleep() at _sleep+0x367/frame 0xfffffe081b366a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe081b366a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b366ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b366ab0 --- trap 0, rip = 0, rsp = 0xfffffe081b366b70, rbp = 0 --- Tracing command kernel pid 0 tid 100095 td 0xfffff8000dbb44a0 sched_switch() at sched_switch+0x4cf/frame 0xfffffe081b3708f0 mi_switch() at mi_switch+0x179/frame 0xfffffe081b370930 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081b370970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081b3709a0 _sleep() at _sleep+0x367/frame 0xfffffe081b370a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe081b370a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b370ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b370ab0 --- trap 0, rip = 0, rsp = 0xfffffe081b370b70, rbp = 0 --- Tracing command kernel pid 0 tid 100098 td 0xfffff8000dbaf4a0 sched_switch() at sched_switch+0x4cf/frame 0xfffffe081b3bf8f0 mi_switch() at mi_switch+0x179/frame 0xfffffe081b3bf930 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081b3bf970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081b3bf9a0 _sleep() at _sleep+0x367/frame 0xfffffe081b3bfa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe081b3bfa70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b3bfab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b3bfab0 --- trap 0, rip = 0, rsp = 0xfffffe081b3bfb70, rbp = 0 --- Tracing command kernel pid 0 tid 100100 td 0xfffff8000dbcd940 sched_switch() at sched_switch+0x4cf/frame 0xfffffe081b3c98f0 mi_switch() at mi_switch+0x179/frame 0xfffffe081b3c9930 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081b3c9970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081b3c99a0 _sleep() at _sleep+0x367/frame 0xfffffe081b3c9a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe081b3c9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b3c9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b3c9ab0 --- trap 0, rip = 0, rsp = 0xfffffe081b3c9b70, rbp = 0 --- Tracing command kernel pid 0 tid 100102 td 0xfffff8000dbcd000 sched_switch() at sched_switch+0x4cf/frame 0xfffffe081b3d38f0 mi_switch() at mi_switch+0x179/frame 0xfffffe081b3d3930 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081b3d3970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081b3d39a0 _sleep() at _sleep+0x367/frame 0xfffffe081b3d3a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe081b3d3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b3d3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b3d3ab0 --- trap 0, rip = 0, rsp = 0xfffffe081b3d3b70, rbp = 0 --- Tracing command kernel pid 0 tid 100104 td 0xfffff8000dbcc4a0 sched_switch() at sched_switch+0x4cf/frame 0xfffffe081b3dd8f0 mi_switch() at mi_switch+0x179/frame 0xfffffe081b3dd930 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081b3dd970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081b3dd9a0 _sleep() at _sleep+0x367/frame 0xfffffe081b3dda40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe081b3dda70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b3ddab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b3ddab0 --- trap 0, rip = 0, rsp = 0xfffffe081b3ddb70, rbp = 0 --- Tracing command kernel pid 0 tid 100106 td 0xfffff8000dbcb940 sched_switch() at sched_switch+0x4cf/frame 0xfffffe081b3e78f0 mi_switch() at mi_switch+0x179/frame 0xfffffe081b3e7930 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081b3e7970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081b3e79a0 _sleep() at _sleep+0x367/frame 0xfffffe081b3e7a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe081b3e7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b3e7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b3e7ab0 --- trap 0, rip = 0, rsp = 0xfffffe081b3e7b70, rbp = 0 --- Tracing command kernel pid 0 tid 100108 td 0xfffff8000dbcb000 sched_switch() at sched_switch+0x4cf/frame 0xfffffe081b3f18f0 mi_switch() at mi_switch+0x179/frame 0xfffffe081b3f1930 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081b3f1970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081b3f19a0 _sleep() at _sleep+0x367/frame 0xfffffe081b3f1a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe081b3f1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b3f1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b3f1ab0 --- trap 0, rip = 0, rsp = 0xfffffe081b3f1b70, rbp = 0 --- Tracing command kernel pid 0 tid 100110 td 0xfffff8000dbd04a0 sched_switch() at sched_switch+0x4cf/frame 0xfffffe081b3fb8f0 mi_switch() at mi_switch+0x179/frame 0xfffffe081b3fb930 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081b3fb970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081b3fb9a0 _sleep() at _sleep+0x367/frame 0xfffffe081b3fba40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe081b3fba70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b3fbab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b3fbab0 --- trap 0, rip = 0, rsp = 0xfffffe081b3fbb70, rbp = 0 --- Tracing command kernel pid 0 tid 100112 td 0xfffff8000dbcf940 sched_switch() at sched_switch+0x4cf/frame 0xfffffe081b4098f0 mi_switch() at mi_switch+0x179/frame 0xfffffe081b409930 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081b409970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081b4099a0 _sleep() at _sleep+0x367/frame 0xfffffe081b409a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe081b409a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b409ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b409ab0 --- trap 0, rip = 0, rsp = 0xfffffe081b409b70, rbp = 0 --- Tracing command kernel pid 0 tid 100127 td 0xfffff8000e1fd940 sched_switch() at sched_switch+0x4cf/frame 0xfffffe081d679900 mi_switch() at mi_switch+0x179/frame 0xfffffe081d679940 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081d679980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081d6799b0 msleep_spin_sbt() at msleep_spin_sbt+0x1eb/frame 0xfffffe081d679a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x8d/frame 0xfffffe081d679a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081d679ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081d679ab0 --- trap 0, rip = 0, rsp = 0xfffffe081d679b70, rbp = 0 --- Tracing command kernel pid 0 tid 100128 td 0xfffff8000e1fd4a0 sched_switch() at sched_switch+0x4cf/frame 0xfffffe081d67e880 mi_switch() at mi_switch+0x179/frame 0xfffffe081d67e8c0 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081d67e900 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe081d67e930 _sleep() at _sleep+0x311/frame 0xfffffe081d67e9d0 pause_sbt() at pause_sbt+0xd8/frame 0xfffffe081d67ea20 deadlkres() at deadlkres+0x2c/frame 0xfffffe081d67ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe081d67eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081d67eab0 --- trap 0, rip = 0, rsp = 0xfffffe081d67eb70, rbp = 0 --- Tracing command kernel pid 0 tid 100130 td 0xfffff8000e1fc940 sched_switch() at sched_switch+0x4cf/frame 0xfffffe081d6898f0 mi_switch() at mi_switch+0x179/frame 0xfffffe081d689930 sleepq_switch() at sleepq_switch+0x152/frame 0xfffffe081d689970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081d6899a0 _sleep() at _sleep+0x367/frame 0xfffffe081d689a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe081d689a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081d689ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081d689ab0 --- trap 0, rip = 0, rsp = 0xfffffe081d689b70, rbp = 0 --- db:0:allt> call doadump Dumping 1329 out of 31641 MB:..2%..11%..21%..31%..41%..51%..61%..71%..81%..91% Dump complete = 0 db:0:doadump> reset (kgdb) bt #0 doadump (textdump=Unhandled dwarf expression opcode 0x93 ) at pcpu.h:219 #1 0xffffffff80355e66 in db_fncall (dummy1=, dummy2=, dummy3=, dummy4=) at ../../../ddb/db_command.c:568 #2 0xffffffff80355b4c in db_command (cmd_table=0x0) at ../../../ddb/db_command.c:440 #3 0xffffffff80359f68 in db_script_exec (scriptname=0xffffffff8186bb90 "doadump", warnifnotfound=) at ../../../ddb/db_script.c:302 #4 0xffffffff80355b4c in db_command (cmd_table=0x0) at ../../../ddb/db_command.c:440 #5 0xffffffff803558b4 in db_command_loop () at ../../../ddb/db_command.c:493 #6 0xffffffff803583f0 in db_trap (type=, code=Unhandled dwarf expression opcode 0x93 ) at ../../../ddb/db_main.c:251 #7 0xffffffff8099f9ce in kdb_trap (type=Unhandled dwarf expression opcode 0x93 ) at ../../../kern/subr_kdb.c:654 #8 0xffffffff80d9f80b in trap (frame=0xfffffe081e022540) at ../../../amd64/amd64/trap.c:542 #9 0xffffffff80d7e4e2 in calltrap () at ../../../amd64/amd64/exception.S:235 #10 0xffffffff8099f0be in kdb_enter (why=0xffffffff81040b09 "panic", msg=0x80
) at cpufunc.h:63 #11 0xffffffff80962f39 in vpanic (fmt=, ap=) at ../../../kern/kern_shutdown.c:740 #12 0xffffffff80962fa3 in panic (fmt=0xffffffff810458ef "KDB: debugger backends:") at ../../../kern/kern_shutdown.c:676 #13 0xffffffff80bbc971 in softdep_waitidle (mp=0xfffff80012747b58, flags=0x2) at ../../../ufs/ffs/ffs_softdep.c:1944 #14 0xffffffff80bbc4b9 in softdep_flushfiles (oldmnt=0xfffff80012747b58, flags=0x2, td=0xfffff800a7337000) at ../../../ufs/ffs/ffs_softdep.c:2005 #15 0xffffffff80bed033 in ffs_unmount (mp=0xfffff80012747b58, mntflags=) at ../../../ufs/ffs/ffs_vfsops.c:1236 #16 0xffffffff80a1238c in dounmount (mp=, flags=Unhandled dwarf expression opcode 0x93 ) at ../../../kern/vfs_mount.c:1316 #17 0xffffffff80a1b721 in vfs_unmountall () at ../../../kern/vfs_subr.c:3504 #18 0xffffffff80962716 in kern_reboot (howto=Unhandled dwarf expression opcode 0x93 ) at ../../../kern/kern_shutdown.c:431 #19 0xffffffff80962218 in sys_reboot (td=, uap=) at ../../../kern/kern_shutdown.c:193 #20 0xffffffff80da074c in amd64_syscall (td=0xfffff800a7337000, traced=0x0) at subr_syscall.c:133 #21 0xffffffff80d7e7cb in Xfast_syscall () at ../../../amd64/amd64/exception.S:395 #22 0x000000080086b5ec in ?? () Previous frame inner to this frame (corrupt stack?) Current language: auto; currently minimal (kgdb) f 13 #13 0xffffffff80bbc971 in softdep_waitidle (mp=0xfffff80012747b58, flags=0x2) at ../../../ufs/ffs/ffs_softdep.c:1944 1944 panic("softdep_waitidle: Failed to flush worklist for %p\n", (kgdb) p *mp $1 = {mnt_mtx = {lock_object = {lo_name = 0xffffffff8104a9ca "struct mount mtx", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xfffffe0000b1fa80}, mtx_lock = 0x4}, mnt_gen = 0x1, mnt_list = {tqe_next = 0x0, tqe_prev = 0xffffffff81537310}, mnt_op = 0xffffffff815661e0, mnt_vfc = 0xffffffff81566300, mnt_vnodecovered = 0x0, mnt_syncer = 0x0, mnt_ref = 0x1, mnt_nvnodelist = {tqh_first = 0x0, tqh_last = 0xfffff80012747bb8}, mnt_nvnodelistsize = 0x0, mnt_activevnodelist = {tqh_first = 0x0, tqh_last = 0xfffff80012747bd0}, mnt_activevnodelistsize = 0x0, mnt_writeopcount = 0x0, mnt_kern_flag = 0x6980214d, mnt_flag = 0x205300, mnt_opt = 0xfffff8001265c1d0, mnt_optnew = 0x0, mnt_maxsymlinklen = 0x78, mnt_stat = {f_version = 0x20030518, f_type = 0x35, f_flags = 0x205300, f_bsize = 0x1000, f_iosize = 0x8000, f_blocks = 0x5f2a0dd, f_bfree = 0x3b95ac6, f_bavail = 0x33f8b59, f_files = 0x3136c7e, f_ffree = 0x2f3fb0f, f_syncwrites = 0x1, f_asyncwrites = 0x37, f_syncreads = 0x10a6, f_asyncreads = 0x10, f_spare = {0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0}, f_namemax = 0xff, f_owner = 0x0, f_fsid = {val = {0x41da6a2f, 0xdfc2e18b}}, f_charspare = '\0' , f_fstypename = "ufs", '\0' , f_mntfromname = "/dev/da0p2", '\0' , f_mntonname = "/", '\0' }, mnt_cred = 0xfffff800125b1200, mnt_data = 0xfffff8001277a000, mnt_time = 0x55082196, mnt_iosize_max = 0x20000, mnt_export = 0xfffff800a7357e00, mnt_label = 0x0, mnt_hashseed = 0xeaa83080, mnt_lockref = 0x0, mnt_secondary_writes = 0x1, mnt_secondary_accwrites = 0x88e, mnt_susp_owner = 0xfffff800a7337000, mnt_gjprovider = 0x0, mnt_explock = {lock_object = {lo_name = 0xffffffff8102a9fb "explock", lo_flags = 0x6730000, lo_data = 0x0, lo_witness = 0xfffffe0000b2b080}, lk_lock = 0x1, lk_exslpfail = 0x0, lk_timo = 0x0, lk_pri = 0x60, lk_stack = {depth = 0x6, pcs = { 0xffffffff80943da6, 0xffffffff80a0a749, 0xffffffff80a10d72, 0xffffffff80a0fc61, 0xffffffff80da074c, 0xffffffff80d7e7cb, 0x0 }}}, mnt_upper_link = {tqe_next = 0x0, tqe_prev = 0x0}, mnt_uppers = {tqh_first = 0x0, tqh_last = 0xfffff80012747f10}} (kgdb) p *ump $2 = {um_mountp = 0xfffff80012747b58, um_dev = 0xfffff800124a0600, um_cp = 0xfffff800125a6600, um_bo = 0xfffff8001274dd98, um_devvp = 0xfffff8001274dc30, um_fstype = 0x2, um_fs = 0xfffff8001277d000, um_extattr = {uepm_lock = {lock_object = { lo_name = 0xffffffff81080478 "ufs_extattr_sx", lo_flags = 0x2330000, lo_data = 0x0, lo_witness = 0xfffffe0000b2ce00}, sx_lock = 0x1}, uepm_list = {lh_first = 0x0}, uepm_ucred = 0x0, uepm_flags = 0x1}, um_nindir = 0x1000, um_bptrtodb = 0x3, um_seqinc = 0x8, um_lock = { lock_object = {lo_name = 0xffffffff8107f744 "FFS", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xfffffe0000b2cd80}, mtx_lock = 0x4}, um_fsckpid = 0x0, um_softdep = 0xfffff80012e28000, um_quotas = {0x0, 0x0}, um_cred = {0x0, 0x0}, um_btime = {0x0, 0x0}, um_itime = {0x0, 0x0}, um_qflags = "\000", um_savedmaxfilesize = 0x0, um_candelete = 0x0, um_writesuspended = 0x0, um_balloc = 0xffffffff80bb1a30 , um_blkatoff = 0xffffffff80be9200 , um_truncate = 0xffffffff80bb3ae0 , um_update = 0xffffffff80bb3760 , um_valloc = 0xffffffff80bac750 , um_vfree = 0xffffffff80bad540 , um_ifree = 0xffffffff80bedb70 , um_rdonly = 0xffffffff80bb5620 , um_snapgone = 0xffffffff80bb9090 } (kgdb) p *ump->um_softdep $3 = {sd_fslock = {lock_object = {lo_name = 0xffffffff8107bb06 "Per-Filesystem Softdep Lock", lo_flags = 0x5230000, lo_data = 0x0, lo_witness = 0xfffffe0000b2cf80}, rw_lock = 0xfffff800a7337000}, sd_workitem_pending = {lh_first = 0xfffffe081da60948}, sd_worklist_tail = 0xfffffe081da60948, sd_journal_pending = {lh_first = 0x0}, sd_journal_tail = 0x0, sd_jblocks = 0x0, sd_unlinked = { tqh_first = 0x0, tqh_last = 0xfffff80012e28048}, sd_dirtycg = {lh_first = 0x0}, sd_mkdirlisthd = {lh_first = 0x0}, sd_pdhash = 0xfffffe0003c0a000, sd_pdhashsize = 0xffff, sd_pdnextclean = 0x0, sd_idhash = 0xfffffe0003c8a000, sd_idhashsize = 0x7ffff, sd_idnextclean = 0x0, sd_newblkhash = 0xfffffe000408a000, sd_newblkhashsize = 0xfffff, sd_bmhash = 0xfffffe000488a000, sd_bmhashsize = 0x3ff, sd_indirhash = 0xfffff80012e363f0, sd_indirhashsize = 0x0, sd_on_journal = 0x0, sd_on_worklist = 0x0, sd_deps = 0xe, sd_accdeps = 0x1a5, sd_req = 0x0, sd_flags = 0x0, sd_cleanups = 0x0, sd_flushtd = 0xfffff80012b94000, sd_next = {tqe_next = 0x0, tqe_prev = 0xffffffff81805c18}, sd_ump = 0xfffff8001277a000, sd_curdeps = {0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x1, 0x0, 0x0, 0x0, 0x0, 0x0, 0xd, 0x0 }, sd_x = {lh_first = 0xfffff80006540200}} (kgdb) p ump->um_softdep->sd_x $4 = {lh_first = 0xfffff80006540200} (kgdb) p *ump->um_softdep->sd_x.lh_first $5 = {wk_list = {le_next = 0xfffff80006540300, le_prev = 0xfffff800124e7248}, wk_mp = 0xfffff80012747b58, wk_type = 0xe, wk_state = 0x1001, wk_x = { le_next = 0xfffff80006540300, le_prev = 0xfffff80012e281e8}} (kgdb) p *(struct freework *)0xfffff80006540200 $6 = {fw_list = {wk_list = {le_next = 0xfffff80006540300, le_prev = 0xfffff800124e7248}, wk_mp = 0xfffff80012747b58, wk_type = 0xe, wk_state = 0x1001, wk_x = {le_next = 0xfffff80006540300, le_prev = 0xfffff80012e281e8}}, fw_segs = {le_next = 0x7070707070707070, le_prev = 0x7070707070707070}, fw_next = {tqe_next = 0x7070707070707070, tqe_prev = 0x7070707070707070}, fw_jnewblk = 0x0, fw_freeblks = 0xfffff800124e7200, fw_parent = 0x0, fw_indir = 0x0, fw_blkno = 0xd018a0, fw_lbn = 0xfffffffffffffff4, fw_frags = 0x8, fw_ref = 0x0, fw_off = 0x0, fw_start = 0x0} (kgdb) $ svn diff -x -p /usr/src/sys Index: /usr/src/sys/ufs/ffs/ffs_softdep.c =================================================================== --- /usr/src/sys/ufs/ffs/ffs_softdep.c (revision 280133) +++ /usr/src/sys/ufs/ffs/ffs_softdep.c (working copy) @@ -1182,6 +1182,7 @@ workitem_free(item, type) KASSERT(ump->softdep_curdeps[item->wk_type] > 0, ("workitem_free: %s: softdep_curdeps[%s] going negative", ump->um_fs->fs_fsmnt, TYPENAME(item->wk_type))); + LIST_REMOVE(item, wk_x); atomic_subtract_long(&dep_current[item->wk_type], 1); ump->softdep_curdeps[item->wk_type] -= 1; free(item, DtoM(type)); @@ -1210,6 +1211,7 @@ workitem_alloc(item, type, mp) ump->softdep_curdeps[type] += 1; ump->softdep_deps++; ump->softdep_accdeps++; + LIST_INSERT_HEAD(&ump->um_softdep->sd_x, item, wk_x); FREE_LOCK(ump); } @@ -1912,10 +1914,15 @@ static int softdep_waitidle(struct mount *mp, int flags __unused) { struct ufsmount *ump; + struct vnode *devvp; + struct thread *td; int error; int i; ump = VFSTOUFS(mp); + devvp = ump->um_devvp; + td = curthread; + error = 0; ACQUIRE_LOCK(ump); for (i = 0; i < 10 && ump->softdep_deps; i++) { ump->softdep_req = 1; @@ -1922,16 +1929,22 @@ softdep_waitidle(struct mount *mp, int flags __unu KASSERT((flags & FORCECLOSE) == 0 || ump->softdep_on_worklist == 0, ("softdep_waitidle: work added after flush")); - msleep(&ump->softdep_deps, LOCK_PTR(ump), PVM, "softdeps", 1); + msleep(&ump->softdep_deps, LOCK_PTR(ump), PVM | PDROP, + "softdeps", 1); + vn_lock(devvp, LK_EXCLUSIVE | LK_RETRY); + error = VOP_FSYNC(devvp, MNT_WAIT, td); + VOP_UNLOCK(devvp, 0); + if (error != 0) + break; + ACQUIRE_LOCK(ump); } ump->softdep_req = 0; - FREE_LOCK(ump); - error = 0; - if (i == 10) { + if (i == 10 && error == 0 && ump->softdep_deps != 0) { error = EBUSY; - printf("softdep_waitidle: Failed to flush worklist for %p\n", + panic("softdep_waitidle: Failed to flush worklist for %p\n", mp); } + FREE_LOCK(ump); return (error); } @@ -2453,6 +2466,7 @@ softdep_mount(devvp, mp, fs, cred) MNT_IUNLOCK(mp); rw_init(LOCK_PTR(ump), "Per-Filesystem Softdep Lock"); sdp->sd_ump = ump; + LIST_INIT(&sdp->sd_x); LIST_INIT(&ump->softdep_workitem_pending); LIST_INIT(&ump->softdep_journal_pending); TAILQ_INIT(&ump->softdep_unlinked); @@ -7637,17 +7651,13 @@ check_inode_unwritten(inodedep) return (1); } -/* - * Try to free an inodedep structure. Return 1 if it could be freed. - */ static int -free_inodedep(inodedep) +check_inodedep_free(inodedep) struct inodedep *inodedep; { LOCK_OWNED(VFSTOUFS(inodedep->id_list.wk_mp)); - if ((inodedep->id_state & (ONWORKLIST | UNLINKED)) != 0 || - (inodedep->id_state & ALLCOMPLETE) != ALLCOMPLETE || + if ((inodedep->id_state & ALLCOMPLETE) != ALLCOMPLETE || !LIST_EMPTY(&inodedep->id_dirremhd) || !LIST_EMPTY(&inodedep->id_pendinghd) || !LIST_EMPTY(&inodedep->id_bufwait) || @@ -7662,6 +7672,21 @@ static int inodedep->id_nlinkdelta != 0 || inodedep->id_savedino1 != NULL) return (0); + return (1); +} + +/* + * Try to free an inodedep structure. Return 1 if it could be freed. + */ +static int +free_inodedep(inodedep) + struct inodedep *inodedep; +{ + + LOCK_OWNED(VFSTOUFS(inodedep->id_list.wk_mp)); + if ((inodedep->id_state & (ONWORKLIST | UNLINKED)) != 0 || + !check_inodedep_free(inodedep)) + return (0); if (inodedep->id_state & ONDEPLIST) LIST_REMOVE(inodedep, id_deps); LIST_REMOVE(inodedep, id_hash); @@ -13846,7 +13871,8 @@ softdep_check_suspend(struct mount *mp, { struct bufobj *bo; struct ufsmount *ump; - int error; + struct inodedep *inodedep; + int error, unlinked; bo = &devvp->v_bufobj; ASSERT_BO_WLOCKED(bo); @@ -13907,6 +13933,20 @@ softdep_check_suspend(struct mount *mp, break; } + unlinked = 0; + if (MOUNTEDSUJ(mp)) { + for (inodedep = TAILQ_FIRST(&ump->softdep_unlinked); + inodedep != NULL; + inodedep = TAILQ_NEXT(inodedep, id_unlinked)) { + if ((inodedep->id_state & (UNLINKED | UNLINKLINKS | + UNLINKONLIST)) != (UNLINKED | UNLINKLINKS | + UNLINKONLIST) || + !check_inodedep_free(inodedep)) + continue; + unlinked++; + } + } + /* * Reasons for needing more work before suspend: * - Dirty buffers on devvp. @@ -13916,8 +13956,8 @@ softdep_check_suspend(struct mount *mp, error = 0; if (bo->bo_numoutput > 0 || bo->bo_dirty.bv_cnt > 0 || - softdep_depcnt != 0 || - ump->softdep_deps != 0 || + softdep_depcnt != unlinked || + ump->softdep_deps != unlinked || softdep_accdepcnt != ump->softdep_accdeps || secondary_writes != 0 || mp->mnt_secondary_writes != 0 || @@ -14137,6 +14177,7 @@ db_print_ffs(struct ufsmount *ump) ump->um_mountp, ump->um_mountp->mnt_stat.f_mntonname, ump->um_devvp, ump->um_fs, ump->softdep_on_worklist, ump->softdep_deps, ump->softdep_req); + db_printf("ump = %p\n", ump); /* XXX pho */ } #endif /* DDB */ Index: /usr/src/sys/ufs/ffs/softdep.h =================================================================== --- /usr/src/sys/ufs/ffs/softdep.h (revision 280133) +++ /usr/src/sys/ufs/ffs/softdep.h (working copy) @@ -202,6 +202,7 @@ struct worklist { struct mount *wk_mp; /* Mount we live in */ unsigned int wk_type:8, /* type of request */ wk_state:24; /* state flags */ + LIST_ENTRY(worklist) wk_x; }; #define WK_DATA(wk) ((void *)(wk)) #define WK_PAGEDEP(wk) ((struct pagedep *)(wk)) @@ -1057,6 +1058,7 @@ struct mount_softdeps { TAILQ_ENTRY(mount_softdeps) sd_next; /* List of softdep filesystem */ struct ufsmount *sd_ump; /* our ufsmount structure */ u_long sd_curdeps[D_LAST + 1]; /* count of current deps */ + LIST_HEAD(, worklist) sd_x; }; /* * Flags for communicating with the syncer thread.