panic: dead bo 0xfffff8000a838b48, vmcore.18 KDB: debugger backends: ddb KDB: current backend: ddb ---<>--- Copyright (c) 1992-2019 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 13.0-CURRENT #1 r343678: Mon Feb 4 22:25:25 CET 2019 pho@mercat1.netperf.freebsd.org:/usr/src/sys/amd64/compile/PHO amd64 FreeBSD clang version 7.0.1 (tags/RELEASE_701/final 349250) (based on LLVM 7.0.1) WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. Entering uma_startup with 10 boot pages configured startup_alloc from "UMA Kegs", 8 boot pages left startup_alloc from "UMA Zones", 7 boot pages left startup_alloc from "UMA Zones", 6 boot pages left startup_alloc from "UMA Zones", 5 boot pages left startup_alloc from "UMA Zones", 4 boot pages left startup_alloc from "UMA Zones", 3 boot pages left startup_alloc from "UMA Hash", 2 boot pages left startup_alloc from "UMA Zones", 1 boot pages left Entering uma_startup1 with 0 boot pages left Entering uma_startup2 with 0 boot pages left VT(vga): resolution 640x480 CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.07-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics real memory = 34359738368 (32768 MB) avail memory = 33182691328 (31645 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 12 CPUs FreeBSD/SMP: 1 package(s) x 6 core(s) x 2 hardware threads random: unblocking device. ioapic0 irqs 0-23 on motherboard ioapic1 irqs 24-47 on motherboard Launching APs: 1 7 3 9 6 10 2 11 4 5 8 Timecounter "TSC-low" frequency 1750037120 Hz quality 1000 random: entropy device external interface [ath_hal] loaded kbd1 at kbdmux0 module_register_init: MOD_LOAD (vesa, 0xffffffff8114a690, 0) error 19 random: registering fast source Intel Secure Key RNG random: fast provider: "Intel Secure Key RNG" 000.000061 [4192] netmap_init netmap: loaded module nexus0 vtvga0: on motherboard cryptosoft0: on motherboard acpi0: on motherboard acpi0: Power Button (fixed) cpu0: on acpi0 atrtc0: port 0x70-0x71,0x74-0x77 irq 8 on acpi0 atrtc0: registered as a time-of-day clock, resolution 1.000000s Event timer "RTC" frequency 32768 Hz quality 0 attimer0: port 0x40-0x43,0x50-0x53 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Event timer "HPET" frequency 14318180 Hz quality 350 Event timer "HPET1" frequency 14318180 Hz quality 340 Event timer "HPET2" frequency 14318180 Hz quality 340 Event timer "HPET3" frequency 14318180 Hz quality 340 Event timer "HPET4" frequency 14318180 Hz quality 340 Event timer "HPET5" frequency 14318180 Hz quality 340 Event timer "HPET6" frequency 14318180 Hz quality 340 Event timer "HPET7" frequency 14318180 Hz quality 340 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 pcib0: on acpi0 pci0: on pcib0 pci0: at device 11.1 (no driver attached) pci0: at device 11.2 (no driver attached) pci0: at device 16.1 (no driver attached) pci0: at device 16.6 (no driver attached) pci0: at device 18.1 (no driver attached) acpi_syscontainer0: on acpi0 acpi_syscontainer1: on acpi0 acpi_syscontainer2: on acpi0 acpi_syscontainer3: on acpi0 pcib1: port 0xcf8-0xcff on acpi0 pci1: on pcib1 pcib2: irq 26 at device 1.0 on pci1 pci2: on pcib2 pcib3: irq 32 at device 2.0 on pci1 pci3: on pcib3 pci3: at device 0.0 (no driver attached) pci3: at device 0.1 (no driver attached) pcib4: irq 40 at device 3.0 on pci1 pci4: on pcib4 pci1: at device 17.0 (no driver attached) ahci0: port 0xf110-0xf117,0xf100-0xf103,0xf0f0-0xf0f7,0xf0e0-0xf0e3,0xf020-0xf03f mem 0xfb438000-0xfb4387ff irq 16 at device 17.4 on pci1 ahci0: AHCI v1.30 with 4 6Gbps ports, Port Multiplier not supported ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahcich2: at channel 2 on ahci0 ahcich3: at channel 3 on ahci0 ahciem0: on ahci0 xhci0: mem 0xfb400000-0xfb40ffff irq 19 at device 20.0 on pci1 xhci0: 32 bytes context size, 64-bit DMA usbus0 on xhci0 usbus0: 5.0Gbps Super Speed USB v3.0 pci1: at device 22.0 (no driver attached) pci1: at device 22.1 (no driver attached) ehci0: mem 0xfb434000-0xfb4343ff irq 18 at device 26.0 on pci1 usbus1: EHCI version 1.0 usbus1 on ehci0 usbus1: 480Mbps High Speed USB v2.0 pcib5: irq 16 at device 28.0 on pci1 pci5: on pcib5 pcib6: irq 18 at device 28.2 on pci1 pci6: on pcib6 pcib7: at device 0.0 on pci6 pci7: on pcib7 vgapci0: port 0xe000-0xe07f mem 0xfa000000-0xfaffffff,0xfb000000-0xfb01ffff irq 18 at device 0.0 on pci7 vgapci0: Boot video device pcib8: irq 16 at device 28.4 on pci1 pci8: on pcib8 igb0: port 0xd020-0xd03f mem 0xfb320000-0xfb33ffff,0xfb344000-0xfb347fff irq 16 at device 0.0 on pci8 igb0: Using 1024 tx descriptors and 1024 rx descriptors igb0: queue equality override n options=e507bb ether 0c:c4:7a:a8:cd:db media: Ethernet autoselect status: no carrier nd6 options=29 Starting devd. igb0: link state changed to UP Autoloading module: ioat.ko ioat0: mem 0xfb42c000-0xfb42ffff irq 31 at device 4.0 on pci1 ioat0: Capabilities: 2f7 ioat1: mem 0xfb428000-0xfb42bfff irq 39 at device 4.1 on pci1 ioat1: Capabilities: 2f7 ioat2: mem 0xfb424000-0xfb427fff irq 31 at device 4.2 on pci1 ioat2: Capabilities: f7 ioat3: mem 0xfb420000-0xfb423fff irq 39 at device 4.3 on pci1 ioat3: Capabilities: f7 ioat4: mem 0xfb41c000-0xfb41ffff irq 31 at device 4.4 on pci1 ioat4: Capabilities: f7 ioat5: mem 0xfb418000-0xfb41bfff irq 39 at device 4.5 on pci1 ioat5: Capabilities: f7 ioat6: mem 0xfb414000-0xfb417fff irq 31 at device 4.6 on pci1 ioat6: Capabilities: f7 ioat7: mem 0xfb410000-0xfb413fff irq 39 at device 4.7 on pci1 ioat7: Capabilities: f7 Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Starting Network: igb1. igb1: flags=8802 metric 0 mtu 1500 options=e507bb ether 0c:c4:7a:a8:cd:db media: Ethernet autoselect status: no carrier nd6 options=29 Autoloading module: uhid.ko Autoloading module: ums.ko ums0 on uhub4 ums0: on usbus0 ums0: 3 buttons and [Z] coordinates ID=0 Starting dhclient. DHCPREQUEST on igb0 to 255.255.255.255 port 67 DHCPACK from 192if_delmulti_locked: detaching ifnet instance 0xfffff80006059000 .168.5.1 bound to 192.168.5.171 -- renewal in 300 seconds. add host 127.0.0.1: gateway lo0 fib 0: route already in table add host ::1: gateway lo0 fib 0: route already in table add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Creating and/or trimming log files. Starting syslogd. Setting date via ntp. 4 Feb 22:33:33 ntpdate[2037]: step time server 192.168.5.1 offset -1.189643 sec Starting rpcbind. NFS access cache time=60 Starting watchdogd. No core dumps found. Clearing /tmp (X related). Starting statd. Starting lockd. fscklock order reversal: 1st 0xfffff8000ad7d558 ufs (ufs) @ kern/vfs_subr.c:2590 2nd 0xfffffe000088b208 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:282 3rd 0xfffff800172a07d0 ufs (ufs) @ kern/vfs_subr.c:2590 stack backtrace: #0 0xffffffff80c4a133 at witness_debugger+0x73 #1 0xffffffff80c49e83 at witness_checkorder+0xac3 #2 0xffffffff80bb62db at lockmgr_xlock_hard+0x6b #3 0xffffffff80bb6d63 at __lockmgr_args+0x5f3 #4 0xffffffff80f059dc at ffs_lock+0x7c #5 0xffffffff8124da69 at VOP_LOCK1_APV+0x1d9 #6 0xffffffff80cd30f5 at _vn_lock+0x65 #7 0xffffffff80cbbbaa at vget+0x14a #8 0xffffffff80cab65c at vfs_hash_get+0xcc #9 0xffffffff80f0131f at ffs_vgetf+0x3f #10 0xffffffff80ef6992 at softdep_sync_buf+0x382 #11 0xffffffff80f06764 at ffs_syncvnode+0x224 #12 0xffffffff80f03fad at ffs_sync+0x20d #13 0xffffffff80cb1f12 at dounmount+0x462 #14 0xffffffff80cb1a10 at sys_unmount+0x300 #15 0xffffffff810c4eb1 at amd64_syscall+0x291 #16 0xffffffff8109f17d at fast_syscall_common+0x101 lock order reversal: 1st 0xfffff8000ad53558 ufs (ufs) @ kern/vfs_mount.c:1353 2nd 0xfffff8000ad7d7d0 devfs (devfs) @ ufs/ffs/ffs_softdep.c:1914 stack backtrace: #0 0xffffffff80c4a133 at witness_debugger+0x73 #1 0xffffffff80c49e83 at witness_checkorder+0xac3 #2 0xffffffff80bb5ddb at lockmgr_lock_fast_path+0x16b #3 0xffffffff8124da69 at VOP_LOCK1_APV+0x1d9 #4 0xffffffff80cd30f5 at _vn_lock+0x65 #5 0xffffffff80ee3f8d at softdep_flushworklist+0x5d #6 0xffffffff80f041a6 at ffs_sync+0x406 #7 0xffffffff80cb1f12 at dounmount+0x462 #8 0xffffffff80cb1a10 at sys_unmount+0x300 #9 0xffffffff810c4eb1 at amd64_syscall+0x291 #10 0xffffffff8109f17d at fast_syscall_common+0x101 ** /dev/gpt/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 1668 files, 53138 used, 1212269 free (141 frags, 151516 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** Updating motd:. Mounting late filesystems:. Configuring vt: blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting cron. Mon Feb 4 22:33 FreeBSD/amd64 (mercat1.netperf.freebsd.org) (ttyu1) login: root Feb 4 22:36:41 mercat1 login[2306]: ROOT LOGIN (root) ON ttyu1 Last login: Mon Feb 4 22:23:14 on ttyu1 FreeBSD 13.0-CURRENT (PHO) #1 r343678: Mon Feb 4 22:25:25 CET 2019 root@mercat1:/stress2/misc # sh -x ./devfs4.sh + id -u + [ 0 -ne 0 ] + umount -f /dev panic: dead bo 0xfffff8000a838b48 cpuid = 1 time = 1549316213 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00b6981280 vpanic() at vpanic+0x1b4/frame 0xfffffe00b69812e0 panic() at panic+0x43/frame 0xfffffe00b6981340 buf_vlist_add() at buf_vlist_add+0x8d/frame 0xfffffe00b6981380 reassignbuf() at reassignbuf+0x157/frame 0xfffffe00b69813d0 bdirty() at bdirty+0xfe/frame 0xfffffe00b69813f0 bdwrite() at bdwrite+0x152/frame 0xfffffe00b6981440 ffs_update() at ffs_update+0x5c8/frame 0xfffffe00b6981540 ufs_inactive() at ufs_inactive+0x51c/frame 0xfffffe00b69815f0 VOP_INACTIVE_APV() at VOP_INACTIVE_APV+0x1f5/frame 0xfffffe00b6981660 VOP_INACTIVE() at VOP_INACTIVE+0x39/frame 0xfffffe00b69816a0 vinactive() at vinactive+0x19b/frame 0xfffffe00b6981700 vputx() at vputx+0x44a/frame 0xfffffe00b6981790 vput() at vput+0x1a/frame 0xfffffe00b69817b0 vn_close1() at vn_close1+0x11b/frame 0xfffffe00b6981820 vn_closefile() at vn_closefile+0x53/frame 0xfffffe00b69818a0 _fdrop() at _fdrop+0x1a/frame 0xfffffe00b69818c0 closef() at closef+0x1ec/frame 0xfffffe00b6981950 closefp() at closefp+0x9e/frame 0xfffffe00b6981990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00b6981ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00b6981ab0 --- syscall (6, FreeBSD ELF64, sys_close), rip = 0x3395da, rsp = 0x7fffffffdc18, rbp = 0x7fffffffdc40 --- KDB: enter: panic [ thread pid 2322 tid 100208 ] Stopped at kdb_enter+0x3b: movq $0,kdb_why db> run pho db:0:pho> set $lines 20000 db:0:pho> run pho1 db:1:pho1> bt Tracing pid 2322 tid 100208 td 0xfffff80017163000 kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00b6981280 vpanic() at vpanic+0x1d1/frame 0xfffffe00b69812e0 panic() at panic+0x43/frame 0xfffffe00b6981340 buf_vlist_add() at buf_vlist_add+0x8d/frame 0xfffffe00b6981380 reassignbuf() at reassignbuf+0x157/frame 0xfffffe00b69813d0 bdirty() at bdirty+0xfe/frame 0xfffffe00b69813f0 bdwrite() at bdwrite+0x152/frame 0xfffffe00b6981440 ffs_update() at ffs_update+0x5c8/frame 0xfffffe00b6981540 ufs_inactive() at ufs_inactive+0x51c/frame 0xfffffe00b69815f0 VOP_INACTIVE_APV() at VOP_INACTIVE_APV+0x1f5/frame 0xfffffe00b6981660 VOP_INACTIVE() at VOP_INACTIVE+0x39/frame 0xfffffe00b69816a0 vinactive() at vinactive+0x19b/frame 0xfffffe00b6981700 vputx() at vputx+0x44a/frame 0xfffffe00b6981790 vput() at vput+0x1a/frame 0xfffffe00b69817b0 vn_close1() at vn_close1+0x11b/frame 0xfffffe00b6981820 vn_closefile() at vn_closefile+0x53/frame 0xfffffe00b69818a0 _fdrop() at _fdrop+0x1a/frame 0xfffffe00b69818c0 closef() at closef+0x1ec/frame 0xfffffe00b6981950 closefp() at closefp+0x9e/frame 0xfffffe00b6981990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00b6981ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00b6981ab0 --- syscall (6, FreeBSD ELF64, sys_close), rip = 0x3395da, rsp = 0x7fffffffdc18, rbp = 0x7fffffffdc40 --- db:1:pho1> show allpcpu Current CPU: 1 cpuid = 0 dynamic pcpu = 0xd64680 curthread = 0xfffff800036bf000: pid 11 tid 100003 "idle: cpu0" curpcb = 0xfffffe0076766b80 fpcurthread = none idlethread = 0xfffff800036bf000: tid 100003 "idle: cpu0" curpmap = 0xffffffff82094cd8 tssp = 0xffffffff821cc3a0 commontssp = 0xffffffff821cc3a0 rsp0 = 0xfffffe0076766b80 gs32p = 0xffffffff821d2fd8 ldt = 0xffffffff821d3018 tss = 0xffffffff821d3008 tlb gen = 2631 curvnet = 0 spin locks held: cpuid = 1 dynamic pcpu = 0xfffffe0084fdd680 curthread = 0xfffff80017163000: pid 2322 tid 100208 "init" curpcb = 0xfffffe00b6981b80 fpcurthread = 0xfffff80017163000: pid 2322 "init" idlethread = 0xfffff800036be5a0: tid 100004 "idle: cpu1" curpmap = 0xfffff800173f7130 tssp = 0xffffffff821cc408 commontssp = 0xffffffff821cc408 rsp0 = 0xfffffe00b6981b80 gs32p = 0xffffffff821d3040 ldt = 0xffffffff821d3080 tss = 0xffffffff821d3070 tlb gen = 2642 curvnet = 0 spin locks held: cpuid = 2 dynamic pcpu = 0xfffffe0084fe9680 curthread = 0xfffff800036bf5a0: pid 1 tid 100002 "init" curpcb = 0xfffffe0076761b80 fpcurthread = none idlethread = 0xfffff800036be000: tid 100005 "idle: cpu2" curpmap = 0xfffff800036c7130 tssp = 0xffffffff821cc470 commontssp = 0xffffffff821cc470 rsp0 = 0xfffffe0076761b80 gs32p = 0xffffffff821d30a8 ldt = 0xffffffff821d30e8 tss = 0xffffffff821d30d8 tlb gen = 2642 curvnet = 0 spin locks held: cpuid = 3 dynamic pcpu = 0xfffffe0084ff5680 curthread = 0xfffff800036bd5a0: pid 11 tid 100006 "idle: cpu3" curpcb = 0xfffffe0076775b80 fpcurthread = none idlethread = 0xfffff800036bd5a0: tid 100006 "idle: cpu3" curpmap = 0xffffffff82094cd8 tssp = 0xffffffff821cc4d8 commontssp = 0xffffffff821cc4d8 rsp0 = 0xfffffe0076775b80 gs32p = 0xffffffff821d3110 ldt = 0xffffffff821d3150 tss = 0xffffffff821d3140 tlb gen = 2642 curvnet = 0 spin locks held: cpuid = 4 dynamic pcpu = 0xfffffe0085001680 curthread = 0xfffff80060c9e5a0: pid 2325 tid 100215 "init" curpcb = 0xfffffe00b69a4b80 fpcurthread = 0xfffff80060c9e5a0: pid 2325 "init" idlethread = 0xfffff800036bd000: tid 100007 "idle: cpu4" curpmap = 0xfffff800173c0130 tssp = 0xffffffff821cc540 commontssp = 0xffffffff821cc540 rsp0 = 0xfffffe00b69a4b80 gs32p = 0xffffffff821d3178 ldt = 0xffffffff821d31b8 tss = 0xffffffff821d31a8 tlb gen = 2642 curvnet = 0 spin locks held: cpuid = 5 dynamic pcpu = 0xfffffe008500d680 curthread = 0xfffff800036bc5a0: pid 11 tid 100008 "idle: cpu5" curpcb = 0xfffffe007677fb80 fpcurthread = none idlethread = 0xfffff800036bc5a0: tid 100008 "idle: cpu5" curpmap = 0xffffffff82094cd8 tssp = 0xffffffff821cc5a8 commontssp = 0xffffffff821cc5a8 rsp0 = 0xfffffe007677fb80 gs32p = 0xffffffff821d31e0 ldt = 0xffffffff821d3220 tss = 0xffffffff821d3210 tlb gen = 2642 curvnet = 0 spin locks held: cpuid = 6 dynamic pcpu = 0xfffffe0085019680 curthread = 0xfffff800036bc000: pid 11 tid 100009 "idle: cpu6" curpcb = 0xfffffe0076784b80 fpcurthread = none idlethread = 0xfffff800036bc000: tid 100009 "idle: cpu6" curpmap = 0xffffffff82094cd8 tssp = 0xffffffff821cc610 commontssp = 0xffffffff821cc610 rsp0 = 0xfffffe0076784b80 gs32p = 0xffffffff821d3248 ldt = 0xffffffff821d3288 tss = 0xffffffff821d3278 tlb gen = 2642 curvnet = 0 spin locks held: cpuid = 7 dynamic pcpu = 0xfffffe0085025680 curthread = 0xfffff800036d05a0: pid 11 tid 100010 "idle: cpu7" curpcb = 0xfffffe0076789b80 fpcurthread = none idlethread = 0xfffff800036d05a0: tid 100010 "idle: cpu7" curpmap = 0xffffffff82094cd8 tssp = 0xffffffff821cc678 commontssp = 0xffffffff821cc678 rsp0 = 0xfffffe0076789b80 gs32p = 0xffffffff821d32b0 ldt = 0xffffffff821d32f0 tss = 0xffffffff821d32e0 tlb gen = 2642 curvnet = 0 spin locks held: cpuid = 8 dynamic pcpu = 0xfffffe0085031680 curthread = 0xfffff800036d0000: pid 11 tid 100011 "idle: cpu8" curpcb = 0xfffffe007678eb80 fpcurthread = none idlethread = 0xfffff800036d0000: tid 100011 "idle: cpu8" curpmap = 0xffffffff82094cd8 tssp = 0xffffffff821cc6e0 commontssp = 0xffffffff821cc6e0 rsp0 = 0xfffffe007678eb80 gs32p = 0xffffffff821d3318 ldt = 0xffffffff821d3358 tss = 0xffffffff821d3348 tlb gen = 2642 curvnet = 0 spin locks held: cpuid = 9 dynamic pcpu = 0xfffffe008503d680 curthread = 0xfffff800036cf5a0: pid 11 tid 100012 "idle: cpu9" curpcb = 0xfffffe0076793b80 fpcurthread = none idlethread = 0xfffff800036cf5a0: tid 100012 "idle: cpu9" curpmap = 0xffffffff82094cd8 tssp = 0xffffffff821cc748 commontssp = 0xffffffff821cc748 rsp0 = 0xfffffe0076793b80 gs32p = 0xffffffff821d3380 ldt = 0xffffffff821d33c0 tss = 0xffffffff821d33b0 tlb gen = 2642 curvnet = 0 spin locks held: cpuid = 10 dynamic pcpu = 0xfffffe0085049680 curthread = 0xfffff800036cf000: pid 11 tid 100013 "idle: cpu10" curpcb = 0xfffffe0076798b80 fpcurthread = none idlethread = 0xfffff800036cf000: tid 100013 "idle: cpu10" curpmap = 0xffffffff82094cd8 tssp = 0xffffffff821cc7b0 commontssp = 0xffffffff821cc7b0 rsp0 = 0xfffffe0076798b80 gs32p = 0xffffffff821d33e8 ldt = 0xffffffff821d3428 tss = 0xffffffff821d3418 tlb gen = 2642 curvnet = 0 spin locks held: cpuid = 11 dynamic pcpu = 0xfffffe0085055680 curthread = 0xfffff800171625a0: pid 2324 tid 100209 "init" curpcb = 0xfffffe00b6986b80 fpcurthread = 0xfffff800171625a0: pid 2324 "init" idlethread = 0xfffff800036ce5a0: tid 100014 "idle: cpu11" curpmap = 0xfffff80017018130 tssp = 0xffffffff821cc818 commontssp = 0xffffffff821cc818 rsp0 = 0xfffffe00b6986b80 gs32p = 0xffffffff821d3450 ldt = 0xffffffff821d3490 tss = 0xffffffff821d3480 tlb gen = 2642 curvnet = 0 spin locks held: db:1:pho1> show alllocks Process 2325 (init) thread 0xfffff80060c9e5a0 (100215) exclusive sleep mutex process lock (process lock) r = 0 (0xfffff80060c7e650) locked @ kern/subr_trap.c:117 Process 2324 (init) thread 0xfffff800171625a0 (100209) exclusive rw vm object (vm object) r = 0 (0xfffff8001726ab00) locked @ vm/vm_object.c:543 shared sx vm map (user) (vm map (user)) r = 0 (0xfffff80017018078) locked @ vm/vm_map.c:4076 Process 2323 (init) thread 0xfffff80060c9e000 (100216) shared lockmgr ufs (ufs) r = 0 (0xfffff8000a838068) locked @ kern/vfs_subr.c:2590 Process 2322 (init) thread 0xfffff80017163000 (100208) exclusive rw bufobj interlock (bufobj interlock) r = 0 (0xfffff8000a838b48) locked @ kern/vfs_subr.c:2422 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe00008fa5b0) locked @ kern/vfs_bio.c:1660 exclusive lockmgr ufs (ufs) r = 0 (0xfffff8000acc8068) locked @ kern/vfs_vnops.c:449 Process 2321 (umount) thread 0xfffff8000ad2a000 (100168) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe00008ca4f0) locked @ kern/vfs_bio.c:1660 exclusive lockmgr ufs (ufs) r = 0 (0xfffff80017026cc0) locked @ kern/vfs_subr.c:2753 Process 1 (init) thread 0xfffff800036bf5a0 (100002) exclusive rw vm object (vm object) r = 0 (0xfffff80017000100) locked @ vm/vm_fault.c:1069 shared sx vm map (user) (vm map (user)) r = 0 (0xfffff800036c7078) locked @ vm/vm_map.c:4076 db:1:pho1> show lockedvnods Locked vnodes vnode 0xfffff8000a838000: tag ufs, type VDIR usecount 1, writecount 0, refcount 4 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff8000366b500 ref 0 pages 1 cleanbuf 1 dirtybuf 0 lock type ufs: SHARED (count 1) #0 0xffffffff80bb620c at lockmgr_slock_hard+0x34c #1 0xffffffff80bb6eb5 at __lockmgr_args+0x745 #2 0xffffffff80f059dc at ffs_lock+0x7c #3 0xffffffff8124da69 at VOP_LOCK1_APV+0x1d9 #4 0xffffffff80cd30f5 at _vn_lock+0x65 #5 0xffffffff80cbbbaa at vget+0x14a #6 0xffffffff80c9f0b2 at cache_lookup+0x582 #7 0xffffffff80ca3d9c at vfs_cache_lookup+0xac #8 0xffffffff812479dc at VOP_LOOKUP_APV+0x1ec #9 0xffffffff80cadbd1 at lookup+0x601 #10 0xffffffff80cad04d at namei+0x4fd #11 0xffffffff80cccd54 at kern_statat+0x84 #12 0xffffffff80ccd52f at sys_fstatat+0x2f #13 0xffffffff810c4eb1 at amd64_syscall+0x291 #14 0xffffffff8109f17d at fast_syscall_common+0x101 ino 75601152, on dev gpt/work vnode 0xfffff8000acc8000: tag ufs, type VREG usecount 0, writecount 0, refcount 4 flags (VI_ACTIVE|VI_DOINGINACT) v_object 0xfffff8000acc3000 ref 0 pages 4 cleanbuf 1 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff80017163000 (pid 2322, init, tid 100208) with shared waiters pending #0 0xffffffff80bb620c at lockmgr_slock_hard+0x34c #1 0xffffffff80bb6eb5 at __lockmgr_args+0x745 #2 0xffffffff80f059dc at ffs_lock+0x7c #3 0xffffffff8124da69 at VOP_LOCK1_APV+0x1d9 #4 0xffffffff80cd30f5 at _vn_lock+0x65 #5 0xffffffff80cd3243 at vn_close1+0x73 #6 0xffffffff80cd2083 at vn_closefile+0x53 #7 0xffffffff80b89e3a at _fdrop+0x1a #8 0xffffffff80b8cf4c at closef+0x1ec #9 0xffffffff80b8a37e at closefp+0x9e #10 0xffffffff810c4eb1 at amd64_syscall+0x291 #11 0xffffffff8109f17d at fast_syscall_common+0x101 ino 75601226, on dev gpt/work vnode 0xfffff80017026c58: tag ufs, type VREG usecount 0, writecount 0, refcount 3 flags (VI_ACTIVE|VI_DOINGINACT) v_object 0xfffff8000ad49200 ref 0 pages 7 cleanbuf 1 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff8000ad2a000 (pid 2321, umount, tid 100168) #0 0xffffffff80bb660e at lockmgr_xlock_hard+0x39e #1 0xffffffff80bb6d63 at __lockmgr_args+0x5f3 #2 0xffffffff80f059dc at ffs_lock+0x7c #3 0xffffffff8124da69 at VOP_LOCK1_APV+0x1d9 #4 0xffffffff80cd30f5 at _vn_lock+0x65 #5 0xffffffff80cbc8f8 at vputx+0x288 #6 0xffffffff80cbc66a at vrele+0x1a #7 0xffffffff80b9c124 at exit1+0x5d4 #8 0xffffffff80b9bb4d at sys_sys_exit+0xd #9 0xffffffff810c4eb1 at amd64_syscall+0x291 #10 0xffffffff8109f17d at fast_syscall_common+0x101 ino 90528808, on dev gpt/work db:1:pho1> show allchains chain 1: thread 100216 (pid 2323, init) blocked on lockmgr ufsEXCL thread 100208 (pid 2322, init) running on CPU 1 chain 2: thread 100168 (pid 2321, umount) sleeping on 0xfffffe00008ca470 "biord" chain 3: thread 100218 (pid 2319, sh) sleeping on 0xfffff80060c60530 "wait" chain 4: thread 100181 (pid 2315, csh) sleeping on 0xfffff80017213b08 "pause" chain 5: thread 100217 (pid 2306, login) sleeping on 0xfffff80060c7da60 "wait" chain 6: thread 100191 (pid 2251, cron) sleeping on 0xffffffff81e9cfb7 "nanslp" chain 7: thread 100170 (pid 2247, sshd) sleeping on 0xfffff80003d94340 "select" chain 8: thread 100156 (pid 2168, NLM: master) sleeping on 0xfffff80006053260 "rpcsvc" chain 9: thread 100197 (pid 2165, rpc.statd) sleeping on 0xfffff8000a655440 "select" chain 10: thread 100165 (pid 2119, watchdogd) sleeping on 0xffffffff81e9cfb6 "nanslp" chain 11: thread 100194 (pid 2040, rpcbind) sleeping on 0xfffff800061a8c40 "select" chain 12: thread 100166 (pid 2030, syslogd) sleeping on 0xfffff8000a37ed40 "select" chain 13: thread 100169 (pid 1959, devd) sleeping on 0xfffff8000a37e2c0 "select" chain 14: thread 100176 (pid 1954, dhclient) sleeping on 0xfffff8000a540ec0 "select" chain 15: thread 100152 (pid 1910, dhclient) sleeping on 0xfffff800061a9040 "select" chain 16: thread 100141 (pid 34, vnlru) sleeping on 0xfffff8000a434a60 "vlruwt" chain 17: thread 100140 (pid 33, syncer) sleeping on 0xffffffff8203f400 "syncer" chain 18: thread 100131 (pid 32, bufdaemon) sleeping on 0xffffffff8203e8a8 "qsleep" chain 19: thread 100133 (pid 32, bufspacedaemon-0) sleeping on 0xffffffff81a0a880 "-" chain 20: thread 100134 (pid 32, bufspacedaemon-1) sleeping on 0xffffffff81a12b40 "-" chain 21: thread 100135 (pid 32, bufspacedaemon-2) sleeping on 0xffffffff81a1ae00 "-" chain 22: thread 100136 (pid 32, bufspacedaemon-3) sleeping on 0xffffffff81a230c0 "-" chain 23: thread 100137 (pid 32, bufspacedaemon-4) sleeping on 0xffffffff81a2b380 "-" chain 24: thread 100138 (pid 32, bufspacedaemon-5) sleeping on 0xffffffff81a33640 "-" chain 25: thread 100139 (pid 32, bufspacedaemon-6) sleeping on 0xffffffff81a3b900 "-" chain 26: thread 100154 (pid 32, / worker) sleeping on 0xfffff8000ad380e8 "sdflush" chain 27: thread 100205 (pid 32, /tmp worker) sleeping on 0xfffff8000a4bece8 "sdflush" chain 28: thread 100129 (pid 31, vmdaemon) sleeping on 0xffffffff8205b708 "psleep" chain 29: thread 100128 (pid 30, dom0) sleeping on 0xffffffff820c54d8 "psleep" chain 30: thread 100130 (pid 30, laundry: dom0) sleeping on 0xffffffff820c54e4 "launds" chain 31: thread 100132 (pid 30, uma) sleeping on 0xffffffff80f23850 "umarcl" chain 32: thread 100127 (pid 29, enc_daemon1) sleeping on 0xfffff8000a32c000 "idle" chain 33: thread 100126 (pid 28, enc_daemon0) sleeping on 0xfffff8000a32c530 "idle" chain 34: thread 100120 (pid 27, rand_harvestq) sleeping on 0xffffffff81cfc628 "-" chain 35: thread 100119 (pid 26, sctp_iterator) sleeping on 0xffffffff820c3bc0 "waiting_for_work" chain 36: thread 100118 (pid 25, soaiod4) sleeping on 0xffffffff8203e29c "-" chain 37: thread 100117 (pid 24, soaiod3) sleeping on 0xffffffff8203e29c "-" chain 38: thread 100116 (pid 23, soaiod2) sleeping on 0xffffffff8203e29c "-" chain 39: thread 100115 (pid 22, soaiod1) sleeping on 0xffffffff8203e29c "-" chain 40: thread 100096 (pid 21, usbus0) sleeping on 0xfffffe009a1aa460 "-" chain 41: thread 100097 (pid 21, usbus0) sleeping on 0xfffffe009a1aa4b8 "-" chain 42: thread 100098 (pid 21, usbus0) sleeping on 0xfffffe009a1aa510 "-" chain 43: thread 100099 (pid 21, usbus0) sleeping on 0xfffffe009a1aa568 "-" chain 44: thread 100100 (pid 21, usbus0) sleeping on 0xfffffe009a1aa5c0 "-" chain 45: thread 100102 (pid 21, usbus1) sleeping on 0xfffffe0006dd6d10 "-" chain 46: thread 100103 (pid 21, usbus1) sleeping on 0xfffffe0006dd6d68 "-" chain 47: thread 100104 (pid 21, usbus1) sleeping on 0xfffffe0006dd6dc0 "-" chain 48: thread 100105 (pid 21, usbus1) sleeping on 0xfffffe0006dd6e18 "-" chain 49: thread 100106 (pid 21, usbus1) sleeping on 0xfffffe0006dd6e70 "-" chain 50: thread 100107 (pid 21, usbus2) sleeping on 0xfffffe009a63bd10 "-" chain 51: thread 100108 (pid 21, usbus2) sleeping on 0xfffffe009a63bd68 "-" chain 52: thread 100109 (pid 21, usbus2) sleeping on 0xfffffe009a63bdc0 "-" chain 53: thread 100110 (pid 21, usbus2) sleeping on 0xfffffe009a63be18 "-" chain 54: thread 100111 (pid 21, usbus2) sleeping on 0xfffffe009a63be70 "-" chain 55: thread 100091 (pid 20, doneq0) sleeping on 0xffffffff81bd78c0 "-" chain 56: thread 100092 (pid 20, doneq1) sleeping on 0xffffffff81bd7940 "-" chain 57: thread 100093 (pid 20, doneq2) sleeping on 0xffffffff81bd79c0 "-" chain 58: thread 100125 (pid 20, scanner) sleeping on 0xffffffff81bd7788 "-" chain 59: thread 100090 (pid 19, crypto returns 11) sleeping on 0xfffff8000394cc50 "crypto_ret_wait" chain 60: thread 100089 (pid 18, crypto returns 10) sleeping on 0xfffff8000394cbf0 "crypto_ret_wait" chain 61: thread 100088 (pid 17, crypto returns 9) sleeping on 0xfffff8000394cb90 "crypto_ret_wait" chain 62: thread 100087 (pid 16, crypto returns 8) sleeping on 0xfffff8000394cb30 "crypto_ret_wait" chain 63: thread 100086 (pid 15, crypto returns 7) sleeping on 0xfffff8000394cad0 "crypto_ret_wait" chain 64: thread 100085 (pid 9, crypto returns 6) sleeping on 0xfffff8000394ca70 "crypto_ret_wait" chain 65: thread 100084 (pid 8, crypto returns 5) sleeping on 0xfffff8000394ca10 "crypto_ret_wait" chain 66: thread 100083 (pid 7, crypto returns 4) sleeping on 0xfffff8000394c9b0 "crypto_ret_wait" chain 67: thread 100082 (pid 6, crypto returns 3) sleeping on 0xfffff8000394c950 "crypto_ret_wait" chain 68: thread 100081 (pid 5, crypto returns 2) sleeping on 0xfffff8000394c8f0 "crypto_ret_wait" chain 69: thread 100080 (pid 4, crypto returns 1) sleeping on 0xfffff8000394c890 "crypto_ret_wait" chain 70: thread 100079 (pid 3, crypto returns 0) sleeping on 0xfffff8000394c830 "crypto_ret_wait" chain 71: thread 100078 (pid 2, crypto) sleeping on 0xffffffff82055d10 "crypto_wait" chain 72: thread 100065 (pid 14, sequencer 00) sleeping on 0xfffff800038f9c88 "seqstate" chain 73: thread 100061 (pid 13, g_event) sleeping on 0xffffffff82094080 "-" chain 74: thread 100062 (pid 13, g_up) sleeping on 0xffffffff82094090 "-" chain 75: thread 100063 (pid 13, g_down) sleeping on 0xffffffff82094078 "-" chain 76: thread 100001 (pid 10, audit) sleeping on 0xffffffff820c48e0 "audit_worker_cv" chain 77: thread 100000 (pid 0, swapper) sleeping on 0xffffffff820940c0 "swapin" chain 78: thread 100016 (pid 0, config_0) sleeping on 0xfffff80003710000 "-" chain 79: thread 100017 (pid 0, kqueue_ctx taskq) sleeping on 0xfffff80003684c00 "-" chain 80: thread 100018 (pid 0, aiod_kick taskq) sleeping on 0xfffff80003684b00 "-" chain 81: thread 100021 (pid 0, thread taskq) sleeping on 0xfffff80003684800 "-" chain 82: thread 100022 (pid 0, if_config_tqg_0) sleeping on 0xfffff8000370fe00 "-" chain 83: thread 100023 (pid 0, softirq_0) sleeping on 0xfffff8000370fd00 "-" chain 84: thread 100024 (pid 0, softirq_1) sleeping on 0xfffff8000370fc00 "-" chain 85: thread 100025 (pid 0, softirq_2) sleeping on 0xfffff8000370fb00 "-" chain 86: thread 100026 (pid 0, softirq_3) sleeping on 0xfffff8000370fa00 "-" chain 87: thread 100027 (pid 0, softirq_4) sleeping on 0xfffff8000370f900 "-" chain 88: thread 100028 (pid 0, softirq_5) sleeping on 0xfffff8000370f800 "-" chain 89: thread 100029 (pid 0, softirq_6) sleeping on 0xfffff8000370f700 "-" chain 90: thread 100030 (pid 0, softirq_7) sleeping on 0xfffff8000370f600 "-" chain 91: thread 100031 (pid 0, softirq_8) sleeping on 0xfffff8000370f500 "-" chain 92: thread 100032 (pid 0, softirq_9) sleeping on 0xfffff8000370f400 "-" chain 93: thread 100033 (pid 0, softirq_10) sleeping on 0xfffff8000370f300 "-" chain 94: thread 100034 (pid 0, softirq_11) sleeping on 0xfffff8000370f200 "-" chain 95: thread 100035 (pid 0, if_io_tqg_0) sleeping on 0xfffff8000370f100 "-" chain 96: thread 100036 (pid 0, if_io_tqg_1) sleeping on 0xfffff8000370f000 "-" chain 97: thread 100037 (pid 0, if_io_tqg_2) sleeping on 0xfffff8000370ee00 "-" chain 98: thread 100038 (pid 0, if_io_tqg_3) sleeping on 0xfffff8000370ed00 "-" chain 99: thread 100039 (pid 0, if_io_tqg_4) sleeping on 0xfffff8000370ec00 "-" chain 100: thread 100040 (pid 0, if_io_tqg_5) sleeping on 0xfffff8000370eb00 "-" chain 101: thread 100041 (pid 0, if_io_tqg_6) sleeping on 0xfffff8000370ea00 "-" chain 102: thread 100042 (pid 0, if_io_tqg_7) sleeping on 0xfffff8000370e900 "-" chain 103: thread 100043 (pid 0, if_io_tqg_8) sleeping on 0xfffff8000370e800 "-" chain 104: thread 100044 (pid 0, if_io_tqg_9) sleeping on 0xfffff8000370e700 "-" chain 105: thread 100045 (pid 0, if_io_tqg_10) sleeping on 0xfffff8000370e600 "-" chain 106: thread 100046 (pid 0, if_io_tqg_11) sleeping on 0xfffff8000370e500 "-" chain 107: thread 100064 (pid 0, firmware taskq) sleeping on 0xfffff80003883000 "-" chain 108: thread 100066 (pid 0, crypto_0) sleeping on 0xfffff80003882d00 "-" chain 109: thread 100067 (pid 0, crypto_1) sleeping on 0xfffff80003882d00 "-" chain 110: thread 100068 (pid 0, crypto_2) sleeping on 0xfffff80003882d00 "-" chain 111: thread 100069 (pid 0, crypto_3) sleeping on 0xfffff80003882d00 "-" chain 112: thread 100070 (pid 0, crypto_4) sleeping on 0xfffff80003882d00 "-" chain 113: thread 100071 (pid 0, crypto_5) sleeping on 0xfffff80003882d00 "-" chain 114: thread 100072 (pid 0, crypto_6) sleeping on 0xfffff80003882d00 "-" chain 115: thread 100073 (pid 0, crypto_7) sleeping on 0xfffff80003882d00 "-" chain 116: thread 100074 (pid 0, crypto_8) sleeping on 0xfffff80003882d00 "-" chain 117: thread 100075 (pid 0, crypto_9) sleeping on 0xfffff80003882d00 "-" chain 118: thread 100076 (pid 0, crypto_10) sleeping on 0xfffff80003882d00 "-" chain 119: thread 100077 (pid 0, crypto_11) sleeping on 0xfffff80003882d00 "-" chain 120: thread 100114 (pid 0, mca taskq) blocked on lockmgr (null)EXCL KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00b6980990 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00b69809a0 trap() at trap+0x5b/frame 0xfffffe00b6980ab0 calltrap() at calltrap+0x8/frame 0xfffffe00b6980ab0 --- trap 0xc, rip = 0xffffffff80c41f5a, rsp = 0xfffffe00b6980b80, rbp = 0xfffffe00b6980ba0 --- print_lockchain() at print_lockchain+0x3a/frame 0xfffffe00b6980ba0 db_show_allchains() at db_show_allchains+0x80/frame 0xfffffe00b6980bd0 db_command() at db_command+0x279/frame 0xfffffe00b6980ca0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00b6980d40 db_command() at db_command+0x279/frame 0xfffffe00b6980e10 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00b6980eb0 db_command() at db_command+0x279/frame 0xfffffe00b6980f80 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00b6980f90 db_trap() at db_trap+0xef/frame 0xfffffe00b6981020 kdb_trap() at kdb_trap+0x174/frame 0xfffffe00b6981090 trap() at trap+0x80b/frame 0xfffffe00b69811a0 calltrap() at calltrap+0x8/frame 0xfffffe00b69811a0 --- trap 0x3, rip = 0xffffffff80c296cb, rsp = 0xfffffe00b6981270, rbp = 0xfffffe00b6981280 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00b6981280 vpanic() at vpanic+0x1d1/frame 0xfffffe00b69812e0 panic() at panic+0x43/frame 0xfffffe00b6981340 buf_vlist_add() at buf_vlist_add+0x8d/frame 0xfffffe00b6981380 reassignbuf() at reassignbuf+0x157/frame 0xfffffe00b69813d0 bdirty() at bdirty+0xfe/frame 0xfffffe00b69813f0 bdwrite() at bdwrite+0x152/frame 0xfffffe00b6981440 ffs_update() at ffs_update+0x5c8/frame 0xfffffe00b6981540 ufs_inactive() at ufs_inactive+0x51c/frame 0xfffffe00b69815f0 VOP_INACTIVE_APV() at VOP_INACTIVE_APV+0x1f5/frame 0xfffffe00b6981660 VOP_INACTIVE() at VOP_INACTIVE+0x39/frame 0xfffffe00b69816a0 vinactive() at vinactive+0x19b/frame 0xfffffe00b6981700 vputx() at vputx+0x44a/frame 0xfffffe00b6981790 vput() at vput+0x1a/frame 0xfffffe00b69817b0 vn_close1() at vn_close1+0x11b/frame 0xfffffe00b6981820 vn_closefile() at vn_closefile+0x53/frame 0xfffffe00b69818a0 _fdrop() at _fdrop+0x1a/frame 0xfffffe00b69818c0 closef() at closef+0x1ec/frame 0xfffffe00b6981950 closefp() at closefp+0x9e/frame 0xfffffe00b6981990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00b6981ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00b6981ab0 --- syscall (6, FreeBSD ELF64, sys_close), rip = 0x3395da, rsp = 0x7fffffffdc18, rbp = 0x7fffffffdc40 --- Script command 'show allchains' returned error db:1:pho1> show mount 0xfffff8000a835000 /dev/gpt/work on / (ufs) 0xfffff80060a68000 /dev/gpt/tmp on /tmp (ufs) More info: show mount db:1:pho1> show bufqueues bqempty: 104774 Buf domain 0 freebufs 15019 lofreebufs 219 hifreebufs 329 bufspace 2011136 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 25 (663552) dirtyq count 0 (0) wakeup 0 lim 25 CPU 2, 3, 4, 23, 5, 1, 3, 1, 15, 7, 20, 5, Locked buffers: 0 space 0 Total buffers: 132 space 2011136 Buf domain 1 freebufs 14975 lofreebufs 219 hifreebufs 329 bufspace 3563520 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 1 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 82 (2347008) dirtyq count 1 (4096) wakeup 0 lim 25 CPU 8, 1, 0, 23, 4, 3, 0, 0, 13, 2, 17, 2, Locked buffers: 2 space 65536 Total buffers: 257 space 3563520 Buf domain 2 freebufs 15017 lofreebufs 219 hifreebufs 329 bufspace 2301952 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 2 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 25 (790528) dirtyq count 2 (36864) wakeup 0 lim 25 CPU 6, 4, 1, 24, 2, 13, 2, 4, 12, 4, 13, 4, Locked buffers: 0 space 0 Total buffers: 117 space 2301952 Buf domain 3 freebufs 14996 lofreebufs 219 hifreebufs 329 bufspace 2789376 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 2 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 49 (937984) dirtyq count 2 (8192) wakeup 0 lim 25 CPU 17, 4, 7, 0, 18, 0, 3, 5, 8, 7, 15, 2, Locked buffers: 0 space 0 Total buffers: 138 space 2789376 Buf domain 4 freebufs 15039 lofreebufs 219 hifreebufs 329 bufspace 1269760 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 2 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 0 (0) dirtyq count 2 (28672) wakeup 0 lim 25 CPU 7, 9, 6, 24, 3, 10, 4, 2, 13, 2, 9, 3, Locked buffers: 0 space 0 Total buffers: 95 space 1269760 Buf domain 5 freebufs 14926 lofreebufs 219 hifreebufs 329 bufspace 5099520 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 123 (3162112) dirtyq count 0 (0) wakeup 0 lim 25 CPU 5, 9, 14, 2, 15, 14, 8, 1, 1, 2, 8, 5, Locked buffers: 0 space 0 Total buffers: 230 space 5099520 Buf domain 6 freebufs 15032 lofreebufs 219 hifreebufs 329 bufspace 1634304 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 50 (778240) dirtyq count 0 (0) wakeup 0 lim 25 CPU 3, 4, 8, 1, 4, 1, 5, 0, 8, 8, 7, 2, Locked buffers: 0 space 0 Total buffers: 102 space 1634304 db:1:pho1> show page vm_cnt.v_free_count: 8013800 vm_cnt.v_inactive_count: 284 vm_cnt.v_active_count: 5135 vm_cnt.v_laundry_count: 0 vm_cnt.v_wire_count: 106190 vm_cnt.v_free_reserved: 10649 vm_cnt.v_free_min: 51289 vm_cnt.v_free_target: 173209 vm_cnt.v_inactive_target: 259813 db:1:pho1> show pageq pq_free 8013800 dom 0 page_cnt 8128423 free 8013800 pq_act 5135 pq_inact 284 pq_laund 0 pq_unsw 0 db:0:pho> show freepages DOMAIN: 0 FREE LIST 0: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 001943 | 000000 11 (008192K) | 000003 | 000000 10 (004096K) | 000004 | 000000 09 (002048K) | 000007 | 000000 08 (001024K) | 000001 | 000000 07 (000512K) | 000000 | 000001 06 (000256K) | 000000 | 000001 05 (000128K) | 000000 | 000001 04 (000064K) | 000002 | 000001 03 (000032K) | 000007 | 000001 02 (000016K) | 000042 | 000007 01 (000008K) | 000080 | 000031 00 (000004K) | 000366 | 000006 FREE LIST 1: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000000 | 000000 09 (002048K) | 000000 | 000000 08 (001024K) | 000000 | 000000 07 (000512K) | 000000 | 000000 06 (000256K) | 000001 | 000000 05 (000128K) | 000001 | 000000 04 (000064K) | 000002 | 000000 03 (000032K) | 000000 | 000000 02 (000016K) | 000001 | 000000 01 (000008K) | 000000 | 000000 00 (000004K) | 000001 | 000000 db:0:pho> acttrace Tracing command init pid 2325 tid 100215 td 0xfffff80060c9e5a0 (CPU 4) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006b97df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006b97e10 trap() at trap+0x48/frame 0xfffffe0006b97f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006b97f20 --- trap 0x13, rip = 0xffffffff80bc1deb, rsp = 0xfffffe00b69a49a0, rbp = 0xfffffe00b69a49d0 --- _thread_lock() at _thread_lock+0x5b/frame 0xfffffe00b69a49d0 userret() at userret+0x6b/frame 0xfffffe00b69a4a30 fork_return() at fork_return+0x189/frame 0xfffffe00b69a4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00b69a4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00b69a4ab0 --- trap 0xc, rip = 0x2b265a, rsp = 0x7fffffffe688, rbp = 0x7fffffffe710 --- Tracing command init pid 2324 tid 100209 td 0xfffff800171625a0 (CPU 11) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006bebdf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006bebe10 trap() at trap+0x48/frame 0xfffffe0006bebf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bebf20 --- trap 0x13, rip = 0xffffffff80c4a8bb, rsp = 0xfffffe00b6986700, rbp = 0xfffffe00b6986730 --- witness_unlock() at witness_unlock+0x15b/frame 0xfffffe00b6986730 _rw_wunlock_cookie() at _rw_wunlock_cookie+0x59/frame 0xfffffe00b6986750 vm_object_deallocate() at vm_object_deallocate+0x6ed/frame 0xfffffe00b69867b0 unlock_and_deallocate() at unlock_and_deallocate+0xe6/frame 0xfffffe00b69867d0 vm_fault_hold() at vm_fault_hold+0x1ae9/frame 0xfffffe00b6986910 vm_fault() at vm_fault+0x60/frame 0xfffffe00b6986950 trap_pfault() at trap_pfault+0x189/frame 0xfffffe00b69869a0 trap() at trap+0x460/frame 0xfffffe00b6986ab0 calltrap() at calltrap+0x8/frame 0xfffffe00b6986ab0 --- trap 0xc, rip = 0x274049, rsp = 0x7fffffffd1c0, rbp = 0x7fffffffd1f0 --- Tracing command init pid 2322 tid 100208 td 0xfffff80017163000 (CPU 1) kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00b6981280 vpanic() at vpanic+0x1d1/frame 0xfffffe00b69812e0 panic() at panic+0x43/frame 0xfffffe00b6981340 buf_vlist_add() at buf_vlist_add+0x8d/frame 0xfffffe00b6981380 reassignbuf() at reassignbuf+0x157/frame 0xfffffe00b69813d0 bdirty() at bdirty+0xfe/frame 0xfffffe00b69813f0 bdwrite() at bdwrite+0x152/frame 0xfffffe00b6981440 ffs_update() at ffs_update+0x5c8/frame 0xfffffe00b6981540 ufs_inactive() at ufs_inactive+0x51c/frame 0xfffffe00b69815f0 VOP_INACTIVE_APV() at VOP_INACTIVE_APV+0x1f5/frame 0xfffffe00b6981660 VOP_INACTIVE() at VOP_INACTIVE+0x39/frame 0xfffffe00b69816a0 vinactive() at vinactive+0x19b/frame 0xfffffe00b6981700 vputx() at vputx+0x44a/frame 0xfffffe00b6981790 vput() at vput+0x1a/frame 0xfffffe00b69817b0 vn_close1() at vn_close1+0x11b/frame 0xfffffe00b6981820 vn_closefile() at vn_closefile+0x53/frame 0xfffffe00b69818a0 _fdrop() at _fdrop+0x1a/frame 0xfffffe00b69818c0 closef() at closef+0x1ec/frame 0xfffffe00b6981950 closefp() at closefp+0x9e/frame 0xfffffe00b6981990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00b6981ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00b6981ab0 --- syscall (6, FreeBSD ELF64, sys_close), rip = 0x3395da, rsp = 0x7fffffffdc18, rbp = 0x7fffffffdc40 --- Tracing command idle pid 11 tid 100003 td 0xfffff800036bf000 (CPU 0) cpustop_handler() at cpustop_handler+0x28/frame 0xffffffff8205fa70 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xffffffff8205fa90 trap() at trap+0x48/frame 0xffffffff8205fba0 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff8205fba0 --- trap 0x13, rip = 0xffffffff8122d6a6, rsp = 0xfffffe0076766900, rbp = 0xfffffe0076766900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076766900 acpi_cpu_idle() at acpi_cpu_idle+0x23f/frame 0xfffffe0076766950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076766970 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe0076766990 sched_idletd() at sched_idletd+0x482/frame 0xfffffe0076766a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076766ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076766ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffff800036bd5a0 (CPU 3) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006b8bdf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006b8be10 trap() at trap+0x48/frame 0xfffffe0006b8bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006b8bf20 --- trap 0x13, rip = 0xffffffff8122ddd6, rsp = 0xfffffe0076775980, rbp = 0xfffffe0076775990 --- cpu_idle() at cpu_idle+0xf6/frame 0xfffffe0076775990 sched_idletd() at sched_idletd+0x482/frame 0xfffffe0076775a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076775ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076775ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffff800036bc5a0 (CPU 5) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006ba3df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006ba3e10 trap() at trap+0x48/frame 0xfffffe0006ba3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006ba3f20 --- trap 0x13, rip = 0xffffffff8122ddd6, rsp = 0xfffffe007677f980, rbp = 0xfffffe007677f990 --- cpu_idle() at cpu_idle+0xf6/frame 0xfffffe007677f990 sched_idletd() at sched_idletd+0x482/frame 0xfffffe007677fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe007677fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007677fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffff800036bc000 (CPU 6) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006bafdf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006bafe10 trap() at trap+0x48/frame 0xfffffe0006baff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006baff20 --- trap 0x13, rip = 0xffffffff8122ddd6, rsp = 0xfffffe0076784980, rbp = 0xfffffe0076784990 --- cpu_idle() at cpu_idle+0xf6/frame 0xfffffe0076784990 sched_idletd() at sched_idletd+0x482/frame 0xfffffe0076784a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076784ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076784ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffff800036d05a0 (CPU 7) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006bbbdf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006bbbe10 trap() at trap+0x48/frame 0xfffffe0006bbbf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bbbf20 --- trap 0x13, rip = 0xffffffff8122ddd6, rsp = 0xfffffe0076789980, rbp = 0xfffffe0076789990 --- cpu_idle() at cpu_idle+0xf6/frame 0xfffffe0076789990 sched_idletd() at sched_idletd+0x482/frame 0xfffffe0076789a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076789ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076789ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffff800036d0000 (CPU 8) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006bc7df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006bc7e10 trap() at trap+0x48/frame 0xfffffe0006bc7f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bc7f20 --- trap 0x13, rip = 0xffffffff8122ddd6, rsp = 0xfffffe007678e980, rbp = 0xfffffe007678e990 --- cpu_idle() at cpu_idle+0xf6/frame 0xfffffe007678e990 sched_idletd() at sched_idletd+0x482/frame 0xfffffe007678ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe007678eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007678eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffff800036cf5a0 (CPU 9) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006bd3df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006bd3e10 trap() at trap+0x48/frame 0xfffffe0006bd3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bd3f20 --- trap 0x13, rip = 0xffffffff8122ddd6, rsp = 0xfffffe0076793980, rbp = 0xfffffe0076793990 --- cpu_idle() at cpu_idle+0xf6/frame 0xfffffe0076793990 sched_idletd() at sched_idletd+0x482/frame 0xfffffe0076793a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076793ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076793ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffff800036cf000 (CPU 10) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006bdfdf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006bdfe10 trap() at trap+0x48/frame 0xfffffe0006bdff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bdff20 --- trap 0x13, rip = 0xffffffff8122ddd6, rsp = 0xfffffe0076798980, rbp = 0xfffffe0076798990 --- cpu_idle() at cpu_idle+0xf6/frame 0xfffffe0076798990 sched_idletd() at sched_idletd+0x482/frame 0xfffffe0076798a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076798ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076798ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command init pid 1 tid 100002 td 0xfffff800036bf5a0 (CPU 2) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006b7fdf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006b7fe10 trap() at trap+0x48/frame 0xfffffe0006b7ff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006b7ff20 --- trap 0x13, rip = 0xffffffff80f27a11, rsp = 0xfffffe00767617e0, rbp = 0xfffffe0076761910 --- vm_fault_hold() at vm_fault_hold+0x691/frame 0xfffffe0076761910 vm_fault() at vm_fault+0x60/frame 0xfffffe0076761950 trap_pfault() at trap_pfault+0x189/frame 0xfffffe00767619a0 trap() at trap+0x460/frame 0xfffffe0076761ab0 calltrap() at calltrap+0x8/frame 0xfffffe0076761ab0 --- trap 0xc, rip = 0x24096e, rsp = 0x7fffffffe720, rbp = 0x7fffffffe770 --- db:0:pho> ps pid ppid pgrp uid state wmesg wchan cmd 2325 1 1 0 R CPU 4 init 2324 1 1 0 R CPU 11 init 2323 1 1 0 D ufs 0xfffff8000acc8068 init 2322 1 1 0 R CPU 1 init 2321 2319 2319 0 DE+ biord 0xfffffe00008ca470 umount 2319 2315 2319 0 S+ wait 0xfffff80060c60530 sh 2315 2306 2315 0 S+ pause 0xfffff80017213b08 csh 2306 1 2306 0 Ss+ wait 0xfffff80060c7da60 login 2251 1 2251 0 Ss nanslp 0xffffffff81e9cfb7 cron 2247 1 2247 0 Ss select 0xfffff80003d94340 sshd 2168 1 2168 0 Ss rpcsvc 0xfffff80006053260 NLM: master 2165 1 2165 0 Ss select 0xfffff8000a655440 rpc.statd 2119 1 2119 0 Ss nanslp 0xffffffff81e9cfb6 watchdogd 2040 1 2040 0 Ss select 0xfffff800061a8c40 rpcbind 2030 1 2030 0 Ss select 0xfffff8000a37ed40 syslogd 1959 1 1959 0 Ss select 0xfffff8000a37e2c0 devd 1954 1 1954 65 Ss select 0xfffff8000a540ec0 dhclient 1910 1 1910 0 Ss select 0xfffff800061a9040 dhclient 34 0 0 0 DL vlruwt 0xfffff8000a434a60 [vnlru] 33 0 0 0 DL syncer 0xffffffff8203f400 [syncer] 32 0 0 0 DL (threaded) [bufdaemon] 100131 D qsleep 0xffffffff8203e8a8 [bufdaemon] 100133 D - 0xffffffff81a0a880 [bufspacedaemon-0] 100134 D - 0xffffffff81a12b40 [bufspacedaemon-1] 100135 D - 0xffffffff81a1ae00 [bufspacedaemon-2] 100136 D - 0xffffffff81a230c0 [bufspacedaemon-3] 100137 D - 0xffffffff81a2b380 [bufspacedaemon-4] 100138 D - 0xffffffff81a33640 [bufspacedaemon-5] 100139 D - 0xffffffff81a3b900 [bufspacedaemon-6] 100154 D sdflush 0xfffff8000ad380e8 [/ worker] 100205 D sdflush 0xfffff8000a4bece8 [/tmp worker] 31 0 0 0 DL psleep 0xffffffff8205b708 [vmdaemon] 30 0 0 0 DL (threaded) [pagedaemon] 100128 D psleep 0xffffffff820c54d8 [dom0] 100130 D launds 0xffffffff820c54e4 [laundry: dom0] 100132 D umarcl 0xffffffff80f23850 [uma] 29 0 0 0 DL idle 0xfffff8000a32c000 [enc_daemon1] 28 0 0 0 DL idle 0xfffff8000a32c530 [enc_daemon0] 27 0 0 0 DL - 0xffffffff81cfc628 [rand_harvestq] 26 0 0 0 DL waiting 0xffffffff820c3bc0 [sctp_iterator] 25 0 0 0 DL - 0xffffffff8203e29c [soaiod4] 24 0 0 0 DL - 0xffffffff8203e29c [soaiod3] 23 0 0 0 DL - 0xffffffff8203e29c [soaiod2] 22 0 0 0 DL - 0xffffffff8203e29c [soaiod1] 21 0 0 0 DL (threaded) [usb] 100096 D - 0xfffffe009a1aa460 [usbus0] 100097 D - 0xfffffe009a1aa4b8 [usbus0] 100098 D - 0xfffffe009a1aa510 [usbus0] 100099 D - 0xfffffe009a1aa568 [usbus0] 100100 D - 0xfffffe009a1aa5c0 [usbus0] 100102 D - 0xfffffe0006dd6d10 [usbus1] 100103 D - 0xfffffe0006dd6d68 [usbus1] 100104 D - 0xfffffe0006dd6dc0 [usbus1] 100105 D - 0xfffffe0006dd6e18 [usbus1] 100106 D - 0xfffffe0006dd6e70 [usbus1] 100107 D - 0xfffffe009a63bd10 [usbus2] 100108 D - 0xfffffe009a63bd68 [usbus2] 100109 D - 0xfffffe009a63bdc0 [usbus2] 100110 D - 0xfffffe009a63be18 [usbus2] 100111 D - 0xfffffe009a63be70 [usbus2] 20 0 0 0 DL (threaded) [cam] 100091 D - 0xffffffff81bd78c0 [doneq0] 100092 D - 0xffffffff81bd7940 [doneq1] 100093 D - 0xffffffff81bd79c0 [doneq2] 100125 D - 0xffffffff81bd7788 [scanner] 19 0 0 0 DL crypto_ 0xfffff8000394cc50 [crypto returns 11] 18 0 0 0 DL crypto_ 0xfffff8000394cbf0 [crypto returns 10] 17 0 0 0 DL crypto_ 0xfffff8000394cb90 [crypto returns 9] 16 0 0 0 DL crypto_ 0xfffff8000394cb30 [crypto returns 8] 15 0 0 0 DL crypto_ 0xfffff8000394cad0 [crypto returns 7] 9 0 0 0 DL crypto_ 0xfffff8000394ca70 [crypto returns 6] 8 0 0 0 DL crypto_ 0xfffff8000394ca10 [crypto returns 5] 7 0 0 0 DL crypto_ 0xfffff8000394c9b0 [crypto returns 4] 6 0 0 0 DL crypto_ 0xfffff8000394c950 [crypto returns 3] 5 0 0 0 DL crypto_ 0xfffff8000394c8f0 [crypto returns 2] 4 0 0 0 DL crypto_ 0xfffff8000394c890 [crypto returns 1] 3 0 0 0 DL crypto_ 0xfffff8000394c830 [crypto returns 0] 2 0 0 0 DL crypto_ 0xffffffff82055d10 [crypto] 14 0 0 0 DL seqstat 0xfffff800038f9c88 [sequencer 00] 13 0 0 0 DL (threaded) [geom] 100061 D - 0xffffffff82094080 [g_event] 100062 D - 0xffffffff82094090 [g_up] 100063 D - 0xffffffff82094078 [g_down] 12 0 0 0 WL (threaded) [intr] 100015 I [swi5: fast taskq] 100019 I [swi6: task queue] 100020 I [swi6: Giant taskq] 100047 I [swi3: vm] 100048 I [swi1: netisr 0] 100049 I [swi4: clock (0)] 100050 I [swi4: clock (1)] 100051 I [swi4: clock (2)] 100052 I [swi4: clock (3)] 100053 I [swi4: clock (4)] 100054 I [swi4: clock (5)] 100055 I [swi4: clock (6)] 100056 I [swi4: clock (7)] 100057 I [swi4: clock (8)] 100058 I [swi4: clock (9)] 100059 I [swi4: clock (10)] 100060 I [swi4: clock (11)] 100094 I [irq56: ahci0] 100095 I [irq19: xhci0] 100101 I [irq18: ehci0 ehci1] 100112 I [irq71: ahci1] 100113 I [swi0: uart uart] 100183 I [irq72: ioat0] 100184 I [irq73: ioat1] 100185 I [irq74: ioat2] 100186 I [irq75: ioat3] 100187 I [irq76: ioat4] 100188 I [irq77: ioat5] 100189 I [irq78: ioat6] 100190 I [irq79: ioat7] 11 0 0 0 RL (threaded) [idle] 100003 Run CPU 0 [idle: cpu0] 100004 CanRun [idle: cpu1] 100005 CanRun [idle: cpu2] 100006 Run CPU 3 [idle: cpu3] 100007 CanRun [idle: cpu4] 100008 Run CPU 5 [idle: cpu5] 100009 Run CPU 6 [idle: cpu6] 100010 Run CPU 7 [idle: cpu7] 100011 Run CPU 8 [idle: cpu8] 100012 Run CPU 9 [idle: cpu9] 100013 Run CPU 10 [idle: cpu10] 100014 CanRun [idle: cpu11] 1 0 1 0 RLs CPU 2 [init] 10 0 0 0 DL audit_w 0xffffffff820c48e0 [audit] 0 0 0 0 DLs (threaded) [kernel] 100000 D swapin 0xffffffff820940c0 [swapper] 100016 D - 0xfffff80003710000 [config_0] 100017 D - 0xfffff80003684c00 [kqueue_ctx taskq] 100018 D - 0xfffff80003684b00 [aiod_kick taskq] 100021 D - 0xfffff80003684800 [thread taskq] 100022 D - 0xfffff8000370fe00 [if_config_tqg_0] 100023 D - 0xfffff8000370fd00 [softirq_0] 100024 D - 0xfffff8000370fc00 [softirq_1] 100025 D - 0xfffff8000370fb00 [softirq_2] 100026 D - 0xfffff8000370fa00 [softirq_3] 100027 D - 0xfffff8000370f900 [softirq_4] 100028 D - 0xfffff8000370f800 [softirq_5] 100029 D - 0xfffff8000370f700 [softirq_6] 100030 D - 0xfffff8000370f600 [softirq_7] 100031 D - 0xfffff8000370f500 [softirq_8] 100032 D - 0xfffff8000370f400 [softirq_9] 100033 D - 0xfffff8000370f300 [softirq_10] 100034 D - 0xfffff8000370f200 [softirq_11] 100035 D - 0xfffff8000370f100 [if_io_tqg_0] 100036 D - 0xfffff8000370f000 [if_io_tqg_1] 100037 D - 0xfffff8000370ee00 [if_io_tqg_2] 100038 D - 0xfffff8000370ed00 [if_io_tqg_3] 100039 D - 0xfffff8000370ec00 [if_io_tqg_4] 100040 D - 0xfffff8000370eb00 [if_io_tqg_5] 100041 D - 0xfffff8000370ea00 [if_io_tqg_6] 100042 D - 0xfffff8000370e900 [if_io_tqg_7] 100043 D - 0xfffff8000370e800 [if_io_tqg_8] 100044 D - 0xfffff8000370e700 [if_io_tqg_9] 100045 D - 0xfffff8000370e600 [if_io_tqg_10] 100046 D - 0xfffff8000370e500 [if_io_tqg_11] 100064 D - 0xfffff80003883000 [firmware taskq] 100066 D - 0xfffff80003882d00 [crypto_0] 100067 D - 0xfffff80003882d00 [crypto_1] 100068 D - 0xfffff80003882d00 [crypto_2] 100069 D - 0xfffff80003882d00 [crypto_3] 100070 D - 0xfffff80003882d00 [crypto_4] 100071 D - 0xfffff80003882d00 [crypto_5] 100072 D - 0xfffff80003882d00 [crypto_6] 100073 D - 0xfffff80003882d00 [crypto_7] 100074 D - 0xfffff80003882d00 [crypto_8] 100075 D - 0xfffff80003882d00 [crypto_9] 100076 D - 0xfffff80003882d00 [crypto_10] 100077 D - 0xfffff80003882d00 [crypto_11] 100114 D - 0xfffff8000617a200 [mca taskq] 100121 D - 0xfffff8000a479300 [acpi_task_0] 100122 D - 0xfffff8000a479300 [acpi_task_1] 100123 D - 0xfffff8000a479300 [acpi_task_2] 100124 D - 0xfffff80003882a00 [CAM taskq] 2302 1 2302 0 Z+ getty 2303 1 2303 0 Z+ getty 2299 1 2299 0 Z+ getty 2300 1 2300 0 Z+ getty 2301 1 2301 0 Z+ getty db:0:pho> allt Tracing command init pid 2325 tid 100215 td 0xfffff80060c9e5a0 (CPU 4) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006b97df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006b97e10 trap() at trap+0x48/frame 0xfffffe0006b97f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006b97f20 --- trap 0x13, rip = 0xffffffff80bc1deb, rsp = 0xfffffe00b69a49a0, rbp = 0xfffffe00b69a49d0 --- _thread_lock() at _thread_lock+0x5b/frame 0xfffffe00b69a49d0 userret() at userret+0x6b/frame 0xfffffe00b69a4a30 fork_return() at fork_return+0x189/frame 0xfffffe00b69a4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00b69a4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00b69a4ab0 --- trap 0xc, rip = 0x2b265a, rsp = 0x7fffffffe688, rbp = 0x7fffffffe710 --- Tracing command init pid 2324 tid 100209 td 0xfffff800171625a0 (CPU 11) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006bebdf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006bebe10 trap() at trap+0x48/frame 0xfffffe0006bebf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bebf20 --- trap 0x13, rip = 0xffffffff80c4a8bb, rsp = 0xfffffe00b6986700, rbp = 0xfffffe00b6986730 --- witness_unlock() at witness_unlock+0x15b/frame 0xfffffe00b6986730 _rw_wunlock_cookie() at _rw_wunlock_cookie+0x59/frame 0xfffffe00b6986750 vm_object_deallocate() at vm_object_deallocate+0x6ed/frame 0xfffffe00b69867b0 unlock_and_deallocate() at unlock_and_deallocate+0xe6/frame 0xfffffe00b69867d0 vm_fault_hold() at vm_fault_hold+0x1ae9/frame 0xfffffe00b6986910 vm_fault() at vm_fault+0x60/frame 0xfffffe00b6986950 trap_pfault() at trap_pfault+0x189/frame 0xfffffe00b69869a0 trap() at trap+0x460/frame 0xfffffe00b6986ab0 calltrap() at calltrap+0x8/frame 0xfffffe00b6986ab0 --- trap 0xc, rip = 0x274049, rsp = 0x7fffffffd1c0, rbp = 0x7fffffffd1f0 --- Tracing command init pid 2323 tid 100216 td 0xfffff80060c9e000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00b69a8ff0 mi_switch() at mi_switch+0x174/frame 0xfffffe00b69a9020 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00b69a9060 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00b69a9090 sleeplk() at sleeplk+0x109/frame 0xfffffe00b69a90f0 lockmgr_slock_hard() at lockmgr_slock_hard+0x1db/frame 0xfffffe00b69a9180 __lockmgr_args() at __lockmgr_args+0x745/frame 0xfffffe00b69a9220 ffs_lock() at ffs_lock+0x7c/frame 0xfffffe00b69a9270 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x1d9/frame 0xfffffe00b69a92e0 _vn_lock() at _vn_lock+0x65/frame 0xfffffe00b69a9340 vget() at vget+0x14a/frame 0xfffffe00b69a9390 cache_lookup() at cache_lookup+0x582/frame 0xfffffe00b69a9470 vfs_cache_lookup() at vfs_cache_lookup+0xac/frame 0xfffffe00b69a94d0 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x1ec/frame 0xfffffe00b69a9540 lookup() at lookup+0x601/frame 0xfffffe00b69a95e0 namei() at namei+0x4fd/frame 0xfffffe00b69a96d0 vn_open_cred() at vn_open_cred+0x224/frame 0xfffffe00b69a9820 kern_openat() at kern_openat+0x1fd/frame 0xfffffe00b69a9990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00b69a9ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00b69a9ab0 --- syscall (5, FreeBSD ELF64, sys_open), rip = 0x334b4a, rsp = 0x7fffffffda58, rbp = 0x7fffffffdc60 --- Tracing command init pid 2322 tid 100208 td 0xfffff80017163000 (CPU 1) kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00b6981280 vpanic() at vpanic+0x1d1/frame 0xfffffe00b69812e0 panic() at panic+0x43/frame 0xfffffe00b6981340 buf_vlist_add() at buf_vlist_add+0x8d/frame 0xfffffe00b6981380 reassignbuf() at reassignbuf+0x157/frame 0xfffffe00b69813d0 bdirty() at bdirty+0xfe/frame 0xfffffe00b69813f0 bdwrite() at bdwrite+0x152/frame 0xfffffe00b6981440 ffs_update() at ffs_update+0x5c8/frame 0xfffffe00b6981540 ufs_inactive() at ufs_inactive+0x51c/frame 0xfffffe00b69815f0 VOP_INACTIVE_APV() at VOP_INACTIVE_APV+0x1f5/frame 0xfffffe00b6981660 VOP_INACTIVE() at VOP_INACTIVE+0x39/frame 0xfffffe00b69816a0 vinactive() at vinactive+0x19b/frame 0xfffffe00b6981700 vputx() at vputx+0x44a/frame 0xfffffe00b6981790 vput() at vput+0x1a/frame 0xfffffe00b69817b0 vn_close1() at vn_close1+0x11b/frame 0xfffffe00b6981820 vn_closefile() at vn_closefile+0x53/frame 0xfffffe00b69818a0 _fdrop() at _fdrop+0x1a/frame 0xfffffe00b69818c0 closef() at closef+0x1ec/frame 0xfffffe00b6981950 closefp() at closefp+0x9e/frame 0xfffffe00b6981990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00b6981ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00b6981ab0 --- syscall (6, FreeBSD ELF64, sys_close), rip = 0x3395da, rsp = 0x7fffffffdc18, rbp = 0x7fffffffdc40 --- Tracing command umount pid 2321 tid 100168 td 0xfffff8000ad2a000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00b685e310 mi_switch() at mi_switch+0x174/frame 0xfffffe00b685e340 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00b685e380 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00b685e3b0 _sleep() at _sleep+0x2da/frame 0xfffffe00b685e450 bwait() at bwait+0xac/frame 0xfffffe00b685e4b0 bufwait() at bufwait+0x32/frame 0xfffffe00b685e4e0 breadn_flags() at breadn_flags+0x2a3/frame 0xfffffe00b685e5a0 ffs_update() at ffs_update+0x295/frame 0xfffffe00b685e6a0 ufs_inactive() at ufs_inactive+0x51c/frame 0xfffffe00b685e750 VOP_INACTIVE_APV() at VOP_INACTIVE_APV+0x1f5/frame 0xfffffe00b685e7c0 VOP_INACTIVE() at VOP_INACTIVE+0x39/frame 0xfffffe00b685e800 vinactive() at vinactive+0x19b/frame 0xfffffe00b685e860 vputx() at vputx+0x44a/frame 0xfffffe00b685e8f0 vrele() at vrele+0x1a/frame 0xfffffe00b685e910 exit1() at exit1+0x5d4/frame 0xfffffe00b685e980 sys_sys_exit() at sys_sys_exit+0xd/frame 0xfffffe00b685e990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00b685eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00b685eab0 --- syscall (1, FreeBSD ELF64, sys_sys_exit), rip = 0x8003ae10a, rsp = 0x7fffffffeac8, rbp = 0x7fffffffeae0 --- Tracing command sh pid 2319 tid 100218 td 0xfffff80060efb000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00b69b3570 mi_switch() at mi_switch+0x174/frame 0xfffffe00b69b35a0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00b69b35e0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00b69b3640 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00b69b3670 _sleep() at _sleep+0x2d0/frame 0xfffffe00b69b3710 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00b69b37a0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00b69b3990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00b69b3ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00b69b3ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040d21a, rsp = 0x7fffffffe718, rbp = 0x7fffffffe7d0 --- Tracing command csh pid 2315 tid 100181 td 0xfffff800171fc000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00b68c3760 mi_switch() at mi_switch+0x174/frame 0xfffffe00b68c3790 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00b68c37d0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00b68c3830 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00b68c3860 _sleep() at _sleep+0x2d0/frame 0xfffffe00b68c3900 kern_sigsuspend() at kern_sigsuspend+0xb4/frame 0xfffffe00b68c3960 sys_sigsuspend() at sys_sigsuspend+0x31/frame 0xfffffe00b68c3990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00b68c3ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00b68c3ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x80049129a, rsp = 0x7fffffffe0f8, rbp = 0x7fffffffe180 --- Tracing command login pid 2306 tid 100217 td 0xfffff80060c9d5a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00b69ae570 mi_switch() at mi_switch+0x174/frame 0xfffffe00b69ae5a0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00b69ae5e0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00b69ae640 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00b69ae670 _sleep() at _sleep+0x2d0/frame 0xfffffe00b69ae710 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00b69ae7a0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00b69ae990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00b69aeab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00b69aeab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003f321a, rsp = 0x7fffffffeb48, rbp = 0x7fffffffed00 --- Tracing command cron pid 2251 tid 100191 td 0xfffff800171315a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00b6925710 mi_switch() at mi_switch+0x174/frame 0xfffffe00b6925740 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00b6925780 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00b69257e0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00b6925820 _sleep() at _sleep+0x265/frame 0xfffffe00b69258c0 kern_clock_nanosleep() at kern_clock_nanosleep+0x207/frame 0xfffffe00b6925950 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00b6925990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00b6925ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00b6925ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003db39a, rsp = 0x7fffffffead8, rbp = 0x7fffffffecc0 --- Tracing command sshd pid 2247 tid 100170 td 0xfffff80006031000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00b688c5d0 mi_switch() at mi_switch+0x174/frame 0xfffffe00b688c600 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00b688c640 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00b688c6a0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00b688c6d0 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00b688c730 seltdwait() at seltdwait+0x8d/frame 0xfffffe00b688c770 kern_select() at kern_select+0x953/frame 0xfffffe00b688c950 sys_select() at sys_select+0x56/frame 0xfffffe00b688c990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00b688cab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00b688cab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80090b18a, rsp = 0x7fffffffe668, rbp = 0x7fffffffe6a0 --- Tracing command rpc.lockd pid 2168 tid 100156 td 0xfffff8001718a000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00b68224f0 mi_switch() at mi_switch+0x174/frame 0xfffffe00b6822520 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00b6822560 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00b68225c0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00b6822600 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x185/frame 0xfffffe00b6822670 svc_run_internal() at svc_run_internal+0xa94/frame 0xfffffe00b68227b0 svc_run() at svc_run+0x1ee/frame 0xfffffe00b6822810 sys_nlm_syscall() at sys_nlm_syscall+0x75b/frame 0xfffffe00b6822990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00b6822ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00b6822ab0 --- syscall (154, FreeBSD ELF64, sys_nlm_syscall), rip = 0x8002f60aa, rsp = 0x7fffffffec08, rbp = 0x7fffffffecc0 --- Tracing command rpc.statd pid 2165 tid 100197 td 0xfffff800172305a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00b69435b0 mi_switch() at mi_switch+0x174/frame 0xfffffe00b69435e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00b6943620 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00b6943680 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00b69436c0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x185/frame 0xfffffe00b6943730 seltdwait() at seltdwait+0x6b/frame 0xfffffe00b6943770 kern_select() at kern_select+0x953/frame 0xfffffe00b6943950 sys_select() at sys_select+0x56/frame 0xfffffe00b6943990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00b6943ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00b6943ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80042c18a, rsp = 0x7fffffffea98, rbp = 0x7fffffffebe0 --- Tracing command watchdogd pid 2119 tid 100165 td 0xfffff80017164000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00b684f710 mi_switch() at mi_switch+0x174/frame 0xfffffe00b684f740 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00b684f780 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00b684f7e0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00b684f820 _sleep() at _sleep+0x265/frame 0xfffffe00b684f8c0 kern_clock_nanosleep() at kern_clock_nanosleep+0x207/frame 0xfffffe00b684f950 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00b684f990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00b684fab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00b684fab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003c439a, rsp = 0x7fffffffea98, rbp = 0x7fffffffeae0 --- Tracing command rpcbind pid 2040 tid 100194 td 0xfffff800037d4000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00b6934630 mi_switch() at mi_switch+0x174/frame 0xfffffe00b6934660 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00b69346a0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00b6934700 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00b6934740 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x185/frame 0xfffffe00b69347b0 seltdwait() at seltdwait+0x6b/frame 0xfffffe00b69347f0 kern_poll() at kern_poll+0x439/frame 0xfffffe00b6934970 sys_poll() at sys_poll+0x50/frame 0xfffffe00b6934990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00b6934ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00b6934ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003d291a, rsp = 0x7fffffffca38, rbp = 0x7fffffffec50 --- Tracing command syslogd pid 2030 tid 100166 td 0xfffff800171fc5a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00b68545d0 mi_switch() at mi_switch+0x174/frame 0xfffffe00b6854600 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00b6854640 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00b68546a0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00b68546d0 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00b6854730 seltdwait() at seltdwait+0x8d/frame 0xfffffe00b6854770 kern_select() at kern_select+0x953/frame 0xfffffe00b6854950 sys_select() at sys_select+0x56/frame 0xfffffe00b6854990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00b6854ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00b6854ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80043d18a, rsp = 0x7fffffffe6a8, rbp = 0x7fffffffecc0 --- Tracing command devd pid 1959 tid 100169 td 0xfffff80017132000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00b68875b0 mi_switch() at mi_switch+0x174/frame 0xfffffe00b68875e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00b6887620 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00b6887680 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00b68876c0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x185/frame 0xfffffe00b6887730 seltdwait() at seltdwait+0x6b/frame 0xfffffe00b6887770 kern_select() at kern_select+0x953/frame 0xfffffe00b6887950 sys_select() at sys_select+0x56/frame 0xfffffe00b6887990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00b6887ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00b6887ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x2fd40a, rsp = 0x7fffffffcb48, rbp = 0x7fffffffece0 --- Tracing command dhclient pid 1954 tid 100176 td 0xfffff800060305a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00b68aa630 mi_switch() at mi_switch+0x174/frame 0xfffffe00b68aa660 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00b68aa6a0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00b68aa700 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00b68aa740 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x185/frame 0xfffffe00b68aa7b0 seltdwait() at seltdwait+0x6b/frame 0xfffffe00b68aa7f0 kern_poll() at kern_poll+0x439/frame 0xfffffe00b68aa970 sys_poll() at sys_poll+0x50/frame 0xfffffe00b68aa990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00b68aaab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00b68aaab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003f591a, rsp = 0x7fffffffec28, rbp = 0x7fffffffec60 --- Tracing command dhclient pid 1910 tid 100152 td 0xfffff8000a332000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00b680e650 mi_switch() at mi_switch+0x174/frame 0xfffffe00b680e680 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00b680e6c0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00b680e720 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00b680e750 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00b680e7b0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00b680e7f0 kern_poll() at kern_poll+0x439/frame 0xfffffe00b680e970 sys_poll() at sys_poll+0x50/frame 0xfffffe00b680e990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00b680eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00b680eab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003f591a, rsp = 0x7fffffffec38, rbp = 0x7fffffffec60 --- Tracing command vnlru pid 34 tid 100141 td 0xfffff8000a8435a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00a35f3880 mi_switch() at mi_switch+0x174/frame 0xfffffe00a35f38b0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a35f38f0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00a35f3930 _sleep() at _sleep+0x279/frame 0xfffffe00a35f39d0 vnlru_proc() at vnlru_proc+0x16f/frame 0xfffffe00a35f3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a35f3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a35f3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command syncer pid 33 tid 100140 td 0xfffff8000a844000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00a35ee8b0 mi_switch() at mi_switch+0x174/frame 0xfffffe00a35ee8e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a35ee920 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00a35ee960 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x185/frame 0xfffffe00a35ee9d0 sched_sync() at sched_sync+0x617/frame 0xfffffe00a35eea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a35eeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a35eeab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100131 td 0xfffff8000a8445a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006f3d880 mi_switch() at mi_switch+0x174/frame 0xfffffe0006f3d8b0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f3d8f0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006f3d930 _sleep() at _sleep+0x279/frame 0xfffffe0006f3d9d0 buf_daemon() at buf_daemon+0x391/frame 0xfffffe0006f3da70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f3dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f3dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100133 td 0xfffff80003ab95a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006fe7860 mi_switch() at mi_switch+0x174/frame 0xfffffe0006fe7890 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006fe78d0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006fe7910 _sleep() at _sleep+0x279/frame 0xfffffe0006fe79b0 bufspace_daemon_wait() at bufspace_daemon_wait+0xe0/frame 0xfffffe0006fe7a00 bufspace_daemon() at bufspace_daemon+0x1d0/frame 0xfffffe0006fe7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006fe7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006fe7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100134 td 0xfffff80003ab9000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006fec860 mi_switch() at mi_switch+0x174/frame 0xfffffe0006fec890 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006fec8d0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006fec910 _sleep() at _sleep+0x279/frame 0xfffffe0006fec9b0 bufspace_daemon_wait() at bufspace_daemon_wait+0xe0/frame 0xfffffe0006feca00 bufspace_daemon() at bufspace_daemon+0x1d0/frame 0xfffffe0006feca70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006fecab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006fecab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100135 td 0xfffff80003ab85a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006ff1860 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ff1890 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006ff18d0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006ff1910 _sleep() at _sleep+0x279/frame 0xfffffe0006ff19b0 bufspace_daemon_wait() at bufspace_daemon_wait+0xe0/frame 0xfffffe0006ff1a00 bufspace_daemon() at bufspace_daemon+0x1d0/frame 0xfffffe0006ff1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ff1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ff1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100136 td 0xfffff80003ab8000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006ff6860 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ff6890 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006ff68d0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006ff6910 _sleep() at _sleep+0x279/frame 0xfffffe0006ff69b0 bufspace_daemon_wait() at bufspace_daemon_wait+0xe0/frame 0xfffffe0006ff6a00 bufspace_daemon() at bufspace_daemon+0x1d0/frame 0xfffffe0006ff6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ff6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ff6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100137 td 0xfffff800039555a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006ffb860 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ffb890 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006ffb8d0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006ffb910 _sleep() at _sleep+0x279/frame 0xfffffe0006ffb9b0 bufspace_daemon_wait() at bufspace_daemon_wait+0xe0/frame 0xfffffe0006ffba00 bufspace_daemon() at bufspace_daemon+0x1d0/frame 0xfffffe0006ffba70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ffbab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ffbab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100138 td 0xfffff8000a87e000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00a3564860 mi_switch() at mi_switch+0x174/frame 0xfffffe00a3564890 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a35648d0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00a3564910 _sleep() at _sleep+0x279/frame 0xfffffe00a35649b0 bufspace_daemon_wait() at bufspace_daemon_wait+0xe0/frame 0xfffffe00a3564a00 bufspace_daemon() at bufspace_daemon+0x1d0/frame 0xfffffe00a3564a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a3564ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a3564ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100139 td 0xfffff8000a8755a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00a35e9860 mi_switch() at mi_switch+0x174/frame 0xfffffe00a35e9890 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a35e98d0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00a35e9910 _sleep() at _sleep+0x279/frame 0xfffffe00a35e99b0 bufspace_daemon_wait() at bufspace_daemon_wait+0xe0/frame 0xfffffe00a35e9a00 bufspace_daemon() at bufspace_daemon+0x1d0/frame 0xfffffe00a35e9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a35e9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a35e9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100154 td 0xfffff80017165000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00b68188f0 mi_switch() at mi_switch+0x174/frame 0xfffffe00b6818920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00b6818960 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00b68189a0 _sleep() at _sleep+0x279/frame 0xfffffe00b6818a40 softdep_flush() at softdep_flush+0x17f/frame 0xfffffe00b6818a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00b6818ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00b6818ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100205 td 0xfffff80017247000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00b68318f0 mi_switch() at mi_switch+0x174/frame 0xfffffe00b6831920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00b6831960 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00b68319a0 _sleep() at _sleep+0x279/frame 0xfffffe00b6831a40 softdep_flush() at softdep_flush+0x17f/frame 0xfffffe00b6831a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00b6831ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00b6831ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vmdaemon pid 31 tid 100129 td 0xfffff8000a43f000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006f338b0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006f338e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f33920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006f33950 _sleep() at _sleep+0x2da/frame 0xfffffe0006f339f0 vm_daemon() at vm_daemon+0xaa6/frame 0xfffffe0006f33a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f33ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f33ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100128 td 0xfffff8000a43f5a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006f2e520 mi_switch() at mi_switch+0x174/frame 0xfffffe0006f2e550 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f2e590 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006f2e5d0 _sleep() at _sleep+0x279/frame 0xfffffe0006f2e670 vm_pageout_worker() at vm_pageout_worker+0x26e/frame 0xfffffe0006f2ea30 vm_pageout() at vm_pageout+0x156/frame 0xfffffe0006f2ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f2eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f2eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100130 td 0xfffff80003aba5a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006f386b0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006f386e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f38720 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006f38750 _sleep() at _sleep+0x2da/frame 0xfffffe0006f387f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0xc60/frame 0xfffffe0006f38a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f38ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f38ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100132 td 0xfffff80003aba000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006f428f0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006f42920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f42960 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006f429a0 _sleep() at _sleep+0x279/frame 0xfffffe0006f42a40 uma_reclaim_worker() at uma_reclaim_worker+0xda/frame 0xfffffe0006f42a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f42ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f42ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon1 pid 29 tid 100127 td 0xfffff8000a344000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006f1d8b0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006f1d8e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f1d920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006f1d950 _sleep() at _sleep+0x2da/frame 0xfffffe0006f1d9f0 enc_daemon() at enc_daemon+0x1cf/frame 0xfffffe0006f1da70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f1dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f1dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon0 pid 28 tid 100126 td 0xfffff8000a3445a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006f188b0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006f188e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f18920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006f18950 _sleep() at _sleep+0x2da/frame 0xfffffe0006f189f0 enc_daemon() at enc_daemon+0x1cf/frame 0xfffffe0006f18a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f18ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f18ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command rand_harvestq pid 27 tid 100120 td 0xfffff8000a4495a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006efa8c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006efa8f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006efa930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006efa970 _sleep() at _sleep+0x279/frame 0xfffffe0006efaa10 random_kthread() at random_kthread+0x27a/frame 0xfffffe0006efaa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006efaab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006efaab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sctp_iterator pid 26 tid 100119 td 0xfffff8000a44a000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006ee9910 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ee9940 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006ee9980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006ee99b0 _sleep() at _sleep+0x2da/frame 0xfffffe0006ee9a50 sctp_iterator_thread() at sctp_iterator_thread+0x59/frame 0xfffffe0006ee9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ee9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ee9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod4 pid 25 tid 100118 td 0xfffff8000a345000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006ed88e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ed8910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006ed8950 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006ed8990 _sleep() at _sleep+0x279/frame 0xfffffe0006ed8a30 soaio_kproc_loop() at soaio_kproc_loop+0x170/frame 0xfffffe0006ed8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ed8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ed8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod3 pid 24 tid 100117 td 0xfffff8000a3455a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006ed38e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ed3910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006ed3950 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006ed3990 _sleep() at _sleep+0x279/frame 0xfffffe0006ed3a30 soaio_kproc_loop() at soaio_kproc_loop+0x170/frame 0xfffffe0006ed3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ed3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ed3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod2 pid 23 tid 100116 td 0xfffff8000a346000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006ece8e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ece910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006ece950 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006ece990 _sleep() at _sleep+0x279/frame 0xfffffe0006ecea30 soaio_kproc_loop() at soaio_kproc_loop+0x170/frame 0xfffffe0006ecea70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006eceab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006eceab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod1 pid 22 tid 100115 td 0xfffff8000a3465a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006ec98e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ec9910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006ec9950 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006ec9990 _sleep() at _sleep+0x279/frame 0xfffffe0006ec9a30 soaio_kproc_loop() at soaio_kproc_loop+0x170/frame 0xfffffe0006ec9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ec9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ec9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100096 td 0xfffff80003eaa000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e5e930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e5e960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e5e9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e5e9d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e5ea30 usb_process() at usb_process+0x12b/frame 0xfffffe0006e5ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e5eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e5eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100097 td 0xfffff80003ea95a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e63930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e63960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e639a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e639d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e63a30 usb_process() at usb_process+0x12b/frame 0xfffffe0006e63a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e63ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e63ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100098 td 0xfffff80003ea9000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e68930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e68960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e689a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e689d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e68a30 usb_process() at usb_process+0x12b/frame 0xfffffe0006e68a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e68ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e68ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100099 td 0xfffff80003ea85a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e6d930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e6d960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e6d9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e6d9d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e6da30 usb_process() at usb_process+0x12b/frame 0xfffffe0006e6da70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e6dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e6dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100100 td 0xfffff80003ea8000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e72930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e72960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e729a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e729d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e72a30 usb_process() at usb_process+0x12b/frame 0xfffffe0006e72a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e72ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e72ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100102 td 0xfffff80003e9e000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e7c930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e7c960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e7c9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e7c9d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e7ca30 usb_process() at usb_process+0x12b/frame 0xfffffe0006e7ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e7cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e7cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100103 td 0xfffff800060335a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e81930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e81960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e819a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e819d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e81a30 usb_process() at usb_process+0x12b/frame 0xfffffe0006e81a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e81ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e81ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100104 td 0xfffff80006033000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e86930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e86960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e869a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e869d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e86a30 usb_process() at usb_process+0x12b/frame 0xfffffe0006e86a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e86ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e86ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100105 td 0xfffff800060325a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e8b930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e8b960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e8b9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e8b9d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e8ba30 usb_process() at usb_process+0x12b/frame 0xfffffe0006e8ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e8bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e8bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100106 td 0xfffff80006032000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e90930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e90960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e909a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e909d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e90a30 usb_process() at usb_process+0x12b/frame 0xfffffe0006e90a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e90ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e90ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100107 td 0xfffff8000611c000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006ea1930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ea1960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006ea19a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006ea19d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006ea1a30 usb_process() at usb_process+0x12b/frame 0xfffffe0006ea1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ea1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ea1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100108 td 0xfffff8000611b5a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006ea6930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ea6960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006ea69a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006ea69d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006ea6a30 usb_process() at usb_process+0x12b/frame 0xfffffe0006ea6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ea6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ea6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100109 td 0xfffff8000611b000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006eab930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006eab960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006eab9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006eab9d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006eaba30 usb_process() at usb_process+0x12b/frame 0xfffffe0006eaba70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006eabab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006eabab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100110 td 0xfffff8000611a5a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006eb0930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006eb0960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006eb09a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006eb09d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006eb0a30 usb_process() at usb_process+0x12b/frame 0xfffffe0006eb0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006eb0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006eb0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100111 td 0xfffff8000611a000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006eb5930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006eb5960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006eb59a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006eb59d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006eb5a30 usb_process() at usb_process+0x12b/frame 0xfffffe0006eb5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006eb5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006eb5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100091 td 0xfffff80003951000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e458e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e45910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e45950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e45980 _sleep() at _sleep+0x2da/frame 0xfffffe0006e45a20 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe0006e45a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e45ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e45ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100092 td 0xfffff80003abb5a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e4a8e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e4a910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e4a950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e4a980 _sleep() at _sleep+0x2da/frame 0xfffffe0006e4aa20 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe0006e4aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e4aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e4aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100093 td 0xfffff80003abb000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e4f8e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e4f910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e4f950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e4f980 _sleep() at _sleep+0x2da/frame 0xfffffe0006e4fa20 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe0006e4fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e4fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e4fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100125 td 0xfffff8000a447000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006f138d0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006f13900 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f13940 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006f13970 _sleep() at _sleep+0x2da/frame 0xfffffe0006f13a10 xpt_scanner_thread() at xpt_scanner_thread+0x93/frame 0xfffffe0006f13a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f13ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f13ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 11 pid 19 tid 100090 td 0xfffff800039515a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e408c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e408f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e40930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e40960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e40a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e40a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e40ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e40ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 10 pid 18 tid 100089 td 0xfffff80003952000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e3b8c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e3b8f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e3b930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e3b960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e3ba00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e3ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e3bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e3bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 9 pid 17 tid 100088 td 0xfffff800039525a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e368c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e368f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e36930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e36960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e36a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e36a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e36ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e36ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 8 pid 16 tid 100087 td 0xfffff80003953000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e318c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e318f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e31930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e31960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e31a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e31a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e31ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e31ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 7 pid 15 tid 100086 td 0xfffff800039535a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e2c8c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e2c8f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e2c930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e2c960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e2ca00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e2ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e2cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e2cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 6 pid 9 tid 100085 td 0xfffff80003954000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e278c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e278f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e27930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e27960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e27a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e27a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e27ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e27ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 5 pid 8 tid 100084 td 0xfffff800039545a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e228c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e228f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e22930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e22960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e22a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e22a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e22ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e22ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 4 pid 7 tid 100083 td 0xfffff80003955000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e1d8c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e1d8f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e1d930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e1d960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e1da00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e1da70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e1dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e1dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 3 pid 6 tid 100082 td 0xfffff8000393a5a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e188c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e188f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e18930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e18960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e18a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e18a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e18ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e18ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 2 pid 5 tid 100081 td 0xfffff80003946000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e138c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e138f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e13930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e13960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e13a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e13a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e13ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e13ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 1 pid 4 tid 100080 td 0xfffff800039465a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e0e8c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e0e8f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e0e930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e0e960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e0ea00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e0ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e0eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e0eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 0 pid 3 tid 100079 td 0xfffff80003947000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e098c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e098f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e09930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e09960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e09a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e09a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e09ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e09ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 2 tid 100078 td 0xfffff800039475a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e048f0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e04920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e04960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e04990 _sleep() at _sleep+0x2da/frame 0xfffffe0006e04a30 crypto_proc() at crypto_proc+0x2c5/frame 0xfffffe0006e04a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e04ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e04ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sequencer 00 pid 14 tid 100065 td 0xfffff8000393a000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00005c08f0 mi_switch() at mi_switch+0x174/frame 0xfffffe00005c0920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005c0960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005c0990 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe00005c09f0 seq_eventthread() at seq_eventthread+0xdc/frame 0xfffffe00005c0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005c0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005c0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100061 td 0xfffff8000380c000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00005948f0 mi_switch() at mi_switch+0x174/frame 0xfffffe0000594920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000594960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000594990 _sleep() at _sleep+0x2da/frame 0xfffffe0000594a30 g_run_events() at g_run_events+0x4f/frame 0xfffffe0000594a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000594ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000594ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100062 td 0xfffff8000380b5a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00005998f0 mi_switch() at mi_switch+0x174/frame 0xfffffe0000599920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000599960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000599990 _sleep() at _sleep+0x2da/frame 0xfffffe0000599a30 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0000599a60 g_up_procbody() at g_up_procbody+0x6d/frame 0xfffffe0000599a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000599ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000599ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100063 td 0xfffff8000380b000 sched_switch() at sched_switch+0x71a/frame 0xfffffe000059e8f0 mi_switch() at mi_switch+0x174/frame 0xfffffe000059e920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000059e960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000059e990 _sleep() at _sleep+0x2da/frame 0xfffffe000059ea30 g_io_schedule_down() at g_io_schedule_down+0x14c/frame 0xfffffe000059ea60 g_down_procbody() at g_down_procbody+0x6d/frame 0xfffffe000059ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe000059eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000059eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100015 td 0xfffff800036ce000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100019 td 0xfffff80003719000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00767c29e0 mi_switch() at mi_switch+0x174/frame 0xfffffe00767c2a10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe00767c2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00767c2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00767c2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100020 td 0xfffff800037185a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00767c79e0 mi_switch() at mi_switch+0x174/frame 0xfffffe00767c7a10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe00767c7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00767c7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00767c7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100047 td 0xfffff80003802000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100048 td 0xfffff800038015a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00004f39e0 mi_switch() at mi_switch+0x174/frame 0xfffffe00004f3a10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe00004f3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004f3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004f3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100049 td 0xfffff80003801000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00004f89e0 mi_switch() at mi_switch+0x174/frame 0xfffffe00004f8a10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe00004f8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004f8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004f8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100050 td 0xfffff800038005a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100051 td 0xfffff80003800000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100052 td 0xfffff800037ff5a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100053 td 0xfffff800037ff000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100054 td 0xfffff800037f55a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100055 td 0xfffff800037f5000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100056 td 0xfffff8000380e5a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100057 td 0xfffff8000380e000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100058 td 0xfffff8000380d5a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100059 td 0xfffff8000380d000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100060 td 0xfffff8000380c5a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100094 td 0xfffff80003eab000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e549e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e54a10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe0006e54a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e54ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e54ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100095 td 0xfffff80003eaa5a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e599e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e59a10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe0006e59a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e59ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e59ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100101 td 0xfffff80003e9e5a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e779e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e77a10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe0006e77a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e77ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e77ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100112 td 0xfffff800061195a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100113 td 0xfffff80006119000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006ebf9e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ebfa10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe0006ebfa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ebfab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ebfab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100183 td 0xfffff800171895a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100184 td 0xfffff80017189000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100185 td 0xfffff800171865a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100186 td 0xfffff80017186000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100187 td 0xfffff8001713e5a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100188 td 0xfffff8001713e000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100189 td 0xfffff800171655a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100190 td 0xfffff80017bd25a0 fork_trampoline() at fork_trampoline Tracing command idle pid 11 tid 100003 td 0xfffff800036bf000 (CPU 0) cpustop_handler() at cpustop_handler+0x28/frame 0xffffffff8205fa70 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xffffffff8205fa90 trap() at trap+0x48/frame 0xffffffff8205fba0 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff8205fba0 --- trap 0x13, rip = 0xffffffff8122d6a6, rsp = 0xfffffe0076766900, rbp = 0xfffffe0076766900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076766900 acpi_cpu_idle() at acpi_cpu_idle+0x23f/frame 0xfffffe0076766950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076766970 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe0076766990 sched_idletd() at sched_idletd+0x482/frame 0xfffffe0076766a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076766ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076766ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffff800036be5a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe007676b960 mi_switch() at mi_switch+0x174/frame 0xfffffe007676b990 sched_idletd() at sched_idletd+0xb6/frame 0xfffffe007676ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe007676bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007676bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffff800036be000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0076770960 mi_switch() at mi_switch+0x174/frame 0xfffffe0076770990 sched_idletd() at sched_idletd+0xb6/frame 0xfffffe0076770a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076770ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076770ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffff800036bd5a0 (CPU 3) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006b8bdf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006b8be10 trap() at trap+0x48/frame 0xfffffe0006b8bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006b8bf20 --- trap 0x13, rip = 0xffffffff8122ddd6, rsp = 0xfffffe0076775980, rbp = 0xfffffe0076775990 --- cpu_idle() at cpu_idle+0xf6/frame 0xfffffe0076775990 sched_idletd() at sched_idletd+0x482/frame 0xfffffe0076775a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076775ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076775ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffff800036bd000 sched_switch() at sched_switch+0x71a/frame 0xfffffe007677a960 mi_switch() at mi_switch+0x174/frame 0xfffffe007677a990 sched_idletd() at sched_idletd+0xb6/frame 0xfffffe007677aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe007677aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007677aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffff800036bc5a0 (CPU 5) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006ba3df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006ba3e10 trap() at trap+0x48/frame 0xfffffe0006ba3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006ba3f20 --- trap 0x13, rip = 0xffffffff8122ddd6, rsp = 0xfffffe007677f980, rbp = 0xfffffe007677f990 --- cpu_idle() at cpu_idle+0xf6/frame 0xfffffe007677f990 sched_idletd() at sched_idletd+0x482/frame 0xfffffe007677fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe007677fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007677fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffff800036bc000 (CPU 6) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006bafdf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006bafe10 trap() at trap+0x48/frame 0xfffffe0006baff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006baff20 --- trap 0x13, rip = 0xffffffff8122ddd6, rsp = 0xfffffe0076784980, rbp = 0xfffffe0076784990 --- cpu_idle() at cpu_idle+0xf6/frame 0xfffffe0076784990 sched_idletd() at sched_idletd+0x482/frame 0xfffffe0076784a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076784ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076784ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffff800036d05a0 (CPU 7) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006bbbdf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006bbbe10 trap() at trap+0x48/frame 0xfffffe0006bbbf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bbbf20 --- trap 0x13, rip = 0xffffffff8122ddd6, rsp = 0xfffffe0076789980, rbp = 0xfffffe0076789990 --- cpu_idle() at cpu_idle+0xf6/frame 0xfffffe0076789990 sched_idletd() at sched_idletd+0x482/frame 0xfffffe0076789a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076789ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076789ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffff800036d0000 (CPU 8) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006bc7df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006bc7e10 trap() at trap+0x48/frame 0xfffffe0006bc7f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bc7f20 --- trap 0x13, rip = 0xffffffff8122ddd6, rsp = 0xfffffe007678e980, rbp = 0xfffffe007678e990 --- cpu_idle() at cpu_idle+0xf6/frame 0xfffffe007678e990 sched_idletd() at sched_idletd+0x482/frame 0xfffffe007678ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe007678eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007678eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffff800036cf5a0 (CPU 9) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006bd3df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006bd3e10 trap() at trap+0x48/frame 0xfffffe0006bd3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bd3f20 --- trap 0x13, rip = 0xffffffff8122ddd6, rsp = 0xfffffe0076793980, rbp = 0xfffffe0076793990 --- cpu_idle() at cpu_idle+0xf6/frame 0xfffffe0076793990 sched_idletd() at sched_idletd+0x482/frame 0xfffffe0076793a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076793ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076793ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffff800036cf000 (CPU 10) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006bdfdf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006bdfe10 trap() at trap+0x48/frame 0xfffffe0006bdff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bdff20 --- trap 0x13, rip = 0xffffffff8122ddd6, rsp = 0xfffffe0076798980, rbp = 0xfffffe0076798990 --- cpu_idle() at cpu_idle+0xf6/frame 0xfffffe0076798990 sched_idletd() at sched_idletd+0x482/frame 0xfffffe0076798a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076798ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076798ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffff800036ce5a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe007679d960 mi_switch() at mi_switch+0x174/frame 0xfffffe007679d990 sched_idletd() at sched_idletd+0xb6/frame 0xfffffe007679da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007679dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007679dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command init pid 1 tid 100002 td 0xfffff800036bf5a0 (CPU 2) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006b7fdf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006b7fe10 trap() at trap+0x48/frame 0xfffffe0006b7ff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006b7ff20 --- trap 0x13, rip = 0xffffffff80f27a11, rsp = 0xfffffe00767617e0, rbp = 0xfffffe0076761910 --- vm_fault_hold() at vm_fault_hold+0x691/frame 0xfffffe0076761910 vm_fault() at vm_fault+0x60/frame 0xfffffe0076761950 trap_pfault() at trap_pfault+0x189/frame 0xfffffe00767619a0 trap() at trap+0x460/frame 0xfffffe0076761ab0 calltrap() at calltrap+0x8/frame 0xfffffe0076761ab0 --- trap 0xc, rip = 0x24096e, rsp = 0x7fffffffe720, rbp = 0x7fffffffe770 --- Tracing command audit pid 10 tid 100001 td 0xfffff800036c0000 sched_switch() at sched_switch+0x71a/frame 0xfffffe007675c910 mi_switch() at mi_switch+0x174/frame 0xfffffe007675c940 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe007675c980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe007675c9b0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe007675ca10 audit_worker() at audit_worker+0x93/frame 0xfffffe007675ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe007675cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007675cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xffffffff82094600 sched_switch() at sched_switch+0x71a/frame 0xffffffff828fb980 mi_switch() at mi_switch+0x174/frame 0xffffffff828fb9b0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffffff828fb9f0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xffffffff828fba30 _sleep() at _sleep+0x279/frame 0xffffffff828fbad0 swapper() at swapper+0x77/frame 0xffffffff828fbb20 mi_startup() at mi_startup+0x2e7/frame 0xffffffff828fbb70 btext() at btext+0x2c Tracing command kernel pid 0 tid 100016 td 0xfffff800036cd5a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00767b3930 mi_switch() at mi_switch+0x174/frame 0xfffffe00767b3960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00767b39a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00767b39d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe00767b3a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00767b3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00767b3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00767b3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100017 td 0xfffff800036cd000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00767b8900 mi_switch() at mi_switch+0x174/frame 0xfffffe00767b8930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00767b8970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00767b89a0 _sleep() at _sleep+0x2da/frame 0xfffffe00767b8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00767b8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00767b8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00767b8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100018 td 0xfffff800036c05a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00767bd900 mi_switch() at mi_switch+0x174/frame 0xfffffe00767bd930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00767bd970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00767bd9a0 _sleep() at _sleep+0x2da/frame 0xfffffe00767bda40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00767bda70 fork_exit() at fork_exit+0x84/frame 0xfffffe00767bdab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00767bdab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xfffff80003718000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00767cc900 mi_switch() at mi_switch+0x174/frame 0xfffffe00767cc930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00767cc970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00767cc9a0 _sleep() at _sleep+0x2da/frame 0xfffffe00767cca40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00767cca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00767ccab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00767ccab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xfffff800037175a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe0000471930 mi_switch() at mi_switch+0x174/frame 0xfffffe0000471960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004719a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004719d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe0000471a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000471a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000471ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000471ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xfffff80003717000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0000476930 mi_switch() at mi_switch+0x174/frame 0xfffffe0000476960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004769a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004769d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe0000476a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000476a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000476ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000476ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xfffff800037165a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe000047b930 mi_switch() at mi_switch+0x174/frame 0xfffffe000047b960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000047b9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000047b9d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe000047ba40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000047ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe000047bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000047bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xfffff80003716000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0000480930 mi_switch() at mi_switch+0x174/frame 0xfffffe0000480960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004809a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004809d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe0000480a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000480a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000480ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000480ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100026 td 0xfffff800037155a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe0000485930 mi_switch() at mi_switch+0x174/frame 0xfffffe0000485960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004859a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004859d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe0000485a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000485a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000485ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000485ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100027 td 0xfffff80003715000 sched_switch() at sched_switch+0x71a/frame 0xfffffe000048a930 mi_switch() at mi_switch+0x174/frame 0xfffffe000048a960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000048a9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000048a9d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe000048aa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000048aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000048aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000048aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100028 td 0xfffff8000374e5a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe000048f930 mi_switch() at mi_switch+0x174/frame 0xfffffe000048f960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000048f9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000048f9d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe000048fa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000048fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000048fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000048fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100029 td 0xfffff8000374e000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0000494930 mi_switch() at mi_switch+0x174/frame 0xfffffe0000494960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004949a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004949d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe0000494a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000494a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000494ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000494ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100030 td 0xfffff8000374d5a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe0000499930 mi_switch() at mi_switch+0x174/frame 0xfffffe0000499960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004999a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004999d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe0000499a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000499a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000499ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000499ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100031 td 0xfffff8000374d000 sched_switch() at sched_switch+0x71a/frame 0xfffffe000049e930 mi_switch() at mi_switch+0x174/frame 0xfffffe000049e960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000049e9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000049e9d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe000049ea40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000049ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe000049eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000049eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100032 td 0xfffff8000374c5a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00004a3930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004a3960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004a39a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004a39d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe00004a3a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004a3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004a3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004a3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100033 td 0xfffff8000374c000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00004a8930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004a8960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004a89a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004a89d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe00004a8a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004a8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004a8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004a8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100034 td 0xfffff8000374b5a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00004ad930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004ad960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004ad9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004ad9d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe00004ada40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004ada70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004adab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004adab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100035 td 0xfffff8000374b000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00004b2930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004b2960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004b29a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004b29d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe00004b2a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004b2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004b2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004b2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100036 td 0xfffff800037195a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00004b7930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004b7960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004b79a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004b79d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe00004b7a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004b7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004b7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004b7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100037 td 0xfffff8000378d000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00004bc930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004bc960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004bc9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004bc9d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe00004bca40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004bca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004bcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004bcab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100038 td 0xfffff800037885a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00004c1930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004c1960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004c19a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004c19d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe00004c1a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004c1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004c1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004c1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100039 td 0xfffff80003788000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00004c6930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004c6960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004c69a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004c69d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe00004c6a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004c6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004c6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004c6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100040 td 0xfffff800037865a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00004cb930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004cb960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004cb9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004cb9d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe00004cba40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004cba70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004cbab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004cbab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100041 td 0xfffff80003786000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00004d0930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004d0960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004d09a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004d09d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe00004d0a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004d0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004d0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004d0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100042 td 0xfffff800037835a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00004d5930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004d5960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004d59a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004d59d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe00004d5a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004d5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004d5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004d5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100043 td 0xfffff80003783000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00004da930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004da960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004da9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004da9d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe00004daa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004daa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004daab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004daab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100044 td 0xfffff800037705a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00004df930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004df960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004df9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004df9d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe00004dfa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004dfa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004dfab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004dfab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100045 td 0xfffff80003770000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00004e4930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004e4960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004e49a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004e49d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe00004e4a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004e4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004e4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004e4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100046 td 0xfffff800037d65a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00004e9930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004e9960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004e99a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004e99d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe00004e9a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004e9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004e9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004e9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100064 td 0xfffff800038025a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00005af900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005af930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005af970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005af9a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005afa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005afa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005afab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005afab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100066 td 0xfffff800039395a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00005c5900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005c5930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005c5970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005c59a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005c5a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005c5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005c5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005c5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100067 td 0xfffff80003939000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00005ca900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005ca930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005ca970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005ca9a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005caa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005caa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005caab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005caab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100068 td 0xfffff800039385a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00005cf900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005cf930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005cf970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005cf9a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005cfa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005cfa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005cfab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005cfab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100069 td 0xfffff80003938000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00005d4900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005d4930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005d4970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005d49a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005d4a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005d4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005d4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005d4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100070 td 0xfffff800039375a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00005d9900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005d9930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005d9970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005d99a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005d9a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005d9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005d9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005d9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100071 td 0xfffff80003937000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00005de900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005de930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005de970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005de9a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005dea40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005dea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005deab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005deab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100072 td 0xfffff800039365a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00005e3900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005e3930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005e3970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005e39a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005e3a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005e3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005e3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005e3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100073 td 0xfffff80003936000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00005e8900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005e8930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005e8970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005e89a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005e8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005e8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005e8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005e8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100074 td 0xfffff800039495a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00005ed900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005ed930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005ed970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005ed9a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005eda40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005eda70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005edab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005edab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100075 td 0xfffff80003949000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00005f2900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005f2930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005f2970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005f29a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005f2a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005f2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005f2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005f2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100076 td 0xfffff800039485a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00005f7900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005f7930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005f7970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005f79a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005f7a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005f7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005f7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005f7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100077 td 0xfffff80003948000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00005fc900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005fc930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005fc970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005fc9a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005fca40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005fca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005fcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005fcab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100114 td 0xfffff8000610f5a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006ec4930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ec4960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006ec49a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006ec49d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe0006ec4a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0006ec4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ec4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ec4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100121 td 0xfffff8000a449000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006eff930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006eff960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006eff9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006eff9d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe0006effa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0006effa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006effab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006effab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100122 td 0xfffff8000a4485a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006f04930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006f04960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f049a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006f049d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe0006f04a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0006f04a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f04ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f04ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100123 td 0xfffff8000a448000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006f09930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006f09960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f099a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006f099d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe0006f09a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0006f09a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f09ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f09ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100124 td 0xfffff8000a4475a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006f0e900 mi_switch() at mi_switch+0x174/frame 0xfffffe0006f0e930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f0e970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006f0e9a0 _sleep() at _sleep+0x2da/frame 0xfffffe0006f0ea40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0006f0ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f0eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f0eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:pho> dump Dumping 1307 out of 32621 MB:..2%..12%..21%..31%..41%..51%..62%..71%..81%..91% Dump complete db> (kgdb) bt #0 doadump (textdump=) at pcpu.h:230 #1 0xffffffff8049ba3b in db_dump (dummy=, dummy2=, dummy3=, dummy4=) at ../../../ddb/db_command.c:574 #2 0xffffffff8049b809 in db_command (cmd_table=, dopager=0x0) at ../../../ddb/db_command.c:481 #3 0xffffffff804a0708 in db_script_exec (scriptname=, warnifnotfound=) at ../../../ddb/db_script.c:304 #4 0xffffffff8049b809 in db_command (cmd_table=, dopager=0x1) at ../../../ddb/db_command.c:481 #5 0xffffffff8049b584 in db_command_loop () at ../../../ddb/db_command.c:534 #6 0xffffffff8049e73f in db_trap (type=, code=) at ../../../ddb/db_main.c:252 #7 0xffffffff80c29fc4 in kdb_trap (type=0x3, code=0x0, tf=) at ../../../kern/subr_kdb.c:692 #8 0xffffffff810c3f9b in trap (frame=0xfffffe00b69811b0) at ../../../amd64/amd64/trap.c:619 #9 0xffffffff8109e895 in calltrap () at ../../../amd64/amd64/exception.S:232 #10 0xffffffff80c296cb in kdb_enter (why=0xffffffff8135dc5d "panic", msg=) at cpufunc.h:65 #11 0xffffffff80be1a91 in vpanic (fmt=, ap=0xfffffe00b6981320) at ../../../kern/kern_shutdown.c:866 #12 0xffffffff80be1823 in panic (fmt=) at ../../../kern/kern_shutdown.c:804 #13 0xffffffff80cb9d1d in buf_vlist_add (bp=0xfffffe00008fa530, bo=0xfffff8000a838b48, xflags=0x1) at ../../../kern/vfs_subr.c:1991 #14 0xffffffff80cbb477 in reassignbuf (bp=0xfffffe00008fa530) at ../../../kern/vfs_subr.c:2445 #15 0xffffffff80c9532e in bdirty (bp=0xfffffe00008fa530) at ../../../kern/vfs_bio.c:2456 #16 0xffffffff80c95182 in bdwrite (bp=0xfffffe00008fa530) at ../../../kern/vfs_bio.c:2381 #17 0xffffffff80eda598 in ffs_update (vp=0xfffff8000acc8000, waitfor=0x0) at ../../../ufs/ffs/ffs_inode.c:174 #18 0xffffffff80f0df2c in ufs_inactive (ap=0xfffffe00b6981678) at ../../../ufs/ufs/ufs_inode.c:167 #19 0xffffffff8124d415 in VOP_INACTIVE_APV (vop=0xffffffff81b65130, a=0xfffffe00b6981678) at vnode_if.c:1927 #20 0xffffffff80cbcf39 in VOP_INACTIVE (vp=0xfffff8000acc8000, td=0xfffff80017163000) at vnode_if.h:807 #21 0xffffffff80cbc16b in vinactive (vp=0xfffff8000acc8000, td=0xfffff80017163000) at ../../../kern/vfs_subr.c:3046 #22 0xffffffff80cbcaba in vputx (vp=0xfffff8000acc8000, func=0x2) at ../../../kern/vfs_subr.c:2774 #23 0xffffffff80cbcb1a in vput (vp=0xfffff8000acc8000) at ../../../kern/vfs_subr.c:2801 #24 0xffffffff80cd32eb in vn_close1 (vp=0xfffff8000acc8000, flags=0x1, file_cred=0xfffff80003684e00, td=, keep_ref=0x0) at ../../../kern/vfs_vnops.c:462 #25 0xffffffff80cd2083 in vn_closefile (fp=0xfffff800170370a0, td=) at ../../../kern/vfs_vnops.c:1567 #26 0xffffffff80b89e3a in _fdrop (fp=0xfffff800170370a0, td=) at file.h:353 #27 0xffffffff80b8cf4c in closef (fp=0xfffff800170370a0, td=0xfffff80017163000) at ../../../kern/kern_descrip.c:2511 #28 0xffffffff80b8a37e in closefp (fdp=0xfffff800177b7000, fd=0x0, fp=0xfffff800170370a0, td=, holdleaders=0x0) at ../../../kern/kern_descrip.c:1198 #29 0xffffffff810c4eb1 in amd64_syscall (td=0xfffff80017163000, traced=0x0) at subr_syscall.c:135 #30 0xffffffff8109f17d in fast_syscall_common () at ../../../amd64/amd64/exception.S:504 #31 0x00000000003395da in ?? () Previous frame inner to this frame (corrupt stack?) Current language: auto; currently minimal (kgdb) f 13 #13 0xffffffff80cb9d1d in buf_vlist_add (bp=0xfffffe00008fa530, bo=0xfffff8000a838b48, xflags=0x1) at ../../../kern/vfs_subr.c:1991 1991 KASSERT((xflags & BX_VNDIRTY) == 0 || (bo->bo_flag & BO_DEAD) == 0, (kgdb) info loc bv = (struct bufv *) 0xfffffe00b6981380 n = (struct buf *) 0xffffffff80cbba51 error = 0xfffffe00 (kgdb) p *bp $1 = {b_bufobj = 0xfffff8000a838b48, b_bcount = 0x8000, b_caller1 = 0x0, b_data = 0xfffffe0007418000 "A\035", b_error = 0x0, b_iocmd = 0x2, b_ioflags = 0x0, b_iooffset = 0x8ffd478000, b_resid = 0x0, b_iodone = 0, b_ckhashcalc = 0, b_ckhash = 0x0, b_blkno = 0x47fea3c0, b_offset = 0x8ffd478000, b_bobufs = { tqe_next = 0xfffffe00008ca470, tqe_prev = 0xfffff8000a838b90}, b_vflags = 0x0, b_qindex = 0x0, b_domain = 0x1, b_subqueue = 0xffff, b_flags = 0x20280, b_xflags = 0x0, b_lock = {lock_object = {lo_name = 0xffffffff813981af "bufwait", lo_flags = 0x26730000, lo_data = 0x0, lo_witness = 0xfffff8087fd71200}, lk_lock = 0xfffff80017163000, lk_exslpfail = 0x0, lk_timo = 0x0, lk_pri = 0x60, lk_stack = {depth = 0x12, pcs = 0xfffffe00008fa5e8}}, b_bufsize = 0x8000, b_runningbufspace = 0x0, b_kvasize = 0x8000, b_dirtyoff = 0x0, b_dirtyend = 0x0, b_kvabase = 0xfffffe0007418000 "A\035", b_lblkno = 0x47fea3c0, b_vp = 0xfffff8000a8389e0, b_rcred = 0x0, b_wcred = 0x0, {b_freelist = { tqe_next = 0xfffffe00008fa908, tqe_prev = 0xffffffff81a02600}, {b_pgiodone = 0xfffffe00008fa908, b_pgbefore = 0x81a02600, b_pgafter = 0xffffffff}}, b_cluster = { cluster_head = {tqh_first = 0x0, tqh_last = 0x0}, cluster_entry = {tqe_next = 0x0, tqe_prev = 0x0}}, b_pages = 0xfffffe00008fa6d8, b_npages = 0x8, b_dep = {lh_first = 0x0}, b_fsprivate1 = 0x0, b_fsprivate2 = 0x0, b_fsprivate3 = 0x0, b_io_tracking = 0xfffffe00008fa800, b_io_tcnt = 0x26} (kgdb) f 14 #14 0xffffffff80cbb477 in reassignbuf (bp=0xfffffe00008fa530) at ../../../kern/vfs_subr.c:2445 2445 buf_vlist_add(bp, bo, BX_VNDIRTY); (kgdb) l 2440 default: 2441 delay = filedelay; 2442 } 2443 vn_syncer_add_to_worklist(bo, delay); 2444 } 2445 buf_vlist_add(bp, bo, BX_VNDIRTY); 2446 } else { 2447 buf_vlist_add(bp, bo, BX_VNCLEAN); 2448 2449 if ((bo->bo_flag & BO_ONWORKLST) && bo->bo_dirty.bv_cnt == 0) { (kgdb) f 15 #15 0xffffffff80c9532e in bdirty (bp=0xfffffe00008fa530) at ../../../kern/vfs_bio.c:2456 2456 reassignbuf(bp); (kgdb) l 2451 bp->b_flags &= ~(B_RELBUF); 2452 bp->b_iocmd = BIO_WRITE; 2453 2454 if ((bp->b_flags & B_DELWRI) == 0) { 2455 bp->b_flags |= /* XXX B_DONE | */ B_DELWRI; 2456 reassignbuf(bp); 2457 bdirtyadd(bp); 2458 } 2459 } 2460 (kgdb) f 16 #16 0xffffffff80c95182 in bdwrite (bp=0xfffffe00008fa530) at ../../../kern/vfs_bio.c:2381 2381 bdirty(bp); (kgdb) l 2376 BO_BDFLUSH(bo, bp); 2377 td->td_pflags &= ~TDP_INBDFLUSH; 2378 } else 2379 recursiveflushes++; 2380 2381 bdirty(bp); 2382 /* 2383 * Set B_CACHE, indicating that the buffer is fully valid. This is 2384 * true even of NFS now. 2385 */ (kgdb) f 17 #17 0xffffffff80eda598 in ffs_update (vp=0xfffff8000acc8000, waitfor=0x0) at ../../../ufs/ffs/ffs_inode.c:174 174 bdwrite(bp); (kgdb) p *vp $2 = {v_tag = 0xffffffff8127ae75 "ufs", v_op = 0xffffffff81b643f0, v_data = 0xfffff8000ace7000, v_mount = 0xfffff8000a835000, v_nmntvnodes = {tqe_next = 0xfffff8000acc7c58, tqe_prev = 0xfffff8000acc8298}, {v_mountedhere = 0x0, v_unpcb = 0x0, v_rdev = 0x0, v_fifoinfo = 0x0}, v_hashlist = {le_next = 0x0, le_prev = 0xfffffe009bca46a0}, v_cache_src = {lh_first = 0x0}, v_cache_dst = {tqh_first = 0xfffff8000acef150, tqh_last = 0xfffff8000acef170}, v_cache_dd = 0x0, v_lock = {lock_object = { lo_name = 0xffffffff8127ae75 "ufs", lo_flags = 0x6fb0000, lo_data = 0x0, lo_witness = 0xfffff8087fd78680}, lk_lock = 0xfffff80017163002, lk_exslpfail = 0x0, lk_timo = 0x33, lk_pri = 0x60, lk_stack = {depth = 0xc, pcs = 0xfffff8000acc80a0}}, v_interlock = {lock_object = {lo_name = 0xffffffff813a2ed7 "vnode interlock", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xfffff8087fd6b680}, mtx_lock = 0x0}, v_vnlock = 0xfffff8000acc8068, v_actfreelist = {tqe_next = 0xfffff8000a838000, tqe_prev = 0xfffff8000acc7b38}, v_bufobj = {bo_lock = {lock_object = {lo_name = 0xffffffff8136388e "bufobj interlock", lo_flags = 0x5230000, lo_data = 0x0, lo_witness = 0xfffff8087fd75a00}, rw_lock = 0x1}, bo_ops = 0xffffffff81b28f30, bo_object = 0xfffff8000acc3000, bo_synclist = {le_next = 0x0, le_prev = 0x0}, bo_private = 0xfffff8000acc8000, bo_clean = {bv_hd = {tqh_first = 0xfffffe000080b4a8, tqh_last = 0xfffffe000080b508}, bv_root = {pt_root = 0xfffffe000080b611}, bv_cnt = 0x1}, bo_dirty = {bv_hd = {tqh_first = 0x0, tqh_last = 0xfffff8000acc81d0}, bv_root = {pt_root = 0x0}, bv_cnt = 0x0}, bo_numoutput = 0x0, bo_flag = 0x0, bo_domain = 0x1, bo_bsize = 0x8000}, v_pollinfo = 0x0, v_label = 0x0, v_lockf = 0x0, v_rl = {rl_waiters = {tqh_first = 0x0, tqh_last = 0xfffff8000acc8220}, rl_currdep = 0x0}, v_cstart = 0x0, v_lasta = 0x0, v_lastw = 0x0, v_clen = 0x0, v_holdcnt = 0x4, v_usecount = 0x0, v_iflag = 0xa00, v_vflag = 0x0, v_mflag = 0x0, v_writecount = 0x0, v_hash = 0x481954a, v_type = VREG} (kgdb) -- Test scenario: misc/devfs4.sh