panic: brelse: non-VMIO buffer marked NOREUSE, vmcore. KDB: debugger backends: ddb KDB: current backend: ddb ---<>--- Copyright (c) 1992-2018 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 13.0-CURRENT #1 r342378: Sun Dec 23 13:12:03 CET 2018 pho@mercat1.netperf.freebsd.org:/usr/src/sys/amd64/compile/PHO amd64 FreeBSD clang version 7.0.1 (tags/RELEASE_701/final 349250) (based on LLVM 7.0.1) WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. Entering uma_startup with 10 boot pages configured startup_alloc from "UMA Kegs", 8 boot pages left startup_alloc from "UMA Zones", 7 boot pages left startup_alloc from "UMA Zones", 6 boot pages left startup_alloc from "UMA Zones", 5 boot pages left startup_alloc from "UMA Zones", 4 boot pages left startup_alloc from "UMA Zones", 3 boot pages left startup_alloc from "UMA Hash", 2 boot pages left startup_alloc from "UMA Zones", 1 boot pages left Entering uma_startup1 with 0 boot pages left Entering uma_startup2 with 0 boot pages left VT(vga): resolution 640x480 CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.08-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics real memory = 34359738368 (32768 MB) avail memory = 33182404608 (31645 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 12 CPUs FreeBSD/SMP: 1 package(s) x 6 core(s) x 2 hardware threads random: unblocking device. ioapic0 irqs 0-23 on motherboard ioapic1 irqs 24-47 on motherboard Launching APs: 1 9 4 7 11 6 10 3 5 2 8 Timecounter "TSC-low" frequency 1750038358 Hz quality 1000 random: entropy device external interface [ath_hal] loaded kbd1 at kbdmux0 module_register_init: MOD_LOAD (vesa, 0xffffffff8113c580, 0) error 19 random: registering fast source Intel Secure Key RNG random: fast provider: "Intel Secure Key RNG" 000.000061 [4184] netmap_init netmap: loaded module nexus0 vtvga0: on motherboard cryptosoft0: on motherboard acpi0: on motherboard acpi0: Power Button (fixed) cpu0: on acpi0 atrtc0: port 0x70-0x71,0x74-0x77 irq 8 on acpi0 atrtc0: registered as a time-of-day clock, resolution 1.000000s Event timer "RTC" frequency 32768 Hz quality 0 attimer0: port 0x40-0x43,0x50-0x53 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Event timer "HPET" frequency 14318180 Hz quality 350 Event timer "HPET1" frequency 14318180 Hz quality 340 Event timer "HPET2" frequency 14318180 Hz quality 340 Event timer "HPET3" frequency 14318180 Hz quality 340 Event timer "HPET4" frequency 14318180 Hz quality 340 Event timer "HPET5" frequency 14318180 Hz quality 340 Event timer "HPET6" frequency 14318180 Hz quality 340 Event timer "HPET7" frequency 14318180 Hz quality 340 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 pcib0: on acpi0 pci0: on pcib0 pci0: at device 11.1 (no driver attached) pci0: at device 11.2 (no driver attached) pci0: at device 16.1 (no driver attached) pci0: at device 16.6 (no driver attached) pci0: at device 18.1 (no driver attached) acpi_syscontainer0: on acpi0 acpi_syscontainer1: on acpi0 acpi_syscontainer2: on acpi0 acpi_syscontainer3: on acpi0 pcib1: port 0xcf8-0xcff on acpi0 pci1: on pcib1 pcib2: irq 26 at device 1.0 on pci1 pci2: on pcib2 pcib3: irq 32 at device 2.0 on pci1 pci3: on pcib3 pci3: at device 0.0 (no driver attached) pci3: at device 0.1 (no driver attached) pcib4: irq 40 at device 3.0 on pci1 pci4: on pcib4 pci1: at device 17.0 (no driver attached) ahci0: port 0xf110-0xf117,0xf100-0xf103,0xf0f0-0xf0f7,0xf0e0-0xf0e3,0xf020-0xf03f mem 0xfb438000-0xfb4387ff irq 16 at device 17.4 on pci1 ahci0: AHCI v1.30 with 4 6Gbps ports, Port Multiplier not supported ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahcich2: at channel 2 on ahci0 ahcich3: at channel 3 on ahci0 ahciem0: on ahci0 xhci0: mem 0xfb400000-0xfb40ffff irq 19 at device 20.0 on pci1 xhci0: 32 bytes context size, 64-bit DMA usbus0 on xhci0 usbus0: 5.0Gbps Super Speed USB v3.0 pci1: at device 22.0 (no driver attached) pci1: at device 22.1 (no driver attached) ehci0: mem 0xfb434000-0xfb4343ff irq 18 at device 26.0 on pci1 usbus1: EHCI version 1.0 usbus1 on ehci0 usbus1: 480Mbps High Speed USB v2.0 pcib5: irq 16 at device 28.0 on pci1 pci5: on pcib5 pcib6: irq 18 at device 28.2 on pci1 pci6: on pcib6 pcib7: at device 0.0 on pci6 pci7: on pcib7 vgapci0: port 0xe000-0xe07f mem 0xfa000000-0xfaffffff,0xfb000000-0xfb01ffff irq 18 at device 0.0 on pci7 vgapci0: Boot video device pcib8: irq 16 at device 28.4 on pci1 pci8: on pcib8 igb0: port 0xd020-0xd03f mem 0xfb320000-0xfb33ffff,0xfb344000-0xfb347fff irq 16 at device 0.0 on pci8 igb0: attach_pre capping queues at 8 igb0: using 1024 tx descriptors and 1024 rx descriptors igb0: msix_init qsets capped at 8 igb0: pxm cpus: 6 queue msgs: 9 admincnt: 1 igb0: queue equality override not set, capping rx_queues at 6 and tx_queues at 6 igb0: using 6 rx queues 6 tx queues igb0: Using MSIX interrupts with 7 vectors igb0: allocated for 6 tx_queues igb0: allocated for 6 rx_queues igb0: Ethernet address: 0c:c4:7a:a8:cd:da igb0: netmap queues/slots: TX 6/1024, RX 6/1024 igb1: port 0xd000-0xd01f mem 0xfb300000-0xfb31ffff,0xfb340000-0xfb343fff irq 17 at device 0.1 on pci8 igb1: attach_pre capping queues at 8 igb1: using 1024 tx descriptors and 1024 rx descriptors igb1: msix_init qsets capped at 8 igb1: pxm cpus: 6 queue msgs: 9 admincnt: 1 igb1: queue equality override not set, capping rx_queues at 6 and tx_queues at 6 igb1: using 6 rx queues 6 tx queues igb1: Using MSIX interrupts with 7 vectors igb1: allocated for 6 tx_queues igb1: allocated for 6 rx_queues igb1: Ethernet address: 0c:c4:7a:a8:cd:db igb1: netmap queues/slots: TX 6/1024, RX 6/1024 ehci1: mem 0xfb433000-0xfb4333ff irq 18 at device 29.0 on pci1 usbus2: EHCI version 1.0 usbus2 on ehci1 usbus2: 480Mbps High Speed USB v2.0 isab0: at device 31.0 on pci1 isa0: on isab0 ahci1: port 0xf070-0xf077,0xf060-0xf063,0xf050-0xf057,0xf040-0xf043,0xf000-0xf01f mem 0xfb432000-0xfb4327ff irq 16 at device 31.2 on pci1 ahci1: AHCI v1.30 with 6 6Gbps ports, Port Multiplier not supported ahcich4: at channel 0 on ahci1 ahcich5: at channel 1 on ahci1 ahcich6: at channel 2 on ahci1 ahcich7: at channel 3 on ahci1 ahcich8: at channel 4 on ahci1 ahcich9: at channel 5 on ahci1 ahciem1: on ahci1 acpi_button0: on acpi0 uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0 uart1: console (115200,n,8,1) orm0: at iomem 0xc0000-0xc7fff,0xcb000-0xcbfff pnpid ORM0000 on isa0 est0: on cpu0 p4tcc0: on cpu0 NULL mp in getnewvnode(9), tag crossmp Timecounters tick every 1.000 msec ugen0.1: <0x8086 XHCI root HUB> at usbus0 ugen1.1: at usbus1 uhub0: <0x8086 XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0 ugen2.1: at usbus2 uhub1: on usbus1 uhub2: on usbus2 Expensive timeout(9) function: 0xffffffff804cec10(0xfffffe009c007000) 0.004076010 s ses0 at ahciem0 bus 0 scbus4 target 0 lun 0 ses0: SEMB S-E-S 2.00 device ses0: SEMB SES Device ses1 at ahciem1 bus 0 scbus11 target 0 lun 0 ses1: SEMB S-E-S 2.00 device ses1: SEMB SES Device ada0 at ahcich1 bus 0 scbus1 target 0 lun 0 ada0: ACS-2 ATA SATA 3.x device ada0: Serial Number WD-WCC3F3KDDP98 ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes) ada0: Command Queueing enabled ada0: 953869MB (1953525168 512 byte sectors) ada0: quirks=0x1<4K> hwpmc: SOFT/16/64/0x67 TSC/1/64/0x20 IAP/4/48/0x3ff IAF/3/48/0x67 WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. Trying to mount root from ufs:/dev/gpt/work [rw]... Expensive timeout(9) function: 0xffffffff80a45eb0(0xffffffff81af3540) 0.007387140 s WARNING: / was not properly dismounted Interface IP-Address Broadcast Setting hostuuid: 00000000-0000-0000-0000-002590c99976. Setting hostid: 0x90b83241. ugen0.3: at usbus0 ukbd0 on uhub3 ukbd0: on usbus0 kbd2 at ukbd0 ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 1648 files, 53361 used, 1212046 free (126 frags, 151490 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/e2fsprogs 32-bit compatibility ldconfig path: /usr/lib32 Setting hostname: mercat1.netperf.freebsd.org. Setting up harvesting: PURE_RDRAND,[UMA],[FS_ATIME],SWI,INTERRUPT,NET_NG,[NET_ETHER],NET_TUN,MOUSE,KEYBOARD,ATTACH,CACHED Feeding entropy: . lo0: link state changed to UP Autoloading module: ioat.ko ioat0: mem 0xfb42c000-0xfb42ffff irq 31 at device 4.0 on pci1 ioat0: Capabilities: 2f7 ioat1: mem 0xfb428000-0xfb42bfff irq 39 at device 4.1 on pci1 ioat1: Capabilities: 2f7 ioat2: mem 0xfb424000-0xfb427fff irq 31 at device 4.2 on pci1 ioat2: Capabilities: f7 ioat4: mem 0xfb41c000-0xfb41ffff irq 31 at device 4.4 on pci1 ioat4: Capabilities: f7 ioat5: mem 0xfb418000-0xfb41bfff irq 39 at device 4.5 on pci1 ioat5: Capabilities: f7 ioat6: mem 0xfb414000-0xfb417fff irq 31 at device 4.6 on pci1 ioat6: Capabilities: f7 ioat7: mem 0xfb410000-0xfb413fff irq 39 at device 4.7 on pci1 ioat7: Capabilities: f7 Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Starting Network: igb1. igb1: flags=8802 metric 0 mtu 1500 options=e507bb ether 0c:c4:7a:a8:cd:db media: Ethernet autoselect status: no carrier nd6 options=29 Autoloading module: uhid.ko Autoloading module: ums.ko ums0 on uhub3 ums0: on usbus0 ums0: 3 buttons and [Z] coordinates ID=0 Starting dhclient. DHCPREQUEST on igb0 to 255.255.255.255 port 67 DHCPACK from 192if_delmulti_locked: detaching ifnet instance 0xfffff80003e01800 .168.5.1 bound to 192.168.5.171 -- renewal in 300 seconds. add host 127.0.0.1: gateway lo0 fib 0: route already in table add host ::1: gateway lo0 fib 0: route already in table add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Creating and/or trimming log files. Starting syslogd. Setting date via ntp. 23 Dec 13:15:06 ntpdate[2046]: step time server 192.168.5.1 offset -0.562979 sec Starting rpcbind. Starting watchdogd. No core dumps found. NFS access cache time=60 Clearing /tmp (X related). Starting statd. Starting lockd. Updating motd:. Mounting late filesystems:. Configuring vt: blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting cron. Sun Dec 23 13:15 FreeBSD/amd64 (mercat1.netperf.freebsd.org) (ttyu1) login: root Dec 23 13:15:10 mercat1 login[2302]: ROOT LOGIN (root) ON ttyu1 Last login: Sun Dec 23 12:50:27 on ttyu1 FreeBSD 13.0-CURRENT (PHO) #1 r342378: Sun Dec 23 13:12:03 CET 2018 20181223 13:15:34 all (1/1): snap11.sh panic: brelse: non-VMIO buffer marked NOREUSE cpuid = 6 time = 1545567335 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00a6b6e5e0 vpanic() at vpanic+0x1b4/frame 0xfffffe00a6b6e640 panic() at panic+0x43/frame 0xfffffe00a6b6e6a0 brelse() at brelse+0xc7/frame 0xfffffe00a6b6e720 bnoreuselist() at bnoreuselist+0x1df/frame 0xfffffe00a6b6e780 vop_stdadvise() at vop_stdadvise+0x220/frame 0xfffffe00a6b6e820 VOP_ADVISE_APV() at VOP_ADVISE_APV+0x88/frame 0xfffffe00a6b6e840 VOP_ADVISE() at VOP_ADVISE+0x4e/frame 0xfffffe00a6b6e8a0 mdstart_vnode() at mdstart_vnode+0x746/frame 0xfffffe00a6b6e9f0 md_kthread() at md_kthread+0x332/frame 0xfffffe00a6b6ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a6b6eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a6b6eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- KDB: enter: panic [ thread pid 3924 tid 100232 ] Stopped at kdb_enter+0x3b: movq $0,kdb_why db> run pho db:0:pho> set $lines 20000 db:0:pho> run pho1 db:1:pho1> bt Tracing pid 3924 tid 100232 td 0xfffff80254c1c580 kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00a6b6e5e0 vpanic() at vpanic+0x1d1/frame 0xfffffe00a6b6e640 panic() at panic+0x43/frame 0xfffffe00a6b6e6a0 brelse() at brelse+0xc7/frame 0xfffffe00a6b6e720 bnoreuselist() at bnoreuselist+0x1df/frame 0xfffffe00a6b6e780 vop_stdadvise() at vop_stdadvise+0x220/frame 0xfffffe00a6b6e820 VOP_ADVISE_APV() at VOP_ADVISE_APV+0x88/frame 0xfffffe00a6b6e840 VOP_ADVISE() at VOP_ADVISE+0x4e/frame 0xfffffe00a6b6e8a0 mdstart_vnode() at mdstart_vnode+0x746/frame 0xfffffe00a6b6e9f0 md_kthread() at md_kthread+0x332/frame 0xfffffe00a6b6ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a6b6eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a6b6eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:1:pho1> show allpcpu Current CPU: 6 cpuid = 0 dynamic pcpu = 0xd5eb00 curthread = 0xfffff800036ad000: pid 11 tid 100003 "idle: cpu0" curpcb = 0xfffffe007875ab80 fpcurthread = none idlethread = 0xfffff800036ad000: tid 100003 "idle: cpu0" curpmap = 0xffffffff82093930 tssp = 0xffffffff821cb020 commontssp = 0xffffffff821cb020 rsp0 = 0xfffffe007875ab80 gs32p = 0xffffffff821d1c58 ldt = 0xffffffff821d1c98 tss = 0xffffffff821d1c88 curvnet = 0 spin locks held: cpuid = 1 dynamic pcpu = 0xfffffe008501bb00 curthread = 0xfffff800036ac580: pid 11 tid 100004 "idle: cpu1" curpcb = 0xfffffe007875fb80 fpcurthread = none idlethread = 0xfffff800036ac580: tid 100004 "idle: cpu1" curpmap = 0xffffffff82093930 tssp = 0xffffffff821cb088 commontssp = 0xffffffff821cb088 rsp0 = 0xfffffe007875fb80 gs32p = 0xffffffff821d1cc0 ldt = 0xffffffff821d1d00 tss = 0xffffffff821d1cf0 curvnet = 0 spin locks held: cpuid = 2 dynamic pcpu = 0xfffffe0085027b00 curthread = 0xfffff800036ac000: pid 11 tid 100005 "idle: cpu2" curpcb = 0xfffffe0078764b80 fpcurthread = none idlethread = 0xfffff800036ac000: tid 100005 "idle: cpu2" curpmap = 0xffffffff82093930 tssp = 0xffffffff821cb0f0 commontssp = 0xffffffff821cb0f0 rsp0 = 0xfffffe0078764b80 gs32p = 0xffffffff821d1d28 ldt = 0xffffffff821d1d68 tss = 0xffffffff821d1d58 curvnet = 0 spin locks held: cpuid = 3 dynamic pcpu = 0xfffffe0085033b00 curthread = 0xfffff800036ab580: pid 11 tid 100006 "idle: cpu3" curpcb = 0xfffffe0078769b80 fpcurthread = none idlethread = 0xfffff800036ab580: tid 100006 "idle: cpu3" curpmap = 0xffffffff82093930 tssp = 0xffffffff821cb158 commontssp = 0xffffffff821cb158 rsp0 = 0xfffffe0078769b80 gs32p = 0xffffffff821d1d90 ldt = 0xffffffff821d1dd0 tss = 0xffffffff821d1dc0 curvnet = 0 spin locks held: cpuid = 4 dynamic pcpu = 0xfffffe008503fb00 curthread = 0xfffff800036ab000: pid 11 tid 100007 "idle: cpu4" curpcb = 0xfffffe007876eb80 fpcurthread = none idlethread = 0xfffff800036ab000: tid 100007 "idle: cpu4" curpmap = 0xffffffff82093930 tssp = 0xffffffff821cb1c0 commontssp = 0xffffffff821cb1c0 rsp0 = 0xfffffe007876eb80 gs32p = 0xffffffff821d1df8 ldt = 0xffffffff821d1e38 tss = 0xffffffff821d1e28 curvnet = 0 spin locks held: cpuid = 5 dynamic pcpu = 0xfffffe008504bb00 curthread = 0xfffff800036aa580: pid 11 tid 100008 "idle: cpu5" curpcb = 0xfffffe0078773b80 fpcurthread = none idlethread = 0xfffff800036aa580: tid 100008 "idle: cpu5" curpmap = 0xffffffff82093930 tssp = 0xffffffff821cb228 commontssp = 0xffffffff821cb228 rsp0 = 0xfffffe0078773b80 gs32p = 0xffffffff821d1e60 ldt = 0xffffffff821d1ea0 tss = 0xffffffff821d1e90 curvnet = 0 spin locks held: cpuid = 6 dynamic pcpu = 0xfffffe0085057b00 curthread = 0xfffff80254c1c580: pid 3924 tid 100232 "md11" curpcb = 0xfffffe00a6b6eb80 fpcurthread = none idlethread = 0xfffff800036aa000: tid 100009 "idle: cpu6" curpmap = 0xffffffff82093930 tssp = 0xffffffff821cb290 commontssp = 0xffffffff821cb290 rsp0 = 0xfffffe00a6b6eb80 gs32p = 0xffffffff821d1ec8 ldt = 0xffffffff821d1f08 tss = 0xffffffff821d1ef8 curvnet = 0 spin locks held: cpuid = 7 dynamic pcpu = 0xfffffe0085063b00 curthread = 0xfffff800036be580: pid 11 tid 100010 "idle: cpu7" curpcb = 0xfffffe007877db80 fpcurthread = none idlethread = 0xfffff800036be580: tid 100010 "idle: cpu7" curpmap = 0xffffffff82093930 tssp = 0xffffffff821cb2f8 commontssp = 0xffffffff821cb2f8 rsp0 = 0xfffffe007877db80 gs32p = 0xffffffff821d1f30 ldt = 0xffffffff821d1f70 tss = 0xffffffff821d1f60 curvnet = 0 spin locks held: cpuid = 8 dynamic pcpu = 0xfffffe007e6dfb00 curthread = 0xfffff8000c1f6580: pid 27 tid 100120 "rand_harvestq" curpcb = 0xfffffe0006ed4b80 fpcurthread = none idlethread = 0xfffff800036be000: tid 100011 "idle: cpu8" curpmap = 0xffffffff82093930 tssp = 0xffffffff821cb360 commontssp = 0xffffffff821cb360 rsp0 = 0xfffffe0006ed4b80 gs32p = 0xffffffff821d1f98 ldt = 0xffffffff821d1fd8 tss = 0xffffffff821d1fc8 curvnet = 0 spin locks held: cpuid = 9 dynamic pcpu = 0xfffffe007e6ebb00 curthread = 0xfffff800036bd580: pid 11 tid 100012 "idle: cpu9" curpcb = 0xfffffe0078787b80 fpcurthread = none idlethread = 0xfffff800036bd580: tid 100012 "idle: cpu9" curpmap = 0xffffffff82093930 tssp = 0xffffffff821cb3c8 commontssp = 0xffffffff821cb3c8 rsp0 = 0xfffffe0078787b80 gs32p = 0xffffffff821d2000 ldt = 0xffffffff821d2040 tss = 0xffffffff821d2030 curvnet = 0 spin locks held: cpuid = 10 dynamic pcpu = 0xfffffe007e6f7b00 curthread = 0xfffff800036bd000: pid 11 tid 100013 "idle: cpu10" curpcb = 0xfffffe007878cb80 fpcurthread = none idlethread = 0xfffff800036bd000: tid 100013 "idle: cpu10" curpmap = 0xffffffff82093930 tssp = 0xffffffff821cb430 commontssp = 0xffffffff821cb430 rsp0 = 0xfffffe007878cb80 gs32p = 0xffffffff821d2068 ldt = 0xffffffff821d20a8 tss = 0xffffffff821d2098 curvnet = 0 spin locks held: cpuid = 11 dynamic pcpu = 0xfffffe007e703b00 curthread = 0xfffff800036bc580: pid 11 tid 100014 "idle: cpu11" curpcb = 0xfffffe0078791b80 fpcurthread = none idlethread = 0xfffff800036bc580: tid 100014 "idle: cpu11" curpmap = 0xffffffff82093930 tssp = 0xffffffff821cb498 commontssp = 0xffffffff821cb498 rsp0 = 0xfffffe0078791b80 gs32p = 0xffffffff821d20d0 ldt = 0xffffffff821d2110 tss = 0xffffffff821d2100 curvnet = 0 spin locks held: db:1:pho1> show alllocks Process 3924 (md11) thread 0xfffff80254c1c580 (100232) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0000977ff8) locked @ kern/vfs_subr.c:1823 exclusive lockmgr snaplk (snaplk) r = 0 (0xfffff8000c30fa30) locked @ kern/vfs_default.c:1081 Process 3918 (sh) thread 0xfffff80254c1b580 (100248) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe00009755b0) locked @ kern/vfs_bio.c:1670 shared lockmgr ufs (ufs) r = 0 (0xfffff80254ce4cc0) locked @ kern/vfs_vnops.c:792 db:1:pho1> show lockedvnods Locked vnodes vnode 0xfffff80254ce4c58: tag ufs, type VREG usecount 1, writecount 0, refcount 3 flags (VI_ACTIVE) v_object 0xfffff80254dd2200 ref 0 pages 1 cleanbuf 1 dirtybuf 0 lock type ufs: SHARED (count 1) #0 0xffffffff80baa9fc at lockmgr_slock_hard+0x34c #1 0xffffffff80bab6a5 at __lockmgr_args+0x745 #2 0xffffffff80ef73cc at ffs_lock+0x7c #3 0xffffffff81240070 at VOP_LOCK1_APV+0x70 #4 0xffffffff80cc8865 at _vn_lock+0x65 #5 0xffffffff80ccaec6 at vn_read+0x116 #6 0xffffffff80ccad03 at vn_io_fault_doio+0x43 #7 0xffffffff80cc8f1a at vn_io_fault1+0x17a #8 0xffffffff80cc72d9 at vn_io_fault+0x189 #9 0xffffffff80c42a91 at dofileread+0x81 #10 0xffffffff80c426ca at kern_readv+0x4a #11 0xffffffff80c42676 at sys_read+0x86 #12 0xffffffff810b6e91 at amd64_syscall+0x291 #13 0xffffffff810908fd at fast_syscall_common+0x101 ino 109228428, on dev gpt/work vnode 0xfffff8000c8f5768: tag ufs, type VREG usecount 2, writecount 0, refcount 37 flags (VV_SYSTEM|VV_MD|VI_ACTIVE) v_object 0xfffff80254e23d00 ref 0 pages 0 cleanbuf 35 dirtybuf 0 lock type snaplk: EXCL by thread 0xfffff80254c1c580 (pid 3924, md11, tid 100232) #0 0xffffffff80baadfe at lockmgr_xlock_hard+0x39e #1 0xffffffff80bab553 at __lockmgr_args+0x5f3 #2 0xffffffff80ef73cc at ffs_lock+0x7c #3 0xffffffff81240070 at VOP_LOCK1_APV+0x70 #4 0xffffffff80cc8865 at _vn_lock+0x65 #5 0xffffffff80c9d509 at vop_stdadvise+0x79 #6 0xffffffff81242838 at VOP_ADVISE_APV+0x88 #7 0xffffffff806eb24e at VOP_ADVISE+0x4e #8 0xffffffff806e8e36 at mdstart_vnode+0x746 #9 0xffffffff806e6d82 at md_kthread+0x332 #10 0xffffffff80b95d14 at fork_exit+0x84 #11 0xffffffff81090ffe at fork_trampoline+0xe ino 4, on dev md10a db:1:pho1> show allchains chain 1: thread 100237 (pid 3923, mdconfig) sleeping on 0xffffffff81e94f68 "g_waitidle" chain 2: thread 100248 (pid 3918, sh) sleeping on 0xfffffe0000975530 "biord" chain 3: thread 100235 (pid 3911, md10) sleeping on 0xfffff80254608000 "mdwait" chain 4: thread 100229 (pid 3901, tee) sleeping on 0xfffff8000c8c4000 "piperd" chain 5: thread 100236 (pid 3900, sh) sleeping on 0xfffff8000c67e000 "wait" chain 6: thread 100148 (pid 3899, sh) sleeping on 0xfffff8000c1dd530 "wait" chain 7: thread 100247 (pid 3897, sleep) sleeping on 0xffffffff81e9bc13 "nanslp" chain 8: thread 100226 (pid 2449, sh) sleeping on 0xfffff8000c69e2f8 "piperd" chain 9: thread 100225 (pid 2447, awk) sleeping on 0xfffff8000c8c48e8 "piperd" chain 10: thread 100224 (pid 2446, sh) sleeping on 0xfffff8000c661a60 "wait" chain 11: thread 100202 (pid 2389, sh) sleeping on 0xfffff8000c5ed530 "wait" chain 12: thread 100171 (pid 2316, sh) sleeping on 0xfffff80003fb0a60 "wait" chain 13: thread 100191 (pid 2315, bash) sleeping on 0xfffff80003fafa60 "wait" chain 14: thread 100187 (pid 2313, csh) sleeping on 0xfffff8000c67f0a8 "pause" chain 15: thread 100192 (pid 2312, su) sleeping on 0xfffff8000c6c0000 "wait" chain 16: thread 100162 (pid 2311, bash) sleeping on 0xfffff8000c5ee000 "wait" chain 17: thread 100188 (pid 2310, sshd) sleeping on 0xfffff8000c2ad140 "select" chain 18: thread 100173 (pid 2307, sshd) sleeping on 0xfffff8000c873d40 "select" chain 19: thread 100172 (pid 2303, csh) sleeping on 0xfffff8000611fcb0 "ttyin" chain 20: thread 100199 (pid 2302, login) sleeping on 0xfffff8025465f530 "wait" chain 21: thread 100198 (pid 2301, getty) sleeping on 0xfffff800061200b0 "ttyin" chain 22: thread 100197 (pid 2300, getty) sleeping on 0xfffff8000c3488b0 "ttyin" chain 23: thread 100196 (pid 2299, getty) sleeping on 0xfffff8000c348cb0 "ttyin" chain 24: thread 100190 (pid 2298, getty) sleeping on 0xfffff8000c3490b0 "ttyin" chain 25: thread 100151 (pid 2297, getty) sleeping on 0xfffff8000c3494b0 "ttyin" chain 26: thread 100167 (pid 2296, getty) sleeping on 0xfffff8000c3498b0 "ttyin" chain 27: thread 100194 (pid 2295, getty) sleeping on 0xfffff8000c349cb0 "ttyin" chain 28: thread 100195 (pid 2294, getty) sleeping on 0xfffff8000c34a0b0 "ttyin" chain 29: thread 100142 (pid 2293, getty) sleeping on 0xfffff8000c34a4b0 "ttyin" chain 30: thread 100145 (pid 2247, cron) sleeping on 0xffffffff81e9bc11 "nanslp" chain 31: thread 100163 (pid 2243, sshd) sleeping on 0xfffff800060149c0 "select" chain 32: thread 100143 (pid 2178, NLM: master) sleeping on 0xfffff8000c2ee460 "rpcsvc" chain 33: thread 100185 (pid 2175, rpc.statd) sleeping on 0xfffff801d4031d40 "select" chain 34: thread 100174 (pid 2125, watchdogd) sleeping on 0xffffffff81e9bc16 "nanslp" chain 35: thread 100166 (pid 2049, rpcbind) sleeping on 0xfffff8000c873ec0 "select" chain 36: thread 100154 (pid 2039, syslogd) sleeping on 0xfffff8000c3d38c0 "select" chain 37: thread 100160 (pid 1968, devd) sleeping on 0xfffff801d4031cc0 "select" chain 38: thread 100184 (pid 1963, dhclient) sleeping on 0xfffff8000c873dc0 "select" chain 39: thread 100144 (pid 1919, dhclient) sleeping on 0xfffff801d4031e40 "select" chain 40: thread 100134 (pid 34, vnlru) sleeping on 0xfffff8000c1dda60 "vlruwt" chain 41: thread 100133 (pid 33, syncer) sleeping on 0xffffffff8203e040 "syncer" chain 42: thread 100132 (pid 32, bufdaemon) sleeping on 0xffffffff8203d4e8 "qsleep" chain 43: thread 100135 (pid 32, bufspacedaemon-0) sleeping on 0xffffffff81a0a880 "-" chain 44: thread 100136 (pid 32, bufspacedaemon-1) sleeping on 0xffffffff81a12b40 "-" chain 45: thread 100137 (pid 32, bufspacedaemon-2) sleeping on 0xffffffff81a1ae00 "-" chain 46: thread 100138 (pid 32, bufspacedaemon-3) sleeping on 0xffffffff81a230c0 "-" chain 47: thread 100139 (pid 32, bufspacedaemon-4) sleeping on 0xffffffff81a2b380 "-" chain 48: thread 100140 (pid 32, bufspacedaemon-5) sleeping on 0xffffffff81a33640 "-" chain 49: thread 100141 (pid 32, bufspacedaemon-6) sleeping on 0xffffffff81a3b900 "-" chain 50: thread 100152 (pid 32, / worker) sleeping on 0xfffff8000c663ce8 "sdflush" chain 51: thread 100159 (pid 32, /tmp worker) sleeping on 0xfffff8000c0da4e8 "sdflush" chain 52: thread 100249 (pid 32, /mnt worker) sleeping on 0xfffff8000c5eaae8 "sdflush" chain 53: thread 100129 (pid 31, vmdaemon) sleeping on 0xffffffff8205a348 "psleep" chain 54: thread 100128 (pid 30, dom0) sleeping on 0xffffffff820c4118 "psleep" chain 55: thread 100130 (pid 30, laundry: dom0) sleeping on 0xffffffff820c4124 "launds" chain 56: thread 100131 (pid 30, uma) sleeping on 0xffffffff80f14dd0 "umarcl" chain 57: thread 100127 (pid 29, enc_daemon1) sleeping on 0xfffff8000c0dc000 "idle" chain 58: thread 100126 (pid 28, enc_daemon0) sleeping on 0xfffff8000c0dc530 "idle" chain 59: thread 100119 (pid 26, sctp_iterator) sleeping on 0xffffffff820c2800 "waiting_for_work" chain 60: thread 100118 (pid 25, soaiod4) sleeping on 0xffffffff8203cedc "-" chain 61: thread 100117 (pid 24, soaiod3) sleeping on 0xffffffff8203cedc "-" chain 62: thread 100116 (pid 23, soaiod2) sleeping on 0xffffffff8203cedc "-" chain 63: thread 100115 (pid 22, soaiod1) sleeping on 0xffffffff8203cedc "-" chain 64: thread 100096 (pid 21, usbus0) sleeping on 0xfffffe009c1cf460 "-" chain 65: thread 100097 (pid 21, usbus0) sleeping on 0xfffffe009c1cf4b8 "-" chain 66: thread 100098 (pid 21, usbus0) sleeping on 0xfffffe009c1cf510 "-" chain 67: thread 100099 (pid 21, usbus0) sleeping on 0xfffffe009c1cf568 "-" chain 68: thread 100100 (pid 21, usbus0) sleeping on 0xfffffe009c1cf5c0 "-" chain 69: thread 100102 (pid 21, usbus1) sleeping on 0xfffffe009a006d10 "-" chain 70: thread 100103 (pid 21, usbus1) sleeping on 0xfffffe009a006d68 "-" chain 71: thread 100104 (pid 21, usbus1) sleeping on 0xfffffe009a006dc0 "-" chain 72: thread 100105 (pid 21, usbus1) sleeping on 0xfffffe009a006e18 "-" chain 73: thread 100106 (pid 21, usbus1) sleeping on 0xfffffe009a006e70 "-" chain 74: thread 100107 (pid 21, usbus2) sleeping on 0xfffffe009c65ad10 "-" chain 75: thread 100108 (pid 21, usbus2) sleeping on 0xfffffe009c65ad68 "-" chain 76: thread 100109 (pid 21, usbus2) sleeping on 0xfffffe009c65adc0 "-" chain 77: thread 100110 (pid 21, usbus2) sleeping on 0xfffffe009c65ae18 "-" chain 78: thread 100111 (pid 21, usbus2) sleeping on 0xfffffe009c65ae70 "-" chain 79: thread 100091 (pid 20, doneq0) sleeping on 0xffffffff81bd66c0 "-" chain 80: thread 100092 (pid 20, doneq1) sleeping on 0xffffffff81bd6740 "-" chain 81: thread 100093 (pid 20, doneq2) sleeping on 0xffffffff81bd67c0 "-" chain 82: thread 100125 (pid 20, scanner) sleeping on 0xffffffff81bd6588 "-" chain 83: thread 100090 (pid 19, crypto returns 11) sleeping on 0xfffff80003928450 "crypto_ret_wait" chain 84: thread 100089 (pid 18, crypto returns 10) sleeping on 0xfffff800039283f0 "crypto_ret_wait" chain 85: thread 100088 (pid 17, crypto returns 9) sleeping on 0xfffff80003928390 "crypto_ret_wait" chain 86: thread 100087 (pid 16, crypto returns 8) sleeping on 0xfffff80003928330 "crypto_ret_wait" chain 87: thread 100086 (pid 15, crypto returns 7) sleeping on 0xfffff800039282d0 "crypto_ret_wait" chain 88: thread 100085 (pid 9, crypto returns 6) sleeping on 0xfffff80003928270 "crypto_ret_wait" chain 89: thread 100084 (pid 8, crypto returns 5) sleeping on 0xfffff80003928210 "crypto_ret_wait" chain 90: thread 100083 (pid 7, crypto returns 4) sleeping on 0xfffff800039281b0 "crypto_ret_wait" chain 91: thread 100082 (pid 6, crypto returns 3) sleeping on 0xfffff80003928150 "crypto_ret_wait" chain 92: thread 100081 (pid 5, crypto returns 2) sleeping on 0xfffff800039280f0 "crypto_ret_wait" chain 93: thread 100080 (pid 4, crypto returns 1) sleeping on 0xfffff80003928090 "crypto_ret_wait" chain 94: thread 100079 (pid 3, crypto returns 0) sleeping on 0xfffff80003928030 "crypto_ret_wait" chain 95: thread 100078 (pid 2, crypto) sleeping on 0xffffffff82054950 "crypto_wait" chain 96: thread 100065 (pid 14, sequencer 00) sleeping on 0xfffff800038adc88 "seqstate" chain 97: thread 100061 (pid 13, g_event) sleeping on 0xfffff80254c14330 "gread" chain 98: thread 100062 (pid 13, g_up) sleeping on 0xffffffff82092ce0 "-" chain 99: thread 100063 (pid 13, g_down) sleeping on 0xffffffff82092cc8 "-" chain 100: thread 100002 (pid 1, init) sleeping on 0xfffff800036a9530 "wait" chain 101: thread 100001 (pid 10, audit) sleeping on 0xffffffff820c3520 "audit_worker_cv" chain 102: thread 100000 (pid 0, swapper) sleeping on 0xffffffff82092d10 "swapin" chain 103: thread 100015 (pid 0, thread taskq) sleeping on 0xfffff800036ec000 "-" chain 104: thread 100017 (pid 0, config_0) sleeping on 0xfffff800036cec00 "-" chain 105: thread 100018 (pid 0, kqueue_ctx taskq) sleeping on 0xfffff800036ebd00 "-" chain 106: thread 100019 (pid 0, aiod_kick taskq) sleeping on 0xfffff800036ebc00 "-" chain 107: thread 100022 (pid 0, if_config_tqg_0) sleeping on 0xfffff800036ce900 "-" chain 108: thread 100023 (pid 0, if_io_tqg_0) sleeping on 0xfffff800036ce800 "-" chain 109: thread 100024 (pid 0, if_io_tqg_1) sleeping on 0xfffff800036ce700 "-" chain 110: thread 100025 (pid 0, if_io_tqg_2) sleeping on 0xfffff800036ce600 "-" chain 111: thread 100026 (pid 0, if_io_tqg_3) sleeping on 0xfffff800036ce500 "-" chain 112: thread 100027 (pid 0, if_io_tqg_4) sleeping on 0xfffff800036ce400 "-" chain 113: thread 100028 (pid 0, if_io_tqg_5) sleeping on 0xfffff800036ce300 "-" chain 114: thread 100029 (pid 0, if_io_tqg_6) sleeping on 0xfffff800036ce200 "-" chain 115: thread 100030 (pid 0, if_io_tqg_7) sleeping on 0xfffff800036ce100 "-" chain 116: thread 100031 (pid 0, if_io_tqg_8) sleeping on 0xfffff800036ce000 "-" chain 117: thread 100032 (pid 0, if_io_tqg_9) sleeping on 0xfffff8000372e100 "-" chain 118: thread 100033 (pid 0, if_io_tqg_10) sleeping on 0xfffff8000372e000 "-" chain 119: thread 100034 (pid 0, if_io_tqg_11) sleeping on 0xfffff8000372de00 "-" chain 120: thread 100035 (pid 0, softirq_0) sleeping on 0xfffff8000372dd00 "-" chain 121: thread 100036 (pid 0, softirq_1) sleeping on 0xfffff8000372dc00 "-" chain 122: thread 100037 (pid 0, softirq_2) sleeping on 0xfffff8000372db00 "-" chain 123: thread 100038 (pid 0, softirq_3) sleeping on 0xfffff8000372da00 "-" chain 124: thread 100039 (pid 0, softirq_4) sleeping on 0xfffff8000372d900 "-" chain 125: thread 100040 (pid 0, softirq_5) sleeping on 0xfffff8000372d800 "-" chain 126: thread 100041 (pid 0, softirq_6) sleeping on 0xfffff8000372d700 "-" chain 127: thread 100042 (pid 0, softirq_7) sleeping on 0xfffff8000372d600 "-" chain 128: thread 100043 (pid 0, softirq_8) sleeping on 0xfffff8000372d500 "-" chain 129: thread 100044 (pid 0, softirq_9) sleeping on 0xfffff8000372d400 "-" chain 130: thread 100045 (pid 0, softirq_10) sleeping on 0xfffff8000372d300 "-" chain 131: thread 100046 (pid 0, softirq_11) sleeping on 0xfffff8000372d200 "-" chain 132: thread 100064 (pid 0, firmware taskq) sleeping on 0xfffff80003870000 "-" chain 133: thread 100066 (pid 0, crypto_0) sleeping on 0xfffff8000386fe00 "-" chain 134: thread 100067 (pid 0, crypto_1) sleeping on 0xfffff8000386fe00 "-" chain 135: thread 100068 (pid 0, crypto_2) sleeping on 0xfffff8000386fe00 "-" chain 136: thread 100069 (pid 0, crypto_3) sleeping on 0xfffff8000386fe00 "-" chain 137: thread 100070 (pid 0, crypto_4) sleeping on 0xfffff8000386fe00 "-" chain 138: thread 100071 (pid 0, crypto_5) sleeping on 0xfffff8000386fe00 "-" chain 139: thread 100072 (pid 0, crypto_6) sleeping on 0xfffff8000386fe00 "-" chain 140: thread 100073 (pid 0, crypto_7) sleeping on 0xfffff8000386fe00 "-" chain 141: thread 100074 (pid 0, crypto_8) sleeping on 0xfffff8000386fe00 "-" chain 142: thread 100075 (pid 0, crypto_9) sleeping on 0xfffff8000386fe00 "-" chain 143: thread 100076 (pid 0, crypto_10) sleeping on 0xfffff8000386fe00 "-" chain 144: thread 100077 (pid 0, crypto_11) sleeping on 0xfffff8000386fe00 "-" chain 145: thread 100114 (pid 0, mca taskq) blocked on lockmgr (null)EXCL KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00a6b6dcf0 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00a6b6dd00 trap() at trap+0x5b/frame 0xfffffe00a6b6de10 calltrap() at calltrap+0x8/frame 0xfffffe00a6b6de10 --- trap 0xc, rip = 0xffffffff80c365ca, rsp = 0xfffffe00a6b6dee0, rbp = 0xfffffe00a6b6df00 --- print_lockchain() at print_lockchain+0x3a/frame 0xfffffe00a6b6df00 db_show_allchains() at db_show_allchains+0x80/frame 0xfffffe00a6b6df30 db_command() at db_command+0x279/frame 0xfffffe00a6b6e000 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00a6b6e0a0 db_command() at db_command+0x279/frame 0xfffffe00a6b6e170 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00a6b6e210 db_command() at db_command+0x279/frame 0xfffffe00a6b6e2e0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00a6b6e2f0 db_trap() at db_trap+0xef/frame 0xfffffe00a6b6e380 kdb_trap() at kdb_trap+0x174/frame 0xfffffe00a6b6e3f0 trap() at trap+0x80b/frame 0xfffffe00a6b6e500 calltrap() at calltrap+0x8/frame 0xfffffe00a6b6e500 --- trap 0x3, rip = 0xffffffff80c1ddcb, rsp = 0xfffffe00a6b6e5d0, rbp = 0xfffffe00a6b6e5e0 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00a6b6e5e0 vpanic() at vpanic+0x1d1/frame 0xfffffe00a6b6e640 panic() at panic+0x43/frame 0xfffffe00a6b6e6a0 brelse() at brelse+0xc7/frame 0xfffffe00a6b6e720 bnoreuselist() at bnoreuselist+0x1df/frame 0xfffffe00a6b6e780 vop_stdadvise() at vop_stdadvise+0x220/frame 0xfffffe00a6b6e820 VOP_ADVISE_APV() at VOP_ADVISE_APV+0x88/frame 0xfffffe00a6b6e840 VOP_ADVISE() at VOP_ADVISE+0x4e/frame 0xfffffe00a6b6e8a0 mdstart_vnode() at mdstart_vnode+0x746/frame 0xfffffe00a6b6e9f0 md_kthread() at md_kthread+0x332/frame 0xfffffe00a6b6ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a6b6eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a6b6eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Script command 'show allchains' returned error db:1:pho1> show mount 0xfffff8000c552000 /dev/gpt/work on / (ufs) 0xfffff8000c553000 devfs on /dev (devfs) 0xfffff8000ca15000 /dev/gpt/tmp on /tmp (ufs) 0xfffff80254ee4000 /dev/md10a on /mnt (ufs) More info: show mount db:1:pho1> show bufqueues bqempty: 104579 Buf domain 0 freebufs 15011 lofreebufs 219 hifreebufs 329 bufspace 1957888 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 25 (110592) dirtyq count 0 (0) wakeup 0 lim 25 CPU 2, 14, 15, 6, 7, 8, 2, 20, 11, 1, 8, 3, Locked buffers: 0 space 0 Total buffers: 145 space 1957888 Buf domain 1 freebufs 14852 lofreebufs 219 hifreebufs 329 bufspace 7122944 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 28 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 167 (4395008) dirtyq count 28 (888832) wakeup 0 lim 25 CPU 0, 11, 0, 6, 18, 7, 9, 10, 9, 0, 10, 5, Locked buffers: 1 space 4096 Total buffers: 281 space 7122944 Buf domain 2 freebufs 15000 lofreebufs 219 hifreebufs 329 bufspace 2625536 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 50 (954368) dirtyq count 0 (0) wakeup 0 lim 25 CPU 2, 18, 17, 8, 8, 6, 0, 5, 8, 2, 6, 3, Locked buffers: 0 space 0 Total buffers: 133 space 2625536 Buf domain 3 freebufs 14868 lofreebufs 219 hifreebufs 329 bufspace 6692864 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 2 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 174 (4558848) dirtyq count 2 (8192) wakeup 0 lim 25 CPU 2, 16, 6, 5, 5, 17, 2, 5, 3, 6, 19, 3, Locked buffers: 0 space 0 Total buffers: 266 space 6692864 Buf domain 4 freebufs 14912 lofreebufs 219 hifreebufs 329 bufspace 5214208 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 1 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 95 (2297856) dirtyq count 1 (32768) wakeup 0 lim 25 CPU 1, 23, 22, 3, 17, 8, 12, 6, 6, 4, 16, 7, Locked buffers: 1 space 32768 Total buffers: 228 space 5214208 Buf domain 5 freebufs 14997 lofreebufs 219 hifreebufs 329 bufspace 2330624 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 50 (651264) dirtyq count 0 (0) wakeup 0 lim 25 CPU 4, 9, 0, 5, 5, 13, 9, 11, 6, 3, 14, 7, Locked buffers: 0 space 0 Total buffers: 136 space 2330624 Buf domain 6 freebufs 15027 lofreebufs 219 hifreebufs 329 bufspace 1433600 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 1 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 24 (106496) dirtyq count 1 (4096) wakeup 0 lim 25 CPU 4, 9, 11, 4, 8, 10, 3, 21, 2, 1, 4, 4, Locked buffers: 0 space 0 Total buffers: 106 space 1433600 db:1:pho1> show page vm_cnt.v_free_count: 8005802 vm_cnt.v_inactive_count: 676 vm_cnt.v_active_count: 8702 vm_cnt.v_laundry_count: 0 vm_cnt.v_wire_count: 109686 vm_cnt.v_free_reserved: 10649 vm_cnt.v_free_min: 51289 vm_cnt.v_free_target: 173209 vm_cnt.v_inactive_target: 259813 db:1:pho1> show pageq pq_free 8005802 dom 0 page_cnt 8128423 free 8005802 pq_act 8702 pq_inact 676 pq_laund 0 pq_unsw 0 db:0:pho> show freepages DOMAIN: 0 FREE LIST 0: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 001934 | 000000 11 (008192K) | 000000 | 000001 10 (004096K) | 000000 | 000001 09 (002048K) | 000000 | 000001 08 (001024K) | 000001 | 000001 07 (000512K) | 000000 | 000001 06 (000256K) | 000000 | 000001 05 (000128K) | 000000 | 000000 04 (000064K) | 000000 | 000001 03 (000032K) | 000001 | 000001 02 (000016K) | 000001 | 000001 01 (000008K) | 000001 | 000001 00 (000004K) | 000000 | 000001 FREE LIST 1: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000000 | 000000 09 (002048K) | 000000 | 000000 08 (001024K) | 000000 | 000000 07 (000512K) | 000000 | 000000 06 (000256K) | 000001 | 000000 05 (000128K) | 000001 | 000000 04 (000064K) | 000002 | 000000 03 (000032K) | 000000 | 000000 02 (000016K) | 000001 | 000000 01 (000008K) | 000000 | 000000 00 (000004K) | 000001 | 000000 db:0:pho> acttrace Tracing command md11 pid 3924 tid 100232 td 0xfffff80254c1c580 (CPU 6) kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00a6b6e5e0 vpanic() at vpanic+0x1d1/frame 0xfffffe00a6b6e640 panic() at panic+0x43/frame 0xfffffe00a6b6e6a0 brelse() at brelse+0xc7/frame 0xfffffe00a6b6e720 bnoreuselist() at bnoreuselist+0x1df/frame 0xfffffe00a6b6e780 vop_stdadvise() at vop_stdadvise+0x220/frame 0xfffffe00a6b6e820 VOP_ADVISE_APV() at VOP_ADVISE_APV+0x88/frame 0xfffffe00a6b6e840 VOP_ADVISE() at VOP_ADVISE+0x4e/frame 0xfffffe00a6b6e8a0 mdstart_vnode() at mdstart_vnode+0x746/frame 0xfffffe00a6b6e9f0 md_kthread() at md_kthread+0x332/frame 0xfffffe00a6b6ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a6b6eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a6b6eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command rand_harvestq pid 27 tid 100120 td 0xfffff8000c1f6580 (CPU 8) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000274df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000274e10 trap() at trap+0x48/frame 0xfffffe0000274f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000274f20 --- trap 0x13, rip = 0xffffffff811accd9, rsp = 0xfffffe0006ed4a18, rbp = 0xfffffe0006ed4a70 --- random_ivy_read() at random_ivy_read+0x19/frame 0xfffffe0006ed4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ed4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ed4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100003 td 0xfffff800036ad000 (CPU 0) cpustop_handler() at cpustop_handler+0x28/frame 0xffffffff8205e6b0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xffffffff8205e6d0 trap() at trap+0x48/frame 0xffffffff8205e7e0 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff8205e7e0 --- trap 0x13, rip = 0xffffffff81223366, rsp = 0xfffffe007875a900, rbp = 0xfffffe007875a900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007875a900 acpi_cpu_idle() at acpi_cpu_idle+0x23f/frame 0xfffffe007875a950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007875a970 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe007875a990 sched_idletd() at sched_idletd+0x482/frame 0xfffffe007875aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe007875aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007875aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffff800036ac580 (CPU 1) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006bb0df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006bb0e10 trap() at trap+0x48/frame 0xfffffe0006bb0f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bb0f20 --- trap 0x13, rip = 0xffffffff81223366, rsp = 0xfffffe007875f900, rbp = 0xfffffe007875f900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007875f900 acpi_cpu_idle() at acpi_cpu_idle+0x23f/frame 0xfffffe007875f950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007875f970 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe007875f990 sched_idletd() at sched_idletd+0x482/frame 0xfffffe007875fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe007875fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007875fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffff800036ac000 (CPU 2) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006bbcdf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006bbce10 trap() at trap+0x48/frame 0xfffffe0006bbcf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bbcf20 --- trap 0x13, rip = 0xffffffff81223a96, rsp = 0xfffffe0078764980, rbp = 0xfffffe0078764990 --- cpu_idle() at cpu_idle+0xf6/frame 0xfffffe0078764990 sched_idletd() at sched_idletd+0x482/frame 0xfffffe0078764a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078764ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078764ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffff800036ab580 (CPU 3) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006bc8df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006bc8e10 trap() at trap+0x48/frame 0xfffffe0006bc8f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bc8f20 --- trap 0x13, rip = 0xffffffff81223366, rsp = 0xfffffe0078769900, rbp = 0xfffffe0078769900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0078769900 acpi_cpu_idle() at acpi_cpu_idle+0x23f/frame 0xfffffe0078769950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0078769970 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe0078769990 sched_idletd() at sched_idletd+0x482/frame 0xfffffe0078769a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078769ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078769ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffff800036ab000 (CPU 4) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006bd4df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006bd4e10 trap() at trap+0x48/frame 0xfffffe0006bd4f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bd4f20 --- trap 0x13, rip = 0xffffffff81223a96, rsp = 0xfffffe007876e980, rbp = 0xfffffe007876e990 --- cpu_idle() at cpu_idle+0xf6/frame 0xfffffe007876e990 sched_idletd() at sched_idletd+0x482/frame 0xfffffe007876ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe007876eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007876eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffff800036aa580 (CPU 5) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006be0df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006be0e10 trap() at trap+0x48/frame 0xfffffe0006be0f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006be0f20 --- trap 0x13, rip = 0xffffffff81223366, rsp = 0xfffffe0078773900, rbp = 0xfffffe0078773900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0078773900 acpi_cpu_idle() at acpi_cpu_idle+0x23f/frame 0xfffffe0078773950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0078773970 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe0078773990 sched_idletd() at sched_idletd+0x482/frame 0xfffffe0078773a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078773ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078773ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffff800036be580 (CPU 7) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006bf8df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006bf8e10 trap() at trap+0x48/frame 0xfffffe0006bf8f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bf8f20 --- trap 0x13, rip = 0xffffffff81223366, rsp = 0xfffffe007877d900, rbp = 0xfffffe007877d900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007877d900 acpi_cpu_idle() at acpi_cpu_idle+0x23f/frame 0xfffffe007877d950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007877d970 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe007877d990 sched_idletd() at sched_idletd+0x482/frame 0xfffffe007877da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007877dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007877dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffff800036bd580 (CPU 9) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000280df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000280e10 trap() at trap+0x48/frame 0xfffffe0000280f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000280f20 --- trap 0x13, rip = 0xffffffff81223366, rsp = 0xfffffe0078787900, rbp = 0xfffffe0078787900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0078787900 acpi_cpu_idle() at acpi_cpu_idle+0x23f/frame 0xfffffe0078787950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0078787970 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe0078787990 sched_idletd() at sched_idletd+0x482/frame 0xfffffe0078787a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078787ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078787ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffff800036bd000 (CPU 10) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe000028cdf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe000028ce10 trap() at trap+0x48/frame 0xfffffe000028cf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe000028cf20 --- trap 0x13, rip = 0xffffffff81223366, rsp = 0xfffffe007878c900, rbp = 0xfffffe007878c900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007878c900 acpi_cpu_idle() at acpi_cpu_idle+0x23f/frame 0xfffffe007878c950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007878c970 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe007878c990 sched_idletd() at sched_idletd+0x482/frame 0xfffffe007878ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe007878cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007878cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffff800036bc580 (CPU 11) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000298df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000298e10 trap() at trap+0x48/frame 0xfffffe0000298f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000298f20 --- trap 0x13, rip = 0xffffffff81223366, rsp = 0xfffffe0078791900, rbp = 0xfffffe0078791900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0078791900 acpi_cpu_idle() at acpi_cpu_idle+0x23f/frame 0xfffffe0078791950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0078791970 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe0078791990 sched_idletd() at sched_idletd+0x482/frame 0xfffffe0078791a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078791ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078791ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:pho> ps pid ppid pgrp uid state wmesg wchan cmd 3924 0 0 0 RL CPU 6 [md11] 3923 3900 2316 0 D+ g_waiti 0xffffffff81e94f68 mdconfig 3918 3900 2316 0 D+ biord 0xfffffe0000975530 sh 3911 0 0 0 DL mdwait 0xfffff80254608000 [md10] 3901 2316 2316 0 S+ piperd 0xfffff8000c8c4000 tee 3900 3899 2316 0 S+ wait 0xfffff8000c67e000 sh 3899 2316 2316 0 S+ wait 0xfffff8000c1dd530 sh 3897 2446 2389 0 S nanslp 0xffffffff81e9bc13 sleep 2449 2389 2389 0 S piperd 0xfffff8000c69e2f8 sh 2447 2389 2389 0 S piperd 0xfffff8000c8c48e8 awk 2446 2389 2389 0 S wait 0xfffff8000c661a60 sh 2389 1 2389 0 Ss wait 0xfffff8000c5ed530 sh 2316 2315 2316 0 S+ wait 0xfffff80003fb0a60 sh 2315 2313 2315 0 S+ wait 0xfffff80003fafa60 bash 2313 2312 2313 0 S+ pause 0xfffff8000c67f0a8 csh 2312 2311 2312 2006 S+ wait 0xfffff8000c6c0000 su 2311 2310 2311 2006 Ss+ wait 0xfffff8000c5ee000 bash 2310 2307 2307 2006 S select 0xfffff8000c2ad140 sshd 2307 2243 2307 0 Ss select 0xfffff8000c873d40 sshd 2303 2302 2303 0 S+ ttyin 0xfffff8000611fcb0 csh 2302 1 2302 0 Ss+ wait 0xfffff8025465f530 login 2301 1 2301 0 Ss+ ttyin 0xfffff800061200b0 getty 2300 1 2300 0 Ss+ ttyin 0xfffff8000c3488b0 getty 2299 1 2299 0 Ss+ ttyin 0xfffff8000c348cb0 getty 2298 1 2298 0 Ss+ ttyin 0xfffff8000c3490b0 getty 2297 1 2297 0 Ss+ ttyin 0xfffff8000c3494b0 getty 2296 1 2296 0 Ss+ ttyin 0xfffff8000c3498b0 getty 2295 1 2295 0 Ss+ ttyin 0xfffff8000c349cb0 getty 2294 1 2294 0 Ss+ ttyin 0xfffff8000c34a0b0 getty 2293 1 2293 0 Ss+ ttyin 0xfffff8000c34a4b0 getty 2247 1 2247 0 Ss nanslp 0xffffffff81e9bc11 cron 2243 1 2243 0 Ss select 0xfffff800060149c0 sshd 2178 1 2178 0 Ss rpcsvc 0xfffff8000c2ee460 NLM: master 2175 1 2175 0 Ss select 0xfffff801d4031d40 rpc.statd 2125 1 2125 0 Ss nanslp 0xffffffff81e9bc16 watchdogd 2049 1 2049 0 Ss select 0xfffff8000c873ec0 rpcbind 2039 1 2039 0 Ss select 0xfffff8000c3d38c0 syslogd 1968 1 1968 0 Ss select 0xfffff801d4031cc0 devd 1963 1 1963 65 Ss select 0xfffff8000c873dc0 dhclient 1919 1 1919 0 Ss select 0xfffff801d4031e40 dhclient 34 0 0 0 DL vlruwt 0xfffff8000c1dda60 [vnlru] 33 0 0 0 DL syncer 0xffffffff8203e040 [syncer] 32 0 0 0 DL (threaded) [bufdaemon] 100132 D qsleep 0xffffffff8203d4e8 [bufdaemon] 100135 D - 0xffffffff81a0a880 [bufspacedaemon-0] 100136 D - 0xffffffff81a12b40 [bufspacedaemon-1] 100137 D - 0xffffffff81a1ae00 [bufspacedaemon-2] 100138 D - 0xffffffff81a230c0 [bufspacedaemon-3] 100139 D - 0xffffffff81a2b380 [bufspacedaemon-4] 100140 D - 0xffffffff81a33640 [bufspacedaemon-5] 100141 D - 0xffffffff81a3b900 [bufspacedaemon-6] 100152 D sdflush 0xfffff8000c663ce8 [/ worker] 100159 D sdflush 0xfffff8000c0da4e8 [/tmp worker] 100249 D sdflush 0xfffff8000c5eaae8 [/mnt worker] 31 0 0 0 DL psleep 0xffffffff8205a348 [vmdaemon] 30 0 0 0 DL (threaded) [pagedaemon] 100128 D psleep 0xffffffff820c4118 [dom0] 100130 D launds 0xffffffff820c4124 [laundry: dom0] 100131 D umarcl 0xffffffff80f14dd0 [uma] 29 0 0 0 DL idle 0xfffff8000c0dc000 [enc_daemon1] 28 0 0 0 DL idle 0xfffff8000c0dc530 [enc_daemon0] 27 0 0 0 RL CPU 8 [rand_harvestq] 26 0 0 0 DL waiting 0xffffffff820c2800 [sctp_iterator] 25 0 0 0 DL - 0xffffffff8203cedc [soaiod4] 24 0 0 0 DL - 0xffffffff8203cedc [soaiod3] 23 0 0 0 DL - 0xffffffff8203cedc [soaiod2] 22 0 0 0 DL - 0xffffffff8203cedc [soaiod1] 21 0 0 0 DL (threaded) [usb] 100096 D - 0xfffffe009c1cf460 [usbus0] 100097 D - 0xfffffe009c1cf4b8 [usbus0] 100098 D - 0xfffffe009c1cf510 [usbus0] 100099 D - 0xfffffe009c1cf568 [usbus0] 100100 D - 0xfffffe009c1cf5c0 [usbus0] 100102 D - 0xfffffe009a006d10 [usbus1] 100103 D - 0xfffffe009a006d68 [usbus1] 100104 D - 0xfffffe009a006dc0 [usbus1] 100105 D - 0xfffffe009a006e18 [usbus1] 100106 D - 0xfffffe009a006e70 [usbus1] 100107 D - 0xfffffe009c65ad10 [usbus2] 100108 D - 0xfffffe009c65ad68 [usbus2] 100109 D - 0xfffffe009c65adc0 [usbus2] 100110 D - 0xfffffe009c65ae18 [usbus2] 100111 D - 0xfffffe009c65ae70 [usbus2] 20 0 0 0 DL (threaded) [cam] 100091 D - 0xffffffff81bd66c0 [doneq0] 100092 D - 0xffffffff81bd6740 [doneq1] 100093 D - 0xffffffff81bd67c0 [doneq2] 100125 D - 0xffffffff81bd6588 [scanner] 19 0 0 0 DL crypto_ 0xfffff80003928450 [crypto returns 11] 18 0 0 0 DL crypto_ 0xfffff800039283f0 [crypto returns 10] 17 0 0 0 DL crypto_ 0xfffff80003928390 [crypto returns 9] 16 0 0 0 DL crypto_ 0xfffff80003928330 [crypto returns 8] 15 0 0 0 DL crypto_ 0xfffff800039282d0 [crypto returns 7] 9 0 0 0 DL crypto_ 0xfffff80003928270 [crypto returns 6] 8 0 0 0 DL crypto_ 0xfffff80003928210 [crypto returns 5] 7 0 0 0 DL crypto_ 0xfffff800039281b0 [crypto returns 4] 6 0 0 0 DL crypto_ 0xfffff80003928150 [crypto returns 3] 5 0 0 0 DL crypto_ 0xfffff800039280f0 [crypto returns 2] 4 0 0 0 DL crypto_ 0xfffff80003928090 [crypto returns 1] 3 0 0 0 DL crypto_ 0xfffff80003928030 [crypto returns 0] 2 0 0 0 DL crypto_ 0xffffffff82054950 [crypto] 14 0 0 0 DL seqstat 0xfffff800038adc88 [sequencer 00] 13 0 0 0 DL (threaded) [geom] 100061 D gread 0xfffff80254c14330 [g_event] 100062 D - 0xffffffff82092ce0 [g_up] 100063 D - 0xffffffff82092cc8 [g_down] 12 0 0 0 WL (threaded) [intr] 100016 I [swi5: fast taskq] 100020 I [swi6: task queue] 100021 I [swi6: Giant taskq] 100047 I [swi4: clock (0)] 100048 I [swi4: clock (1)] 100049 I [swi4: clock (2)] 100050 I [swi4: clock (3)] 100051 I [swi4: clock (4)] 100052 I [swi4: clock (5)] 100053 I [swi4: clock (6)] 100054 I [swi4: clock (7)] 100055 I [swi4: clock (8)] 100056 I [swi4: clock (9)] 100057 I [swi4: clock (10)] 100058 I [swi4: clock (11)] 100059 I [swi1: netisr 0] 100060 I [swi3: vm] 100094 I [irq56: ahci0] 100095 I [irq19: xhci0] 100101 I [irq18: ehci0 ehci1] 100112 I [irq71: ahci1] 100113 I [swi0: uart uart] 100176 I [irq72: ioat0] 100177 I [irq73: ioat1] 100178 I [irq74: ioat2] 100179 I [irq75: ioat3] 100180 I [irq76: ioat4] 100181 I [irq77: ioat5] 100182 I [irq78: ioat6] 100183 I [irq79: ioat7] 11 0 0 0 RL (threaded) [idle] 100003 Run CPU 0 [idle: cpu0] 100004 Run CPU 1 [idle: cpu1] 100005 Run CPU 2 [idle: cpu2] 100006 Run CPU 3 [idle: cpu3] 100007 Run CPU 4 [idle: cpu4] 100008 Run CPU 5 [idle: cpu5] 100009 CanRun [idle: cpu6] 100010 Run CPU 7 [idle: cpu7] 100011 CanRun [idle: cpu8] 100012 Run CPU 9 [idle: cpu9] 100013 Run CPU 10 [idle: cpu10] 100014 Run CPU 11 [idle: cpu11] 1 0 1 0 SLs wait 0xfffff800036a9530 [init] 10 0 0 0 DL audit_w 0xffffffff820c3520 [audit] 0 0 0 0 DLs (threaded) [kernel] 100000 D swapin 0xffffffff82092d10 [swapper] 100015 D - 0xfffff800036ec000 [thread taskq] 100017 D - 0xfffff800036cec00 [config_0] 100018 D - 0xfffff800036ebd00 [kqueue_ctx taskq] 100019 D - 0xfffff800036ebc00 [aiod_kick taskq] 100022 D - 0xfffff800036ce900 [if_config_tqg_0] 100023 D - 0xfffff800036ce800 [if_io_tqg_0] 100024 D - 0xfffff800036ce700 [if_io_tqg_1] 100025 D - 0xfffff800036ce600 [if_io_tqg_2] 100026 D - 0xfffff800036ce500 [if_io_tqg_3] 100027 D - 0xfffff800036ce400 [if_io_tqg_4] 100028 D - 0xfffff800036ce300 [if_io_tqg_5] 100029 D - 0xfffff800036ce200 [if_io_tqg_6] 100030 D - 0xfffff800036ce100 [if_io_tqg_7] 100031 D - 0xfffff800036ce000 [if_io_tqg_8] 100032 D - 0xfffff8000372e100 [if_io_tqg_9] 100033 D - 0xfffff8000372e000 [if_io_tqg_10] 100034 D - 0xfffff8000372de00 [if_io_tqg_11] 100035 D - 0xfffff8000372dd00 [softirq_0] 100036 D - 0xfffff8000372dc00 [softirq_1] 100037 D - 0xfffff8000372db00 [softirq_2] 100038 D - 0xfffff8000372da00 [softirq_3] 100039 D - 0xfffff8000372d900 [softirq_4] 100040 D - 0xfffff8000372d800 [softirq_5] 100041 D - 0xfffff8000372d700 [softirq_6] 100042 D - 0xfffff8000372d600 [softirq_7] 100043 D - 0xfffff8000372d500 [softirq_8] 100044 D - 0xfffff8000372d400 [softirq_9] 100045 D - 0xfffff8000372d300 [softirq_10] 100046 D - 0xfffff8000372d200 [softirq_11] 100064 D - 0xfffff80003870000 [firmware taskq] 100066 D - 0xfffff8000386fe00 [crypto_0] 100067 D - 0xfffff8000386fe00 [crypto_1] 100068 D - 0xfffff8000386fe00 [crypto_2] 100069 D - 0xfffff8000386fe00 [crypto_3] 100070 D - 0xfffff8000386fe00 [crypto_4] 100071 D - 0xfffff8000386fe00 [crypto_5] 100072 D - 0xfffff8000386fe00 [crypto_6] 100073 D - 0xfffff8000386fe00 [crypto_7] 100074 D - 0xfffff8000386fe00 [crypto_8] 100075 D - 0xfffff8000386fe00 [crypto_9] 100076 D - 0xfffff8000386fe00 [crypto_10] 100077 D - 0xfffff8000386fe00 [crypto_11] 100114 D - 0xfffff80006029000 [mca taskq] 100121 D - 0xfffff8000c17f200 [acpi_task_0] 100122 D - 0xfffff8000c17f200 [acpi_task_1] 100123 D - 0xfffff8000c17f200 [acpi_task_2] 100124 D - 0xfffff8000386fb00 [CAM taskq] db:0:pho> allt Tracing command md11 pid 3924 tid 100232 td 0xfffff80254c1c580 (CPU 6) kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00a6b6e5e0 vpanic() at vpanic+0x1d1/frame 0xfffffe00a6b6e640 panic() at panic+0x43/frame 0xfffffe00a6b6e6a0 brelse() at brelse+0xc7/frame 0xfffffe00a6b6e720 bnoreuselist() at bnoreuselist+0x1df/frame 0xfffffe00a6b6e780 vop_stdadvise() at vop_stdadvise+0x220/frame 0xfffffe00a6b6e820 VOP_ADVISE_APV() at VOP_ADVISE_APV+0x88/frame 0xfffffe00a6b6e840 VOP_ADVISE() at VOP_ADVISE+0x4e/frame 0xfffffe00a6b6e8a0 mdstart_vnode() at mdstart_vnode+0x746/frame 0xfffffe00a6b6e9f0 md_kthread() at md_kthread+0x332/frame 0xfffffe00a6b6ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a6b6eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a6b6eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command mdconfig pid 3923 tid 100237 td 0xfffff8000c686580 sched_switch() at sched_switch+0x71a/frame 0xfffffe00a6b877c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00a6b877f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a6b87830 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00a6b87870 _sleep() at _sleep+0x279/frame 0xfffffe00a6b87910 g_waitidle() at g_waitidle+0xa1/frame 0xfffffe00a6b87930 userret() at userret+0x322/frame 0xfffffe00a6b87990 amd64_syscall() at amd64_syscall+0x520/frame 0xfffffe00a6b87ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a6b87ab0 --- syscall (0, FreeBSD ELF64, nosys), rip = 0x80043efca, rsp = 0x7fffffffe638, rbp = 0x7fffffffe6a0 --- Tracing command sh pid 3918 tid 100248 td 0xfffff80254c1b580 sched_switch() at sched_switch+0x71a/frame 0xfffffe00a6bbe2b0 mi_switch() at mi_switch+0x174/frame 0xfffffe00a6bbe2e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a6bbe320 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00a6bbe350 _sleep() at _sleep+0x2da/frame 0xfffffe00a6bbe3f0 bwait() at bwait+0xac/frame 0xfffffe00a6bbe450 bufwait() at bufwait+0x32/frame 0xfffffe00a6bbe480 breadn_flags() at breadn_flags+0x2a3/frame 0xfffffe00a6bbe540 ffs_read() at ffs_read+0x1eb/frame 0xfffffe00a6bbe5f0 VOP_READ_APV() at VOP_READ_APV+0x82/frame 0xfffffe00a6bbe610 vn_read() at vn_read+0x1f1/frame 0xfffffe00a6bbe690 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00a6bbe6f0 vn_io_fault1() at vn_io_fault1+0x17a/frame 0xfffffe00a6bbe840 vn_io_fault() at vn_io_fault+0x189/frame 0xfffffe00a6bbe8b0 dofileread() at dofileread+0x81/frame 0xfffffe00a6bbe900 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a6bbe940 sys_read() at sys_read+0x86/frame 0xfffffe00a6bbe990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a6bbeab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a6bbeab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80047df2a, rsp = 0x7fffffffe198, rbp = 0x7fffffffe1e0 --- Tracing command md10 pid 3911 tid 100235 td 0xfffff8000cbb7580 sched_switch() at sched_switch+0x71a/frame 0xfffffe00a6b7d8b0 mi_switch() at mi_switch+0x174/frame 0xfffffe00a6b7d8e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a6b7d920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00a6b7d950 _sleep() at _sleep+0x2da/frame 0xfffffe00a6b7d9f0 md_kthread() at md_kthread+0x1a3/frame 0xfffffe00a6b7da70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a6b7dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a6b7dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command tee pid 3901 tid 100229 td 0xfffff8000c878580 sched_switch() at sched_switch+0x71a/frame 0xfffffe00a6b5f6b0 mi_switch() at mi_switch+0x174/frame 0xfffffe00a6b5f6e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a6b5f720 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00a6b5f780 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a6b5f7b0 _sleep() at _sleep+0x2d0/frame 0xfffffe00a6b5f850 pipe_read() at pipe_read+0x35a/frame 0xfffffe00a6b5f8b0 dofileread() at dofileread+0x81/frame 0xfffffe00a6b5f900 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a6b5f940 sys_read() at sys_read+0x86/frame 0xfffffe00a6b5f990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a6b5fab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a6b5fab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80041bf2a, rsp = 0x7fffffffe6b8, rbp = 0x7fffffffe700 --- Tracing command sh pid 3900 tid 100236 td 0xfffff8000c7a0000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00a6b82570 mi_switch() at mi_switch+0x174/frame 0xfffffe00a6b825a0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a6b825e0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00a6b82640 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a6b82670 _sleep() at _sleep+0x2d0/frame 0xfffffe00a6b82710 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00a6b827a0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00a6b82990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a6b82ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a6b82ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040cf9a, rsp = 0x7fffffffe248, rbp = 0x7fffffffe300 --- Tracing command sh pid 3899 tid 100148 td 0xfffff8000c563000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006f6c570 mi_switch() at mi_switch+0x174/frame 0xfffffe0006f6c5a0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f6c5e0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe0006f6c640 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe0006f6c670 _sleep() at _sleep+0x2d0/frame 0xfffffe0006f6c710 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe0006f6c7a0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe0006f6c990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe0006f6cab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0006f6cab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040cf9a, rsp = 0x7fffffffe258, rbp = 0x7fffffffe310 --- Tracing command sleep pid 3897 tid 100247 td 0xfffff80254ccf580 sched_switch() at sched_switch+0x71a/frame 0xfffffe00a6bb9710 mi_switch() at mi_switch+0x174/frame 0xfffffe00a6bb9740 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a6bb9780 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00a6bb97e0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00a6bb9820 _sleep() at _sleep+0x265/frame 0xfffffe00a6bb98c0 kern_clock_nanosleep() at kern_clock_nanosleep+0x207/frame 0xfffffe00a6bb9950 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00a6bb9990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a6bb9ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a6bb9ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003ab11a, rsp = 0x7fffffffe6a8, rbp = 0x7fffffffe6f0 --- Tracing command sh pid 2449 tid 100226 td 0xfffff80254d87000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00a6b506b0 mi_switch() at mi_switch+0x174/frame 0xfffffe00a6b506e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a6b50720 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00a6b50780 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a6b507b0 _sleep() at _sleep+0x2d0/frame 0xfffffe00a6b50850 pipe_read() at pipe_read+0x35a/frame 0xfffffe00a6b508b0 dofileread() at dofileread+0x81/frame 0xfffffe00a6b50900 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a6b50940 sys_read() at sys_read+0x86/frame 0xfffffe00a6b50990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a6b50ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a6b50ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80047df2a, rsp = 0x7fffffffe228, rbp = 0x7fffffffe330 --- Tracing command awk pid 2447 tid 100225 td 0xfffff8000c668000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00a6b4b6b0 mi_switch() at mi_switch+0x174/frame 0xfffffe00a6b4b6e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a6b4b720 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00a6b4b780 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a6b4b7b0 _sleep() at _sleep+0x2d0/frame 0xfffffe00a6b4b850 pipe_read() at pipe_read+0x35a/frame 0xfffffe00a6b4b8b0 dofileread() at dofileread+0x81/frame 0xfffffe00a6b4b900 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a6b4b940 sys_read() at sys_read+0x86/frame 0xfffffe00a6b4b990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a6b4bab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a6b4bab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80047ef2a, rsp = 0x7fffffffe328, rbp = 0x7fffffffe340 --- Tracing command sh pid 2446 tid 100224 td 0xfffff8000c668580 sched_switch() at sched_switch+0x71a/frame 0xfffffe00a6b46570 mi_switch() at mi_switch+0x174/frame 0xfffffe00a6b465a0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a6b465e0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00a6b46640 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a6b46670 _sleep() at _sleep+0x2d0/frame 0xfffffe00a6b46710 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00a6b467a0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00a6b46990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a6b46ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a6b46ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040cf9a, rsp = 0x7fffffffe238, rbp = 0x7fffffffe2f0 --- Tracing command sh pid 2389 tid 100202 td 0xfffff8000c5f7580 sched_switch() at sched_switch+0x71a/frame 0xfffffe00a6ad8570 mi_switch() at mi_switch+0x174/frame 0xfffffe00a6ad85a0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a6ad85e0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00a6ad8640 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a6ad8670 _sleep() at _sleep+0x2d0/frame 0xfffffe00a6ad8710 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00a6ad87a0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00a6ad8990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a6ad8ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a6ad8ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040cf9a, rsp = 0x7fffffffe4c8, rbp = 0x7fffffffe580 --- Tracing command sh pid 2316 tid 100171 td 0xfffff8000c562000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006ff2570 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ff25a0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006ff25e0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe0006ff2640 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe0006ff2670 _sleep() at _sleep+0x2d0/frame 0xfffffe0006ff2710 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe0006ff27a0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe0006ff2990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe0006ff2ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0006ff2ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040cf9a, rsp = 0x7fffffffe578, rbp = 0x7fffffffe630 --- Tracing command bash pid 2315 tid 100191 td 0xfffff80003e50580 sched_switch() at sched_switch+0x71a/frame 0xfffffe00a6aa1570 mi_switch() at mi_switch+0x174/frame 0xfffffe00a6aa15a0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a6aa15e0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00a6aa1640 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a6aa1670 _sleep() at _sleep+0x2d0/frame 0xfffffe00a6aa1710 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00a6aa17a0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00a6aa1990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a6aa1ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a6aa1ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80051bf9a, rsp = 0x7fffffffe678, rbp = 0x7fffffffe6c0 --- Tracing command csh pid 2313 tid 100187 td 0xfffff8000c7a1580 sched_switch() at sched_switch+0x71a/frame 0xfffffe00a6a75760 mi_switch() at mi_switch+0x174/frame 0xfffffe00a6a75790 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a6a757d0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00a6a75830 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a6a75860 _sleep() at _sleep+0x2d0/frame 0xfffffe00a6a75900 kern_sigsuspend() at kern_sigsuspend+0xb4/frame 0xfffffe00a6a75960 sys_sigsuspend() at sys_sigsuspend+0x31/frame 0xfffffe00a6a75990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a6a75ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a6a75ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x80049101a, rsp = 0x7fffffffdff8, rbp = 0x7fffffffe080 --- Tracing command su pid 2312 tid 100192 td 0xfffff8000c9ea000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00a6aa6570 mi_switch() at mi_switch+0x174/frame 0xfffffe00a6aa65a0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a6aa65e0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00a6aa6640 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a6aa6670 _sleep() at _sleep+0x2d0/frame 0xfffffe00a6aa6710 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00a6aa67a0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00a6aa6990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a6aa6ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a6aa6ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003f0f9a, rsp = 0x7fffffffe5f8, rbp = 0x7fffffffeb40 --- Tracing command bash pid 2311 tid 100162 td 0xfffff8000c5f8580 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006fad570 mi_switch() at mi_switch+0x174/frame 0xfffffe0006fad5a0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006fad5e0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe0006fad640 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe0006fad670 _sleep() at _sleep+0x2d0/frame 0xfffffe0006fad710 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe0006fad7a0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe0006fad990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe0006fadab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0006fadab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80051bf9a, rsp = 0x7fffffffe7c8, rbp = 0x7fffffffe810 --- Tracing command sshd pid 2310 tid 100188 td 0xfffff8000c92f000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00a6a7a5d0 mi_switch() at mi_switch+0x174/frame 0xfffffe00a6a7a600 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a6a7a640 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00a6a7a6a0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a6a7a6d0 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00a6a7a730 seltdwait() at seltdwait+0x8d/frame 0xfffffe00a6a7a770 kern_select() at kern_select+0x953/frame 0xfffffe00a6a7a950 sys_select() at sys_select+0x56/frame 0xfffffe00a6a7a990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a6a7aab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a6a7aab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80090af0a, rsp = 0x7fffffffa578, rbp = 0x7fffffffa5b0 --- Tracing command sshd pid 2307 tid 100173 td 0xfffff8000c879000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006ffc650 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ffc680 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006ffc6c0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe0006ffc720 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe0006ffc750 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe0006ffc7b0 seltdwait() at seltdwait+0x8d/frame 0xfffffe0006ffc7f0 kern_poll() at kern_poll+0x439/frame 0xfffffe0006ffc970 sys_poll() at sys_poll+0x50/frame 0xfffffe0006ffc990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe0006ffcab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0006ffcab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8008ac69a, rsp = 0x7fffffffe5d8, rbp = 0x7fffffffe610 --- Tracing command csh pid 2303 tid 100172 td 0xfffff8000c879580 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006ff7630 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ff7660 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006ff76a0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe0006ff7700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe0006ff7730 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe0006ff7790 tty_wait() at tty_wait+0x42/frame 0xfffffe0006ff77c0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe0006ff7820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe0006ff7850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe0006ff78b0 dofileread() at dofileread+0x81/frame 0xfffffe0006ff7900 kern_readv() at kern_readv+0x4a/frame 0xfffffe0006ff7940 sys_read() at sys_read+0x86/frame 0xfffffe0006ff7990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe0006ff7ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0006ff7ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800501f2a, rsp = 0x7fffffffe1e8, rbp = 0x7fffffffe210 --- Tracing command login pid 2302 tid 100199 td 0xfffff800037b7000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00a6ac9570 mi_switch() at mi_switch+0x174/frame 0xfffffe00a6ac95a0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a6ac95e0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00a6ac9640 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a6ac9670 _sleep() at _sleep+0x2d0/frame 0xfffffe00a6ac9710 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00a6ac97a0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00a6ac9990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a6ac9ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a6ac9ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003f2f9a, rsp = 0x7fffffffeb48, rbp = 0x7fffffffed00 --- Tracing command getty pid 2301 tid 100198 td 0xfffff800037b7580 sched_switch() at sched_switch+0x71a/frame 0xfffffe00a6ac4630 mi_switch() at mi_switch+0x174/frame 0xfffffe00a6ac4660 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a6ac46a0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00a6ac4700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a6ac4730 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00a6ac4790 tty_wait() at tty_wait+0x42/frame 0xfffffe00a6ac47c0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00a6ac4820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00a6ac4850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00a6ac48b0 dofileread() at dofileread+0x81/frame 0xfffffe00a6ac4900 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a6ac4940 sys_read() at sys_read+0x86/frame 0xfffffe00a6ac4990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a6ac4ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a6ac4ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800437f2a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2300 tid 100197 td 0xfffff800037b8000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00a6abf630 mi_switch() at mi_switch+0x174/frame 0xfffffe00a6abf660 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a6abf6a0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00a6abf700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a6abf730 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00a6abf790 tty_wait() at tty_wait+0x42/frame 0xfffffe00a6abf7c0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00a6abf820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00a6abf850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00a6abf8b0 dofileread() at dofileread+0x81/frame 0xfffffe00a6abf900 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a6abf940 sys_read() at sys_read+0x86/frame 0xfffffe00a6abf990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a6abfab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a6abfab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800437f2a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2299 tid 100196 td 0xfffff800037b8580 sched_switch() at sched_switch+0x71a/frame 0xfffffe00a6aba630 mi_switch() at mi_switch+0x174/frame 0xfffffe00a6aba660 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a6aba6a0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00a6aba700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a6aba730 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00a6aba790 tty_wait() at tty_wait+0x42/frame 0xfffffe00a6aba7c0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00a6aba820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00a6aba850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00a6aba8b0 dofileread() at dofileread+0x81/frame 0xfffffe00a6aba900 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a6aba940 sys_read() at sys_read+0x86/frame 0xfffffe00a6aba990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a6abaab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a6abaab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800437f2a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2298 tid 100190 td 0xfffff80003fc6000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00a6a9c630 mi_switch() at mi_switch+0x174/frame 0xfffffe00a6a9c660 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a6a9c6a0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00a6a9c700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a6a9c730 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00a6a9c790 tty_wait() at tty_wait+0x42/frame 0xfffffe00a6a9c7c0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00a6a9c820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00a6a9c850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00a6a9c8b0 dofileread() at dofileread+0x81/frame 0xfffffe00a6a9c900 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a6a9c940 sys_read() at sys_read+0x86/frame 0xfffffe00a6a9c990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a6a9cab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a6a9cab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800437f2a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2297 tid 100151 td 0xfffff80003a7d580 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006f7b630 mi_switch() at mi_switch+0x174/frame 0xfffffe0006f7b660 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f7b6a0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe0006f7b700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe0006f7b730 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe0006f7b790 tty_wait() at tty_wait+0x42/frame 0xfffffe0006f7b7c0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe0006f7b820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe0006f7b850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe0006f7b8b0 dofileread() at dofileread+0x81/frame 0xfffffe0006f7b900 kern_readv() at kern_readv+0x4a/frame 0xfffffe0006f7b940 sys_read() at sys_read+0x86/frame 0xfffffe0006f7b990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe0006f7bab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0006f7bab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800437f2a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2296 tid 100167 td 0xfffff800037ba000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006fc6630 mi_switch() at mi_switch+0x174/frame 0xfffffe0006fc6660 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006fc66a0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe0006fc6700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe0006fc6730 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe0006fc6790 tty_wait() at tty_wait+0x42/frame 0xfffffe0006fc67c0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe0006fc6820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe0006fc6850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe0006fc68b0 dofileread() at dofileread+0x81/frame 0xfffffe0006fc6900 kern_readv() at kern_readv+0x4a/frame 0xfffffe0006fc6940 sys_read() at sys_read+0x86/frame 0xfffffe0006fc6990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe0006fc6ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0006fc6ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800437f2a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2295 tid 100194 td 0xfffff800037b9580 sched_switch() at sched_switch+0x71a/frame 0xfffffe00a6ab0630 mi_switch() at mi_switch+0x174/frame 0xfffffe00a6ab0660 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a6ab06a0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00a6ab0700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a6ab0730 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00a6ab0790 tty_wait() at tty_wait+0x42/frame 0xfffffe00a6ab07c0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00a6ab0820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00a6ab0850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00a6ab08b0 dofileread() at dofileread+0x81/frame 0xfffffe00a6ab0900 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a6ab0940 sys_read() at sys_read+0x86/frame 0xfffffe00a6ab0990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a6ab0ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a6ab0ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800437f2a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2294 tid 100195 td 0xfffff800037b9000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00a6ab5630 mi_switch() at mi_switch+0x174/frame 0xfffffe00a6ab5660 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a6ab56a0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00a6ab5700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a6ab5730 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00a6ab5790 tty_wait() at tty_wait+0x42/frame 0xfffffe00a6ab57c0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00a6ab5820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00a6ab5850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00a6ab58b0 dofileread() at dofileread+0x81/frame 0xfffffe00a6ab5900 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a6ab5940 sys_read() at sys_read+0x86/frame 0xfffffe00a6ab5990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a6ab5ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a6ab5ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800437f2a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2293 tid 100142 td 0xfffff8000c5f9580 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006f4e630 mi_switch() at mi_switch+0x174/frame 0xfffffe0006f4e660 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f4e6a0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe0006f4e700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe0006f4e730 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe0006f4e790 tty_wait() at tty_wait+0x42/frame 0xfffffe0006f4e7c0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe0006f4e820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe0006f4e850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe0006f4e8b0 dofileread() at dofileread+0x81/frame 0xfffffe0006f4e900 kern_readv() at kern_readv+0x4a/frame 0xfffffe0006f4e940 sys_read() at sys_read+0x86/frame 0xfffffe0006f4e990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe0006f4eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0006f4eab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800437f2a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command cron pid 2247 tid 100145 td 0xfffff8000c7a2580 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006f5d710 mi_switch() at mi_switch+0x174/frame 0xfffffe0006f5d740 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f5d780 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe0006f5d7e0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe0006f5d820 _sleep() at _sleep+0x265/frame 0xfffffe0006f5d8c0 kern_clock_nanosleep() at kern_clock_nanosleep+0x207/frame 0xfffffe0006f5d950 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe0006f5d990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe0006f5dab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0006f5dab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003db11a, rsp = 0x7fffffffead8, rbp = 0x7fffffffecc0 --- Tracing command sshd pid 2243 tid 100163 td 0xfffff80003a7d000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006fb25d0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006fb2600 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006fb2640 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe0006fb26a0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe0006fb26d0 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe0006fb2730 seltdwait() at seltdwait+0x8d/frame 0xfffffe0006fb2770 kern_select() at kern_select+0x953/frame 0xfffffe0006fb2950 sys_select() at sys_select+0x56/frame 0xfffffe0006fb2990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe0006fb2ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0006fb2ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80090af0a, rsp = 0x7fffffffe668, rbp = 0x7fffffffe6a0 --- Tracing command rpc.lockd pid 2178 tid 100143 td 0xfffff8000c673000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006f534f0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006f53520 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f53560 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe0006f535c0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe0006f53600 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x185/frame 0xfffffe0006f53670 svc_run_internal() at svc_run_internal+0xa94/frame 0xfffffe0006f537b0 svc_run() at svc_run+0x1ee/frame 0xfffffe0006f53810 sys_nlm_syscall() at sys_nlm_syscall+0x75b/frame 0xfffffe0006f53990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe0006f53ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0006f53ab0 --- syscall (154, FreeBSD ELF64, sys_nlm_syscall), rip = 0x8002f5f5a, rsp = 0x7fffffffec08, rbp = 0x7fffffffecc0 --- Tracing command rpc.statd pid 2175 tid 100185 td 0xfffff8000c9ea580 sched_switch() at sched_switch+0x71a/frame 0xfffffe00a6a6b5b0 mi_switch() at mi_switch+0x174/frame 0xfffffe00a6a6b5e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a6a6b620 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00a6a6b680 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00a6a6b6c0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x185/frame 0xfffffe00a6a6b730 seltdwait() at seltdwait+0x6b/frame 0xfffffe00a6a6b770 kern_select() at kern_select+0x953/frame 0xfffffe00a6a6b950 sys_select() at sys_select+0x56/frame 0xfffffe00a6a6b990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a6a6bab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a6a6bab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80042bf0a, rsp = 0x7fffffffea98, rbp = 0x7fffffffebe0 --- Tracing command watchdogd pid 2125 tid 100174 td 0xfffff8000cbb9000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00a6a04710 mi_switch() at mi_switch+0x174/frame 0xfffffe00a6a04740 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a6a04780 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00a6a047e0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00a6a04820 _sleep() at _sleep+0x265/frame 0xfffffe00a6a048c0 kern_clock_nanosleep() at kern_clock_nanosleep+0x207/frame 0xfffffe00a6a04950 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00a6a04990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a6a04ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a6a04ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003c411a, rsp = 0x7fffffffea98, rbp = 0x7fffffffeae0 --- Tracing command rpcbind pid 2049 tid 100166 td 0xfffff8000cbb9580 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006fc1630 mi_switch() at mi_switch+0x174/frame 0xfffffe0006fc1660 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006fc16a0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe0006fc1700 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe0006fc1740 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x185/frame 0xfffffe0006fc17b0 seltdwait() at seltdwait+0x6b/frame 0xfffffe0006fc17f0 kern_poll() at kern_poll+0x439/frame 0xfffffe0006fc1970 sys_poll() at sys_poll+0x50/frame 0xfffffe0006fc1990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe0006fc1ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0006fc1ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003d269a, rsp = 0x7fffffffca38, rbp = 0x7fffffffec50 --- Tracing command syslogd pid 2039 tid 100154 td 0xfffff80003fc7580 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006f8a5d0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006f8a600 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f8a640 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe0006f8a6a0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe0006f8a6d0 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe0006f8a730 seltdwait() at seltdwait+0x8d/frame 0xfffffe0006f8a770 kern_select() at kern_select+0x953/frame 0xfffffe0006f8a950 sys_select() at sys_select+0x56/frame 0xfffffe0006f8a990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe0006f8aab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0006f8aab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80043cf0a, rsp = 0x7fffffffe6a8, rbp = 0x7fffffffecc0 --- Tracing command devd pid 1968 tid 100160 td 0xfffff8000c998000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006fa35b0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006fa35e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006fa3620 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe0006fa3680 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe0006fa36c0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x185/frame 0xfffffe0006fa3730 seltdwait() at seltdwait+0x6b/frame 0xfffffe0006fa3770 kern_select() at kern_select+0x953/frame 0xfffffe0006fa3950 sys_select() at sys_select+0x56/frame 0xfffffe0006fa3990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe0006fa3ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0006fa3ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x2fd2da, rsp = 0x7fffffffcb48, rbp = 0x7fffffffece0 --- Tracing command dhclient pid 1963 tid 100184 td 0xfffff80003fc6580 sched_switch() at sched_switch+0x71a/frame 0xfffffe00a6a66630 mi_switch() at mi_switch+0x174/frame 0xfffffe00a6a66660 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a6a666a0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00a6a66700 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00a6a66740 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x185/frame 0xfffffe00a6a667b0 seltdwait() at seltdwait+0x6b/frame 0xfffffe00a6a667f0 kern_poll() at kern_poll+0x439/frame 0xfffffe00a6a66970 sys_poll() at sys_poll+0x50/frame 0xfffffe00a6a66990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a6a66ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a6a66ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003f569a, rsp = 0x7fffffffec28, rbp = 0x7fffffffec60 --- Tracing command dhclient pid 1919 tid 100144 td 0xfffff800060c4000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006f58650 mi_switch() at mi_switch+0x174/frame 0xfffffe0006f58680 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f586c0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe0006f58720 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe0006f58750 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe0006f587b0 seltdwait() at seltdwait+0x8d/frame 0xfffffe0006f587f0 kern_poll() at kern_poll+0x439/frame 0xfffffe0006f58970 sys_poll() at sys_poll+0x50/frame 0xfffffe0006f58990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe0006f58ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0006f58ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003f569a, rsp = 0x7fffffffec38, rbp = 0x7fffffffec60 --- Tracing command vnlru pid 34 tid 100134 td 0xfffff8000c563580 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006f26880 mi_switch() at mi_switch+0x174/frame 0xfffffe0006f268b0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f268f0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006f26930 _sleep() at _sleep+0x279/frame 0xfffffe0006f269d0 vnlru_proc() at vnlru_proc+0x16f/frame 0xfffffe0006f26a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f26ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f26ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command syncer pid 33 tid 100133 td 0xfffff8000c564000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006f218b0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006f218e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f21920 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006f21960 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x185/frame 0xfffffe0006f219d0 sched_sync() at sched_sync+0x617/frame 0xfffffe0006f21a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f21ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f21ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100132 td 0xfffff8000c564580 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006f1c880 mi_switch() at mi_switch+0x174/frame 0xfffffe0006f1c8b0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f1c8f0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006f1c930 _sleep() at _sleep+0x279/frame 0xfffffe0006f1c9d0 buf_daemon() at buf_daemon+0x391/frame 0xfffffe0006f1ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f1cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f1cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100135 td 0xfffff8000c57c000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006f2b860 mi_switch() at mi_switch+0x174/frame 0xfffffe0006f2b890 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f2b8d0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006f2b910 _sleep() at _sleep+0x279/frame 0xfffffe0006f2b9b0 bufspace_daemon_wait() at bufspace_daemon_wait+0xe0/frame 0xfffffe0006f2ba00 bufspace_daemon() at bufspace_daemon+0x1d0/frame 0xfffffe0006f2ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f2bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f2bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100136 td 0xfffff8000c57b580 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006f30860 mi_switch() at mi_switch+0x174/frame 0xfffffe0006f30890 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f308d0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006f30910 _sleep() at _sleep+0x279/frame 0xfffffe0006f309b0 bufspace_daemon_wait() at bufspace_daemon_wait+0xe0/frame 0xfffffe0006f30a00 bufspace_daemon() at bufspace_daemon+0x1d0/frame 0xfffffe0006f30a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f30ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f30ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100137 td 0xfffff8000c57b000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006f35860 mi_switch() at mi_switch+0x174/frame 0xfffffe0006f35890 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f358d0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006f35910 _sleep() at _sleep+0x279/frame 0xfffffe0006f359b0 bufspace_daemon_wait() at bufspace_daemon_wait+0xe0/frame 0xfffffe0006f35a00 bufspace_daemon() at bufspace_daemon+0x1d0/frame 0xfffffe0006f35a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f35ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f35ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100138 td 0xfffff8000c57a580 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006f3a860 mi_switch() at mi_switch+0x174/frame 0xfffffe0006f3a890 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f3a8d0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006f3a910 _sleep() at _sleep+0x279/frame 0xfffffe0006f3a9b0 bufspace_daemon_wait() at bufspace_daemon_wait+0xe0/frame 0xfffffe0006f3aa00 bufspace_daemon() at bufspace_daemon+0x1d0/frame 0xfffffe0006f3aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f3aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f3aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100139 td 0xfffff8000c57a000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006f3f860 mi_switch() at mi_switch+0x174/frame 0xfffffe0006f3f890 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f3f8d0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006f3f910 _sleep() at _sleep+0x279/frame 0xfffffe0006f3f9b0 bufspace_daemon_wait() at bufspace_daemon_wait+0xe0/frame 0xfffffe0006f3fa00 bufspace_daemon() at bufspace_daemon+0x1d0/frame 0xfffffe0006f3fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f3fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f3fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100140 td 0xfffff8000c579580 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006f44860 mi_switch() at mi_switch+0x174/frame 0xfffffe0006f44890 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f448d0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006f44910 _sleep() at _sleep+0x279/frame 0xfffffe0006f449b0 bufspace_daemon_wait() at bufspace_daemon_wait+0xe0/frame 0xfffffe0006f44a00 bufspace_daemon() at bufspace_daemon+0x1d0/frame 0xfffffe0006f44a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f44ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f44ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100141 td 0xfffff8000c579000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006f49860 mi_switch() at mi_switch+0x174/frame 0xfffffe0006f49890 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f498d0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006f49910 _sleep() at _sleep+0x279/frame 0xfffffe0006f499b0 bufspace_daemon_wait() at bufspace_daemon_wait+0xe0/frame 0xfffffe0006f49a00 bufspace_daemon() at bufspace_daemon+0x1d0/frame 0xfffffe0006f49a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f49ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f49ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100152 td 0xfffff8000c672580 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006f808f0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006f80920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f80960 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006f809a0 _sleep() at _sleep+0x279/frame 0xfffffe0006f80a40 softdep_flush() at softdep_flush+0x17f/frame 0xfffffe0006f80a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f80ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f80ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100159 td 0xfffff800060cf580 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006f9e8f0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006f9e920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f9e960 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006f9e9a0 _sleep() at _sleep+0x279/frame 0xfffffe0006f9ea40 softdep_flush() at softdep_flush+0x17f/frame 0xfffffe0006f9ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f9eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f9eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100249 td 0xfffff8000c5ef000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00a6bc38f0 mi_switch() at mi_switch+0x174/frame 0xfffffe00a6bc3920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a6bc3960 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00a6bc39a0 _sleep() at _sleep+0x279/frame 0xfffffe00a6bc3a40 softdep_flush() at softdep_flush+0x17f/frame 0xfffffe00a6bc3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a6bc3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a6bc3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vmdaemon pid 31 tid 100129 td 0xfffff8000c1e8000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006f0d8b0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006f0d8e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f0d920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006f0d950 _sleep() at _sleep+0x2da/frame 0xfffffe0006f0d9f0 vm_daemon() at vm_daemon+0xaa6/frame 0xfffffe0006f0da70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f0dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f0dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100128 td 0xfffff8000c1e8580 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006f08520 mi_switch() at mi_switch+0x174/frame 0xfffffe0006f08550 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f08590 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006f085d0 _sleep() at _sleep+0x279/frame 0xfffffe0006f08670 vm_pageout_worker() at vm_pageout_worker+0x26e/frame 0xfffffe0006f08a30 vm_pageout() at vm_pageout+0x156/frame 0xfffffe0006f08a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f08ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f08ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100130 td 0xfffff8000c0e7580 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006f126b0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006f126e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f12720 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006f12750 _sleep() at _sleep+0x2da/frame 0xfffffe0006f127f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0xc60/frame 0xfffffe0006f12a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f12ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f12ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100131 td 0xfffff8000c0e7000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006f178f0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006f17920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f17960 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006f179a0 _sleep() at _sleep+0x279/frame 0xfffffe0006f17a40 uma_reclaim_worker() at uma_reclaim_worker+0xda/frame 0xfffffe0006f17a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f17ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f17ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon1 pid 29 tid 100127 td 0xfffff8000c0fa000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006ef78b0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ef78e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006ef7920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006ef7950 _sleep() at _sleep+0x2da/frame 0xfffffe0006ef79f0 enc_daemon() at enc_daemon+0x1cf/frame 0xfffffe0006ef7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ef7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ef7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon0 pid 28 tid 100126 td 0xfffff8000c0fa580 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006ef28b0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ef28e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006ef2920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006ef2950 _sleep() at _sleep+0x2da/frame 0xfffffe0006ef29f0 enc_daemon() at enc_daemon+0x1cf/frame 0xfffffe0006ef2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ef2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ef2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command rand_harvestq pid 27 tid 100120 td 0xfffff8000c1f6580 (CPU 8) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000274df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000274e10 trap() at trap+0x48/frame 0xfffffe0000274f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000274f20 --- trap 0x13, rip = 0xffffffff811accd9, rsp = 0xfffffe0006ed4a18, rbp = 0xfffffe0006ed4a70 --- random_ivy_read() at random_ivy_read+0x19/frame 0xfffffe0006ed4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ed4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ed4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sctp_iterator pid 26 tid 100119 td 0xfffff8000c1f7000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006ec3910 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ec3940 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006ec3980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006ec39b0 _sleep() at _sleep+0x2da/frame 0xfffffe0006ec3a50 sctp_iterator_thread() at sctp_iterator_thread+0x59/frame 0xfffffe0006ec3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ec3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ec3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod4 pid 25 tid 100118 td 0xfffff8000c0fb000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006eb28e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006eb2910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006eb2950 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006eb2990 _sleep() at _sleep+0x279/frame 0xfffffe0006eb2a30 soaio_kproc_loop() at soaio_kproc_loop+0x170/frame 0xfffffe0006eb2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006eb2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006eb2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod3 pid 24 tid 100117 td 0xfffff8000c0fb580 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006ead8e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ead910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006ead950 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006ead990 _sleep() at _sleep+0x279/frame 0xfffffe0006eada30 soaio_kproc_loop() at soaio_kproc_loop+0x170/frame 0xfffffe0006eada70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006eadab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006eadab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod2 pid 23 tid 100116 td 0xfffff8000c0fc000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006ea88e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ea8910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006ea8950 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006ea8990 _sleep() at _sleep+0x279/frame 0xfffffe0006ea8a30 soaio_kproc_loop() at soaio_kproc_loop+0x170/frame 0xfffffe0006ea8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ea8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ea8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod1 pid 22 tid 100115 td 0xfffff8000c0fc580 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006ea38e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ea3910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006ea3950 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006ea3990 _sleep() at _sleep+0x279/frame 0xfffffe0006ea3a30 soaio_kproc_loop() at soaio_kproc_loop+0x170/frame 0xfffffe0006ea3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ea3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ea3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100096 td 0xfffff80003e4f000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e2c930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e2c960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e2c9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e2c9d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e2ca30 usb_process() at usb_process+0x12b/frame 0xfffffe0006e2ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e2cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e2cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100097 td 0xfffff80003e4e580 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e31930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e31960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e319a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e319d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e31a30 usb_process() at usb_process+0x12b/frame 0xfffffe0006e31a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e31ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e31ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100098 td 0xfffff80003e4e000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e36930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e36960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e369a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e369d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e36a30 usb_process() at usb_process+0x12b/frame 0xfffffe0006e36a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e36ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e36ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100099 td 0xfffff80003e4d580 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e3b930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e3b960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e3b9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e3b9d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e3ba30 usb_process() at usb_process+0x12b/frame 0xfffffe0006e3ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e3bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e3bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100100 td 0xfffff80003e4d000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e40930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e40960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e409a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e409d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e40a30 usb_process() at usb_process+0x12b/frame 0xfffffe0006e40a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e40ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e40ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100102 td 0xfffff80003e45000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e4a930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e4a960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e4a9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e4a9d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e4aa30 usb_process() at usb_process+0x12b/frame 0xfffffe0006e4aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e4aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e4aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100103 td 0xfffff80003fc9580 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e4f930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e4f960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e4f9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e4f9d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e4fa30 usb_process() at usb_process+0x12b/frame 0xfffffe0006e4fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e4fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e4fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100104 td 0xfffff80003fc9000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e54930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e54960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e549a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e549d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e54a30 usb_process() at usb_process+0x12b/frame 0xfffffe0006e54a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e54ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e54ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100105 td 0xfffff80003fc8580 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e59930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e59960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e599a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e599d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e59a30 usb_process() at usb_process+0x12b/frame 0xfffffe0006e59a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e59ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e59ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100106 td 0xfffff80003fc8000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e5e930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e5e960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e5e9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e5e9d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e5ea30 usb_process() at usb_process+0x12b/frame 0xfffffe0006e5ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e5eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e5eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100107 td 0xfffff800060cf000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e7b930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e7b960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e7b9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e7b9d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e7ba30 usb_process() at usb_process+0x12b/frame 0xfffffe0006e7ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e7bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e7bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100108 td 0xfffff800060ce580 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e80930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e80960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e809a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e809d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e80a30 usb_process() at usb_process+0x12b/frame 0xfffffe0006e80a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e80ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e80ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100109 td 0xfffff800060ce000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e85930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e85960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e859a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e859d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e85a30 usb_process() at usb_process+0x12b/frame 0xfffffe0006e85a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e85ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e85ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100110 td 0xfffff800060cd580 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e8a930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e8a960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e8a9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e8a9d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e8aa30 usb_process() at usb_process+0x12b/frame 0xfffffe0006e8aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e8aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e8aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100111 td 0xfffff800060cd000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e8f930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e8f960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e8f9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e8f9d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e8fa30 usb_process() at usb_process+0x12b/frame 0xfffffe0006e8fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e8fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e8fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100091 td 0xfffff8000392d000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e138e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e13910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e13950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e13980 _sleep() at _sleep+0x2da/frame 0xfffffe0006e13a20 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe0006e13a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e13ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e13ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100092 td 0xfffff80003a7e580 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e188e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e18910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e18950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e18980 _sleep() at _sleep+0x2da/frame 0xfffffe0006e18a20 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe0006e18a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e18ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e18ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100093 td 0xfffff80003a7e000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e1d8e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e1d910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e1d950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e1d980 _sleep() at _sleep+0x2da/frame 0xfffffe0006e1da20 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe0006e1da70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e1dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e1dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100125 td 0xfffff8000c1f4000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006eed8d0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006eed900 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006eed940 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006eed970 _sleep() at _sleep+0x2da/frame 0xfffffe0006eeda10 xpt_scanner_thread() at xpt_scanner_thread+0x93/frame 0xfffffe0006eeda70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006eedab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006eedab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 11 pid 19 tid 100090 td 0xfffff8000392d580 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e0e8c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e0e8f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e0e930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e0e960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e0ea00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e0ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e0eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e0eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 10 pid 18 tid 100089 td 0xfffff8000392e000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e098c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e098f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e09930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e09960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e09a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e09a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e09ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e09ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 9 pid 17 tid 100088 td 0xfffff8000392e580 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e048c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e048f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e04930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e04960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e04a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e04a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e04ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e04ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 8 pid 16 tid 100087 td 0xfffff8000392f000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00005fd8c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00005fd8f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005fd930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005fd960 _sleep() at _sleep+0x2da/frame 0xfffffe00005fda00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00005fda70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005fdab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005fdab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 7 pid 15 tid 100086 td 0xfffff8000392f580 sched_switch() at sched_switch+0x71a/frame 0xfffffe00005f88c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00005f88f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005f8930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005f8960 _sleep() at _sleep+0x2da/frame 0xfffffe00005f8a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00005f8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005f8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005f8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 6 pid 9 tid 100085 td 0xfffff80003930000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00005f38c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00005f38f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005f3930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005f3960 _sleep() at _sleep+0x2da/frame 0xfffffe00005f3a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00005f3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005f3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005f3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 5 pid 8 tid 100084 td 0xfffff80003930580 sched_switch() at sched_switch+0x71a/frame 0xfffffe00005ee8c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00005ee8f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005ee930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005ee960 _sleep() at _sleep+0x2da/frame 0xfffffe00005eea00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00005eea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005eeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005eeab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 4 pid 7 tid 100083 td 0xfffff80003931000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00005e98c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00005e98f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005e9930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005e9960 _sleep() at _sleep+0x2da/frame 0xfffffe00005e9a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00005e9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005e9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005e9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 3 pid 6 tid 100082 td 0xfffff80003911580 sched_switch() at sched_switch+0x71a/frame 0xfffffe00005e48c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00005e48f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005e4930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005e4960 _sleep() at _sleep+0x2da/frame 0xfffffe00005e4a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00005e4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005e4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005e4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 2 pid 5 tid 100081 td 0xfffff8000391d000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00005df8c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00005df8f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005df930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005df960 _sleep() at _sleep+0x2da/frame 0xfffffe00005dfa00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00005dfa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005dfab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005dfab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 1 pid 4 tid 100080 td 0xfffff8000391d580 sched_switch() at sched_switch+0x71a/frame 0xfffffe00005da8c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00005da8f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005da930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005da960 _sleep() at _sleep+0x2da/frame 0xfffffe00005daa00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00005daa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005daab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005daab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 0 pid 3 tid 100079 td 0xfffff8000391e000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00005d58c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00005d58f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005d5930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005d5960 _sleep() at _sleep+0x2da/frame 0xfffffe00005d5a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00005d5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005d5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005d5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 2 tid 100078 td 0xfffff8000391e580 sched_switch() at sched_switch+0x71a/frame 0xfffffe00005d08f0 mi_switch() at mi_switch+0x174/frame 0xfffffe00005d0920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005d0960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005d0990 _sleep() at _sleep+0x2da/frame 0xfffffe00005d0a30 crypto_proc() at crypto_proc+0x2c5/frame 0xfffffe00005d0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005d0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005d0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sequencer 00 pid 14 tid 100065 td 0xfffff80003911000 sched_switch() at sched_switch+0x71a/frame 0xfffffe000058f8f0 mi_switch() at mi_switch+0x174/frame 0xfffffe000058f920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000058f960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000058f990 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe000058f9f0 seq_eventthread() at seq_eventthread+0xdc/frame 0xfffffe000058fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000058fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000058fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100061 td 0xfffff800037ed000 sched_switch() at sched_switch+0x71a/frame 0xfffffe000057b690 mi_switch() at mi_switch+0x174/frame 0xfffffe000057b6c0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000057b700 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000057b730 _sleep() at _sleep+0x2da/frame 0xfffffe000057b7d0 biowait() at biowait+0xa6/frame 0xfffffe000057b830 g_read_data() at g_read_data+0xa4/frame 0xfffffe000057b870 g_raid_md_taste_ddf() at g_raid_md_taste_ddf+0x105/frame 0xfffffe000057b9c0 g_raid_taste() at g_raid_taste+0x19b/frame 0xfffffe000057ba10 g_new_provider_event() at g_new_provider_event+0x1ba/frame 0xfffffe000057ba30 g_run_events() at g_run_events+0x1a7/frame 0xfffffe000057ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe000057bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000057bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100062 td 0xfffff800037ec580 sched_switch() at sched_switch+0x71a/frame 0xfffffe00005808f0 mi_switch() at mi_switch+0x174/frame 0xfffffe0000580920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000580960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000580990 _sleep() at _sleep+0x2da/frame 0xfffffe0000580a30 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0000580a60 g_up_procbody() at g_up_procbody+0x6d/frame 0xfffffe0000580a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000580ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000580ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100063 td 0xfffff800037ec000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00005858f0 mi_switch() at mi_switch+0x174/frame 0xfffffe0000585920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000585960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000585990 _sleep() at _sleep+0x2da/frame 0xfffffe0000585a30 g_io_schedule_down() at g_io_schedule_down+0x14c/frame 0xfffffe0000585a60 g_down_procbody() at g_down_procbody+0x6d/frame 0xfffffe0000585a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000585ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000585ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100016 td 0xfffff800036bb580 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100020 td 0xfffff800036f3580 sched_switch() at sched_switch+0x71a/frame 0xfffffe00787af9e0 mi_switch() at mi_switch+0x174/frame 0xfffffe00787afa10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe00787afa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00787afab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00787afab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100021 td 0xfffff800036f3000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00787b49e0 mi_switch() at mi_switch+0x174/frame 0xfffffe00787b4a10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe00787b4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00787b4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00787b4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100047 td 0xfffff800037e1000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00004d59e0 mi_switch() at mi_switch+0x174/frame 0xfffffe00004d5a10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe00004d5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004d5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004d5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100048 td 0xfffff800037e0580 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100049 td 0xfffff800037e0000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100050 td 0xfffff800037df580 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100051 td 0xfffff800037df000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100052 td 0xfffff800037de580 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100053 td 0xfffff800037de000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100054 td 0xfffff800037d0580 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100055 td 0xfffff800037d0000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100056 td 0xfffff800037ef580 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100057 td 0xfffff800037ef000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100058 td 0xfffff800037ee580 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100059 td 0xfffff800037ee000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00005119e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0000511a10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe0000511a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000511ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000511ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100060 td 0xfffff800037ed580 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100094 td 0xfffff80003e50000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e229e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e22a10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe0006e22a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e22ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e22ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100095 td 0xfffff80003e4f580 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e279e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e27a10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe0006e27a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e27ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e27ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100101 td 0xfffff80003e45580 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e459e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e45a10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe0006e45a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e45ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e45ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100112 td 0xfffff800060cc580 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100113 td 0xfffff800060cc000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e999e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e99a10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe0006e99a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e99ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e99ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100176 td 0xfffff80003a7c580 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100177 td 0xfffff80003a7c000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100178 td 0xfffff80003a7b580 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100179 td 0xfffff80003a7b000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100180 td 0xfffff80003931580 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100181 td 0xfffff801d4035580 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100182 td 0xfffff801d4035000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100183 td 0xfffff801d4034580 fork_trampoline() at fork_trampoline Tracing command idle pid 11 tid 100003 td 0xfffff800036ad000 (CPU 0) cpustop_handler() at cpustop_handler+0x28/frame 0xffffffff8205e6b0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xffffffff8205e6d0 trap() at trap+0x48/frame 0xffffffff8205e7e0 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff8205e7e0 --- trap 0x13, rip = 0xffffffff81223366, rsp = 0xfffffe007875a900, rbp = 0xfffffe007875a900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007875a900 acpi_cpu_idle() at acpi_cpu_idle+0x23f/frame 0xfffffe007875a950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007875a970 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe007875a990 sched_idletd() at sched_idletd+0x482/frame 0xfffffe007875aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe007875aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007875aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffff800036ac580 (CPU 1) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006bb0df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006bb0e10 trap() at trap+0x48/frame 0xfffffe0006bb0f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bb0f20 --- trap 0x13, rip = 0xffffffff81223366, rsp = 0xfffffe007875f900, rbp = 0xfffffe007875f900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007875f900 acpi_cpu_idle() at acpi_cpu_idle+0x23f/frame 0xfffffe007875f950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007875f970 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe007875f990 sched_idletd() at sched_idletd+0x482/frame 0xfffffe007875fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe007875fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007875fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffff800036ac000 (CPU 2) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006bbcdf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006bbce10 trap() at trap+0x48/frame 0xfffffe0006bbcf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bbcf20 --- trap 0x13, rip = 0xffffffff81223a96, rsp = 0xfffffe0078764980, rbp = 0xfffffe0078764990 --- cpu_idle() at cpu_idle+0xf6/frame 0xfffffe0078764990 sched_idletd() at sched_idletd+0x482/frame 0xfffffe0078764a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078764ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078764ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffff800036ab580 (CPU 3) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006bc8df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006bc8e10 trap() at trap+0x48/frame 0xfffffe0006bc8f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bc8f20 --- trap 0x13, rip = 0xffffffff81223366, rsp = 0xfffffe0078769900, rbp = 0xfffffe0078769900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0078769900 acpi_cpu_idle() at acpi_cpu_idle+0x23f/frame 0xfffffe0078769950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0078769970 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe0078769990 sched_idletd() at sched_idletd+0x482/frame 0xfffffe0078769a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078769ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078769ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffff800036ab000 (CPU 4) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006bd4df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006bd4e10 trap() at trap+0x48/frame 0xfffffe0006bd4f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bd4f20 --- trap 0x13, rip = 0xffffffff81223a96, rsp = 0xfffffe007876e980, rbp = 0xfffffe007876e990 --- cpu_idle() at cpu_idle+0xf6/frame 0xfffffe007876e990 sched_idletd() at sched_idletd+0x482/frame 0xfffffe007876ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe007876eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007876eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffff800036aa580 (CPU 5) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006be0df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006be0e10 trap() at trap+0x48/frame 0xfffffe0006be0f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006be0f20 --- trap 0x13, rip = 0xffffffff81223366, rsp = 0xfffffe0078773900, rbp = 0xfffffe0078773900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0078773900 acpi_cpu_idle() at acpi_cpu_idle+0x23f/frame 0xfffffe0078773950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0078773970 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe0078773990 sched_idletd() at sched_idletd+0x482/frame 0xfffffe0078773a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078773ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078773ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffff800036aa000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0078778940 mi_switch() at mi_switch+0x174/frame 0xfffffe0078778970 critical_exit_preempt() at critical_exit_preempt+0x66/frame 0xfffffe0078778990 sched_idletd() at sched_idletd+0x482/frame 0xfffffe0078778a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078778ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078778ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffff800036be580 (CPU 7) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006bf8df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006bf8e10 trap() at trap+0x48/frame 0xfffffe0006bf8f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bf8f20 --- trap 0x13, rip = 0xffffffff81223366, rsp = 0xfffffe007877d900, rbp = 0xfffffe007877d900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007877d900 acpi_cpu_idle() at acpi_cpu_idle+0x23f/frame 0xfffffe007877d950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007877d970 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe007877d990 sched_idletd() at sched_idletd+0x482/frame 0xfffffe007877da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007877dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007877dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffff800036be000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0078782940 mi_switch() at mi_switch+0x174/frame 0xfffffe0078782970 critical_exit_preempt() at critical_exit_preempt+0x66/frame 0xfffffe0078782990 sched_idletd() at sched_idletd+0x482/frame 0xfffffe0078782a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078782ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078782ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffff800036bd580 (CPU 9) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000280df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000280e10 trap() at trap+0x48/frame 0xfffffe0000280f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000280f20 --- trap 0x13, rip = 0xffffffff81223366, rsp = 0xfffffe0078787900, rbp = 0xfffffe0078787900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0078787900 acpi_cpu_idle() at acpi_cpu_idle+0x23f/frame 0xfffffe0078787950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0078787970 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe0078787990 sched_idletd() at sched_idletd+0x482/frame 0xfffffe0078787a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078787ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078787ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffff800036bd000 (CPU 10) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe000028cdf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe000028ce10 trap() at trap+0x48/frame 0xfffffe000028cf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe000028cf20 --- trap 0x13, rip = 0xffffffff81223366, rsp = 0xfffffe007878c900, rbp = 0xfffffe007878c900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007878c900 acpi_cpu_idle() at acpi_cpu_idle+0x23f/frame 0xfffffe007878c950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007878c970 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe007878c990 sched_idletd() at sched_idletd+0x482/frame 0xfffffe007878ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe007878cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007878cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffff800036bc580 (CPU 11) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000298df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000298e10 trap() at trap+0x48/frame 0xfffffe0000298f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000298f20 --- trap 0x13, rip = 0xffffffff81223366, rsp = 0xfffffe0078791900, rbp = 0xfffffe0078791900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0078791900 acpi_cpu_idle() at acpi_cpu_idle+0x23f/frame 0xfffffe0078791950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0078791970 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe0078791990 sched_idletd() at sched_idletd+0x482/frame 0xfffffe0078791a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078791ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078791ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command init pid 1 tid 100002 td 0xfffff800036ad580 sched_switch() at sched_switch+0x71a/frame 0xfffffe0078755570 mi_switch() at mi_switch+0x174/frame 0xfffffe00787555a0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00787555e0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe0078755640 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe0078755670 _sleep() at _sleep+0x2d0/frame 0xfffffe0078755710 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00787557a0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe0078755990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe0078755ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0078755ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x2b249a, rsp = 0x7fffffffe778, rbp = 0x7fffffffe7e0 --- Tracing command audit pid 10 tid 100001 td 0xfffff800036ae000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0078750910 mi_switch() at mi_switch+0x174/frame 0xfffffe0078750940 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0078750980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00787509b0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0078750a10 audit_worker() at audit_worker+0x93/frame 0xfffffe0078750a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078750ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078750ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xffffffff82093260 sched_switch() at sched_switch+0x71a/frame 0xffffffff828f4980 mi_switch() at mi_switch+0x174/frame 0xffffffff828f49b0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffffff828f49f0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xffffffff828f4a30 _sleep() at _sleep+0x279/frame 0xffffffff828f4ad0 swapper() at swapper+0x77/frame 0xffffffff828f4b20 mi_startup() at mi_startup+0x2e7/frame 0xffffffff828f4b70 btext() at btext+0x2c Tracing command kernel pid 0 tid 100015 td 0xfffff800036bc000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0078796900 mi_switch() at mi_switch+0x174/frame 0xfffffe0078796930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0078796970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00787969a0 _sleep() at _sleep+0x2da/frame 0xfffffe0078796a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0078796a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078796ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078796ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100017 td 0xfffff800036bb000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00787a0930 mi_switch() at mi_switch+0x174/frame 0xfffffe00787a0960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00787a09a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00787a09d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe00787a0a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00787a0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00787a0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00787a0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100018 td 0xfffff800036ae580 sched_switch() at sched_switch+0x71a/frame 0xfffffe00787a5900 mi_switch() at mi_switch+0x174/frame 0xfffffe00787a5930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00787a5970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00787a59a0 _sleep() at _sleep+0x2da/frame 0xfffffe00787a5a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00787a5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00787a5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00787a5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100019 td 0xfffff800036f4000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00787aa900 mi_switch() at mi_switch+0x174/frame 0xfffffe00787aa930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00787aa970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00787aa9a0 _sleep() at _sleep+0x2da/frame 0xfffffe00787aaa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00787aaa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00787aaab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00787aaab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xfffff800036f2580 sched_switch() at sched_switch+0x71a/frame 0xfffffe00787e9930 mi_switch() at mi_switch+0x174/frame 0xfffffe00787e9960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00787e99a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00787e99d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe00787e9a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00787e9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00787e9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00787e9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xfffff800036f2000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00787ee930 mi_switch() at mi_switch+0x174/frame 0xfffffe00787ee960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00787ee9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00787ee9d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe00787eea40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00787eea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00787eeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00787eeab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xfffff800036f1580 sched_switch() at sched_switch+0x71a/frame 0xfffffe00787f3930 mi_switch() at mi_switch+0x174/frame 0xfffffe00787f3960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00787f39a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00787f39d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe00787f3a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00787f3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00787f3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00787f3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xfffff800036f1000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00787f8930 mi_switch() at mi_switch+0x174/frame 0xfffffe00787f8960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00787f89a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00787f89d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe00787f8a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00787f8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00787f8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00787f8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100026 td 0xfffff800036f0580 sched_switch() at sched_switch+0x71a/frame 0xfffffe00787fd930 mi_switch() at mi_switch+0x174/frame 0xfffffe00787fd960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00787fd9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00787fd9d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe00787fda40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00787fda70 fork_exit() at fork_exit+0x84/frame 0xfffffe00787fdab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00787fdab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100027 td 0xfffff800036f0000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0000471930 mi_switch() at mi_switch+0x174/frame 0xfffffe0000471960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004719a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004719d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe0000471a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000471a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000471ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000471ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100028 td 0xfffff8000372a580 sched_switch() at sched_switch+0x71a/frame 0xfffffe0000476930 mi_switch() at mi_switch+0x174/frame 0xfffffe0000476960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004769a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004769d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe0000476a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000476a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000476ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000476ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100029 td 0xfffff8000372a000 sched_switch() at sched_switch+0x71a/frame 0xfffffe000047b930 mi_switch() at mi_switch+0x174/frame 0xfffffe000047b960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000047b9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000047b9d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe000047ba40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000047ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe000047bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000047bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100030 td 0xfffff80003729580 sched_switch() at sched_switch+0x71a/frame 0xfffffe0000480930 mi_switch() at mi_switch+0x174/frame 0xfffffe0000480960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004809a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004809d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe0000480a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000480a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000480ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000480ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100031 td 0xfffff80003729000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0000485930 mi_switch() at mi_switch+0x174/frame 0xfffffe0000485960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004859a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004859d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe0000485a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000485a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000485ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000485ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100032 td 0xfffff80003728580 sched_switch() at sched_switch+0x71a/frame 0xfffffe000048a930 mi_switch() at mi_switch+0x174/frame 0xfffffe000048a960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000048a9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000048a9d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe000048aa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000048aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000048aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000048aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100033 td 0xfffff80003728000 sched_switch() at sched_switch+0x71a/frame 0xfffffe000048f930 mi_switch() at mi_switch+0x174/frame 0xfffffe000048f960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000048f9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000048f9d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe000048fa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000048fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000048fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000048fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100034 td 0xfffff80003727580 sched_switch() at sched_switch+0x71a/frame 0xfffffe0000494930 mi_switch() at mi_switch+0x174/frame 0xfffffe0000494960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004949a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004949d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe0000494a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000494a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000494ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000494ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100035 td 0xfffff80003727000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0000499930 mi_switch() at mi_switch+0x174/frame 0xfffffe0000499960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004999a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004999d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe0000499a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000499a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000499ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000499ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100036 td 0xfffff800036f4580 sched_switch() at sched_switch+0x71a/frame 0xfffffe000049e930 mi_switch() at mi_switch+0x174/frame 0xfffffe000049e960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000049e9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000049e9d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe000049ea40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000049ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe000049eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000049eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100037 td 0xfffff800037b6000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00004a3930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004a3960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004a39a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004a39d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe00004a3a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004a3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004a3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004a3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100038 td 0xfffff800037b5580 sched_switch() at sched_switch+0x71a/frame 0xfffffe00004a8930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004a8960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004a89a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004a89d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe00004a8a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004a8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004a8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004a8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100039 td 0xfffff800037b5000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00004ad930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004ad960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004ad9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004ad9d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe00004ada40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004ada70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004adab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004adab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100040 td 0xfffff800037b4580 sched_switch() at sched_switch+0x71a/frame 0xfffffe00004b2930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004b2960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004b29a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004b29d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe00004b2a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004b2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004b2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004b2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100041 td 0xfffff800037b4000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00004b7930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004b7960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004b79a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004b79d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe00004b7a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004b7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004b7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004b7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100042 td 0xfffff800037af580 sched_switch() at sched_switch+0x71a/frame 0xfffffe00004bc930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004bc960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004bc9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004bc9d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe00004bca40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004bca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004bcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004bcab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100043 td 0xfffff800037af000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00004c1930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004c1960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004c19a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004c19d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe00004c1a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004c1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004c1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004c1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100044 td 0xfffff800037ae580 sched_switch() at sched_switch+0x71a/frame 0xfffffe00004c6930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004c6960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004c69a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004c69d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe00004c6a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004c6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004c6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004c6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100045 td 0xfffff800037ae000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00004cb930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004cb960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004cb9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004cb9d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe00004cba40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004cba70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004cbab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004cbab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100046 td 0xfffff800037ba580 sched_switch() at sched_switch+0x71a/frame 0xfffffe00004d0930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004d0960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004d09a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004d09d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe00004d0a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004d0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004d0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004d0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100064 td 0xfffff800037e1580 sched_switch() at sched_switch+0x71a/frame 0xfffffe000058a900 mi_switch() at mi_switch+0x174/frame 0xfffffe000058a930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000058a970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000058a9a0 _sleep() at _sleep+0x2da/frame 0xfffffe000058aa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe000058aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000058aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000058aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100066 td 0xfffff80003910580 sched_switch() at sched_switch+0x71a/frame 0xfffffe0000594900 mi_switch() at mi_switch+0x174/frame 0xfffffe0000594930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000594970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005949a0 _sleep() at _sleep+0x2da/frame 0xfffffe0000594a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0000594a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000594ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000594ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100067 td 0xfffff80003910000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0000599900 mi_switch() at mi_switch+0x174/frame 0xfffffe0000599930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000599970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005999a0 _sleep() at _sleep+0x2da/frame 0xfffffe0000599a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0000599a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000599ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000599ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100068 td 0xfffff8000390f580 sched_switch() at sched_switch+0x71a/frame 0xfffffe000059e900 mi_switch() at mi_switch+0x174/frame 0xfffffe000059e930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000059e970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000059e9a0 _sleep() at _sleep+0x2da/frame 0xfffffe000059ea40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe000059ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe000059eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000059eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100069 td 0xfffff8000390f000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00005a3900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005a3930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005a3970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005a39a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005a3a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005a3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005a3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005a3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100070 td 0xfffff8000390e580 sched_switch() at sched_switch+0x71a/frame 0xfffffe00005a8900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005a8930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005a8970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005a89a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005a8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005a8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005a8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005a8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100071 td 0xfffff8000390e000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00005ad900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005ad930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005ad970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005ad9a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005ada40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005ada70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005adab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005adab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100072 td 0xfffff8000390d580 sched_switch() at sched_switch+0x71a/frame 0xfffffe00005b2900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005b2930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005b2970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005b29a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005b2a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005b2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005b2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005b2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100073 td 0xfffff8000390d000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00005b7900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005b7930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005b7970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005b79a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005b7a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005b7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005b7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005b7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100074 td 0xfffff80003920580 sched_switch() at sched_switch+0x71a/frame 0xfffffe00005bc900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005bc930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005bc970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005bc9a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005bca40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005bca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005bcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005bcab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100075 td 0xfffff80003920000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00005c1900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005c1930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005c1970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005c19a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005c1a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005c1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005c1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005c1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100076 td 0xfffff8000391f580 sched_switch() at sched_switch+0x71a/frame 0xfffffe00005c6900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005c6930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005c6970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005c69a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005c6a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005c6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005c6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005c6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100077 td 0xfffff8000391f000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00005cb900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005cb930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005cb970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005cb9a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005cba40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005cba70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005cbab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005cbab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100114 td 0xfffff800060c4580 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e9e930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e9e960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e9e9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e9e9d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe0006e9ea40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0006e9ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e9eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e9eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100121 td 0xfffff8000c1f6000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006ed9930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ed9960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006ed99a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006ed99d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe0006ed9a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0006ed9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ed9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ed9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100122 td 0xfffff8000c1f5580 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006ede930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ede960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006ede9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006ede9d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe0006edea40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0006edea70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006edeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006edeab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100123 td 0xfffff8000c1f5000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006ee3930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ee3960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006ee39a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006ee39d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe0006ee3a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0006ee3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ee3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ee3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100124 td 0xfffff8000c1f4580 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006ee8900 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ee8930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006ee8970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006ee89a0 _sleep() at _sleep+0x2da/frame 0xfffffe0006ee8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0006ee8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ee8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ee8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:pho> dump Dumping 1316 out of 32621 MB:..2%..11%..21%..31%..41%..52%..61%..71%..81%..92% Dump complete db> reset cpu_reset: Restarting BSP cpu_reset_proxy: Stopped CPU 6 (kgdb) bt #0 doadump (textdump=) at pcpu.h:230 #1 0xffffffff804902ab in db_dump (dummy=, dummy2=, dummy3=, dummy4=) at ../../../ddb/db_command.c:574 #2 0xffffffff80490079 in db_command (cmd_table=, dopager=0x0) at ../../../ddb/db_command.c:481 #3 0xffffffff80494f78 in db_script_exec (scriptname=, warnifnotfound=) at ../../../ddb/db_script.c:304 #4 0xffffffff80490079 in db_command (cmd_table=, dopager=0x1) at ../../../ddb/db_command.c:481 #5 0xffffffff8048fdf4 in db_command_loop () at ../../../ddb/db_command.c:534 #6 0xffffffff80492faf in db_trap (type=, code=) at ../../../ddb/db_main.c:252 #7 0xffffffff80c1e6c4 in kdb_trap (type=0x3, code=0x0, tf=) at ../../../kern/subr_kdb.c:692 #8 0xffffffff810b5f7b in trap (frame=0xfffffe00a6b6e510) at ../../../amd64/amd64/trap.c:619 #9 0xffffffff81090015 in calltrap () at ../../../amd64/amd64/exception.S:232 #10 0xffffffff80c1ddcb in kdb_enter (why=0xffffffff8134ba9e "panic", msg=) at cpufunc.h:65 #11 0xffffffff80bd6181 in vpanic (fmt=, ap=0xfffffe00a6b6e680) at ../../../kern/kern_shutdown.c:866 #12 0xffffffff80bd5f13 in panic (fmt=) at ../../../kern/kern_shutdown.c:804 #13 0xffffffff80c888e7 in brelse (bp=0xfffffe0000977f78) at ../../../kern/vfs_bio.c:2611 #14 0xffffffff80cae44f in bnoreuselist (bufv=0xfffff8000c8f5918, bo=0xfffff8000c8f58d0, startn=0xffff, endn=0x10000) at ../../../kern/vfs_subr.c:1845 #15 0xffffffff80c9d6b0 in vop_stdadvise (ap=0xfffffe00a6b6e858) at ../../../kern/vfs_default.c:1119 #16 0xffffffff81242838 in VOP_ADVISE_APV (vop=0xffffffff81b2b438, a=0xfffffe00a6b6e858) at vnode_if.c:3795 #17 0xffffffff806eb24e in VOP_ADVISE (vp=0xfffff8000c8f5768, start=0x7ffffe00, end=0x7fffffff, advice=0x4) at vnode_if.h:1654 #18 0xffffffff806e8e36 in mdstart_vnode (sc=0xfffff8000c3fa000, bp=0xfffff80254c14330) at ../../../dev/md/md.c:1004 #19 0xffffffff806e6d82 in md_kthread (arg=0xfffff8000c3fa000) at ../../../dev/md/md.c:1241 #20 0xffffffff80b95d14 in fork_exit (callout=0xffffffff806e6a50 , arg=0xfffff8000c3fa000, frame=0xfffffe00a6b6eac0) at ../../../kern/kern_fork.c:1053 #21 0xffffffff81090ffe in fork_trampoline () at ../../../amd64/amd64/exception.S:993 #22 0x0000000000000000 in ?? () Current language: auto; currently minimal (kgdb) f 13 #13 0xffffffff80c888e7 in brelse (bp=0xfffffe0000977f78) at ../../../kern/vfs_bio.c:2611 2611 KASSERT((bp->b_flags & B_VMIO) != 0 || (bp->b_flags & B_NOREUSE) == 0, (kgdb) l 2606 return; 2607 CTR3(KTR_BUF, "brelse(%p) vp %p flags %X", 2608 bp, bp->b_vp, bp->b_flags); 2609 KASSERT(!(bp->b_flags & (B_CLUSTER|B_PAGING)), 2610 ("brelse: inappropriate B_PAGING or B_CLUSTER bp %p", bp)); 2611 KASSERT((bp->b_flags & B_VMIO) != 0 || (bp->b_flags & B_NOREUSE) == 0, 2612 ("brelse: non-VMIO buffer marked NOREUSE")); 2613 2614 if (BUF_LOCKRECURSED(bp)) { 2615 /* (kgdb) info loc v_mnt = (struct mount *) 0x819000000ffff qindex = 0xffffffff (kgdb) p *bp $1 = {b_bufobj = 0xfffff8000c8f58d0, b_bcount = 0x8000, b_caller1 = 0x0, b_data = 0xfffffe0007880000 "", b_error = 0x0, b_iocmd = 0x2, b_ioflags = 0x0, b_iooffset = 0x624a0000, b_resid = 0x0, b_iodone = 0, b_ckhashcalc = 0, b_ckhash = 0x0, b_blkno = 0x312500, b_offset = 0x7fff8000, b_bobufs = { tqe_next = 0xfffffe000097a5e8, tqe_prev = 0xfffffe000097c508}, b_vflags = 0x0, b_qindex = 0x3, b_domain = 0x4, b_subqueue = 0xc, b_flags = 0x80401820, b_xflags = 0x2, b_lock = {lock_object = {lo_name = 0xffffffff81385df0 "bufwait", lo_flags = 0x6730000, lo_data = 0x0, lo_witness = 0xfffff8087fd71200}, lk_lock = 0xfffff80254c1c580, lk_exslpfail = 0x0, lk_timo = 0x0, lk_pri = 0x60, lk_stack = {depth = 0xb, pcs = 0xfffffe0000978030}}, b_bufsize = 0x8000, b_runningbufspace = 0x0, b_kvasize = 0x8000, b_dirtyoff = 0x0, b_dirtyend = 0x0, b_kvabase = 0xfffffe0007880000 "", b_lblkno = 0xffff, b_vp = 0xfffff8000c8f5768, b_rcred = 0x0, b_wcred = 0x0, {b_freelist = { tqe_next = 0xfffffe00009773f0, tqe_prev = 0xfffffe00009677c8}, {b_pgiodone = 0xfffffe00009773f0, b_pgbefore = 0x9677c8, b_pgafter = 0xfffffe00}}, b_cluster = { cluster_head = {tqh_first = 0x0, tqh_last = 0x0}, cluster_entry = {tqe_next = 0x0, tqe_prev = 0x0}}, b_pages = 0xfffffe0000978120, b_npages = 0x8, b_dep = { lh_first = 0x0}, b_fsprivate1 = 0x0, b_fsprivate2 = 0x0, b_fsprivate3 = 0x0, b_io_tracking = 0xfffffe0000978248, b_io_tcnt = 0x1e} (kgdb) f 14 #14 0xffffffff80cae44f in bnoreuselist (bufv=0xfffff8000c8f5918, bo=0xfffff8000c8f58d0, startn=0xffff, endn=0x10000) at ../../../kern/vfs_subr.c:1845 1845 brelse(bp); (kgdb) l 1840 * reused. Dirty buffers will have the hint applied once 1841 * they've been written. 1842 */ 1843 if (bp->b_vp->v_object != NULL) 1844 bp->b_flags |= B_NOREUSE; 1845 brelse(bp); 1846 BO_RLOCK(bo); 1847 } 1848 return (0); 1849 } (kgdb) info loc bp = (struct buf *) 0xfffffe0000977f78 error = 0x0 lblkno = 0x10000 (kgdb) p *bufv $2 = {bv_hd = {tqh_first = 0xfffffe000097c880, tqh_last = 0xfffffe0000978b60}, bv_root = {pt_root = 0xfffff8000c096090}, bv_cnt = 0x23} (kgdb) p *bo $3 = {bo_lock = {lock_object = {lo_name = 0xffffffff8135168f "bufobj interlock", lo_flags = 0x5230000, lo_data = 0x0, lo_witness = 0xfffff8087fd75a00}, rw_lock = 0x1}, bo_ops = 0xffffffff81b28860, bo_object = 0xfffff80254e23d00, bo_synclist = {le_next = 0x0, le_prev = 0xfffff80006028e60}, bo_private = 0xfffff8000c8f5768, bo_clean = { bv_hd = {tqh_first = 0xfffffe000097c880, tqh_last = 0xfffffe0000978b60}, bv_root = {pt_root = 0xfffff8000c096090}, bv_cnt = 0x23}, bo_dirty = {bv_hd = {tqh_first = 0x0, tqh_last = 0xfffff8000c8f5938}, bv_root = {pt_root = 0x0}, bv_cnt = 0x0}, bo_numoutput = 0x0, bo_flag = 0x0, bo_domain = 0x4, bo_bsize = 0x8000} (kgdb) f 18 #18 0xffffffff806e8e36 in mdstart_vnode (sc=0xfffff8000c3fa000, bp=0xfffff80254c14330) at ../../../dev/md/md.c:1004 1004 VOP_ADVISE(vp, iostart, auio.uio_offset - 1, (kgdb) l 999 sc->flags &= ~MD_VERIFY; 1000 } 1001 1002 /* When MD_CACHE is set, try to avoid double-caching the data. */ 1003 if (error == 0 && (sc->flags & MD_CACHE) == 0) 1004 VOP_ADVISE(vp, iostart, auio.uio_offset - 1, 1005 POSIX_FADV_DONTNEED); 1006 1007 if (pb != NULL) { 1008 pmap_qremove((vm_offset_t)pb->b_data, npages); (kgdb) info loc error = 0x0 auio = {uio_iov = 0xfffffe00a6b6e990, uio_iovcnt = 0x1, uio_offset = 0x80000000, uio_resid = 0x0, uio_segflg = UIO_SYSSPACE, uio_rw = UIO_READ, uio_td = 0xfffff80254c1c580} aiov = {iov_base = 0xfffff8000ce9ea00, iov_len = 0x0} piov = (struct iovec *) 0x0 mp = (struct mount *) 0xffffffff812658ab vp = (struct vnode *) 0xfffff8000c8f5768 pb = (struct buf *) 0x0 vlist = (bus_dma_segment_t *) 0xffffffff80c3e975 td = (struct thread *) 0xfffff80254c1c580 iolen = 0xffffffff80be0fdf iostart = 0x7ffffe00 len = 0x200 zerosize = 0x0 ma_offs = 0x0 npages = 0x246 (kgdb) p *sc $4 = {unit = 0xb, list = {le_next = 0xfffff80254608000, le_prev = 0xffffffff81bf6be8}, bio_queue = {queue = {tqh_first = 0x0, tqh_last = 0xfffff8000c3fa018}, last_offset = 0x80000000, insert_point = 0x0, total = 0x0, batched = 0x1}, queue_mtx = {lock_object = {lo_name = 0xffffffff81322587 "md bio queue", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xfffff8087fd79080}, mtx_lock = 0x0}, stat_mtx = {lock_object = {lo_name = 0xffffffff812b930f "md stat", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xfffff8087fd79100}, mtx_lock = 0x0}, dev = 0x0, type = MD_VNODE, mediasize = 0x80000000, sectorsize = 0x200, opencount = 0x1, fwheads = 0x0, fwsectors = 0x0, ident = 0xfffff8000c3fa0a8 "MD-DEV150-INO4", flags = 0x8, name = 0xfffff8000c3fa0cc "md11", procp = 0xfffff80254ce8a60, gp = 0xfffff80003dcd200, pp = 0xfffff80003dcd100, start = 0xffffffff806e86f0 , devstat = 0xfffff800036e0ea0, indir = 0x0, uma = 0x0, pl_ptr = 0x0, pl_len = 0x0, vnode = 0xfffff8000c8f5768, file = 0xfffff8000c3fa130 "/mnt/.snap/stress2", label = 0xfffff8000c3fa530 "", cred = 0xfffff8000ce5ba00, object = 0x0} (kgdb) p *bp $5 = {bio_cmd = 0x1, bio_flags = 0x0, bio_cflags = 0x0, bio_pflags = 0x0, bio_dev = 0x0, bio_disk = 0x0, bio_offset = 0x7ffffe00, bio_bcount = 0x0, bio_data = 0xfffff8000ce9e800 "", bio_ma = 0x0, bio_ma_offset = 0x0, bio_ma_n = 0x0, bio_error = 0x0, bio_resid = 0x0, bio_done = 0, bio_driver1 = 0x0, bio_driver2 = 0x0, bio_caller1 = 0x0, bio_caller2 = 0x0, bio_queue = {tqe_next = 0x0, tqe_prev = 0xfffff8000c3fa018}, bio_attribute = 0x0, bio_zone = {zone_cmd = 0x0, zone_params = { disk_params = {zone_mode = 0x0, flags = 0x0, optimal_seq_zones = 0x0, optimal_nonseq_zones = 0x0, max_seq_zones = 0x0}, rwp = {id = 0x0, flags = 0x0}, report = { starting_id = 0x0, rep_options = 0x0, header = {same = 0x0, maximum_lba = 0x0, reserved = 0xfffff80254c143e8 ""}, entries_allocated = 0x0, entries_filled = 0x0, entries_available = 0x0, entries = 0x0}}}, bio_from = 0xfffff8000c2ace00, bio_to = 0xfffff80003dcd100, bio_length = 0x200, bio_completed = 0x0, bio_children = 0x0, bio_inbed = 0x0, bio_parent = 0x0, bio_t0 = {sec = 0x30, frac = 0x8492050a7bade68d}, bio_task = 0, bio_task_arg = 0x0, bio_classifier1 = 0x0, bio_classifier2 = 0x0, _bio_caller1 = 0x0, _bio_caller2 = 0x0, _bio_cflags = 0x0, bio_track_bp = 0x0, bio_pblkno = 0x0} (kgdb) -- Test scenario: misc/snap11.sh