panic: vm_page_relookup: Invalid page 0, vmcore.183 KDB: debugger backends: ddb KDB: current backend: ddb ---<>--- Copyright (c) 1992-2020 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 13.0-CURRENT #0 r359962: Wed Apr 15 13:39:21 CEST 2020 pho@mercat1.netperf.freebsd.org:/usr/src/sys/amd64/compile/PHO amd64 FreeBSD clang version 10.0.0 (git@github.com:llvm/llvm-project.git llvmorg-10.0.0-0-gd32170dbd5b) WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. VT(vga): resolution 640x480 CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.07-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics real memory = 34359738368 (32768 MB) avail memory = 33163632640 (31627 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 12 CPUs FreeBSD/SMP: 1 package(s) x 6 core(s) x 2 hardware threads random: registering fast source Intel Secure Key RNG random: fast provider: "Intel Secure Key RNG" random: unblocking device. ioapic0 irqs 0-23 ioapic1 irqs 24-47 Launching APs: 1 5 2 9 4 3 7 10 11 8 6 Timecounter "TSC-low" frequency 1750033580 Hz quality 1000 random: entropy device external interface WARNING: Device "kbd" is Giant locked and may be deleted before FreeBSD 13.0. kbd1 at kbdmux0 000.000052 [4342] netmap_init netmap: loaded module [ath_hal] loaded nexus0 vtvga0: cryptosoft0: acpi0: acpi0: Power Button (fixed) cpu0: on acpi0 atrtc0: port 0x70-0x71,0x74-0x77 irq 8 on acpi0 atrtc0: registered as a time-of-day clock, resolution 1.000000s Event timer "RTC" frequency 32768 Hz quality 0 attimer0: port 0x40-0x43,0x50-0x53 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Event timer "HPET" frequency 14318180 Hz quality 350 Event timer "HPET1" frequency 14318180 Hz quality 340 Event timer "HPET2" frequency 14318180 Hz quality 340 Event timer "HPET3" frequency 14318180 Hz quality 340 Event timer "HPET4" frequency 14318180 Hz quality 340 Event timer "HPET5" frequency 14318180 Hz quality 340 Event timer "HPET6" frequency 14318180 Hz quality 340 Event timer "HPET7" frequency 14318180 Hz quality 340 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 pcib0: on acpi0 pci0: on pcib0 pci0: at device 11.1 (no driver attached) pci0: at device 11.2 (no driver attached) pci0: at device 16.1 (no driver attached) pci0: at device 16.6 (no driver attached) pci0: at device 18.1 (no driver attached) acpi_syscontainer0: on acpi0 acpi_syscontainer1: on acpi0 acpi_syscontainer2: on acpi0 acpi_syscontainer3: on acpi0 pcib1: port 0xcf8-0xcff on acpi0 pci1: on pcib1 pcib2: irq 26 at device 1.0 on pci1 pci2: on pcib2 pcib3: irq 32 at device 2.0 on pci1 pci3: on pcib3 pci3: at device 0.0 (no driver attached) pci3: at device 0.1 (no driver attached) pcib4: irq 40 at device 3.0 on pci1 pci4: on pcib4 pci1: at device 17.0 (no driver attached) ahci0: port 0xf110-0xf117,0xf100-0xf103,0xf0f0-0xf0f7,0xf0e0-0xf0e3,0xf020-0xf03f mem 0xfb438000-0xfb4387ff irq 16 at device 17.4 on pci1 ahci0: AHCI v1.30 with 4 6Gbps ports, Port Multiplier not supported ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahcich2: at channel 2 on ahci0 ahcich3: at channel 3 on ahci0 ahciem0: on ahci0 xhci0: mem 0xfb400000-0xfb40ffff irq 19 at device 20.0 on pci1 xhci0: 32 bytes context size, 64-bit DMA usbus0 on xhci0 usbus0: 5.0Gbps Super Speed USB v3.0 pci1: at device 22.0 (no driver attached) pci1: at device 22.1 (no driver attached) ehci0: mem 0xfb434000-0xfb4343ff irq 18 at device 26.0 on pci1 usbus1: EHCI version 1.0 usbus1 on ehci0 usbus1: 480Mbps High Speed USB v2.0 pcib5: irq 16 at device 28.0 on pci1 pci5: on pcib5 pcib6: irq 18 at device 28.2 on pci1 pci6: on pcib6 pcib7: at device 0.0 on pci6 pci7: on pcib7 vgapci0: port 0xe000-0xe07f mem 0xfa000000-0xfaffffff,0xfb000000-0xfb01ffff irq 18 at device 0.0 on pci7 vgapci0: Boot video device pcib8: irq 16 at device 28.4 on pci1 pci8: on pcib8 igb0: port 0xd020-0xd03f mem 0xfb320000-0xfb33ffff,0xfb344000-0xfb347fff irq 16 at device 0.0 on pci8 igb0: Using 1024 TX descriptors and 1024 RX descriptors igb0: queue equality override not set, capping rx_queues at 6 and tx_queues at 6 igb0: Using 6 RX queues 6 TX queues igb0: Using MSI-X interrupts with 7 vectors igb0: Ethernet address: 0c:c4:7a:a8:cd:da igb0: netmap queues/slots: TX 6/1024, RX 6/1024 igb1: port 0xd000-0xd01f mem 0xfb300000-0xfb31ffff,0xfb340000-0xfb343fff irq 17 at device 0.1 on pci8 igb1: Using 1024 TX descriptors and 1024 RX descriptors igb1: queue equality override not set, capping rx_queues at 6 and tx_queues at 6 igb1: Using 6 RX queues 6 TX queues igb1: Using MSI-X interrupts with 7 vectors igb1: Ethernet address: 0c:c4:7a:a8:cd:db igb1: netmap queues/slots: TX 6/1024, RX 6/1024 ehci1: mem 0xfb433000-0xfb4333ff irq 18 at device 29.0 on pci1 usbus2: EHCI version 1.0 usbus2 on ehci1 usbus2: 480Mbps High Speed USB v2.0 isab0: at device 31.0 on pci1 isa0: on isab0 ahci1: port 0xf070-0xf077,0xf060-0xf063,0xf050-0xf057,0xf040-0xf043,0xf000-0xf01f mem 0xfb432000-0xfb4327ff irq 16 at device 31.2 on pci1 ahci1: AHCI v1.30 with 6 6Gbps ports, Port Multiplier not supported ahcich4: at channel 0 on ahci1 ahcich5: at channel 1 on ahci1 ahcich6: at channel 2 on ahci1 ahcich7: at channel 3 on ahci1 ahcich8: at channel 4 on ahci1 ahcich9: at channel 5 on ahci1 ahciem1: on ahci1 acpi_button0: on acpi0 uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0 uart1: console (115200,n,8,1) orm0: at iomem 0xc0000-0xc7fff,0xcb000-0xcbfff pnpid ORM0000 on isa0 est0: on cpu0 p4tcc0: on cpu0 NULL mp in getnewvnode(9), tag crossmp Timecounters tick every 1.000 msec Obsolete code will be removed soon: random(9) is the obsolete Park-Miller LCG from 1988 Expensive timeout(9) function: 0xffffffff804db010(0xfffffe00d2ac8000) 0.005031631 s ses0 at ahciem0 bus 0 scbus4 target 0 lun 0 ses0: SEMB S-E-S 2.00 device ses0: SEMB SES Device ses1 at ahciem1 bus 0 scbus11 target 0 lun 0 ses1: SEMB S-E-S 2.00 device ses1: SEMB SES Device ses0: pass0 in 'Slot 01', SATA Slot: scbus1 target 0 ada0 at ahcich1 bus 0 scbus1 target 0 lun 0 ada0: ACS-2 ATA SATA 3.x device ada0: Serial Number WD-WCC3F3KDDP98 ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes) ada0: Command Queueing enabled ada0: 953869MB (1953525168 512 byte sectors) ada0: quirks=0x1<4K> Expensive timeout(9) function: 0xffffffff80a2da20(0xffffffff818e6468) 0.007402573 s hwpmc: SOFT/16/64/0x67 TSC/1/64/0x20 IAP/4/48/0x3ff IAF/3/48/0x67 Trying to mount root from ufs:/dev/gpt/work [rw]... WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. ugen2.1: at usbus2 ugen1.1: at usbus1 uhub0 on usbus2 ugen0.1: <0x8086 XHCI root HUB> at usbus0 uhub0: on usbus2 uhub1 on usbus0 uhub1: <0x8086 XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0 uhub2 on usbus1 uhub2: on usbus1 . ugen0.3: at usbus0 ukbd0 on uhub3 ukbd0: on usbus0 kbd2 at ukbd0 lo0: link state changed to UP Starting Network: lo0 igb0 igb1. lo0: flags=8049 metric 0 mtu 16384 options=680003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x3 inet 127.0.0.1 netmask 0xff000000 groups: lo nd6 options=21 igb0: flags=8863 metric 0 mtu 1500 options=4e507bb ether 0c:c4:7a:a8:cd:da inet6 fe80::ec4:7aff:fea8:cdda%igb0 prefixlen 64 scopeid 0x1 media: Ethernet autoselect status: no carrier nd6 options=21 igb1: flags=8822 metric 0 mtu 1500 options=4e507bb ether 0c:c4:7a:a8:cd:db media: Ethernet autoselect status: no carrier nd6 options=29 Starting devd. igb0: link state changed to UP Autoloading module: ioat.ko ioat0: mem 0xfb42c000-0xfb42ffff irq 31 at device 4.0 on pci1 ioat0: Capabilities: 2f7 ioat1: mem 0xfb428000-0xfb42bfff irq 39 at device 4.1 on pci1 ioat1: Capabilities: 2f7 ioat2: mem 0xfb424000-0xfb427fff irq 31 at device 4.2 on pci1 ioat2: Capabilities: f7 ioat3: mem 0xfb420000-0xfb423fff irq 39 at device 4.3 on pci1 ioat3: Capabilities: f7 ioat4: mem 0xfb41c000-0xfb41ffff irq 31 at device 4.4 on pci1 ioat4: Capabilities: f7 ioat5: mem 0xfb418000-0xfb41bfff irq 39 at device 4.5 on pci1 ioat5: Capabilities: f7 ioat6: mem 0xfb414000-0xfb417fff irq 31 at device 4.6 on pci1 ioat6: Capabilities: f7 ioat7: mem 0xfb410000-0xfb413fff irq 39 at device 4.7 on pci1 ioat7: Capabilities: f7 Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Starting Network: igb1. igb1: flags=8822 metric 0 mtu 1500 options=4e507bb ether 0c:c4:7a:a8:cd:db media: Ethernet autoselect status: no carrier nd6 options=29 Autoloading module: uhid.ko Autoloading module: ums.ko ums0 on uhub3 ums0: on usbus0 ums0: 3 buttons and [Z] coordinates ID=0 Starting dhclient. DHCPREQUEST on igb0 to 255.255.255.255 port 67 DHCPACK from 192if_delmulti_locked: detaching ifnet instance 0xfffff800041d9800 .168.5.1 bound to 192.168.5.171 -- renewal in 300 seconds. add host 127.0.0.1: gateway lo0 fib 0: route already in table add host ::1: gateway lo0 fib 0: route already in table add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Creating and/or trimming log files. Starting syslogd. Setting date via ntp. 15 Apr 14:12:28 ntpdate[2073]: step time server 192.168.5.1 offset -0.120248 sec Starting rpcbind. NFS access cache time=60 Updating CPU Microcode... CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.07-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab Structured Extended Features3=0x9c000400 XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics Done. Starting watchdogd. No core dumps found. Clearing /tmp (X related). Starting statd. Starting lockd. Recovering vi editor sessions:. fsckumount: unmount of /tmp failed: Device busy ** /dev/gpt/tmp (NO WRITE) ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 429 files, 8295 used, 1257112 free (136 frags, 157122 blocks, 0.0% fragmentation) mount: /dev/gpt/tmp: Device busy Updating motd:. Mounting late filesystems:. Security policy loaded: MAC/ntpd (mac_ntpd) Starting ntpd. Starting powerd. Configuring vt: blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting cron. Wed Apr 15 14:12 FreeBSD/amd64 (mercat1.netperf.freebsd.org) (ttyu1) login: root Apr 15 14:13:47 mercat1 login[2431]: ROOT LOGIN (root) ON ttyu1 Last login: Wed Apr 15 12:04:09 on ttyu1 FreeBSD 13.0-CURRENT (PHO) #0 r359962: Wed Apr 15 13:39:21 CEST 2020 root@mercat1:~ # Apr 15 14:14:09 mercat1 su[2449]: pho to root on /dev/pts/0 lock order reversal: 1st 0xfffff8020f9727e8 ufs (ufs) @ kern/vfs_mount.c:1631 2nd 0xfffff802b9387a68 devfs (devfs) @ kern/vfs_subr.c:3259 stack backtrace: #0 0xffffffff80c30f61 at witness_debugger+0x71 #1 0xffffffff80b95e12 at lockmgr_lock_flags+0x172 #2 0xffffffff810eab10 at VOP_LOCK1_APV+0x40 #3 0xffffffff80cb3524 at _vn_lock+0x54 #4 0xffffffff80c9e185 at vput_final+0x135 #5 0xffffffff80ee6161 at ffs_unmount+0x391 #6 0xffffffff80c95753 at dounmount+0x423 #7 0xffffffff80c952d9 at kern_unmount+0x2b9 #8 0xffffffff8106dcf9 at amd64_syscall+0x159 #9 0xffffffff81043cf0 at fast_syscall_common+0x101 Apr 15 18:56:53 mercat1 su[1359]: pho to root on /dev/pts/1 Apr 15 19:54:11 mercat1 su[13284]: pho to root on /dev/pts/1 panic: vm_page_relookup: Invalid page 0 cpuid = 9 time = 1586975929 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e39f0960 vpanic() at vpanic+0x182/frame 0xfffffe00e39f09b0 panic() at panic+0x43/frame 0xfffffe00e39f0a10 vm_page_relookup() at vm_page_relookup+0x4e/frame 0xfffffe00e39f0a30 sendfile_iodone() at sendfile_iodone+0x153/frame 0xfffffe00e39f0a70 vnode_pager_generic_getpages_done_async() at vnode_pager_generic_getpages_done_async+0x3a/frame 0xfffffe00e39f0a90 bufdone() at bufdone+0x6c/frame 0xfffffe00e39f0b00 g_io_deliver() at g_io_deliver+0x25e/frame 0xfffffe00e39f0b50 md_kthread() at md_kthread+0x259/frame 0xfffffe00e39f0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e39f0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e39f0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- KDB: enter: panic [ thread pid 93020 tid 100215 ] Stopped at kdb_enter+0x37: movq $0,0x10cafd6(%rip) db> run pho db:0:pho> set $lines 20000 db:0:pho> run pho1 db:1:pho1> dump Dumping 1609 out of 32626 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% Dump complete db:1:pho1> bt Tracing pid 93020 tid 100215 td 0xfffffe00e449cc00 kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e39f0960 vpanic() at vpanic+0x19e/frame 0xfffffe00e39f09b0 panic() at panic+0x43/frame 0xfffffe00e39f0a10 vm_page_relookup() at vm_page_relookup+0x4e/frame 0xfffffe00e39f0a30 sendfile_iodone() at sendfile_iodone+0x153/frame 0xfffffe00e39f0a70 vnode_pager_generic_getpages_done_async() at vnode_pager_generic_getpages_done_async+0x3a/frame 0xfffffe00e39f0a90 bufdone() at bufdone+0x6c/frame 0xfffffe00e39f0b00 g_io_deliver() at g_io_deliver+0x25e/frame 0xfffffe00e39f0b50 md_kthread() at md_kthread+0x259/frame 0xfffffe00e39f0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e39f0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e39f0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:1:pho1> show allpcpu Current CPU: 9 cpuid = 0 dynamic pcpu = 0x97bb80 curthread = 0xfffffe003e3e0300: pid 11 tid 100003 critnest 1 "idle: cpu0" curpcb = 0xfffffe003e3e0810 fpcurthread = none idlethread = 0xfffffe003e3e0300: tid 100003 "idle: cpu0" self = 0xffffffff82410000 curpmap = 0xffffffff81c8df80 tssp = 0xffffffff82410384 rsp0 = 0xfffffe00add46cc0 kcr3 = 0x800000000230d002 ucr3 = 0xffffffffffffffff scr3 = 0x44df01e2c gs32p = 0xffffffff82410404 ldt = 0xffffffff82410444 tss = 0xffffffff82410434 tlb gen = 126772222 curvnet = 0 spin locks held: cpuid = 1 dynamic pcpu = 0xfffffe00bc7f3b80 curthread = 0xfffffe00e3a04e00: pid 94786 tid 101322 critnest 0 "sendfile21" curpcb = 0xfffffe00e3a05310 fpcurthread = 0xfffffe00e3a04e00: pid 94786 "sendfile21" idlethread = 0xfffffe003e3dfc00: tid 100004 "idle: cpu1" self = 0xffffffff82411000 curpmap = 0xfffffe00e3a0cb08 tssp = 0xffffffff82411384 rsp0 = 0xfffffe00e60c9cc0 kcr3 = 0x800000038a984284 ucr3 = 0x80000006fc90fa84 scr3 = 0x70e786a83 gs32p = 0xffffffff82411404 ldt = 0xffffffff82411444 tss = 0xffffffff82411434 tlb gen = 126772222 curvnet = 0xfffff800037c2040 spin locks held: cpuid = 2 dynamic pcpu = 0xfffffe00bc7ffb80 curthread = 0xfffffe003e3df500: pid 11 tid 100005 critnest 1 "idle: cpu2" curpcb = 0xfffffe003e3dfa10 fpcurthread = none idlethread = 0xfffffe003e3df500: tid 100005 "idle: cpu2" self = 0xffffffff82412000 curpmap = 0xffffffff81c8df80 tssp = 0xffffffff82412384 rsp0 = 0xfffffe00add50cc0 kcr3 = 0x800000000230d002 ucr3 = 0xffffffffffffffff scr3 = 0x6fc90fd32 gs32p = 0xffffffff82412404 ldt = 0xffffffff82412444 tss = 0xffffffff82412434 tlb gen = 126772222 curvnet = 0 spin locks held: cpuid = 3 dynamic pcpu = 0xfffffe00bc80bb80 curthread = 0xfffffe003e3dee00: pid 11 tid 100006 critnest 1 "idle: cpu3" curpcb = 0xfffffe003e3df310 fpcurthread = none idlethread = 0xfffffe003e3dee00: tid 100006 "idle: cpu3" self = 0xffffffff82413000 curpmap = 0xffffffff81c8df80 tssp = 0xffffffff82413384 rsp0 = 0xfffffe00add55cc0 kcr3 = 0x800000000230d002 ucr3 = 0xffffffffffffffff scr3 = 0x1de90f901 gs32p = 0xffffffff82413404 ldt = 0xffffffff82413444 tss = 0xffffffff82413434 tlb gen = 126772222 curvnet = 0 spin locks held: cpuid = 4 dynamic pcpu = 0xfffffe00bc817b80 curthread = 0xfffffe003e3de700: pid 11 tid 100007 critnest 1 "idle: cpu4" curpcb = 0xfffffe003e3dec10 fpcurthread = none idlethread = 0xfffffe003e3de700: tid 100007 "idle: cpu4" self = 0xffffffff82414000 curpmap = 0xffffffff81c8df80 tssp = 0xffffffff82414384 rsp0 = 0xfffffe00add5acc0 kcr3 = 0x800000000230d003 ucr3 = 0xffffffffffffffff scr3 = 0x1de508fda gs32p = 0xffffffff82414404 ldt = 0xffffffff82414444 tss = 0xffffffff82414434 tlb gen = 126772222 curvnet = 0 spin locks held: cpuid = 5 dynamic pcpu = 0xfffffe00bc823b80 curthread = 0xfffffe003e466800: pid 12 tid 100049 critnest 0 "swi4: clock (0)" curpcb = 0xfffffe003e466d10 fpcurthread = none idlethread = 0xfffffe003e3de000: tid 100008 "idle: cpu5" self = 0xffffffff82415000 curpmap = 0xffffffff81c8df80 tssp = 0xffffffff82415384 rsp0 = 0xfffffe0037a5ccc0 kcr3 = 0x800000000230d002 ucr3 = 0xffffffffffffffff scr3 = 0x1e8359d0c gs32p = 0xffffffff82415404 ldt = 0xffffffff82415444 tss = 0xffffffff82415434 tlb gen = 126772222 curvnet = 0xfffff800037c2040 spin locks held: cpuid = 6 dynamic pcpu = 0xfffffe00bc82fb80 curthread = 0xfffffe003e3e8a00: pid 11 tid 100009 critnest 1 "idle: cpu6" curpcb = 0xfffffe003e3e8f10 fpcurthread = none idlethread = 0xfffffe003e3e8a00: tid 100009 "idle: cpu6" self = 0xffffffff82416000 curpmap = 0xffffffff81c8df80 tssp = 0xffffffff82416384 rsp0 = 0xfffffe00add64cc0 kcr3 = 0x800000000230d002 ucr3 = 0xffffffffffffffff scr3 = 0x3a41dc38 gs32p = 0xffffffff82416404 ldt = 0xffffffff82416444 tss = 0xffffffff82416434 tlb gen = 126772222 curvnet = 0 spin locks held: cpuid = 7 dynamic pcpu = 0xfffffe00bc83bb80 curthread = 0xfffffe00d3dd0300: pid 93028 tid 101074 critnest 0 "swap" curpcb = 0xfffffe00d3dd0810 fpcurthread = 0xfffffe00d3dd0300: pid 93028 "swap" idlethread = 0xfffffe003e3e8300: tid 100010 "idle: cpu7" self = 0xffffffff82417000 curpmap = 0xfffffe00e44a04f0 tssp = 0xffffffff82417384 rsp0 = 0xfffffe00e613ccc0 kcr3 = 0x80000002773f321b ucr3 = 0x80000007d4de1a1b scr3 = 0x818b00a16 gs32p = 0xffffffff82417404 ldt = 0xffffffff82417444 tss = 0xffffffff82417434 tlb gen = 126772223 curvnet = 0 spin locks held: cpuid = 8 dynamic pcpu = 0xfffffe00bc847b80 curthread = 0xfffffe003e3e7c00: pid 11 tid 100011 critnest 1 "idle: cpu8" curpcb = 0xfffffe003e3e8110 fpcurthread = none idlethread = 0xfffffe003e3e7c00: tid 100011 "idle: cpu8" self = 0xffffffff82418000 curpmap = 0xffffffff81c8df80 tssp = 0xffffffff82418384 rsp0 = 0xfffffe00add6ecc0 kcr3 = 0x800000000230d003 ucr3 = 0xffffffffffffffff scr3 = 0x573dc18c1 gs32p = 0xffffffff82418404 ldt = 0xffffffff82418444 tss = 0xffffffff82418434 tlb gen = 126772222 curvnet = 0 spin locks held: cpuid = 9 dynamic pcpu = 0xfffffe00bc853b80 curthread = 0xfffffe00e449cc00: pid 93020 tid 100215 critnest 1 "md10" curpcb = 0xfffffe00e449d110 fpcurthread = none idlethread = 0xfffffe003e3e7500: tid 100012 "idle: cpu9" self = 0xffffffff82419000 curpmap = 0xffffffff81c8df80 tssp = 0xffffffff82419384 rsp0 = 0xfffffe00e39f0cc0 kcr3 = 0x800000000230d005 ucr3 = 0xffffffffffffffff scr3 = 0x1de904dd4 gs32p = 0xffffffff82419404 ldt = 0xffffffff82419444 tss = 0xffffffff82419434 tlb gen = 126772222 curvnet = 0 spin locks held: cpuid = 10 dynamic pcpu = 0xfffffe00bc85fb80 curthread = 0xfffffe003e3e6e00: pid 11 tid 100013 critnest 1 "idle: cpu10" curpcb = 0xfffffe003e3e7310 fpcurthread = none idlethread = 0xfffffe003e3e6e00: tid 100013 "idle: cpu10" self = 0xffffffff8241a000 curpmap = 0xffffffff81c8df80 tssp = 0xffffffff8241a384 rsp0 = 0xfffffe00add78cc0 kcr3 = 0x800000000230d002 ucr3 = 0xffffffffffffffff scr3 = 0x44302990 gs32p = 0xffffffff8241a404 ldt = 0xffffffff8241a444 tss = 0xffffffff8241a434 tlb gen = 126772222 curvnet = 0 spin locks held: cpuid = 11 dynamic pcpu = 0xfffffe00bc86bb80 curthread = 0xfffffe003e3e6700: pid 11 tid 100014 critnest 1 "idle: cpu11" curpcb = 0xfffffe003e3e6c10 fpcurthread = none idlethread = 0xfffffe003e3e6700: tid 100014 "idle: cpu11" self = 0xffffffff8241b000 curpmap = 0xffffffff81c8df80 tssp = 0xffffffff8241b384 rsp0 = 0xfffffe00add7dcc0 kcr3 = 0x800000000230d004 ucr3 = 0xffffffffffffffff scr3 = 0x7ae705e51 gs32p = 0xffffffff8241b404 ldt = 0xffffffff8241b444 tss = 0xffffffff8241b434 tlb gen = 126772221 curvnet = 0 spin locks held: db:1:pho1> show alllocks Process 94786 (sendfile21) thread 0xfffffe00e3a04e00 (101322) exclusive rw tcpinp (tcpinp) r = 0 (0xfffff8012ed8b020) locked @ netinet/tcp_usrreq.c:897 exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xfffffe00e68dff98) locked @ kern/uipc_sockbuf.c:419 Process 94785 (sendfile21) thread 0xfffffe00e6383e00 (101317) exclusive sx so_snd_sx (so_snd_sx) r = 0 (0xfffffe00e68e0b30) locked @ kern/uipc_sockbuf.c:416 Process 12 (intr) thread 0xfffffe003e466800 (100049) exclusive sleep mutex IP reassembly (IP reassembly) r = 0 (0xfffffe003e38e208) locked @ netinet/ip_reass.c:597 shared rw vnet_rwlock (vnet_rwlock) r = 0 (0xffffffff81d9b788) locked @ netinet/ip_input.c:844 db:1:pho1> show lockedvnods Locked vnodes db:1:pho1> show mount 0xfffffe00d41fd700 /dev/gpt/work on / (ufs) 0xfffffe00d41fe280 devfs on /dev (devfs) 0xfffffe00e44a5280 /dev/gpt/tmp on /tmp (ufs) 0xfffffe00e5ff0b80 /dev/md10 on /mnt (ufs) More info: show mount db:1:pho1> show bufqueues bqempty: 96458 Buf domain 0 freebufs 14169 lofreebufs 219 hifreebufs 329 bufspace 9007104 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 899 (8470528) dirtyq count 0 (0) wakeup 0 lim 25 CPU 8, 0, 12, 10, 5, 8, 6, 0, 9, 3, 4, 0, Locked buffers: 0 space 0 Total buffers: 6335 space 9007104 Buf domain 1 freebufs 14244 lofreebufs 219 hifreebufs 329 bufspace 6660096 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 2 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 819 (5767168) dirtyq count 2 (65536) wakeup 0 lim 25 CPU 3, 8, 5, 11, 10, 1, 0, 8, 6, 10, 5, 1, Locked buffers: 0 space 0 Total buffers: 13176 space 6660096 Buf domain 2 freebufs 14142 lofreebufs 219 hifreebufs 329 bufspace 9859072 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 4 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 927 (9027584) dirtyq count 4 (69632) wakeup 0 lim 25 CPU 11, 0, 5, 0, 11, 9, 11, 0, 1, 2, 9, 1, Locked buffers: 0 space 0 Total buffers: 3177 space 9859072 Buf domain 3 freebufs 14251 lofreebufs 219 hifreebufs 329 bufspace 7008256 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 831 (6672384) dirtyq count 0 (0) wakeup 0 lim 25 CPU 6, 3, 0, 0, 0, 8, 5, 6, 7, 10, 6, 0, Locked buffers: 0 space 0 Total buffers: 1430 space 7008256 Buf domain 4 freebufs 14281 lofreebufs 219 hifreebufs 329 bufspace 5836800 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 803 (5361664) dirtyq count 0 (0) wakeup 0 lim 25 CPU 0, 3, 3, 5, 0, 10, 12, 3, 1, 10, 0, 2, Locked buffers: 0 space 0 Total buffers: 1954 space 5836800 Buf domain 5 freebufs 12881 lofreebufs 219 hifreebufs 329 bufspace 51216384 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 2196 (50556928) dirtyq count 0 (0) wakeup 0 lim 25 CPU 7, 2, 7, 4, 0, 6, 5, 11, 2, 8, 0, 4, Locked buffers: 0 space 0 Total buffers: 7160 space 51216384 Buf domain 6 freebufs 12742 lofreebufs 219 hifreebufs 329 bufspace 55422976 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 9 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 2367 (54722560) dirtyq count 9 (294912) wakeup 0 lim 25 CPU 2, 0, 2, 2, 0, 1, 0, 2, 1, 3, 1, 1, Locked buffers: 0 space 0 Total buffers: 8220 space 55422976 db:1:pho1> show page vm_cnt.v_free_count: 169796 vm_cnt.v_inactive_count: 3990 vm_cnt.v_active_count: 4755222 vm_cnt.v_laundry_count: 2986162 vm_cnt.v_wire_count: 208299 vm_cnt.v_free_reserved: 10644 vm_cnt.v_free_min: 51264 vm_cnt.v_free_target: 173124 vm_cnt.v_inactive_target: 259686 db:1:pho1> show pageq pq_free 169796 dom 0 page_cnt 8124099 free 169796 pq_act 4755222 pq_inact 3990 pq_laund 2986162 pq_unsw 0 db:0:pho> show freepages DOMAIN: 0 FREE LIST 0: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000000 | 000000 09 (002048K) | 000000 | 000000 08 (001024K) | 000000 | 000000 07 (000512K) | 000000 | 000001 06 (000256K) | 000000 | 000001 05 (000128K) | 000001 | 000001 04 (000064K) | 000000 | 000001 03 (000032K) | 000000 | 000001 02 (000016K) | 000000 | 000001 01 (000008K) | 000000 | 000001 00 (000004K) | 000000 | 000000 FREE LIST 1: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000000 | 000000 09 (002048K) | 000000 | 000000 08 (001024K) | 000000 | 000000 07 (000512K) | 000000 | 000000 06 (000256K) | 000000 | 000000 05 (000128K) | 000000 | 000000 04 (000064K) | 000000 | 000000 03 (000032K) | 000000 | 000000 02 (000016K) | 000000 | 000000 01 (000008K) | 000000 | 000000 00 (000004K) | 000000 | 000000 db:0:pho> show uma Zone Size Used Free Requests Sleeps Bucket Total Mem XFree RADIX NODE 144 527714 13572 29507138 0 62 77945184 0 VNODE 640 65074 182 311679 0 16 41763840 0 mbuf_cluster 2048 12315 219 68697 0 8 25669632 0 swblk 136 43356 99817 1453652 0 62 19471528 0 FFS2 dinode 256 64948 692 229648 0 62 16803840 0 BUF TRIE 144 789 105163 854532 0 62 15257088 0 FFS inode 160 64948 702 229648 0 62 10504000 0 S VFS Cache 108 65331 1269 231003 0 126 7192800 0 mbuf 256 16533 6149 9512686 0 254 5806592 0 socket 904 58 2993 156069 0 16 2758104 0 VM OBJECT 264 6966 744 7714782 0 30 2035440 0 128 128 14349 252 975739 0 126 1868928 0 swpctrie 144 4259 7501 146226 0 62 1693440 0 4096 4096 351 0 296048 0 2 1437696 0 128 128 10581 362 270566 0 126 1400704 0 UMA Slabs 0 112 7938 1785 41288 0 126 1088976 0 vmem btag 56 17244 1967 17870 0 254 1075816 0 8192 8192 105 0 105 0 1 860160 0 32768 32768 25 0 93 0 1 819200 0 64 64 9489 3048 9222296 0 254 802368 0 THREAD 1792 322 92 12570 0 8 741888 0 256 Bucket 2048 234 76 296951 0 8 634880 0 pbuf 984 0 637 0 0 0 626808 0 16384 16384 36 0 36 0 1 589824 0 64 64 8634 564 8953 0 254 588672 0 32768 32768 9 6 2329 0 1 491520 0 1024 1024 247 193 1349527 0 16 450560 0 4096 4096 79 28 694339 0 2 438272 0 MAP ENTRY 96 2019 2223 20037634 0 126 407232 0 256 256 681 744 741850 0 62 364800 0 64 Bucket 512 309 387 3576458 0 30 356352 0 VMSPACE 2536 42 81 694274 0 4 311928 0 2048 2048 19 125 1006374 0 8 294912 0 32 Bucket 256 107 957 2186333 0 62 272384 0 PROC 1312 76 128 694336 0 8 267648 0 65536 65536 4 0 2171 0 1 262144 0 65536 65536 3 1 398 0 1 262144 0 512 512 149 363 554941 0 30 262144 0 32 32 6713 1477 77543 0 254 262080 0 128 128 494 1521 612889 0 126 257920 0 filedesc0 1088 77 154 694337 0 8 251328 0 16 16 13656 1844 155695 0 254 248000 0 64 64 2998 782 62021 0 254 241920 0 64 64 716 3064 812952 0 254 241920 0 128 128 1473 356 1482 0 126 234112 0 128 Bucket 1024 153 58 530573 0 16 216064 0 Mountpoints 2944 4 68 11768 0 4 211968 0 tcp_inpcb 488 206 218 24935 0 30 206912 0 64 64 113 3100 706480 0 254 205632 0 2048 2048 96 4 390 0 8 204800 0 g_bio 408 4 496 7328848 0 30 204000 0 4096 4096 49 0 142 0 2 200704 0 1024 1024 4 192 389264 0 16 200704 0 64 64 8 3079 3097029 0 254 197568 0 NAMEI 1024 0 192 5881908 0 16 196608 0 16384 16384 12 0 2670 0 1 196608 0 64 64 253 2644 21539 0 254 185408 0 16384 16384 11 0 175717 0 1 180224 0 UMA Zones 2048 85 3 85 0 8 180224 0 128 128 5 1390 101394 0 126 178560 0 tcpcb 1016 13 159 24935 0 16 174752 0 256 256 441 219 769361 0 62 168960 0 256 256 35 625 83890 0 62 168960 0 Files 80 130 1920 3522649 0 126 164000 0 128 128 264 914 349349 0 126 150784 0 256 256 3 567 1614118 0 62 145920 0 8 Bucket 80 143 1657 1082857 0 126 144000 0 512 512 219 61 617 0 30 143360 0 128 128 666 450 97526 0 126 142848 0 selfd 64 158 1921 3183873 0 254 133056 0 ksiginfo 112 179 1009 40866 0 126 133056 0 65536 65536 2 0 212 0 1 131072 0 65536 65536 2 0 7 0 1 131072 0 65536 65536 2 0 2 0 1 131072 0 pipe 760 6 164 243986 0 16 129200 0 tcptw 88 193 1233 8175 0 126 125488 0 syncache 168 0 744 8175 0 62 124992 0 PWD 32 21 3885 46376 0 254 124992 0 2 Bucket 32 156 3624 2006968 0 254 120960 0 4 Bucket 48 25 2411 549539 0 254 116928 0 vnpbuf 984 1 111 281434 0 8 110208 0 16 Bucket 144 151 604 2896882 0 62 108720 0 TURNSTILE 136 415 341 415 0 62 102816 0 32 32 307 2843 823535 0 254 100800 0 32 32 280 2870 27462 0 254 100800 0 32 32 112 2912 237093 0 254 96768 0 L VFS Cache 328 234 54 236 0 30 94464 0 rl_entry 40 206 2117 206 0 254 92920 0 4096 4096 21 0 94914 0 2 86016 0 8192 8192 10 0 1670 0 1 81920 0 ttyinq 160 345 155 555 0 62 80000 0 512 512 85 67 91 0 30 77824 0 ttyoutq 256 181 119 290 0 62 76800 0 8192 8192 9 0 35276 0 1 73728 0 512 512 63 81 63 0 30 73728 0 SLEEPQUEUE 88 415 385 415 0 126 70400 0 512 512 57 79 57095 0 30 69632 0 256 256 56 214 2669 0 62 69120 0 128 128 105 422 4212 0 126 67456 0 65536 65536 1 0 1 0 1 65536 0 32768 32768 2 0 2 0 1 65536 0 4096 4096 16 0 11786 0 2 65536 0 64 64 161 847 47246 0 254 64512 0 256 256 30 195 57148 0 62 57600 0 1024 1024 28 24 3573 0 16 53248 0 32 32 270 1368 117431 0 254 52416 0 32 32 139 1499 96705 0 254 52416 0 16 16 23 3227 949217 0 254 52000 0 16 16 25 3225 26 0 254 52000 0 32 32 576 810 70202 0 254 44352 0 16 16 314 2436 94498 0 254 44000 0 unpcb 256 22 143 129152 0 62 42240 0 256 256 44 121 528596 0 62 42240 0 cpuset 104 27 376 27 0 126 41912 0 8192 8192 5 0 5 0 1 40960 0 64 pcpu 8 3362 1758 3745 0 254 40960 0 16 16 266 2234 24573 0 254 40000 0 16 16 295 2205 20644 0 254 40000 0 udp_inpcb 488 20 60 1895 0 30 39040 0 256 256 78 72 210711 0 62 38400 0 mt_stats_zone 64 433 143 433 0 254 36864 0 32768 32768 1 0 2 0 1 32768 0 32768 32768 1 0 2330 0 1 32768 0 16384 16384 2 0 4 0 1 32768 0 16384 16384 2 0 2 0 1 32768 0 8192 8192 4 0 4 0 1 32768 0 swrbuf 984 1 32 263769 0 2 32472 0 KMAP ENTRY 96 18 315 18 0 126 31968 0 clpbuf 984 0 30 210210 0 2 29520 0 512 512 14 42 31 0 30 28672 0 UMA Kegs 384 74 0 74 0 30 28416 0 udpcb 32 20 862 1895 0 254 28224 0 16 16 16 1734 17 0 254 28000 0 rtentry 216 12 114 15 0 62 27216 0 1024 1024 7 17 406 0 16 24576 0 mt_zone 24 433 569 433 0 254 24048 0 routing nhops 256 7 83 15 0 62 23040 0 16 16 494 756 901383 0 254 20000 0 16384 16384 1 0 1 0 1 16384 0 16384 16384 1 0 1 0 1 16384 0 2048 2048 5 3 5639 0 8 16384 0 32 32 16 488 17 0 254 16128 0 MAP 216 2 69 2 0 62 15336 0 2048 2048 3 3 4 0 8 12288 0 2048 2048 4 2 4 0 8 12288 0 2048 2048 4 2 4 0 8 12288 0 1024 1024 7 5 7 0 16 12288 0 1024 1024 6 6 8 0 16 12288 0 1024 1024 4 8 7 0 16 12288 0 512 512 8 16 6247 0 30 12288 0 int pcpu 4 290 2270 290 0 254 10240 0 8192 8192 1 0 1 0 1 8192 0 2048 2048 3 1 667 0 8 8192 0 mbuf_packet 256 28 0 663150 0 254 7168 0 epoch_record pcpu 256 4 12 4 0 62 4096 0 4096 4096 1 0 2 0 2 4096 0 4096 4096 1 0 13 0 2 4096 0 1024 1024 1 3 1 0 16 4096 0 hostcache 96 1 41 1 0 126 4032 0 procdesc 136 1 28 42 0 62 3944 0 ripcb 488 1 7 1 0 30 3904 0 vmem 1856 1 1 1 0 8 3712 0 UMA Slabs 1 176 12 8 12 0 62 3520 0 SMR CPU 32 1 62 1 0 254 2016 0 SMR SHARED 24 1 62 1 0 254 1512 0 FFS1 dinode 128 0 0 0 0 126 0 0 udplite_inpcb 488 0 0 0 0 30 0 0 sctp_asconf_ack 48 0 0 0 0 254 0 0 sctp_asconf 40 0 0 0 0 254 0 0 sctp_stream_msg_out 112 0 0 0 0 126 0 0 sctp_readq 152 0 0 0 0 62 0 0 sctp_chunk 152 0 0 0 0 62 0 0 sctp_raddr 736 0 0 0 0 16 0 0 sctp_laddr 48 0 0 4 0 254 0 0 sctp_asoc 2288 0 0 0 0 4 0 0 sctp_ep 1280 0 0 0 0 8 0 0 tcp_log_node 120 0 0 0 0 126 0 0 tcp_log_bucket 184 0 0 0 0 62 0 0 tcp_log 408 0 0 0 0 30 0 0 tcpreass 48 0 0 0 0 254 0 0 tfo_ccache_entries 80 0 0 0 0 126 0 0 tfo 4 0 0 0 0 254 0 0 sackhole 32 0 0 0 0 254 0 0 ipq 56 0 0 0 0 254 0 0 IPsec SA lft_c 16 0 0 0 0 254 0 0 KNOTE 160 0 0 0 0 62 0 0 itimer 352 0 0 0 0 30 0 0 AIOLIO 280 0 0 0 0 30 0 0 AIOCB 752 0 0 0 0 16 0 0 AIOP 32 0 0 0 0 254 0 0 AIO 208 0 0 0 0 62 0 0 NCLNODE 744 0 0 0 0 16 0 0 DIRHASH 1024 0 0 1172 0 16 0 0 LTS VFS Cache 368 0 0 0 0 30 0 0 STS VFS Cache 148 0 0 0 0 62 0 0 rentr 24 0 0 11765 0 254 0 0 VNODEPOLL 120 0 0 0 0 126 0 0 vtnet_tx_hdr 24 0 0 0 0 254 0 0 crypto_session 72 0 0 0 0 126 0 0 cryptop 240 0 0 0 0 62 0 0 nvme_request 128 0 0 0 0 126 0 0 FPU_save_area 832 0 0 0 0 16 0 0 DMAR_MAP_ENTRY 128 0 0 0 0 126 0 0 mbuf_jumbo_16k 16384 0 0 0 0 1 0 0 mbuf_jumbo_9k 9216 0 0 0 0 1 0 0 mbuf_jumbo_page 4096 0 0 4 0 2 0 0 audit_record 1280 0 0 0 0 8 0 0 domainset 40 0 0 0 0 254 0 0 MAC labels 40 0 0 0 0 254 0 0 mdpbuf 984 0 0 0 0 0 0 0 nfspbuf 984 0 0 0 0 2 0 0 swwbuf 984 0 0 717915 0 0 0 0 umtx_shm 88 0 0 0 0 126 0 0 umtx pi 96 0 0 0 0 126 0 0 rangeset pctrie nodes 144 0 0 0 0 62 0 0 65536 65536 0 0 0 0 1 0 0 65536 65536 0 0 0 0 1 0 0 32768 32768 0 0 8 0 1 0 0 32768 32768 0 0 1 0 1 0 0 32768 32768 0 0 0 0 1 0 0 16384 16384 0 0 12 0 1 0 0 8192 8192 0 0 260232 0 1 0 0 8192 8192 0 0 0 0 1 0 0 4096 4096 0 0 23590 0 2 0 0 2048 2048 0 0 47278 0 8 0 0 512 512 0 0 461236 0 30 0 0 fakepg 104 0 0 0 0 126 0 0 UMA Hash 256 0 0 0 0 62 0 0 db:0:pho> show umacache Zone Size Used Free Requests Bucket debugnet_mbuf_packet 2048 0 0 0 0 debugnet_mbuf_cluster 2048 -6144 0 0 0 debugnet_mbuf 256 -10240 0 0 0 kstack_cache 16384 195 0 12443 1 vm pgcache 4096 74792 38 15861920 2 vm pgcache 4096 2740987 114 103381143 8 buf free cache 984 9221 252 1234159 16 buffer arena-65 65536 0 0 0 1 buffer arena-61 61440 0 0 0 1 buffer arena-57 57344 0 0 0 1 buffer arena-53 53248 0 0 0 1 buffer arena-49 49152 0 0 0 1 buffer arena-45 45056 0 0 0 1 buffer arena-40 40960 0 0 0 1 buffer arena-36 36864 0 0 0 1 buffer arena-32 32768 5078 30 185770 1 buffer arena-28 28672 0 0 0 1 buffer arena-24 24576 0 0 0 1 buffer arena-20 20480 0 0 0 1 buffer arena-16 16384 6 23 128923 1 buffer arena-12 12288 0 0 0 1 buffer arena-81 8192 0 0 0 1 buffer arena-40 4096 0 0 0 2 db:0:pho> acttrace Tracing command sendfile21 pid 94786 tid 101322 td 0xfffffe00e3a04e00 (CPU 1) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e17de00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e17de10 trap() at trap+0x56/frame 0xfffffe003e17df20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e17df20 --- trap 0x13, rip = 0xffffffff80f0491c, rsp = 0xfffffe00e60c9730, rbp = 0xfffffe00e60c9750 --- uma_zalloc_arg() at uma_zalloc_arg+0xc/frame 0xfffffe00e60c9750 tcp_output() at tcp_output+0xf8b/frame 0xfffffe00e60c98e0 tcp_usr_rcvd() at tcp_usr_rcvd+0x90/frame 0xfffffe00e60c9930 soreceive_generic() at soreceive_generic+0xd3f/frame 0xfffffe00e60c99f0 soreceive() at soreceive+0x59/frame 0xfffffe00e60c9a10 dofileread() at dofileread+0x81/frame 0xfffffe00e60c9a60 sys_read() at sys_read+0xc0/frame 0xfffffe00e60c9ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e60c9bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e60c9bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80041a81a, rsp = 0x7fffffffd538, rbp = 0x7fffffffe6f0 --- Tracing command swap pid 93028 tid 101074 td 0xfffffe00d3dd0300 (CPU 7) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1c5e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1c5e10 trap() at trap+0x56/frame 0xfffffe003e1c5f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1c5f20 --- trap 0x13, rip = 0x203829, rsp = 0x7fffffffe520, rbp = 0x7fffffffe540 --- Tracing command md10 pid 93020 tid 100215 td 0xfffffe00e449cc00 (CPU 9) kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e39f0960 vpanic() at vpanic+0x19e/frame 0xfffffe00e39f09b0 panic() at panic+0x43/frame 0xfffffe00e39f0a10 vm_page_relookup() at vm_page_relookup+0x4e/frame 0xfffffe00e39f0a30 sendfile_iodone() at sendfile_iodone+0x153/frame 0xfffffe00e39f0a70 vnode_pager_generic_getpages_done_async() at vnode_pager_generic_getpages_done_async+0x3a/frame 0xfffffe00e39f0a90 bufdone() at bufdone+0x6c/frame 0xfffffe00e39f0b00 g_io_deliver() at g_io_deliver+0x25e/frame 0xfffffe00e39f0b50 md_kthread() at md_kthread+0x259/frame 0xfffffe00e39f0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e39f0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e39f0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100049 td 0xfffffe003e466800 (CPU 5) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1ade00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1ade10 trap() at trap+0x56/frame 0xfffffe003e1adf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1adf20 --- trap 0x13, rip = 0xffffffff80c31669, rsp = 0xfffffe0037a5c900, rbp = 0xfffffe0037a5c930 --- witness_unlock() at witness_unlock+0x79/frame 0xfffffe0037a5c930 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe0037a5c960 ipreass_slowtimo() at ipreass_slowtimo+0x5a/frame 0xfffffe0037a5c9a0 ip_slowtimo() at ip_slowtimo+0x64/frame 0xfffffe0037a5c9d0 pfslowtimo() at pfslowtimo+0x64/frame 0xfffffe0037a5ca20 softclock_call_cc() at softclock_call_cc+0x175/frame 0xfffffe0037a5caf0 softclock() at softclock+0x8b/frame 0xfffffe0037a5cb20 ithread_loop() at ithread_loop+0x279/frame 0xfffffe0037a5cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a5cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a5cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100003 td 0xfffffe003e3e0300 (CPU 0) cpustop_handler() at cpustop_handler+0x26/frame 0xffffffff81de6aa0 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xffffffff81de6ab0 trap() at trap+0x56/frame 0xffffffff81de6bc0 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81de6bc0 --- trap 0x13, rip = 0xffffffff8102c476, rsp = 0xfffffe00add46a50, rbp = 0xfffffe00add46a50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add46a50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add46aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add46ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add46ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add46bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add46bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add46bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffffe003e3df500 (CPU 2) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e189e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e189e10 trap() at trap+0x56/frame 0xfffffe003e189f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e189f20 --- trap 0x13, rip = 0xffffffff8102c476, rsp = 0xfffffe00add50a50, rbp = 0xfffffe00add50a50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add50a50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add50aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add50ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add50ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add50bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add50bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add50bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffffe003e3dee00 (CPU 3) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e195e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e195e10 trap() at trap+0x56/frame 0xfffffe003e195f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e195f20 --- trap 0x13, rip = 0xffffffff8102c476, rsp = 0xfffffe00add55a50, rbp = 0xfffffe00add55a50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add55a50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add55aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add55ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add55ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add55bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add55bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add55bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffffe003e3de700 (CPU 4) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1a1e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1a1e10 trap() at trap+0x56/frame 0xfffffe003e1a1f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1a1f20 --- trap 0x13, rip = 0xffffffff8102c476, rsp = 0xfffffe00add5aa50, rbp = 0xfffffe00add5aa50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add5aa50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add5aaa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add5aac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add5aae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add5abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add5abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add5abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffffe003e3e8a00 (CPU 6) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1b9e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1b9e10 trap() at trap+0x56/frame 0xfffffe003e1b9f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1b9f20 --- trap 0x13, rip = 0xffffffff8102c476, rsp = 0xfffffe00add64a50, rbp = 0xfffffe00add64a50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add64a50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add64aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add64ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add64ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add64bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add64bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add64bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffffe003e3e7c00 (CPU 8) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1d1e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1d1e10 trap() at trap+0x56/frame 0xfffffe003e1d1f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1d1f20 --- trap 0x13, rip = 0xffffffff8102c476, rsp = 0xfffffe00add6ea50, rbp = 0xfffffe00add6ea50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add6ea50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add6eaa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add6eac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add6eae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add6ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add6ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add6ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffffe003e3e6e00 (CPU 10) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1e9e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1e9e10 trap() at trap+0x56/frame 0xfffffe003e1e9f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1e9f20 --- trap 0x13, rip = 0xffffffff8102c476, rsp = 0xfffffe00add78a50, rbp = 0xfffffe00add78a50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add78a50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add78aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add78ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add78ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add78bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add78bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add78bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffffe003e3e6700 (CPU 11) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1f5e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1f5e10 trap() at trap+0x56/frame 0xfffffe003e1f5f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1f5f20 --- trap 0x13, rip = 0xffffffff8102c476, rsp = 0xfffffe00add7da50, rbp = 0xfffffe00add7da50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add7da50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add7daa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add7dac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add7dae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add7dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add7dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add7dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:pho> ps pid ppid pgrp uid state wmesg wchan cmd 94786 94785 93004 0 R+ CPU 1 sendfile21 94785 94784 93004 0 S+ sbwait 0xfffffe00e68e0b8c sendfile21 94784 93004 93004 0 S+ wait 0xfffff800038f6520 sendfile21 93029 93027 93004 0 D+ swread 0xfffff802b939b5f0 swap 93028 93027 93004 0 R+ CPU 7 swap 93027 93025 93004 0 SW+ wait 0xfffff8029debda40 swap 93025 93004 93004 0 S+ nanslp 0xffffffff81cadcd5 swap 93020 0 0 0 RL CPU 9 [md10] 93004 2452 93004 0 S+ wait 0xfffff800038f6a40 sh 46096 46095 46096 2006 Ss+ select 0xfffff800204e32c0 bash 46095 46092 46092 2006 S select 0xfffff8065f23f2c0 sshd 46092 2369 46092 0 Ss select 0xfffff8042900ae40 sshd 2452 2449 2452 0 SW+ wait 0xfffff800208b1a40 bash 2449 2448 2449 0 SW+ pause 0xfffff80020a87ae8 csh 2448 2442 2448 2006 SW+ wait 0xfffff80020660520 su 2442 2441 2442 2006 SWs+ wait 0xfffff8020fa09000 bash 2441 2438 2438 2006 S select 0xfffff800209aadc0 sshd 2438 2369 2438 0 Ss select 0xfffff800209b9840 sshd 2434 2431 2434 0 S+ ttyin 0xfffff800170ec8b0 csh 2431 1 2431 0 SWs+ wait 0xfffff8020fed9520 login 2430 1 2430 0 Ss+ ttyin 0xfffff800170d34b0 getty 2429 1 2429 0 Ss+ ttyin 0xfffff800201b90b0 getty 2428 1 2428 0 Ss+ ttyin 0xfffff800201b98b0 getty 2427 1 2427 0 Ss+ ttyin 0xfffff80003add0b0 getty 2426 1 2426 0 Ss+ ttyin 0xfffff80003add8b0 getty 2425 1 2425 0 Ss+ ttyin 0xfffff80003ae00b0 getty 2424 1 2424 0 Ss+ ttyin 0xfffff80003ae08b0 getty 2423 1 2423 0 Ss+ ttyin 0xfffff80003adf0b0 getty 2422 1 2422 0 Ss+ ttyin 0xfffff80003adf8b0 getty 2373 1 2373 0 SWs nanslp 0xffffffff81cadcd5 cron 2369 1 2369 0 Ss select 0xfffff8011b018bc0 sshd 2341 1 2341 0 Ss select 0xfffff800209b96c0 powerd 2338 1 2338 123 Ss (threaded) ntpd 100204 S select 0xfffff80020315c40 ntpd 101231 S usem 0xfffff803bf289380 ntpd 2273 1 2273 0 Ss rpcsvc 0xfffff800037e9a60 NLM: master 2270 1 2270 0 Ss select 0xfffff800209b93c0 rpc.statd 2224 1 2224 0 Ss nanslp 0xffffffff81cadcd8 watchdogd 2076 1 2076 0 Ss select 0xfffff8002053f640 rpcbind 2066 1 2066 0 Ss select 0xfffff80020532440 syslogd 1995 1 1995 0 Ss select 0xfffff80020315dc0 devd 1990 1 1990 65 Ss select 0xfffff80020315ec0 dhclient 1931 1 1931 0 Ss select 0xfffff800203180c0 dhclient 1928 1 1928 0 Ss select 0xfffff8002032c3c0 dhclient 34 0 0 0 DL syncer 0xffffffff81d99898 [syncer] 33 0 0 0 DL vlruwt 0xfffff80020144000 [vnlru] 32 0 0 0 DL (threaded) [bufdaemon] 100130 D qsleep 0xffffffff81d98bc0 [bufdaemon] 100131 D - 0xffffffff8180aa00 [bufspacedaemon-0] 100132 D - 0xffffffff81812cc0 [bufspacedaemon-1] 100133 D - 0xffffffff8181af80 [bufspacedaemon-2] 100136 D - 0xffffffff81823240 [bufspacedaemon-3] 100137 D - 0xffffffff8182b500 [bufspacedaemon-4] 100139 D - 0xffffffff818337c0 [bufspacedaemon-5] 100140 D - 0xffffffff8183ba80 [bufspacedaemon-6] 100153 D sdflush 0xfffff80003f040e8 [/ worker] 100157 D sdflush 0xfffff800201b84e8 [/tmp worker] 31 0 0 0 DL psleep 0xffffffff81dbdac8 [vmdaemon] 30 0 0 0 DL (threaded) [pagedaemon] 100128 D psleep 0xffffffff81db2098 [dom0] 100134 D laundp 0xffffffff8158eaf0 [laundry: dom0] 100138 D umarcl 0xffffffff80f06cb0 [uma] 29 0 0 0 DL idle 0xfffff80004196a40 [enc_daemon1] 28 0 0 0 DL idle 0xfffff80004195000 [enc_daemon0] 27 0 0 0 DL - 0xffffffff81ae18a0 [rand_harvestq] 26 0 0 0 DL waiting 0xffffffff81d9c010 [sctp_iterator] 25 0 0 0 DL - 0xffffffff81d984ec [soaiod4] 24 0 0 0 DL - 0xffffffff81d984ec [soaiod3] 23 0 0 0 DL - 0xffffffff81d984ec [soaiod2] 22 0 0 0 DL - 0xffffffff81d984ec [soaiod1] 21 0 0 0 DL (threaded) [usb] 100096 D - 0xfffffe00d2d84440 [usbus0] 100097 D - 0xfffffe00d2d84498 [usbus0] 100098 D - 0xfffffe00d2d844f0 [usbus0] 100099 D - 0xfffffe00d2d84548 [usbus0] 100100 D - 0xfffffe00d2d845a0 [usbus0] 100102 D - 0xfffffe003e4a2cf0 [usbus1] 100103 D - 0xfffffe003e4a2d48 [usbus1] 100104 D - 0xfffffe003e4a2da0 [usbus1] 100105 D - 0xfffffe003e4a2df8 [usbus1] 100106 D - 0xfffffe003e4a2e50 [usbus1] 100107 D - 0xfffffe00d2e23cf0 [usbus2] 100108 D - 0xfffffe00d2e23d48 [usbus2] 100109 D - 0xfffffe00d2e23da0 [usbus2] 100110 D - 0xfffffe00d2e23df8 [usbus2] 100111 D - 0xfffffe00d2e23e50 [usbus2] 20 0 0 0 RL (threaded) [cam] 100091 D - 0xffffffff819b95c0 [doneq0] 100092 RunQ [doneq1] 100093 D - 0xffffffff819b96c0 [doneq2] 100125 D - 0xffffffff819b9490 [scanner] 19 0 0 0 DL crypto_ 0xfffff80003b10c50 [crypto returns 11] 18 0 0 0 DL crypto_ 0xfffff80003b10bf0 [crypto returns 10] 17 0 0 0 DL crypto_ 0xfffff80003b10b90 [crypto returns 9] 16 0 0 0 DL crypto_ 0xfffff80003b10b30 [crypto returns 8] 15 0 0 0 DL crypto_ 0xfffff80003b10ad0 [crypto returns 7] 9 0 0 0 DL crypto_ 0xfffff80003b10a70 [crypto returns 6] 8 0 0 0 DL crypto_ 0xfffff80003b10a10 [crypto returns 5] 7 0 0 0 DL crypto_ 0xfffff80003b109b0 [crypto returns 4] 6 0 0 0 DL crypto_ 0xfffff80003b10950 [crypto returns 3] 5 0 0 0 DL crypto_ 0xfffff80003b108f0 [crypto returns 2] 4 0 0 0 DL crypto_ 0xfffff80003b10890 [crypto returns 1] 3 0 0 0 DL crypto_ 0xfffff80003b10830 [crypto returns 0] 2 0 0 0 DL crypto_ 0xffffffff81daf7c0 [crypto] 14 0 0 0 DL seqstat 0xfffff80003a2d488 [sequencer 00] 13 0 0 0 DL (threaded) [geom] 100062 D - 0xffffffff81c8cc80 [g_event] 100063 D - 0xffffffff81c8cc88 [g_up] 100064 D - 0xffffffff81c8cc90 [g_down] 12 0 0 0 RL (threaded) [intr] 100041 I [swi5: fast taskq] 100045 I [swi6: task queue] 100046 I [swi6: Giant taskq] 100047 I [swi1: netisr 0] 100048 I [swi3: vm] 100049 Run CPU 5 [swi4: clock (0)] 100050 I [swi4: clock (1)] 100051 I [swi4: clock (2)] 100052 I [swi4: clock (3)] 100053 I [swi4: clock (4)] 100054 I [swi4: clock (5)] 100055 I [swi4: clock (6)] 100056 I [swi4: clock (7)] 100057 I [swi4: clock (8)] 100058 I [swi4: clock (9)] 100059 I [swi4: clock (10)] 100060 I [swi4: clock (11)] 100094 I [irq56: ahci0] 100095 I [irq19: xhci0] 100101 I [irq18: ehci0 ehci1] 100112 I [irq71: ahci1] 100113 I [swi0: uart uart] 100176 I [irq72: ioat0] 100177 I [irq73: ioat1] 100178 I [irq74: ioat2] 100179 I [irq75: ioat3] 100180 I [irq76: ioat4] 100181 I [irq77: ioat5] 100182 I [irq78: ioat6] 100183 I [irq79: ioat7] 11 0 0 0 RL (threaded) [idle] 100003 Run CPU 0 [idle: cpu0] 100004 CanRun [idle: cpu1] 100005 Run CPU 2 [idle: cpu2] 100006 Run CPU 3 [idle: cpu3] 100007 Run CPU 4 [idle: cpu4] 100008 CanRun [idle: cpu5] 100009 Run CPU 6 [idle: cpu6] 100010 CanRun [idle: cpu7] 100011 Run CPU 8 [idle: cpu8] 100012 CanRun [idle: cpu9] 100013 Run CPU 10 [idle: cpu10] 100014 Run CPU 11 [idle: cpu11] 1 0 1 0 SLs wait 0xfffff800038f8000 [init] 10 0 0 0 DL audit_w 0xffffffff81dafc98 [audit] 0 0 0 0 DLs (threaded) [kernel] 100000 D swapin 0xffffffff81c8d210 [swapper] 100015 D - 0xfffff8000391c100 [if_io_tqg_0] 100016 D - 0xfffff8000391c000 [if_io_tqg_1] 100017 D - 0xfffff80003919e00 [if_io_tqg_2] 100018 D - 0xfffff80003919d00 [if_io_tqg_3] 100019 D - 0xfffff80003919c00 [if_io_tqg_4] 100020 D - 0xfffff80003919b00 [if_io_tqg_5] 100021 D - 0xfffff80003919a00 [if_io_tqg_6] 100022 D - 0xfffff80003919900 [if_io_tqg_7] 100023 D - 0xfffff80003919800 [if_io_tqg_8] 100024 D - 0xfffff80003919700 [if_io_tqg_9] 100025 D - 0xfffff80003919600 [if_io_tqg_10] 100026 D - 0xfffff80003919500 [if_io_tqg_11] 100027 D - 0xfffff80003919400 [if_config_tqg_0] 100028 D - 0xfffff80003919300 [softirq_0] 100029 D - 0xfffff80003919200 [softirq_1] 100030 D - 0xfffff80003919100 [softirq_2] 100031 D - 0xfffff80003919000 [softirq_3] 100032 D - 0xfffff8000391ae00 [softirq_4] 100033 D - 0xfffff8000391ad00 [softirq_5] 100034 D - 0xfffff8000391ac00 [softirq_6] 100035 D - 0xfffff8000391ab00 [softirq_7] 100036 D - 0xfffff8000391aa00 [softirq_8] 100037 D - 0xfffff8000391a900 [softirq_9] 100038 D - 0xfffff8000391a800 [softirq_10] 100039 D - 0xfffff8000391a700 [softirq_11] 100040 D - 0xfffff8000393c100 [thread taskq] 100042 D - 0xfffff80003939e00 [aiod_kick taskq] 100043 D - 0xfffff80003939d00 [in6m_free taskq] 100044 D - 0xfffff80003939c00 [kqueue_ctx taskq] 100061 D - 0xfffff80003a72300 [firmware taskq] 100066 D - 0xfffff80003a72200 [crypto_0] 100067 D - 0xfffff80003a72200 [crypto_1] 100068 D - 0xfffff80003a72200 [crypto_2] 100069 D - 0xfffff80003a72200 [crypto_3] 100070 D - 0xfffff80003a72200 [crypto_4] 100071 D - 0xfffff80003a72200 [crypto_5] 100072 D - 0xfffff80003a72200 [crypto_6] 100073 D - 0xfffff80003a72200 [crypto_7] 100074 D - 0xfffff80003a72200 [crypto_8] 100075 D - 0xfffff80003a72200 [crypto_9] 100076 D - 0xfffff80003a72200 [crypto_10] 100077 D - 0xfffff80003a72200 [crypto_11] 100114 D - 0xfffff80017158500 [mca taskq] 100120 D - 0xfffff8002018f700 [acpi_task_0] 100121 D - 0xfffff8002018f700 [acpi_task_1] 100122 D - 0xfffff8002018f700 [acpi_task_2] 100124 D - 0xfffff80003a72100 [CAM taskq] db:0:pho> allt Tracing command sendfile21 pid 94786 tid 101322 td 0xfffffe00e3a04e00 (CPU 1) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e17de00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e17de10 trap() at trap+0x56/frame 0xfffffe003e17df20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e17df20 --- trap 0x13, rip = 0xffffffff80f0491c, rsp = 0xfffffe00e60c9730, rbp = 0xfffffe00e60c9750 --- uma_zalloc_arg() at uma_zalloc_arg+0xc/frame 0xfffffe00e60c9750 tcp_output() at tcp_output+0xf8b/frame 0xfffffe00e60c98e0 tcp_usr_rcvd() at tcp_usr_rcvd+0x90/frame 0xfffffe00e60c9930 soreceive_generic() at soreceive_generic+0xd3f/frame 0xfffffe00e60c99f0 soreceive() at soreceive+0x59/frame 0xfffffe00e60c9a10 dofileread() at dofileread+0x81/frame 0xfffffe00e60c9a60 sys_read() at sys_read+0xc0/frame 0xfffffe00e60c9ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e60c9bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e60c9bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80041a81a, rsp = 0x7fffffffd538, rbp = 0x7fffffffe6f0 --- Tracing command sendfile21 pid 94785 tid 101317 td 0xfffffe00e6383e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e6123630 mi_switch() at mi_switch+0x155/frame 0xfffffe00e6123650 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e6123690 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e61236f0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e6123700 _sleep() at _sleep+0x2c3/frame 0xfffffe00e61237a0 sbwait() at sbwait+0x67/frame 0xfffffe00e61237c0 vn_sendfile() at vn_sendfile+0x611/frame 0xfffffe00e6123a40 sendfile() at sendfile+0x127/frame 0xfffffe00e6123ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e6123bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e6123bf0 --- syscall (393, FreeBSD ELF64, sys_sendfile), rip = 0x8002ddefa, rsp = 0x7fffffffd538, rbp = 0x7fffffffe6f0 --- Tracing command sendfile21 pid 94784 tid 100148 td 0xfffffe00e3a00e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e381d6e0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e381d700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e381d740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e381d7a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e381d7b0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e381d850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00e381d8e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe00e381dad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e381dbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e381dbf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003aba4a, rsp = 0x7fffffffe6f8, rbp = 0x7fffffffe710 --- Tracing command swap pid 93029 tid 100206 td 0xfffffe00e6993700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e39b7720 mi_switch() at mi_switch+0x155/frame 0xfffffe00e39b7740 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e39b7780 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e39b77c0 _sleep() at _sleep+0x26c/frame 0xfffffe00e39b7860 swap_pager_getpages_locked() at swap_pager_getpages_locked+0x571/frame 0xfffffe00e39b78e0 vm_pager_get_pages() at vm_pager_get_pages+0x4f/frame 0xfffffe00e39b7930 vm_fault() at vm_fault+0x780/frame 0xfffffe00e39b7a40 vm_fault_trap() at vm_fault_trap+0x6e/frame 0xfffffe00e39b7a80 trap_pfault() at trap_pfault+0x1ee/frame 0xfffffe00e39b7ae0 trap() at trap+0x44c/frame 0xfffffe00e39b7bf0 calltrap() at calltrap+0x8/frame 0xfffffe00e39b7bf0 --- trap 0xc, rip = 0x203829, rsp = 0x7fffffffe520, rbp = 0x7fffffffe540 --- Tracing command swap pid 93028 tid 101074 td 0xfffffe00d3dd0300 (CPU 7) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1c5e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1c5e10 trap() at trap+0x56/frame 0xfffffe003e1c5f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1c5f20 --- trap 0x13, rip = 0x203829, rsp = 0x7fffffffe520, rbp = 0x7fffffffe540 --- Tracing command swap pid 93027 tid 101297 td 0xfffffe00d49e5700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00377a16e0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e39f0010 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e39f0020 trap() at trap+0x6c/frame 0xfffffe00e39f0130 calltrap() at calltrap+0x8/frame 0xfffffe00e39f0130 --- trap 0xc, rip = 0xffffffff810406d0, rsp = 0xfffffe00e39f0200, rbp = 0xfffffe00e39f0290 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe00e39f0290 db_get_value() at db_get_value+0x32/frame 0xfffffe00e39f02d0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00e39f0360 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e39f0380 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e39f0420 db_command() at db_command+0x25c/frame 0xfffffe00e39f04f0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00e39f0590 db_command() at db_command+0x25c/frame 0xfffffe00e39f0660 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e39f0670 db_trap() at db_trap+0xe8/frame 0xfffffe00e39f0700 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00e39f0770 trap() at trap+0x7b8/frame 0xfffffe00e39f0880 calltrap() at calltrap+0x8/frame 0xfffffe00e39f0880 --- trap 0x3, rip = 0xffffffff80c0e347, rsp = 0xfffffe00e39f0950, rbp = 0xfffffe00e39f0960 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e39f0960 vpanic() at vpanic+0x19e/frame 0xfffffe00e39f09b0 panic() at panic+0x43/frame 0xfffffe00e39f0a10 vm_page_relookup() at vm_page_relookup+0x4e/frame 0xfffffe00e39f0a30 sendfile_iodone() at sendfile_iodone+0x153/frame 0xfffffe00e39f0a70 vnode_pager_generic_getpages_done_async() at vnode_pager_generic_getpages_done_async+0x3a/frame 0xfffffe00e39f0a90 bufdone() at bufdone+0x6c/frame 0xfffffe00e39f0b00 g_io_deliver() at g_io_deliver+0x25e/frame 0xfffffe00e39f0b50 md_kthread() at md_kthread+0x259/frame 0xfffffe00e39f0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e39f0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e39f0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00377a16e8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e39f0280 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e39f0290 db_get_value() at db_get_value+0x4c/frame 0xfffffe00e39f02d0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00e39f0360 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e39f0380 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e39f0420 db_command() at db_command+0x25c/frame 0xfffffe00e39f04f0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00e39f0590 db_command() at db_command+0x25c/frame 0xfffffe00e39f0660 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e39f0670 db_trap() at db_trap+0xe8/frame 0xfffffe00e39f0700 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00e39f0770 trap() at trap+0x7b8/frame 0xfffffe00e39f0880 calltrap() at calltrap+0x8/frame 0xfffffe00e39f0880 --- trap 0x3, rip = 0xffffffff80c0e347, rsp = 0xfffffe00e39f0950, rbp = 0xfffffe00e39f0960 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e39f0960 vpanic() at vpanic+0x19e/frame 0xfffffe00e39f09b0 panic() at panic+0x43/frame 0xfffffe00e39f0a10 vm_page_relookup() at vm_page_relookup+0x4e/frame 0xfffffe00e39f0a30 sendfile_iodone() at sendfile_iodone+0x153/frame 0xfffffe00e39f0a70 vnode_pager_generic_getpages_done_async() at vnode_pager_generic_getpages_done_async+0x3a/frame 0xfffffe00e39f0a90 bufdone() at bufdone+0x6c/frame 0xfffffe00e39f0b00 g_io_deliver() at g_io_deliver+0x25e/frame 0xfffffe00e39f0b50 md_kthread() at md_kthread+0x259/frame 0xfffffe00e39f0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e39f0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e39f0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command swap pid 93025 tid 100797 td 0xfffffe00e3a54e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e60bf870 mi_switch() at mi_switch+0x155/frame 0xfffffe00e60bf890 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e60bf8d0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e60bf930 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e60bf970 _sleep() at _sleep+0x258/frame 0xfffffe00e60bfa10 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe00e60bfa90 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe00e60bfad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e60bfbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e60bfbf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003c6baa, rsp = 0x7fffffffe558, rbp = 0x7fffffffe5a0 --- Tracing command md10 pid 93020 tid 100215 td 0xfffffe00e449cc00 (CPU 9) kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e39f0960 vpanic() at vpanic+0x19e/frame 0xfffffe00e39f09b0 panic() at panic+0x43/frame 0xfffffe00e39f0a10 vm_page_relookup() at vm_page_relookup+0x4e/frame 0xfffffe00e39f0a30 sendfile_iodone() at sendfile_iodone+0x153/frame 0xfffffe00e39f0a70 vnode_pager_generic_getpages_done_async() at vnode_pager_generic_getpages_done_async+0x3a/frame 0xfffffe00e39f0a90 bufdone() at bufdone+0x6c/frame 0xfffffe00e39f0b00 g_io_deliver() at g_io_deliver+0x25e/frame 0xfffffe00e39f0b50 md_kthread() at md_kthread+0x259/frame 0xfffffe00e39f0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e39f0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e39f0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sh pid 93004 tid 100147 td 0xfffffe003e460c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e38186e0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e3818700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e3818740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e38187a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e38187b0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e3818850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00e38188e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe00e3818ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e3818bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3818bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ba4a, rsp = 0x7fffffffe538, rbp = 0x7fffffffe5f0 --- Tracing command bash pid 46096 tid 100210 td 0xfffffe00e69db700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e39d7700 mi_switch() at mi_switch+0x155/frame 0xfffffe00e39d7720 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e39d7760 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e39d77c0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e39d77d0 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e39d7830 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e39d7870 kern_select() at kern_select+0x87a/frame 0xfffffe00e39d7a50 sys_pselect() at sys_pselect+0x127/frame 0xfffffe00e39d7ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e39d7bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e39d7bf0 --- syscall (522, FreeBSD ELF64, sys_pselect), rip = 0x800534b6a, rsp = 0x7fffffffd728, rbp = 0x7fffffffd7f0 --- Tracing command sshd pid 46095 tid 101263 td 0xfffffe00e661ce00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e609a740 mi_switch() at mi_switch+0x155/frame 0xfffffe00e609a760 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e609a7a0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e609a800 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e609a810 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e609a870 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e609a8b0 kern_select() at kern_select+0x87a/frame 0xfffffe00e609aa90 sys_select() at sys_select+0x56/frame 0xfffffe00e609aad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e609abf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e609abf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8008e17fa, rsp = 0x7fffffffa548, rbp = 0x7fffffffa580 --- Tracing command sshd pid 46092 tid 100800 td 0xfffffe00dd3e0e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe003779c7c0 mi_switch() at mi_switch+0x155/frame 0xfffffe003779c7e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe003779c820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe003779c880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe003779c890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe003779c8f0 seltdwait() at seltdwait+0x8d/frame 0xfffffe003779c930 kern_poll() at kern_poll+0x48b/frame 0xfffffe003779cab0 sys_poll() at sys_poll+0x50/frame 0xfffffe003779cad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe003779cbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe003779cbf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x80088500a, rsp = 0x7fffffffe5a8, rbp = 0x7fffffffe5e0 --- Tracing command bash pid 2452 tid 100226 td 0xfffffe00dd3fa000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e60276e0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e39f0010 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e39f0020 trap() at trap+0x6c/frame 0xfffffe00e39f0130 calltrap() at calltrap+0x8/frame 0xfffffe00e39f0130 --- trap 0xc, rip = 0xffffffff810406d0, rsp = 0xfffffe00e39f0200, rbp = 0xfffffe00e39f0290 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe00e39f0290 db_get_value() at db_get_value+0x32/frame 0xfffffe00e39f02d0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00e39f0360 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e39f0380 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e39f0420 db_command() at db_command+0x25c/frame 0xfffffe00e39f04f0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00e39f0590 db_command() at db_command+0x25c/frame 0xfffffe00e39f0660 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e39f0670 db_trap() at db_trap+0xe8/frame 0xfffffe00e39f0700 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00e39f0770 trap() at trap+0x7b8/frame 0xfffffe00e39f0880 calltrap() at calltrap+0x8/frame 0xfffffe00e39f0880 --- trap 0x3, rip = 0xffffffff80c0e347, rsp = 0xfffffe00e39f0950, rbp = 0xfffffe00e39f0960 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e39f0960 vpanic() at vpanic+0x19e/frame 0xfffffe00e39f09b0 panic() at panic+0x43/frame 0xfffffe00e39f0a10 vm_page_relookup() at vm_page_relookup+0x4e/frame 0xfffffe00e39f0a30 sendfile_iodone() at sendfile_iodone+0x153/frame 0xfffffe00e39f0a70 vnode_pager_generic_getpages_done_async() at vnode_pager_generic_getpages_done_async+0x3a/frame 0xfffffe00e39f0a90 bufdone() at bufdone+0x6c/frame 0xfffffe00e39f0b00 g_io_deliver() at g_io_deliver+0x25e/frame 0xfffffe00e39f0b50 md_kthread() at md_kthread+0x259/frame 0xfffffe00e39f0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e39f0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e39f0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00e60276e8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e39f0280 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e39f0290 db_get_value() at db_get_value+0x4c/frame 0xfffffe00e39f02d0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00e39f0360 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e39f0380 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e39f0420 db_command() at db_command+0x25c/frame 0xfffffe00e39f04f0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00e39f0590 db_command() at db_command+0x25c/frame 0xfffffe00e39f0660 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e39f0670 db_trap() at db_trap+0xe8/frame 0xfffffe00e39f0700 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00e39f0770 trap() at trap+0x7b8/frame 0xfffffe00e39f0880 calltrap() at calltrap+0x8/frame 0xfffffe00e39f0880 --- trap 0x3, rip = 0xffffffff80c0e347, rsp = 0xfffffe00e39f0950, rbp = 0xfffffe00e39f0960 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e39f0960 vpanic() at vpanic+0x19e/frame 0xfffffe00e39f09b0 panic() at panic+0x43/frame 0xfffffe00e39f0a10 vm_page_relookup() at vm_page_relookup+0x4e/frame 0xfffffe00e39f0a30 sendfile_iodone() at sendfile_iodone+0x153/frame 0xfffffe00e39f0a70 vnode_pager_generic_getpages_done_async() at vnode_pager_generic_getpages_done_async+0x3a/frame 0xfffffe00e39f0a90 bufdone() at bufdone+0x6c/frame 0xfffffe00e39f0b00 g_io_deliver() at g_io_deliver+0x25e/frame 0xfffffe00e39f0b50 md_kthread() at md_kthread+0x259/frame 0xfffffe00e39f0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e39f0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e39f0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command csh pid 2449 tid 100211 td 0xfffffe00e69db000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e39dc8d0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e39f0010 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e39f0020 trap() at trap+0x6c/frame 0xfffffe00e39f0130 calltrap() at calltrap+0x8/frame 0xfffffe00e39f0130 --- trap 0xc, rip = 0xffffffff810406d0, rsp = 0xfffffe00e39f0200, rbp = 0xfffffe00e39f0290 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe00e39f0290 db_get_value() at db_get_value+0x32/frame 0xfffffe00e39f02d0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00e39f0360 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e39f0380 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e39f0420 db_command() at db_command+0x25c/frame 0xfffffe00e39f04f0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00e39f0590 db_command() at db_command+0x25c/frame 0xfffffe00e39f0660 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e39f0670 db_trap() at db_trap+0xe8/frame 0xfffffe00e39f0700 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00e39f0770 trap() at trap+0x7b8/frame 0xfffffe00e39f0880 calltrap() at calltrap+0x8/frame 0xfffffe00e39f0880 --- trap 0x3, rip = 0xffffffff80c0e347, rsp = 0xfffffe00e39f0950, rbp = 0xfffffe00e39f0960 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e39f0960 vpanic() at vpanic+0x19e/frame 0xfffffe00e39f09b0 panic() at panic+0x43/frame 0xfffffe00e39f0a10 vm_page_relookup() at vm_page_relookup+0x4e/frame 0xfffffe00e39f0a30 sendfile_iodone() at sendfile_iodone+0x153/frame 0xfffffe00e39f0a70 vnode_pager_generic_getpages_done_async() at vnode_pager_generic_getpages_done_async+0x3a/frame 0xfffffe00e39f0a90 bufdone() at bufdone+0x6c/frame 0xfffffe00e39f0b00 g_io_deliver() at g_io_deliver+0x25e/frame 0xfffffe00e39f0b50 md_kthread() at md_kthread+0x259/frame 0xfffffe00e39f0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e39f0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e39f0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00e39dc8d8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e39f0280 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e39f0290 db_get_value() at db_get_value+0x4c/frame 0xfffffe00e39f02d0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00e39f0360 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e39f0380 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e39f0420 db_command() at db_command+0x25c/frame 0xfffffe00e39f04f0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00e39f0590 db_command() at db_command+0x25c/frame 0xfffffe00e39f0660 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e39f0670 db_trap() at db_trap+0xe8/frame 0xfffffe00e39f0700 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00e39f0770 trap() at trap+0x7b8/frame 0xfffffe00e39f0880 calltrap() at calltrap+0x8/frame 0xfffffe00e39f0880 --- trap 0x3, rip = 0xffffffff80c0e347, rsp = 0xfffffe00e39f0950, rbp = 0xfffffe00e39f0960 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e39f0960 vpanic() at vpanic+0x19e/frame 0xfffffe00e39f09b0 panic() at panic+0x43/frame 0xfffffe00e39f0a10 vm_page_relookup() at vm_page_relookup+0x4e/frame 0xfffffe00e39f0a30 sendfile_iodone() at sendfile_iodone+0x153/frame 0xfffffe00e39f0a70 vnode_pager_generic_getpages_done_async() at vnode_pager_generic_getpages_done_async+0x3a/frame 0xfffffe00e39f0a90 bufdone() at bufdone+0x6c/frame 0xfffffe00e39f0b00 g_io_deliver() at g_io_deliver+0x25e/frame 0xfffffe00e39f0b50 md_kthread() at md_kthread+0x259/frame 0xfffffe00e39f0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e39f0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e39f0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command su pid 2448 tid 100143 td 0xfffffe00d39ef300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e38046e0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e39f0010 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e39f0020 trap() at trap+0x6c/frame 0xfffffe00e39f0130 calltrap() at calltrap+0x8/frame 0xfffffe00e39f0130 --- trap 0xc, rip = 0xffffffff810406d0, rsp = 0xfffffe00e39f0200, rbp = 0xfffffe00e39f0290 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe00e39f0290 db_get_value() at db_get_value+0x32/frame 0xfffffe00e39f02d0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00e39f0360 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e39f0380 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e39f0420 db_command() at db_command+0x25c/frame 0xfffffe00e39f04f0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00e39f0590 db_command() at db_command+0x25c/frame 0xfffffe00e39f0660 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e39f0670 db_trap() at db_trap+0xe8/frame 0xfffffe00e39f0700 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00e39f0770 trap() at trap+0x7b8/frame 0xfffffe00e39f0880 calltrap() at calltrap+0x8/frame 0xfffffe00e39f0880 --- trap 0x3, rip = 0xffffffff80c0e347, rsp = 0xfffffe00e39f0950, rbp = 0xfffffe00e39f0960 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e39f0960 vpanic() at vpanic+0x19e/frame 0xfffffe00e39f09b0 panic() at panic+0x43/frame 0xfffffe00e39f0a10 vm_page_relookup() at vm_page_relookup+0x4e/frame 0xfffffe00e39f0a30 sendfile_iodone() at sendfile_iodone+0x153/frame 0xfffffe00e39f0a70 vnode_pager_generic_getpages_done_async() at vnode_pager_generic_getpages_done_async+0x3a/frame 0xfffffe00e39f0a90 bufdone() at bufdone+0x6c/frame 0xfffffe00e39f0b00 g_io_deliver() at g_io_deliver+0x25e/frame 0xfffffe00e39f0b50 md_kthread() at md_kthread+0x259/frame 0xfffffe00e39f0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e39f0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e39f0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00e38046e8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e39f0280 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e39f0290 db_get_value() at db_get_value+0x4c/frame 0xfffffe00e39f02d0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00e39f0360 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e39f0380 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e39f0420 db_command() at db_command+0x25c/frame 0xfffffe00e39f04f0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00e39f0590 db_command() at db_command+0x25c/frame 0xfffffe00e39f0660 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e39f0670 db_trap() at db_trap+0xe8/frame 0xfffffe00e39f0700 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00e39f0770 trap() at trap+0x7b8/frame 0xfffffe00e39f0880 calltrap() at calltrap+0x8/frame 0xfffffe00e39f0880 --- trap 0x3, rip = 0xffffffff80c0e347, rsp = 0xfffffe00e39f0950, rbp = 0xfffffe00e39f0960 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e39f0960 vpanic() at vpanic+0x19e/frame 0xfffffe00e39f09b0 panic() at panic+0x43/frame 0xfffffe00e39f0a10 vm_page_relookup() at vm_page_relookup+0x4e/frame 0xfffffe00e39f0a30 sendfile_iodone() at sendfile_iodone+0x153/frame 0xfffffe00e39f0a70 vnode_pager_generic_getpages_done_async() at vnode_pager_generic_getpages_done_async+0x3a/frame 0xfffffe00e39f0a90 bufdone() at bufdone+0x6c/frame 0xfffffe00e39f0b00 g_io_deliver() at g_io_deliver+0x25e/frame 0xfffffe00e39f0b50 md_kthread() at md_kthread+0x259/frame 0xfffffe00e39f0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e39f0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e39f0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bash pid 2442 tid 100205 td 0xfffffe00e6993e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e39b26e0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e39f0010 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e39f0020 trap() at trap+0x6c/frame 0xfffffe00e39f0130 calltrap() at calltrap+0x8/frame 0xfffffe00e39f0130 --- trap 0xc, rip = 0xffffffff810406d0, rsp = 0xfffffe00e39f0200, rbp = 0xfffffe00e39f0290 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe00e39f0290 db_get_value() at db_get_value+0x32/frame 0xfffffe00e39f02d0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00e39f0360 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e39f0380 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e39f0420 db_command() at db_command+0x25c/frame 0xfffffe00e39f04f0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00e39f0590 db_command() at db_command+0x25c/frame 0xfffffe00e39f0660 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e39f0670 db_trap() at db_trap+0xe8/frame 0xfffffe00e39f0700 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00e39f0770 trap() at trap+0x7b8/frame 0xfffffe00e39f0880 calltrap() at calltrap+0x8/frame 0xfffffe00e39f0880 --- trap 0x3, rip = 0xffffffff80c0e347, rsp = 0xfffffe00e39f0950, rbp = 0xfffffe00e39f0960 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e39f0960 vpanic() at vpanic+0x19e/frame 0xfffffe00e39f09b0 panic() at panic+0x43/frame 0xfffffe00e39f0a10 vm_page_relookup() at vm_page_relookup+0x4e/frame 0xfffffe00e39f0a30 sendfile_iodone() at sendfile_iodone+0x153/frame 0xfffffe00e39f0a70 vnode_pager_generic_getpages_done_async() at vnode_pager_generic_getpages_done_async+0x3a/frame 0xfffffe00e39f0a90 bufdone() at bufdone+0x6c/frame 0xfffffe00e39f0b00 g_io_deliver() at g_io_deliver+0x25e/frame 0xfffffe00e39f0b50 md_kthread() at md_kthread+0x259/frame 0xfffffe00e39f0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e39f0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e39f0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00e39b26e8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e39f0280 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e39f0290 db_get_value() at db_get_value+0x4c/frame 0xfffffe00e39f02d0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00e39f0360 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e39f0380 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e39f0420 db_command() at db_command+0x25c/frame 0xfffffe00e39f04f0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00e39f0590 db_command() at db_command+0x25c/frame 0xfffffe00e39f0660 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e39f0670 db_trap() at db_trap+0xe8/frame 0xfffffe00e39f0700 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00e39f0770 trap() at trap+0x7b8/frame 0xfffffe00e39f0880 calltrap() at calltrap+0x8/frame 0xfffffe00e39f0880 --- trap 0x3, rip = 0xffffffff80c0e347, rsp = 0xfffffe00e39f0950, rbp = 0xfffffe00e39f0960 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e39f0960 vpanic() at vpanic+0x19e/frame 0xfffffe00e39f09b0 panic() at panic+0x43/frame 0xfffffe00e39f0a10 vm_page_relookup() at vm_page_relookup+0x4e/frame 0xfffffe00e39f0a30 sendfile_iodone() at sendfile_iodone+0x153/frame 0xfffffe00e39f0a70 vnode_pager_generic_getpages_done_async() at vnode_pager_generic_getpages_done_async+0x3a/frame 0xfffffe00e39f0a90 bufdone() at bufdone+0x6c/frame 0xfffffe00e39f0b00 g_io_deliver() at g_io_deliver+0x25e/frame 0xfffffe00e39f0b50 md_kthread() at md_kthread+0x259/frame 0xfffffe00e39f0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e39f0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e39f0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sshd pid 2441 tid 100216 td 0xfffffe00e69da800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e39f5740 mi_switch() at mi_switch+0x155/frame 0xfffffe00e39f5760 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e39f57a0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e39f5800 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e39f5810 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e39f5870 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e39f58b0 kern_select() at kern_select+0x87a/frame 0xfffffe00e39f5a90 sys_select() at sys_select+0x56/frame 0xfffffe00e39f5ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e39f5bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e39f5bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8008e17fa, rsp = 0x7fffffffa548, rbp = 0x7fffffffa580 --- Tracing command sshd pid 2438 tid 100159 td 0xfffffe00e453b100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e38547c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e38547e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e3854820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e3854880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e3854890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e38548f0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e3854930 kern_poll() at kern_poll+0x48b/frame 0xfffffe00e3854ab0 sys_poll() at sys_poll+0x50/frame 0xfffffe00e3854ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e3854bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3854bf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x80088500a, rsp = 0x7fffffffe5a8, rbp = 0x7fffffffe5e0 --- Tracing command csh pid 2434 tid 100212 td 0xfffffe00dd3fae00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e39e17c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e39e17e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e39e1820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e39e1880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e39e1890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e39e18f0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e39e1920 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e39e1980 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e39e19b0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e39e1a10 dofileread() at dofileread+0x81/frame 0xfffffe00e39e1a60 sys_read() at sys_read+0xc0/frame 0xfffffe00e39e1ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e39e1bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e39e1bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80051081a, rsp = 0x7fffffffe1e8, rbp = 0x7fffffffe210 --- Tracing command login pid 2431 tid 100224 td 0xfffffe00e6658700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e601d6e0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e39f0010 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e39f0020 trap() at trap+0x6c/frame 0xfffffe00e39f0130 calltrap() at calltrap+0x8/frame 0xfffffe00e39f0130 --- trap 0xc, rip = 0xffffffff810406d0, rsp = 0xfffffe00e39f0200, rbp = 0xfffffe00e39f0290 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe00e39f0290 db_get_value() at db_get_value+0x32/frame 0xfffffe00e39f02d0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00e39f0360 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e39f0380 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e39f0420 db_command() at db_command+0x25c/frame 0xfffffe00e39f04f0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00e39f0590 db_command() at db_command+0x25c/frame 0xfffffe00e39f0660 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e39f0670 db_trap() at db_trap+0xe8/frame 0xfffffe00e39f0700 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00e39f0770 trap() at trap+0x7b8/frame 0xfffffe00e39f0880 calltrap() at calltrap+0x8/frame 0xfffffe00e39f0880 --- trap 0x3, rip = 0xffffffff80c0e347, rsp = 0xfffffe00e39f0950, rbp = 0xfffffe00e39f0960 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e39f0960 vpanic() at vpanic+0x19e/frame 0xfffffe00e39f09b0 panic() at panic+0x43/frame 0xfffffe00e39f0a10 vm_page_relookup() at vm_page_relookup+0x4e/frame 0xfffffe00e39f0a30 sendfile_iodone() at sendfile_iodone+0x153/frame 0xfffffe00e39f0a70 vnode_pager_generic_getpages_done_async() at vnode_pager_generic_getpages_done_async+0x3a/frame 0xfffffe00e39f0a90 bufdone() at bufdone+0x6c/frame 0xfffffe00e39f0b00 g_io_deliver() at g_io_deliver+0x25e/frame 0xfffffe00e39f0b50 md_kthread() at md_kthread+0x259/frame 0xfffffe00e39f0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e39f0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e39f0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00e601d6e8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e39f0280 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e39f0290 db_get_value() at db_get_value+0x4c/frame 0xfffffe00e39f02d0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00e39f0360 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e39f0380 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e39f0420 db_command() at db_command+0x25c/frame 0xfffffe00e39f04f0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00e39f0590 db_command() at db_command+0x25c/frame 0xfffffe00e39f0660 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e39f0670 db_trap() at db_trap+0xe8/frame 0xfffffe00e39f0700 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00e39f0770 trap() at trap+0x7b8/frame 0xfffffe00e39f0880 calltrap() at calltrap+0x8/frame 0xfffffe00e39f0880 --- trap 0x3, rip = 0xffffffff80c0e347, rsp = 0xfffffe00e39f0950, rbp = 0xfffffe00e39f0960 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e39f0960 vpanic() at vpanic+0x19e/frame 0xfffffe00e39f09b0 panic() at panic+0x43/frame 0xfffffe00e39f0a10 vm_page_relookup() at vm_page_relookup+0x4e/frame 0xfffffe00e39f0a30 sendfile_iodone() at sendfile_iodone+0x153/frame 0xfffffe00e39f0a70 vnode_pager_generic_getpages_done_async() at vnode_pager_generic_getpages_done_async+0x3a/frame 0xfffffe00e39f0a90 bufdone() at bufdone+0x6c/frame 0xfffffe00e39f0b00 g_io_deliver() at g_io_deliver+0x25e/frame 0xfffffe00e39f0b50 md_kthread() at md_kthread+0x259/frame 0xfffffe00e39f0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e39f0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e39f0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command getty pid 2430 tid 100223 td 0xfffffe00e3a01500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e60187c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e60187e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e6018820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e6018880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e6018890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e60188f0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e6018920 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e6018980 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e60189b0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e6018a10 dofileread() at dofileread+0x81/frame 0xfffffe00e6018a60 sys_read() at sys_read+0xc0/frame 0xfffffe00e6018ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e6018bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e6018bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043781a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2429 tid 100222 td 0xfffffe00e3a01c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e60137c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e60137e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e6013820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e6013880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e6013890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e60138f0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e6013920 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e6013980 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e60139b0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e6013a10 dofileread() at dofileread+0x81/frame 0xfffffe00e6013a60 sys_read() at sys_read+0xc0/frame 0xfffffe00e6013ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e6013bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e6013bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043781a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2428 tid 100221 td 0xfffffe00e3a02300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e600e7c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e600e7e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e600e820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e600e880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e600e890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e600e8f0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e600e920 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e600e980 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e600e9b0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e600ea10 dofileread() at dofileread+0x81/frame 0xfffffe00e600ea60 sys_read() at sys_read+0xc0/frame 0xfffffe00e600ead0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e600ebf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e600ebf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043781a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2427 tid 100220 td 0xfffffe00e3a02a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e60097c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e60097e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e6009820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e6009880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e6009890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e60098f0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e6009920 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e6009980 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e60099b0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e6009a10 dofileread() at dofileread+0x81/frame 0xfffffe00e6009a60 sys_read() at sys_read+0xc0/frame 0xfffffe00e6009ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e6009bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e6009bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043781a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2426 tid 100175 td 0xfffffe00e3a00000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e38b07c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e38b07e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e38b0820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e38b0880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e38b0890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e38b08f0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e38b0920 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e38b0980 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e38b09b0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e38b0a10 dofileread() at dofileread+0x81/frame 0xfffffe00e38b0a60 sys_read() at sys_read+0xc0/frame 0xfffffe00e38b0ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e38b0bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e38b0bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043781a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2425 tid 100195 td 0xfffffe00dd3fd100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e39807c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e39807e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e3980820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e3980880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e3980890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e39808f0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e3980920 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e3980980 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e39809b0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e3980a10 dofileread() at dofileread+0x81/frame 0xfffffe00e3980a60 sys_read() at sys_read+0xc0/frame 0xfffffe00e3980ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e3980bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3980bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043781a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2424 tid 100188 td 0xfffffe00e3a03100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e39217c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e39217e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e3921820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e3921880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e3921890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e39218f0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e3921920 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e3921980 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e39219b0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e3921a10 dofileread() at dofileread+0x81/frame 0xfffffe00e3921a60 sys_read() at sys_read+0xc0/frame 0xfffffe00e3921ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e3921bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3921bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043781a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2423 tid 100196 td 0xfffffe00dd3fca00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e39857c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e39857e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e3985820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e3985880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e3985890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e39858f0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e3985920 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e3985980 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e39859b0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e3985a10 dofileread() at dofileread+0x81/frame 0xfffffe00e3985a60 sys_read() at sys_read+0xc0/frame 0xfffffe00e3985ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e3985bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3985bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043781a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2422 tid 100142 td 0xfffffe003e461300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e37fd7c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e37fd7e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e37fd820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e37fd880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e37fd890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e37fd8f0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e37fd920 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e37fd980 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e37fd9b0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e37fda10 dofileread() at dofileread+0x81/frame 0xfffffe00e37fda60 sys_read() at sys_read+0xc0/frame 0xfffffe00e37fdad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e37fdbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e37fdbf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043781a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command cron pid 2373 tid 100213 td 0xfffffe00dd3fa700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e39e6870 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e39f0010 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e39f0020 trap() at trap+0x6c/frame 0xfffffe00e39f0130 calltrap() at calltrap+0x8/frame 0xfffffe00e39f0130 --- trap 0xc, rip = 0xffffffff810406d0, rsp = 0xfffffe00e39f0200, rbp = 0xfffffe00e39f0290 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe00e39f0290 db_get_value() at db_get_value+0x32/frame 0xfffffe00e39f02d0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00e39f0360 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e39f0380 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e39f0420 db_command() at db_command+0x25c/frame 0xfffffe00e39f04f0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00e39f0590 db_command() at db_command+0x25c/frame 0xfffffe00e39f0660 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e39f0670 db_trap() at db_trap+0xe8/frame 0xfffffe00e39f0700 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00e39f0770 trap() at trap+0x7b8/frame 0xfffffe00e39f0880 calltrap() at calltrap+0x8/frame 0xfffffe00e39f0880 --- trap 0x3, rip = 0xffffffff80c0e347, rsp = 0xfffffe00e39f0950, rbp = 0xfffffe00e39f0960 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e39f0960 vpanic() at vpanic+0x19e/frame 0xfffffe00e39f09b0 panic() at panic+0x43/frame 0xfffffe00e39f0a10 vm_page_relookup() at vm_page_relookup+0x4e/frame 0xfffffe00e39f0a30 sendfile_iodone() at sendfile_iodone+0x153/frame 0xfffffe00e39f0a70 vnode_pager_generic_getpages_done_async() at vnode_pager_generic_getpages_done_async+0x3a/frame 0xfffffe00e39f0a90 bufdone() at bufdone+0x6c/frame 0xfffffe00e39f0b00 g_io_deliver() at g_io_deliver+0x25e/frame 0xfffffe00e39f0b50 md_kthread() at md_kthread+0x259/frame 0xfffffe00e39f0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e39f0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e39f0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00e39e6878 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e39f0280 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e39f0290 db_get_value() at db_get_value+0x4c/frame 0xfffffe00e39f02d0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00e39f0360 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e39f0380 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e39f0420 db_command() at db_command+0x25c/frame 0xfffffe00e39f04f0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00e39f0590 db_command() at db_command+0x25c/frame 0xfffffe00e39f0660 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e39f0670 db_trap() at db_trap+0xe8/frame 0xfffffe00e39f0700 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00e39f0770 trap() at trap+0x7b8/frame 0xfffffe00e39f0880 calltrap() at calltrap+0x8/frame 0xfffffe00e39f0880 --- trap 0x3, rip = 0xffffffff80c0e347, rsp = 0xfffffe00e39f0950, rbp = 0xfffffe00e39f0960 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e39f0960 vpanic() at vpanic+0x19e/frame 0xfffffe00e39f09b0 panic() at panic+0x43/frame 0xfffffe00e39f0a10 vm_page_relookup() at vm_page_relookup+0x4e/frame 0xfffffe00e39f0a30 sendfile_iodone() at sendfile_iodone+0x153/frame 0xfffffe00e39f0a70 vnode_pager_generic_getpages_done_async() at vnode_pager_generic_getpages_done_async+0x3a/frame 0xfffffe00e39f0a90 bufdone() at bufdone+0x6c/frame 0xfffffe00e39f0b00 g_io_deliver() at g_io_deliver+0x25e/frame 0xfffffe00e39f0b50 md_kthread() at md_kthread+0x259/frame 0xfffffe00e39f0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e39f0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e39f0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sshd pid 2369 tid 100165 td 0xfffffe00d31a6300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e3872740 mi_switch() at mi_switch+0x155/frame 0xfffffe00e3872760 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e38727a0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e3872800 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e3872810 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e3872870 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e38728b0 kern_select() at kern_select+0x87a/frame 0xfffffe00e3872a90 sys_select() at sys_select+0x56/frame 0xfffffe00e3872ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e3872bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3872bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8008e17fa, rsp = 0x7fffffffe638, rbp = 0x7fffffffe670 --- Tracing command powerd pid 2341 tid 100199 td 0xfffffe00d35e7e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e3994700 mi_switch() at mi_switch+0x155/frame 0xfffffe00e3994720 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e3994760 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e39947c0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e3994800 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00e3994870 seltdwait() at seltdwait+0x6b/frame 0xfffffe00e39948b0 kern_select() at kern_select+0x87a/frame 0xfffffe00e3994a90 sys_select() at sys_select+0x56/frame 0xfffffe00e3994ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e3994bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3994bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8004347fa, rsp = 0x7fffffffeb58, rbp = 0x7fffffffeca0 --- Tracing command ntpd pid 2338 tid 100204 td 0xfffffe00e449da00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e39ad740 mi_switch() at mi_switch+0x155/frame 0xfffffe00e39ad760 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e39ad7a0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e39ad800 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e39ad810 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e39ad870 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e39ad8b0 kern_select() at kern_select+0x87a/frame 0xfffffe00e39ada90 sys_select() at sys_select+0x56/frame 0xfffffe00e39adad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e39adbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e39adbf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80080f7fa, rsp = 0x7fffffffdec8, rbp = 0x7fffffffdf00 --- Tracing command ntpd pid 2338 tid 101231 td 0xfffffe00e6850100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e6173820 mi_switch() at mi_switch+0x155/frame 0xfffffe00e6173840 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e6173880 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e61738e0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e61738f0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e6173990 umtxq_sleep() at umtxq_sleep+0x19e/frame 0xfffffe00e61739f0 do_sem2_wait() at do_sem2_wait+0x38f/frame 0xfffffe00e6173a80 __umtx_op_sem2_wait() at __umtx_op_sem2_wait+0x76/frame 0xfffffe00e6173ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e6173bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e6173bf0 --- syscall (454, FreeBSD ELF64, sys__umtx_op), rip = 0x800706a6a, rsp = 0x7fffdff3aee8, rbp = 0x7fffdff3af60 --- Tracing command rpc.lockd pid 2273 tid 100146 td 0xfffffe00dd3fb500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e3813640 mi_switch() at mi_switch+0x155/frame 0xfffffe00e3813660 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e38136a0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e3813700 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e3813740 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00e38137b0 svc_run_internal() at svc_run_internal+0xafe/frame 0xfffffe00e38138f0 svc_run() at svc_run+0x253/frame 0xfffffe00e3813950 sys_nlm_syscall() at sys_nlm_syscall+0x74d/frame 0xfffffe00e3813ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e3813bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3813bf0 --- syscall (154, FreeBSD ELF64, sys_nlm_syscall), rip = 0x8002f9b5a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec90 --- Tracing command rpc.statd pid 2270 tid 100208 td 0xfffffe00e69dbe00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e39c1700 mi_switch() at mi_switch+0x155/frame 0xfffffe00e39c1720 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e39c1760 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e39c17c0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e39c1800 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00e39c1870 seltdwait() at seltdwait+0x6b/frame 0xfffffe00e39c18b0 kern_select() at kern_select+0x87a/frame 0xfffffe00e39c1a90 sys_select() at sys_select+0x56/frame 0xfffffe00e39c1ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e39c1bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e39c1bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80042a7fa, rsp = 0x7fffffffea68, rbp = 0x7fffffffebb0 --- Tracing command watchdogd pid 2224 tid 100152 td 0xfffffe00d61fdc00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e3831870 mi_switch() at mi_switch+0x155/frame 0xfffffe00e3831890 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e38318d0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e3831930 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e3831970 _sleep() at _sleep+0x258/frame 0xfffffe00e3831a10 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe00e3831a90 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe00e3831ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e3831bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3831bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003c5baa, rsp = 0x7fffffffea68, rbp = 0x7fffffffeab0 --- Tracing command rpcbind pid 2076 tid 100145 td 0xfffffe00dd3f3c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e380e780 mi_switch() at mi_switch+0x155/frame 0xfffffe00e380e7a0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e380e7e0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e380e840 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e380e880 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00e380e8f0 seltdwait() at seltdwait+0x6b/frame 0xfffffe00e380e930 kern_poll() at kern_poll+0x48b/frame 0xfffffe00e380eab0 sys_poll() at sys_poll+0x50/frame 0xfffffe00e380ead0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e380ebf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e380ebf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003d300a, rsp = 0x7fffffffca08, rbp = 0x7fffffffec20 --- Tracing command syslogd pid 2066 tid 100190 td 0xfffffe00e4539500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e392b740 mi_switch() at mi_switch+0x155/frame 0xfffffe00e392b760 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e392b7a0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e392b800 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e392b810 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e392b870 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e392b8b0 kern_select() at kern_select+0x87a/frame 0xfffffe00e392ba90 sys_select() at sys_select+0x56/frame 0xfffffe00e392bad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e392bbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e392bbf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80043d7fa, rsp = 0x7fffffffe718, rbp = 0x7fffffffec90 --- Tracing command devd pid 1995 tid 100167 td 0xfffffe00dd3f2e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e387c700 mi_switch() at mi_switch+0x155/frame 0xfffffe00e387c720 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e387c760 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e387c7c0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e387c800 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00e387c870 seltdwait() at seltdwait+0x6b/frame 0xfffffe00e387c8b0 kern_select() at kern_select+0x87a/frame 0xfffffe00e387ca90 sys_select() at sys_select+0x56/frame 0xfffffe00e387cad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e387cbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e387cbf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x2f63aa, rsp = 0x7fffffffcb18, rbp = 0x7fffffffecb0 --- Tracing command dhclient pid 1990 tid 100162 td 0xfffffe00d39eec00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e3863780 mi_switch() at mi_switch+0x155/frame 0xfffffe00e38637a0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e38637e0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e3863840 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e3863880 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00e38638f0 seltdwait() at seltdwait+0x6b/frame 0xfffffe00e3863930 kern_poll() at kern_poll+0x48b/frame 0xfffffe00e3863ab0 sys_poll() at sys_poll+0x50/frame 0xfffffe00e3863ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e3863bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3863bf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003f800a, rsp = 0x7fffffffebf8, rbp = 0x7fffffffec30 --- Tracing command dhclient pid 1931 tid 100163 td 0xfffffe00d31a6a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e38687c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e38687e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e3868820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e3868880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e3868890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e38688f0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e3868930 kern_poll() at kern_poll+0x48b/frame 0xfffffe00e3868ab0 sys_poll() at sys_poll+0x50/frame 0xfffffe00e3868ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e3868bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3868bf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003f800a, rsp = 0x7fffffffec08, rbp = 0x7fffffffec30 --- Tracing command dhclient pid 1928 tid 100155 td 0xfffffe00e449e800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e3840740 mi_switch() at mi_switch+0x155/frame 0xfffffe00e3840760 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e38407a0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e3840800 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e3840810 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e3840870 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e38408b0 kern_select() at kern_select+0x87a/frame 0xfffffe00e3840a90 sys_select() at sys_select+0x56/frame 0xfffffe00e3840ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e3840bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3840bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8004547fa, rsp = 0x7fffffffe9b8, rbp = 0x7fffffffea70 --- Tracing command syncer pid 34 tid 100141 td 0xfffffe00d61fe300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e37f8a10 mi_switch() at mi_switch+0x155/frame 0xfffffe00e37f8a30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e37f8a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e37f8ab0 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x184/frame 0xfffffe00e37f8b20 sched_sync() at sched_sync+0x68b/frame 0xfffffe00e37f8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e37f8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e37f8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vnlru pid 33 tid 100135 td 0xfffffe00d61fea00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00de1f89d0 mi_switch() at mi_switch+0x155/frame 0xfffffe00de1f89f0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00de1f8a30 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00de1f8a70 _sleep() at _sleep+0x26c/frame 0xfffffe00de1f8b10 vnlru_proc() at vnlru_proc+0xaac/frame 0xfffffe00de1f8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00de1f8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00de1f8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100130 td 0xfffffe00d61ff100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d743da20 mi_switch() at mi_switch+0x155/frame 0xfffffe00d743da40 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d743da80 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00d743dac0 _sleep() at _sleep+0x26c/frame 0xfffffe00d743db60 buf_daemon() at buf_daemon+0x112/frame 0xfffffe00d743dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d743dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d743dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100131 td 0xfffffe00d35e6100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00de184a10 mi_switch() at mi_switch+0x155/frame 0xfffffe00de184a30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00de184a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00de184ab0 _sleep() at _sleep+0x26c/frame 0xfffffe00de184b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00de184bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00de184bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00de184bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100132 td 0xfffffe00d35e5a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00de189a10 mi_switch() at mi_switch+0x155/frame 0xfffffe00de189a30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00de189a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00de189ab0 _sleep() at _sleep+0x26c/frame 0xfffffe00de189b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00de189bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00de189bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00de189bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100133 td 0xfffffe00d35e5300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00de1eea10 mi_switch() at mi_switch+0x155/frame 0xfffffe00de1eea30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00de1eea70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00de1eeab0 _sleep() at _sleep+0x26c/frame 0xfffffe00de1eeb50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00de1eebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00de1eebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00de1eebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100136 td 0xfffffe00d35e4c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00de1fda10 mi_switch() at mi_switch+0x155/frame 0xfffffe00de1fda30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00de1fda70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00de1fdab0 _sleep() at _sleep+0x26c/frame 0xfffffe00de1fdb50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00de1fdbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00de1fdbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00de1fdbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100137 td 0xfffffe00d35e4500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e37e4a10 mi_switch() at mi_switch+0x155/frame 0xfffffe00e37e4a30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e37e4a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e37e4ab0 _sleep() at _sleep+0x26c/frame 0xfffffe00e37e4b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00e37e4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e37e4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e37e4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100139 td 0xfffffe00d35e3e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e37eea10 mi_switch() at mi_switch+0x155/frame 0xfffffe00e37eea30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e37eea70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e37eeab0 _sleep() at _sleep+0x26c/frame 0xfffffe00e37eeb50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00e37eebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e37eebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e37eebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100140 td 0xfffffe00d35e3700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e37f3a10 mi_switch() at mi_switch+0x155/frame 0xfffffe00e37f3a30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e37f3a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e37f3ab0 _sleep() at _sleep+0x26c/frame 0xfffffe00e37f3b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00e37f3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e37f3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e37f3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100153 td 0xfffffe003e1b6100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e3836a40 mi_switch() at mi_switch+0x155/frame 0xfffffe00e3836a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e3836aa0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e3836ae0 _sleep() at _sleep+0x26c/frame 0xfffffe00e3836b80 softdep_flush() at softdep_flush+0x16e/frame 0xfffffe00e3836bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e3836bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e3836bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100157 td 0xfffffe00d61fd500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e384aa40 mi_switch() at mi_switch+0x155/frame 0xfffffe00e384aa60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e384aaa0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e384aae0 _sleep() at _sleep+0x26c/frame 0xfffffe00e384ab80 softdep_flush() at softdep_flush+0x16e/frame 0xfffffe00e384abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e384abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e384abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vmdaemon pid 31 tid 100129 td 0xfffffe00d61ff800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d7438a40 mi_switch() at mi_switch+0x155/frame 0xfffffe00d7438a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d7438aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe00d7438b40 vm_daemon() at vm_daemon+0x82/frame 0xfffffe00d7438bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d7438bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d7438bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100128 td 0xfffffe00d6097e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d7433670 mi_switch() at mi_switch+0x155/frame 0xfffffe00d7433690 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d74336d0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00d7433710 _sleep() at _sleep+0x26c/frame 0xfffffe00d74337b0 vm_pageout_worker() at vm_pageout_worker+0x279/frame 0xfffffe00d7433b70 vm_pageout() at vm_pageout+0x193/frame 0xfffffe00d7433bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d7433bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d7433bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100134 td 0xfffffe00d35e9a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00de1f37c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00de1f37e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00de1f3820 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00de1f3860 _sleep() at _sleep+0x26c/frame 0xfffffe00de1f3900 pause_sbt() at pause_sbt+0xf1/frame 0xfffffe00de1f3930 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0xaee/frame 0xfffffe00de1f3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00de1f3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00de1f3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100138 td 0xfffffe00d35e9300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e37e9a40 mi_switch() at mi_switch+0x155/frame 0xfffffe00e37e9a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e37e9aa0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e37e9ae0 _sleep() at _sleep+0x26c/frame 0xfffffe00e37e9b80 uma_reclaim_worker() at uma_reclaim_worker+0xb8/frame 0xfffffe00e37e9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e37e9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e37e9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon1 pid 29 tid 100127 td 0xfffffe003e4b6a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d742ea40 mi_switch() at mi_switch+0x155/frame 0xfffffe00d742ea60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d742eaa0 _sleep() at _sleep+0x2cd/frame 0xfffffe00d742eb40 enc_daemon() at enc_daemon+0xe4/frame 0xfffffe00d742ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d742ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d742ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon0 pid 28 tid 100126 td 0xfffffe003e4b7100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d7429a40 mi_switch() at mi_switch+0x155/frame 0xfffffe00d7429a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d7429aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe00d7429b40 enc_daemon() at enc_daemon+0xe4/frame 0xfffffe00d7429bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d7429bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d7429bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command rand_harvestq pid 27 tid 100123 td 0xfffffe00d6099300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d741a9f0 mi_switch() at mi_switch+0x155/frame 0xfffffe00d741aa10 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d741aa50 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00d741aa90 _sleep() at _sleep+0x26c/frame 0xfffffe00d741ab30 random_kthread() at random_kthread+0x67/frame 0xfffffe00d741abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d741abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d741abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sctp_iterator pid 26 tid 100119 td 0xfffffe00d61fc000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037bf6a90 mi_switch() at mi_switch+0x155/frame 0xfffffe0037bf6ab0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bf6af0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037bf6b90 sctp_iterator_thread() at sctp_iterator_thread+0x59/frame 0xfffffe0037bf6bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bf6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bf6bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod4 pid 25 tid 100118 td 0xfffffe00d31a7100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037bf1a30 mi_switch() at mi_switch+0x155/frame 0xfffffe0037bf1a50 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bf1a90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037bf1ad0 _sleep() at _sleep+0x26c/frame 0xfffffe0037bf1b70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe0037bf1bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bf1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bf1bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod3 pid 24 tid 100117 td 0xfffffe00d31a7800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037beca30 mi_switch() at mi_switch+0x155/frame 0xfffffe0037beca50 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037beca90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037becad0 _sleep() at _sleep+0x26c/frame 0xfffffe0037becb70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe0037becbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037becbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037becbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod2 pid 23 tid 100116 td 0xfffffe00d6097000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037be7a30 mi_switch() at mi_switch+0x155/frame 0xfffffe0037be7a50 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037be7a90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037be7ad0 _sleep() at _sleep+0x26c/frame 0xfffffe0037be7b70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe0037be7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037be7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037be7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod1 pid 22 tid 100115 td 0xfffffe00d6097700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037be2a30 mi_switch() at mi_switch+0x155/frame 0xfffffe0037be2a50 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037be2a90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037be2ad0 _sleep() at _sleep+0x26c/frame 0xfffffe0037be2b70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe0037be2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037be2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037be2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100096 td 0xfffffe003e4b4e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b77ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b77ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b77b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b77b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b77bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b77bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b77bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100097 td 0xfffffe003e4b4700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b7cab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b7cad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b7cb10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b7cb70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b7cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b7cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b7cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100098 td 0xfffffe003e4b4000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b81ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b81ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b81b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b81b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b81bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b81bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b81bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100099 td 0xfffffe003e1aa800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b86ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b86ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b86b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b86b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b86bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b86bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b86bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100100 td 0xfffffe003e1aa100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b8bab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b8bad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b8bb10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b8bb70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b8bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b8bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b8bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100102 td 0xfffffe00d2e1a500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b95ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b95ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b95b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b95b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b95bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b95bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b95bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100103 td 0xfffffe00d2e19e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b9aab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b9aad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b9ab10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b9ab70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b9abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b9abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b9abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100104 td 0xfffffe00d2e19700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b9fab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b9fad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b9fb10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b9fb70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b9fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b9fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b9fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100105 td 0xfffffe00d2e19000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037ba4ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037ba4ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ba4b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037ba4b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037ba4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ba4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ba4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100106 td 0xfffffe003e4b7800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037ba9ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037ba9ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ba9b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037ba9b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037ba9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ba9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ba9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100107 td 0xfffffe00d31a4e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037bbaab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037bbaad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bbab10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037bbab70 usb_process() at usb_process+0xc3/frame 0xfffffe0037bbabb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bbabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bbabf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100108 td 0xfffffe00d31a4700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037bbfab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037bbfad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bbfb10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037bbfb70 usb_process() at usb_process+0xc3/frame 0xfffffe0037bbfbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bbfbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bbfbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100109 td 0xfffffe00d31a4000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037bc4ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037bc4ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bc4b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037bc4b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037bc4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bc4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bc4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100110 td 0xfffffe00d2e1c800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037bc9ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037bc9ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bc9b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037bc9b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037bc9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bc9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bc9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100111 td 0xfffffe00d2e1c100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037bceab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037bcead0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bceb10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037bceb70 usb_process() at usb_process+0xc3/frame 0xfffffe0037bcebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bcebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bcebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100091 td 0xfffffe003e1a7700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b5ea60 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b5ea80 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b5eac0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b5eb60 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe0037b5ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b5ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b5ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100092 td 0xfffffe003e1a7000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b63a60 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b63a80 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b63ac0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b63b60 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe0037b63bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b63bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b63bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100093 td 0xfffffe003e1b6800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b68a60 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b68a80 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b68ac0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b68b60 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe0037b68bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b68bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b68bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100125 td 0xfffffe00d6098500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d7424a70 mi_switch() at mi_switch+0x155/frame 0xfffffe00d7424a90 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d7424ad0 _sleep() at _sleep+0x2cd/frame 0xfffffe00d7424b70 xpt_scanner_thread() at xpt_scanner_thread+0x68/frame 0xfffffe00d7424bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d7424bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d7424bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 11 pid 19 tid 100090 td 0xfffffe003e1a7e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b59a40 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b59a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b59aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b59b40 crypto_ret_proc() at crypto_ret_proc+0x270/frame 0xfffffe0037b59bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b59bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b59bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 10 pid 18 tid 100089 td 0xfffffe003e1a8500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b54a40 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b54a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b54aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b54b40 crypto_ret_proc() at crypto_ret_proc+0x270/frame 0xfffffe0037b54bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b54bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b54bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 9 pid 17 tid 100088 td 0xfffffe003e1a8c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b4fa40 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b4fa60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b4faa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b4fb40 crypto_ret_proc() at crypto_ret_proc+0x270/frame 0xfffffe0037b4fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b4fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b4fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 8 pid 16 tid 100087 td 0xfffffe003e1a9300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b4aa40 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b4aa60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b4aaa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b4ab40 crypto_ret_proc() at crypto_ret_proc+0x270/frame 0xfffffe0037b4abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b4abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b4abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 7 pid 15 tid 100086 td 0xfffffe003e1c2800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b45a40 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b45a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b45aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b45b40 crypto_ret_proc() at crypto_ret_proc+0x270/frame 0xfffffe0037b45bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b45bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b45bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 6 pid 9 tid 100085 td 0xfffffe003e1b3000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b40a40 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b40a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b40aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b40b40 crypto_ret_proc() at crypto_ret_proc+0x270/frame 0xfffffe0037b40bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b40bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b40bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 5 pid 8 tid 100084 td 0xfffffe003e1b3700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b3ba40 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b3ba60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b3baa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b3bb40 crypto_ret_proc() at crypto_ret_proc+0x270/frame 0xfffffe0037b3bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b3bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b3bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 4 pid 7 tid 100083 td 0xfffffe003e1b3e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b36a40 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b36a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b36aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b36b40 crypto_ret_proc() at crypto_ret_proc+0x270/frame 0xfffffe0037b36bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b36bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b36bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 3 pid 6 tid 100082 td 0xfffffe003e1b4500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b31a40 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b31a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b31aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b31b40 crypto_ret_proc() at crypto_ret_proc+0x270/frame 0xfffffe0037b31bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b31bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b31bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 2 pid 5 tid 100081 td 0xfffffe003e1b4c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b2ca40 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b2ca60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b2caa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b2cb40 crypto_ret_proc() at crypto_ret_proc+0x270/frame 0xfffffe0037b2cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b2cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b2cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 1 pid 4 tid 100080 td 0xfffffe003e1b5300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b27a40 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b27a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b27aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b27b40 crypto_ret_proc() at crypto_ret_proc+0x270/frame 0xfffffe0037b27bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b27bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b27bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 0 pid 3 tid 100079 td 0xfffffe003e1b5a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b22a40 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b22a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b22aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b22b40 crypto_ret_proc() at crypto_ret_proc+0x270/frame 0xfffffe0037b22bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b22bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b22bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 2 tid 100078 td 0xfffffe003e1bf000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b1da70 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b1da90 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b1dad0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b1db70 crypto_proc() at crypto_proc+0x25b/frame 0xfffffe0037b1dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b1dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b1dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sequencer 00 pid 14 tid 100065 td 0xfffffe003e1e5a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037adca70 mi_switch() at mi_switch+0x155/frame 0xfffffe0037adca90 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037adcad0 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037adcb30 seq_eventthread() at seq_eventthread+0x91/frame 0xfffffe0037adcbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037adcbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037adcbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100062 td 0xfffffe003e1efe00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037acda70 mi_switch() at mi_switch+0x155/frame 0xfffffe0037acda90 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037acdad0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037acdb70 g_run_events() at g_run_events+0x64/frame 0xfffffe0037acdbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037acdbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037acdbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100063 td 0xfffffe003e1e6800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037ad2a70 mi_switch() at mi_switch+0x155/frame 0xfffffe0037ad2a90 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ad2ad0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ad2b70 g_io_schedule_up() at g_io_schedule_up+0x3c/frame 0xfffffe0037ad2ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe0037ad2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ad2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ad2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100064 td 0xfffffe003e1e6100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037ad7a70 mi_switch() at mi_switch+0x155/frame 0xfffffe0037ad7a90 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ad7ad0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ad7b70 g_io_schedule_down() at g_io_schedule_down+0x4c/frame 0xfffffe0037ad7ba0 g_down_procbody() at g_down_procbody+0x5c/frame 0xfffffe0037ad7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ad7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ad7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100041 td 0xfffffe003e463e00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100045 td 0xfffffe003e462100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037a18b00 mi_switch() at mi_switch+0x155/frame 0xfffffe0037a18b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037a18bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a18bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a18bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100046 td 0xfffffe003e461a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037a1db00 mi_switch() at mi_switch+0x155/frame 0xfffffe0037a1db20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037a1dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a1dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a1dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100047 td 0xfffffe003e1ef700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037a52b00 mi_switch() at mi_switch+0x155/frame 0xfffffe0037a52b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037a52bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a52bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a52bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100048 td 0xfffffe003e1ef000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100049 td 0xfffffe003e466800 (CPU 5) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1ade00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1ade10 trap() at trap+0x56/frame 0xfffffe003e1adf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1adf20 --- trap 0x13, rip = 0xffffffff80c31669, rsp = 0xfffffe0037a5c900, rbp = 0xfffffe0037a5c930 --- witness_unlock() at witness_unlock+0x79/frame 0xfffffe0037a5c930 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe0037a5c960 ipreass_slowtimo() at ipreass_slowtimo+0x5a/frame 0xfffffe0037a5c9a0 ip_slowtimo() at ip_slowtimo+0x64/frame 0xfffffe0037a5c9d0 pfslowtimo() at pfslowtimo+0x64/frame 0xfffffe0037a5ca20 softclock_call_cc() at softclock_call_cc+0x175/frame 0xfffffe0037a5caf0 softclock() at softclock+0x8b/frame 0xfffffe0037a5cb20 ithread_loop() at ithread_loop+0x279/frame 0xfffffe0037a5cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a5cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a5cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100050 td 0xfffffe003e466100 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100051 td 0xfffffe003e465a00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100052 td 0xfffffe003e465300 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100053 td 0xfffffe003e464c00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100054 td 0xfffffe003e464500 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100055 td 0xfffffe003e1e3000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100056 td 0xfffffe003e1f2800 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100057 td 0xfffffe003e1f2100 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100058 td 0xfffffe003e1f1a00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100059 td 0xfffffe003e1f1300 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100060 td 0xfffffe003e1f0c00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100094 td 0xfffffe003e4b5c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b6db00 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b6db20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037b6dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b6dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b6dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100095 td 0xfffffe003e4b5500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b72b00 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b72b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037b72bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b72bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b72bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100101 td 0xfffffe003e1a9a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b90b00 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b90b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037b90bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b90bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b90bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100112 td 0xfffffe00d2e1ba00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100113 td 0xfffffe00d2e1b300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037bd8b00 mi_switch() at mi_switch+0x155/frame 0xfffffe0037bd8b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037bd8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bd8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bd8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100176 td 0xfffffe00dd3fd800 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100177 td 0xfffffe00dd3f2000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100178 td 0xfffffe00d39f0800 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100179 td 0xfffffe00d39f0100 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100180 td 0xfffffe00d39efa00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100181 td 0xfffffe00e5fe2300 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100182 td 0xfffffe00e5fe1c00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100183 td 0xfffffe00e5fe1500 fork_trampoline() at fork_trampoline Tracing command idle pid 11 tid 100003 td 0xfffffe003e3e0300 (CPU 0) cpustop_handler() at cpustop_handler+0x26/frame 0xffffffff81de6aa0 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xffffffff81de6ab0 trap() at trap+0x56/frame 0xffffffff81de6bc0 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81de6bc0 --- trap 0x13, rip = 0xffffffff8102c476, rsp = 0xfffffe00add46a50, rbp = 0xfffffe00add46a50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add46a50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add46aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add46ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add46ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add46bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add46bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add46bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffffe003e3dfc00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add4bac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add4bae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add4bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add4bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add4bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffffe003e3df500 (CPU 2) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e189e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e189e10 trap() at trap+0x56/frame 0xfffffe003e189f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e189f20 --- trap 0x13, rip = 0xffffffff8102c476, rsp = 0xfffffe00add50a50, rbp = 0xfffffe00add50a50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add50a50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add50aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add50ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add50ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add50bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add50bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add50bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffffe003e3dee00 (CPU 3) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e195e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e195e10 trap() at trap+0x56/frame 0xfffffe003e195f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e195f20 --- trap 0x13, rip = 0xffffffff8102c476, rsp = 0xfffffe00add55a50, rbp = 0xfffffe00add55a50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add55a50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add55aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add55ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add55ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add55bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add55bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add55bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffffe003e3de700 (CPU 4) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1a1e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1a1e10 trap() at trap+0x56/frame 0xfffffe003e1a1f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1a1f20 --- trap 0x13, rip = 0xffffffff8102c476, rsp = 0xfffffe00add5aa50, rbp = 0xfffffe00add5aa50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add5aa50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add5aaa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add5aac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add5aae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add5abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add5abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add5abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffffe003e3de000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add5fac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add5fae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add5fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add5fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add5fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffffe003e3e8a00 (CPU 6) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1b9e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1b9e10 trap() at trap+0x56/frame 0xfffffe003e1b9f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1b9f20 --- trap 0x13, rip = 0xffffffff8102c476, rsp = 0xfffffe00add64a50, rbp = 0xfffffe00add64a50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add64a50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add64aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add64ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add64ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add64bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add64bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add64bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffffe003e3e8300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add69ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add69ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add69bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add69bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add69bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffffe003e3e7c00 (CPU 8) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1d1e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1d1e10 trap() at trap+0x56/frame 0xfffffe003e1d1f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1d1f20 --- trap 0x13, rip = 0xffffffff8102c476, rsp = 0xfffffe00add6ea50, rbp = 0xfffffe00add6ea50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add6ea50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add6eaa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add6eac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add6eae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add6ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add6ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add6ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffffe003e3e7500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add73ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add73ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add73bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add73bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add73bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffffe003e3e6e00 (CPU 10) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1e9e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1e9e10 trap() at trap+0x56/frame 0xfffffe003e1e9f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1e9f20 --- trap 0x13, rip = 0xffffffff8102c476, rsp = 0xfffffe00add78a50, rbp = 0xfffffe00add78a50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add78a50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add78aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add78ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add78ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add78bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add78bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add78bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffffe003e3e6700 (CPU 11) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1f5e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1f5e10 trap() at trap+0x56/frame 0xfffffe003e1f5f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1f5f20 --- trap 0x13, rip = 0xffffffff8102c476, rsp = 0xfffffe00add7da50, rbp = 0xfffffe00add7da50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add7da50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add7daa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add7dac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add7dae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add7dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add7dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add7dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command init pid 1 tid 100002 td 0xfffffe003e3e0a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add416e0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add41700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00add41740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00add417a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00add417b0 _sleep() at _sleep+0x2c3/frame 0xfffffe00add41850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00add418e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe00add41ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00add41bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00add41bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x2b133a, rsp = 0x7fffffffe778, rbp = 0x7fffffffe7e0 --- Tracing command audit pid 10 tid 100001 td 0xfffffe003e3e1100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add3ca90 mi_switch() at mi_switch+0x155/frame 0xfffffe00add3cab0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00add3caf0 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe00add3cb50 audit_worker() at audit_worker+0x9f/frame 0xfffffe00add3cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add3cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add3cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xffffffff81c8d740 sched_switch() at sched_switch+0x5b2/frame 0xffffffff82306c10 mi_switch() at mi_switch+0x155/frame 0xffffffff82306c30 sleepq_switch() at sleepq_switch+0x11a/frame 0xffffffff82306c70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xffffffff82306cb0 _sleep() at _sleep+0x26c/frame 0xffffffff82306d50 swapper() at swapper+0x75/frame 0xffffffff82306da0 mi_startup() at mi_startup+0x2ed/frame 0xffffffff82306df0 btext() at btext+0x2c Tracing command kernel pid 0 tid 100015 td 0xfffffe003e3e6000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add82ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add82ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00add82b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00add82b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00add82bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add82bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add82bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100016 td 0xfffffe003e3e1800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add87ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add87ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00add87b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00add87b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00add87bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add87bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add87bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100017 td 0xfffffe003e455300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add8cab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add8cad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00add8cb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00add8cb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00add8cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add8cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add8cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100018 td 0xfffffe003e454c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add91ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add91ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00add91b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00add91b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00add91bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add91bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add91bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100019 td 0xfffffe003e454500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add96ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add96ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00add96b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00add96b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00add96bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add96bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add96bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xfffffe003e453e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add9bab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add9bad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00add9bb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00add9bb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00add9bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add9bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add9bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xfffffe003e453700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00adda0ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00adda0ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00adda0b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00adda0b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00adda0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adda0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adda0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xfffffe003e453000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00adda5ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00adda5ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00adda5b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00adda5b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00adda5bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adda5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adda5bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xfffffe003e3e9800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addaaab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addaaad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addaab10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addaab80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addaabb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addaabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addaabf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xfffffe003e3e9100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addafab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addafad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addafb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addafb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addafbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addafbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addafbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xfffffe003e458c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addb4ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addb4ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addb4b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addb4b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addb4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addb4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addb4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100026 td 0xfffffe003e458500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addb9ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addb9ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addb9b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addb9b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addb9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addb9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addb9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100027 td 0xfffffe003e457e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addbeab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addbead0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addbeb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addbeb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addbebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addbebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addbebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100028 td 0xfffffe003e457700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addc3ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addc3ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addc3b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addc3b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addc3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addc3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addc3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100029 td 0xfffffe003e457000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addc8ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addc8ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addc8b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addc8b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addc8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addc8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addc8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100030 td 0xfffffe003e456800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addcdab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addcdad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addcdb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addcdb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addcdbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addcdbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addcdbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100031 td 0xfffffe003e456100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addd2ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addd2ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addd2b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addd2b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addd2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addd2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addd2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100032 td 0xfffffe003e455a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addd7ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addd7ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addd7b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addd7b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addd7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addd7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addd7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100033 td 0xfffffe003e460500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00adddcab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00adddcad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00adddcb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00adddcb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00adddcbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adddcbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adddcbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100034 td 0xfffffe003e45fe00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00adde1ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00adde1ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00adde1b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00adde1b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00adde1bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adde1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adde1bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100035 td 0xfffffe003e45f700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00adde6ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00adde6ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00adde6b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00adde6b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00adde6bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adde6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adde6bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100036 td 0xfffffe003e45f000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addebab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addebad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addebb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addebb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addebbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addebbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addebbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100037 td 0xfffffe003e45a800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addf0ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addf0ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addf0b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addf0b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addf0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addf0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addf0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100038 td 0xfffffe003e45a100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addf5ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addf5ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addf5b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addf5b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addf5bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addf5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addf5bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100039 td 0xfffffe003e459a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addfaab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addfaad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addfab10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addfab80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addfabb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addfabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addfabf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100040 td 0xfffffe003e459300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addffa80 mi_switch() at mi_switch+0x155/frame 0xfffffe00addffaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addffae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00addffb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00addffbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addffbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addffbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100042 td 0xfffffe003e463700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037a09a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037a09aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037a09ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037a09b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037a09bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a09bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a09bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100043 td 0xfffffe003e463000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037a0ea80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037a0eaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037a0eae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037a0eb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037a0ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a0ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a0ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100044 td 0xfffffe003e462800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037a13a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037a13aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037a13ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037a13b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037a13bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a13bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a13bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100061 td 0xfffffe003e1f0500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037ac8a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037ac8aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ac8ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ac8b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037ac8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ac8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ac8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100066 td 0xfffffe003e1e5300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037ae1a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037ae1aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ae1ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ae1b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037ae1bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ae1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ae1bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100067 td 0xfffffe003e1e4c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037ae6a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037ae6aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ae6ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ae6b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037ae6bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ae6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ae6bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100068 td 0xfffffe003e1e4500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037aeba80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037aebaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037aebae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037aebb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037aebbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037aebbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037aebbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100069 td 0xfffffe003e1e3e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037af0a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037af0aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037af0ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037af0b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037af0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037af0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037af0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100070 td 0xfffffe003e1e3700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037af5a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037af5aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037af5ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037af5b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037af5bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037af5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037af5bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100071 td 0xfffffe003e1c2100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037afaa80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037afaaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037afaae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037afab80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037afabb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037afabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037afabf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100072 td 0xfffffe003e1c1a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037affa80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037affaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037affae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037affb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037affbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037affbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037affbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100073 td 0xfffffe003e1c1300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b04a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b04aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b04ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b04b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037b04bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b04bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b04bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100074 td 0xfffffe003e1c0c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b09a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b09aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b09ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b09b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037b09bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b09bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b09bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100075 td 0xfffffe003e1c0500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b0ea80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b0eaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b0eae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b0eb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037b0ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b0ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b0ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100076 td 0xfffffe003e1bfe00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b13a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b13aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b13ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b13b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037b13bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b13bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b13bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100077 td 0xfffffe003e1bf700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b18a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b18aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b18ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b18b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037b18bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b18bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b18bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100114 td 0xfffffe00d2e1ac00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037bddab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037bddad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bddb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0037bddb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xef/frame 0xfffffe0037bddbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bddbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bddbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100120 td 0xfffffe00d609a800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037bfbab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037bfbad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bfbb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0037bfbb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xef/frame 0xfffffe0037bfbbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bfbbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bfbbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100121 td 0xfffffe00d609a100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d7410ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00d7410ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d7410b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00d7410b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xef/frame 0xfffffe00d7410bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d7410bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d7410bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100122 td 0xfffffe00d6099a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d7415ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00d7415ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d7415b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00d7415b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xef/frame 0xfffffe00d7415bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d7415bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d7415bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100124 td 0xfffffe00d6098c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d741fa80 mi_switch() at mi_switch+0x155/frame 0xfffffe00d741faa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d741fae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00d741fb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00d741fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d741fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d741fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:pho> show allchains chain 1: thread 101317 (pid 94785, sendfile21) is sleeping on 0xfffffe00e68e0b8c "sbwait" chain 2: thread 100148 (pid 94784, sendfile21) is sleeping on 0xfffff800038f6520 "wait" chain 3: thread 100206 (pid 93029, swap) is sleeping on 0xfffff802b939b5f0 "swread" chain 4: thread 101297 (pid 93027, swap) is sleeping on 0xfffff8029debda40 "wait" chain 5: thread 100797 (pid 93025, swap) is sleeping on 0xffffffff81cadcd5 "nanslp" chain 6: thread 100147 (pid 93004, sh) is sleeping on 0xfffff800038f6a40 "wait" chain 7: thread 100210 (pid 46096, bash) is sleeping on 0xfffff800204e32c0 "select" chain 8: thread 101263 (pid 46095, sshd) is sleeping on 0xfffff8065f23f2c0 "select" chain 9: thread 100800 (pid 46092, sshd) is sleeping on 0xfffff8042900ae40 "select" chain 10: thread 100226 (pid 2452, bash) is sleeping on 0xfffff800208b1a40 "wait" chain 11: thread 100211 (pid 2449, csh) is sleeping on 0xfffff80020a87ae8 "pause" chain 12: thread 100143 (pid 2448, su) is sleeping on 0xfffff80020660520 "wait" chain 13: thread 100205 (pid 2442, bash) is sleeping on 0xfffff8020fa09000 "wait" chain 14: thread 100216 (pid 2441, sshd) is sleeping on 0xfffff800209aadc0 "select" chain 15: thread 100159 (pid 2438, sshd) is sleeping on 0xfffff800209b9840 "select" chain 16: thread 100212 (pid 2434, csh) is sleeping on 0xfffff800170ec8b0 "ttyin" chain 17: thread 100224 (pid 2431, login) is sleeping on 0xfffff8020fed9520 "wait" chain 18: thread 100223 (pid 2430, getty) is sleeping on 0xfffff800170d34b0 "ttyin" chain 19: thread 100222 (pid 2429, getty) is sleeping on 0xfffff800201b90b0 "ttyin" chain 20: thread 100221 (pid 2428, getty) is sleeping on 0xfffff800201b98b0 "ttyin" chain 21: thread 100220 (pid 2427, getty) is sleeping on 0xfffff80003add0b0 "ttyin" chain 22: thread 100175 (pid 2426, getty) is sleeping on 0xfffff80003add8b0 "ttyin" chain 23: thread 100195 (pid 2425, getty) is sleeping on 0xfffff80003ae00b0 "ttyin" chain 24: thread 100188 (pid 2424, getty) is sleeping on 0xfffff80003ae08b0 "ttyin" chain 25: thread 100196 (pid 2423, getty) is sleeping on 0xfffff80003adf0b0 "ttyin" chain 26: thread 100142 (pid 2422, getty) is sleeping on 0xfffff80003adf8b0 "ttyin" chain 27: thread 100213 (pid 2373, cron) is sleeping on 0xffffffff81cadcd5 "nanslp" chain 28: thread 100165 (pid 2369, sshd) is sleeping on 0xfffff8011b018bc0 "select" chain 29: thread 100199 (pid 2341, powerd) is sleeping on 0xfffff800209b96c0 "select" chain 30: thread 100204 (pid 2338, ntpd) is sleeping on 0xfffff80020315c40 "select" chain 31: thread 101231 (pid 2338, ntpd) is sleeping on 0xfffff803bf289380 "usem" chain 32: thread 100146 (pid 2273, NLM: master) is sleeping on 0xfffff800037e9a60 "rpcsvc" chain 33: thread 100208 (pid 2270, rpc.statd) is sleeping on 0xfffff800209b93c0 "select" chain 34: thread 100152 (pid 2224, watchdogd) is sleeping on 0xffffffff81cadcd8 "nanslp" chain 35: thread 100145 (pid 2076, rpcbind) is sleeping on 0xfffff8002053f640 "select" chain 36: thread 100190 (pid 2066, syslogd) is sleeping on 0xfffff80020532440 "select" chain 37: thread 100167 (pid 1995, devd) is sleeping on 0xfffff80020315dc0 "select" chain 38: thread 100162 (pid 1990, dhclient) is sleeping on 0xfffff80020315ec0 "select" chain 39: thread 100163 (pid 1931, dhclient) is sleeping on 0xfffff800203180c0 "select" chain 40: thread 100155 (pid 1928, dhclient) is sleeping on 0xfffff8002032c3c0 "select" chain 41: thread 100141 (pid 34, syncer) is sleeping on 0xffffffff81d99898 "syncer" chain 42: thread 100135 (pid 33, vnlru) is sleeping on 0xfffff80020144000 "vlruwt" chain 43: thread 100130 (pid 32, bufdaemon) is sleeping on 0xffffffff81d98bc0 "qsleep" chain 44: thread 100131 (pid 32, bufspacedaemon-0) is sleeping on 0xffffffff8180aa00 "-" chain 45: thread 100132 (pid 32, bufspacedaemon-1) is sleeping on 0xffffffff81812cc0 "-" chain 46: thread 100133 (pid 32, bufspacedaemon-2) is sleeping on 0xffffffff8181af80 "-" chain 47: thread 100136 (pid 32, bufspacedaemon-3) is sleeping on 0xffffffff81823240 "-" chain 48: thread 100137 (pid 32, bufspacedaemon-4) is sleeping on 0xffffffff8182b500 "-" chain 49: thread 100139 (pid 32, bufspacedaemon-5) is sleeping on 0xffffffff818337c0 "-" chain 50: thread 100140 (pid 32, bufspacedaemon-6) is sleeping on 0xffffffff8183ba80 "-" chain 51: thread 100153 (pid 32, / worker) is sleeping on 0xfffff80003f040e8 "sdflush" chain 52: thread 100157 (pid 32, /tmp worker) is sleeping on 0xfffff800201b84e8 "sdflush" chain 53: thread 100129 (pid 31, vmdaemon) is sleeping on 0xffffffff81dbdac8 "psleep" chain 54: thread 100128 (pid 30, dom0) is sleeping on 0xffffffff81db2098 "psleep" chain 55: thread 100134 (pid 30, laundry: dom0) is sleeping on 0xffffffff8158eaf0 "laundp" chain 56: thread 100138 (pid 30, uma) is sleeping on 0xffffffff80f06cb0 "umarcl" chain 57: thread 100127 (pid 29, enc_daemon1) is sleeping on 0xfffff80004196a40 "idle" chain 58: thread 100126 (pid 28, enc_daemon0) is sleeping on 0xfffff80004195000 "idle" chain 59: thread 100123 (pid 27, rand_harvestq) is sleeping on 0xffffffff81ae18a0 "-" chain 60: thread 100119 (pid 26, sctp_iterator) is sleeping on 0xffffffff81d9c010 "waiting_for_work" chain 61: thread 100118 (pid 25, soaiod4) is sleeping on 0xffffffff81d984ec "-" chain 62: thread 100117 (pid 24, soaiod3) is sleeping on 0xffffffff81d984ec "-" chain 63: thread 100116 (pid 23, soaiod2) is sleeping on 0xffffffff81d984ec "-" chain 64: thread 100115 (pid 22, soaiod1) is sleeping on 0xffffffff81d984ec "-" chain 65: thread 100096 (pid 21, usbus0) is sleeping on 0xfffffe00d2d84440 "-" chain 66: thread 100097 (pid 21, usbus0) is sleeping on 0xfffffe00d2d84498 "-" chain 67: thread 100098 (pid 21, usbus0) is sleeping on 0xfffffe00d2d844f0 "-" chain 68: thread 100099 (pid 21, usbus0) is sleeping on 0xfffffe00d2d84548 "-" chain 69: thread 100100 (pid 21, usbus0) is sleeping on 0xfffffe00d2d845a0 "-" chain 70: thread 100102 (pid 21, usbus1) is sleeping on 0xfffffe003e4a2cf0 "-" chain 71: thread 100103 (pid 21, usbus1) is sleeping on 0xfffffe003e4a2d48 "-" chain 72: thread 100104 (pid 21, usbus1) is sleeping on 0xfffffe003e4a2da0 "-" chain 73: thread 100105 (pid 21, usbus1) is sleeping on 0xfffffe003e4a2df8 "-" chain 74: thread 100106 (pid 21, usbus1) is sleeping on 0xfffffe003e4a2e50 "-" chain 75: thread 100107 (pid 21, usbus2) is sleeping on 0xfffffe00d2e23cf0 "-" chain 76: thread 100108 (pid 21, usbus2) is sleeping on 0xfffffe00d2e23d48 "-" chain 77: thread 100109 (pid 21, usbus2) is sleeping on 0xfffffe00d2e23da0 "-" chain 78: thread 100110 (pid 21, usbus2) is sleeping on 0xfffffe00d2e23df8 "-" chain 79: thread 100111 (pid 21, usbus2) is sleeping on 0xfffffe00d2e23e50 "-" chain 80: thread 100091 (pid 20, doneq0) is sleeping on 0xffffffff819b95c0 "-" chain 81: thread 100093 (pid 20, doneq2) is sleeping on 0xffffffff819b96c0 "-" chain 82: thread 100125 (pid 20, scanner) is sleeping on 0xffffffff819b9490 "-" chain 83: thread 100090 (pid 19, crypto returns 11) is sleeping on 0xfffff80003b10c50 "crypto_ret_wait" chain 84: thread 100089 (pid 18, crypto returns 10) is sleeping on 0xfffff80003b10bf0 "crypto_ret_wait" chain 85: thread 100088 (pid 17, crypto returns 9) is sleeping on 0xfffff80003b10b90 "crypto_ret_wait" chain 86: thread 100087 (pid 16, crypto returns 8) is sleeping on 0xfffff80003b10b30 "crypto_ret_wait" chain 87: thread 100086 (pid 15, crypto returns 7) is sleeping on 0xfffff80003b10ad0 "crypto_ret_wait" chain 88: thread 100085 (pid 9, crypto returns 6) is sleeping on 0xfffff80003b10a70 "crypto_ret_wait" chain 89: thread 100084 (pid 8, crypto returns 5) is sleeping on 0xfffff80003b10a10 "crypto_ret_wait" chain 90: thread 100083 (pid 7, crypto returns 4) is sleeping on 0xfffff80003b109b0 "crypto_ret_wait" chain 91: thread 100082 (pid 6, crypto returns 3) is sleeping on 0xfffff80003b10950 "crypto_ret_wait" chain 92: thread 100081 (pid 5, crypto returns 2) is sleeping on 0xfffff80003b108f0 "crypto_ret_wait" chain 93: thread 100080 (pid 4, crypto returns 1) is sleeping on 0xfffff80003b10890 "crypto_ret_wait" chain 94: thread 100079 (pid 3, crypto returns 0) is sleeping on 0xfffff80003b10830 "crypto_ret_wait" chain 95: thread 100078 (pid 2, crypto) is sleeping on 0xffffffff81daf7c0 "crypto_wait" chain 96: thread 100065 (pid 14, sequencer 00) is sleeping on 0xfffff80003a2d488 "seqstate" chain 97: thread 100062 (pid 13, g_event) is sleeping on 0xffffffff81c8cc80 "-" chain 98: thread 100063 (pid 13, g_up) is sleeping on 0xffffffff81c8cc88 "-" chain 99: thread 100064 (pid 13, g_down) is sleeping on 0xffffffff81c8cc90 "-" chain 100: thread 100002 (pid 1, init) is sleeping on 0xfffff800038f8000 "wait" chain 101: thread 100001 (pid 10, audit) is sleeping on 0xffffffff81dafc98 "audit_worker_cv" chain 102: thread 100000 (pid 0, swapper) is sleeping on 0xffffffff81c8d210 "swapin" chain 103: thread 100015 (pid 0, if_io_tqg_0) is sleeping on 0xfffff8000391c100 "-" chain 104: thread 100016 (pid 0, if_io_tqg_1) is sleeping on 0xfffff8000391c000 "-" chain 105: thread 100017 (pid 0, if_io_tqg_2) is sleeping on 0xfffff80003919e00 "-" chain 106: thread 100018 (pid 0, if_io_tqg_3) is sleeping on 0xfffff80003919d00 "-" chain 107: thread 100019 (pid 0, if_io_tqg_4) is sleeping on 0xfffff80003919c00 "-" chain 108: thread 100020 (pid 0, if_io_tqg_5) is sleeping on 0xfffff80003919b00 "-" chain 109: thread 100021 (pid 0, if_io_tqg_6) is sleeping on 0xfffff80003919a00 "-" chain 110: thread 100022 (pid 0, if_io_tqg_7) is sleeping on 0xfffff80003919900 "-" chain 111: thread 100023 (pid 0, if_io_tqg_8) is sleeping on 0xfffff80003919800 "-" chain 112: thread 100024 (pid 0, if_io_tqg_9) is sleeping on 0xfffff80003919700 "-" chain 113: thread 100025 (pid 0, if_io_tqg_10) is sleeping on 0xfffff80003919600 "-" chain 114: thread 100026 (pid 0, if_io_tqg_11) is sleeping on 0xfffff80003919500 "-" chain 115: thread 100027 (pid 0, if_config_tqg_0) is sleeping on 0xfffff80003919400 "-" chain 116: thread 100028 (pid 0, softirq_0) is sleeping on 0xfffff80003919300 "-" chain 117: thread 100029 (pid 0, softirq_1) is sleeping on 0xfffff80003919200 "-" chain 118: thread 100030 (pid 0, softirq_2) is sleeping on 0xfffff80003919100 "-" chain 119: thread 100031 (pid 0, softirq_3) is sleeping on 0xfffff80003919000 "-" chain 120: thread 100032 (pid 0, softirq_4) is sleeping on 0xfffff8000391ae00 "-" chain 121: thread 100033 (pid 0, softirq_5) is sleeping on 0xfffff8000391ad00 "-" chain 122: thread 100034 (pid 0, softirq_6) is sleeping on 0xfffff8000391ac00 "-" chain 123: thread 100035 (pid 0, softirq_7) is sleeping on 0xfffff8000391ab00 "-" chain 124: thread 100036 (pid 0, softirq_8) is sleeping on 0xfffff8000391aa00 "-" chain 125: thread 100037 (pid 0, softirq_9) is sleeping on 0xfffff8000391a900 "-" chain 126: thread 100038 (pid 0, softirq_10) is sleeping on 0xfffff8000391a800 "-" chain 127: thread 100039 (pid 0, softirq_11) is sleeping on 0xfffff8000391a700 "-" chain 128: thread 100040 (pid 0, thread taskq) is sleeping on 0xfffff8000393c100 "-" chain 129: thread 100042 (pid 0, aiod_kick taskq) is sleeping on 0xfffff80003939e00 "-" chain 130: thread 100043 (pid 0, in6m_free taskq) is sleeping on 0xfffff80003939d00 "-" chain 131: thread 100044 (pid 0, kqueue_ctx taskq) is sleeping on 0xfffff80003939c00 "-" chain 132: thread 100061 (pid 0, firmware taskq) is sleeping on 0xfffff80003a72300 "-" chain 133: thread 100066 (pid 0, crypto_0) is sleeping on 0xfffff80003a72200 "-" chain 134: thread 100067 (pid 0, crypto_1) is sleeping on 0xfffff80003a72200 "-" chain 135: thread 100068 (pid 0, crypto_2) is sleeping on 0xfffff80003a72200 "-" chain 136: thread 100069 (pid 0, crypto_3) is sleeping on 0xfffff80003a72200 "-" chain 137: thread 100070 (pid 0, crypto_4) is sleeping on 0xfffff80003a72200 "-" chain 138: thread 100071 (pid 0, crypto_5) is sleeping on 0xfffff80003a72200 "-" chain 139: thread 100072 (pid 0, crypto_6) is sleeping on 0xfffff80003a72200 "-" chain 140: thread 100073 (pid 0, crypto_7) is sleeping on 0xfffff80003a72200 "-" chain 141: thread 100074 (pid 0, crypto_8) is sleeping on 0xfffff80003a72200 "-" chain 142: thread 100075 (pid 0, crypto_9) is sleeping on 0xfffff80003a72200 "-" chain 143: thread 100076 (pid 0, crypto_10) is sleeping on 0xfffff80003a72200 "-" chain 144: thread 100077 (pid 0, crypto_11) is sleeping on 0xfffff80003a72200 "-" chain 145: thread 100114 (pid 0, mca taskq) is sleeping on 0xfffff80017158500 "-" chain 146: thread 100120 (pid 0, acpi_task_0) is sleeping on 0xfffff8002018f700 "-" chain 147: thread 100121 (pid 0, acpi_task_1) is sleeping on 0xfffff8002018f700 "-" chain 148: thread 100122 (pid 0, acpi_task_2) is sleeping on 0xfffff8002018f700 "-" chain 149: thread 100124 (pid 0, CAM taskq) is sleeping on 0xfffff80003a72100 "-" db:0:pho> chain 1: thread 101317 (pid 94785, sendfile21) is sleeping on 0xfffffe00e68e0b8c "sbwait" chain 2: thread 100148 (pid 94784, sendfile21) is sleeping on 0xfffff800038f6520 "wait" chain 3: thread 100206 (pid 93029, swap) is sleeping on 0xfffff802b939b5f0 "swread" chain 4: thread 101297 (pid 93027, swap) is sleeping on 0xfffff8029debda40 "wait" chain 5: thread 100797 (pid 93025, swap) is sleeping on 0xffffffff81cadcd5 "nanslp" chain 6: thread 100147 (pid 93004, sh) is sleeping on 0xfffff800038f6a40 "wait" chain 7: thread 100210 (pid 46096, bash) is sleeping on 0xfffff800204e32c0 "select" chain 8: thread 101263 (pid 46095, sshd) is sleeping on 0xfffff8065f23f2c0 "select" chain 9: thread 100800 (pid 46092, sshd) is sleeping on 0xfffff8042900ae40 "select" chain 10: thread 100226 (pid 2452, bash) is sleeping on 0xfffff800208b1a40 "wait" chain 11: thread 100211 (pid 2449, csh) is sleeping on 0xfffff80020a87ae8 "pause" chain 12: thread 100143 (pid 2448, su) is sleeping on 0xfffff80020660520 "wait" chain 13: thread 100205 (pid 2442, bash) is sleeping on 0xfffff8020fa09000 "wait" chain 14: thread 100216 (pid 2441, sshd) is sleeping on 0xfffff800209aadc0 "select" chain 15: thread 100159 (pid 2438, sshd) is sleeping on 0xfffff800209b9840 "select" chain 16: thread 100212 (pid 2434, csh) is sleeping on 0xfffff800170ec8b0 "ttyin" chain 17: thread 100224 (pid 2431, login) is sleeping on 0xfffff8020fed9520 "wait" chain 18: thread 100223 (pid 2430, getty) is sleeping on 0xfffff800170d34b0 "ttyin" chain 19: thread 100222 (pid 2429, getty) is sleeping on 0xfffff800201b90b0 "ttyin" chain 20: thread 100221 (pid 2428, getty) is sleeping on 0xfffff800201b98b0 "ttyin" chain 21: thread 100220 (pid 2427, getty) is sleeping on 0xfffff80003add0b0 "ttyin" chain 22: thread 100175 (pid 2426, getty) is sleeping on 0xfffff80003add8b0 "ttyin" chain 23: thread 100195 (pid 2425, getty) is sleeping on 0xfffff80003ae00b0 "ttyin" chain 24: thread 100188 (pid 2424, getty) is sleeping on 0xfffff80003ae08b0 "ttyin" chain 25: thread 100196 (pid 2423, getty) is sleeping on 0xfffff80003adf0b0 "ttyin" chain 26: thread 100142 (pid 2422, getty) is sleeping on 0xfffff80003adf8b0 "ttyin" chain 27: thread 100213 (pid 2373, cron) is sleeping on 0xffffffff81cadcd5 "nanslp" chain 28: thread 100165 (pid 2369, sshd) is sleeping on 0xfffff8011b018bc0 "select" chain 29: thread 100199 (pid 2341, powerd) is sleeping on 0xfffff800209b96c0 "select" chain 30: thread 100204 (pid 2338, ntpd) is sleeping on 0xfffff80020315c40 "select" chain 31: thread 101231 (pid 2338, ntpd) is sleeping on 0xfffff803bf289380 "usem" chain 32: thread 100146 (pid 2273, NLM: master) is sleeping on 0xfffff800037e9a60 "rpcsvc" chain 33: thread 100208 (pid 2270, rpc.statd) is sleeping on 0xfffff800209b93c0 "select" chain 34: thread 100152 (pid 2224, watchdogd) is sleeping on 0xffffffff81cadcd8 "nanslp" chain 35: thread 100145 (pid 2076, rpcbind) is sleeping on 0xfffff8002053f640 "select" chain 36: thread 100190 (pid 2066, syslogd) is sleeping on 0xfffff80020532440 "select" chain 37: thread 100167 (pid 1995, devd) is sleeping on 0xfffff80020315dc0 "select" chain 38: thread 100162 (pid 1990, dhclient) is sleeping on 0xfffff80020315ec0 "select" chain 39: thread 100163 (pid 1931, dhclient) is sleeping on 0xfffff800203180c0 "select" chain 40: thread 100155 (pid 1928, dhclient) is sleeping on 0xfffff8002032c3c0 "select" chain 41: thread 100141 (pid 34, syncer) is sleeping on 0xffffffff81d99898 "syncer" chain 42: thread 100135 (pid 33, vnlru) is sleeping on 0xfffff80020144000 "vlruwt" chain 43: thread 100130 (pid 32, bufdaemon) is sleeping on 0xffffffff81d98bc0 "qsleep" chain 44: thread 100131 (pid 32, bufspacedaemon-0) is sleeping on 0xffffffff8180aa00 "-" chain 45: thread 100132 (pid 32, bufspacedaemon-1) is sleeping on 0xffffffff81812cc0 "-" chain 46: thread 100133 (pid 32, bufspacedaemon-2) is sleeping on 0xffffffff8181af80 "-" chain 47: thread 100136 (pid 32, bufspacedaemon-3) is sleeping on 0xffffffff81823240 "-" chain 48: thread 100137 (pid 32, bufspacedaemon-4) is sleeping on 0xffffffff8182b500 "-" chain 49: thread 100139 (pid 32, bufspacedaemon-5) is sleeping on 0xffffffff818337c0 "-" chain 50: thread 100140 (pid 32, bufspacedaemon-6) is sleeping on 0xffffffff8183ba80 "-" chain 51: thread 100153 (pid 32, / worker) is sleeping on 0xfffff80003f040e8 "sdflush" chain 52: thread 100157 (pid 32, /tmp worker) is sleeping on 0xfffff800201b84e8 "sdflush" chain 53: thread 100129 (pid 31, vmdaemon) is sleeping on 0xffffffff81dbdac8 "psleep" chain 54: thread 100128 (pid 30, dom0) is sleeping on 0xffffffff81db2098 "psleep" chain 55: thread 100134 (pid 30, laundry: dom0) is sleeping on 0xffffffff8158eaf0 "laundp" chain 56: thread 100138 (pid 30, uma) is sleeping on 0xffffffff80f06cb0 "umarcl" chain 57: thread 100127 (pid 29, enc_daemon1) is sleeping on 0xfffff80004196a40 "idle" chain 58: thread 100126 (pid 28, enc_daemon0) is sleeping on 0xfffff80004195000 "idle" chain 59: thread 100123 (pid 27, rand_harvestq) is sleeping on 0xffffffff81ae18a0 "-" chain 60: thread 100119 (pid 26, sctp_iterator) is sleeping on 0xffffffff81d9c010 "waiting_for_work" chain 61: thread 100118 (pid 25, soaiod4) is sleeping on 0xffffffff81d984ec "-" chain 62: thread 100117 (pid 24, soaiod3) is sleeping on 0xffffffff81d984ec "-" chain 63: thread 100116 (pid 23, soaiod2) is sleeping on 0xffffffff81d984ec "-" chain 64: thread 100115 (pid 22, soaiod1) is sleeping on 0xffffffff81d984ec "-" chain 65: thread 100096 (pid 21, usbus0) is sleeping on 0xfffffe00d2d84440 "-" chain 66: thread 100097 (pid 21, usbus0) is sleeping on 0xfffffe00d2d84498 "-" chain 67: thread 100098 (pid 21, usbus0) is sleeping on 0xfffffe00d2d844f0 "-" chain 68: thread 100099 (pid 21, usbus0) is sleeping on 0xfffffe00d2d84548 "-" chain 69: thread 100100 (pid 21, usbus0) is sleeping on 0xfffffe00d2d845a0 "-" chain 70: thread 100102 (pid 21, usbus1) is sleeping on 0xfffffe003e4a2cf0 "-" chain 71: thread 100103 (pid 21, usbus1) is sleeping on 0xfffffe003e4a2d48 "-" chain 72: thread 100104 (pid 21, usbus1) is sleeping on 0xfffffe003e4a2da0 "-" chain 73: thread 100105 (pid 21, usbus1) is sleeping on 0xfffffe003e4a2df8 "-" chain 74: thread 100106 (pid 21, usbus1) is sleeping on 0xfffffe003e4a2e50 "-" chain 75: thread 100107 (pid 21, usbus2) is sleeping on 0xfffffe00d2e23cf0 "-" chain 76: thread 100108 (pid 21, usbus2) is sleeping on 0xfffffe00d2e23d48 "-" chain 77: thread 100109 (pid 21, usbus2) is sleeping on 0xfffffe00d2e23da0 "-" chain 78: thread 100110 (pid 21, usbus2) is sleeping on 0xfffffe00d2e23df8 "-" chain 79: thread 100111 (pid 21, usbus2) is sleeping on 0xfffffe00d2e23e50 "-" chain 80: thread 100091 (pid 20, doneq0) is sleeping on 0xffffffff819b95c0 "-" chain 81: thread 100093 (pid 20, doneq2) is sleeping on 0xffffffff819b96c0 "-" chain 82: thread 100125 (pid 20, scanner) is sleeping on 0xffffffff819b9490 "-" chain 83: thread 100090 (pid 19, crypto returns 11) is sleeping on 0xfffff80003b10c50 "crypto_ret_wait" chain 84: thread 100089 (pid 18, crypto returns 10) is sleeping on 0xfffff80003b10bf0 "crypto_ret_wait" chain 85: thread 100088 (pid 17, crypto returns 9) is sleeping on 0xfffff80003b10b90 "crypto_ret_wait" chain 86: thread 100087 (pid 16, crypto returns 8) is sleeping on 0xfffff80003b10b30 "crypto_ret_wait" chain 87: thread 100086 (pid 15, crypto returns 7) is sleeping on 0xfffff80003b10ad0 "crypto_ret_wait" chain 88: thread 100085 (pid 9, crypto returns 6) is sleeping on 0xfffff80003b10a70 "crypto_ret_wait" chain 89: thread 100084 (pid 8, crypto returns 5) is sleeping on 0xfffff80003b10a10 "crypto_ret_wait" chain 90: thread 100083 (pid 7, crypto returns 4) is sleeping on 0xfffff80003b109b0 "crypto_ret_wait" chain 91: thread 100082 (pid 6, crypto returns 3) is sleeping on 0xfffff80003b10950 "crypto_ret_wait" chain 92: thread 100081 (pid 5, crypto returns 2) is sleeping on 0xfffff80003b108f0 "crypto_ret_wait" chain 93: thread 100080 (pid 4, crypto returns 1) is sleeping on 0xfffff80003b10890 "crypto_ret_wait" chain 94: thread 100079 (pid 3, crypto returns 0) is sleeping on 0xfffff80003b10830 "crypto_ret_wait" chain 95: thread 100078 (pid 2, crypto) is sleeping on 0xffffffff81daf7c0 "crypto_wait" chain 96: thread 100065 (pid 14, sequencer 00) is sleeping on 0xfffff80003a2d488 "seqstate" chain 97: thread 100062 (pid 13, g_event) is sleeping on 0xffffffff81c8cc80 "-" chain 98: thread 100063 (pid 13, g_up) is sleeping on 0xffffffff81c8cc88 "-" chain 99: thread 100064 (pid 13, g_down) is sleeping on 0xffffffff81c8cc90 "-" chain 100: thread 100002 (pid 1, init) is sleeping on 0xfffff800038f8000 "wait" chain 101: thread 100001 (pid 10, audit) is sleeping on 0xffffffff81dafc98 "audit_worker_cv" chain 102: thread 100000 (pid 0, swapper) is sleeping on 0xffffffff81c8d210 "swapin" chain 103: thread 100015 (pid 0, if_io_tqg_0) is sleeping on 0xfffff8000391c100 "-" chain 104: thread 100016 (pid 0, if_io_tqg_1) is sleeping on 0xfffff8000391c000 "-" chain 105: thread 100017 (pid 0, if_io_tqg_2) is sleeping on 0xfffff80003919e00 "-" chain 106: thread 100018 (pid 0, if_io_tqg_3) is sleeping on 0xfffff80003919d00 "-" chain 107: thread 100019 (pid 0, if_io_tqg_4) is sleeping on 0xfffff80003919c00 "-" chain 108: thread 100020 (pid 0, if_io_tqg_5) is sleeping on 0xfffff80003919b00 "-" chain 109: thread 100021 (pid 0, if_io_tqg_6) is sleeping on 0xfffff80003919a00 "-" chain 110: thread 100022 (pid 0, if_io_tqg_7) is sleeping on 0xfffff80003919900 "-" chain 111: thread 100023 (pid 0, if_io_tqg_8) is sleeping on 0xfffff80003919800 "-" chain 112: thread 100024 (pid 0, if_io_tqg_9) is sleeping on 0xfffff80003919700 "-" chain 113: thread 100025 (pid 0, if_io_tqg_10) is sleeping on 0xfffff80003919600 "-" chain 114: thread 100026 (pid 0, if_io_tqg_11) is sleeping on 0xfffff80003919500 "-" chain 115: thread 100027 (pid 0, if_config_tqg_0) is sleeping on 0xfffff80003919400 "-" chain 116: thread 100028 (pid 0, softirq_0) is sleeping on 0xfffff80003919300 "-" chain 117: thread 100029 (pid 0, softirq_1) is sleeping on 0xfffff80003919200 "-" chain 118: thread 100030 (pid 0, softirq_2) is sleeping on 0xfffff80003919100 "-" chain 119: thread 100031 (pid 0, softirq_3) is sleeping on 0xfffff80003919000 "-" chain 120: thread 100032 (pid 0, softirq_4) is sleeping on 0xfffff8000391ae00 "-" chain 121: thread 100033 (pid 0, softirq_5) is sleeping on 0xfffff8000391ad00 "-" chain 122: thread 100034 (pid 0, softirq_6) is sleeping on 0xfffff8000391ac00 "-" chain 123: thread 100035 (pid 0, softirq_7) is sleeping on 0xfffff8000391ab00 "-" chain 124: thread 100036 (pid 0, softirq_8) is sleeping on 0xfffff8000391aa00 "-" chain 125: thread 100037 (pid 0, softirq_9) is sleeping on 0xfffff8000391a900 "-" chain 126: thread 100038 (pid 0, softirq_10) is sleeping on 0xfffff8000391a800 "-" chain 127: thread 100039 (pid 0, softirq_11) is sleeping on 0xfffff8000391a700 "-" chain 128: thread 100040 (pid 0, thread taskq) is sleeping on 0xfffff8000393c100 "-" chain 129: thread 100042 (pid 0, aiod_kick taskq) is sleeping on 0xfffff80003939e00 "-" chain 130: thread 100043 (pid 0, in6m_free taskq) is sleeping on 0xfffff80003939d00 "-" chain 131: thread 100044 (pid 0, kqueue_ctx taskq) is sleeping on 0xfffff80003939c00 "-" chain 132: thread 100061 (pid 0, firmware taskq) is sleeping on 0xfffff80003a72300 "-" chain 133: thread 100066 (pid 0, crypto_0) is sleeping on 0xfffff80003a72200 "-" chain 134: thread 100067 (pid 0, crypto_1) is sleeping on 0xfffff80003a72200 "-" chain 135: thread 100068 (pid 0, crypto_2) is sleeping on 0xfffff80003a72200 "-" chain 136: thread 100069 (pid 0, crypto_3) is sleeping on 0xfffff80003a72200 "-" chain 137: thread 100070 (pid 0, crypto_4) is sleeping on 0xfffff80003a72200 "-" chain 138: thread 100071 (pid 0, crypto_5) is sleeping on 0xfffff80003a72200 "-" chain 139: thread 100072 (pid 0, crypto_6) is sleeping on 0xfffff80003a72200 "-" chain 140: thread 100073 (pid 0, crypto_7) is sleeping on 0xfffff80003a72200 "-" chain 141: thread 100074 (pid 0, crypto_8) is sleeping on 0xfffff80003a72200 "-" chain 142: thread 100075 (pid 0, crypto_9) is sleeping on 0xfffff80003a72200 "-" chain 143: thread 100076 (pid 0, crypto_10) is sleeping on 0xfffff80003a72200 "-" chain 144: thread 100077 (pid 0, crypto_11) is sleeping on 0xfffff80003a72200 "-" chain 145: thread 100114 (pid 0, mca taskq) is sleeping on 0xfffff80017158500 "-" chain 146: thread 100120 (pid 0, acpi_task_0) is sleeping on 0xfffff8002018f700 "-" chain 147: thread 100121 (pid 0, acpi_task_1) is sleeping on 0xfffff8002018f700 "-" chain 148: thread 100122 (pid 0, acpi_task_2) is sleeping on 0xfffff8002018f700 "-" chain 149: thread 100124 (pid 0, CAM taskq) is sleeping on 0xfffff80003a72100 "-" db> (kgdb) bt #0 __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:55 #1 doadump (textdump=0x0) at ../../../kern/kern_shutdown.c:394 #2 0xffffffff8049b63a in db_dump (dummy=, dummy2=, dummy3=, dummy4=) at ../../../ddb/db_command.c:575 #3 0xffffffff8049b3fc in db_command (last_cmdp=, cmd_table=, dopager=0x0) at ../../../ddb/db_command.c:482 #4 0xffffffff804a0378 in db_script_exec (scriptname=, warnifnotfound=) at ../../../ddb/db_script.c:304 #5 0xffffffff8049b3fc in db_command (last_cmdp=, cmd_table=, dopager=0x0) at ../../../ddb/db_command.c:482 #6 0xffffffff804a0378 in db_script_exec (scriptname=, warnifnotfound=) at ../../../ddb/db_script.c:304 #7 0xffffffff8049b3fc in db_command (last_cmdp=, cmd_table=, dopager=0x1) at ../../../ddb/db_command.c:482 #8 0xffffffff8049b16d in db_command_loop () at ../../../ddb/db_command.c:535 #9 0xffffffff8049e388 in db_trap (type=, code=) at ../../../ddb/db_main.c:253 #10 0xffffffff80c0ebb4 in kdb_trap (type=0x3, code=0x0, tf=) at ../../../kern/subr_kdb.c:699 #11 0xffffffff8106cea8 in trap (frame=0xfffffe00e39f0890) at ../../../amd64/amd64/trap.c:578 #12 #13 kdb_enter (why=0xffffffff811fd793 "panic", msg=) at ../../../kern/subr_kdb.c:486 #14 0xffffffff80bc41ae in vpanic (fmt=, ap=) at ../../../kern/kern_shutdown.c:902 #15 0xffffffff80bc3f43 in panic (fmt=0xffffffff81c8eb68 "\241\025\034\201\377\377\377\377") at ../../../kern/kern_shutdown.c:839 #16 0xffffffff80f279ce in vm_page_relookup (object=0xfffff8075e982108, pindex=0xffffffff4d775bea) at ../../../vm/vm_page.c:1675 #17 0xffffffff80bc26b3 in sendfile_iodone (arg=0xfffff805b4909700, pa=0xfffff800204b75a8, count=0x8, error=) at ../../../kern/kern_sendfile.c:300 #18 0xffffffff80f3f1ca in vnode_pager_generic_getpages_done_async (bp=0xfffff800204b7400) at ../../../vm/vnode_pager.c:1107 #19 0xffffffff80c7dabc in bufdone (bp=0xfffff800204b7400) at ../../../kern/vfs_bio.c:4415 #20 0xffffffff80b0808e in g_io_deliver (bp=0xfffff805ade83660, error=0x0) at ../../../geom/geom_io.c:695 #21 0xffffffff806e8ff9 in md_kthread (arg=0xfffff803d7f85000) at ../../../dev/md/md.c:1250 #22 0xffffffff80b816b0 in fork_exit (callout=0xffffffff806e8da0 , arg=0xfffff803d7f85000, frame=0xfffffe00e39f0c00) at ../../../kern/kern_fork.c:1051 #23 (kgdb) f 16 #16 0xffffffff80f279ce in vm_page_relookup (object=0xfffff8075e982108, pindex=0xffffffff4d775bea) at ../../../vm/vm_page.c:1675 1675 KASSERT(m != NULL && (vm_page_busied(m) || vm_page_wired(m)) && (kgdb) l 1670 vm_page_relookup(vm_object_t object, vm_pindex_t pindex) 1671 { 1672 vm_page_t m; 1673 1674 m = vm_radix_lookup_unlocked(&object->rtree, pindex); 1675 KASSERT(m != NULL && (vm_page_busied(m) || vm_page_wired(m)) && 1676 m->object == object && m->pindex == pindex, 1677 ("vm_page_relookup: Invalid page %p", m)); 1678 return (m); 1679 } (kgdb) info loc m = (kgdb) p *object $1 = {lock = {lock_object = {lo_name = 0xffffffff81157ade "vm object", lo_flags = 0x25630000, lo_data = 0x0, lo_witness = 0xfffff8087fd75800}, rw_lock = 0x1}, object_list = {tqe_next = 0xfffff8075e982210, tqe_prev = 0xfffff8075e982020}, shadow_head = {lh_first = 0x0}, shadow_list = {le_next = 0xffffffffffffffff, le_prev = 0xffffffffffffffff}, memq = {tqh_first = 0xfffffe0016a5c310, tqh_last = 0xfffffe0015ec41b8}, rtree = {rt_root = 0xfffff804559ce1b0}, size = 0x64, domain = { dr_policy = 0x0, dr_iter = 0x0}, generation = 0x1, cleangeneration = 0x1, ref_count = 0x1, shadow_count = 0x0, memattr = 0x6, type = 0x2, flags = 0x1000, pg_color = 0x0, paging_in_progress = {__count = 0x1}, busy = {__count = 0x0}, resident_page_count = 0x38, backing_object = 0x0, backing_object_offset = 0x0, pager_object_list = {tqe_next = 0x0, tqe_prev = 0x0}, rvq = {lh_first = 0x0}, handle = 0xfffff8018cac7500, un_pager = {vnp = {vnp_size = 0x64000, writemappings = 0x0}, devp = {devp_pglist = {tqh_first = 0x64000, tqh_last = 0x0}, ops = 0x0, dev = 0x0}, sgp = {sgp_pglist = {tqh_first = 0x64000, tqh_last = 0x0}}, swp = { swp_tmpfs = 0x64000, swp_blks = {pt_root = 0x0}, writemappings = 0x0}}, cred = 0x0, charge = 0x0, umtx_data = 0x0} (kgdb) -- Test scenario: wip/sendfile21b.sh