Fatal trap 12: page fault while in kernel mode, vmcore.186 KDB: debugger backends: ddb KDB: current backend: ddb ---<>--- Copyright (c) 1992-2020 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 13.0-CURRENT #1 r359962M: Thu Apr 16 11:05:31 CEST 2020 pho@mercat1.netperf.freebsd.org:/usr/src/sys/amd64/compile/PHO amd64 FreeBSD clang version 10.0.0 (git@github.com:llvm/llvm-project.git llvmorg-10.0.0-0-gd32170dbd5b) WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. VT(vga): resolution 640x480 CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.07-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics real memory = 34359738368 (32768 MB) avail memory = 33163632640 (31627 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 12 CPUs FreeBSD/SMP: 1 package(s) x 6 core(s) x 2 hardware threads random: registering fast source Intel Secure Key RNG random: fast provider: "Intel Secure Key RNG" random: unblocking device. ioapic0 irqs 0-23 ioapic1 irqs 24-47 Launching APs: 1 5 2 10 11 9 7 8 4 3 6 Timecounter "TSC-low" frequency 1750032566 Hz quality 1000 random: entropy device external interface WARNING: Device "kbd" is Giant locked and may be deleted before FreeBSD 13.0. kbd1 at kbdmux0 000.000052 [4342] netmap_init netmap: loaded module [ath_hal] loaded nexus0 vtvga0: cryptosoft0: acpi0: acpi0: Power Button (fixed) cpu0: on acpi0 atrtc0: port 0x70-0x71,0x74-0x77 irq 8 on acpi0 atrtc0: registered as a time-of-day clock, resolution 1.000000s Event timer "RTC" frequency 32768 Hz quality 0 attimer0: port 0x40-0x43,0x50-0x53 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Event timer "HPET" frequency 14318180 Hz quality 350 Event timer "HPET1" frequency 14318180 Hz quality 340 Event timer "HPET2" frequency 14318180 Hz quality 340 Event timer "HPET3" frequency 14318180 Hz quality 340 Event timer "HPET4" frequency 14318180 Hz quality 340 Event timer "HPET5" frequency 14318180 Hz quality 340 Event timer "HPET6" frequency 14318180 Hz quality 340 Event timer "HPET7" frequency 14318180 Hz quality 340 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 pcib0: on acpi0 pci0: on pcib0 pci0: at device 11.1 (no driver attached) pci0: at device 11.2 (no driver attached) pci0: at device 16.1 (no driver attached) pci0: at device 16.6 (no driver attached) pci0: at device 18.1 (no driver attached) acpi_syscontainer0: on acpi0 acpi_syscontainer1: on acpi0 acpi_syscontainer2: on acpi0 acpi_syscontainer3: on acpi0 pcib1: port 0xcf8-0xcff on acpi0 pci1: on pcib1 pcib2: irq 26 at device 1.0 on pci1 pci2: on pcib2 pcib3: irq 32 at device 2.0 on pci1 pci3: on pcib3 pci3: at device 0.0 (no driver attached) pci3: at device 0.1 (no driver attached) pcib4: irq 40 at device 3.0 on pci1 pci4: on pcib4 pci1: at device 17.0 (no driver attached) ahci0: port 0xf110-0xf117,0xf100-0xf103,0xf0f0-0xf0f7,0xf0e0-0xf0e3,0xf020-0xf03f mem 0xfb438000-0xfb4387ff irq 16 at device 17.4 on pci1 ahci0: AHCI v1.30 with 4 6Gbps ports, Port Multiplier not supported ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahcich2: at channel 2 on ahci0 ahcich3: at channel 3 on ahci0 ahciem0: on ahci0 xhci0: mem 0xfb400000-0xfb40ffff irq 19 at device 20.0 on pci1 xhci0: 32 bytes context size, 64-bit DMA usbus0 on xhci0 usbus0: 5.0Gbps Super Speed USB v3.0 pci1: at device 22.0 (no driver attached) pci1: at device 22.1 (no driver attached) ehci0: mem 0xfb434000-0xfb4343ff irq 18 at device 26.0 on pci1 usbus1: EHCI version 1.0 usbus1 on ehci0 usbus1: 480Mbps High Speed USB v2.0 pcib5: irq 16 at device 28.0 on pci1 pci5: on pcib5 pcib6: irq 18 at device 28.2 on pci1 pci6: on pcib6 pcib7: at device 0.0 on pci6 pci7: on pcib7 vgapci0: port 0xe000-0xe07f mem 0xfa000000-0xfaffffff,0xfb000000-0xfb01ffff irq 18 at device 0.0 on pci7 vgapci0: Boot video device pcib8: irq 16 at device 28.4 on pci1 pci8: on pcib8 igb0: port 0xd020-0xd03f mem 0xfb320000-0xfb33ffff,0xfb344000-0xfb347fff irq 16 at device 0.0 on pci8 igb0: Using 1024 TX descriptors and 1024 RX descriptors igb0: queue equality override not set, nd 1024 RX descriptors igb1: queue equality override not set, capping rx_queues at 6 and tx_queues at 6 igb1: Using 6 RX queues 6 TX queues igb1: Using MSI-X interrupts with 7 vectors igb1: Ethernet address: 0c:c4:7a:a8:cd:db igb1: netmap queues/slots: TX 6/1024, RX 6/1024 ehci1: mem 0xfb433000-0xfb4333ff irq 18 at device 29.0 on pci1 usbus2: EHCI version 1.0 usbus2 on ehci1 usbus2: 480Mbps High Speed USB v2.0 isab0: at device 31.0 on pci1 isa0: on isab0 ahci1: port 0xf070-0xf077,0xf060-0xf063,0xf050-0xf057,0xf040-0xf043,0xf000-0xf01f mem 0xfb432000-0xfb4327ff irq 16 at device 31.2 on pci1 ahci1: AHCI v1.30 with 6 6Gbps ports, Port Multiplier not supported ahcich4: at channel 0 on ahci1 ahcich5: at channel 1 on ahci1 ahcich6: at channel 2 on ahci1 ahcich7: at channel 3 on ahci1 ahcich8: at channel 4 on ahci1 ahcich9: at channel 5 on ahci1 ahciem1: on ahci1 acpi_button0: on acpi0 uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0 uart1: console (115200,n,8,1) orm0: at iomem 0xc0000-0xc7fff,0xcb000-0xcbfff pnpid ORM0000 on isa0 est0: on cpu0 p4tcc0: on cpu0 NULL mp in getnewvnode(9), tag crossmp Timecounters tick every 1.000 msec Obsolete code will be removed soon: random(9) is the obsolete Park-Miller LCG from 1988 Expensive timeout(9) function: 0xffffffff804db010(0xfffffe00d2ac8000) 0.004535805 s ses0 at ahciem0 bus 0 scbus4 target 0 lun 0 ses0: SEMB S-E-S 2.00 device ses0: SEMB SES Device ses1 at ahciem1 bus 0 scbus11 target 0 lun 0 ses1: SEMB S-E-S 2.00 device ses1: SEMB SES Device ses0: pass0 in 'Slot 01', SATA Slot: scbus1 target 0 ada0 at ahcich1 bus 0 scbus1 target 0 lun 0 ada0: ACS-2 ATA SATA 3.x device ada0: Serial Number WD-WCC3F3KDDP98 ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes) ada0: Command Queueing enabled ada0: 953869MB (1953525168 512 byte sectors) ada0: quirks=0x1<4K> hwpmc: SOFT/16/64/0x67Expensive timeout(9) function: 0xffffffff80a2da20(0xffffffff818e6468) 0.007388097 s TSC/1/64/0x20 IAP/4/48/0x3ff IAF/3/48/0x67 Trying to mount root from ufs:/dev/gpt/work [rw]... WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. ugen0.1: <0x8086 XHCI root HUB> at usbus0 ugen2.1: at usbus2 uhub0 on usbus0 ugen1.1: at usbus1 uhub0: <0x8086 XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0 uhub1 on usbus2 uhub1: on usbus2 uhub2 on usbus1 uhub2: on usbus1 Starting Network: lo0 igb0 igb1. lo0: flags=8049 metric 0 mtu 16384 options=680003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x3 inet 127.0.0.1 netmask 0xff000000 groups: lo nd6 options=21 igb0: flags=8863 metric 0 mtuigb0: link state changed to UP Autoloading module: ioat.ko ioat0: mem 0xfb42c000-0xfb42ffff irq 31 at device 4.0 on pci1 ioat0: Capabilities: 2f7 ioat1: mem 0xfb428000-0xfb42bfff irq 39 at device 4.1 on pci1 ioat1: Capabilities: 2f7 ioat2: mem 0xfb424000-0xfb427fff irq 31 at device 4.2 on pci1 ioat2: Capabilities: f7 ioat3: mem 0xfb420000-0xfb423fff irq 39 at device 4.3 on pci1 ioat3: Capabilities: f7 ioat4: mem 0xfb41c000-0xfb41ffff irq 31 at device 4.4 on pci1 ioat4: Capabilities: f7 ioat5: mem 0xfb418000-0xfb41bfff irq 39 at device 4.5 on pci1 ioat5: Capabilities: f7 ioat6: mem 0xfb414000-0xfb417fff irq 31 at device 4.6 on pci1 ioat6: Capabilities: f7 ioat7: mem 0xfb410000-0xfb413fff irq 39 at device 4.7 on pci1 ioat7: Capabilities: f7 Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Starting Network: igb1. igb1: flags=8822 metric 0 mtu 1500 options=4e507bb ether 0c:c4:7a:a8:cd:db media: Ethernet autoselect status: no carrier nd6 options=29 Autoloading module: uhid.ko Autoloading module: ums.ko ums0 on uhub3 ums0: on usbus0 ums0: 3 buttons and [Z] coordinates ID=0 Starting dhclient. DHCPREQUEST on igb0 to 255.255.255.255 port 67 DHCPACK from 192.168.5.1 if_delmulti_locked: detaching ifnet instance 0xfffff800041d9800 bound to 192.168.5.171 -- renewal in 300 seconds. add host 127.0.0.1: gateway lo0 fib 0: route already in table add host ::1: gateway lo0 fib 0: route already in table add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Creating and/or trimming log files. Starting syslogd. Setting date via ntp. 16 Apr 12:25:12 ntpdate[2073]: step time server 192.168.5.1 offset -0.971581 sec Starting rpcbind. NFS access cache time=60 Updating CPU Microcode... CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.07-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab Structured Extended Features3=0x9c000400 XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics Done. Starting watchdogd. No core dumps found. Clearing /tmp (X related). Starting statd. Starting lockd. Recovering vi editor sessions:. fscklock order reversal: 1st 0xfffff800218c77e8 ufs (ufs) @ kern/vfs_mount.c:1631 2nd 0xfffff8002163a068 devfs (devfs) @ kern/vfs_subr.c:3259 stack backtrace: #0 0xffffffff80c32a21 at witness_debugger+0x71 #1 0xffffffff80b95e12 at lockmgr_lock_flags+0x172 #2 0xffffffff810ecb10 at VOP_LOCK1_APV+0x40 #3 0xffffffff80cb4fe4 at _vn_lock+0x54 #4 0xffffffff80c9fc45 at vput_final+0x135 #5 0xffffffff80ee7c21 at ffs_unmount+0x391 #6 0xffffffff80c97213 at dounmount+0x423 #7 0xffffffff80c96d99 at kern_unmount+0x2b9 #8 0xffffffff8106fcf9 at amd64_syscall+0x159 #9 0xffffffff810457b0 at fast_syscall_common+0x101 ** /dev/gpt/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 438 files, 8061 used, 1257346 free (130 frags, 157152 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** Updating motd:. Mounting late filesystems:. Security policy loaded: MAC/ntpd (mac_ntpd) Starting ntpd. Starting powerd. Configuring vt: blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting cron. Thu Apr 16 12:25 FreeBSD/amd64 (mercat1.netperf.freebsd.org) (ttyu1) login: root Apr 16 12:25:20 mercat1 login[2431]: ROOT LOGIN (root) ON ttyu1 Last login: Thu Apr 16 11:04:14 on ttyu1 FreeBSD 13.0-CURRENT (PHO) #1 r359962M: Thu Apr 16 11:05:31 CEST 2020 root@mercat1:~ # Apr 16 12:25:40 mercat1 su[2447]: pho to root on /dev/pts/0 Fatal trap 12: page fault while in kernel mode cpuid = 10; apic id = 0a fault virtual address = 0x8 fault code = supervisor read data, page not present instruction pointer = 0x20:0xffffffff80bc34c5 stack pointer = 0x0:0xfffffe00e684a540 frame pointer = 0x0:0xfffffe00e684a5c0 code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags = interrupt enabled, resume, IOPL = 0 current process = 6482 (sendfile21) trap number = 12 panic: page fault cpuid = 10 time = 1587033068 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e684a1f0 vpanic() at vpanic+0x182/frame 0xfffffe00e684a240 panic() at panic+0x43/frame 0xfffffe00e684a2a0 trap_fatal() at trap_fatal+0x387/frame 0xfffffe00e684a300 trap_pfault() at trap_pfault+0x99/frame 0xfffffe00e684a360 trap() at trap+0x2a5/frame 0xfffffe00e684a470 calltrap() at calltrap+0x8/frame 0xfffffe00e684a470 --- trap 0xc, rip = 0xffffffff80bc34c5, rsp = 0xfffffe00e684a540, rbp = 0xfffffe00e684a5c0 --- sendfile_iodone() at sendfile_iodone+0x215/frame 0xfffffe00e684a5c0 vn_sendfile() at vn_sendfile+0x1789/frame 0xfffffe00e684a970 fo_sendfile() at fo_sendfile+0x8e/frame 0xfffffe00e684aa10 sendfile() at sendfile+0x1e0/frame 0xfffffe00e684aaa0 sys_sendfile() at sys_sendfile+0x24/frame 0xfffffe00e684aad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e684abf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e684abf0 --- syscall (393, FreeBSD ELF64, sys_sendfile), rip = 0x8002ddefa, rsp = 0x7fffffffd5a8, rbp = 0x7fffffffe6f0 --- KDB: enter: panic [ thread pid 6482 tid 100237 ] Stopped at kdb_enter+0x37: movq $0,0x10c9516(%rip) db> run pho db:0:pho> set $lines 20000 db:0:pho> run pho1 db:1:pho1> dump Dumping 1585 out of 32626 MB:..2%..11%..21%..31%..41%..51%..61%..71%..81%..91% Dump complete db:1:pho1> bt Tracing pid 6482 tid 100237 td 0xfffffe00d61fc700 kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e684a1f0 vpanic() at vpanic+0x19e/frame 0xfffffe00e684a240 panic() at panic+0x43/frame 0xfffffe00e684a2a0 trap_fatal() at trap_fatal+0x387/frame 0xfffffe00e684a300 trap_pfault() at trap_pfault+0x99/frame 0xfffffe00e684a360 trap() at trap+0x2a5/frame 0xfffffe00e684a470 calltrap() at calltrap+0x8/frame 0xfffffe00e684a470 --- trap 0xc, rip = 0xffffffff80bc34c5, rsp = 0xfffffe00e684a540, rbp = 0xfffffe00e684a5c0 --- sendfile_iodone() at sendfile_iodone+0x215/frame 0xfffffe00e684a5c0 vn_sendfile() at vn_sendfile+0x1789/frame 0xfffffe00e684a970 fo_sendfile() at fo_sendfile+0x8e/frame 0xfffffe00e684aa10 sendfile() at sendfile+0x1e0/frame 0xfffffe00e684aaa0 sys_sendfile() at sys_sendfile+0x24/frame 0xfffffe00e684aad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e684abf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e684abf0 --- syscall (393, FreeBSD ELF64, sys_sendfile), rip = 0x8002ddefa, rsp = 0x7fffffffd5a8, rbp = 0x7fffffffe6f0 --- db:1:pho1> show allpcpu Current CPU: 10 cpuid = 0 dynamic pcpu = 0x97cb80 curthread = 0xfffffe00e3f14a00: pid 3461 tid 100292 critnest 0 "swap" curpcb = 0xfffffe00e3f14f10 fpcurthread = 0xfffffe00e3f14a00: pid 3461 "swap" idlethread = 0xfffffe003e3e0300: tid 100003 "idle: cpu0" self = 0xffffffff82410000 curpmap = 0xfffffe00dd3ecb08 tssp = 0xffffffff82410384 rsp0 = 0xfffffe00e6937cc0 kcr3 = 0x80000006e7d443b0 ucr3 = 0x80000006e7d41bb0 scr3 = 0x4b3126f37 gs32p = 0xffffffff82410404 ldt = 0xffffffff82410444 tss = 0xffffffff82410434 tlb gen = 410147 curvnet = 0 spin locks held: cpuid = 1 dynamic pcpu = 0xfffffe00bc7f3b80 curthread = 0xfffffe00e6243000: pid 3454 tid 100251 critnest 0 "swap" curpcb = 0xfffffe00e6243510 fpcurthread = 0xfffffe00e6243000: pid 3454 "swap" idlethread = 0xfffffe003e3dfc00: tid 100004 "idle: cpu1" self = 0xffffffff82411000 curpmap = 0xfffffe00e62334f0 tssp = 0xffffffff82411384 rsp0 = 0xfffffe00e6883cc0 kcr3 = 0x80000006e7fdb491 ucr3 = 0x8000000170e92c91 scr3 = 0x170f27d71 gs32p = 0xffffffff82411404 ldt = 0xffffffff82411444 tss = 0xffffffff82411434 tlb gen = 410153 curvnet = 0 spin locks held: cpuid = 2 dynamic pcpu = 0xfffffe00bc7ffb80 curthread = 0xfffffe00e629ba00: pid 3459 tid 100252 critnest 0 "swap" curpcb = 0xfffffe00e629bf10 fpcurthread = 0xfffffe00e629ba00: pid 3459 "swap" idlethread = 0xfffffe003e3df500: tid 100005 "idle: cpu2" self = 0xffffffff82412000 curpmap = 0xfffffe00d3df94f0 tssp = 0xffffffff82412384 rsp0 = 0xfffffe00e6888cc0 kcr3 = 0x80000006e7db053a ucr3 = 0x80000002772b6d3a scr3 = 0x170f27d45 gs32p = 0xffffffff82412404 ldt = 0xffffffff82412444 tss = 0xffffffff82412434 tlb gen = 410153 curvnet = 0 spin locks held: cpuid = 3 dynamic pcpu = 0xfffffe00bc80bb80 curthread = 0xfffffe00d39e6a00: pid 3456 tid 100288 critnest 0 "swap" curpcb = 0xfffffe00d39e6f10 fpcurthread = 0xfffffe00d39e6a00: pid 3456 "swap" idlethread = 0xfffffe003e3dee00: tid 100006 "idle: cpu3" self = 0xffffffff82413000 curpmap = 0xfffffe003e3e4b08 tssp = 0xffffffff82413384 rsp0 = 0xfffffe00e682ccc0 kcr3 = 0x800000027739952b ucr3 = 0x8000000277398d2b scr3 = 0x170f27d42 gs32p = 0xffffffff82413404 ldt = 0xffffffff82413444 tss = 0xffffffff82413434 tlb gen = 410153 curvnet = 0 spin locks held: cpuid = 4 dynamic pcpu = 0xfffffe00bc817b80 curthread = 0xfffffe00e6228700: pid 3463 tid 100294 critnest 0 "swap" curpcb = 0xfffffe00e6228c10 fpcurthread = 0xfffffe00e6228700: pid 3463 "swap" idlethread = 0xfffffe003e3de700: tid 100007 "idle: cpu4" self = 0xffffffff82414000 curpmap = 0xfffffe00e3e964f0 tssp = 0xffffffff82414384 rsp0 = 0xfffffe00e690acc0 kcr3 = 0x80000006e7ce548d ucr3 = 0x80000006e7c8cc8d scr3 = 0x170f27d2f gs32p = 0xffffffff82414404 ldt = 0xffffffff82414444 tss = 0xffffffff82414434 tlb gen = 410153 curvnet = 0 spin locks held: cpuid = 5 dynamic pcpu = 0xfffffe00bc823b80 curthread = 0xfffffe00e622c000: pid 3458 tid 100290 critnest 0 "swap" curpcb = 0xfffffe00e622c510 fpcurthread = 0xfffffe00e622c000: pid 3458 "swap" idlethread = 0xfffffe003e3de000: tid 100008 "idle: cpu5" self = 0xffffffff82415000 curpmap = 0xfffffe00e3f68120 tssp = 0xffffffff82415384 rsp0 = 0xfffffe00e690fcc0 kcr3 = 0x80000006e7dd54a8 ucr3 = 0x80000006e7de0ca8 scr3 = 0x170f27cb0 gs32p = 0xffffffff82415404 ldt = 0xffffffff82415444 tss = 0xffffffff82415434 tlb gen = 410153 curvnet = 0 spin locks held: cpuid = 6 dynamic pcpu = 0xfffffe00bc82fb80 curthread = 0xfffffe00e3f13500: pid 3464 tid 100295 critnest 0 "swap" curpcb = 0xfffffe00e3f13a10 fpcurthread = 0xfffffe00e3f13500: pid 3464 "swap" idlethread = 0xfffffe003e3e8a00: tid 100009 "idle: cpu6" self = 0xffffffff82416000 curpmap = 0xfffffe00d3dfa120 tssp = 0xffffffff82416384 rsp0 = 0xfffffe00e6928cc0 kcr3 = 0x80000002771b95af ucr3 = 0x80000002771b8daf scr3 = 0x170f27db4 gs32p = 0xffffffff82416404 ldt = 0xffffffff82416444 tss = 0xffffffff82416434 tlb gen = 410153 curvnet = 0 spin locks held: cpuid = 7 dynamic pcpu = 0xfffffe00bc83bb80 curthread = 0xfffffe00e58c8000: pid 3453 tid 100164 critnest 0 "swap" curpcb = 0xfffffe00e58c8510 fpcurthread = 0xfffffe00e58c8000: pid 3453 "swap" idlethread = 0xfffffe003e3e8300: tid 100010 "idle: cpu7" self = 0xffffffff82417000 curpmap = 0xfffffe00e3f28b08 tssp = 0xffffffff82417384 rsp0 = 0xfffffe00e3883cc0 kcr3 = 0x80000007ce069658 ucr3 = 0x80000007ce05ee58 scr3 = 0x170f27eee gs32p = 0xffffffff82417404 ldt = 0xffffffff82417444 tss = 0xffffffff82417434 tlb gen = 410153 curvnet = 0 spin locks held: cpuid = 8 dynamic pcpu = 0xfffffe00bc847b80 curthread = 0xfffffe00e6228000: pid 3460 tid 100291 critnest 0 "swap" curpcb = 0xfffffe00e6228510 fpcurthread = 0xfffffe00e6228000: pid 3460 "swap" idlethread = 0xfffffe003e3e7c00: tid 100011 "idle: cpu8" self = 0xffffffff82418000 curpmap = 0xfffffe00e3e95b08 tssp = 0xffffffff82418384 rsp0 = 0xfffffe00e683bcc0 kcr3 = 0x8000000277285389 ucr3 = 0x8000000277296b89 scr3 = 0x13a6efd16 gs32p = 0xffffffff82418404 ldt = 0xffffffff82418444 tss = 0xffffffff82418434 tlb gen = 410153 curvnet = 0 spin locks held: cpuid = 9 dynamic pcpu = 0xfffffe00bc853b80 curthread = 0xfffffe00e622f800: pid 3457 tid 100289 critnest 0 "swap" curpcb = 0xfffffe00e622fd10 fpcurthread = 0xfffffe00e622f800: pid 3457 "swap" idlethread = 0xfffffe003e3e7500: tid 100012 "idle: cpu9" self = 0xffffffff82419000 curpmap = 0xfffffe00d39ff4f0 tssp = 0xffffffff82419384 rsp0 = 0xfffffe00e6836cc0 kcr3 = 0x80000006e7dfa43e ucr3 = 0x80000006e7e0bc3e scr3 = 0x170f27c3d gs32p = 0xffffffff82419404 ldt = 0xffffffff82419444 tss = 0xffffffff82419434 tlb gen = 410153 curvnet = 0 spin locks held: cpuid = 10 dynamic pcpu = 0xfffffe00bc85fb80 curthread = 0xfffffe00d61fc700: pid 6482 tid 100237 critnest 1 "sendfile21" curpcb = 0xfffffe00d61fcc10 fpcurthread = 0xfffffe00d61fc700: pid 6482 "sendfile21" idlethread = 0xfffffe003e3e6e00: tid 100013 "idle: cpu10" self = 0xffffffff8241a000 curpmap = 0xfffffe00e624c4f0 tssp = 0xffffffff8241a384 rsp0 = 0xfffffe00e684acc0 kcr3 = 0x80000004b30517be ucr3 = 0x80000004b307afbe scr3 = 0x170f27fbf gs32p = 0xffffffff8241a404 ldt = 0xffffffff8241a444 tss = 0xffffffff8241a434 tlb gen = 410153 curvnet = 0xfffff800037c2040 spin locks held: cpuid = 11 dynamic pcpu = 0xfffffe00bc86bb80 curthread = 0xfffffe00e5be3800: pid 3462 tid 100293 critnest 0 "swap" curpcb = 0xfffffe00e5be3d10 fpcurthread = 0xfffffe00e5be3800: pid 3462 "swap" idlethread = 0xfffffe003e3e6700: tid 100014 "idle: cpu11" self = 0xffffffff8241b000 curpmap = 0xfffffe00e62a1120 tssp = 0xffffffff8241b384 rsp0 = 0xfffffe00e6919cc0 kcr3 = 0x80000006e7d01534 ucr3 = 0x80000006e7d00d34 scr3 = 0x170f27d68 gs32p = 0xffffffff8241b404 ldt = 0xffffffff8241b444 tss = 0xffffffff8241b434 tlb gen = 410153 curvnet = 0 spin locks held: db:1:pho1> show alllocks Process 6483 (sendfile21) thread 0xfffffe00e622d500 (100260) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xfffffe00e591c500) locked @ kern/uipc_sockbuf.c:419 Process 6482 (sendfile21) thread 0xfffffe00d61fc700 (100237) exclusive sx so_snd_sx (so_snd_sx) r = 0 (0xfffffe00e58c6600) locked @ kern/uipc_sockbuf.c:416 db:1:pho1> show lockedvnods Locked vnodes db:1:pho1> show mount 0xfffffe00d39de700 /dev/gpt/work on / (ufs) 0xfffffe00d39df280 devfs on /dev (devfs) 0xfffffe00e3ea0700 /dev/gpt/tmp on /tmp (ufs) 0xfffffe00e6349280 /dev/md10 on /mnt (ufs) More info: show mount db:1:pho1> show bufqueues bqempty: 97723 Buf domain 0 freebufs 14386 lofreebufs 219 hifreebufs 329 bufspace 5271552 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 671 (4390912) dirtyq count 0 (0) wakeup 0 lim 25 CPU 10, 8, 7, 7, 9, 2, 4, 10, 4, 4, 0, 11, Locked buffers: 0 space 0 Total buffers: 758 space 5271552 Buf domain 1 freebufs 14407 lofreebufs 219 hifreebufs 329 bufspace 5033984 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 695 (4562944) dirtyq count 0 (0) wakeup 0 lim 25 CPU 0, 6, 5, 5, 6, 0, 0, 0, 8, 0, 1, 0, Locked buffers: 0 space 0 Total buffers: 741 space 5033984 Buf domain 2 freebufs 13761 lofreebufs 219 hifreebufs 329 bufspace 25591808 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 1327 (24862720) dirtyq count 0 (0) wakeup 0 lim 25 CPU 4, 5, 11, 0, 9, 0, 0, 0, 0, 0, 5, 11, Locked buffers: 0 space 0 Total buffers: 1399 space 25591808 Buf domain 3 freebufs 14249 lofreebufs 219 hifreebufs 329 bufspace 9658368 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 1 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 833 (8769536) dirtyq count 1 (16384) wakeup 0 lim 25 CPU 1, 6, 10, 1, 0, 16, 0, 8, 8, 0, 0, 0, Locked buffers: 0 space 0 Total buffers: 891 space 9658368 Buf domain 4 freebufs 14371 lofreebufs 219 hifreebufs 329 bufspace 6082560 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 708 (5361664) dirtyq count 0 (0) wakeup 0 lim 25 CPU 10, 4, 8, 0, 6, 15, 0, 1, 8, 2, 0, 0, Locked buffers: 0 space 0 Total buffers: 809 space 6082560 Buf domain 5 freebufs 14371 lofreebufs 219 hifreebufs 329 bufspace 5865472 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 3 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 725 (5435392) dirtyq count 3 (98304) wakeup 0 lim 25 CPU 0, 0, 8, 7, 8, 1, 0, 1, 0, 0, 0, 9, Locked buffers: 0 space 0 Total buffers: 855 space 5865472 Buf domain 6 freebufs 12400 lofreebufs 219 hifreebufs 329 bufspace 71217152 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 7 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 2669 (69488640) dirtyq count 7 (229376) wakeup 0 lim 25 CPU 7, 7, 3, 1, 3, 13, 9, 3, 0, 2, 9, 0, Locked buffers: 0 space 0 Total buffers: 2771 space 71217152 db:1:pho1> show page vm_cnt.v_free_count: 173325 vm_cnt.v_inactive_count: 107269 vm_cnt.v_active_count: 6700528 vm_cnt.v_laundry_count: 938949 vm_cnt.v_wire_count: 203174 vm_cnt.v_free_reserved: 10644 vm_cnt.v_free_min: 51264 vm_cnt.v_free_target: 173124 vm_cnt.v_inactive_target: 259686 db:1:pho1> show pageq pq_free 173325 dom 0 page_cnt 8124099 free 173325 pq_act 6700528 pq_inact 107269 pq_laund 938949 pq_unsw 0 db:0:pho> show freepages DOMAIN: 0 FREE LIST 0: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000000 | 000000 09 (002048K) | 000000 | 000000 08 (001024K) | 000002 | 000000 07 (000512K) | 000005 | 000001 06 (000256K) | 000004 | 000001 05 (000128K) | 000007 | 000000 04 (000064K) | 000017 | 000001 03 (000032K) | 000054 | 000000 02 (000016K) | 000107 | 000000 01 (000008K) | 000272 | 000000 00 (000004K) | 000849 | 000001 FREE LIST 1: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000000 | 000000 09 (002048K) | 000000 | 000000 08 (001024K) | 000000 | 000000 07 (000512K) | 000000 | 000000 06 (000256K) | 000000 | 000000 05 (000128K) | 000000 | 000000 04 (000064K) | 000000 | 000000 03 (000032K) | 000000 | 000000 02 (000016K) | 000000 | 000000 01 (000008K) | 000000 | 000000 00 (000004K) | 000000 | 000000 db:0:pho> show uma Zone Size Used Free Requests Sleeps Bucket Total Mem XFree RADIX NODE 144 527809 9109 1179991 0 62 77316192 0 VNODE 640 62889 171 64519 0 16 40358400 0 mbuf_cluster 2048 15079 665 15183 0 247 32243712 0 FFS2 dinode 256 62763 417 63982 0 62 16174080 0 BUF TRIE 144 759 105193 6155 0 62 15257088 0 FFS inode 160 62763 437 63982 0 62 10112000 0 S VFS Cache 108 62806 950 64474 0 126 6885648 0 mbuf 256 16434 2372 60343 0 254 4814336 0 socket 904 57 2994 6063 0 247 2758104 0 mbuf_jumbo_page 4096 0 508 4 0 247 2080768 0 128 128 14349 1275 928385 0 126 1999872 0 swblk 136 12571 421 18562 0 62 1766912 0 VM OBJECT 264 6169 431 101381 0 30 1742400 0 tcpcb 1016 10 1514 15 0 247 1548384 0 4096 4096 351 17 717 0 2 1507328 0 udp_inpcb 488 20 3028 185 0 247 1487424 0 128 128 10581 1013 10783 0 126 1484032 0 256 Bucket 2048 624 58 1198 0 8 1396736 0 UMA Slabs 0 112 11208 27 11339 0 126 1258320 0 vmem btag 56 17143 1348 17143 0 254 1035496 0 32768 32768 9 18 49 0 1 884736 0 8192 8192 105 0 105 0 1 860160 0 32768 32768 25 1 29 0 1 851968 0 64 64 9489 2985 148188 0 254 798336 0 unpcb 256 24 3036 5852 0 247 783360 0 tcp_inpcb 488 10 1518 15 0 247 745664 0 16384 16384 12 33 5658 0 1 737280 0 65536 65536 2 9 60 0 1 720896 0 mbuf_packet 256 14 2780 717 0 254 715264 0 pbuf 984 0 650 0 0 0 639600 0 64 64 8634 1320 8726 0 254 637056 0 THREAD 1792 280 62 307 0 8 612864 0 65536 65536 3 6 18 0 1 589824 0 16384 16384 36 0 36 0 1 589824 0 128 Bucket 1024 253 234 17133 0 16 498688 0 65536 65536 2 5 7 0 1 458752 0 4096 4096 90 21 6486 0 2 454656 0 1024 1024 247 145 16177 0 16 401408 0 MAP ENTRY 96 2337 1737 282548 0 126 391104 0 64 64 2998 2609 3040 0 254 358848 0 DIRHASH 1024 130 198 418 0 16 335872 0 64 Bucket 512 383 273 11454 0 30 335872 0 256 256 692 553 9056 0 62 318720 0 2048 2048 19 129 25719 0 8 303104 0 128 128 1329 965 1338 0 126 293632 0 VMSPACE 2536 53 61 6449 0 4 289104 0 32 Bucket 256 157 952 4891 0 62 283904 0 2048 2048 96 40 386 0 8 278528 0 32 32 6713 1981 6777 0 254 278208 0 65536 65536 4 0 2171 0 1 262144 0 128 128 666 1380 2689 0 126 261888 0 256 256 441 564 7151 0 62 257280 0 1024 1024 28 216 3573 0 16 249856 0 512 512 149 339 5742 0 30 249856 0 16 16 13656 1844 13916 0 254 248000 0 128 128 494 1428 6449 0 126 246016 0 swpctrie 144 1260 448 1706 0 62 245952 0 PROC 1312 87 99 6483 0 8 244032 0 g_bio 408 0 570 113166 0 30 232560 0 64 64 727 2864 7934 0 254 229824 0 4096 4096 49 7 58 0 2 229376 0 ksiginfo 112 137 1843 1451 0 126 221760 0 filedesc0 1088 88 115 6484 0 8 220864 0 512 512 201 191 219 0 30 200704 0 selfd 64 105 2982 9533 0 254 197568 0 64 64 9 3078 20216 0 254 197568 0 64 64 161 2926 198 0 254 197568 0 64 64 125 2962 6669 0 254 197568 0 NAMEI 1024 0 192 234167 0 16 196608 0 16384 16384 12 0 2670 0 1 196608 0 2048 2048 5 91 5639 0 8 196608 0 128 128 209 1310 29494 0 126 194432 0 128 128 106 1413 152 0 126 194432 0 ttyoutq 256 181 569 290 0 62 192000 0 256 256 78 672 9731 0 62 192000 0 256 256 56 694 459 0 62 192000 0 512 512 54 306 194 0 30 184320 0 1024 1024 4 172 2174 0 16 180224 0 UMA Zones 2048 85 3 85 0 8 180224 0 256 256 44 646 347 0 62 176640 0 256 256 3 687 49 0 62 176640 0 256 256 37 653 622 0 62 176640 0 512 512 63 273 63 0 30 172032 0 512 512 77 259 83 0 30 172032 0 8 Bucket 80 189 1911 38465 0 126 168000 0 64 64 58 2524 156 0 254 165248 0 4096 4096 21 19 92076 0 2 163840 0 128 128 2 1269 58 0 126 162688 0 cpuset 104 27 1492 27 0 126 157976 0 4 Bucket 48 32 3076 13209 0 254 149184 0 pipe 760 6 189 2085 0 16 148200 0 routing nhops 256 7 563 15 0 62 145920 0 256 256 29 541 155 0 62 145920 0 ttyinq 160 345 530 555 0 62 140000 0 16 Bucket 144 225 726 35006 0 62 136944 0 65536 65536 2 0 2 0 1 131072 0 L VFS Cache 328 234 162 236 0 30 129888 0 rl_entry 40 111 3020 111 0 254 125240 0 ripcb 488 1 255 1 0 247 124928 0 Files 80 131 1419 66944 0 126 124000 0 SLEEPQUEUE 88 343 1065 343 0 126 123904 0 rtentry 216 12 546 15 0 62 120528 0 32 32 576 3078 22886 0 254 116928 0 8192 8192 9 5 14 0 1 114688 0 TURNSTILE 136 343 476 343 0 62 111384 0 512 512 14 202 31 0 30 110592 0 PWD 32 21 3381 16222 0 254 108864 0 2 Bucket 32 285 3117 32130 0 254 108864 0 4096 4096 16 10 25 0 2 106496 0 vnpbuf 984 0 104 1631 0 8 102336 0 udpcb 32 20 3130 185 0 254 100800 0 32 32 140 3010 258 0 254 100800 0 32 32 128 3022 2345 0 254 100800 0 32 32 307 2843 16396 0 254 100800 0 32 32 84 3066 376 0 254 100800 0 1024 1024 7 89 26 0 16 98304 0 procdesc 136 1 695 42 0 62 94656 0 syncache 168 0 528 2 0 247 88704 0 32 32 268 2378 437 0 254 84672 0 8192 8192 10 0 1670 0 1 81920 0 2048 2048 0 40 38 0 8 81920 0 8192 8192 0 9 152 0 1 73728 0 65536 65536 1 0 1 0 1 65536 0 32768 32768 0 2 8 0 1 65536 0 32768 32768 1 1 2 0 1 65536 0 32768 32768 2 0 2 0 1 65536 0 mt_stats_zone 64 433 591 433 0 254 65536 0 KMAP ENTRY 96 18 651 18 0 126 64224 0 512 512 0 120 390 0 30 61440 0 16 16 494 3006 901383 0 254 56000 0 16 16 314 2936 402 0 254 52000 0 16 16 266 2984 570 0 254 52000 0 16 16 54 3196 968 0 254 52000 0 16 16 25 3225 26 0 254 52000 0 16384 16384 0 3 12 0 1 49152 0 16384 16384 2 1 4 0 1 49152 0 2048 2048 3 21 4 0 8 49152 0 2048 2048 4 20 4 0 8 49152 0 1024 1024 7 41 7 0 16 49152 0 1024 1024 4 44 7 0 16 49152 0 512 512 8 88 6247 0 30 49152 0 64 pcpu 8 3794 2350 3799 0 254 49152 0 Mountpoints 2944 4 12 6 0 4 47104 0 16 16 296 2454 20561 0 254 44000 0 8192 8192 5 0 5 0 1 40960 0 sctp_laddr 48 0 840 4 0 254 40320 0 swrbuf 984 0 34 3559 0 2 33456 0 32768 32768 1 0 2330 0 1 32768 0 16384 16384 2 0 2 0 1 32768 0 8192 8192 4 0 4 0 1 32768 0 2048 2048 4 12 4 0 8 32768 0 1024 1024 6 26 6 0 16 32768 0 UMA Kegs 384 74 0 74 0 30 28416 0 32 32 16 866 17 0 254 28224 0 rentr 24 0 1169 4 0 254 28056 0 mt_zone 24 433 736 433 0 254 28056 0 clpbuf 984 0 24 1227 0 2 23616 0 16 16 16 1234 17 0 254 20000 0 epoch_record pcpu 256 4 60 4 0 62 16384 0 16384 16384 1 0 1 0 1 16384 0 16384 16384 1 0 1 0 1 16384 0 4096 4096 0 4 10 0 2 16384 0 4096 4096 1 3 13 0 2 16384 0 1024 1024 1 15 1 0 16 16384 0 MAP 216 2 69 2 0 62 15336 0 vmem 1856 1 7 1 0 8 14848 0 8192 8192 1 0 1 0 1 8192 0 4096 4096 1 1 1 0 2 8192 0 2048 2048 3 1 667 0 8 8192 0 SMR CPU 32 1 254 1 0 254 8160 0 SMR SHARED 24 1 254 1 0 254 6120 0 int pcpu 4 66 958 66 0 254 4096 0 UMA Slabs 1 176 11 9 11 0 62 3520 0 FFS1 dinode 128 0 0 0 0 126 0 0 udplite_inpcb 488 0 0 0 0 247 0 0 sctp_asconf_ack 48 0 0 0 0 254 0 0 sctp_asconf 40 0 0 0 0 254 0 0 sctp_stream_msg_out 112 0 0 0 0 247 0 0 sctp_readq 152 0 0 0 0 247 0 0 sctp_chunk 152 0 0 0 0 247 0 0 sctp_raddr 736 0 0 0 0 247 0 0 sctp_asoc 2288 0 0 0 0 247 0 0 sctp_ep 1280 0 0 0 0 247 0 0 tcp_log_node 120 0 0 0 0 126 0 0 tcp_log_bucket 184 0 0 0 0 62 0 0 tcp_log 408 0 0 0 0 247 0 0 tcpreass 48 0 0 0 0 254 0 0 tfo_ccache_entries 80 0 0 0 0 126 0 0 tfo 4 0 0 0 0 254 0 0 sackhole 32 0 0 0 0 254 0 0 hostcache 96 0 0 0 0 247 0 0 tcptw 88 0 0 0 0 247 0 0 ipq 56 0 0 0 0 254 0 0 IPsec SA lft_c 16 0 0 0 0 254 0 0 KNOTE 160 0 0 0 0 62 0 0 itimer 352 0 0 0 0 30 0 0 AIOLIO 280 0 0 0 0 30 0 0 AIOCB 752 0 0 0 0 16 0 0 AIOP 32 0 0 0 0 254 0 0 AIO 208 0 0 0 0 62 0 0 NCLNODE 744 0 0 0 0 16 0 0 LTS VFS Cache 368 0 0 0 0 30 0 0 STS VFS Cache 148 0 0 0 0 62 0 0 VNODEPOLL 120 0 0 0 0 126 0 0 vtnet_tx_hdr 24 0 0 0 0 254 0 0 crypto_session 72 0 0 0 0 126 0 0 cryptop 240 0 0 0 0 62 0 0 nvme_request 128 0 0 0 0 126 0 0 FPU_save_area 832 0 0 0 0 16 0 0 DMAR_MAP_ENTRY 128 0 0 0 0 126 0 0 mbuf_jumbo_16k 16384 0 0 0 0 247 0 0 mbuf_jumbo_9k 9216 0 0 0 0 247 0 0 audit_record 1280 0 0 0 0 8 0 0 domainset 40 0 0 0 0 254 0 0 MAC labels 40 0 0 0 0 254 0 0 mdpbuf 984 0 0 0 0 0 0 0 nfspbuf 984 0 0 0 0 2 0 0 swwbuf 984 0 0 10209 0 0 0 0 umtx_shm 88 0 0 0 0 126 0 0 umtx pi 96 0 0 0 0 126 0 0 rangeset pctrie nodes 144 0 0 0 0 62 0 0 65536 65536 0 0 0 0 1 0 0 65536 65536 0 0 0 0 1 0 0 32768 32768 0 0 0 0 1 0 0 32768 32768 0 0 0 0 1 0 0 8192 8192 0 0 0 0 1 0 0 fakepg 104 0 0 0 0 126 0 0 UMA Hash 256 0 0 0 0 62 0 0 db:0:pho> show umacache Zone Size Used Free Requests Bucket debugnet_mbuf_packet 2048 0 0 0 0 debugnet_mbuf_cluster 2048 -6144 0 0 0 debugnet_mbuf 256 -10240 0 0 0 kstack_cache 16384 153 3 180 1 vm pgcache 4096 77637 117 343167 10 vm pgcache 4096 137748 119 676105 7 buf free cache 984 7986 222 14807 16 buffer arena-65 65536 0 0 0 1 buffer arena-61 61440 0 0 0 1 buffer arena-57 57344 0 0 0 1 buffer arena-53 53248 0 0 0 1 buffer arena-49 49152 0 0 0 1 buffer arena-45 45056 0 0 0 1 buffer arena-40 40960 0 0 0 1 buffer arena-36 36864 0 0 0 1 buffer arena-32 32768 5034 34 5946 1 buffer arena-28 28672 0 0 0 1 buffer arena-24 24576 0 0 0 1 buffer arena-20 20480 0 0 0 1 buffer arena-16 16384 6 15 425 1 buffer arena-12 12288 0 0 0 1 buffer arena-81 8192 0 0 0 1 buffer arena-40 4096 0 0 0 2 db:0:pho> acttrace Tracing command sendfile21 pid 6482 tid 100237 td 0xfffffe00d61fc700 (CPU 10) kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e684a1f0 vpanic() at vpanic+0x19e/frame 0xfffffe00e684a240 panic() at panic+0x43/frame 0xfffffe00e684a2a0 trap_fatal() at trap_fatal+0x387/frame 0xfffffe00e684a300 trap_pfault() at trap_pfault+0x99/frame 0xfffffe00e684a360 trap() at trap+0x2a5/frame 0xfffffe00e684a470 calltrap() at calltrap+0x8/frame 0xfffffe00e684a470 --- trap 0xc, rip = 0xffffffff80bc34c5, rsp = 0xfffffe00e684a540, rbp = 0xfffffe00e684a5c0 --- sendfile_iodone() at sendfile_iodone+0x215/frame 0xfffffe00e684a5c0 vn_sendfile() at vn_sendfile+0x1789/frame 0xfffffe00e684a970 fo_sendfile() at fo_sendfile+0x8e/frame 0xfffffe00e684aa10 sendfile() at sendfile+0x1e0/frame 0xfffffe00e684aaa0 sys_sendfile() at sys_sendfile+0x24/frame 0xfffffe00e684aad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e684abf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e684abf0 --- syscall (393, FreeBSD ELF64, sys_sendfile), rip = 0x8002ddefa, rsp = 0x7fffffffd5a8, rbp = 0x7fffffffe6f0 --- Tracing command swap pid 3464 tid 100295 td 0xfffffe00e3f13500 (CPU 6) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1b9e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1b9e10 trap() at trap+0x56/frame 0xfffffe003e1b9f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1b9f20 --- trap 0x13, rip = 0x203827, rsp = 0x7fffffffe520, rbp = 0x7fffffffe540 --- Tracing command swap pid 3463 tid 100294 td 0xfffffe00e6228700 (CPU 4) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1a1e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1a1e10 trap() at trap+0x56/frame 0xfffffe003e1a1f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1a1f20 --- trap 0x13, rip = 0x203829, rsp = 0x7fffffffe520, rbp = 0x7fffffffe540 --- Tracing command swap pid 3462 tid 100293 td 0xfffffe00e5be3800 (CPU 11) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1f5e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1f5e10 trap() at trap+0x56/frame 0xfffffe003e1f5f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1f5f20 --- trap 0x13, rip = 0x203829, rsp = 0x7fffffffe520, rbp = 0x7fffffffe540 --- Tracing command swap pid 3461 tid 100292 td 0xfffffe00e3f14a00 (CPU 0) cpustop_handler() at cpustop_handler+0x26/frame 0xffffffff81de6aa0 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xffffffff81de6ab0 trap() at trap+0x56/frame 0xffffffff81de6bc0 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81de6bc0 --- trap 0x13, rip = 0x203829, rsp = 0x7fffffffe520, rbp = 0x7fffffffe540 --- Tracing command swap pid 3460 tid 100291 td 0xfffffe00e6228000 (CPU 8) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1d1e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1d1e10 trap() at trap+0x56/frame 0xfffffe003e1d1f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1d1f20 --- trap 0x13, rip = 0x203827, rsp = 0x7fffffffe520, rbp = 0x7fffffffe540 --- Tracing command swap pid 3459 tid 100252 td 0xfffffe00e629ba00 (CPU 2) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e189e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e189e10 trap() at trap+0x56/frame 0xfffffe003e189f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e189f20 --- trap 0x13, rip = 0x203827, rsp = 0x7fffffffe520, rbp = 0x7fffffffe540 --- Tracing command swap pid 3458 tid 100290 td 0xfffffe00e622c000 (CPU 5) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1ade00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1ade10 trap() at trap+0x56/frame 0xfffffe003e1adf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1adf20 --- trap 0x13, rip = 0x203827, rsp = 0x7fffffffe520, rbp = 0x7fffffffe540 --- Tracing command swap pid 3457 tid 100289 td 0xfffffe00e622f800 (CPU 9) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1dde00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1dde10 trap() at trap+0x56/frame 0xfffffe003e1ddf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1ddf20 --- trap 0x13, rip = 0x203827, rsp = 0x7fffffffe520, rbp = 0x7fffffffe540 --- Tracing command swap pid 3456 tid 100288 td 0xfffffe00d39e6a00 (CPU 3) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e195e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e195e10 trap() at trap+0x56/frame 0xfffffe003e195f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e195f20 --- trap 0x13, rip = 0x203827, rsp = 0x7fffffffe520, rbp = 0x7fffffffe540 --- Tracing command swap pid 3454 tid 100251 td 0xfffffe00e6243000 (CPU 1) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e17de00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e17de10 trap() at trap+0x56/frame 0xfffffe003e17df20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e17df20 --- trap 0x13, rip = 0x203827, rsp = 0x7fffffffe520, rbp = 0x7fffffffe540 --- Tracing command swap pid 3453 tid 100164 td 0xfffffe00e58c8000 (CPU 7) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1c5e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1c5e10 trap() at trap+0x56/frame 0xfffffe003e1c5f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1c5f20 --- trap 0x13, rip = 0x203827, rsp = 0x7fffffffe520, rbp = 0x7fffffffe540 --- db:0:pho> ps pid ppid pgrp uid state wmesg wchan cmd 6483 6482 3429 0 S+ sbwait 0xfffffe00e591c55c sendfile21 6482 6481 3429 0 R+ CPU 10 sendfile21 6481 3429 3429 0 S+ wait 0xfffff800211f4520 sendfile21 3464 3452 3429 0 R+ CPU 6 swap 3463 3452 3429 0 R+ CPU 4 swap 3462 3452 3429 0 R+ CPU 11 swap 3461 3452 3429 0 R+ CPU 0 swap 3460 3452 3429 0 R+ CPU 8 swap 3459 3452 3429 0 R+ CPU 2 swap 3458 3452 3429 0 R+ CPU 5 swap 3457 3452 3429 0 R+ CPU 9 swap 3456 3452 3429 0 R+ CPU 3 swap 3455 3452 3429 0 R+ swap 3454 3452 3429 0 R+ CPU 1 swap 3453 3452 3429 0 R+ CPU 7 swap 3452 3450 3429 0 SW+ wait 0xfffff80170ea8520 swap 3450 3429 3429 0 S+ nanslp 0xffffffff81cadcd6 swap 3445 0 0 0 DL mdwait 0xfffff80170e1c000 [md10] 3429 2449 3429 0 S+ wait 0xfffff8013a8fa000 sh 2499 2493 2499 2006 S+ select 0xfffff80021b13ac0 top 2493 2492 2493 2006 SWs+ wait 0xfffff8013a3f0520 bash 2492 2489 2489 2006 S select 0xfffff80021a683c0 sshd 2489 2369 2489 0 Ss select 0xfffff800031c8840 sshd 2449 2447 2449 0 SW+ wait 0xfffff8002192e520 bash 2447 2446 2447 0 SW+ pause 0xfffff800211f3ae8 csh 2446 2440 2446 2006 SW+ wait 0xfffff80004195a40 su 2440 2439 2440 2006 SWs+ wait 0xfffff8013a8fa520 bash 2439 2436 2436 2006 S select 0xfffff80021329dc0 sshd 2436 2369 2436 0 Ss select 0xfffff80021319d40 sshd 2432 2431 2432 0 S+ ttyin 0xfffff800170698b0 csh 2431 1 2431 0 SWs+ wait 0xfffff8013a8faa40 login 2430 1 2430 0 Ss+ ttyin 0xfffff8001706b4b0 getty 2429 1 2429 0 Ss+ ttyin 0xfffff800211444b0 getty 2428 1 2428 0 Ss+ ttyin 0xfffff80021144cb0 getty 2427 1 2427 0 Ss+ ttyin 0xfffff800210844b0 getty 2426 1 2426 0 Ss+ ttyin 0xfffff80021084cb0 getty 2425 1 2425 0 Ss+ ttyin 0xfffff800210834b0 getty 2424 1 2424 0 Ss+ ttyin 0xfffff80021083cb0 getty 2423 1 2423 0 Ss+ ttyin 0xfffff800210864b0 getty 2422 1 2422 0 Ss+ ttyin 0xfffff80021086cb0 getty 2373 1 2373 0 Ss nanslp 0xffffffff81cadcd2 cron 2369 1 2369 0 Ss select 0xfffff8003d129a40 sshd 2341 1 2341 0 Ss select 0xfffff800215665c0 powerd 2338 1 2338 123 Ss (threaded) ntpd 100202 S select 0xfffff80021a68540 ntpd 100296 S usem 0xfffff800212c4100 ntpd 2273 1 2273 0 Ss rpcsvc 0xfffff80021540460 NLM: master 2270 1 2270 0 Ss select 0xfffff8002132c040 rpc.statd 2224 1 2224 0 Ss nanslp 0xffffffff81cadcd7 watchdogd 2076 1 2076 0 Ss select 0xfffff8002132c240 rpcbind 2066 1 2066 0 Ss select 0xfffff8003d129ac0 syslogd 1995 1 1995 0 Ss select 0xfffff80021531440 devd 1990 1 1990 65 Ss select 0xfffff8002131c0c0 dhclient 1931 1 1931 0 Ss select 0xfffff800212ed040 dhclient 1928 1 1928 0 Ss select 0xfffff80021531540 dhclient 34 0 0 0 DL syncer 0xffffffff81d99898 [syncer] 33 0 0 0 DL vlruwt 0xfffff800210f2000 [vnlru] 32 0 0 0 RL (threaded) [bufdaemon] 100130 RunQ [bufdaemon] 100131 D - 0xffffffff8180aa00 [bufspacedaemon-0] 100132 D - 0xffffffff81812cc0 [bufspacedaemon-1] 100133 D - 0xffffffff8181af80 [bufspacedaemon-2] 100136 D - 0xffffffff81823240 [bufspacedaemon-3] 100137 D - 0xffffffff8182b500 [bufspacedaemon-4] 100138 D - 0xffffffff818337c0 [bufspacedaemon-5] 100139 D - 0xffffffff8183ba80 [bufspacedaemon-6] 100151 D sdflush 0xfffff800214fd8e8 [/ worker] 100206 D sdflush 0xfffff800218244e8 [/tmp worker] 31 0 0 0 DL psleep 0xffffffff81dbdac8 [vmdaemon] 30 0 0 0 DL (threaded) [pagedaemon] 100128 D psleep 0xffffffff81db2098 [dom0] 100134 D laundp 0xffffffff81590bb0 [laundry: dom0] 100141 D umarcl 0xffffffff80f08770 [uma] 29 0 0 0 DL idle 0xfffff800212b7000 [enc_daemon1] 28 0 0 0 DL idle 0xfffff800211f3520 [enc_daemon0] 27 0 0 0 DL - 0xffffffff81ae18a0 [rand_harvestq] 26 0 0 0 DL waiting 0xffffffff81d9c010 [sctp_iterator] 25 0 0 0 DL - 0xffffffff81d984ec [soaiod4] 24 0 0 0 DL - 0xffffffff81d984ec [soaiod3] 23 0 0 0 DL - 0xffffffff81d984ec [soaiod2] 22 0 0 0 DL - 0xffffffff81d984ec [soaiod1] 21 0 0 0 DL (threaded) [usb] 100096 D - 0xfffffe00d2d84440 [usbus0] 100097 D - 0xfffffe00d2d84498 [usbus0] 100098 D - 0xfffffe00d2d844f0 [usbus0] 100099 D - 0xfffffe00d2d84548 [usbus0] 100100 D - 0xfffffe00d2d845a0 [usbus0] 100102 D - 0xfffffe003e4a2cf0 [usbus1] 100103 D - 0xfffffe003e4a2d48 [usbus1] 100104 D - 0xfffffe003e4a2da0 [usbus1] 100105 D - 0xfffffe003e4a2df8 [usbus1] 100106 D - 0xfffffe003e4a2e50 [usbus1] 100107 D - 0xfffffe00d2e23cf0 [usbus2] 100108 D - 0xfffffe00d2e23d48 [usbus2] 100109 D - 0xfffffe00d2e23da0 [usbus2] 100110 D - 0xfffffe00d2e23df8 [usbus2] 100111 D - 0xfffffe00d2e23e50 [usbus2] 20 0 0 0 RL (threaded) [cam] 100091 D - 0xffffffff819b95c0 [doneq0] 100092 RunQ [doneq1] 100093 D - 0xffffffff819b96c0 [doneq2] 100125 D - 0xffffffff819b9490 [scanner] 19 0 0 0 DL crypto_ 0xfffff80003b0fc50 [crypto returns 11] 18 0 0 0 DL crypto_ 0xfffff80003b0fbf0 [crypto returns 10] 17 0 0 0 DL crypto_ 0xfffff80003b0fb90 [crypto returns 9] 16 0 0 0 DL crypto_ 0xfffff80003b0fb30 [crypto returns 8] 15 0 0 0 DL crypto_ 0xfffff80003b0fad0 [crypto returns 7] 9 0 0 0 DL crypto_ 0xfffff80003b0fa70 [crypto returns 6] 8 0 0 0 DL crypto_ 0xfffff80003b0fa10 [crypto returns 5] 7 0 0 0 DL crypto_ 0xfffff80003b0f9b0 [crypto returns 4] 6 0 0 0 DL crypto_ 0xfffff80003b0f950 [crypto returns 3] 5 0 0 0 DL crypto_ 0xfffff80003b0f8f0 [crypto returns 2] 4 0 0 0 DL crypto_ 0xfffff80003b0f890 [crypto returns 1] 3 0 0 0 DL crypto_ 0xfffff80003b0f830 [crypto returns 0] 2 0 0 0 DL crypto_ 0xffffffff81daf7c0 [crypto] 14 0 0 0 DL seqstat 0xfffff80003a2e488 [sequencer 00] 13 0 0 0 DL (threaded) [geom] 100062 D - 0xffffffff81c8cc80 [g_event] 100063 D - 0xffffffff81c8cc88 [g_up] 100064 D - 0xffffffff81c8cc90 [g_down] 12 0 0 0 WL (threaded) [intr] 100041 I [swi5: fast taskq] 100045 I [swi6: task queue] 100046 I [swi6: Giant taskq] 100047 I [swi1: netisr 0] 100048 I [swi3: vm] 100049 I [swi4: clock (0)] 100050 I [swi4: clock (1)] 100051 I [swi4: clock (2)] 100052 I [swi4: clock (3)] 100053 I [swi4: clock (4)] 100054 I [swi4: clock (5)] 100055 I [swi4: clock (6)] 100056 I [swi4: clock (7)] 100057 I [swi4: clock (8)] 100058 I [swi4: clock (9)] 100059 I [swi4: clock (10)] 100060 I [swi4: clock (11)] 100094 I [irq56: ahci0] 100095 I [irq19: xhci0] 100101 I [irq18: ehci0 ehci1] 100112 I [irq71: ahci1] 100113 I [swi0: uart uart] 100173 I [irq72: ioat0] 100174 I [irq73: ioat1] 100175 I [irq74: ioat2] 100176 I [irq75: ioat3] 100177 I [irq76: ioat4] 100178 I [irq77: ioat5] 100179 I [irq78: ioat6] 100180 I [irq79: ioat7] 11 0 0 0 RL (threaded) [idle] 100003 CanRun [idle: cpu0] 100004 CanRun [idle: cpu1] 100005 CanRun [idle: cpu2] 100006 CanRun [idle: cpu3] 100007 CanRun [idle: cpu4] 100008 CanRun [idle: cpu5] 100009 CanRun [idle: cpu6] 100010 CanRun [idle: cpu7] 100011 CanRun [idle: cpu8] 100012 CanRun [idle: cpu9] 100013 CanRun [idle: cpu10] 100014 CanRun [idle: cpu11] 1 0 1 0 SLs wait 0xfffff800038f8000 [init] 10 0 0 0 DL audit_w 0xffffffff81dafc98 [audit] 0 0 0 0 DLs (threaded) [kernel] 100000 D swapin 0xffffffff81c8d210 [swapper] 100015 D - 0xfffff8000391c100 [if_io_tqg_0] 100016 D - 0xfffff8000391c000 [if_io_tqg_1] 100017 D - 0xfffff80003919e00 [if_io_tqg_2] 100018 D - 0xfffff80003919d00 [if_io_tqg_3] 100019 D - 0xfffff80003919c00 [if_io_tqg_4] 100020 D - 0xfffff80003919b00 [if_io_tqg_5] 100021 D - 0xfffff80003919a00 [if_io_tqg_6] 100022 D - 0xfffff80003919900 [if_io_tqg_7] 100023 D - 0xfffff80003919800 [if_io_tqg_8] 100024 D - 0xfffff80003919700 [if_io_tqg_9] 100025 D - 0xfffff80003919600 [if_io_tqg_10] 100026 D - 0xfffff80003919500 [if_io_tqg_11] 100027 D - 0xfffff80003919400 [if_config_tqg_0] 100028 D - 0xfffff80003919300 [softirq_0] 100029 D - 0xfffff80003919200 [softirq_1] 100030 D - 0xfffff80003919100 [softirq_2] 100031 D - 0xfffff80003919000 [softirq_3] 100032 D - 0xfffff8000391ae00 [softirq_4] 100033 D - 0xfffff8000391ad00 [softirq_5] 100034 D - 0xfffff8000391ac00 [softirq_6] 100035 D - 0xfffff8000391ab00 [softirq_7] 100036 D - 0xfffff8000391aa00 [softirq_8] 100037 D - 0xfffff8000391a900 [softirq_9] 100038 D - 0xfffff8000391a800 [softirq_10] 100039 D - 0xfffff8000391a700 [softirq_11] 100040 D - 0xfffff8000393c100 [thread taskq] 100042 D - 0xfffff80003939e00 [aiod_kick taskq] 100043 D - 0xfffff80003939d00 [in6m_free taskq] 100044 D - 0xfffff80003939c00 [kqueue_ctx taskq] 100061 D - 0xfffff80003a6f300 [firmware taskq] 100066 D - 0xfffff80003a6f200 [crypto_0] 100067 D - 0xfffff80003a6f200 [crypto_1] 100068 D - 0xfffff80003a6f200 [crypto_2] 100069 D - 0xfffff80003a6f200 [crypto_3] 100070 D - 0xfffff80003a6f200 [crypto_4] 100071 D - 0xfffff80003a6f200 [crypto_5] 100072 D - 0xfffff80003a6f200 [crypto_6] 100073 D - 0xfffff80003a6f200 [crypto_7] 100074 D - 0xfffff80003a6f200 [crypto_8] 100075 D - 0xfffff80003a6f200 [crypto_9] 100076 D - 0xfffff80003a6f200 [crypto_10] 100077 D - 0xfffff80003a6f200 [crypto_11] 100114 D - 0xfffff80003a70e00 [mca taskq] 100120 D - 0xfffff80021131500 [acpi_task_0] 100121 D - 0xfffff80021131500 [acpi_task_1] 100122 D - 0xfffff80021131500 [acpi_task_2] 100124 D - 0xfffff80003a6f100 [CAM taskq] db:0:pho> allt Tracing command sendfile21 pid 6483 tid 100260 td 0xfffffe00e622d500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e68b07a0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e68b07c0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e68b0800 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e68b0860 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e68b0870 _sleep() at _sleep+0x2c3/frame 0xfffffe00e68b0910 sbwait() at sbwait+0x67/frame 0xfffffe00e68b0930 soreceive_generic() at soreceive_generic+0x280/frame 0xfffffe00e68b09f0 soreceive() at soreceive+0x59/frame 0xfffffe00e68b0a10 dofileread() at dofileread+0x81/frame 0xfffffe00e68b0a60 sys_read() at sys_read+0xc0/frame 0xfffffe00e68b0ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e68b0bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e68b0bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80041a81a, rsp = 0x7fffffffd5a8, rbp = 0x7fffffffe6f0 --- Tracing command sendfile21 pid 6482 tid 100237 td 0xfffffe00d61fc700 (CPU 10) kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e684a1f0 vpanic() at vpanic+0x19e/frame 0xfffffe00e684a240 panic() at panic+0x43/frame 0xfffffe00e684a2a0 trap_fatal() at trap_fatal+0x387/frame 0xfffffe00e684a300 trap_pfault() at trap_pfault+0x99/frame 0xfffffe00e684a360 trap() at trap+0x2a5/frame 0xfffffe00e684a470 calltrap() at calltrap+0x8/frame 0xfffffe00e684a470 --- trap 0xc, rip = 0xffffffff80bc34c5, rsp = 0xfffffe00e684a540, rbp = 0xfffffe00e684a5c0 --- sendfile_iodone() at sendfile_iodone+0x215/frame 0xfffffe00e684a5c0 vn_sendfile() at vn_sendfile+0x1789/frame 0xfffffe00e684a970 fo_sendfile() at fo_sendfile+0x8e/frame 0xfffffe00e684aa10 sendfile() at sendfile+0x1e0/frame 0xfffffe00e684aaa0 sys_sendfile() at sys_sendfile+0x24/frame 0xfffffe00e684aad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e684abf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e684abf0 --- syscall (393, FreeBSD ELF64, sys_sendfile), rip = 0x8002ddefa, rsp = 0x7fffffffd5a8, rbp = 0x7fffffffe6f0 --- Tracing command sendfile21 pid 6481 tid 100172 td 0xfffffe00d61fe300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e38ab6e0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e38ab700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e38ab740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e38ab7a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e38ab7b0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e38ab850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00e38ab8e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe00e38abad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e38abbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e38abbf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003aba4a, rsp = 0x7fffffffe6f8, rbp = 0x7fffffffe710 --- Tracing command swap pid 3464 tid 100295 td 0xfffffe00e3f13500 (CPU 6) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1b9e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1b9e10 trap() at trap+0x56/frame 0xfffffe003e1b9f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1b9f20 --- trap 0x13, rip = 0x203827, rsp = 0x7fffffffe520, rbp = 0x7fffffffe540 --- Tracing command swap pid 3463 tid 100294 td 0xfffffe00e6228700 (CPU 4) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1a1e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1a1e10 trap() at trap+0x56/frame 0xfffffe003e1a1f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1a1f20 --- trap 0x13, rip = 0x203829, rsp = 0x7fffffffe520, rbp = 0x7fffffffe540 --- Tracing command swap pid 3462 tid 100293 td 0xfffffe00e5be3800 (CPU 11) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1f5e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1f5e10 trap() at trap+0x56/frame 0xfffffe003e1f5f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1f5f20 --- trap 0x13, rip = 0x203829, rsp = 0x7fffffffe520, rbp = 0x7fffffffe540 --- Tracing command swap pid 3461 tid 100292 td 0xfffffe00e3f14a00 (CPU 0) cpustop_handler() at cpustop_handler+0x26/frame 0xffffffff81de6aa0 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xffffffff81de6ab0 trap() at trap+0x56/frame 0xffffffff81de6bc0 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81de6bc0 --- trap 0x13, rip = 0x203829, rsp = 0x7fffffffe520, rbp = 0x7fffffffe540 --- Tracing command swap pid 3460 tid 100291 td 0xfffffe00e6228000 (CPU 8) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1d1e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1d1e10 trap() at trap+0x56/frame 0xfffffe003e1d1f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1d1f20 --- trap 0x13, rip = 0x203827, rsp = 0x7fffffffe520, rbp = 0x7fffffffe540 --- Tracing command swap pid 3459 tid 100252 td 0xfffffe00e629ba00 (CPU 2) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e189e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e189e10 trap() at trap+0x56/frame 0xfffffe003e189f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e189f20 --- trap 0x13, rip = 0x203827, rsp = 0x7fffffffe520, rbp = 0x7fffffffe540 --- Tracing command swap pid 3458 tid 100290 td 0xfffffe00e622c000 (CPU 5) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1ade00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1ade10 trap() at trap+0x56/frame 0xfffffe003e1adf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1adf20 --- trap 0x13, rip = 0x203827, rsp = 0x7fffffffe520, rbp = 0x7fffffffe540 --- Tracing command swap pid 3457 tid 100289 td 0xfffffe00e622f800 (CPU 9) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1dde00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1dde10 trap() at trap+0x56/frame 0xfffffe003e1ddf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1ddf20 --- trap 0x13, rip = 0x203827, rsp = 0x7fffffffe520, rbp = 0x7fffffffe540 --- Tracing command swap pid 3456 tid 100288 td 0xfffffe00d39e6a00 (CPU 3) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e195e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e195e10 trap() at trap+0x56/frame 0xfffffe003e195f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e195f20 --- trap 0x13, rip = 0x203827, rsp = 0x7fffffffe520, rbp = 0x7fffffffe540 --- Tracing command swap pid 3455 tid 100257 td 0xfffffe00e622e300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e68a1720 mi_switch() at mi_switch+0x155/frame 0xfffffe00e68a1740 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e68a1780 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e68a17c0 _sleep() at _sleep+0x26c/frame 0xfffffe00e68a1860 swap_pager_getpages_locked() at swap_pager_getpages_locked+0x571/frame 0xfffffe00e68a18e0 vm_pager_get_pages() at vm_pager_get_pages+0x4f/frame 0xfffffe00e68a1930 vm_fault() at vm_fault+0x780/frame 0xfffffe00e68a1a40 vm_fault_trap() at vm_fault_trap+0x6e/frame 0xfffffe00e68a1a80 trap_pfault() at trap_pfault+0x1ee/frame 0xfffffe00e68a1ae0 trap() at trap+0x44c/frame 0xfffffe00e68a1bf0 calltrap() at calltrap+0x8/frame 0xfffffe00e68a1bf0 --- trap 0xc, rip = 0x203829, rsp = 0x7fffffffe520, rbp = 0x7fffffffe540 --- Tracing command swap pid 3454 tid 100251 td 0xfffffe00e6243000 (CPU 1) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e17de00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e17de10 trap() at trap+0x56/frame 0xfffffe003e17df20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e17df20 --- trap 0x13, rip = 0x203827, rsp = 0x7fffffffe520, rbp = 0x7fffffffe540 --- Tracing command swap pid 3453 tid 100164 td 0xfffffe00e58c8000 (CPU 7) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1c5e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1c5e10 trap() at trap+0x56/frame 0xfffffe003e1c5f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1c5f20 --- trap 0x13, rip = 0x203827, rsp = 0x7fffffffe520, rbp = 0x7fffffffe540 --- Tracing command swap pid 3452 tid 100249 td 0xfffffe00e6243e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e68796e0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e68498a0 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e68498b0 trap() at trap+0x6c/frame 0xfffffe00e68499c0 calltrap() at calltrap+0x8/frame 0xfffffe00e68499c0 --- trap 0xc, rip = 0xffffffff81042190, rsp = 0xfffffe00e6849a90, rbp = 0xfffffe00e6849b20 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe00e6849b20 db_get_value() at db_get_value+0x32/frame 0xfffffe00e6849b60 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00e6849bf0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e6849c10 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e6849cb0 db_command() at db_command+0x25c/frame 0xfffffe00e6849d80 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00e6849e20 db_command() at db_command+0x25c/frame 0xfffffe00e6849ef0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e6849f00 db_trap() at db_trap+0xe8/frame 0xfffffe00e6849f90 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00e684a000 trap() at trap+0x7b8/frame 0xfffffe00e684a110 calltrap() at calltrap+0x8/frame 0xfffffe00e684a110 --- trap 0x3, rip = 0xffffffff80c0fe07, rsp = 0xfffffe00e684a1e0, rbp = 0xfffffe00e684a1f0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e684a1f0 vpanic() at vpanic+0x19e/frame 0xfffffe00e684a240 panic() at panic+0x43/frame 0xfffffe00e684a2a0 trap_fatal() at trap_fatal+0x387/frame 0xfffffe00e684a300 trap_pfault() at trap_pfault+0x99/frame 0xfffffe00e684a360 trap() at trap+0x2a5/frame 0xfffffe00e684a470 calltrap() at calltrap+0x8/frame 0xfffffe00e684a470 --- trap 0xc, rip = 0xffffffff80bc34c5, rsp = 0xfffffe00e684a540, rbp = 0xfffffe00e684a5c0 --- sendfile_iodone() at sendfile_iodone+0x215/frame 0xfffffe00e684a5c0 vn_sendfile() at vn_sendfile+0x1789/frame 0xfffffe00e684a970 fo_sendfile() at fo_sendfile+0x8e/frame 0xfffffe00e684aa10 sendfile() at sendfile+0x1e0/frame 0xfffffe00e684aaa0 sys_sendfile() at sys_sendfile+0x24/frame 0xfffffe00e684aad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e684abf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e684abf0 --- syscall (393, FreeBSD ELF64, sys_sendfile), rip = 0x8002ddefa, rsp = 0x7fffffffd5a8, rbp = 0x7fffffffe6f0 --- *** error reading from address fffffe00e68796e8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e6849b10 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e6849b20 db_get_value() at db_get_value+0x4c/frame 0xfffffe00e6849b60 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00e6849bf0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e6849c10 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e6849cb0 db_command() at db_command+0x25c/frame 0xfffffe00e6849d80 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00e6849e20 db_command() at db_command+0x25c/frame 0xfffffe00e6849ef0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e6849f00 db_trap() at db_trap+0xe8/frame 0xfffffe00e6849f90 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00e684a000 trap() at trap+0x7b8/frame 0xfffffe00e684a110 calltrap() at calltrap+0x8/frame 0xfffffe00e684a110 --- trap 0x3, rip = 0xffffffff80c0fe07, rsp = 0xfffffe00e684a1e0, rbp = 0xfffffe00e684a1f0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e684a1f0 vpanic() at vpanic+0x19e/frame 0xfffffe00e684a240 panic() at panic+0x43/frame 0xfffffe00e684a2a0 trap_fatal() at trap_fatal+0x387/frame 0xfffffe00e684a300 trap_pfault() at trap_pfault+0x99/frame 0xfffffe00e684a360 trap() at trap+0x2a5/frame 0xfffffe00e684a470 calltrap() at calltrap+0x8/frame 0xfffffe00e684a470 --- trap 0xc, rip = 0xffffffff80bc34c5, rsp = 0xfffffe00e684a540, rbp = 0xfffffe00e684a5c0 --- sendfile_iodone() at sendfile_iodone+0x215/frame 0xfffffe00e684a5c0 vn_sendfile() at vn_sendfile+0x1789/frame 0xfffffe00e684a970 fo_sendfile() at fo_sendfile+0x8e/frame 0xfffffe00e684aa10 sendfile() at sendfile+0x1e0/frame 0xfffffe00e684aaa0 sys_sendfile() at sys_sendfile+0x24/frame 0xfffffe00e684aad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e684abf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e684abf0 --- syscall (393, FreeBSD ELF64, sys_sendfile), rip = 0x8002ddefa, rsp = 0x7fffffffd5a8, rbp = 0x7fffffffe6f0 --- Tracing command swap pid 3450 tid 100269 td 0xfffffe00e6229500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e68dd870 mi_switch() at mi_switch+0x155/frame 0xfffffe00e68dd890 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e68dd8d0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e68dd930 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e68dd970 _sleep() at _sleep+0x258/frame 0xfffffe00e68dda10 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe00e68dda90 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe00e68ddad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e68ddbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e68ddbf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003c6baa, rsp = 0x7fffffffe558, rbp = 0x7fffffffe5a0 --- Tracing command md10 pid 3445 tid 100270 td 0xfffffe00e67f1700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e68e2a50 mi_switch() at mi_switch+0x155/frame 0xfffffe00e68e2a70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e68e2ab0 _sleep() at _sleep+0x2cd/frame 0xfffffe00e68e2b50 md_kthread() at md_kthread+0xe3/frame 0xfffffe00e68e2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e68e2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e68e2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sh pid 3429 tid 100219 td 0xfffffe00e66a7000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e680e6e0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e680e700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e680e740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e680e7a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e680e7b0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e680e850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00e680e8e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe00e680ead0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e680ebf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e680ebf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ba4a, rsp = 0x7fffffffe548, rbp = 0x7fffffffe600 --- Tracing command top pid 2499 tid 100184 td 0xfffffe00d61fdc00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e3917700 mi_switch() at mi_switch+0x155/frame 0xfffffe00e3917720 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e3917760 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e39177c0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e3917800 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00e3917870 seltdwait() at seltdwait+0x6b/frame 0xfffffe00e39178b0 kern_select() at kern_select+0x87a/frame 0xfffffe00e3917a90 sys_select() at sys_select+0x56/frame 0xfffffe00e3917ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e3917bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3917bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8005087fa, rsp = 0x7fffffffe938, rbp = 0x7fffffffeb40 --- Tracing command bash pid 2493 tid 100195 td 0xfffffe00e66f4500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e39966e0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e68498a0 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e68498b0 trap() at trap+0x6c/frame 0xfffffe00e68499c0 calltrap() at calltrap+0x8/frame 0xfffffe00e68499c0 --- trap 0xc, rip = 0xffffffff81042190, rsp = 0xfffffe00e6849a90, rbp = 0xfffffe00e6849b20 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe00e6849b20 db_get_value() at db_get_value+0x32/frame 0xfffffe00e6849b60 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00e6849bf0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e6849c10 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e6849cb0 db_command() at db_command+0x25c/frame 0xfffffe00e6849d80 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00e6849e20 db_command() at db_command+0x25c/frame 0xfffffe00e6849ef0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e6849f00 db_trap() at db_trap+0xe8/frame 0xfffffe00e6849f90 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00e684a000 trap() at trap+0x7b8/frame 0xfffffe00e684a110 calltrap() at calltrap+0x8/frame 0xfffffe00e684a110 --- trap 0x3, rip = 0xffffffff80c0fe07, rsp = 0xfffffe00e684a1e0, rbp = 0xfffffe00e684a1f0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e684a1f0 vpanic() at vpanic+0x19e/frame 0xfffffe00e684a240 panic() at panic+0x43/frame 0xfffffe00e684a2a0 trap_fatal() at trap_fatal+0x387/frame 0xfffffe00e684a300 trap_pfault() at trap_pfault+0x99/frame 0xfffffe00e684a360 trap() at trap+0x2a5/frame 0xfffffe00e684a470 calltrap() at calltrap+0x8/frame 0xfffffe00e684a470 --- trap 0xc, rip = 0xffffffff80bc34c5, rsp = 0xfffffe00e684a540, rbp = 0xfffffe00e684a5c0 --- sendfile_iodone() at sendfile_iodone+0x215/frame 0xfffffe00e684a5c0 vn_sendfile() at vn_sendfile+0x1789/frame 0xfffffe00e684a970 fo_sendfile() at fo_sendfile+0x8e/frame 0xfffffe00e684aa10 sendfile() at sendfile+0x1e0/frame 0xfffffe00e684aaa0 sys_sendfile() at sys_sendfile+0x24/frame 0xfffffe00e684aad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e684abf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e684abf0 --- syscall (393, FreeBSD ELF64, sys_sendfile), rip = 0x8002ddefa, rsp = 0x7fffffffd5a8, rbp = 0x7fffffffe6f0 --- *** error reading from address fffffe00e39966e8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e6849b10 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e6849b20 db_get_value() at db_get_value+0x4c/frame 0xfffffe00e6849b60 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00e6849bf0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e6849c10 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e6849cb0 db_command() at db_command+0x25c/frame 0xfffffe00e6849d80 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00e6849e20 db_command() at db_command+0x25c/frame 0xfffffe00e6849ef0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e6849f00 db_trap() at db_trap+0xe8/frame 0xfffffe00e6849f90 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00e684a000 trap() at trap+0x7b8/frame 0xfffffe00e684a110 calltrap() at calltrap+0x8/frame 0xfffffe00e684a110 --- trap 0x3, rip = 0xffffffff80c0fe07, rsp = 0xfffffe00e684a1e0, rbp = 0xfffffe00e684a1f0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e684a1f0 vpanic() at vpanic+0x19e/frame 0xfffffe00e684a240 panic() at panic+0x43/frame 0xfffffe00e684a2a0 trap_fatal() at trap_fatal+0x387/frame 0xfffffe00e684a300 trap_pfault() at trap_pfault+0x99/frame 0xfffffe00e684a360 trap() at trap+0x2a5/frame 0xfffffe00e684a470 calltrap() at calltrap+0x8/frame 0xfffffe00e684a470 --- trap 0xc, rip = 0xffffffff80bc34c5, rsp = 0xfffffe00e684a540, rbp = 0xfffffe00e684a5c0 --- sendfile_iodone() at sendfile_iodone+0x215/frame 0xfffffe00e684a5c0 vn_sendfile() at vn_sendfile+0x1789/frame 0xfffffe00e684a970 fo_sendfile() at fo_sendfile+0x8e/frame 0xfffffe00e684aa10 sendfile() at sendfile+0x1e0/frame 0xfffffe00e684aaa0 sys_sendfile() at sys_sendfile+0x24/frame 0xfffffe00e684aad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e684abf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e684abf0 --- syscall (393, FreeBSD ELF64, sys_sendfile), rip = 0x8002ddefa, rsp = 0x7fffffffd5a8, rbp = 0x7fffffffe6f0 --- Tracing command sshd pid 2492 tid 100216 td 0xfffffe00d35cb000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e39ff740 mi_switch() at mi_switch+0x155/frame 0xfffffe00e39ff760 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e39ff7a0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e39ff800 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e39ff810 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e39ff870 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e39ff8b0 kern_select() at kern_select+0x87a/frame 0xfffffe00e39ffa90 sys_select() at sys_select+0x56/frame 0xfffffe00e39ffad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e39ffbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e39ffbf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8008e17fa, rsp = 0x7fffffffa548, rbp = 0x7fffffffa580 --- Tracing command sshd pid 2489 tid 100250 td 0xfffffe00e6243700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e687e7c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e687e7e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e687e820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e687e880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e687e890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e687e8f0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e687e930 kern_poll() at kern_poll+0x48b/frame 0xfffffe00e687eab0 sys_poll() at sys_poll+0x50/frame 0xfffffe00e687ead0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e687ebf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e687ebf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x80088500a, rsp = 0x7fffffffe5a8, rbp = 0x7fffffffe5e0 --- Tracing command bash pid 2449 tid 100154 td 0xfffffe00dd3fa700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e38456e0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e68498a0 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e68498b0 trap() at trap+0x6c/frame 0xfffffe00e68499c0 calltrap() at calltrap+0x8/frame 0xfffffe00e68499c0 --- trap 0xc, rip = 0xffffffff81042190, rsp = 0xfffffe00e6849a90, rbp = 0xfffffe00e6849b20 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe00e6849b20 db_get_value() at db_get_value+0x32/frame 0xfffffe00e6849b60 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00e6849bf0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e6849c10 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e6849cb0 db_command() at db_command+0x25c/frame 0xfffffe00e6849d80 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00e6849e20 db_command() at db_command+0x25c/frame 0xfffffe00e6849ef0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e6849f00 db_trap() at db_trap+0xe8/frame 0xfffffe00e6849f90 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00e684a000 trap() at trap+0x7b8/frame 0xfffffe00e684a110 calltrap() at calltrap+0x8/frame 0xfffffe00e684a110 --- trap 0x3, rip = 0xffffffff80c0fe07, rsp = 0xfffffe00e684a1e0, rbp = 0xfffffe00e684a1f0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e684a1f0 vpanic() at vpanic+0x19e/frame 0xfffffe00e684a240 panic() at panic+0x43/frame 0xfffffe00e684a2a0 trap_fatal() at trap_fatal+0x387/frame 0xfffffe00e684a300 trap_pfault() at trap_pfault+0x99/frame 0xfffffe00e684a360 trap() at trap+0x2a5/frame 0xfffffe00e684a470 calltrap() at calltrap+0x8/frame 0xfffffe00e684a470 --- trap 0xc, rip = 0xffffffff80bc34c5, rsp = 0xfffffe00e684a540, rbp = 0xfffffe00e684a5c0 --- sendfile_iodone() at sendfile_iodone+0x215/frame 0xfffffe00e684a5c0 vn_sendfile() at vn_sendfile+0x1789/frame 0xfffffe00e684a970 fo_sendfile() at fo_sendfile+0x8e/frame 0xfffffe00e684aa10 sendfile() at sendfile+0x1e0/frame 0xfffffe00e684aaa0 sys_sendfile() at sys_sendfile+0x24/frame 0xfffffe00e684aad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e684abf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e684abf0 --- syscall (393, FreeBSD ELF64, sys_sendfile), rip = 0x8002ddefa, rsp = 0x7fffffffd5a8, rbp = 0x7fffffffe6f0 --- *** error reading from address fffffe00e38456e8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e6849b10 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e6849b20 db_get_value() at db_get_value+0x4c/frame 0xfffffe00e6849b60 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00e6849bf0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e6849c10 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e6849cb0 db_command() at db_command+0x25c/frame 0xfffffe00e6849d80 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00e6849e20 db_command() at db_command+0x25c/frame 0xfffffe00e6849ef0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e6849f00 db_trap() at db_trap+0xe8/frame 0xfffffe00e6849f90 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00e684a000 trap() at trap+0x7b8/frame 0xfffffe00e684a110 calltrap() at calltrap+0x8/frame 0xfffffe00e684a110 --- trap 0x3, rip = 0xffffffff80c0fe07, rsp = 0xfffffe00e684a1e0, rbp = 0xfffffe00e684a1f0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e684a1f0 vpanic() at vpanic+0x19e/frame 0xfffffe00e684a240 panic() at panic+0x43/frame 0xfffffe00e684a2a0 trap_fatal() at trap_fatal+0x387/frame 0xfffffe00e684a300 trap_pfault() at trap_pfault+0x99/frame 0xfffffe00e684a360 trap() at trap+0x2a5/frame 0xfffffe00e684a470 calltrap() at calltrap+0x8/frame 0xfffffe00e684a470 --- trap 0xc, rip = 0xffffffff80bc34c5, rsp = 0xfffffe00e684a540, rbp = 0xfffffe00e684a5c0 --- sendfile_iodone() at sendfile_iodone+0x215/frame 0xfffffe00e684a5c0 vn_sendfile() at vn_sendfile+0x1789/frame 0xfffffe00e684a970 fo_sendfile() at fo_sendfile+0x8e/frame 0xfffffe00e684aa10 sendfile() at sendfile+0x1e0/frame 0xfffffe00e684aaa0 sys_sendfile() at sys_sendfile+0x24/frame 0xfffffe00e684aad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e684abf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e684abf0 --- syscall (393, FreeBSD ELF64, sys_sendfile), rip = 0x8002ddefa, rsp = 0x7fffffffd5a8, rbp = 0x7fffffffe6f0 --- Tracing command csh pid 2447 tid 100218 td 0xfffffe00e3f12e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e68098d0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e68498a0 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e68498b0 trap() at trap+0x6c/frame 0xfffffe00e68499c0 calltrap() at calltrap+0x8/frame 0xfffffe00e68499c0 --- trap 0xc, rip = 0xffffffff81042190, rsp = 0xfffffe00e6849a90, rbp = 0xfffffe00e6849b20 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe00e6849b20 db_get_value() at db_get_value+0x32/frame 0xfffffe00e6849b60 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00e6849bf0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e6849c10 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e6849cb0 db_command() at db_command+0x25c/frame 0xfffffe00e6849d80 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00e6849e20 db_command() at db_command+0x25c/frame 0xfffffe00e6849ef0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e6849f00 db_trap() at db_trap+0xe8/frame 0xfffffe00e6849f90 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00e684a000 trap() at trap+0x7b8/frame 0xfffffe00e684a110 calltrap() at calltrap+0x8/frame 0xfffffe00e684a110 --- trap 0x3, rip = 0xffffffff80c0fe07, rsp = 0xfffffe00e684a1e0, rbp = 0xfffffe00e684a1f0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e684a1f0 vpanic() at vpanic+0x19e/frame 0xfffffe00e684a240 panic() at panic+0x43/frame 0xfffffe00e684a2a0 trap_fatal() at trap_fatal+0x387/frame 0xfffffe00e684a300 trap_pfault() at trap_pfault+0x99/frame 0xfffffe00e684a360 trap() at trap+0x2a5/frame 0xfffffe00e684a470 calltrap() at calltrap+0x8/frame 0xfffffe00e684a470 --- trap 0xc, rip = 0xffffffff80bc34c5, rsp = 0xfffffe00e684a540, rbp = 0xfffffe00e684a5c0 --- sendfile_iodone() at sendfile_iodone+0x215/frame 0xfffffe00e684a5c0 vn_sendfile() at vn_sendfile+0x1789/frame 0xfffffe00e684a970 fo_sendfile() at fo_sendfile+0x8e/frame 0xfffffe00e684aa10 sendfile() at sendfile+0x1e0/frame 0xfffffe00e684aaa0 sys_sendfile() at sys_sendfile+0x24/frame 0xfffffe00e684aad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e684abf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e684abf0 --- syscall (393, FreeBSD ELF64, sys_sendfile), rip = 0x8002ddefa, rsp = 0x7fffffffd5a8, rbp = 0x7fffffffe6f0 --- *** error reading from address fffffe00e68098d8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e6849b10 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e6849b20 db_get_value() at db_get_value+0x4c/frame 0xfffffe00e6849b60 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00e6849bf0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e6849c10 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e6849cb0 db_command() at db_command+0x25c/frame 0xfffffe00e6849d80 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00e6849e20 db_command() at db_command+0x25c/frame 0xfffffe00e6849ef0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e6849f00 db_trap() at db_trap+0xe8/frame 0xfffffe00e6849f90 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00e684a000 trap() at trap+0x7b8/frame 0xfffffe00e684a110 calltrap() at calltrap+0x8/frame 0xfffffe00e684a110 --- trap 0x3, rip = 0xffffffff80c0fe07, rsp = 0xfffffe00e684a1e0, rbp = 0xfffffe00e684a1f0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e684a1f0 vpanic() at vpanic+0x19e/frame 0xfffffe00e684a240 panic() at panic+0x43/frame 0xfffffe00e684a2a0 trap_fatal() at trap_fatal+0x387/frame 0xfffffe00e684a300 trap_pfault() at trap_pfault+0x99/frame 0xfffffe00e684a360 trap() at trap+0x2a5/frame 0xfffffe00e684a470 calltrap() at calltrap+0x8/frame 0xfffffe00e684a470 --- trap 0xc, rip = 0xffffffff80bc34c5, rsp = 0xfffffe00e684a540, rbp = 0xfffffe00e684a5c0 --- sendfile_iodone() at sendfile_iodone+0x215/frame 0xfffffe00e684a5c0 vn_sendfile() at vn_sendfile+0x1789/frame 0xfffffe00e684a970 fo_sendfile() at fo_sendfile+0x8e/frame 0xfffffe00e684aa10 sendfile() at sendfile+0x1e0/frame 0xfffffe00e684aaa0 sys_sendfile() at sys_sendfile+0x24/frame 0xfffffe00e684aad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e684abf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e684abf0 --- syscall (393, FreeBSD ELF64, sys_sendfile), rip = 0x8002ddefa, rsp = 0x7fffffffd5a8, rbp = 0x7fffffffe6f0 --- Tracing command su pid 2446 tid 100197 td 0xfffffe00e673ac00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e39a06e0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e68498a0 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e68498b0 trap() at trap+0x6c/frame 0xfffffe00e68499c0 calltrap() at calltrap+0x8/frame 0xfffffe00e68499c0 --- trap 0xc, rip = 0xffffffff81042190, rsp = 0xfffffe00e6849a90, rbp = 0xfffffe00e6849b20 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe00e6849b20 db_get_value() at db_get_value+0x32/frame 0xfffffe00e6849b60 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00e6849bf0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e6849c10 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e6849cb0 db_command() at db_command+0x25c/frame 0xfffffe00e6849d80 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00e6849e20 db_command() at db_command+0x25c/frame 0xfffffe00e6849ef0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e6849f00 db_trap() at db_trap+0xe8/frame 0xfffffe00e6849f90 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00e684a000 trap() at trap+0x7b8/frame 0xfffffe00e684a110 calltrap() at calltrap+0x8/frame 0xfffffe00e684a110 --- trap 0x3, rip = 0xffffffff80c0fe07, rsp = 0xfffffe00e684a1e0, rbp = 0xfffffe00e684a1f0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e684a1f0 vpanic() at vpanic+0x19e/frame 0xfffffe00e684a240 panic() at panic+0x43/frame 0xfffffe00e684a2a0 trap_fatal() at trap_fatal+0x387/frame 0xfffffe00e684a300 trap_pfault() at trap_pfault+0x99/frame 0xfffffe00e684a360 trap() at trap+0x2a5/frame 0xfffffe00e684a470 calltrap() at calltrap+0x8/frame 0xfffffe00e684a470 --- trap 0xc, rip = 0xffffffff80bc34c5, rsp = 0xfffffe00e684a540, rbp = 0xfffffe00e684a5c0 --- sendfile_iodone() at sendfile_iodone+0x215/frame 0xfffffe00e684a5c0 vn_sendfile() at vn_sendfile+0x1789/frame 0xfffffe00e684a970 fo_sendfile() at fo_sendfile+0x8e/frame 0xfffffe00e684aa10 sendfile() at sendfile+0x1e0/frame 0xfffffe00e684aaa0 sys_sendfile() at sys_sendfile+0x24/frame 0xfffffe00e684aad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e684abf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e684abf0 --- syscall (393, FreeBSD ELF64, sys_sendfile), rip = 0x8002ddefa, rsp = 0x7fffffffd5a8, rbp = 0x7fffffffe6f0 --- *** error reading from address fffffe00e39a06e8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e6849b10 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e6849b20 db_get_value() at db_get_value+0x4c/frame 0xfffffe00e6849b60 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00e6849bf0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e6849c10 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e6849cb0 db_command() at db_command+0x25c/frame 0xfffffe00e6849d80 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00e6849e20 db_command() at db_command+0x25c/frame 0xfffffe00e6849ef0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e6849f00 db_trap() at db_trap+0xe8/frame 0xfffffe00e6849f90 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00e684a000 trap() at trap+0x7b8/frame 0xfffffe00e684a110 calltrap() at calltrap+0x8/frame 0xfffffe00e684a110 --- trap 0x3, rip = 0xffffffff80c0fe07, rsp = 0xfffffe00e684a1e0, rbp = 0xfffffe00e684a1f0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e684a1f0 vpanic() at vpanic+0x19e/frame 0xfffffe00e684a240 panic() at panic+0x43/frame 0xfffffe00e684a2a0 trap_fatal() at trap_fatal+0x387/frame 0xfffffe00e684a300 trap_pfault() at trap_pfault+0x99/frame 0xfffffe00e684a360 trap() at trap+0x2a5/frame 0xfffffe00e684a470 calltrap() at calltrap+0x8/frame 0xfffffe00e684a470 --- trap 0xc, rip = 0xffffffff80bc34c5, rsp = 0xfffffe00e684a540, rbp = 0xfffffe00e684a5c0 --- sendfile_iodone() at sendfile_iodone+0x215/frame 0xfffffe00e684a5c0 vn_sendfile() at vn_sendfile+0x1789/frame 0xfffffe00e684a970 fo_sendfile() at fo_sendfile+0x8e/frame 0xfffffe00e684aa10 sendfile() at sendfile+0x1e0/frame 0xfffffe00e684aaa0 sys_sendfile() at sys_sendfile+0x24/frame 0xfffffe00e684aad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e684abf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e684abf0 --- syscall (393, FreeBSD ELF64, sys_sendfile), rip = 0x8002ddefa, rsp = 0x7fffffffd5a8, rbp = 0x7fffffffe6f0 --- Tracing command bash pid 2440 tid 100215 td 0xfffffe00e66a7700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e39fa6e0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e68498a0 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e68498b0 trap() at trap+0x6c/frame 0xfffffe00e68499c0 calltrap() at calltrap+0x8/frame 0xfffffe00e68499c0 --- trap 0xc, rip = 0xffffffff81042190, rsp = 0xfffffe00e6849a90, rbp = 0xfffffe00e6849b20 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe00e6849b20 db_get_value() at db_get_value+0x32/frame 0xfffffe00e6849b60 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00e6849bf0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e6849c10 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e6849cb0 db_command() at db_command+0x25c/frame 0xfffffe00e6849d80 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00e6849e20 db_command() at db_command+0x25c/frame 0xfffffe00e6849ef0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e6849f00 db_trap() at db_trap+0xe8/frame 0xfffffe00e6849f90 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00e684a000 trap() at trap+0x7b8/frame 0xfffffe00e684a110 calltrap() at calltrap+0x8/frame 0xfffffe00e684a110 --- trap 0x3, rip = 0xffffffff80c0fe07, rsp = 0xfffffe00e684a1e0, rbp = 0xfffffe00e684a1f0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e684a1f0 vpanic() at vpanic+0x19e/frame 0xfffffe00e684a240 panic() at panic+0x43/frame 0xfffffe00e684a2a0 trap_fatal() at trap_fatal+0x387/frame 0xfffffe00e684a300 trap_pfault() at trap_pfault+0x99/frame 0xfffffe00e684a360 trap() at trap+0x2a5/frame 0xfffffe00e684a470 calltrap() at calltrap+0x8/frame 0xfffffe00e684a470 --- trap 0xc, rip = 0xffffffff80bc34c5, rsp = 0xfffffe00e684a540, rbp = 0xfffffe00e684a5c0 --- sendfile_iodone() at sendfile_iodone+0x215/frame 0xfffffe00e684a5c0 vn_sendfile() at vn_sendfile+0x1789/frame 0xfffffe00e684a970 fo_sendfile() at fo_sendfile+0x8e/frame 0xfffffe00e684aa10 sendfile() at sendfile+0x1e0/frame 0xfffffe00e684aaa0 sys_sendfile() at sys_sendfile+0x24/frame 0xfffffe00e684aad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e684abf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e684abf0 --- syscall (393, FreeBSD ELF64, sys_sendfile), rip = 0x8002ddefa, rsp = 0x7fffffffd5a8, rbp = 0x7fffffffe6f0 --- *** error reading from address fffffe00e39fa6e8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e6849b10 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e6849b20 db_get_value() at db_get_value+0x4c/frame 0xfffffe00e6849b60 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00e6849bf0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e6849c10 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e6849cb0 db_command() at db_command+0x25c/frame 0xfffffe00e6849d80 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00e6849e20 db_command() at db_command+0x25c/frame 0xfffffe00e6849ef0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e6849f00 db_trap() at db_trap+0xe8/frame 0xfffffe00e6849f90 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00e684a000 trap() at trap+0x7b8/frame 0xfffffe00e684a110 calltrap() at calltrap+0x8/frame 0xfffffe00e684a110 --- trap 0x3, rip = 0xffffffff80c0fe07, rsp = 0xfffffe00e684a1e0, rbp = 0xfffffe00e684a1f0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e684a1f0 vpanic() at vpanic+0x19e/frame 0xfffffe00e684a240 panic() at panic+0x43/frame 0xfffffe00e684a2a0 trap_fatal() at trap_fatal+0x387/frame 0xfffffe00e684a300 trap_pfault() at trap_pfault+0x99/frame 0xfffffe00e684a360 trap() at trap+0x2a5/frame 0xfffffe00e684a470 calltrap() at calltrap+0x8/frame 0xfffffe00e684a470 --- trap 0xc, rip = 0xffffffff80bc34c5, rsp = 0xfffffe00e684a540, rbp = 0xfffffe00e684a5c0 --- sendfile_iodone() at sendfile_iodone+0x215/frame 0xfffffe00e684a5c0 vn_sendfile() at vn_sendfile+0x1789/frame 0xfffffe00e684a970 fo_sendfile() at fo_sendfile+0x8e/frame 0xfffffe00e684aa10 sendfile() at sendfile+0x1e0/frame 0xfffffe00e684aaa0 sys_sendfile() at sys_sendfile+0x24/frame 0xfffffe00e684aad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e684abf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e684abf0 --- syscall (393, FreeBSD ELF64, sys_sendfile), rip = 0x8002ddefa, rsp = 0x7fffffffd5a8, rbp = 0x7fffffffe6f0 --- Tracing command sshd pid 2439 tid 100209 td 0xfffffe00d35cb700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e39dc740 mi_switch() at mi_switch+0x155/frame 0xfffffe00e39dc760 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e39dc7a0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e39dc800 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e39dc810 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e39dc870 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e39dc8b0 kern_select() at kern_select+0x87a/frame 0xfffffe00e39dca90 sys_select() at sys_select+0x56/frame 0xfffffe00e39dcad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e39dcbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e39dcbf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8008e17fa, rsp = 0x7fffffffa548, rbp = 0x7fffffffa580 --- Tracing command sshd pid 2436 tid 100200 td 0xfffffe00dd3fca00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e39af7c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e39af7e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e39af820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e39af880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e39af890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e39af8f0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e39af930 kern_poll() at kern_poll+0x48b/frame 0xfffffe00e39afab0 sys_poll() at sys_poll+0x50/frame 0xfffffe00e39afad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e39afbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e39afbf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x80088500a, rsp = 0x7fffffffe5a8, rbp = 0x7fffffffe5e0 --- Tracing command csh pid 2432 tid 100199 td 0xfffffe00d61fce00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e39aa7c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e39aa7e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e39aa820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e39aa880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e39aa890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e39aa8f0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e39aa920 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e39aa980 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e39aa9b0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e39aaa10 dofileread() at dofileread+0x81/frame 0xfffffe00e39aaa60 sys_read() at sys_read+0xc0/frame 0xfffffe00e39aaad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e39aabf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e39aabf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80051081a, rsp = 0x7fffffffe1e8, rbp = 0x7fffffffe210 --- Tracing command login pid 2431 tid 100213 td 0xfffffe00e66a7e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e39f06e0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e68498a0 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e68498b0 trap() at trap+0x6c/frame 0xfffffe00e68499c0 calltrap() at calltrap+0x8/frame 0xfffffe00e68499c0 --- trap 0xc, rip = 0xffffffff81042190, rsp = 0xfffffe00e6849a90, rbp = 0xfffffe00e6849b20 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe00e6849b20 db_get_value() at db_get_value+0x32/frame 0xfffffe00e6849b60 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00e6849bf0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e6849c10 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e6849cb0 db_command() at db_command+0x25c/frame 0xfffffe00e6849d80 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00e6849e20 db_command() at db_command+0x25c/frame 0xfffffe00e6849ef0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e6849f00 db_trap() at db_trap+0xe8/frame 0xfffffe00e6849f90 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00e684a000 trap() at trap+0x7b8/frame 0xfffffe00e684a110 calltrap() at calltrap+0x8/frame 0xfffffe00e684a110 --- trap 0x3, rip = 0xffffffff80c0fe07, rsp = 0xfffffe00e684a1e0, rbp = 0xfffffe00e684a1f0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e684a1f0 vpanic() at vpanic+0x19e/frame 0xfffffe00e684a240 panic() at panic+0x43/frame 0xfffffe00e684a2a0 trap_fatal() at trap_fatal+0x387/frame 0xfffffe00e684a300 trap_pfault() at trap_pfault+0x99/frame 0xfffffe00e684a360 trap() at trap+0x2a5/frame 0xfffffe00e684a470 calltrap() at calltrap+0x8/frame 0xfffffe00e684a470 --- trap 0xc, rip = 0xffffffff80bc34c5, rsp = 0xfffffe00e684a540, rbp = 0xfffffe00e684a5c0 --- sendfile_iodone() at sendfile_iodone+0x215/frame 0xfffffe00e684a5c0 vn_sendfile() at vn_sendfile+0x1789/frame 0xfffffe00e684a970 fo_sendfile() at fo_sendfile+0x8e/frame 0xfffffe00e684aa10 sendfile() at sendfile+0x1e0/frame 0xfffffe00e684aaa0 sys_sendfile() at sys_sendfile+0x24/frame 0xfffffe00e684aad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e684abf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e684abf0 --- syscall (393, FreeBSD ELF64, sys_sendfile), rip = 0x8002ddefa, rsp = 0x7fffffffd5a8, rbp = 0x7fffffffe6f0 --- *** error reading from address fffffe00e39f06e8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e6849b10 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e6849b20 db_get_value() at db_get_value+0x4c/frame 0xfffffe00e6849b60 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00e6849bf0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e6849c10 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e6849cb0 db_command() at db_command+0x25c/frame 0xfffffe00e6849d80 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00e6849e20 db_command() at db_command+0x25c/frame 0xfffffe00e6849ef0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e6849f00 db_trap() at db_trap+0xe8/frame 0xfffffe00e6849f90 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00e684a000 trap() at trap+0x7b8/frame 0xfffffe00e684a110 calltrap() at calltrap+0x8/frame 0xfffffe00e684a110 --- trap 0x3, rip = 0xffffffff80c0fe07, rsp = 0xfffffe00e684a1e0, rbp = 0xfffffe00e684a1f0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e684a1f0 vpanic() at vpanic+0x19e/frame 0xfffffe00e684a240 panic() at panic+0x43/frame 0xfffffe00e684a2a0 trap_fatal() at trap_fatal+0x387/frame 0xfffffe00e684a300 trap_pfault() at trap_pfault+0x99/frame 0xfffffe00e684a360 trap() at trap+0x2a5/frame 0xfffffe00e684a470 calltrap() at calltrap+0x8/frame 0xfffffe00e684a470 --- trap 0xc, rip = 0xffffffff80bc34c5, rsp = 0xfffffe00e684a540, rbp = 0xfffffe00e684a5c0 --- sendfile_iodone() at sendfile_iodone+0x215/frame 0xfffffe00e684a5c0 vn_sendfile() at vn_sendfile+0x1789/frame 0xfffffe00e684a970 fo_sendfile() at fo_sendfile+0x8e/frame 0xfffffe00e684aa10 sendfile() at sendfile+0x1e0/frame 0xfffffe00e684aaa0 sys_sendfile() at sys_sendfile+0x24/frame 0xfffffe00e684aad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e684abf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e684abf0 --- syscall (393, FreeBSD ELF64, sys_sendfile), rip = 0x8002ddefa, rsp = 0x7fffffffd5a8, rbp = 0x7fffffffe6f0 --- Tracing command getty pid 2430 tid 100212 td 0xfffffe00e66a8500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e39eb7c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e39eb7e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e39eb820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e39eb880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e39eb890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e39eb8f0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e39eb920 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e39eb980 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e39eb9b0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e39eba10 dofileread() at dofileread+0x81/frame 0xfffffe00e39eba60 sys_read() at sys_read+0xc0/frame 0xfffffe00e39ebad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e39ebbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e39ebbf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043781a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2429 tid 100211 td 0xfffffe00e66a8c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e39e67c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e39e67e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e39e6820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e39e6880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e39e6890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e39e68f0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e39e6920 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e39e6980 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e39e69b0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e39e6a10 dofileread() at dofileread+0x81/frame 0xfffffe00e39e6a60 sys_read() at sys_read+0xc0/frame 0xfffffe00e39e6ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e39e6bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e39e6bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043781a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2428 tid 100210 td 0xfffffe00e66a9300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e39e17c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e39e17e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e39e1820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e39e1880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e39e1890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e39e18f0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e39e1920 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e39e1980 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e39e19b0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e39e1a10 dofileread() at dofileread+0x81/frame 0xfffffe00e39e1a60 sys_read() at sys_read+0xc0/frame 0xfffffe00e39e1ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e39e1bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e39e1bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043781a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2427 tid 100146 td 0xfffffe00d39e0e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e381d7c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e381d7e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e381d820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e381d880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e381d890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e381d8f0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e381d920 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e381d980 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e381d9b0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e381da10 dofileread() at dofileread+0x81/frame 0xfffffe00e381da60 sys_read() at sys_read+0xc0/frame 0xfffffe00e381dad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e381dbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e381dbf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043781a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2426 tid 100185 td 0xfffffe00dd3fd100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e391c7c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e391c7e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e391c820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e391c880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e391c890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e391c8f0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e391c920 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e391c980 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e391c9b0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e391ca10 dofileread() at dofileread+0x81/frame 0xfffffe00e391ca60 sys_read() at sys_read+0xc0/frame 0xfffffe00e391cad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e391cbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e391cbf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043781a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2425 tid 100194 td 0xfffffe00e66f4c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e39917c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e39917e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e3991820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e3991880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e3991890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e39918f0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e3991920 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e3991980 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e39919b0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e3991a10 dofileread() at dofileread+0x81/frame 0xfffffe00e3991a60 sys_read() at sys_read+0xc0/frame 0xfffffe00e3991ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e3991bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3991bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043781a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2424 tid 100181 td 0xfffffe00d35cbe00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e39087c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e39087e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e3908820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e3908880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e3908890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e39088f0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e3908920 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e3908980 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e39089b0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e3908a10 dofileread() at dofileread+0x81/frame 0xfffffe00e3908a60 sys_read() at sys_read+0xc0/frame 0xfffffe00e3908ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e3908bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3908bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043781a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2423 tid 100208 td 0xfffffe00d39e8000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e39d77c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e39d77e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e39d7820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e39d7880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e39d7890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e39d78f0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e39d7920 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e39d7980 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e39d79b0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e39d7a10 dofileread() at dofileread+0x81/frame 0xfffffe00e39d7a60 sys_read() at sys_read+0xc0/frame 0xfffffe00e39d7ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e39d7bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e39d7bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043781a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2422 tid 100142 td 0xfffffe003e461300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e38097c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e38097e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e3809820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e3809880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e3809890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e38098f0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e3809920 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e3809980 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e38099b0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e3809a10 dofileread() at dofileread+0x81/frame 0xfffffe00e3809a60 sys_read() at sys_read+0xc0/frame 0xfffffe00e3809ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e3809bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3809bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043781a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command cron pid 2373 tid 100190 td 0xfffffe00d39eaa00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e3935870 mi_switch() at mi_switch+0x155/frame 0xfffffe00e3935890 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e39358d0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e3935930 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e3935970 _sleep() at _sleep+0x258/frame 0xfffffe00e3935a10 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe00e3935a90 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe00e3935ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e3935bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3935bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003dcbaa, rsp = 0x7fffffffeaa8, rbp = 0x7fffffffec90 --- Tracing command sshd pid 2369 tid 100193 td 0xfffffe00e66f5300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e395c740 mi_switch() at mi_switch+0x155/frame 0xfffffe00e395c760 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e395c7a0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e395c800 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e395c810 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e395c870 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e395c8b0 kern_select() at kern_select+0x87a/frame 0xfffffe00e395ca90 sys_select() at sys_select+0x56/frame 0xfffffe00e395cad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e395cbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e395cbf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8008e17fa, rsp = 0x7fffffffe638, rbp = 0x7fffffffe670 --- Tracing command powerd pid 2341 tid 100201 td 0xfffffe00dd3fc300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e39b4700 mi_switch() at mi_switch+0x155/frame 0xfffffe00e39b4720 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e39b4760 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e39b47c0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e39b4800 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00e39b4870 seltdwait() at seltdwait+0x6b/frame 0xfffffe00e39b48b0 kern_select() at kern_select+0x87a/frame 0xfffffe00e39b4a90 sys_select() at sys_select+0x56/frame 0xfffffe00e39b4ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e39b4bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e39b4bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8004347fa, rsp = 0x7fffffffeb58, rbp = 0x7fffffffeca0 --- Tracing command ntpd pid 2338 tid 100202 td 0xfffffe00dd3e8a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e39b9740 mi_switch() at mi_switch+0x155/frame 0xfffffe00e39b9760 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e39b97a0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e39b9800 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e39b9810 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e39b9870 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e39b98b0 kern_select() at kern_select+0x87a/frame 0xfffffe00e39b9a90 sys_select() at sys_select+0x56/frame 0xfffffe00e39b9ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e39b9bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e39b9bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80080f7fa, rsp = 0x7fffffffdec8, rbp = 0x7fffffffdf00 --- Tracing command ntpd pid 2338 tid 100296 td 0xfffffe00e3f12700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e6900820 mi_switch() at mi_switch+0x155/frame 0xfffffe00e6900840 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e6900880 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e69008e0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e69008f0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e6900990 umtxq_sleep() at umtxq_sleep+0x19e/frame 0xfffffe00e69009f0 do_sem2_wait() at do_sem2_wait+0x38f/frame 0xfffffe00e6900a80 __umtx_op_sem2_wait() at __umtx_op_sem2_wait+0x76/frame 0xfffffe00e6900ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e6900bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e6900bf0 --- syscall (454, FreeBSD ELF64, sys__umtx_op), rip = 0x800706a6a, rsp = 0x7fffdffbcee8, rbp = 0x7fffdffbcf60 --- Tracing command rpc.lockd pid 2273 tid 100205 td 0xfffffe00dd3e7c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e39c8640 mi_switch() at mi_switch+0x155/frame 0xfffffe00e39c8660 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e39c86a0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e39c8700 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e39c8740 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00e39c87b0 svc_run_internal() at svc_run_internal+0xafe/frame 0xfffffe00e39c88f0 svc_run() at svc_run+0x253/frame 0xfffffe00e39c8950 sys_nlm_syscall() at sys_nlm_syscall+0x74d/frame 0xfffffe00e39c8ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e39c8bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e39c8bf0 --- syscall (154, FreeBSD ELF64, sys_nlm_syscall), rip = 0x8002f9b5a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec90 --- Tracing command rpc.statd pid 2270 tid 100196 td 0xfffffe00dd3e9100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e399b700 mi_switch() at mi_switch+0x155/frame 0xfffffe00e399b720 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e399b760 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e399b7c0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e399b800 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00e399b870 seltdwait() at seltdwait+0x6b/frame 0xfffffe00e399b8b0 kern_select() at kern_select+0x87a/frame 0xfffffe00e399ba90 sys_select() at sys_select+0x56/frame 0xfffffe00e399bad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e399bbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e399bbf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80042a7fa, rsp = 0x7fffffffea68, rbp = 0x7fffffffebb0 --- Tracing command watchdogd pid 2224 tid 100191 td 0xfffffe00d39ea300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e393a870 mi_switch() at mi_switch+0x155/frame 0xfffffe00e393a890 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e393a8d0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e393a930 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e393a970 _sleep() at _sleep+0x258/frame 0xfffffe00e393aa10 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe00e393aa90 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe00e393aad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e393abf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e393abf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003c5baa, rsp = 0x7fffffffea68, rbp = 0x7fffffffeab0 --- Tracing command rpcbind pid 2076 tid 100167 td 0xfffffe00d35ccc00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e3892780 mi_switch() at mi_switch+0x155/frame 0xfffffe00e38927a0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e38927e0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e3892840 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e3892880 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00e38928f0 seltdwait() at seltdwait+0x6b/frame 0xfffffe00e3892930 kern_poll() at kern_poll+0x48b/frame 0xfffffe00e3892ab0 sys_poll() at sys_poll+0x50/frame 0xfffffe00e3892ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e3892bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3892bf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003d300a, rsp = 0x7fffffffca08, rbp = 0x7fffffffec20 --- Tracing command syslogd pid 2066 tid 100152 td 0xfffffe00e3e97700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e383b740 mi_switch() at mi_switch+0x155/frame 0xfffffe00e383b760 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e383b7a0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e383b800 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e383b810 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e383b870 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e383b8b0 kern_select() at kern_select+0x87a/frame 0xfffffe00e383ba90 sys_select() at sys_select+0x56/frame 0xfffffe00e383bad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e383bbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e383bbf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80043d7fa, rsp = 0x7fffffffe718, rbp = 0x7fffffffec90 --- Tracing command devd pid 1995 tid 100163 td 0xfffffe00e3e97000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e387e700 mi_switch() at mi_switch+0x155/frame 0xfffffe00e387e720 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e387e760 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e387e7c0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e387e800 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00e387e870 seltdwait() at seltdwait+0x6b/frame 0xfffffe00e387e8b0 kern_select() at kern_select+0x87a/frame 0xfffffe00e387ea90 sys_select() at sys_select+0x56/frame 0xfffffe00e387ead0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e387ebf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e387ebf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x2f63aa, rsp = 0x7fffffffcb18, rbp = 0x7fffffffecb0 --- Tracing command dhclient pid 1990 tid 100171 td 0xfffffe00dd3fa000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e38a6780 mi_switch() at mi_switch+0x155/frame 0xfffffe00e38a67a0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e38a67e0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e38a6840 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e38a6880 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00e38a68f0 seltdwait() at seltdwait+0x6b/frame 0xfffffe00e38a6930 kern_poll() at kern_poll+0x48b/frame 0xfffffe00e38a6ab0 sys_poll() at sys_poll+0x50/frame 0xfffffe00e38a6ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e38a6bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e38a6bf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003f800a, rsp = 0x7fffffffebf8, rbp = 0x7fffffffec30 --- Tracing command dhclient pid 1931 tid 100150 td 0xfffffe00dd3fae00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e38317c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e38317e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e3831820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e3831880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e3831890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e38318f0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e3831930 kern_poll() at kern_poll+0x48b/frame 0xfffffe00e3831ab0 sys_poll() at sys_poll+0x50/frame 0xfffffe00e3831ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e3831bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3831bf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003f800a, rsp = 0x7fffffffec08, rbp = 0x7fffffffec30 --- Tracing command dhclient pid 1928 tid 100166 td 0xfffffe00d31a6300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e388d740 mi_switch() at mi_switch+0x155/frame 0xfffffe00e388d760 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e388d7a0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e388d800 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e388d810 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e388d870 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e388d8b0 kern_select() at kern_select+0x87a/frame 0xfffffe00e388da90 sys_select() at sys_select+0x56/frame 0xfffffe00e388dad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e388dbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e388dbf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8004547fa, rsp = 0x7fffffffe9b8, rbp = 0x7fffffffea70 --- Tracing command syncer pid 34 tid 100140 td 0xfffffe00d39e1500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e37fda10 mi_switch() at mi_switch+0x155/frame 0xfffffe00e37fda30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e37fda70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e37fdab0 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x184/frame 0xfffffe00e37fdb20 sched_sync() at sched_sync+0x68b/frame 0xfffffe00e37fdbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e37fdbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e37fdbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vnlru pid 33 tid 100135 td 0xfffffe00d39e1c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e37e49d0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e37e49f0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e37e4a30 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e37e4a70 _sleep() at _sleep+0x26c/frame 0xfffffe00e37e4b10 vnlru_proc() at vnlru_proc+0xaac/frame 0xfffffe00e37e4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e37e4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e37e4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100130 td 0xfffffe00d39e2300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d7447a20 mi_switch() at mi_switch+0x155/frame 0xfffffe00d7447a40 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d7447a80 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00d7447ac0 _sleep() at _sleep+0x26c/frame 0xfffffe00d7447b60 buf_daemon() at buf_daemon+0x112/frame 0xfffffe00d7447bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d7447bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d7447bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100131 td 0xfffffe00d39e6300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d75eca10 mi_switch() at mi_switch+0x155/frame 0xfffffe00d75eca30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d75eca70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00d75ecab0 _sleep() at _sleep+0x26c/frame 0xfffffe00d75ecb50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00d75ecbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d75ecbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d75ecbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100132 td 0xfffffe00d39e5c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d75f1a10 mi_switch() at mi_switch+0x155/frame 0xfffffe00d75f1a30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d75f1a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00d75f1ab0 _sleep() at _sleep+0x26c/frame 0xfffffe00d75f1b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00d75f1bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d75f1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d75f1bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100133 td 0xfffffe00d39e5500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d75f6a10 mi_switch() at mi_switch+0x155/frame 0xfffffe00d75f6a30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d75f6a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00d75f6ab0 _sleep() at _sleep+0x26c/frame 0xfffffe00d75f6b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00d75f6bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d75f6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d75f6bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100136 td 0xfffffe00d39e4e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e37e9a10 mi_switch() at mi_switch+0x155/frame 0xfffffe00e37e9a30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e37e9a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e37e9ab0 _sleep() at _sleep+0x26c/frame 0xfffffe00e37e9b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00e37e9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e37e9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e37e9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100137 td 0xfffffe00d39e4700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e37eea10 mi_switch() at mi_switch+0x155/frame 0xfffffe00e37eea30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e37eea70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e37eeab0 _sleep() at _sleep+0x26c/frame 0xfffffe00e37eeb50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00e37eebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e37eebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e37eebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100138 td 0xfffffe00d39e4000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e37f3a10 mi_switch() at mi_switch+0x155/frame 0xfffffe00e37f3a30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e37f3a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e37f3ab0 _sleep() at _sleep+0x26c/frame 0xfffffe00e37f3b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00e37f3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e37f3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e37f3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100139 td 0xfffffe00d39e3800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e37f8a10 mi_switch() at mi_switch+0x155/frame 0xfffffe00e37f8a30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e37f8a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e37f8ab0 _sleep() at _sleep+0x26c/frame 0xfffffe00e37f8b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00e37f8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e37f8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e37f8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100151 td 0xfffffe00d31a6a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e3836a40 mi_switch() at mi_switch+0x155/frame 0xfffffe00e3836a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e3836aa0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e3836ae0 _sleep() at _sleep+0x26c/frame 0xfffffe00e3836b80 softdep_flush() at softdep_flush+0x16e/frame 0xfffffe00e3836bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e3836bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e3836bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100206 td 0xfffffe00e5be2a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e39cda40 mi_switch() at mi_switch+0x155/frame 0xfffffe00e39cda60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e39cdaa0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e39cdae0 _sleep() at _sleep+0x26c/frame 0xfffffe00e39cdb80 softdep_flush() at softdep_flush+0x16e/frame 0xfffffe00e39cdbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e39cdbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e39cdbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vmdaemon pid 31 tid 100129 td 0xfffffe00d39e2a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d7436a40 mi_switch() at mi_switch+0x155/frame 0xfffffe00d7436a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d7436aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe00d7436b40 vm_daemon() at vm_daemon+0x82/frame 0xfffffe00d7436bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d7436bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d7436bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100128 td 0xfffffe00d6097e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d7431670 mi_switch() at mi_switch+0x155/frame 0xfffffe00d7431690 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d74316d0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00d7431710 _sleep() at _sleep+0x26c/frame 0xfffffe00d74317b0 vm_pageout_worker() at vm_pageout_worker+0x279/frame 0xfffffe00d7431b70 vm_pageout() at vm_pageout+0x193/frame 0xfffffe00d7431bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d7431bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d7431bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100134 td 0xfffffe00d39e9c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d75fb7c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00d75fb7e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d75fb820 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00d75fb860 _sleep() at _sleep+0x26c/frame 0xfffffe00d75fb900 pause_sbt() at pause_sbt+0xf1/frame 0xfffffe00d75fb930 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0xaee/frame 0xfffffe00d75fbbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d75fbbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d75fbbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100141 td 0xfffffe00d39e9500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e3804a40 mi_switch() at mi_switch+0x155/frame 0xfffffe00e3804a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e3804aa0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e3804ae0 _sleep() at _sleep+0x26c/frame 0xfffffe00e3804b80 uma_reclaim_worker() at uma_reclaim_worker+0xb8/frame 0xfffffe00e3804bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e3804bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e3804bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon1 pid 29 tid 100127 td 0xfffffe00d35ce100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d742ca40 mi_switch() at mi_switch+0x155/frame 0xfffffe00d742ca60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d742caa0 _sleep() at _sleep+0x2cd/frame 0xfffffe00d742cb40 enc_daemon() at enc_daemon+0xe4/frame 0xfffffe00d742cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d742cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d742cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon0 pid 28 tid 100126 td 0xfffffe00d61ff800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d7427a40 mi_switch() at mi_switch+0x155/frame 0xfffffe00d7427a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d7427aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe00d7427b40 enc_daemon() at enc_daemon+0xe4/frame 0xfffffe00d7427bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d7427bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d7427bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command rand_harvestq pid 27 tid 100123 td 0xfffffe00d6099300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d74189f0 mi_switch() at mi_switch+0x155/frame 0xfffffe00d7418a10 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d7418a50 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00d7418a90 _sleep() at _sleep+0x26c/frame 0xfffffe00d7418b30 random_kthread() at random_kthread+0x67/frame 0xfffffe00d7418bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d7418bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d7418bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sctp_iterator pid 26 tid 100119 td 0xfffffe00d61fc000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d7404a90 mi_switch() at mi_switch+0x155/frame 0xfffffe00d7404ab0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d7404af0 _sleep() at _sleep+0x2cd/frame 0xfffffe00d7404b90 sctp_iterator_thread() at sctp_iterator_thread+0x59/frame 0xfffffe00d7404bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d7404bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d7404bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod4 pid 25 tid 100118 td 0xfffffe00d31a7100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037bf1a30 mi_switch() at mi_switch+0x155/frame 0xfffffe0037bf1a50 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bf1a90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037bf1ad0 _sleep() at _sleep+0x26c/frame 0xfffffe0037bf1b70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe0037bf1bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bf1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bf1bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod3 pid 24 tid 100117 td 0xfffffe00d31a7800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037beca30 mi_switch() at mi_switch+0x155/frame 0xfffffe0037beca50 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037beca90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037becad0 _sleep() at _sleep+0x26c/frame 0xfffffe0037becb70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe0037becbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037becbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037becbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod2 pid 23 tid 100116 td 0xfffffe00d6097000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037be7a30 mi_switch() at mi_switch+0x155/frame 0xfffffe0037be7a50 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037be7a90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037be7ad0 _sleep() at _sleep+0x26c/frame 0xfffffe0037be7b70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe0037be7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037be7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037be7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod1 pid 22 tid 100115 td 0xfffffe00d6097700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037be2a30 mi_switch() at mi_switch+0x155/frame 0xfffffe0037be2a50 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037be2a90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037be2ad0 _sleep() at _sleep+0x26c/frame 0xfffffe0037be2b70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe0037be2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037be2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037be2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100096 td 0xfffffe003e4b4e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b77ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b77ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b77b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b77b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b77bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b77bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b77bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100097 td 0xfffffe003e4b4700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b7cab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b7cad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b7cb10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b7cb70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b7cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b7cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b7cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100098 td 0xfffffe003e4b4000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b81ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b81ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b81b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b81b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b81bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b81bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b81bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100099 td 0xfffffe003e1aa800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b86ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b86ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b86b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b86b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b86bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b86bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b86bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100100 td 0xfffffe003e1aa100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b8bab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b8bad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b8bb10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b8bb70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b8bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b8bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b8bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100102 td 0xfffffe00d2e1a500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b95ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b95ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b95b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b95b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b95bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b95bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b95bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100103 td 0xfffffe00d2e19e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b9aab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b9aad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b9ab10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b9ab70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b9abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b9abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b9abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100104 td 0xfffffe00d2e19700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b9fab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b9fad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b9fb10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b9fb70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b9fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b9fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b9fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100105 td 0xfffffe00d2e19000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037ba4ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037ba4ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ba4b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037ba4b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037ba4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ba4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ba4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100106 td 0xfffffe003e4b7800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037ba9ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037ba9ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ba9b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037ba9b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037ba9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ba9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ba9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100107 td 0xfffffe003e1b6100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037bbaab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037bbaad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bbab10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037bbab70 usb_process() at usb_process+0xc3/frame 0xfffffe0037bbabb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bbabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bbabf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100108 td 0xfffffe00d31a4e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037bbfab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037bbfad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bbfb10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037bbfb70 usb_process() at usb_process+0xc3/frame 0xfffffe0037bbfbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bbfbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bbfbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100109 td 0xfffffe00d31a4700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037bc4ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037bc4ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bc4b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037bc4b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037bc4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bc4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bc4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100110 td 0xfffffe00d31a4000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037bc9ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037bc9ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bc9b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037bc9b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037bc9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bc9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bc9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100111 td 0xfffffe00d2e1c800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037bceab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037bcead0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bceb10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037bceb70 usb_process() at usb_process+0xc3/frame 0xfffffe0037bcebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bcebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bcebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100091 td 0xfffffe003e1a7700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b5ea60 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b5ea80 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b5eac0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b5eb60 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe0037b5ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b5ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b5ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100092 td 0xfffffe003e1a7000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b63a60 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b63a80 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b63ac0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b63b60 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe0037b63bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b63bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b63bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100093 td 0xfffffe003e1b6800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b68a60 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b68a80 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b68ac0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b68b60 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe0037b68bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b68bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b68bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100125 td 0xfffffe00d6098500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d7422a70 mi_switch() at mi_switch+0x155/frame 0xfffffe00d7422a90 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d7422ad0 _sleep() at _sleep+0x2cd/frame 0xfffffe00d7422b70 xpt_scanner_thread() at xpt_scanner_thread+0x68/frame 0xfffffe00d7422bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d7422bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d7422bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 11 pid 19 tid 100090 td 0xfffffe003e1a7e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b59a40 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b59a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b59aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b59b40 crypto_ret_proc() at crypto_ret_proc+0x270/frame 0xfffffe0037b59bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b59bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b59bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 10 pid 18 tid 100089 td 0xfffffe003e1a8500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b54a40 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b54a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b54aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b54b40 crypto_ret_proc() at crypto_ret_proc+0x270/frame 0xfffffe0037b54bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b54bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b54bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 9 pid 17 tid 100088 td 0xfffffe003e1a8c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b4fa40 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b4fa60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b4faa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b4fb40 crypto_ret_proc() at crypto_ret_proc+0x270/frame 0xfffffe0037b4fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b4fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b4fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 8 pid 16 tid 100087 td 0xfffffe003e1a9300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b4aa40 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b4aa60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b4aaa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b4ab40 crypto_ret_proc() at crypto_ret_proc+0x270/frame 0xfffffe0037b4abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b4abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b4abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 7 pid 15 tid 100086 td 0xfffffe003e1c2800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b45a40 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b45a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b45aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b45b40 crypto_ret_proc() at crypto_ret_proc+0x270/frame 0xfffffe0037b45bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b45bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b45bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 6 pid 9 tid 100085 td 0xfffffe003e1b3000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b40a40 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b40a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b40aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b40b40 crypto_ret_proc() at crypto_ret_proc+0x270/frame 0xfffffe0037b40bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b40bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b40bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 5 pid 8 tid 100084 td 0xfffffe003e1b3700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b3ba40 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b3ba60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b3baa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b3bb40 crypto_ret_proc() at crypto_ret_proc+0x270/frame 0xfffffe0037b3bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b3bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b3bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 4 pid 7 tid 100083 td 0xfffffe003e1b3e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b36a40 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b36a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b36aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b36b40 crypto_ret_proc() at crypto_ret_proc+0x270/frame 0xfffffe0037b36bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b36bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b36bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 3 pid 6 tid 100082 td 0xfffffe003e1b4500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b31a40 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b31a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b31aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b31b40 crypto_ret_proc() at crypto_ret_proc+0x270/frame 0xfffffe0037b31bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b31bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b31bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 2 pid 5 tid 100081 td 0xfffffe003e1b4c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b2ca40 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b2ca60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b2caa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b2cb40 crypto_ret_proc() at crypto_ret_proc+0x270/frame 0xfffffe0037b2cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b2cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b2cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 1 pid 4 tid 100080 td 0xfffffe003e1b5300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b27a40 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b27a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b27aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b27b40 crypto_ret_proc() at crypto_ret_proc+0x270/frame 0xfffffe0037b27bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b27bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b27bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 0 pid 3 tid 100079 td 0xfffffe003e1b5a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b22a40 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b22a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b22aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b22b40 crypto_ret_proc() at crypto_ret_proc+0x270/frame 0xfffffe0037b22bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b22bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b22bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 2 tid 100078 td 0xfffffe003e1bf000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b1da70 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b1da90 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b1dad0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b1db70 crypto_proc() at crypto_proc+0x25b/frame 0xfffffe0037b1dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b1dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b1dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sequencer 00 pid 14 tid 100065 td 0xfffffe003e1e5a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037adca70 mi_switch() at mi_switch+0x155/frame 0xfffffe0037adca90 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037adcad0 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037adcb30 seq_eventthread() at seq_eventthread+0x91/frame 0xfffffe0037adcbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037adcbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037adcbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100062 td 0xfffffe003e1efe00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037acda70 mi_switch() at mi_switch+0x155/frame 0xfffffe0037acda90 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037acdad0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037acdb70 g_run_events() at g_run_events+0x64/frame 0xfffffe0037acdbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037acdbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037acdbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100063 td 0xfffffe003e1e6800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037ad2a70 mi_switch() at mi_switch+0x155/frame 0xfffffe0037ad2a90 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ad2ad0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ad2b70 g_io_schedule_up() at g_io_schedule_up+0x3c/frame 0xfffffe0037ad2ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe0037ad2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ad2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ad2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100064 td 0xfffffe003e1e6100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037ad7a70 mi_switch() at mi_switch+0x155/frame 0xfffffe0037ad7a90 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ad7ad0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ad7b70 g_io_schedule_down() at g_io_schedule_down+0x4c/frame 0xfffffe0037ad7ba0 g_down_procbody() at g_down_procbody+0x5c/frame 0xfffffe0037ad7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ad7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ad7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100041 td 0xfffffe003e463e00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100045 td 0xfffffe003e462100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037a18b00 mi_switch() at mi_switch+0x155/frame 0xfffffe0037a18b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037a18bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a18bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a18bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100046 td 0xfffffe003e461a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037a1db00 mi_switch() at mi_switch+0x155/frame 0xfffffe0037a1db20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037a1dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a1dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a1dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100047 td 0xfffffe003e1ef700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037a52b00 mi_switch() at mi_switch+0x155/frame 0xfffffe0037a52b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037a52bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a52bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a52bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100048 td 0xfffffe003e1ef000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100049 td 0xfffffe003e466800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037a5cb00 mi_switch() at mi_switch+0x155/frame 0xfffffe0037a5cb20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037a5cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a5cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a5cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100050 td 0xfffffe003e466100 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100051 td 0xfffffe003e465a00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100052 td 0xfffffe003e465300 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100053 td 0xfffffe003e464c00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100054 td 0xfffffe003e464500 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100055 td 0xfffffe003e1e3000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100056 td 0xfffffe003e1f2800 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100057 td 0xfffffe003e1f2100 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100058 td 0xfffffe003e1f1a00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100059 td 0xfffffe003e1f1300 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100060 td 0xfffffe003e1f0c00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100094 td 0xfffffe003e4b5c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b6db00 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b6db20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037b6dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b6dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b6dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100095 td 0xfffffe003e4b5500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b72b00 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b72b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037b72bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b72bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b72bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100101 td 0xfffffe003e1a9a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b90b00 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b90b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037b90bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b90bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b90bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100112 td 0xfffffe00d2e1c100 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100113 td 0xfffffe00d2e1ba00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037bd8b00 mi_switch() at mi_switch+0x155/frame 0xfffffe0037bd8b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037bd8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bd8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bd8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100173 td 0xfffffe00e3e9a800 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100174 td 0xfffffe00e3e9a100 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100175 td 0xfffffe00e3e99a00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100176 td 0xfffffe00e3e99300 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100177 td 0xfffffe00e3e98c00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100178 td 0xfffffe00e3e98500 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100179 td 0xfffffe00e3e97e00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100180 td 0xfffffe00e5be3100 fork_trampoline() at fork_trampoline Tracing command idle pid 11 tid 100003 td 0xfffffe003e3e0300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add46ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add46ae0 sched_idletd() at sched_idletd+0x41d/frame 0xfffffe00add46bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add46bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add46bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffffe003e3dfc00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add4bac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add4bae0 sched_idletd() at sched_idletd+0x41d/frame 0xfffffe00add4bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add4bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add4bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffffe003e3df500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add50ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add50ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add50bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add50bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add50bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffffe003e3dee00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add55ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add55ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add55bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add55bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add55bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffffe003e3de700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add5aac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add5aae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add5abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add5abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add5abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffffe003e3de000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add5fac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add5fae0 sched_idletd() at sched_idletd+0x41d/frame 0xfffffe00add5fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add5fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add5fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffffe003e3e8a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add64ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add64ae0 sched_idletd() at sched_idletd+0x41d/frame 0xfffffe00add64bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add64bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add64bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffffe003e3e8300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add69ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add69ae0 sched_idletd() at sched_idletd+0x41d/frame 0xfffffe00add69bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add69bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add69bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffffe003e3e7c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add6eac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add6eae0 sched_idletd() at sched_idletd+0x41d/frame 0xfffffe00add6ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add6ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add6ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffffe003e3e7500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add73ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add73ae0 sched_idletd() at sched_idletd+0x41d/frame 0xfffffe00add73bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add73bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add73bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffffe003e3e6e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add78ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add78ae0 sched_idletd() at sched_idletd+0x41d/frame 0xfffffe00add78bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add78bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add78bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffffe003e3e6700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add7dac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add7dae0 sched_idletd() at sched_idletd+0x41d/frame 0xfffffe00add7dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add7dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add7dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command init pid 1 tid 100002 td 0xfffffe003e3e0a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add416e0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add41700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00add41740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00add417a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00add417b0 _sleep() at _sleep+0x2c3/frame 0xfffffe00add41850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00add418e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe00add41ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00add41bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00add41bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x2b133a, rsp = 0x7fffffffe778, rbp = 0x7fffffffe7e0 --- Tracing command audit pid 10 tid 100001 td 0xfffffe003e3e1100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add3ca90 mi_switch() at mi_switch+0x155/frame 0xfffffe00add3cab0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00add3caf0 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe00add3cb50 audit_worker() at audit_worker+0x9f/frame 0xfffffe00add3cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add3cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add3cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xffffffff81c8d740 sched_switch() at sched_switch+0x5b2/frame 0xffffffff82307c10 mi_switch() at mi_switch+0x155/frame 0xffffffff82307c30 sleepq_switch() at sleepq_switch+0x11a/frame 0xffffffff82307c70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xffffffff82307cb0 _sleep() at _sleep+0x26c/frame 0xffffffff82307d50 swapper() at swapper+0x75/frame 0xffffffff82307da0 mi_startup() at mi_startup+0x2ed/frame 0xffffffff82307df0 btext() at btext+0x2c Tracing command kernel pid 0 tid 100015 td 0xfffffe003e3e6000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add82ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add82ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00add82b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00add82b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00add82bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add82bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add82bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100016 td 0xfffffe003e3e1800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add87ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add87ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00add87b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00add87b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00add87bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add87bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add87bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100017 td 0xfffffe003e455300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add8cab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add8cad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00add8cb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00add8cb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00add8cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add8cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add8cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100018 td 0xfffffe003e454c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add91ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add91ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00add91b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00add91b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00add91bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add91bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add91bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100019 td 0xfffffe003e454500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add96ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add96ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00add96b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00add96b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00add96bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add96bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add96bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xfffffe003e453e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add9bab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add9bad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00add9bb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00add9bb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00add9bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add9bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add9bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xfffffe003e453700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00adda0ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00adda0ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00adda0b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00adda0b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00adda0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adda0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adda0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xfffffe003e453000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00adda5ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00adda5ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00adda5b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00adda5b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00adda5bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adda5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adda5bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xfffffe003e3e9800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addaaab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addaaad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addaab10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addaab80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addaabb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addaabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addaabf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xfffffe003e3e9100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addafab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addafad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addafb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addafb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addafbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addafbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addafbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xfffffe003e458c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addb4ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addb4ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addb4b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addb4b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addb4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addb4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addb4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100026 td 0xfffffe003e458500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addb9ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addb9ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addb9b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addb9b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addb9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addb9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addb9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100027 td 0xfffffe003e457e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addbeab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addbead0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addbeb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addbeb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addbebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addbebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addbebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100028 td 0xfffffe003e457700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addc3ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addc3ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addc3b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addc3b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addc3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addc3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addc3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100029 td 0xfffffe003e457000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addc8ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addc8ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addc8b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addc8b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addc8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addc8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addc8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100030 td 0xfffffe003e456800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addcdab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addcdad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addcdb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addcdb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addcdbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addcdbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addcdbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100031 td 0xfffffe003e456100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addd2ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addd2ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addd2b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addd2b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addd2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addd2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addd2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100032 td 0xfffffe003e455a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addd7ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addd7ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addd7b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addd7b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addd7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addd7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addd7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100033 td 0xfffffe003e460500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00adddcab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00adddcad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00adddcb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00adddcb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00adddcbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adddcbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adddcbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100034 td 0xfffffe003e45fe00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00adde1ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00adde1ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00adde1b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00adde1b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00adde1bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adde1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adde1bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100035 td 0xfffffe003e45f700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00adde6ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00adde6ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00adde6b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00adde6b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00adde6bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adde6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adde6bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100036 td 0xfffffe003e45f000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addebab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addebad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addebb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addebb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addebbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addebbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addebbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100037 td 0xfffffe003e45a800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addf0ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addf0ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addf0b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addf0b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addf0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addf0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addf0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100038 td 0xfffffe003e45a100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addf5ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addf5ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addf5b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addf5b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addf5bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addf5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addf5bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100039 td 0xfffffe003e459a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addfaab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addfaad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addfab10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addfab80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addfabb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addfabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addfabf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100040 td 0xfffffe003e459300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addffa80 mi_switch() at mi_switch+0x155/frame 0xfffffe00addffaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addffae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00addffb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00addffbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addffbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addffbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100042 td 0xfffffe003e463700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037a09a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037a09aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037a09ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037a09b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037a09bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a09bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a09bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100043 td 0xfffffe003e463000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037a0ea80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037a0eaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037a0eae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037a0eb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037a0ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a0ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a0ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100044 td 0xfffffe003e462800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037a13a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037a13aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037a13ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037a13b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037a13bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a13bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a13bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100061 td 0xfffffe003e1f0500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037ac8a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037ac8aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ac8ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ac8b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037ac8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ac8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ac8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100066 td 0xfffffe003e1e5300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037ae1a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037ae1aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ae1ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ae1b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037ae1bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ae1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ae1bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100067 td 0xfffffe003e1e4c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037ae6a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037ae6aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ae6ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ae6b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037ae6bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ae6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ae6bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100068 td 0xfffffe003e1e4500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037aeba80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037aebaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037aebae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037aebb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037aebbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037aebbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037aebbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100069 td 0xfffffe003e1e3e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037af0a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037af0aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037af0ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037af0b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037af0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037af0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037af0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100070 td 0xfffffe003e1e3700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037af5a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037af5aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037af5ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037af5b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037af5bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037af5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037af5bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100071 td 0xfffffe003e1c2100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037afaa80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037afaaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037afaae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037afab80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037afabb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037afabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037afabf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100072 td 0xfffffe003e1c1a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037affa80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037affaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037affae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037affb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037affbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037affbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037affbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100073 td 0xfffffe003e1c1300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b04a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b04aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b04ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b04b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037b04bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b04bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b04bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100074 td 0xfffffe003e1c0c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b09a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b09aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b09ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b09b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037b09bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b09bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b09bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100075 td 0xfffffe003e1c0500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b0ea80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b0eaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b0eae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b0eb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037b0ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b0ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b0ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100076 td 0xfffffe003e1bfe00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b13a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b13aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b13ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b13b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037b13bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b13bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b13bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100077 td 0xfffffe003e1bf700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b18a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b18aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b18ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b18b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037b18bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b18bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b18bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100114 td 0xfffffe00d2e1b300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037bddab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037bddad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bddb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0037bddb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xef/frame 0xfffffe0037bddbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bddbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bddbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100120 td 0xfffffe00d609a800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d7409ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00d7409ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d7409b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00d7409b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xef/frame 0xfffffe00d7409bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d7409bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d7409bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100121 td 0xfffffe00d609a100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d740eab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00d740ead0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d740eb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00d740eb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xef/frame 0xfffffe00d740ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d740ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d740ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100122 td 0xfffffe00d6099a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d7413ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00d7413ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d7413b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00d7413b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xef/frame 0xfffffe00d7413bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d7413bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d7413bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100124 td 0xfffffe00d6098c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d741da80 mi_switch() at mi_switch+0x155/frame 0xfffffe00d741daa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d741dae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00d741db80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00d741dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d741dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d741dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:pho> show allchains chain 1: thread 100260 (pid 6483, sendfile21) is sleeping on 0xfffffe00e591c55c "sbwait" chain 2: thread 100172 (pid 6481, sendfile21) is sleeping on 0xfffff800211f4520 "wait" chain 3: thread 100249 (pid 3452, swap) is sleeping on 0xfffff80170ea8520 "wait" chain 4: thread 100269 (pid 3450, swap) is sleeping on 0xffffffff81cadcd6 "nanslp" chain 5: thread 100270 (pid 3445, md10) is sleeping on 0xfffff80170e1c000 "mdwait" chain 6: thread 100219 (pid 3429, sh) is sleeping on 0xfffff8013a8fa000 "wait" chain 7: thread 100184 (pid 2499, top) is sleeping on 0xfffff80021b13ac0 "select" chain 8: thread 100195 (pid 2493, bash) is sleeping on 0xfffff8013a3f0520 "wait" chain 9: thread 100216 (pid 2492, sshd) is sleeping on 0xfffff80021a683c0 "select" chain 10: thread 100250 (pid 2489, sshd) is sleeping on 0xfffff800031c8840 "select" chain 11: thread 100154 (pid 2449, bash) is sleeping on 0xfffff8002192e520 "wait" chain 12: thread 100218 (pid 2447, csh) is sleeping on 0xfffff800211f3ae8 "pause" chain 13: thread 100197 (pid 2446, su) is sleeping on 0xfffff80004195a40 "wait" chain 14: thread 100215 (pid 2440, bash) is sleeping on 0xfffff8013a8fa520 "wait" chain 15: thread 100209 (pid 2439, sshd) is sleeping on 0xfffff80021329dc0 "select" chain 16: thread 100200 (pid 2436, sshd) is sleeping on 0xfffff80021319d40 "select" chain 17: thread 100199 (pid 2432, csh) is sleeping on 0xfffff800170698b0 "ttyin" chain 18: thread 100213 (pid 2431, login) is sleeping on 0xfffff8013a8faa40 "wait" chain 19: thread 100212 (pid 2430, getty) is sleeping on 0xfffff8001706b4b0 "ttyin" chain 20: thread 100211 (pid 2429, getty) is sleeping on 0xfffff800211444b0 "ttyin" chain 21: thread 100210 (pid 2428, getty) is sleeping on 0xfffff80021144cb0 "ttyin" chain 22: thread 100146 (pid 2427, getty) is sleeping on 0xfffff800210844b0 "ttyin" chain 23: thread 100185 (pid 2426, getty) is sleeping on 0xfffff80021084cb0 "ttyin" chain 24: thread 100194 (pid 2425, getty) is sleeping on 0xfffff800210834b0 "ttyin" chain 25: thread 100181 (pid 2424, getty) is sleeping on 0xfffff80021083cb0 "ttyin" chain 26: thread 100208 (pid 2423, getty) is sleeping on 0xfffff800210864b0 "ttyin" chain 27: thread 100142 (pid 2422, getty) is sleeping on 0xfffff80021086cb0 "ttyin" chain 28: thread 100190 (pid 2373, cron) is sleeping on 0xffffffff81cadcd2 "nanslp" chain 29: thread 100193 (pid 2369, sshd) is sleeping on 0xfffff8003d129a40 "select" chain 30: thread 100201 (pid 2341, powerd) is sleeping on 0xfffff800215665c0 "select" chain 31: thread 100202 (pid 2338, ntpd) is sleeping on 0xfffff80021a68540 "select" chain 32: thread 100296 (pid 2338, ntpd) is sleeping on 0xfffff800212c4100 "usem" chain 33: thread 100205 (pid 2273, NLM: master) is sleeping on 0xfffff80021540460 "rpcsvc" chain 34: thread 100196 (pid 2270, rpc.statd) is sleeping on 0xfffff8002132c040 "select" chain 35: thread 100191 (pid 2224, watchdogd) is sleeping on 0xffffffff81cadcd7 "nanslp" chain 36: thread 100167 (pid 2076, rpcbind) is sleeping on 0xfffff8002132c240 "select" chain 37: thread 100152 (pid 2066, syslogd) is sleeping on 0xfffff8003d129ac0 "select" chain 38: thread 100163 (pid 1995, devd) is sleeping on 0xfffff80021531440 "select" chain 39: thread 100171 (pid 1990, dhclient) is sleeping on 0xfffff8002131c0c0 "select" chain 40: thread 100150 (pid 1931, dhclient) is sleeping on 0xfffff800212ed040 "select" chain 41: thread 100166 (pid 1928, dhclient) is sleeping on 0xfffff80021531540 "select" chain 42: thread 100140 (pid 34, syncer) is sleeping on 0xffffffff81d99898 "syncer" chain 43: thread 100135 (pid 33, vnlru) is sleeping on 0xfffff800210f2000 "vlruwt" chain 44: thread 100131 (pid 32, bufspacedaemon-0) is sleeping on 0xffffffff8180aa00 "-" chain 45: thread 100132 (pid 32, bufspacedaemon-1) is sleeping on 0xffffffff81812cc0 "-" chain 46: thread 100133 (pid 32, bufspacedaemon-2) is sleeping on 0xffffffff8181af80 "-" chain 47: thread 100136 (pid 32, bufspacedaemon-3) is sleeping on 0xffffffff81823240 "-" chain 48: thread 100137 (pid 32, bufspacedaemon-4) is sleeping on 0xffffffff8182b500 "-" chain 49: thread 100138 (pid 32, bufspacedaemon-5) is sleeping on 0xffffffff818337c0 "-" chain 50: thread 100139 (pid 32, bufspacedaemon-6) is sleeping on 0xffffffff8183ba80 "-" chain 51: thread 100151 (pid 32, / worker) is sleeping on 0xfffff800214fd8e8 "sdflush" chain 52: thread 100206 (pid 32, /tmp worker) is sleeping on 0xfffff800218244e8 "sdflush" chain 53: thread 100129 (pid 31, vmdaemon) is sleeping on 0xffffffff81dbdac8 "psleep" chain 54: thread 100128 (pid 30, dom0) is sleeping on 0xffffffff81db2098 "psleep" chain 55: thread 100134 (pid 30, laundry: dom0) is sleeping on 0xffffffff81590bb0 "laundp" chain 56: thread 100141 (pid 30, uma) is sleeping on 0xffffffff80f08770 "umarcl" chain 57: thread 100127 (pid 29, enc_daemon1) is sleeping on 0xfffff800212b7000 "idle" chain 58: thread 100126 (pid 28, enc_daemon0) is sleeping on 0xfffff800211f3520 "idle" chain 59: thread 100123 (pid 27, rand_harvestq) is sleeping on 0xffffffff81ae18a0 "-" chain 60: thread 100119 (pid 26, sctp_iterator) is sleeping on 0xffffffff81d9c010 "waiting_for_work" chain 61: thread 100118 (pid 25, soaiod4) is sleeping on 0xffffffff81d984ec "-" chain 62: thread 100117 (pid 24, soaiod3) is sleeping on 0xffffffff81d984ec "-" chain 63: thread 100116 (pid 23, soaiod2) is sleeping on 0xffffffff81d984ec "-" chain 64: thread 100115 (pid 22, soaiod1) is sleeping on 0xffffffff81d984ec "-" chain 65: thread 100096 (pid 21, usbus0) is sleeping on 0xfffffe00d2d84440 "-" chain 66: thread 100097 (pid 21, usbus0) is sleeping on 0xfffffe00d2d84498 "-" chain 67: thread 100098 (pid 21, usbus0) is sleeping on 0xfffffe00d2d844f0 "-" chain 68: thread 100099 (pid 21, usbus0) is sleeping on 0xfffffe00d2d84548 "-" chain 69: thread 100100 (pid 21, usbus0) is sleeping on 0xfffffe00d2d845a0 "-" chain 70: thread 100102 (pid 21, usbus1) is sleeping on 0xfffffe003e4a2cf0 "-" chain 71: thread 100103 (pid 21, usbus1) is sleeping on 0xfffffe003e4a2d48 "-" chain 72: thread 100104 (pid 21, usbus1) is sleeping on 0xfffffe003e4a2da0 "-" chain 73: thread 100105 (pid 21, usbus1) is sleeping on 0xfffffe003e4a2df8 "-" chain 74: thread 100106 (pid 21, usbus1) is sleeping on 0xfffffe003e4a2e50 "-" chain 75: thread 100107 (pid 21, usbus2) is sleeping on 0xfffffe00d2e23cf0 "-" chain 76: thread 100108 (pid 21, usbus2) is sleeping on 0xfffffe00d2e23d48 "-" chain 77: thread 100109 (pid 21, usbus2) is sleeping on 0xfffffe00d2e23da0 "-" chain 78: thread 100110 (pid 21, usbus2) is sleeping on 0xfffffe00d2e23df8 "-" chain 79: thread 100111 (pid 21, usbus2) is sleeping on 0xfffffe00d2e23e50 "-" chain 80: thread 100091 (pid 20, doneq0) is sleeping on 0xffffffff819b95c0 "-" chain 81: thread 100093 (pid 20, doneq2) is sleeping on 0xffffffff819b96c0 "-" chain 82: thread 100125 (pid 20, scanner) is sleeping on 0xffffffff819b9490 "-" chain 83: thread 100090 (pid 19, crypto returns 11) is sleeping on 0xfffff80003b0fc50 "crypto_ret_wait" chain 84: thread 100089 (pid 18, crypto returns 10) is sleeping on 0xfffff80003b0fbf0 "crypto_ret_wait" chain 85: thread 100088 (pid 17, crypto returns 9) is sleeping on 0xfffff80003b0fb90 "crypto_ret_wait" chain 86: thread 100087 (pid 16, crypto returns 8) is sleeping on 0xfffff80003b0fb30 "crypto_ret_wait" chain 87: thread 100086 (pid 15, crypto returns 7) is sleeping on 0xfffff80003b0fad0 "crypto_ret_wait" chain 88: thread 100085 (pid 9, crypto returns 6) is sleeping on 0xfffff80003b0fa70 "crypto_ret_wait" chain 89: thread 100084 (pid 8, crypto returns 5) is sleeping on 0xfffff80003b0fa10 "crypto_ret_wait" chain 90: thread 100083 (pid 7, crypto returns 4) is sleeping on 0xfffff80003b0f9b0 "crypto_ret_wait" chain 91: thread 100082 (pid 6, crypto returns 3) is sleeping on 0xfffff80003b0f950 "crypto_ret_wait" chain 92: thread 100081 (pid 5, crypto returns 2) is sleeping on 0xfffff80003b0f8f0 "crypto_ret_wait" chain 93: thread 100080 (pid 4, crypto returns 1) is sleeping on 0xfffff80003b0f890 "crypto_ret_wait" chain 94: thread 100079 (pid 3, crypto returns 0) is sleeping on 0xfffff80003b0f830 "crypto_ret_wait" chain 95: thread 100078 (pid 2, crypto) is sleeping on 0xffffffff81daf7c0 "crypto_wait" chain 96: thread 100065 (pid 14, sequencer 00) is sleeping on 0xfffff80003a2e488 "seqstate" chain 97: thread 100062 (pid 13, g_event) is sleeping on 0xffffffff81c8cc80 "-" chain 98: thread 100063 (pid 13, g_up) is sleeping on 0xffffffff81c8cc88 "-" chain 99: thread 100064 (pid 13, g_down) is sleeping on 0xffffffff81c8cc90 "-" chain 100: thread 100002 (pid 1, init) is sleeping on 0xfffff800038f8000 "wait" chain 101: thread 100001 (pid 10, audit) is sleeping on 0xffffffff81dafc98 "audit_worker_cv" chain 102: thread 100000 (pid 0, swapper) is sleeping on 0xffffffff81c8d210 "swapin" chain 103: thread 100015 (pid 0, if_io_tqg_0) is sleeping on 0xfffff8000391c100 "-" chain 104: thread 100016 (pid 0, if_io_tqg_1) is sleeping on 0xfffff8000391c000 "-" chain 105: thread 100017 (pid 0, if_io_tqg_2) is sleeping on 0xfffff80003919e00 "-" chain 106: thread 100018 (pid 0, if_io_tqg_3) is sleeping on 0xfffff80003919d00 "-" chain 107: thread 100019 (pid 0, if_io_tqg_4) is sleeping on 0xfffff80003919c00 "-" chain 108: thread 100020 (pid 0, if_io_tqg_5) is sleeping on 0xfffff80003919b00 "-" chain 109: thread 100021 (pid 0, if_io_tqg_6) is sleeping on 0xfffff80003919a00 "-" chain 110: thread 100022 (pid 0, if_io_tqg_7) is sleeping on 0xfffff80003919900 "-" chain 111: thread 100023 (pid 0, if_io_tqg_8) is sleeping on 0xfffff80003919800 "-" chain 112: thread 100024 (pid 0, if_io_tqg_9) is sleeping on 0xfffff80003919700 "-" chain 113: thread 100025 (pid 0, if_io_tqg_10) is sleeping on 0xfffff80003919600 "-" chain 114: thread 100026 (pid 0, if_io_tqg_11) is sleeping on 0xfffff80003919500 "-" chain 115: thread 100027 (pid 0, if_config_tqg_0) is sleeping on 0xfffff80003919400 "-" chain 116: thread 100028 (pid 0, softirq_0) is sleeping on 0xfffff80003919300 "-" chain 117: thread 100029 (pid 0, softirq_1) is sleeping on 0xfffff80003919200 "-" chain 118: thread 100030 (pid 0, softirq_2) is sleeping on 0xfffff80003919100 "-" chain 119: thread 100031 (pid 0, softirq_3) is sleeping on 0xfffff80003919000 "-" chain 120: thread 100032 (pid 0, softirq_4) is sleeping on 0xfffff8000391ae00 "-" chain 121: thread 100033 (pid 0, softirq_5) is sleeping on 0xfffff8000391ad00 "-" chain 122: thread 100034 (pid 0, softirq_6) is sleeping on 0xfffff8000391ac00 "-" chain 123: thread 100035 (pid 0, softirq_7) is sleeping on 0xfffff8000391ab00 "-" chain 124: thread 100036 (pid 0, softirq_8) is sleeping on 0xfffff8000391aa00 "-" chain 125: thread 100037 (pid 0, softirq_9) is sleeping on 0xfffff8000391a900 "-" chain 126: thread 100038 (pid 0, softirq_10) is sleeping on 0xfffff8000391a800 "-" chain 127: thread 100039 (pid 0, softirq_11) is sleeping on 0xfffff8000391a700 "-" chain 128: thread 100040 (pid 0, thread taskq) is sleeping on 0xfffff8000393c100 "-" chain 129: thread 100042 (pid 0, aiod_kick taskq) is sleeping on 0xfffff80003939e00 "-" chain 130: thread 100043 (pid 0, in6m_free taskq) is sleeping on 0xfffff80003939d00 "-" chain 131: thread 100044 (pid 0, kqueue_ctx taskq) is sleeping on 0xfffff80003939c00 "-" chain 132: thread 100061 (pid 0, firmware taskq) is sleeping on 0xfffff80003a6f300 "-" chain 133: thread 100066 (pid 0, crypto_0) is sleeping on 0xfffff80003a6f200 "-" chain 134: thread 100067 (pid 0, crypto_1) is sleeping on 0xfffff80003a6f200 "-" chain 135: thread 100068 (pid 0, crypto_2) is sleeping on 0xfffff80003a6f200 "-" chain 136: thread 100069 (pid 0, crypto_3) is sleeping on 0xfffff80003a6f200 "-" chain 137: thread 100070 (pid 0, crypto_4) is sleeping on 0xfffff80003a6f200 "-" chain 138: thread 100071 (pid 0, crypto_5) is sleeping on 0xfffff80003a6f200 "-" chain 139: thread 100072 (pid 0, crypto_6) is sleeping on 0xfffff80003a6f200 "-" chain 140: thread 100073 (pid 0, crypto_7) is sleeping on 0xfffff80003a6f200 "-" chain 141: thread 100074 (pid 0, crypto_8) is sleeping on 0xfffff80003a6f200 "-" chain 142: thread 100075 (pid 0, crypto_9) is sleeping on 0xfffff80003a6f200 "-" chain 143: thread 100076 (pid 0, crypto_10) is sleeping on 0xfffff80003a6f200 "-" chain 144: thread 100077 (pid 0, crypto_11) is sleeping on 0xfffff80003a6f200 "-" chain 145: thread 100114 (pid 0, mca taskq) is sleeping on 0xfffff80003a70e00 "-" chain 146: thread 100120 (pid 0, acpi_task_0) is sleeping on 0xfffff80021131500 "-" chain 147: thread 100121 (pid 0, acpi_task_1) is sleeping on 0xfffff80021131500 "-" chain 148: thread 100122 (pid 0, acpi_task_2) is sleeping on 0xfffff80021131500 "-" chain 149: thread 100124 (pid 0, CAM taskq) is sleeping on 0xfffff80003a6f100 "-" db:0:pho> chain 1: thread 100260 (pid 6483, sendfile21) is sleeping on 0xfffffe00e591c55c "sbwait" chain 2: thread 100172 (pid 6481, sendfile21) is sleeping on 0xfffff800211f4520 "wait" chain 3: thread 100249 (pid 3452, swap) is sleeping on 0xfffff80170ea8520 "wait" chain 4: thread 100269 (pid 3450, swap) is sleeping on 0xffffffff81cadcd6 "nanslp" chain 5: thread 100270 (pid 3445, md10) is sleeping on 0xfffff80170e1c000 "mdwait" chain 6: thread 100219 (pid 3429, sh) is sleeping on 0xfffff8013a8fa000 "wait" chain 7: thread 100184 (pid 2499, top) is sleeping on 0xfffff80021b13ac0 "select" chain 8: thread 100195 (pid 2493, bash) is sleeping on 0xfffff8013a3f0520 "wait" chain 9: thread 100216 (pid 2492, sshd) is sleeping on 0xfffff80021a683c0 "select" chain 10: thread 100250 (pid 2489, sshd) is sleeping on 0xfffff800031c8840 "select" chain 11: thread 100154 (pid 2449, bash) is sleeping on 0xfffff8002192e520 "wait" chain 12: thread 100218 (pid 2447, csh) is sleeping on 0xfffff800211f3ae8 "pause" chain 13: thread 100197 (pid 2446, su) is sleeping on 0xfffff80004195a40 "wait" chain 14: thread 100215 (pid 2440, bash) is sleeping on 0xfffff8013a8fa520 "wait" chain 15: thread 100209 (pid 2439, sshd) is sleeping on 0xfffff80021329dc0 "select" chain 16: thread 100200 (pid 2436, sshd) is sleeping on 0xfffff80021319d40 "select" chain 17: thread 100199 (pid 2432, csh) is sleeping on 0xfffff800170698b0 "ttyin" chain 18: thread 100213 (pid 2431, login) is sleeping on 0xfffff8013a8faa40 "wait" chain 19: thread 100212 (pid 2430, getty) is sleeping on 0xfffff8001706b4b0 "ttyin" chain 20: thread 100211 (pid 2429, getty) is sleeping on 0xfffff800211444b0 "ttyin" chain 21: thread 100210 (pid 2428, getty) is sleeping on 0xfffff80021144cb0 "ttyin" chain 22: thread 100146 (pid 2427, getty) is sleeping on 0xfffff800210844b0 "ttyin" chain 23: thread 100185 (pid 2426, getty) is sleeping on 0xfffff80021084cb0 "ttyin" chain 24: thread 100194 (pid 2425, getty) is sleeping on 0xfffff800210834b0 "ttyin" chain 25: thread 100181 (pid 2424, getty) is sleeping on 0xfffff80021083cb0 "ttyin" chain 26: thread 100208 (pid 2423, getty) is sleeping on 0xfffff800210864b0 "ttyin" chain 27: thread 100142 (pid 2422, getty) is sleeping on 0xfffff80021086cb0 "ttyin" chain 28: thread 100190 (pid 2373, cron) is sleeping on 0xffffffff81cadcd2 "nanslp" chain 29: thread 100193 (pid 2369, sshd) is sleeping on 0xfffff8003d129a40 "select" chain 30: thread 100201 (pid 2341, powerd) is sleeping on 0xfffff800215665c0 "select" chain 31: thread 100202 (pid 2338, ntpd) is sleeping on 0xfffff80021a68540 "select" chain 32: thread 100296 (pid 2338, ntpd) is sleeping on 0xfffff800212c4100 "usem" chain 33: thread 100205 (pid 2273, NLM: master) is sleeping on 0xfffff80021540460 "rpcsvc" chain 34: thread 100196 (pid 2270, rpc.statd) is sleeping on 0xfffff8002132c040 "select" chain 35: thread 100191 (pid 2224, watchdogd) is sleeping on 0xffffffff81cadcd7 "nanslp" chain 36: thread 100167 (pid 2076, rpcbind) is sleeping on 0xfffff8002132c240 "select" chain 37: thread 100152 (pid 2066, syslogd) is sleeping on 0xfffff8003d129ac0 "select" chain 38: thread 100163 (pid 1995, devd) is sleeping on 0xfffff80021531440 "select" chain 39: thread 100171 (pid 1990, dhclient) is sleeping on 0xfffff8002131c0c0 "select" chain 40: thread 100150 (pid 1931, dhclient) is sleeping on 0xfffff800212ed040 "select" chain 41: thread 100166 (pid 1928, dhclient) is sleeping on 0xfffff80021531540 "select" chain 42: thread 100140 (pid 34, syncer) is sleeping on 0xffffffff81d99898 "syncer" chain 43: thread 100135 (pid 33, vnlru) is sleeping on 0xfffff800210f2000 "vlruwt" chain 44: thread 100131 (pid 32, bufspacedaemon-0) is sleeping on 0xffffffff8180aa00 "-" chain 45: thread 100132 (pid 32, bufspacedaemon-1) is sleeping on 0xffffffff81812cc0 "-" chain 46: thread 100133 (pid 32, bufspacedaemon-2) is sleeping on 0xffffffff8181af80 "-" chain 47: thread 100136 (pid 32, bufspacedaemon-3) is sleeping on 0xffffffff81823240 "-" chain 48: thread 100137 (pid 32, bufspacedaemon-4) is sleeping on 0xffffffff8182b500 "-" chain 49: thread 100138 (pid 32, bufspacedaemon-5) is sleeping on 0xffffffff818337c0 "-" chain 50: thread 100139 (pid 32, bufspacedaemon-6) is sleeping on 0xffffffff8183ba80 "-" chain 51: thread 100151 (pid 32, / worker) is sleeping on 0xfffff800214fd8e8 "sdflush" chain 52: thread 100206 (pid 32, /tmp worker) is sleeping on 0xfffff800218244e8 "sdflush" chain 53: thread 100129 (pid 31, vmdaemon) is sleeping on 0xffffffff81dbdac8 "psleep" chain 54: thread 100128 (pid 30, dom0) is sleeping on 0xffffffff81db2098 "psleep" chain 55: thread 100134 (pid 30, laundry: dom0) is sleeping on 0xffffffff81590bb0 "laundp" chain 56: thread 100141 (pid 30, uma) is sleeping on 0xffffffff80f08770 "umarcl" chain 57: thread 100127 (pid 29, enc_daemon1) is sleeping on 0xfffff800212b7000 "idle" chain 58: thread 100126 (pid 28, enc_daemon0) is sleeping on 0xfffff800211f3520 "idle" chain 59: thread 100123 (pid 27, rand_harvestq) is sleeping on 0xffffffff81ae18a0 "-" chain 60: thread 100119 (pid 26, sctp_iterator) is sleeping on 0xffffffff81d9c010 "waiting_for_work" chain 61: thread 100118 (pid 25, soaiod4) is sleeping on 0xffffffff81d984ec "-" chain 62: thread 100117 (pid 24, soaiod3) is sleeping on 0xffffffff81d984ec "-" chain 63: thread 100116 (pid 23, soaiod2) is sleeping on 0xffffffff81d984ec "-" chain 64: thread 100115 (pid 22, soaiod1) is sleeping on 0xffffffff81d984ec "-" chain 65: thread 100096 (pid 21, usbus0) is sleeping on 0xfffffe00d2d84440 "-" chain 66: thread 100097 (pid 21, usbus0) is sleeping on 0xfffffe00d2d84498 "-" chain 67: thread 100098 (pid 21, usbus0) is sleeping on 0xfffffe00d2d844f0 "-" chain 68: thread 100099 (pid 21, usbus0) is sleeping on 0xfffffe00d2d84548 "-" chain 69: thread 100100 (pid 21, usbus0) is sleeping on 0xfffffe00d2d845a0 "-" chain 70: thread 100102 (pid 21, usbus1) is sleeping on 0xfffffe003e4a2cf0 "-" chain 71: thread 100103 (pid 21, usbus1) is sleeping on 0xfffffe003e4a2d48 "-" chain 72: thread 100104 (pid 21, usbus1) is sleeping on 0xfffffe003e4a2da0 "-" chain 73: thread 100105 (pid 21, usbus1) is sleeping on 0xfffffe003e4a2df8 "-" chain 74: thread 100106 (pid 21, usbus1) is sleeping on 0xfffffe003e4a2e50 "-" chain 75: thread 100107 (pid 21, usbus2) is sleeping on 0xfffffe00d2e23cf0 "-" chain 76: thread 100108 (pid 21, usbus2) is sleeping on 0xfffffe00d2e23d48 "-" chain 77: thread 100109 (pid 21, usbus2) is sleeping on 0xfffffe00d2e23da0 "-" chain 78: thread 100110 (pid 21, usbus2) is sleeping on 0xfffffe00d2e23df8 "-" chain 79: thread 100111 (pid 21, usbus2) is sleeping on 0xfffffe00d2e23e50 "-" chain 80: thread 100091 (pid 20, doneq0) is sleeping on 0xffffffff819b95c0 "-" chain 81: thread 100093 (pid 20, doneq2) is sleeping on 0xffffffff819b96c0 "-" chain 82: thread 100125 (pid 20, scanner) is sleeping on 0xffffffff819b9490 "-" chain 83: thread 100090 (pid 19, crypto returns 11) is sleeping on 0xfffff80003b0fc50 "crypto_ret_wait" chain 84: thread 100089 (pid 18, crypto returns 10) is sleeping on 0xfffff80003b0fbf0 "crypto_ret_wait" chain 85: thread 100088 (pid 17, crypto returns 9) is sleeping on 0xfffff80003b0fb90 "crypto_ret_wait" chain 86: thread 100087 (pid 16, crypto returns 8) is sleeping on 0xfffff80003b0fb30 "crypto_ret_wait" chain 87: thread 100086 (pid 15, crypto returns 7) is sleeping on 0xfffff80003b0fad0 "crypto_ret_wait" chain 88: thread 100085 (pid 9, crypto returns 6) is sleeping on 0xfffff80003b0fa70 "crypto_ret_wait" chain 89: thread 100084 (pid 8, crypto returns 5) is sleeping on 0xfffff80003b0fa10 "crypto_ret_wait" chain 90: thread 100083 (pid 7, crypto returns 4) is sleeping on 0xfffff80003b0f9b0 "crypto_ret_wait" chain 91: thread 100082 (pid 6, crypto returns 3) is sleeping on 0xfffff80003b0f950 "crypto_ret_wait" chain 92: thread 100081 (pid 5, crypto returns 2) is sleeping on 0xfffff80003b0f8f0 "crypto_ret_wait" chain 93: thread 100080 (pid 4, crypto returns 1) is sleeping on 0xfffff80003b0f890 "crypto_ret_wait" chain 94: thread 100079 (pid 3, crypto returns 0) is sleeping on 0xfffff80003b0f830 "crypto_ret_wait" chain 95: thread 100078 (pid 2, crypto) is sleeping on 0xffffffff81daf7c0 "crypto_wait" chain 96: thread 100065 (pid 14, sequencer 00) is sleeping on 0xfffff80003a2e488 "seqstate" chain 97: thread 100062 (pid 13, g_event) is sleeping on 0xffffffff81c8cc80 "-" chain 98: thread 100063 (pid 13, g_up) is sleeping on 0xffffffff81c8cc88 "-" chain 99: thread 100064 (pid 13, g_down) is sleeping on 0xffffffff81c8cc90 "-" chain 100: thread 100002 (pid 1, init) is sleeping on 0xfffff800038f8000 "wait" chain 101: thread 100001 (pid 10, audit) is sleeping on 0xffffffff81dafc98 "audit_worker_cv" chain 102: thread 100000 (pid 0, swapper) is sleeping on 0xffffffff81c8d210 "swapin" chain 103: thread 100015 (pid 0, if_io_tqg_0) is sleeping on 0xfffff8000391c100 "-" chain 104: thread 100016 (pid 0, if_io_tqg_1) is sleeping on 0xfffff8000391c000 "-" chain 105: thread 100017 (pid 0, if_io_tqg_2) is sleeping on 0xfffff80003919e00 "-" chain 106: thread 100018 (pid 0, if_io_tqg_3) is sleeping on 0xfffff80003919d00 "-" chain 107: thread 100019 (pid 0, if_io_tqg_4) is sleeping on 0xfffff80003919c00 "-" chain 108: thread 100020 (pid 0, if_io_tqg_5) is sleeping on 0xfffff80003919b00 "-" chain 109: thread 100021 (pid 0, if_io_tqg_6) is sleeping on 0xfffff80003919a00 "-" chain 110: thread 100022 (pid 0, if_io_tqg_7) is sleeping on 0xfffff80003919900 "-" chain 111: thread 100023 (pid 0, if_io_tqg_8) is sleeping on 0xfffff80003919800 "-" chain 112: thread 100024 (pid 0, if_io_tqg_9) is sleeping on 0xfffff80003919700 "-" chain 113: thread 100025 (pid 0, if_io_tqg_10) is sleeping on 0xfffff80003919600 "-" chain 114: thread 100026 (pid 0, if_io_tqg_11) is sleeping on 0xfffff80003919500 "-" chain 115: thread 100027 (pid 0, if_config_tqg_0) is sleeping on 0xfffff80003919400 "-" chain 116: thread 100028 (pid 0, softirq_0) is sleeping on 0xfffff80003919300 "-" chain 117: thread 100029 (pid 0, softirq_1) is sleeping on 0xfffff80003919200 "-" chain 118: thread 100030 (pid 0, softirq_2) is sleeping on 0xfffff80003919100 "-" chain 119: thread 100031 (pid 0, softirq_3) is sleeping on 0xfffff80003919000 "-" chain 120: thread 100032 (pid 0, softirq_4) is sleeping on 0xfffff8000391ae00 "-" chain 121: thread 100033 (pid 0, softirq_5) is sleeping on 0xfffff8000391ad00 "-" chain 122: thread 100034 (pid 0, softirq_6) is sleeping on 0xfffff8000391ac00 "-" chain 123: thread 100035 (pid 0, softirq_7) is sleeping on 0xfffff8000391ab00 "-" chain 124: thread 100036 (pid 0, softirq_8) is sleeping on 0xfffff8000391aa00 "-" chain 125: thread 100037 (pid 0, softirq_9) is sleeping on 0xfffff8000391a900 "-" chain 126: thread 100038 (pid 0, softirq_10) is sleeping on 0xfffff8000391a800 "-" chain 127: thread 100039 (pid 0, softirq_11) is sleeping on 0xfffff8000391a700 "-" chain 128: thread 100040 (pid 0, thread taskq) is sleeping on 0xfffff8000393c100 "-" chain 129: thread 100042 (pid 0, aiod_kick taskq) is sleeping on 0xfffff80003939e00 "-" chain 130: thread 100043 (pid 0, in6m_free taskq) is sleeping on 0xfffff80003939d00 "-" chain 131: thread 100044 (pid 0, kqueue_ctx taskq) is sleeping on 0xfffff80003939c00 "-" chain 132: thread 100061 (pid 0, firmware taskq) is sleeping on 0xfffff80003a6f300 "-" chain 133: thread 100066 (pid 0, crypto_0) is sleeping on 0xfffff80003a6f200 "-" chain 134: thread 100067 (pid 0, crypto_1) is sleeping on 0xfffff80003a6f200 "-" chain 135: thread 100068 (pid 0, crypto_2) is sleeping on 0xfffff80003a6f200 "-" chain 136: thread 100069 (pid 0, crypto_3) is sleeping on 0xfffff80003a6f200 "-" chain 137: thread 100070 (pid 0, crypto_4) is sleeping on 0xfffff80003a6f200 "-" chain 138: thread 100071 (pid 0, crypto_5) is sleeping on 0xfffff80003a6f200 "-" chain 139: thread 100072 (pid 0, crypto_6) is sleeping on 0xfffff80003a6f200 "-" chain 140: thread 100073 (pid 0, crypto_7) is sleeping on 0xfffff80003a6f200 "-" chain 141: thread 100074 (pid 0, crypto_8) is sleeping on 0xfffff80003a6f200 "-" chain 142: thread 100075 (pid 0, crypto_9) is sleeping on 0xfffff80003a6f200 "-" chain 143: thread 100076 (pid 0, crypto_10) is sleeping on 0xfffff80003a6f200 "-" chain 144: thread 100077 (pid 0, crypto_11) is sleeping on 0xfffff80003a6f200 "-" chain 145: thread 100114 (pid 0, mca taskq) is sleeping on 0xfffff80003a70e00 "-" chain 146: thread 100120 (pid 0, acpi_task_0) is sleeping on 0xfffff80021131500 "-" chain 147: thread 100121 (pid 0, acpi_task_1) is sleeping on 0xfffff80021131500 "-" chain 148: thread 100122 (pid 0, acpi_task_2) is sleeping on 0xfffff80021131500 "-" chain 149: thread 100124 (pid 0, CAM taskq) is sleeping on 0xfffff80003a6f100 "-" db> reset cpu_reset: Restarting BSP cpu_reset_proxy: Stopped CPU 10 (kgdb) bt #0 __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:55 #1 doadump (textdump=0x0) at ../../../kern/kern_shutdown.c:394 #2 0xffffffff8049b63a in db_dump (dummy=, dummy2=, dummy3=, dummy4=) at ../../../ddb/db_command.c:575 #3 0xffffffff8049b3fc in db_command (last_cmdp=, cmd_table=, dopager=0x0) at ../../../ddb/db_command.c:482 #4 0xffffffff804a0378 in db_script_exec (scriptname=, warnifnotfound=) at ../../../ddb/db_script.c:304 #5 0xffffffff8049b3fc in db_command (last_cmdp=, cmd_table=, dopager=0x0) at ../../../ddb/db_command.c:482 #6 0xffffffff804a0378 in db_script_exec (scriptname=, warnifnotfound=) at ../../../ddb/db_script.c:304 #7 0xffffffff8049b3fc in db_command (last_cmdp=, cmd_table=, dopager=0x1) at ../../../ddb/db_command.c:482 #8 0xffffffff8049b16d in db_command_loop () at ../../../ddb/db_command.c:535 #9 0xffffffff8049e388 in db_trap (type=, code=) at ../../../ddb/db_main.c:253 #10 0xffffffff80c10674 in kdb_trap (type=0x3, code=0x0, tf=) at ../../../kern/subr_kdb.c:699 #11 0xffffffff8106eea8 in trap (frame=0xfffffe00e684a120) at ../../../amd64/amd64/trap.c:578 #12 #13 kdb_enter (why=0xffffffff811ff809 "panic", msg=) at ../../../kern/subr_kdb.c:486 #14 0xffffffff80bc5c6e in vpanic (fmt=, ap=) at ../../../kern/kern_shutdown.c:902 #15 0xffffffff80bc5a03 in panic (fmt=0xffffffff81c8eb68 "\320\065\034\201\377\377\377\377") at ../../../kern/kern_shutdown.c:839 #16 0xffffffff8106f2f7 in trap_fatal (frame=0xfffffe00e684a480, eva=0x8) at ../../../amd64/amd64/trap.c:919 #17 0xffffffff8106f399 in trap_pfault (frame=0xfffffe00e684a480, usermode=, signo=, ucode=) at ../../../amd64/amd64/trap.c:736 #18 0xffffffff8106e995 in trap (frame=0xfffffe00e684a480) at ../../../amd64/amd64/trap.c:400 #19 #20 0xffffffff80bc34c5 in sendfile_iodone (arg=0xfffff800210d6e00, pa=0x0, count=0x0, error=0x0) at ../../../kern/kern_sendfile.c:318 #21 0xffffffff80bc1fa9 in vn_sendfile (fp=0xfffff800218aa2d0, sockfd=0x3, hdr_uio=0x0, trl_uio=0x0, offset=0x0, nbytes=0x64000, sent=0xfffffe00e684aa40, flags=0x0, td=0xfffffe00d61fc700) at ../../../kern/kern_sendfile.c:1172 #22 0xffffffff80bc493e in fo_sendfile (fp=0xfffff800218aa2d0, sockfd=0x3, hdr_uio=0x0, trl_uio=0x0, offset=0x0, nbytes=0x64000, sent=0xfffffe00e684aa40, flags=0x0, td=0xfffffe00d61fc700) at ../../../sys/file.h:397 #23 0xffffffff80bc43e0 in sendfile (td=0xfffffe00d61fc700, uap=0xfffffe00d61fcad8, compat=0x0) at ../../../kern/kern_sendfile.c:1300 #24 0xffffffff80bc41f4 in sys_sendfile (td=0xfffffe00d61fc700, uap=0xfffffe00d61fcad8) at ../../../kern/kern_sendfile.c:1328 #25 0xffffffff8106fcf9 in syscallenter (td=0xfffffe00d61fc700) at ../../../amd64/amd64/../../kern/subr_syscall.c:162 #26 amd64_syscall (td=0xfffffe00d61fc700, traced=0x0) at ../../../amd64/amd64/trap.c:1161 #27 #28 0x00000008002ddefa in ?? () Backtrace stopped: Cannot access memory at address 0x7fffffffd5a8 (kgdb) f 20 #20 0xffffffff80bc34c5 in sendfile_iodone (arg=0xfffff800210d6e00, pa=0x0, count=0x0, error=0x0) at ../../../kern/kern_sendfile.c:318 318 if (pa[i] == NULL) (kgdb) l 313 if (!refcount_release(&sfio->nios)) 314 return; 315 316 #ifdef INVARIANTS 317 for (i = 1; i < sfio->npages; i++) { 318 if (pa[i] == NULL) 319 break; 320 KASSERT(vm_page_wired(sfio->pa[i]), 321 ("sfio %p page %d %p not wired", sfio, i, pa[i])); 322 if (i == 0) (kgdb) info loc sfio = 0xfffff800210d6e00 so = 0xffffffff80bc0820 i = 0x1 saved_vnet = 0xfffffe0000000000 (kgdb) p pa[1] Cannot access memory at address 0x8 (kgdb) f 21 #21 0xffffffff80bc1fa9 in vn_sendfile (fp=0xfffff800218aa2d0, sockfd=0x3, hdr_uio=0x0, trl_uio=0x0, offset=0x0, nbytes=0x64000, sent=0xfffffe00e684aa40, flags=0x0, td=0xfffffe00d61fc700) at ../../../kern/kern_sendfile.c:1172 1172 sendfile_iodone(sfio, NULL, 0, 0); (kgdb) Index: src/sys/kern/kern_sendfile.c =================================================================== --- src/sys/kern/kern_sendfile.c (revision 359962) +++ src/sys/kern/kern_sendfile.c (working copy) @@ -295,10 +295,12 @@ sendfile_iodone(void *arg, vm_page_t *pa, int coun * unbusied the swapped-in pages, they can become * invalid under us. */ + MPASS(count == 0 || pa[0] != bogus_page); for (i = 0; i < count; i++) { if (pa[i] == bogus_page) { - pa[i] = vm_page_relookup(sfio->obj, - sfio->pindex0 + i + (pa - sfio->pa)); + sfio->pa[(pa[0]->pindex - sfio->pindex0) + i] = + pa[i] = vm_page_relookup(sfio->obj, + pa[0]->pindex + i); KASSERT(pa[i] != NULL, ("%s: page %p[%d] disappeared", __func__, pa, i)); @@ -311,6 +313,24 @@ sendfile_iodone(void *arg, vm_page_t *pa, int coun if (!refcount_release(&sfio->nios)) return; +#ifdef INVARIANTS + for (i = 1; i < sfio->npages; i++) { + if (pa[i] == NULL) + break; + KASSERT(vm_page_wired(sfio->pa[i]), + ("sfio %p page %d %p not wired", sfio, i, pa[i])); + if (i == 0) + continue; + KASSERT(sfio->pa[0]->object == sfio->pa[i]->object, + ("sfio %p page %d %p wrong owner %p %p", sfio, i, pa[i], + sfio->pa[0]->object, sfio->pa[i]->object)); + KASSERT(sfio->pa[0]->pindex + i == sfio->pa[i]->pindex, + ("sfio %p page %d %p wrong index %jx %jx", sfio, i, pa[i], + (uintmax_t)sfio->pa[0]->pindex, + (uintmax_t)sfio->pa[i]->pindex)); + } +#endif + vm_object_pip_wakeup(sfio->obj); if (sfio->m == NULL) { -- Test scenario: wip/sendfile21c.sh