panic: lockmgr_xlock_hard: recursing on non recursive lockmgr 0xfffffe0039029140 @ ../../../kern/vfs_bio.c:4038, vmcore.778 KDB: debugger backends: ddb KDB: current backend: ddb ---<>--- Copyright (c) 1992-2023 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 15.0-CURRENT #0 main-n266816-62d47a4db45793: Tue Dec 5 09:43:26 CET 2023 pho@mercat1.netperf.freebsd.org:/usr/src/sys/amd64/compile/PHO amd64 FreeBSD clang version 16.0.6 (https://github.com/llvm/llvm-project.git llvmorg-16.0.6-0-g7cbf1a259152) WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. VT(vga): resolution 640x480 CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.13-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab Structured Extended Features3=0x9c000400 XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics real memory = 34359738368 (32768 MB) avail memory = 33172803584 (31636 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 12 CPUs FreeBSD/SMP: 1 package(s) x 6 core(s) x 2 hardware threads random: registering fast source Intel Secure Key RNG random: fast provider: "Intel Secure Key RNG" random: unblocking device. ioapic0 irqs 0-23 ioapic1 irqs 24-47 Launching APs: 1 6 8 10 9 5 11 4 2 7 3 random: entropy device external interface kbd1 at kbdmux0 vtvga0: smbios0: at iomem 0xf05e0-0xf05fe smbios0: Version: 3.0, BCD Revision: 3.0 aesni0: acpi0: <> acpi0: Power Button (fixed) cpu0: on acpi0 atrtc0: port 0x70-0x71,0x74-0x77 irq 8 on acpi0 atrtc0: registered as a time-of-day clock, resolution 1.000000s Event timer "RTC" frequency 32768 Hz quality 0 attimer0: port 0x40-0x43,0x50-0x53 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Event timer "HPET" frequency 14318180 Hz quality 350 Event timer "HPET1" frequency 14318180 Hz quality 340 Event timer "HPET2" frequency 14318180 Hz quality 340 Event timer "HPET3" frequency 14318180 Hz quality 340 Event timer "HPET4" frequency 14318180 Hz quality 340 Event timer "HPET5" frequency 14318180 Hz quality 340 Event timer "HPET6" frequency 14318180 Hz quality 340 Event timer "HPET7" frequency 14318180 Hz quality 340 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 pcib0: on acpi0 pci0: on pcib0 pci0: at device 11.1 (no driver attached) pci0: at device 11.2 (no driver attached) pci0: at device 16.1 (no driver attached) pci0: at device 16.6 (no driver attached) pci0: at device 18.1 (no driver attached) acpi_syscontainer0: on acpi0 pcib1: port 0xcf8-0xcff on acpi0 pci1: on pcib1 pcib2: irq 26 at device 1.0 on pci1 pci2: on pcib2 pcib3: irq 32 at device 2.0 on pci1 pci3: on pcib3 pci3: at device 0.0 (no driver attached) pci3: at device 0.1 (no driver attached) pcib4: irq 40 at device 3.0 on pci1 pci4: on pcib4 pci1: at device 17.0 (no driver attached) ahci0: port 0xf110-0xf117,0xf100-0xf103,0xf0f0-0xf0f7,0xf0e0-0xf0e3,0xf020-0xf03f mem 0xfb416000-0xfb4167ff irq 16 at device 17.4 on pci1 ahci0: AHCI v1.30 with 4 6Gbps ports, Port Multiplier not supported ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahcich2: at channel 2 on ahci0 ahcich3: at channel 3 on ahci0 ahciem0: on ahci0 xhci0: mem 0xfb400000-0xfb40ffff irq 19 at device 20.0 on pci1 xhci0: 32 bytes context size, 64-bit DMA usbus0 on xhci0 usbus0: 5.0Gbps Super Speed USB v3.0 pci1: at device 22.0 (no driver attached) pci1: at device 22.1 (no driver attached) ehci0: mem 0xfb412000-0xfb4123ff irq 18 at device 26.0 on pci1 usbus1: EHCI version 1.0 usbus1 on ehci0 usbus1: 480Mbps High Speed USB v2.0 pcib5: irq 16 at device 28.0 on pci1 pci5: on pcib5 pcib6: irq 18 at device 28.2 on pci1 pci6: on pcib6 pcib7: at device 0.0 on pci6 pci7: on pcib7 vgapci0: port 0xe000-0xe07f mem 0xfa000000-0xfaffffff,0xfb000000-0xfb01ffff irq 18 at device 0.0 on pci7 vgapci0: Boot video device pcib8: irq 16 at device 28.4 on pci1 pci8: on pcib8 igb0: port 0xd020-0xd03f mem 0xfb320000-0xfb33ffff,0xfb344000-0xfb347fff irq 16 at device 0.0 on pci8 igb0: EEPROM V1.63-0 eTrack 0x800009fa igb0: Using 1024 TX descriptors and 1024 RX descriptors igb0: queue equality override not set, capping rx_queues at 6 and tx_queues at 6 igb0: Using 6 RX queues 6 TX queues igb0: Using MSI-X interrupts with 7 vectors igb0: Ethernet address: 0c:c4:7a:a8:cd:da igb0: netmap queues/slots: TX 6/1024, RX 6/1024 igb1: port 0xd000-0xd01f mem 0xfb300000-0xfb31ffff,0xfb340000-0xfb343fff irq 17 at device 0.1 on pci8 igb1: EEPROM V1.63-0 eTrack 0x800009fa igb1: Using 1024 TX descriptors and 1024 RX descriptors igb1: queue equality override not set, capping rx_queues at 6 and tx_queues at 6 igb1: Using 6 RX queues 6 TX queues igb1: Using MSI-X interrupts with 7 vectors igb1: Ethernet address: 0c:c4:7a:a8:cd:db igb1: netmap queues/slots: TX 6/1024, RX 6/1024 ehci1: mem 0xfb411000-0xfb4113ff irq 18 at device 29.0 on pci1 usbus2: EHCI version 1.0 usbus2 on ehci1 usbus2: 480Mbps High Speed USB v2.0 isab0: at device 31.0 on pci1 isa0: on isab0 ahci1: port 0xf070-0xf077,0xf060-0xf063,0xf050-0xf057,0xf00-0xf01f mem 0xfb410000-0xfb4107ff irq 16 at device 31.2 on pci1 ahci1: AHCI v1.30 with 6 6Gbps ports, Port Multiplier not supported ahcich4: at channel 0 on ahci1 ahcich5: at channel 1 on ahci1 ahcich6: at channel 2 on ahci1 ahcich7: at channel 3 on ahci1 ahcich8: at channel 4 on ahci1 ahcich9: at channel 5 on ahci1 ahciem1: on ahci1 acpi_button0: on acpi0 apei0: on acpi0 uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0 uart1: console (115200,n,8,1) orm0: at iomem 0xc0000-0xc7fff,0xcb000-0xcbfff pnpid ORM0000 on isa0 est0: on cpu0 NULL mp in getnewvnode(9), tag crossmp Timecounter "TSC-low" frequency 1749998570 Hz quality 1000 Timecounters tick every 1.000 msec Expensive callout(9) function: 0xffffffff804e6970(0xfffffe0109fd1000) 0.005355652 s ada0 at ahcich1 bus 0 scbus1 target 0 lun 0 ada0: ACS-2 ATA SATA 3.x device ada0: Serial Number WD-WCC3F3KDDP98 ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes) ada0: Command Queueing enabled ada0: 953869MB (1953525168 512 byte sectors) ada0: quirks=0x1<4K> ses0 at ahciem0 bus 0 scbus4 target 0 lun 0 ses0: SEMB S-E-S 2.00 device ses0: SEMB SES Device ses1 at ahciem1 bus 0 scbus11 target 0 lun 0 ses1: SEMB S-E-S 2.00 device ses1: SEMB SES Device ses0: ada0,pass0 in 'Slot 01', SATA Slot: scbus1 target 0 Expensive callout(9) function: 0xffffffff80993c20(0xffffffff816a9da8) 0.007388906 s mlx5_core0: mem 0xf8000000-0xf9ffffff irq 32 at device 0.0 on pci3 mlx5: Mellanox Core driver 3.7.1 (November 2021)ugen1.1: at usbus1 mlx5_core0: ERR: mlx5_load_one:1101:(pid 0): Failed initializing command interface, aborting ugen0.1: at usbus0 ugen2.1: at usbus2 mlx5_core0: ERR: init_one:1694:(pid 0): mlx5_load_one failed -12 uhub0 on usbus2 uhub0: on usbus2 uhub1 on usbus1 uhub1: on usbus1 uhub2 on usbus0 uhub2: on usbus0 device_attach: mlx5_core0 attach returned 12 mlx5_core0: mem 0xf6000000-0xf7ffffff irq 32 at device ARNING: / was not properly dismounted Dual Console: Serial Primary, Video Secondary Setting hostuuid: 00000000-0000-0000-0000-002590c99976. Setting hostid: 0x90b83241. Starting file system checks: WARNING: / was not properly dismounted Mounting local filesystems:. Autoloading module: acpi_wmi Autoloading module: ichsmb Autoloading module: ioat Autoloading moduioat0: mem 0x383ffff1c000-0x383ffff1ffff irq 31 at device 4.0 on pci1 ioat0: Capabilities: 2f7 le: mlx5 ioat1: mem 0x383ffff18000-0x383ffff1bfff irq 39 at device 4.1 on pci1 ioat1: Capabilities: 2f7 ioat2: mem 0x383ffff14000-0x383ffff17fff irq 31 at device 4.2 on pci1 ioat2: Capabilities: f7 ioat3: mem 0x383ffff10000-0x383ffff13fff irq 39 at device 4.3 on pci1 ioat3: Capabilities: f7 ioat4: mem 0x383ffff0c000-0x383ffff0ffff irq 31 at device 4.4 on pci1 ioat4: Capabilities: f7 ioat5: mem 0x383ffff08000-0x383ffff0bfff irq 39 at device 4.5 on pci1 ioat5: Capabilities: f7 ioat6: mem 0x383ffff04000-0x383ffff07fff irq 31 at device 4.6 on pci1 ioat6: Capabilities: f7 ioat7: mem 0x383ffff00000-0x383ffff03fff irq 39 at device 4.7 on pci1 ioat7: Capabilities: f7 ichsmb0: port 0x580-0x59f mem 0x383ffff21000-0x383ffff210ff irq 18 at device 31.3 on pci1 smbus0: on ichsmb0 mlx5_core0: mem 0xf8000000-0xf9ffffff irq 32 at device 0.0 on pci3 mlx5_core0: ERR: mlx5_load_one:1101:(pid 116): Failed initializing command interface, aborting mlx5_core0: ERR: init_one:1694:(pid 116): mlx5_load_one failed -12 device_attach: mlx5_core0 attach returned 12 mlx5_core0: mem 0xf6000000-0xf7ffffff irq 32 at device 0.1 on pci3 mlx5_core0: ERR: mlx5_load_one:1101:(pid 116): Failed initializing command interface, aborting mlx5_core0: ERR: init_one:1694:(pid 116): mlx5_load_one failed -12 device_attach: mlx5_core0 attach returned 12 mlx5_core0: mem 0xf8000000-0xf9ffffff irq 32 at device 0.0 on pci3 mlx5_core0: ERR: mlx5_load_one:1101:(pid 116): Failed initializing command interface, aborting mlx5_core0: ERR: init_one:1694:(pid 116): mlx5_load_one failed -12 device_attach: mlx5_core0 attach returned 12 mlx5_core0: mem 0xf6000000-0xf7ffffff irq 32 at device 0.1 on pci3 mlx5_core0: ERR: mlx5_load_one:1101:(pid 116): Failed initializing command interface, aborting mlx5_core0: ERR: init_one:1694:(pid 116): mlx5_load_one failed -12 device_attach: mlx5_core0 attach returned 12 acpi_wmi0: on acpi0 acpi_wmi0: cannot find EC device fsck2+ fsck -fy /tmp ** /dev/gpt/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 859 files, 29224 used, 1236183 free (119 frags, 154508 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** + set +x Updating CPU Microcode... CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.00-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab Structured Extended Features3=0x9c000400 XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics Done. Setting up harvesting: PURE_RDRAND,[CALLOUT],[UMA],[FS_ATIME],SWI,INTERRUPT,NET_NG,[NET_ETHER],NET_TUN,MOUSE,KEYBOARD,ATTACH,CACHED Feeding entropy: . Setting hostname: mercat1.netperf.freebsd.org. ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/e2fsprogs /usr/local/lib/perl5/5.36/mach/CORE 32-bit compatibility ldconfig path: /usr/lib32 /usr/local/lib32/compat igb0: link state changed to UP debugnet_any_ifnet_update: Bad dn_init result from igb0 (ifp 0xfffff800047b3800), ignoring. Autoloading module: mlx5 Autoloading module: mlx5 Starting Network: igb1. igb1: flags=8802 metric 0 mtu 1500 options=4e507bb ether 0c:c4:7a:a8:cd:db media: Ethernet autoselect status: no carrier nd6 options=29 Autoloading module: uhid Autoloading module: ums Autoloading module: usbhid ums0 on uhub3 ums0: on usbus0 ums0: 3 buttons and [Z] coordinates ID=0 Starting dhclient. DHCPREQUEST on igb0 to 255.255.255.255 port 67 DHCPACK from 192.168.5.1 bound to 192.168.5.171 -- renewal in 300 seconds. route: message indicates error: File exists add host 127.0.0.1: gateway lo0 fib 0: route already in table route: message indicates error: File exists add host ::1: gateway lo0 fib 0: route already in table add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Creating and/or trimming log files. Recovering vi editor sessions:. Updating motd:. Clearing /tmp (X related). Updating /var/run/os-release done. Starting syslogd. Setting date via ntp. 6 Dec 17:11:57 ntpdate[3257]: step time server 192.168.5.1 offset -1.243066 sec No core dumps found. Starting watchdogd. Mounting late filesystems:. Security policy loaded: MAC/ntpd (mac_ntpd) Starting ntpd. Starting powerd. Starting inetd. Starting cron. Performing sanity check on sshd configuration. Starting sshd. Wed Dec 6 17:11 FreeBSD/amd64 (mercat1.netperf.freebsd.org) (ttyu1) login: Dec 6 17:12:06 mercat1 su[3420]: pho to root on /dev/pts/0 Dec 6 18:48:43 mercat1 su[8446]: pho to root on /dev/pts/1 FreeBSD/amd64 (mercat1.netperf.freebsd.org) (ttyu1) login: Dec 6 19:50:40 mercat1 kernel: pid 11228 (cmp), jid 0, uid 0, was killed: a thread waited too long to allocate a page FreeBSD/amd64 (mercat1.netperf.freebsd.org) (ttyu1) login: MCA: Bank 9, Status 0x8c00004e000800c0 MCA: Global Cap 0x0000000007000c16, Status 0x0000000000000000 MCA: Vendor "GenuineIntel", ID 0x306f2, APIC ID 0 MCA: CPU 0 COR (1) MS channel 0 memory error MCA: Address 0x23b7c580 (Mode: Physical Address, LSB: 12) MCA: Misc 0x908401000101c8c ZFS filesystem version: 5 ZFS storage pool version: features support (5000) #0 0xffffffff80b21b1e at lockmgr_xlock_hard+0x49e #1 0xffffffff80b21fa7 at __lockmgr_args+0x207 #2 0xffffffff80c22172 at getnewbuf+0x342 #3 0xffffffff80c1f62b at getblkx+0x61b #4 0xffffffff80c21e12 at getblk+0x22 #5 0xffffffff80e9cff6 at ffs_balloc_ufs2+0x1666 #6 0xffffffff80ecd137 at ffs_write+0x257 #7 0xffffffff811366df at VOP_WRITE_APV+0xcf #8 0xffffffff80c6bc84 at vn_write+0x2f4 #9 0xffffffff80c64482 at vn_io_fault+0x1e2 #10 0xffffffff80bcde32 at dofilewrite+0x82 #11 0xffffffff80bcd982 at sys_write+0xc2 #12 0xffffffff8105f733 at amd64_syscall+0x153 #13 0xffffffff810314eb at fast_syscall_common+0xf8 panic: lockmgr_xlock_hard: recursing on non recursive lockmgr 0xfffffe0039029140 @ ../../../kern/vfs_bio.c:4038 cpuid = 2 time = 1701891235 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe015138b160 vpanic() at vpanic+0x132/frame 0xfffffe015138b290 panic() at panic+0x43/frame 0xfffffe015138b2f0 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x11c/frame 0xfffffe015138b3a0 __lockmgr_args() at __lockmgr_args+0x207/frame 0xfffffe015138b440 getblkx() at getblkx+0x1c6/frame 0xfffffe015138b500 breadn_flags() at breadn_flags+0x44/frame 0xfffffe015138b570 vfs_bio_getpages() at vfs_bio_getpages+0x33c/frame 0xfffffe015138b660 ffs_getpages() at ffs_getpages+0x77/frame 0xfffffe015138b680 VOP_GETPAGES_APV() at VOP_GETPAGES_APV+0x60/frame 0xfffffe015138b6b0 vnode_pager_getpages() at vnode_pager_getpages+0x37/frame 0xfffffe015138b6f0 vm_pager_get_pages() at vm_pager_get_pages+0x5f/frame 0xfffffe015138b740 vm_fault() at vm_fault+0x70c/frame 0xfffffe015138b870 vm_fault_trap() at vm_fault_trap+0x6f/frame 0xfffffe015138b8b0 trap_pfault() at trap_pfault+0x24a/frame 0xfffffe015138b920 calltrap() at calltrap+0x8/frame 0xfffffe015138b920 --- trap 0xc, rip = 0xffffffff8105bce6, rsp = 0xfffffe015138b9f0, rbp = 0xfffffe015138b9f0 --- copyin_nosmap_erms() at copyin_nosmap_erms+0x156/frame 0xfffffe015138b9f0 uiomove_fromphys() at uiomove_fromphys+0x15a/frame 0xfffffe015138ba60 ffs_write() at ffs_write+0x356/frame 0xfffffe015138bb10 VOP_WRITE_APV() at VOP_WRITE_APV+0xcf/frame 0xfffffe015138bc20 vn_write() at vn_write+0x2f4/frame 0xfffffe015138bcb0 vn_io_fault() at vn_io_fault+0x1e2/frame 0xfffffe015138bd40 dofilewrite() at dofilewrite+0x82/frame 0xfffffe015138bd90 sys_write() at sys_write+0xc2/frame 0xfffffe015138be00 amd64_syscall() at amd64_syscall+0x153/frame 0xfffffe015138bf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe015138bf30 --- syscall (4, FreeBSD ELF64, write), rip = 0x82249ad0a, rsp = 0x8205d3578, rbp = 0x8205d36a0 --- KDB: enter: panic [ thread pid 22418 tid 100559 ] Stopped at kdb_enter+0x32: movq $0,0xe38b83(%rip) db> run pho db:0:pho> set $lines 20000 db:0:pho> run pho1 db:1:pho1> dump Dumping 1658 out of 32622 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% Dump complete db:1:pho1> bt Tracing pid 22418 tid 100559 td 0xfffff8031c17c740 kdb_enter() at kdb_enter+0x32/frame 0xfffffe015138b160 vpanic() at vpanic+0x163/frame 0xfffffe015138b290 panic() at panic+0x43/frame 0xfffffe015138b2f0 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x11c/frame 0xfffffe015138b3a0 __lockmgr_args() at __lockmgr_args+0x207/frame 0xfffffe015138b440 getblkx() at getblkx+0x1c6/frame 0xfffffe015138b500 breadn_flags() at breadn_flags+0x44/frame 0xfffffe015138b570 vfs_bio_getpages() at vfs_bio_getpages+0x33c/frame 0xfffffe015138b660 ffs_getpages() at ffs_getpages+0x77/frame 0xfffffe015138b680 VOP_GETPAGES_APV() at VOP_GETPAGES_APV+0x60/frame 0xfffffe015138b6b0 vnode_pager_getpages() at vnode_pager_getpages+0x37/frame 0xfffffe015138b6f0 vm_pager_get_pages() at vm_pager_get_pages+0x5f/frame 0xfffffe015138b740 vm_fault() at vm_fault+0x70c/frame 0xfffffe015138b870 vm_fault_trap() at vm_fault_trap+0x6f/frame 0xfffffe015138b8b0 trap_pfault() at trap_pfault+0x24a/frame 0xfffffe015138b920 calltrap() at calltrap+0x8/frame 0xfffffe015138b920 --- trap 0xc, rip = 0xffffffff8105bce6, rsp = 0xfffffe015138b9f0, rbp = 0xfffffe015138b9f0 --- copyin_nosmap_erms() at copyin_nosmap_erms+0x156/frame 0xfffffe015138b9f0 uiomove_fromphys() at uiomove_fromphys+0x15a/frame 0xfffffe015138ba60 ffs_write() at ffs_write+0x356/frame 0xfffffe015138bb10 VOP_WRITE_APV() at VOP_WRITE_APV+0xcf/frame 0xfffffe015138bc20 vn_write() at vn_write+0x2f4/frame 0xfffffe015138bcb0 vn_io_fault() at vn_io_fault+0x1e2/frame 0xfffffe015138bd40 dofilewrite() at dofilewrite+0x82/frame 0xfffffe015138bd90 sys_write() at sys_write+0xc2/frame 0xfffffe015138be00 amd64_syscall() at amd64_syscall+0x153/frame 0xfffffe015138bf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe015138bf30 --- syscall (4, FreeBSD ELF64, write), rip = 0x82249ad0a, rsp = 0x8205d3578, rbp = 0x8205d36a0 --- db:1:pho1> show allpcpu Current CPU: 2 cpuid = 0 dynamic pcpu = 0x9f8040 curthread = 0xfffff80209dda740: pid 22338 tid 100483 critnest 0 "swap" curpcb = 0xfffff80209ddac60 fpcurthread = 0xfffff80209dda740: pid 22338 "swap" idlethread = 0xfffff80003c8f740: tid 100003 "idle: cpu0" self = 0xffffffff82210000 curpmap = 0xfffff80003dc7868 tssp = 0xffffffff82210384 rsp0 = 0xfffffe015b272000 kcr3 = 0x80000004f6bde204 ucr3 = 0x80000002d9ec5a04 scr3 = 0x770f8691a gs32p = 0xffffffff82210404 ldt = 0xffffffff82210444 tss = 0xffffffff82210434 curvnet = 0 spin locks held: cpuid = 1 dynamic pcpu = 0xfffffe00bb6ce040 curthread = 0xfffff8004c341740: pid 22333 tid 100225 critnest 0 "swap" curpcb = 0xfffff8004c341c60 fpcurthread = 0xfffff8004c341740: pid 22333 "swap" idlethread = 0xfffff80003c8f000: tid 100004 "idle: cpu1" self = 0xffffffff82211000 curpmap = 0xfffff800647a0d38 tssp = 0xffffffff82211384 rsp0 = 0xfffffe0157ac3000 kcr3 = 0x800000022557615b ucr3 = 0x800000022559295b scr3 = 0x770f86ae9 gs32p = 0xffffffff82211404 ldt = 0xffffffff82211444 tss = 0xffffffff82211434 curvnet = 0 spin locks held: cpuid = 2 dynamic pcpu = 0xfffffe00bb6dd040 curthread = 0xfffff8031c17c740: pid 22418 tid 100559 critnest 1 "mmap42" curpcb = 0xfffff8031c17cc60 fpcurthread = 0xfffff8031c17c740: pid 22418 "mmap42" idlethread = 0xfffff80003c90740: tid 100005 "idle: cpu2" self = 0xffffffff82212000 curpmap = 0xfffff8006403c130 tssp = 0xffffffff82212384 rsp0 = 0xfffffe015138c000 kcr3 = 0x800000048ae0d047 ucr3 = 0x8000000770d39847 scr3 = 0x770d39847 gs32p = 0xffffffff82212404 ldt = 0xffffffff82212444 tss = 0xffffffff82212434 curvnet = 0 spin locks held: cpuid = 3 dynamic pcpu = 0xfffffe00bb6ec040 curthread = 0xfffff8004c341000: pid 22334 tid 100227 critnest 0 "swap" curpcb = 0xfffff8004c341520 fpcurthread = 0xfffff8004c341000: pid 22334 "swap" idlethread = 0xfffff80003c90000: tid 100006 "idle: cpu3" self = 0xffffffff82213000 curpmap = 0xfffff80003dc5868 tssp = 0xffffffff82213384 rsp0 = 0xfffffe0157abe000 kcr3 = 0x800000022558051b ucr3 = 0x8000000225545d1b scr3 = 0x2d9e89bea gs32p = 0xffffffff82213404 ldt = 0xffffffff82213444 tss = 0xffffffff82213434 curvnet = 0 spin locks held: cpuid = 4 dynamic pcpu = 0xfffffe00bb6fb040 curthread = 0xfffff80209e94000: pid 22341 tid 100481 critnest 0 "swap" curpcb = 0xfffff80209e94520 fpcurthread = 0xfffff80209e94000: pid 22341 "swap" idlethread = 0xfffff80003c91740: tid 100007 "idle: cpu4" self = 0xffffffff82214000 curpmap = 0xfffff80684887ad0 tssp = 0xffffffff82214384 rsp0 = 0xfffffe015b268000 kcr3 = 0x80000002d9e8409a ucr3 = 0x80000002d9e8989a scr3 = 0x1be513cf8 gs32p = 0xffffffff82214404 ldt = 0xffffffff82214444 tss = 0xffffffff82214434 curvnet = 0 spin locks held: cpuid = 5 dynamic pcpu = 0xfffffe00bb70a040 curthread = 0xfffff8004c55e740: pid 22337 tid 100310 critnest 0 "swap" curpcb = 0xfffff8004c55ec60 fpcurthread = 0xfffff8004c55e740: pid 22337 "swap" idlethread = 0xfffff80003c91000: tid 100008 "idle: cpu5" self = 0xffffffff82215000 curpmap = 0xfffff8004c402ad0 tssp = 0xffffffff82215384 rsp0 = 0xfffffe0157bd1000 kcr3 = 0x80000004f6c1d142 ucr3 = 0x80000004f6bf8942 scr3 = 0x682220a22 gs32p = 0xffffffff82215404 ldt = 0xffffffff82215444 tss = 0xffffffff82215434 curvnet = 0 spin locks held: cpuid = 6 dynamic pcpu = 0xfffffe00bb719040 curthread = 0xfffff8031ca81740: pid 22331 tid 100355 critnest 0 "swap" curpcb = 0xfffff8031ca81c60 fpcurthread = 0xfffff8031ca81740: pid 22331 "swap" idlethread = 0xfffff80003c82740: tid 100009 "idle: cpu6" self = 0xffffffff82216000 curpmap = 0xfffff80003dc5d38 tssp = 0xffffffff82216384 rsp0 = 0xfffffe015b20f000 kcr3 = 0x800000024ca69526 ucr3 = 0x800000024ca32d26 scr3 = 0x7a550cf86 gs32p = 0xffffffff82216404 ldt = 0xffffffff82216444 tss = 0xffffffff82216434 curvnet = 0 spin locks held: cpuid = 7 dynamic pcpu = 0xfffffe00bb728040 curthread = 0xfffff8031c983000: pid 22330 tid 100463 critnest 0 "swap" curpcb = 0xfffff8031c983520 fpcurthread = 0xfffff8031c983000: pid 22330 "swap" idlethread = 0xfffff80003c82000: tid 100010 "idle: cpu7" self = 0xffffffff82217000 curpmap = 0xfffff80043db4ad0 tssp = 0xffffffff82217384 rsp0 = 0xfffffe0157bfe000 kcr3 = 0x800000024ca9c0ad ucr3 = 0x800000024ca6a8ad scr3 = 0x770f869a3 gs32p = 0xffffffff82217404 ldt = 0xffffffff82217444 tss = 0xffffffff82217434 curvnet = 0 spin locks held: cpuid = 8 dynamic pcpu = 0xfffffe00bb737040 curthread = 0xfffff80209fff740: pid 22340 tid 100480 critnest 0 "swap" curpcb = 0xfffff80209fffc60 fpcurthread = 0xfffff80209fff740: pid 22340 "swap" idlethread = 0xfffff80003c83740: tid 100011 "idle: cpu8" self = 0xffffffff82218000 curpmap = 0xfffff80003c8cad0 tssp = 0xffffffff82218384 rsp0 = 0xfffffe015b26d000 kcr3 = 0x80000002d9eb109c ucr3 = 0x80000002d9ea689c scr3 = 0x770f86fb9 gs32p = 0xffffffff82218404 ldt = 0xffffffff82218444 tss = 0xffffffff82218434 curvnet = 0 spin locks held: cpuid = 9 dynamic pcpu = 0xfffffe00bb746040 curthread = 0xfffff8004c239740: pid 22342 tid 100466 critnest 0 "swap" curpcb = 0xfffff8004c239c60 fpcurthread = 0xfffff8004c239740: pid 22342 "swap" idlethread = 0xfffff80003c83000: tid 100012 "idle: cpu9" self = 0xffffffff82219000 curpmap = 0xfffff80449e6aad0 tssp = 0xffffffff82219384 rsp0 = 0xfffffe015b21e000 kcr3 = 0x80000002d9e860e9 ucr3 = 0x80000002d9e5e8e9 scr3 = 0x7a54caf46 gs32p = 0xffffffff82219404 ldt = 0xffffffff82219444 tss = 0xffffffff82219434 curvnet = 0 spin locks held: cpuid = 10 dynamic pcpu = 0xfffffe00bb755040 curthread = 0xfffff8004c344000: pid 22336 tid 100309 critnest 0 "swap" curpcb = 0xfffff8004c344520 fpcurthread = 0xfffff8004c344000: pid 22336 "swap" idlethread = 0xfffff80003c84740: tid 100013 "idle: cpu10" self = 0xffffffff8221a000 curpmap = 0xfffff8055303cd38 tssp = 0xffffffff8221a384 rsp0 = 0xfffffe0157bc2000 kcr3 = 0x80000002255150e5 ucr3 = 0x80000004f6c028e5 scr3 = 0x770f86923 gs32p = 0xffffffff8221a404 ldt = 0xffffffff8221a444 tss = 0xffffffff8221a434 curvnet = 0 spin locks held: cpuid = 11 dynamic pcpu = 0xfffffe00bb764040 curthread = 0xfffff8004c239000: pid 22343 tid 100467 critnest 1 "swap" curpcb = 0xfffff8004c239520 fpcurthread = 0xfffff8004c239000: pid 22343 "swap" idlethread = 0xfffff80003c84000: tid 100014 "idle: cpu11" self = 0xffffffff8221b000 curpmap = 0xffffffff8197fe90 tssp = 0xffffffff8221b384 rsp0 = 0xfffffe015b20a000 kcr3 = 0x8000000002171002 ucr3 = 0xffffffffffffffff scr3 = 0x39d16aa03 gs32p = 0xffffffff8221b404 ldt = 0xffffffff8221b444 tss = 0xffffffff8221b434 curvnet = 0 spin locks held: db:1:pho1> show alllocks Process 22418 (mmap42) thread 0xfffff8031c17c740 (100559) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0039029140) locked @ kern/vfs_bio.c:1741 exclusive lockmgr ufs (ufs) r = 1 (0xfffffe01664dfc90) locked @ kern/vfs_subr.c:3294 db:1:pho1> show lockedvnods Locked vnodes vnode 0xfffffe01664dfc20: type VREG state VSTATE_CONSTRUCTED op 0xffffffff81737518 usecount 4, writecount 1, refcount 7268 seqc users 0 hold count flags () flags (VIRF_PGREAD|VMP_LAZYLIST) v_object 0xfffff8049968a630 ref 2 pages 108248 cleanbuf 6219 dirtybuf 1047 lock type ufs: EXCL by thread 0xfffff8031c17c740 (pid 22418, mmap42, tid 100559) #0 0xffffffff80b21049 at lockmgr_lock_flags+0x1d9 #1 0xffffffff80ecd72d at ffs_lock+0x9d #2 0xffffffff811384bd at VOP_LOCK1_APV+0x3d #3 0xffffffff80c66143 at _vn_lock+0x53 #4 0xffffffff80c6bb66 at vn_write+0x1d6 #5 0xffffffff80c64482 at vn_io_fault+0x1e2 #6 0xffffffff80bcde32 at dofilewrite+0x82 #7 0xffffffff80bcd982 at sys_write+0xc2 #8 0xffffffff8105f733 at amd64_syscall+0x153 #9 0xffffffff810314eb at fast_syscall_common+0xf8 nlink=1, effnlink=1, size=875998990, extsize 0 generation=d5026657, uid=0, gid=0, flags=0x0 ino 5, on dev md10 db:1:pho1> show mount 0xfffffe010e0c6700 /dev/gpt/work on / (ufs) 0xfffffe010e0c7280 devfs on /dev (devfs) 0xfffffe010e0c5b80 /dev/gpt/tmp on /tmp (ufs) 0xfffffe01679e4700 /dev/md10 on /mnt (ufs) More info: show mount db:1:pho1> show bufqueues bqempty: 81424 Buf domain 0 freebufs 13701 lofreebufs 219 hifreebufs 329 bufspace 46415872 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 1352 (43986944) dirtyq count 0 (0) wakeup 0 lim 25 CPU 18, 9, 0, 16, 1, 0, 2, 0, 5, 17, 9, 3, Locked buffers: 0 space 0 Total buffers: 1441 space 46415872 Buf domain 1 freebufs 15026 lofreebufs 219 hifreebufs 329 bufspace 2994176 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 30 (958464) dirtyq count 0 (0) wakeup 0 lim 25 CPU 1, 3, 19, 3, 24, 13, 1, 2, 1, 5, 3, 2, Locked buffers: 0 space 0 Total buffers: 7286 space 2994176 Buf domain 2 freebufs 15003 lofreebufs 219 hifreebufs 329 bufspace 3489792 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 2 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 27 (860160) dirtyq count 2 (36864) wakeup 0 lim 25 CPU 5, 11, 6, 10, 6, 5, 1, 9, 11, 10, 9, 18, Locked buffers: 0 space 0 Total buffers: 130 space 3489792 Buf domain 3 freebufs 7885 lofreebufs 219 hifreebufs 329 bufspace 237502464 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 7076 (231866368) dirtyq count 0 (0) wakeup 0 lim 25 CPU 23, 21, 18, 16, 3, 8, 2, 15, 12, 15, 19, 20, Locked buffers: 0 space 0 Total buffers: 14048 space 237502464 Buf domain 4 freebufs 7851 lofreebufs 219 hifreebufs 329 bufspace 238473216 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 1049 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 6120 (200425472) dirtyq count 1049 (34373632) wakeup 0 lim 25 CPU 4, 0, 9, 3, 2, 11, 16, 6, 22, 7, 8, 21, Locked buffers: 4 space 131072 Total buffers: 14197 space 238473216 Buf domain 5 freebufs 14433 lofreebufs 219 hifreebufs 329 bufspace 22282240 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 601 (19591168) dirtyq count 0 (0) wakeup 0 lim 25 CPU 17, 23, 1, 1, 1, 5, 3, 4, 2, 6, 23, 13, Locked buffers: 0 space 0 Total buffers: 7844 space 22282240 Buf domain 6 freebufs 7929 lofreebufs 219 hifreebufs 329 bufspace 235425792 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 14 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 7095 (232464384) dirtyq count 14 (442368) wakeup 0 lim 25 CPU 3, 20, 2, 2, 1, 9, 16, 3, 4, 7, 12, 16, Locked buffers: 0 space 0 Total buffers: 60985 space 235425792 db:1:pho1> show page vm_cnt.v_free_count: 174352 vm_cnt.v_inactive_count: 133626 vm_cnt.v_active_count: 6811854 vm_cnt.v_laundry_count: 607667 vm_cnt.v_wire_count: 394172 vm_cnt.v_free_reserved: 10643 vm_cnt.v_free_min: 51260 vm_cnt.v_free_target: 173111 vm_cnt.v_inactive_target: 259666 db:1:pho1> show pageq pq_free 174352 dom 0 page_cnt 8123551 free 174352 pq_act 6811854 pq_inact 133626 pq_laund 607667 pq_unsw 0 db:0:pho> show freepages DOMAIN: 0 FREE LIST 0: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000087 | 000000 09 (002048K) | 000107 | 000000 08 (001024K) | 000001 | 000000 07 (000512K) | 000001 | 000000 06 (000256K) | 000000 | 000000 05 (000128K) | 000000 | 000001 04 (000064K) | 000001 | 000004 03 (000032K) | 000002 | 000003 02 (000016K) | 000003 | 000012 01 (000008K) | 000007 | 000204 00 (000004K) | 000005 | 000495 FREE LIST 1: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000000 | 000000 09 (002048K) | 000000 | 000000 08 (001024K) | 000000 | 000000 07 (000512K) | 000000 | 000000 06 (000256K) | 000000 | 000000 05 (000128K) | 000000 | 000000 04 (000064K) | 000000 | 000000 03 (000032K) | 000000 | 000000 02 (000016K) | 000000 | 000000 01 (000008K) | 000000 | 000000 00 (000004K) | 000000 | 000000 db:0:pho> show uma Zone Size Used Free Requests Sleeps Bucket Total Mem XFree FFS inode 1168 114944 115 115912 0 8 134388912 0 RADIX NODE 144 526416 9530 42589756 0 62 77176224 0 VNODE 600 115072 251 116179 0 16 69193800 0 FFS2 dinode 256 114944 316 115911 0 62 29506560 0 mbuf_cluster 2048 12292 588 42319 0 8 26378240 0 swblk 136 46759 99865 1375540 0 62 19940864 0 BUF TRIE 144 1927 104025 32956883 0 62 15257088 0 S VFS Cache 104 115774 2162 116850 0 126 12265344 0 malloc-256 256 15144 21126 59836004 0 62 9285120 0 mbuf 256 16494 2551 189846 0 254 4875520 0 VM OBJECT 264 13152 558 382355 0 30 3619440 0 UMA Slabs 0 112 24319 2135 755879 0 126 2962848 0 pbuf 2776 0 994 0 0 0 2759344 0 vmem btag 56 37487 11245 56430 0 254 2728992 0 swpctrie 144 3432 13648 107390 0 62 2459520 0 malloc-128 128 18598 250 2267572 0 126 2412544 0 malloc-128 128 12278 463 18088 0 126 1630848 0 malloc-4096 4096 333 0 2157 0 2 1363968 0 malloc-64 64 20292 435 125803 0 254 1326528 0 L VFS Cache 320 3798 78 3799 0 30 1240320 0 THREAD 1824 340 240 1176 0 8 1057920 0 malloc-8192 8192 86 0 167 0 1 704512 0 malloc-32768 32768 9 7 3583 0 1 524288 0 lkpimm 168 1 3095 2 0 62 520128 0 lkpicurr 168 2 3094 3 0 62 520128 0 malloc-32768 32768 15 0 15 0 1 491520 0 UMA Zones 2048 228 7 291 0 8 481280 0 256 Bucket 2048 179 51 4227200 0 8 471040 0 64 Bucket 512 481 407 17417074 0 30 454656 0 malloc-128 128 2060 1288 32541 0 126 428544 0 MAP ENTRY 96 2267 1975 1739054 0 126 407232 0 FPU_save_area 832 342 135 13547 0 16 396864 0 malloc-32768 32768 12 0 12 0 1 393216 0 malloc-64 64 4450 1031 350483 0 254 350784 0 malloc-4096 4096 77 0 22419 0 2 315392 0 32 Bucket 256 110 1075 3783992 0 62 303360 0 malloc-16 16 15581 2419 105752 0 254 288000 0 malloc-32 32 7112 1582 31119 0 254 278208 0 malloc-65536 65536 4 0 4 0 1 262144 0 PROC 1376 76 111 22418 0 8 257312 0 malloc-256 256 489 486 4431 0 62 249600 0 clpbuf 2776 0 84 2986205 0 4 233184 0 malloc-16384 16384 7 7 209187 0 1 229376 0 malloc-4096 4096 53 0 68 0 2 217088 0 malloc-1024 1024 184 28 628407 0 16 217088 0 128 Bucket 1024 87 124 7198175 0 16 216064 0 malloc-16384 16384 13 0 4831 0 1 212992 0 filedesc0 1072 77 112 22419 0 8 202608 0 VMSPACE 616 53 271 22358 0 16 199584 0 malloc-2048 2048 94 0 2530 0 8 192512 0 malloc-1024 1024 25 163 77372 0 16 192512 0 4 Bucket 48 69 3879 3137049 0 254 189504 0 PGRP 120 33 1518 4739 0 126 186120 0 g_bio 408 0 420 18660970 0 30 171360 0 NAMEI 1024 0 160 807418 0 16 163840 0 malloc-8192 8192 20 0 3132 0 1 163840 0 malloc-512 512 254 66 538 0 30 163840 0 PWD 40 19 4021 9800 0 254 161600 0 udp_inpcb 424 11 367 1025 0 30 160272 0 Files 80 111 1789 246416 0 126 152000 0 ksiginfo 112 168 1164 15719 0 126 149184 0 fakepg 104 0 1404 176 0 126 146016 0 swrbuf 2776 0 50 2989432 0 4 138800 0 malloc-4096 4096 33 0 89 0 2 135168 0 malloc-65536 65536 2 0 7 0 1 131072 0 malloc-65536 65536 2 0 3313 0 1 131072 0 malloc-65536 65536 2 0 2 0 1 131072 0 TURNSTILE 136 581 301 581 0 62 119952 0 8 Bucket 80 50 1400 2622296 0 126 116000 0 malloc-384 384 214 86 214 0 30 115200 0 malloc-8192 8192 14 0 14 0 1 114688 0 swwbuf 2776 0 40 680824 0 2 111040 0 ada_ccb 272 0 406 3721174 0 30 110432 0 malloc-64 64 298 1403 23285 0 254 108864 0 2 Bucket 32 638 2764 1110308 0 254 108864 0 malloc-64 64 152 1486 25296 0 254 104832 0 16 Bucket 144 107 621 1716181 0 62 104832 0 DEVCTL 1024 0 100 1304 0 0 102400 0 malloc-32768 32768 3 0 3622 0 1 98304 0 malloc-8192 8192 12 0 12 0 1 98304 0 malloc-64 64 104 1408 22589 0 254 96768 0 Mountpoints 2944 4 28 44 0 4 94208 0 ertt_txseginfo 40 0 2323 53701 0 254 92920 0 rl_entry 40 162 2161 2452 0 254 92920 0 malloc-256 256 233 127 12453 0 62 92160 0 SLEEPQUEUE 88 581 443 581 0 126 90112 0 socket 960 38 54 7178 0 16 88320 0 malloc-128 128 434 248 6044 0 126 87296 0 malloc-16384 16384 5 0 33991 0 1 81920 0 malloc-32 32 1384 1136 794961 0 254 80640 0 ttyinq 160 330 170 825 0 62 80000 0 UMA Kegs 384 199 4 262 0 30 77952 0 malloc-128 128 93 496 1464 0 126 75392 0 ttyoutq 256 173 112 431 0 62 72960 0 malloc-32 32 120 2148 18275 0 254 72576 0 malloc-2048 2048 17 17 1367 0 8 69632 0 malloc-1024 1024 51 17 3442 0 16 69632 0 malloc-128 128 82 445 38222 0 126 67456 0 malloc-65536 65536 1 0 1 0 1 65536 0 malloc-65536 65536 0 1 308 0 1 65536 0 malloc-32768 32768 2 0 2 0 1 65536 0 malloc-32768 32768 1 1 104 0 1 65536 0 malloc-8192 8192 8 0 661 0 1 65536 0 malloc-256 256 39 216 19885 0 62 65280 0 udp_inpcb ports 32 3 2013 115 0 254 64512 0 malloc-256 256 54 186 3637 0 62 61440 0 malloc-384 384 109 41 899 0 30 57600 0 malloc-2048 2048 24 4 678 0 8 57344 0 malloc-64 64 112 770 126 0 254 56448 0 malloc-32 32 149 1615 1600 0 254 56448 0 malloc-32 32 67 1697 493 0 254 56448 0 malloc-64 64 44 775 2349 0 254 52416 0 tcp_inpcb 1312 6 30 35 0 8 47232 0 unpcb 256 18 162 6034 0 62 46080 0 pcpu-8 8 3704 1928 4208 0 254 45056 0 malloc-16 16 62 2688 45222 0 254 44000 0 malloc-4096 4096 10 0 137579 0 2 40960 0 pcpu-64 64 451 189 456 0 254 40960 0 malloc-16 16 144 2356 5560 0 254 40000 0 malloc-16 16 887 1613 2012065 0 254 40000 0 malloc-128 128 93 217 103 0 126 39680 0 malloc-384 384 56 44 319 0 30 38400 0 malloc-384 384 34 66 38 0 30 38400 0 malloc-1024 1024 20 16 21 0 16 36864 0 tcp_inpcb ports 32 2 1132 23 0 254 36288 0 malloc-32 32 141 993 2553 0 254 36288 0 malloc-16 16 40 2210 2153 0 254 36000 0 malloc-32768 32768 1 0 1 0 1 32768 0 malloc-16384 16384 2 0 2 0 1 32768 0 malloc-1024 1024 31 1 13947 0 16 32768 0 malloc-16 16 160 1840 1748 0 254 32000 0 malloc-64 64 23 418 357394 0 254 28224 0 malloc-32 32 42 840 10315 0 254 28224 0 malloc-256 256 58 47 181207 0 62 26880 0 cpuset 200 27 101 27 0 62 25600 0 malloc-8192 8192 3 0 506 0 1 24576 0 malloc-2048 2048 9 3 114825 0 8 24576 0 malloc-16 16 52 1448 344 0 254 24000 0 malloc-128 128 8 178 1185 0 126 23808 0 malloc-384 384 17 43 1285 0 30 23040 0 malloc-4096 4096 5 0 211 0 2 20480 0 pcpu-16 16 32 1248 32 0 254 20480 0 malloc-32 32 18 612 47 0 254 20160 0 malloc-16 16 6 1244 8 0 254 20000 0 malloc-384 384 17 33 144337 0 30 19200 0 malloc-256 256 34 41 52 0 62 19200 0 malloc-16384 16384 1 0 1 0 1 16384 0 malloc-8192 8192 2 0 2 0 1 16384 0 malloc-1024 1024 6 10 44 0 16 16384 0 malloc-512 512 12 20 84754 0 30 16384 0 rtentry 168 12 84 14 0 62 16128 0 pipe 728 2 20 3887 0 16 16016 0 routing nhops 256 9 51 14 0 62 15360 0 malloc-4096 4096 3 0 64 0 2 12288 0 malloc-2048 2048 3 3 1509 0 8 12288 0 malloc-512 512 4 20 1379 0 30 12288 0 malloc-512 512 3 21 49 0 30 12288 0 STS VFS Cache 144 0 84 5 0 62 12096 0 ertt 72 6 162 35 0 126 12096 0 malloc-2048 2048 3 1 1797 0 8 8192 0 malloc-2048 2048 2 2 103 0 8 8192 0 malloc-1024 1024 2 6 14 0 16 8192 0 hostcache 64 0 126 2 0 254 8064 0 kenv 258 18 12 27409 0 30 7740 0 epoch_record pcpu 256 4 12 4 0 62 4096 0 malloc-2048 2048 1 1 4 0 8 4096 0 malloc-1024 1024 1 3 38 0 16 4096 0 malloc-512 512 1 7 2378 0 30 4096 0 malloc-512 512 1 7 12 0 30 4096 0 SMR CPU 32 7 120 7 0 254 4064 0 vtnet_tx_hdr 24 0 167 0 0 254 4008 0 KNOTE 160 11 14 3625 0 62 4000 0 UMA Slabs 1 176 10 12 10 0 62 3872 0 malloc-384 384 2 8 209 0 30 3840 0 malloc-256 256 1 14 15756 0 62 3840 0 KMAP ENTRY 96 33 6 42 0 0 3744 0 vmem 1856 1 1 1 0 8 3712 0 ripcb 392 1 8 1 0 30 3528 0 SMR SHARED 24 7 120 7 0 254 3048 0 mbuf_packet 256 5 0 5631 0 254 1280 0 FFS1 dinode 128 0 0 0 0 126 0 0 da_ccb 544 0 0 0 0 16 0 0 tfo_ccache_entries 80 0 0 0 0 126 0 0 tfo 4 0 0 0 0 254 0 0 sackhole 32 0 0 0 0 254 0 0 syncache 168 0 0 2 0 62 0 0 ipq 56 0 0 0 0 254 0 0 tcp_log_id_node 120 0 0 0 0 126 0 0 tcp_log_id_bucket 176 0 0 0 0 62 0 0 tcp_log 416 0 0 0 0 30 0 0 tcpreass 48 0 0 0 0 254 0 0 udplite_inpcb ports 32 0 0 0 0 254 0 0 udplite_inpcb 424 0 0 0 0 30 0 0 ripcb ports 32 0 0 0 0 254 0 0 IPsec SA lft_c 16 0 0 0 0 254 0 0 netlink 2048 0 0 46 0 8 0 0 itimer 352 0 0 17 0 30 0 0 AIOLIO 272 0 0 4 0 30 0 0 AIOCB 552 0 0 16 0 16 0 0 AIO 208 0 0 1 0 62 0 0 DIRHASH 1024 0 0 2141 0 16 0 0 TMPFS node 232 0 0 0 0 62 0 0 NCLNODE 760 0 0 8 0 16 0 0 LTS VFS Cache 360 0 0 0 0 30 0 0 cryptop 280 0 0 0 0 30 0 0 linux_dma_object 32 0 0 0 0 254 0 0 linux_dma_pctrie 144 0 0 0 0 62 0 0 IOMMU_MAP_ENTRY 104 0 0 0 0 126 0 0 mbuf_jumbo_16k 16384 0 0 0 0 1 0 0 mbuf_jumbo_9k 9216 0 0 0 0 1 0 0 mbuf_jumbo_page 4096 0 0 7 0 2 0 0 audit_record 1280 0 0 0 0 8 0 0 domainset 40 0 0 0 0 254 0 0 MAC labels 40 0 0 0 0 254 0 0 vnpbuf 2776 0 0 0 0 4 0 0 nfspbuf 2776 0 0 0 0 4 0 0 umtx_shm 88 0 0 0 0 126 0 0 umtx pi 96 0 0 0 0 126 0 0 rangeset pctrie nodes 144 0 0 0 0 62 0 0 malloc-65536 65536 0 0 23 0 1 0 0 malloc-65536 65536 0 0 180 0 1 0 0 malloc-32768 32768 0 0 0 0 1 0 0 malloc-16384 16384 0 0 0 0 1 0 0 malloc-16384 16384 0 0 0 0 1 0 0 malloc-16384 16384 0 0 46 0 1 0 0 malloc-8192 8192 0 0 0 0 1 0 0 malloc-4096 4096 0 0 139 0 2 0 0 malloc-512 512 0 0 73 0 30 0 0 malloc-512 512 0 0 12 0 30 0 0 malloc-384 384 0 0 10177 0 30 0 0 pcpu-32 32 0 0 0 0 254 0 0 pcpu-4 4 0 0 0 0 254 0 0 UMA Hash 256 0 0 0 0 62 0 0 db:0:pho> show umacache Zone Size Used Free Requests Bucket debugnet_mbuf_packet 2048 0 0 0 0 debugnet_mbuf_cluster 2048 -6144 0 0 0 debugnet_mbuf 256 -10240 0 0 0 vm pgcache 4096 75073 1099 11737664 2 vm pgcache 4096 1988615 16 504058433 3 buf free cache 848 24103 404 116928592 16 buffer arena-65 65536 0 0 5 1 buffer arena-61 61440 0 0 0 1 buffer arena-57 57344 0 0 0 1 buffer arena-53 53248 0 0 0 1 buffer arena-49 49152 0 0 0 1 buffer arena-45 45056 0 0 0 1 buffer arena-40 40960 0 0 0 1 buffer arena-36 36864 0 0 0 1 buffer arena-32 32768 127 20 78806 1 buffer arena-28 28672 0 0 0 1 buffer arena-24 24576 0 0 0 1 buffer arena-20 20480 0 0 0 1 buffer arena-16 16384 5 0 257 1 buffer arena-12 12288 0 0 0 1 buffer arena-81 8192 0 0 0 1 buffer arena-40 4096 0 0 0 2 kstack_cache 16384 340 0 1176 1 db:0:pho> acttrace Tracing command bufdaemon pid 17 tid 100169 td 0xfffff80005053000 (CPU -1) sched_switch() at sched_switch+0x5da/frame 0xfffffe010e918d40 mi_switch() at mi_switch+0x173/frame 0xfffffe010e918d60 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe010e918da0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010e918de0 _sleep() at _sleep+0x2bd/frame 0xfffffe010e918e80 bufspace_daemon() at bufspace_daemon+0x322/frame 0xfffffe010e918ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010e918f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010e918f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command swap pid 22330 tid 100463 td 0xfffff8031c983000 (CPU 7) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ce96df0 ipi_nmi_handler() at ipi_nmi_handler+0x3a/frame 0xfffffe003ce96e00 trap() at trap+0x56/frame 0xfffffe003ce96f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce96f20 --- trap 0x13, rip = 0x3d8735ead57a, rsp = 0x3d8f56359bd0, rbp = 0x3d8f56359c00 --- Tracing command swap pid 22331 tid 100355 td 0xfffff8031ca81740 (CPU 6) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ce87df0 ipi_nmi_handler() at ipi_nmi_handler+0x3a/frame 0xfffffe003ce87e00 trap() at trap+0x56/frame 0xfffffe003ce87f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce87f20 --- trap 0x13, rip = 0x3d8735ead57a, rsp = 0x3d8f56359bd0, rbp = 0x3d8f56359c00 --- Tracing command swap pid 22333 tid 100225 td 0xfffff8004c341740 (CPU 1) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ce3cdf0 ipi_nmi_handler() at ipi_nmi_handler+0x3a/frame 0xfffffe003ce3ce00 trap() at trap+0x56/frame 0xfffffe003ce3cf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce3cf20 --- trap 0x13, rip = 0x3d8735ead574, rsp = 0x3d8f56359bd0, rbp = 0x3d8f56359c00 --- Tracing command swap pid 22334 tid 100227 td 0xfffff8004c341000 (CPU 3) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ce5adf0 ipi_nmi_handler() at ipi_nmi_handler+0x3a/frame 0xfffffe003ce5ae00 trap() at trap+0x56/frame 0xfffffe003ce5af20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce5af20 --- trap 0x13, rip = 0x3d8735ead57a, rsp = 0x3d8f56359bd0, rbp = 0x3d8f56359c00 --- Tracing command swap pid 22336 tid 100309 td 0xfffff8004c344000 (CPU 10) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003cec3df0 ipi_nmi_handler() at ipi_nmi_handler+0x3a/frame 0xfffffe003cec3e00 trap() at trap+0x56/frame 0xfffffe003cec3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003cec3f20 --- trap 0x13, rip = 0x3d8735ead57a, rsp = 0x3d8f56359bd0, rbp = 0x3d8f56359c00 --- Tracing command swap pid 22337 tid 100310 td 0xfffff8004c55e740 (CPU 5) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ce78df0 ipi_nmi_handler() at ipi_nmi_handler+0x3a/frame 0xfffffe003ce78e00 trap() at trap+0x56/frame 0xfffffe003ce78f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce78f20 --- trap 0x13, rip = 0x3d8735ead574, rsp = 0x3d8f56359bd0, rbp = 0x3d8f56359c00 --- Tracing command swap pid 22338 tid 100483 td 0xfffff80209dda740 (CPU 0) cpustop_handler() at cpustop_handler+0x27/frame 0xffffffff81b0e200 ipi_nmi_handler() at ipi_nmi_handler+0x3a/frame 0xffffffff81b0e210 trap() at trap+0x56/frame 0xffffffff81b0e330 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81b0e330 --- trap 0x13, rip = 0x3d8735ead57a, rsp = 0x3d8f56359bd0, rbp = 0x3d8f56359c00 --- Tracing command swap pid 22340 tid 100480 td 0xfffff80209fff740 (CPU 8) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003cea5df0 ipi_nmi_handler() at ipi_nmi_handler+0x3a/frame 0xfffffe003cea5e00 trap() at trap+0x56/frame 0xfffffe003cea5f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003cea5f20 --- trap 0x13, rip = 0x3d8735ead574, rsp = 0x3d8f56359bd0, rbp = 0x3d8f56359c00 --- Tracing command swap pid 22341 tid 100481 td 0xfffff80209e94000 (CPU 4) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ce69df0 ipi_nmi_handler() at ipi_nmi_handler+0x3a/frame 0xfffffe003ce69e00 trap() at trap+0x56/frame 0xfffffe003ce69f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce69f20 --- trap 0x13, rip = 0x3d8735ead57a, rsp = 0x3d8f56359bd0, rbp = 0x3d8f56359c00 --- Tracing command swap pid 22342 tid 100466 td 0xfffff8004c239740 (CPU 9) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ceb4df0 ipi_nmi_handler() at ipi_nmi_handler+0x3a/frame 0xfffffe003ceb4e00 trap() at trap+0x56/frame 0xfffffe003ceb4f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ceb4f20 --- trap 0x13, rip = 0x3d8735ead57a, rsp = 0x3d8f56359bd0, rbp = 0x3d8f56359c00 --- Tracing command mmap42 pid 22418 tid 100559 td 0xfffff8031c17c740 (CPU 2) kdb_enter() at kdb_enter+0x32/frame 0xfffffe015138b160 vpanic() at vpanic+0x163/frame 0xfffffe015138b290 panic() at panic+0x43/frame 0xfffffe015138b2f0 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x11c/frame 0xfffffe015138b3a0 __lockmgr_args() at __lockmgr_args+0x207/frame 0xfffffe015138b440 getblkx() at getblkx+0x1c6/frame 0xfffffe015138b500 breadn_flags() at breadn_flags+0x44/frame 0xfffffe015138b570 vfs_bio_getpages() at vfs_bio_getpages+0x33c/frame 0xfffffe015138b660 ffs_getpages() at ffs_getpages+0x77/frame 0xfffffe015138b680 VOP_GETPAGES_APV() at VOP_GETPAGES_APV+0x60/frame 0xfffffe015138b6b0 vnode_pager_getpages() at vnode_pager_getpages+0x37/frame 0xfffffe015138b6f0 vm_pager_get_pages() at vm_pager_get_pages+0x5f/frame 0xfffffe015138b740 vm_fault() at vm_fault+0x70c/frame 0xfffffe015138b870 vm_fault_trap() at vm_fault_trap+0x6f/frame 0xfffffe015138b8b0 trap_pfault() at trap_pfault+0x24a/frame 0xfffffe015138b920 calltrap() at calltrap+0x8/frame 0xfffffe015138b920 --- trap 0xc, rip = 0xffffffff8105bce6, rsp = 0xfffffe015138b9f0, rbp = 0xfffffe015138b9f0 --- copyin_nosmap_erms() at copyin_nosmap_erms+0x156/frame 0xfffffe015138b9f0 uiomove_fromphys() at uiomove_fromphys+0x15a/frame 0xfffffe015138ba60 ffs_write() at ffs_write+0x356/frame 0xfffffe015138bb10 VOP_WRITE_APV() at VOP_WRITE_APV+0xcf/frame 0xfffffe015138bc20 vn_write() at vn_write+0x2f4/frame 0xfffffe015138bcb0 vn_io_fault() at vn_io_fault+0x1e2/frame 0xfffffe015138bd40 dofilewrite() at dofilewrite+0x82/frame 0xfffffe015138bd90 sys_write() at sys_write+0xc2/frame 0xfffffe015138be00 amd64_syscall() at amd64_syscall+0x153/frame 0xfffffe015138bf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe015138bf30 --- syscall (4, FreeBSD ELF64, write), rip = 0x82249ad0a, rsp = 0x8205d3578, rbp = 0x8205d36a0 --- db:0:pho> ps pid ppid pgrp uid state wmesg wchan cmd 22418 22297 22297 0 R+ CPU 2 mmap42 22417 8452 22417 0 S+ nanslp 0xffffffff819c312b sleep 22343 22328 22297 0 R+ swap 22342 22328 22297 0 R+ CPU 9 swap 22341 22328 22297 0 R+ CPU 4 swap 22340 22328 22297 0 R+ CPU 8 swap 22339 22328 22297 0 R+ swap 22338 22328 22297 0 R+ CPU 0 swap 22337 22328 22297 0 R+ CPU 5 swap 22336 22328 22297 0 R+ CPU 10 swap 22335 22328 22297 0 R+ swap 22334 22328 22297 0 R+ CPU 3 swap 22333 22328 22297 0 R+ CPU 1 swap 22332 22328 22297 0 R+ swap 22331 22328 22297 0 R+ CPU 6 swap 22330 22328 22297 0 R+ CPU 7 swap 22329 22328 22297 0 R+ swap 22328 22324 22297 0 SW+ wait 0xfffffe0151488060 swap 22324 22297 22297 0 S+ nanslp 0xffffffff819c3125 swap 22312 0 0 0 DL mdwait 0xfffff80013260000 [md10] 22297 3422 22297 0 S+ wait 0xfffffe0157c0e5a0 sh 22135 0 0 0 DL aiordy 0xfffffe015a302020 [aiod4] 22134 0 0 0 DL aiordy 0xfffffe0151465000 [aiod3] 22133 0 0 0 DL aiordy 0xfffffe003ce36ac0 [aiod2] 22132 0 0 0 DL aiordy 0xfffffe01599575c0 [aiod1] 8452 8446 8452 0 S+ wait 0xfffffe0157c1cb00 bash 8446 8445 8446 0 SW+ pause 0xfffffe01599420f0 csh 8445 4355 8445 2006 SW+ wait 0xfffffe015a1eb020 su 4355 4354 4355 2006 SWs+ wait 0xfffffe003ce755c0 sh 4354 4350 4350 2006 S select 0xfffff80763eaf7c0 sshd 4350 3375 4350 0 Ss select 0xfffff8049900a640 sshd 3422 3420 3422 0 SW+ wait 0xfffffe003ce37020 bash 3420 3419 3420 0 SW+ pause 0xfffffe0159943110 csh 3419 3397 3419 2006 SW+ wait 0xfffffe01599435c0 su 3397 3396 3397 2006 SWs+ wait 0xfffffe010d9feb00 sh 3396 3393 3393 2006 S select 0xfffff8006419a340 sshd 3393 3375 3393 0 Ss select 0xfffff8004c32f340 sshd 3392 1 3392 0 Ss+ ttyin 0xfffff8000587acb0 getty 3391 1 3391 0 Ss+ ttyin 0xfffff800439654b0 getty 3390 1 3390 0 Ss+ ttyin 0xfffff80043965cb0 getty 3389 1 3389 0 Ss+ ttyin 0xfffff80003ed04b0 getty 3388 1 3388 0 Ss+ ttyin 0xfffff80003ed0cb0 getty 3387 1 3387 0 Ss+ ttyin 0xfffff80003ecf4b0 getty 3386 1 3386 0 Ss+ ttyin 0xfffff80003ecfcb0 getty 3385 1 3385 0 Ss+ ttyin 0xfffff80003ece4b0 getty 3384 1 3384 0 Ss+ ttyin 0xfffff80003ececb0 getty 3375 1 3375 0 Ss select 0xfffff8006419a3c0 sshd 3358 1 3358 0 SWs nanslp 0xffffffff819c312a cron 3355 1 3355 0 Ss select 0xfffff8006419a540 inetd 3336 1 3336 0 Ss select 0xfffff800647688c0 powerd 3328 1 3328 123 Ss (threaded) ntpd 100219 S select 0xfffff8004c799440 ntpd 101176 S usem 0xfffff80003dfd580 ntpd 3269 1 3269 0 Ss nanslp 0xffffffff819c3122 watchdogd 3249 1 3249 0 Ss kqread 0xfffff8004393c500 syslogd 3054 1 3054 0 Ss select 0xfffff800640778c0 devd 3039 1 3039 65 Ss select 0xfffff80003243c40 dhclient 2980 1 2980 0 Ss select 0xfffff800647689c0 dhclient 2977 1 2977 0 Ss select 0xfffff800648c67c0 dhclient 19 0 0 0 DL syncer 0xffffffff81aa9928 [syncer] 18 0 0 0 DL vlruwt 0xfffffe003ce37ae0 [vnlru] 17 0 0 0 RL (threaded) [bufdaemon] 100163 D psleep 0xffffffff81aa8940 [bufdaemon] 100164 D - 0xffffffff81603100 [bufspacedaemon-0] 100165 D - 0xffffffff81603380 [bufspacedaemon-1] 100166 D - 0xffffffff81603600 [bufspacedaemon-2] 100167 D - 0xffffffff81603880 [bufspacedaemon-3] 100168 D - 0xffffffff81603b00 [bufspacedaemon-4] 100169 Run CPU -1 [bufspacedaemon-5] 100170 D - 0xffffffff81604000 [bufspacedaemon-6] 100194 D sdflush 0xfffff8004380ace8 [/ worker] 100220 D sdflush 0xfffff8004c628ce8 [/tmp worker] 101174 D sdflush 0xfffff806a9ebd0e8 [/mnt worker] 16 0 0 0 DL psleep 0xffffffff81afdbd0 [vmdaemon] 9 0 0 0 DL (threaded) [pagedaemon] 100161 D psleep 0xffffffff81ae6038 [dom0] 100171 D laundp 0xffffffff813c47a7 [laundry: dom0] 100172 D umarcl 0xffffffff80eef4b0 [uma] 8 0 0 0 DL idle 0xfffffe010d9fdae0 [enc_daemon1] 7 0 0 0 DL idle 0xfffffe010d9fe040 [enc_daemon0] 6 0 0 0 DL - 0xffffffff817c4960 [rand_harvestq] 15 0 0 0 DL (threaded) [usb] 100127 D - 0xfffffe010a1cf440 [usbus0] 100128 D - 0xfffffe010a1cf498 [usbus0] 100129 D - 0xfffffe010a1cf4f0 [usbus0] 100130 D - 0xfffffe010a1cf548 [usbus0] 100131 D - 0xfffffe010a1cf5a0 [usbus0] 100133 D - 0xfffffe00e4d9ccf0 [usbus1] 100134 D - 0xfffffe00e4d9cd48 [usbus1] 100135 D - 0xfffffe00e4d9cda0 [usbus1] 100136 D - 0xfffffe00e4d9cdf8 [usbus1] 100137 D - 0xfffffe00e4d9ce50 [usbus1] 100138 D - 0xfffffe010a57ccf0 [usbus2] 100139 D - 0xfffffe010a57cd48 [usbus2] 100140 D - 0xfffffe010a57cda0 [usbus2] 100141 D - 0xfffffe010a57cdf8 [usbus2] 100142 D - 0xfffffe010a57ce50 [usbus2] 5 0 0 0 DL - 0xffffffff81b07898 [busdma] 4 0 0 0 DL (threaded) [cam] 100120 D - 0xffffffff81796240 [doneq0] 100121 D - 0xffffffff817962c0 [doneq1] 100122 D - 0xffffffff81796340 [doneq2] 100123 D - 0xffffffff817961c0 [async] 100152 D - 0xffffffff81796090 [scanner] 3 0 0 0 DL (threaded) [crypto] 100107 D crypto_ 0xffffffff81ae34b0 [crypto] 100108 D crypto_ 0xfffff8000431fc30 [crypto returns 0] 100109 D crypto_ 0xfffff8000431fc80 [crypto returns 1] 100110 D crypto_ 0xfffff8000431fcd0 [crypto returns 2] 100111 D crypto_ 0xfffff8000431fd20 [crypto returns 3] 100112 D crypto_ 0xfffff8000431fd70 [crypto returns 4] 100113 D crypto_ 0xfffff8000431fdc0 [crypto returns 5] 100114 D crypto_ 0xfffff8000431fe10 [crypto returns 6] 100115 D crypto_ 0xfffff8000431fe60 [crypto returns 7] 100116 D crypto_ 0xfffff8000431feb0 [crypto returns 8] 100117 D crypto_ 0xfffff8000431ff00 [crypto returns 9] 100118 D crypto_ 0xfffff8000431ff50 [crypto returns 10] 100119 D crypto_ 0xfffff8000431ffa0 [crypto returns 11] 14 0 0 0 DL seqstat 0xfffff80003bf4488 [sequencer 00] 13 0 0 0 DL (threaded) [geom] 100091 D - 0xffffffff8197eb40 [g_event] 100092 D - 0xffffffff8197eb48 [g_up] 100093 D - 0xffffffff8197eb50 [g_down] 2 0 0 0 WL (threaded) [clock] 100077 I [clock (0)] 100078 I [clock (1)] 100079 I [clock (2)] 100080 I [clock (3)] 100081 I [clock (4)] 100082 I [clock (5)] 100083 I [clock (6)] 100084 I [clock (7)] 100085 I [clock (8)] 100086 I [clock (9)] 100087 I [clock (10)] 100088 I [clock (11)] 12 0 0 0 WL (threaded) [intr] 100042 I [swi6: task queue] 100043 I [swi6: Giant taskq] 100045 I [swi5: fast taskq] 100089 I [swi1: netisr 0] 100124 I [irq56: ahci0] 100126 I [irq19: xhci0] 100132 I [irq18: ehci0 ehci1+] 100143 I [irq71: ahci1] 100144 I [swi4: apei] 100145 I [swi0: uart uart] 100199 I [irq72: ioat0] 100200 I [irq73: ioat1] 100201 I [irq74: ioat2] 100202 I [irq75: ioat3] 100203 I [irq76: ioat4] 100204 I [irq77: ioat5] 100205 I [irq78: ioat6] 100206 I [irq79: ioat7] 11 0 0 0 RL (threaded) [idle] 100003 CanRun [idle: cpu0] 100004 CanRun [idle: cpu1] 100005 CanRun [idle: cpu2] 100006 CanRun [idle: cpu3] 100007 CanRun [idle: cpu4] 100008 CanRun [idle: cpu5] 100009 CanRun [idle: cpu6] 100010 CanRun [idle: cpu7] 100011 CanRun [idle: cpu8] 100012 CanRun [idle: cpu9] 100013 CanRun [idle: cpu10] 100014 CanRun [idle: cpu11] 1 0 1 0 SLs wait 0xfffffe00e4c84040 [init] 10 0 0 0 DL audit_w 0xffffffff81ae39b0 [audit] 0 0 0 0 DLs (threaded) [kernel] 100000 D swapin 0xffffffff8197f0c0 [swapper] 100015 D - 0xfffff80003c6f100 [softirq_0] 100016 D - 0xfffff80003c6f000 [softirq_1] 100017 D - 0xfffff80003c70e00 [softirq_2] 100018 D - 0xfffff80003c70d00 [softirq_3] 100019 D - 0xfffff80003c70c00 [softirq_4] 100020 D - 0xfffff80003c70b00 [softirq_5] 100021 D - 0xfffff80003c70a00 [softirq_6] 100022 D - 0xfffff80003c70900 [softirq_7] 100023 D - 0xfffff80003c70800 [softirq_8] 100024 D - 0xfffff80003c70700 [softirq_9] 100025 D - 0xfffff80003c70600 [softirq_10] 100026 D - 0xfffff80003c70500 [softirq_11] 100027 D - 0xfffff80003c70400 [if_io_tqg_0] 100028 D - 0xfffff80003c70300 [if_io_tqg_1] 100029 D - 0xfffff80003c70200 [if_io_tqg_2] 100030 D - 0xfffff80003c70100 [if_io_tqg_3] 100031 D - 0xfffff80003c70000 [if_io_tqg_4] 100032 D - 0xfffff80003c71e00 [if_io_tqg_5] 100033 D - 0xfffff80003c71d00 [if_io_tqg_6] 100034 D - 0xfffff80003c71c00 [if_io_tqg_7] 100035 D - 0xfffff80003c71b00 [if_io_tqg_8] 100036 D - 0xfffff80003c71a00 [if_io_tqg_9] 100037 D - 0xfffff80003c71900 [if_io_tqg_10] 100038 D - 0xfffff80003c71800 [if_io_tqg_11] 100039 D - 0xfffff80003c71700 [if_config_tqg_0] 100040 D - 0xfffff80003a70000 [pci_hp taskq] 100041 D - 0xfffff80003a6fe00 [kqueue_ctx taskq] 100044 D - 0xfffff80003a6fb00 [thread taskq] 100046 D - 0xfffff80003a6f900 [aiod_kick taskq] 100047 D - 0xfffff80003a6f800 [deferred_unmount ta] 100048 D - 0xfffff80003a6f700 [inm_free taskq] 100049 D - 0xfffff80003a6f600 [in6m_free taskq] 100050 D - 0xfffff80003a6f500 [linuxkpi_irq_wq] 100051 D - 0xfffff80003a6f400 [linuxkpi_short_wq_0] 100052 D - 0xfffff80003a6f400 [linuxkpi_short_wq_1] 100053 D - 0xfffff80003a6f400 [linuxkpi_short_wq_2] 100054 D - 0xfffff80003a6f400 [linuxkpi_short_wq_3] 100055 D - 0xfffff80003a6f400 [linuxkpi_short_wq_4] 100056 D - 0xfffff80003a6f400 [linuxkpi_short_wq_5] 100057 D - 0xfffff80003a6f400 [linuxkpi_short_wq_6] 100058 D - 0xfffff80003a6f400 [linuxkpi_short_wq_7] 100059 D - 0xfffff80003a6f400 [linuxkpi_short_wq_8] 100060 D - 0xfffff80003a6f400 [linuxkpi_short_wq_9] 100061 D - 0xfffff80003a6f400 [linuxkpi_short_wq_1] 100062 D - 0xfffff80003a6f400 [linuxkpi_short_wq_1] 100063 D - 0xfffff80003a6f400 [linuxkpi_short_wq_1] 100064 D - 0xfffff80003a6f300 [linuxkpi_long_wq_0] 100065 D - 0xfffff80003a6f300 [linuxkpi_long_wq_1] 100066 D - 0xfffff80003a6f300 [linuxkpi_long_wq_2] 100067 D - 0xfffff80003a6f300 [linuxkpi_long_wq_3] 100068 D - 0xfffff80003a6f300 [linuxkpi_long_wq_4] 100069 D - 0xfffff80003a6f300 [linuxkpi_long_wq_5] 100070 D - 0xfffff80003a6f300 [linuxkpi_long_wq_6] 100071 D - 0xfffff80003a6f300 [linuxkpi_long_wq_7] 100072 D - 0xfffff80003a6f300 [linuxkpi_long_wq_8] 100073 D - 0xfffff80003a6f300 [linuxkpi_long_wq_9] 100074 D - 0xfffff80003a6f300 [linuxkpi_long_wq_10] 100075 D - 0xfffff80003a6f300 [linuxkpi_long_wq_11] 100076 D - 0xfffff80003a6f300 [linuxkpi_long_wq_12] 100090 D - 0xfffff80003a6f100 [firmware taskq] 100095 D - 0xfffff80003a6ee00 [crypto_0] 100096 D - 0xfffff80003a6ee00 [crypto_1] 100097 D - 0xfffff80003a6ee00 [crypto_2] 100098 D - 0xfffff80003a6ee00 [crypto_3] 100099 D - 0xfffff80003a6ee00 [crypto_4] 100100 D - 0xfffff80003a6ee00 [crypto_5] 100101 D - 0xfffff80003a6ee00 [crypto_6] 100102 D - 0xfffff80003a6ee00 [crypto_7] 100103 D - 0xfffff80003a6ee00 [crypto_8] 100104 D - 0xfffff80003a6ee00 [crypto_9] 100105 D - 0xfffff80003a6ee00 [crypto_10] 100106 D - 0xfffff80003a6ee00 [crypto_11] 100146 D - 0xfffff80003ef7e00 [acpi_task_0] 100147 D - 0xfffff80003ef7e00 [acpi_task_1] 100148 D - 0xfffff80003ef7e00 [acpi_task_2] 100150 D - 0xfffff80003a70100 [mca taskq] 100151 D - 0xfffff80003a6ec00 [CAM taskq] db:0:pho> allt Tracing command kernel pid 0 tid 100000 td 0xffffffff8197f620 sched_switch() at sched_switch+0x5da/frame 0xffffffff82167e00 mi_switch() at mi_switch+0x173/frame 0xffffffff82167e20 sleepq_switch() at sleepq_switch+0x104/frame 0xffffffff82167e60 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xffffffff82167ea0 _sleep() at _sleep+0x2bd/frame 0xffffffff82167f40 swapper() at swapper+0x75/frame 0xffffffff82167fa0 mi_startup() at mi_startup+0x226/frame 0xffffffff82167ff0 Tracing command kernel pid 0 tid 100015 td 0xfffff80003c85740 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4858de0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4858e00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4858e40 msleep_spin_sbt() at msleep_spin_sbt+0x14d/frame 0xfffffe00e4858ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00e4858ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4858f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4858f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100016 td 0xfffff80003c85000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4853de0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4853e00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4853e40 msleep_spin_sbt() at msleep_spin_sbt+0x14d/frame 0xfffffe00e4853ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00e4853ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4853f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4853f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100017 td 0xfffff80003c54740 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4862de0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4862e00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4862e40 msleep_spin_sbt() at msleep_spin_sbt+0x14d/frame 0xfffffe00e4862ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00e4862ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4862f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4862f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100018 td 0xfffff80003c54000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e485dde0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e485de00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e485de40 msleep_spin_sbt() at msleep_spin_sbt+0x14d/frame 0xfffffe00e485dec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00e485def0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e485df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e485df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100019 td 0xfffff80003c55740 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e486cde0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e486ce00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e486ce40 msleep_spin_sbt() at msleep_spin_sbt+0x14d/frame 0xfffffe00e486cec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00e486cef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e486cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e486cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xfffff80003c55000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4867de0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4867e00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4867e40 msleep_spin_sbt() at msleep_spin_sbt+0x14d/frame 0xfffffe00e4867ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00e4867ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4867f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4867f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xfffff80003c56740 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4876de0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4876e00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4876e40 msleep_spin_sbt() at msleep_spin_sbt+0x14d/frame 0xfffffe00e4876ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00e4876ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4876f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4876f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xfffff80003c56000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4871de0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4871e00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4871e40 msleep_spin_sbt() at msleep_spin_sbt+0x14d/frame 0xfffffe00e4871ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00e4871ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4871f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4871f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xfffff80003c5b740 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4880de0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4880e00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4880e40 msleep_spin_sbt() at msleep_spin_sbt+0x14d/frame 0xfffffe00e4880ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00e4880ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4880f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4880f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xfffff80003c5b000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e487bde0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e487be00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e487be40 msleep_spin_sbt() at msleep_spin_sbt+0x14d/frame 0xfffffe00e487bec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00e487bef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e487bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e487bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xfffff80003c4e740 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e488ade0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e488ae00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e488ae40 msleep_spin_sbt() at msleep_spin_sbt+0x14d/frame 0xfffffe00e488aec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00e488aef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e488af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e488af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100026 td 0xfffff80003c4e000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4885de0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4885e00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4885e40 msleep_spin_sbt() at msleep_spin_sbt+0x14d/frame 0xfffffe00e4885ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00e4885ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4885f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4885f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100027 td 0xfffff80003c4f740 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4894de0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4894e00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4894e40 msleep_spin_sbt() at msleep_spin_sbt+0x14d/frame 0xfffffe00e4894ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00e4894ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4894f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4894f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100028 td 0xfffff80003c4f000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e488fde0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e488fe00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e488fe40 msleep_spin_sbt() at msleep_spin_sbt+0x14d/frame 0xfffffe00e488fec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00e488fef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e488ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e488ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100029 td 0xfffff80003c50740 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e489ede0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e489ee00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e489ee40 msleep_spin_sbt() at msleep_spin_sbt+0x14d/frame 0xfffffe00e489eec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00e489eef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e489ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e489ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100030 td 0xfffff80003c50000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4899de0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4899e00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4899e40 msleep_spin_sbt() at msleep_spin_sbt+0x14d/frame 0xfffffe00e4899ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00e4899ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4899f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4899f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100031 td 0xfffff80003c51740 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e48a8de0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e48a8e00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e48a8e40 msleep_spin_sbt() at msleep_spin_sbt+0x14d/frame 0xfffffe00e48a8ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00e48a8ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e48a8f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48a8f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100032 td 0xfffff80003c51000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e48a3de0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e48a3e00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e48a3e40 msleep_spin_sbt() at msleep_spin_sbt+0x14d/frame 0xfffffe00e48a3ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00e48a3ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e48a3f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48a3f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100033 td 0xfffff80003c4a740 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e48b2de0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e48b2e00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e48b2e40 msleep_spin_sbt() at msleep_spin_sbt+0x14d/frame 0xfffffe00e48b2ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00e48b2ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e48b2f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48b2f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100034 td 0xfffff80003c4a000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e48adde0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e48ade00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e48ade40 msleep_spin_sbt() at msleep_spin_sbt+0x14d/frame 0xfffffe00e48adec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00e48adef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e48adf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48adf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100035 td 0xfffff80003c4b740 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e48bcde0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e48bce00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e48bce40 msleep_spin_sbt() at msleep_spin_sbt+0x14d/frame 0xfffffe00e48bcec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00e48bcef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e48bcf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48bcf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100036 td 0xfffff80003c4b000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e48b7de0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e48b7e00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e48b7e40 msleep_spin_sbt() at msleep_spin_sbt+0x14d/frame 0xfffffe00e48b7ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00e48b7ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e48b7f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48b7f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100037 td 0xfffff80003c4c740 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e48c6de0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e48c6e00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e48c6e40 msleep_spin_sbt() at msleep_spin_sbt+0x14d/frame 0xfffffe00e48c6ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00e48c6ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e48c6f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48c6f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100038 td 0xfffff80003c4c000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e48c1de0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e48c1e00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e48c1e40 msleep_spin_sbt() at msleep_spin_sbt+0x14d/frame 0xfffffe00e48c1ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00e48c1ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e48c1f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48c1f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100039 td 0xfffff80003c4d740 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e48d0de0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e48d0e00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e48d0e40 msleep_spin_sbt() at msleep_spin_sbt+0x14d/frame 0xfffffe00e48d0ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00e48d0ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e48d0f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48d0f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100040 td 0xfffff80003c4d000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e48cbdc0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e48cbde0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e48cbe20 _sleep() at _sleep+0x2d6/frame 0xfffffe00e48cbec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e48cbef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e48cbf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48cbf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100041 td 0xfffff80003c46740 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e48dadc0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e48dade0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e48dae20 _sleep() at _sleep+0x2d6/frame 0xfffffe00e48daec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e48daef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e48daf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48daf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100044 td 0xfffff80003c47000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e48dfdc0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e48dfde0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e48dfe20 _sleep() at _sleep+0x2d6/frame 0xfffffe00e48dfec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e48dfef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e48dff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48dff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100046 td 0xfffff80003c48000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e48e9dc0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e48e9de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e48e9e20 _sleep() at _sleep+0x2d6/frame 0xfffffe00e48e9ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e48e9ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e48e9f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48e9f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100047 td 0xfffff80003c49740 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e48f8dc0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e48f8de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e48f8e20 _sleep() at _sleep+0x2d6/frame 0xfffffe00e48f8ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e48f8ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e48f8f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48f8f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100048 td 0xfffff80003c49000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e48f3dc0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e48f3de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e48f3e20 _sleep() at _sleep+0x2d6/frame 0xfffffe00e48f3ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e48f3ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e48f3f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48f3f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100049 td 0xfffff80003c3b740 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4902dc0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4902de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4902e20 _sleep() at _sleep+0x2d6/frame 0xfffffe00e4902ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e4902ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4902f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4902f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100050 td 0xfffff80003c3b000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e48fdde0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e48fde00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e48fde40 msleep_spin_sbt() at msleep_spin_sbt+0x14d/frame 0xfffffe00e48fdec0 taskqueue_thread_loop() at taskqueue_thread_loop+0x104/frame 0xfffffe00e48fdef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e48fdf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48fdf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100051 td 0xfffff80003c3c740 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e490cdc0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e490cde0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e490ce20 _sleep() at _sleep+0x2d6/frame 0xfffffe00e490cec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e490cef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e490cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e490cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100052 td 0xfffff80003c3c000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4907dc0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4907de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4907e20 _sleep() at _sleep+0x2d6/frame 0xfffffe00e4907ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e4907ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4907f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4907f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100053 td 0xfffff80003c3d740 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4916dc0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4916de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4916e20 _sleep() at _sleep+0x2d6/frame 0xfffffe00e4916ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e4916ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4916f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4916f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100054 td 0xfffff80003c3d000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4911dc0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4911de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4911e20 _sleep() at _sleep+0x2d6/frame 0xfffffe00e4911ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e4911ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4911f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4911f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100055 td 0xfffff80003c3e740 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4920dc0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4920de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4920e20 _sleep() at _sleep+0x2d6/frame 0xfffffe00e4920ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e4920ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4920f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4920f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100056 td 0xfffff80003c3e000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e491bdc0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e491bde0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e491be20 _sleep() at _sleep+0x2d6/frame 0xfffffe00e491bec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e491bef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e491bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e491bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100057 td 0xfffff80003c34740 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e492adc0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e492ade0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e492ae20 _sleep() at _sleep+0x2d6/frame 0xfffffe00e492aec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e492aef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e492af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e492af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100058 td 0xfffff80003c34000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4925dc0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4925de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4925e20 _sleep() at _sleep+0x2d6/frame 0xfffffe00e4925ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e4925ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4925f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4925f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100059 td 0xfffff80003c38740 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4934dc0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4934de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4934e20 _sleep() at _sleep+0x2d6/frame 0xfffffe00e4934ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e4934ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4934f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4934f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100060 td 0xfffff80003c38000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e492fdc0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e492fde0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e492fe20 _sleep() at _sleep+0x2d6/frame 0xfffffe00e492fec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e492fef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e492ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e492ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100061 td 0xfffff80003c39740 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e493edc0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e493ede0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e493ee20 _sleep() at _sleep+0x2d6/frame 0xfffffe00e493eec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e493eef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e493ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e493ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100062 td 0xfffff80003c39000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4939dc0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4939de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4939e20 _sleep() at _sleep+0x2d6/frame 0xfffffe00e4939ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e4939ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4939f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4939f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100063 td 0xfffff80003c3a740 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4948dc0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4948de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4948e20 _sleep() at _sleep+0x2d6/frame 0xfffffe00e4948ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e4948ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4948f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4948f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100064 td 0xfffff80003c3a000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4943dc0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4943de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4943e20 _sleep() at _sleep+0x2d6/frame 0xfffffe00e4943ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e4943ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4943f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4943f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100065 td 0xfffff80003c30740 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4952dc0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4952de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4952e20 _sleep() at _sleep+0x2d6/frame 0xfffffe00e4952ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e4952ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4952f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4952f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100066 td 0xfffff80003c30000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e494ddc0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e494dde0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e494de20 _sleep() at _sleep+0x2d6/frame 0xfffffe00e494dec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e494def0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e494df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e494df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100067 td 0xfffff80003c31740 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e495cdc0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e495cde0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e495ce20 _sleep() at _sleep+0x2d6/frame 0xfffffe00e495cec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e495cef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e495cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e495cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100068 td 0xfffff80003c31000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4957dc0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4957de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4957e20 _sleep() at _sleep+0x2d6/frame 0xfffffe00e4957ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e4957ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4957f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4957f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100069 td 0xfffff80003c32740 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4966dc0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4966de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4966e20 _sleep() at _sleep+0x2d6/frame 0xfffffe00e4966ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e4966ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4966f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4966f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100070 td 0xfffff80003c32000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4961dc0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4961de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4961e20 _sleep() at _sleep+0x2d6/frame 0xfffffe00e4961ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e4961ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4961f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4961f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100071 td 0xfffff80003c33740 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4970dc0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4970de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4970e20 _sleep() at _sleep+0x2d6/frame 0xfffffe00e4970ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e4970ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4970f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4970f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100072 td 0xfffff80003c33000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e496bdc0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e496bde0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e496be20 _sleep() at _sleep+0x2d6/frame 0xfffffe00e496bec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e496bef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e496bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e496bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100073 td 0xfffff80003c28740 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e497adc0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e497ade0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e497ae20 _sleep() at _sleep+0x2d6/frame 0xfffffe00e497aec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e497aef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e497af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e497af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100074 td 0xfffff80003c28000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4975dc0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4975de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4975e20 _sleep() at _sleep+0x2d6/frame 0xfffffe00e4975ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e4975ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4975f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4975f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100075 td 0xfffff80003c29740 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4984dc0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4984de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4984e20 _sleep() at _sleep+0x2d6/frame 0xfffffe00e4984ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e4984ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4984f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4984f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100076 td 0xfffff80003c29000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e497fdc0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e497fde0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e497fe20 _sleep() at _sleep+0x2d6/frame 0xfffffe00e497fec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e497fef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e497ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e497ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100090 td 0xfffff80004211000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e49f5dc0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e49f5de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e49f5e20 _sleep() at _sleep+0x2d6/frame 0xfffffe00e49f5ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e49f5ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e49f5f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49f5f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100095 td 0xfffff80004214740 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4e48dc0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4e48de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4e48e20 _sleep() at _sleep+0x2d6/frame 0xfffffe00e4e48ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e4e48ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4e48f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e48f30 --- trap 0x6060302, rip = 0x703000703070303, rsp = 0xfff57418fff57420, rbp = 0xfff573e8fff573f0 --- Tracing command kernel pid 0 tid 100096 td 0xfffff80004214000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4e43dc0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4e43de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4e43e20 _sleep() at _sleep+0x2d6/frame 0xfffffe00e4e43ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e4e43ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4e43f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e43f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100097 td 0xfffff8000432c740 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4e52dc0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4e52de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4e52e20 _sleep() at _sleep+0x2d6/frame 0xfffffe00e4e52ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e4e52ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4e52f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e52f30 --- trap 0x4, rip = 0x300000000, rsp = 0x400000007, rbp = 0xffffff00120046c8 --- ??() at 0x300000000/frame 0xffffff00120046c8 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe015138a870 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe015138a880 calltrap() at calltrap+0x8/frame 0xfffffe015138a880 --- trap 0xc, rip = 0xffffffff8102e480, rsp = 0xfffffe015138a950, rbp = 0xfffffe015138a9e0 --- db_read_bytes() at db_read_bytes+0xa0/frame 0xfffffe015138a9e0 db_get_value() at db_get_value+0x31/frame 0xfffffe015138aa20 db_backtrace() at db_backtrace+0x1d9/frame 0xfffffe015138aaa0 db_trace_thread() at db_trace_thread+0x3a/frame 0xfffffe015138aac0 _db_stack_trace_all() at _db_stack_trace_all+0xfd/frame 0xfffffe015138ab60 db_command() at db_command+0x30d/frame 0xfffffe015138ac20 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe015138acc0 db_command() at db_command+0x30d/frame 0xfffffe015138ad80 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe015138ad90 db_trap() at db_trap+0xe6/frame 0xfffffe015138ae20 kdb_trap() at kdb_trap+0x253/frame 0xfffffe015138af70 trap() at trap+0x8c9/frame 0xfffffe015138b090 calltrap() at calltrap+0x8/frame 0xfffffe015138b090 --- trap 0x3, rip = 0xffffffff80ba3082, rsp = 0xfffffe015138b160, rbp = 0xfffffe015138b160 --- kdb_enter() at kdb_enter+0x32/frame 0xfffffe015138b160 vpanic() at vpanic+0x163/frame 0xfffffe015138b290 panic() at panic+0x43/frame 0xfffffe015138b2f0 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x11c/frame 0xfffffe015138b3a0 __lockmgr_args() at __lockmgr_args+0x207/frame 0xfffffe015138b440 getblkx() at getblkx+0x1c6/frame 0xfffffe015138b500 breadn_flags() at breadn_flags+0x44/frame 0xfffffe015138b570 vfs_bio_getpages() at vfs_bio_getpages+0x33c/frame 0xfffffe015138b660 ffs_getpages() at ffs_getpages+0x77/frame 0xfffffe015138b680 VOP_GETPAGES_APV() at VOP_GETPAGES_APV+0x60/frame 0xfffffe015138b6b0 vnode_pager_getpages() at vnode_pager_getpages+0x37/frame 0xfffffe015138b6f0 vm_pager_get_pages() at vm_pager_get_pages+0x5f/frame 0xfffffe015138b740 vm_fault() at vm_fault+0x70c/frame 0xfffffe015138b870 vm_fault_trap() at vm_fault_trap+0x6f/frame 0xfffffe015138b8b0 trap_pfault() at trap_pfault+0x24a/frame 0xfffffe015138b920 calltrap() at calltrap+0x8/frame 0xfffffe015138b920 --- trap 0xc, rip = 0xffffffff8105bce6, rsp = 0xfffffe015138b9f0, rbp = 0xfffffe015138b9f0 --- copyin_nosmap_erms() at copyin_nosmap_erms+0x156/frame 0xfffffe015138b9f0 uiomove_fromphys() at uiomove_fromphys+0x15a/frame 0xfffffe015138ba60 ffs_write() at ffs_write+0x356/frame 0xfffffe015138bb10 VOP_WRITE_APV() at VOP_WRITE_APV+0xcf/frame 0xfffffe015138bc20 vn_write() at vn_write+0x2f4/frame 0xfffffe015138bcb0 vn_io_fault() at vn_io_fault+0x1e2/frame 0xfffffe015138bd40 dofilewrite() at dofilewrite+0x82/frame 0xfffffe015138bd90 sys_write() at sys_write+0xc2/frame 0xfffffe015138be00 amd64_syscall() at amd64_syscall+0x153/frame 0xfffffe015138bf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe015138bf30 --- syscall (4, FreeBSD ELF64, write), rip = 0x82249ad0a, rsp = 0x8205d3578, rbp = 0x8205d36a0 --- *** error reading from address ffffff00120046d0 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe015138a9d0 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe015138a9e0 db_get_value() at db_get_value+0x4b/frame 0xfffffe015138aa20 db_backtrace() at db_backtrace+0x1d9/frame 0xfffffe015138aaa0 db_trace_thread() at db_trace_thread+0x3a/frame 0xfffffe015138aac0 _db_stack_trace_all() at _db_stack_trace_all+0xfd/frame 0xfffffe015138ab60 db_command() at db_command+0x30d/frame 0xfffffe015138ac20 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe015138acc0 db_command() at db_command+0x30d/frame 0xfffffe015138ad80 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe015138ad90 db_trap() at db_trap+0xe6/frame 0xfffffe015138ae20 kdb_trap() at kdb_trap+0x253/frame 0xfffffe015138af70 trap() at trap+0x8c9/frame 0xfffffe015138b090 calltrap() at calltrap+0x8/frame 0xfffffe015138b090 --- trap 0x3, rip = 0xffffffff80ba3082, rsp = 0xfffffe015138b160, rbp = 0xfffffe015138b160 --- kdb_enter() at kdb_enter+0x32/frame 0xfffffe015138b160 vpanic() at vpanic+0x163/frame 0xfffffe015138b290 panic() at panic+0x43/frame 0xfffffe015138b2f0 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x11c/frame 0xfffffe015138b3a0 __lockmgr_args() at __lockmgr_args+0x207/frame 0xfffffe015138b440 getblkx() at getblkx+0x1c6/frame 0xfffffe015138b500 breadn_flags() at breadn_flags+0x44/frame 0xfffffe015138b570 vfs_bio_getpages() at vfs_bio_getpages+0x33c/frame 0xfffffe015138b660 ffs_getpages() at ffs_getpages+0x77/frame 0xfffffe015138b680 VOP_GETPAGES_APV() at VOP_GETPAGES_APV+0x60/frame 0xfffffe015138b6b0 vnode_pager_getpages() at vnode_pager_getpages+0x37/frame 0xfffffe015138b6f0 vm_pager_get_pages() at vm_pager_get_pages+0x5f/frame 0xfffffe015138b740 vm_fault() at vm_fault+0x70c/frame 0xfffffe015138b870 vm_fault_trap() at vm_fault_trap+0x6f/frame 0xfffffe015138b8b0 trap_pfault() at trap_pfault+0x24a/frame 0xfffffe015138b920 calltrap() at calltrap+0x8/frame 0xfffffe015138b920 --- trap 0xc, rip = 0xffffffff8105bce6, rsp = 0xfffffe015138b9f0, rbp = 0xfffffe015138b9f0 --- copyin_nosmap_erms() at copyin_nosmap_erms+0x156/frame 0xfffffe015138b9f0 uiomove_fromphys() at uiomove_fromphys+0x15a/frame 0xfffffe015138ba60 ffs_write() at ffs_write+0x356/frame 0xfffffe015138bb10 VOP_WRITE_APV() at VOP_WRITE_APV+0xcf/frame 0xfffffe015138bc20 vn_write() at vn_write+0x2f4/frame 0xfffffe015138bcb0 vn_io_fault() at vn_io_fault+0x1e2/frame 0xfffffe015138bd40 dofilewrite() at dofilewrite+0x82/frame 0xfffffe015138bd90 sys_write() at sys_write+0xc2/frame 0xfffffe015138be00 amd64_syscall() at amd64_syscall+0x153/frame 0xfffffe015138bf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe015138bf30 --- syscall (4, FreeBSD ELF64, write), rip = 0x82249ad0a, rsp = 0x8205d3578, rbp = 0x8205d36a0 --- Tracing command kernel pid 0 tid 100098 td 0xfffff8000432c000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4e4ddc0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4e4dde0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4e4de20 _sleep() at _sleep+0x2d6/frame 0xfffffe00e4e4dec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e4e4def0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4e4df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e4df30 --- trap 0xffffffff, rip = 0xffffffff000000e0, rsp = 0x200000003, rbp = 0xffffffffffffffff --- ??() at 0xffffffff000000e0/frame 0xffffffffffffffff Tracing command kernel pid 0 tid 100099 td 0xfffff8000432d740 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4e5cdc0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4e5cde0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4e5ce20 _sleep() at _sleep+0x2d6/frame 0xfffffe00e4e5cec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e4e5cef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4e5cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e5cf30 --- trap 0x5328202e, rip = 0x6547336e6547203a, rsp = 0x4f50202c64253d54, rbp = 0x5328202e2e2e326e --- Tracing command kernel pid 0 tid 100100 td 0xfffff8000432d000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4e57dc0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4e57de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4e57e20 _sleep() at _sleep+0x2d6/frame 0xfffffe00e4e57ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e4e57ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4e57f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e57f30 --- trap 0x10272900, rip = 0x1b10150162a2b01, rsp = 0x56182c2d00f7122e, rbp = 0x1620e2122002c82 --- Tracing command kernel pid 0 tid 100101 td 0xfffff8000432e740 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4e66dc0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4e66de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4e66e20 _sleep() at _sleep+0x2d6/frame 0xfffffe00e4e66ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e4e66ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4e66f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e66f30 --- trap 0x58450301, rip = 0x7e24453966fffffe, rsp = 0xffffff40820f083a, rbp = 0xc22b99c103fffffe --- Tracing command kernel pid 0 tid 100102 td 0xfffff8000432e000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4e61dc0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4e61de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4e61e20 _sleep() at _sleep+0x2d6/frame 0xfffffe00e4e61ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e4e61ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4e61f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e61f30 --- trap 0xfffff4f8, rip = 0xc0840874013c0000, rsp = 0xc68b52006a000373, rbp = 0xca8100001a89e8c3 --- Tracing command kernel pid 0 tid 100103 td 0xfffff8000432f740 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4e70dc0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4e70de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4e70e20 _sleep() at _sleep+0x2d6/frame 0xfffffe00e4e70ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e4e70ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4e70f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e70f30 --- trap 0x4302444, rip = 0x14c4833824440324, rsp = 0xffff970ae8565553, rbp = 0x54890472c23b2424 --- Tracing command kernel pid 0 tid 100104 td 0xfffff8000432f000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4e6bdc0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4e6bde0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4e6be20 _sleep() at _sleep+0x2d6/frame 0xfffffe00e4e6bec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e4e6bef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4e6bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e6bf30 --- trap 0x1b0c35d, rip = 0x7d830cc483ffffed, rsp = 0x8bc2b60fd2320cc4, rbp = 0x33d88b008b10458b --- Tracing command kernel pid 0 tid 100105 td 0xfffff80004325740 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4e7adc0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4e7ade0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4e7ae20 _sleep() at _sleep+0x2d6/frame 0xfffffe00e4e7aec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e4e7aef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4e7af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e7af30 --- trap 0x75ff0c75, rip = 0x2075ff2475ff176a, rsp = 0xe9fffffaede80a75, rbp = 0xff1c75ff2075ff24 --- Tracing command kernel pid 0 tid 100106 td 0xfffff80004325000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4e75dc0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4e75de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4e75e20 _sleep() at _sleep+0x2d6/frame 0xfffffe00e4e75ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e4e75ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4e75f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e75f30 --- trap 0xbe0574c0, rip = 0x40000000d00046e, rsp = 0xad72020b7d800b45, rbp = 0x8300046fabe853f6 --- Tracing command kernel pid 0 tid 100146 td 0xfffff8004397a740 sched_switch() at sched_switch+0x5da/frame 0xfffffe010da28de0 mi_switch() at mi_switch+0x173/frame 0xfffffe010da28e00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe010da28e40 msleep_spin_sbt() at msleep_spin_sbt+0x14d/frame 0xfffffe010da28ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0x104/frame 0xfffffe010da28ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010da28f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da28f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100147 td 0xfffff8004397a000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4ffcde0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4ffce00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4ffce40 msleep_spin_sbt() at msleep_spin_sbt+0x14d/frame 0xfffffe00e4ffcec0 taskqueue_thread_loop() at taskqueue_thread_loop+0x104/frame 0xfffffe00e4ffcef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4ffcf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ffcf30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100148 td 0xfffff8004397b740 sched_switch() at sched_switch+0x5da/frame 0xfffffe010da32de0 mi_switch() at mi_switch+0x173/frame 0xfffffe010da32e00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe010da32e40 msleep_spin_sbt() at msleep_spin_sbt+0x14d/frame 0xfffffe010da32ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0x104/frame 0xfffffe010da32ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010da32f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da32f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100150 td 0xfffff8004397c740 sched_switch() at sched_switch+0x5da/frame 0xfffffe010da3cde0 mi_switch() at mi_switch+0x173/frame 0xfffffe010da3ce00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe010da3ce40 msleep_spin_sbt() at msleep_spin_sbt+0x14d/frame 0xfffffe010da3cec0 taskqueue_thread_loop() at taskqueue_thread_loop+0x104/frame 0xfffffe010da3cef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010da3cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da3cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100151 td 0xfffff8004397c000 sched_switch() at sched_switch+0x5da/frame 0xfffffe010da37dc0 mi_switch() at mi_switch+0x173/frame 0xfffffe010da37de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe010da37e20 _sleep() at _sleep+0x2d6/frame 0xfffffe010da37ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe010da37ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010da37f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da37f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command init pid 1 tid 100002 td 0xfffff80003c8e000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00377e1a10 mi_switch() at mi_switch+0x173/frame 0xfffffe00377e1a30 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00377e1a70 sleepq_catch_signals() at sleepq_catch_signals+0x276/frame 0xfffffe00377e1ac0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00377e1ad0 _sleep() at _sleep+0x2cc/frame 0xfffffe00377e1b70 kern_wait6() at kern_wait6+0x481/frame 0xfffffe00377e1c00 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe00377e1e00 amd64_syscall() at amd64_syscall+0x153/frame 0xfffffe00377e1f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00377e1f30 --- syscall (7, FreeBSD ELF64, wait4), rip = 0x28d9aa, rsp = 0x8203d35b8, rbp = 0x8203d3620 --- Tracing command clock pid 2 tid 100077 td 0xfffff80003c2a740 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e49beea0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e49beec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe00e49beef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e49bef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49bef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command clock pid 2 tid 100078 td 0xfffff80003c2a000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e49b9ea0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e49b9ec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe00e49b9ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e49b9f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49b9f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command clock pid 2 tid 100079 td 0xfffff80003c2b740 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e49c8ea0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e49c8ec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe00e49c8ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e49c8f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49c8f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command clock pid 2 tid 100080 td 0xfffff80003c2b000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e49c3ea0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e49c3ec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe00e49c3ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e49c3f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49c3f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command clock pid 2 tid 100081 td 0xfffff80004215740 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e49d2ea0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e49d2ec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe00e49d2ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e49d2f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49d2f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command clock pid 2 tid 100082 td 0xfffff80004215000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e49cdea0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e49cdec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe00e49cdef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e49cdf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49cdf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command clock pid 2 tid 100083 td 0xfffff80003bed740 fork_trampoline() at fork_trampoline Tracing command clock pid 2 tid 100084 td 0xfffff80003bed000 fork_trampoline() at fork_trampoline Tracing command clock pid 2 tid 100085 td 0xfffff80003bee740 fork_trampoline() at fork_trampoline Tracing command clock pid 2 tid 100086 td 0xfffff80003bee000 fork_trampoline() at fork_trampoline Tracing command clock pid 2 tid 100087 td 0xfffff80003bf3740 fork_trampoline() at fork_trampoline Tracing command clock pid 2 tid 100088 td 0xfffff80003bf3000 fork_trampoline() at fork_trampoline Tracing command crypto pid 3 tid 100107 td 0xfffff80004326740 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4e84db0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4e84dd0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4e84e10 _sleep() at _sleep+0x2d6/frame 0xfffffe00e4e84eb0 crypto_dispatch_thread() at crypto_dispatch_thread+0x193/frame 0xfffffe00e4e84ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4e84f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e84f30 --- trap 0xd00037e, rip = 0x45fe5959fffec66f, rsp = 0x5e5ffffffd91820f, rbp = 0xff0c0048206851c8 --- Tracing command crypto pid 3 tid 100108 td 0xfffff80004326000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4e7fdb0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4e7fdd0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4e7fe10 _sleep() at _sleep+0x2d6/frame 0xfffffe00e4e7feb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe00e4e7fef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4e7ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e7ff30 --- trap 0x4c458b28, rip = 0xeb80054c8966ffff, rsp = 0xe1c1c18bc8b70fff, rbp = 0x51ffffff400584b7 --- Tracing command crypto pid 3 tid 100109 td 0xfffff80004327740 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4e8edb0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4e8edd0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4e8ee10 _sleep() at _sleep+0x2d6/frame 0xfffffe00e4e8eeb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe00e4e8eef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4e8ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e8ef30 --- trap 0x75084589, rip = 0x5d3966db33530000, rsp = 0xe8560c75ff571475, rbp = 0xff1075ff531875ff --- Tracing command crypto pid 3 tid 100110 td 0xfffff80004327000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4e89db0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4e89dd0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4e89e10 _sleep() at _sleep+0x2d6/frame 0xfffffe00e4e89eb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe00e4e89ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4e89f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e89f30 --- trap 0x99e85750, rip = 0x2b5045c758296a, rsp = 0x38805c458b5c4589, rbp = 0x5753fffe862fe857 --- Tracing command crypto pid 3 tid 100111 td 0xfffff80004328740 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4e98db0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4e98dd0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4e98e10 _sleep() at _sleep+0x2d6/frame 0xfffffe00e4e98eb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe00e4e98ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4e98f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e98f30 --- trap 0x57000226, rip = 0xf5756530c458b10, rsp = 0x3a000000dcbe1045, rbp = 0x1075ff560a03408c --- Tracing command crypto pid 3 tid 100112 td 0xfffff80004328000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4e93db0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4e93dd0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4e93e10 _sleep() at _sleep+0x2d6/frame 0xfffffe00e4e93eb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe00e4e93ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4e93f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e93f30 --- trap 0xc1404cc4, rip = 0x1420885048d59c0, rsp = 0x6a137502147d8019, rbp = 0x8dc0b60ffffde609 --- Tracing command crypto pid 3 tid 100113 td 0xfffff8000431b740 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4ea2db0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4ea2dd0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4ea2e10 _sleep() at _sleep+0x2d6/frame 0xfffffe00e4ea2eb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe00e4ea2ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4ea2f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ea2f30 --- trap 0x8b51511c, rip = 0x5600000a36838a08, rsp = 0xe85357fffffdd6e8, rbp = 0x56ec8b55c35df1f7 --- Tracing command crypto pid 3 tid 100114 td 0xfffff8000431b000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4e9ddb0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4e9ddd0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4e9de10 _sleep() at _sleep+0x2d6/frame 0xfffffe00e4e9deb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe00e4e9def0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4e9df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e9df30 --- trap 0xf03c2f6, rip = 0xfffccd62e80875ff, rsp = 0xcdc8e80875ff50c0, rbp = 0xf45589c9b60fec4d --- Tracing command crypto pid 3 tid 100115 td 0xfffff8000431c740 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4eacdb0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4eacdd0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4eace10 _sleep() at _sleep+0x2d6/frame 0xfffffe00e4eaceb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe00e4eacef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4eacf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4eacf30 --- trap 0xff458d18, rip = 0x8dfc8b5151686a50, rsp = 0x516a6a50ff458d18, rbp = 0xfc8b515100000084 --- Tracing command crypto pid 3 tid 100116 td 0xfffff8000431c000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4ea7db0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4ea7dd0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4ea7e10 _sleep() at _sleep+0x2d6/frame 0xfffffe00e4ea7eb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe00e4ea7ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4ea7f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ea7f30 --- trap 0x15c06bc7, rip = 0x148800020646938a, rsp = 0x8400fe45c6000201, rbp = 0x2b76303b000220d4 --- Tracing command crypto pid 3 tid 100117 td 0xfffff8000431d740 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4eb6db0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4eb6dd0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4eb6e10 _sleep() at _sleep+0x2d6/frame 0xfffffe00e4eb6eb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe00e4eb6ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4eb6f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4eb6f30 --- trap 0xc75ff57, rip = 0xf24d0f653076ae0, rsp = 0x66a406afffd828d, rbp = 0xfbb62ce8ffef45c6 --- Tracing command crypto pid 3 tid 100118 td 0xfffff8000431d000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4eb1db0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4eb1dd0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4eb1e10 _sleep() at _sleep+0x2d6/frame 0xfffffe00e4eb1eb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe00e4eb1ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4eb1f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4eb1f30 --- trap 0xb60fffff, rip = 0xd6184d8c8d880c8d, rsp = 0x56538734ff106a51, rbp = 0xef7d801075000229 --- Tracing command crypto pid 3 tid 100119 td 0xfffff8000431e740 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4ec0db0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4ec0dd0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4ec0e10 _sleep() at _sleep+0x2d6/frame 0xfffffe00e4ec0eb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe00e4ec0ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4ec0f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ec0f30 --- trap 0x4475ff2c, rip = 0xe0c1c18b4674c785, rsp = 0x1ffffe7810a8b, rbp = 0x537475ffffffff71 --- Tracing command cam pid 4 tid 100120 td 0xfffff8000431e000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4ebbda0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4ebbdc0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4ebbe00 _sleep() at _sleep+0x2d6/frame 0xfffffe00e4ebbea0 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe00e4ebbef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4ebbf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ebbf30 --- trap 0x8d374688, rip = 0x9968500b45, rsp = 0x68500b458d394688, rbp = 0x9668500b458d --- Tracing command cam pid 4 tid 100121 td 0xfffff800042c0740 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4ecada0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4ecadc0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4ecae00 _sleep() at _sleep+0x2d6/frame 0xfffffe00e4ecaea0 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe00e4ecaef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4ecaf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ecaf30 --- trap 0xc107241e, rip = 0xb60fc0fec902c002, rsp = 0x5db60f02e2c1006f, rbp = 0x16d45c60100f604 --- Tracing command cam pid 4 tid 100122 td 0xfffff800042c0000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4ec5da0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4ec5dc0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4ec5e00 _sleep() at _sleep+0x2d6/frame 0xfffffe00e4ec5ea0 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe00e4ec5ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4ec5f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ec5f30 --- trap 0x45c614c4, rip = 0xf8830a74016c45f6, rsp = 0x83480b798000003f, rbp = 0x1f88340fec88348 --- Tracing command cam pid 4 tid 100123 td 0xfffff800042c5740 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4ed4da0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4ed4dc0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4ed4e00 _sleep() at _sleep+0x2d6/frame 0xfffffe00e4ed4ea0 xpt_async_td() at xpt_async_td+0x74/frame 0xfffffe00e4ed4ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4ed4f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ed4f30 --- trap 0xe8530c75, rip = 0x57501147d801188, rsp = 0xc483fffe7f3ce853, rbp = 0xeb041345c602fb45 --- Tracing command cam pid 4 tid 100152 td 0xfffff80043988740 sched_switch() at sched_switch+0x5da/frame 0xfffffe010da46dc0 mi_switch() at mi_switch+0x173/frame 0xfffffe010da46de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe010da46e20 _sleep() at _sleep+0x2d6/frame 0xfffffe010da46ec0 xpt_scanner_thread() at xpt_scanner_thread+0x158/frame 0xfffffe010da46ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010da46f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da46f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command busdma pid 5 tid 100125 td 0xfffff800048a4000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4ed9da0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4ed9dc0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4ed9e00 _sleep() at _sleep+0x2d6/frame 0xfffffe00e4ed9ea0 busdma_thread() at busdma_thread+0xc5/frame 0xfffffe00e4ed9ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4ed9f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ed9f30 --- trap 0x4d958dd0, rip = 0x73fff98305723f77, rsp = 0x753b04728b2372dc, rbp = 0x8d078bffffef6ae8 --- Tracing command rand_harvestq pid 6 tid 100149 td 0xfffff8004397b000 sched_switch() at sched_switch+0x5da/frame 0xfffffe010da2dd20 mi_switch() at mi_switch+0x173/frame 0xfffffe010da2dd40 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe010da2dd80 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010da2ddc0 _sleep() at _sleep+0x2bd/frame 0xfffffe010da2de60 random_kthread() at random_kthread+0xb7/frame 0xfffffe010da2def0 fork_exit() at fork_exit+0x82/frame 0xfffffe010da2df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da2df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon0 pid 7 tid 100153 td 0xfffff80004998740 sched_switch() at sched_switch+0x5da/frame 0xfffffe010da5cd80 mi_switch() at mi_switch+0x173/frame 0xfffffe010da5cda0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe010da5cde0 _sleep() at _sleep+0x2d6/frame 0xfffffe010da5ce80 enc_daemon() at enc_daemon+0xdd/frame 0xfffffe010da5cef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010da5cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da5cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon1 pid 8 tid 100154 td 0xfffff80004998000 sched_switch() at sched_switch+0x5da/frame 0xfffffe010da57d80 mi_switch() at mi_switch+0x173/frame 0xfffffe010da57da0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe010da57de0 _sleep() at _sleep+0x2d6/frame 0xfffffe010da57e80 enc_daemon() at enc_daemon+0xdd/frame 0xfffffe010da57ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010da57f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da57f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 9 tid 100161 td 0xfffff80043988000 sched_switch() at sched_switch+0x5da/frame 0xfffffe010da419b0 mi_switch() at mi_switch+0x173/frame 0xfffffe010da419d0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe010da41a10 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010da41a50 _sleep() at _sleep+0x2bd/frame 0xfffffe010da41af0 vm_pageout_worker() at vm_pageout_worker+0x28c/frame 0xfffffe010da41eb0 vm_pageout() at vm_pageout+0x1d7/frame 0xfffffe010da41ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010da41f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da41f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 9 tid 100171 td 0xfffff80004999740 sched_switch() at sched_switch+0x5da/frame 0xfffffe010db91a00 mi_switch() at mi_switch+0x173/frame 0xfffffe010db91a20 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe010db91a60 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db91aa0 _sleep() at _sleep+0x2bd/frame 0xfffffe010db91b40 pause_sbt() at pause_sbt+0xfd/frame 0xfffffe010db91b70 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x9e7/frame 0xfffffe010db91ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010db91f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db91f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 9 tid 100172 td 0xfffff80004999000 sched_switch() at sched_switch+0x5da/frame 0xfffffe010db8cd80 mi_switch() at mi_switch+0x173/frame 0xfffffe010db8cda0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe010db8cde0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db8ce20 _sleep() at _sleep+0x2bd/frame 0xfffffe010db8cec0 uma_reclaim_worker() at uma_reclaim_worker+0xc8/frame 0xfffffe010db8cef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010db8cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db8cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command audit pid 10 tid 100001 td 0xfffff80003c8e740 sched_switch() at sched_switch+0x5da/frame 0xfffffe00377e6dd0 mi_switch() at mi_switch+0x173/frame 0xfffffe00377e6df0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00377e6e30 _cv_wait() at _cv_wait+0x165/frame 0xfffffe00377e6e90 audit_worker() at audit_worker+0x8f/frame 0xfffffe00377e6ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00377e6f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377e6f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100003 td 0xfffff80003c8f740 sched_switch() at sched_switch+0x5da/frame 0xfffffe00377f0dd0 mi_switch() at mi_switch+0x173/frame 0xfffffe00377f0df0 sched_idletd() at sched_idletd+0x90/frame 0xfffffe00377f0ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00377f0f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377f0f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffff80003c8f000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00377ebdd0 mi_switch() at mi_switch+0x173/frame 0xfffffe00377ebdf0 sched_idletd() at sched_idletd+0x58c/frame 0xfffffe00377ebef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00377ebf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377ebf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffff80003c90740 sched_switch() at sched_switch+0x5da/frame 0xfffffe00377fadd0 mi_switch() at mi_switch+0x173/frame 0xfffffe00377fadf0 sched_idletd() at sched_idletd+0x58c/frame 0xfffffe00377faef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00377faf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377faf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffff80003c90000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00377f5dd0 mi_switch() at mi_switch+0x173/frame 0xfffffe00377f5df0 sched_idletd() at sched_idletd+0x90/frame 0xfffffe00377f5ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00377f5f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377f5f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffff80003c91740 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4830dd0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4830df0 sched_idletd() at sched_idletd+0x58c/frame 0xfffffe00e4830ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4830f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4830f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffff80003c91000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00377ffdd0 mi_switch() at mi_switch+0x173/frame 0xfffffe00377ffdf0 sched_idletd() at sched_idletd+0x58c/frame 0xfffffe00377ffef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00377fff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377fff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffff80003c82740 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e483add0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e483adf0 sched_idletd() at sched_idletd+0x58c/frame 0xfffffe00e483aef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e483af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e483af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffff80003c82000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4835dd0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4835df0 sched_idletd() at sched_idletd+0x90/frame 0xfffffe00e4835ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4835f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4835f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffff80003c83740 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4844dd0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4844df0 sched_idletd() at sched_idletd+0x58c/frame 0xfffffe00e4844ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4844f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4844f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffff80003c83000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e483fdd0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e483fdf0 sched_idletd() at sched_idletd+0x58c/frame 0xfffffe00e483fef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e483ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e483ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffff80003c84740 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e484ec50 mi_switch() at mi_switch+0x173/frame 0xfffffe00e484ec70 intr_event_handle() at intr_event_handle+0x341/frame 0xfffffe00e484ece0 intr_execute_handlers() at intr_execute_handlers+0x63/frame 0xfffffe00e484ed10 Xapic_isr1() at Xapic_isr1+0xdc/frame 0xfffffe00e484ed10 --- interrupt, rip = 0xffffffff8103b218, rsp = 0xfffffe00e484ede0, rbp = 0xfffffe00e484edf0 --- spinlock_exit() at spinlock_exit+0x38/frame 0xfffffe00e484edf0 sched_idletd() at sched_idletd+0x90/frame 0xfffffe00e484eef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e484ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e484ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffff80003c84000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4849dd0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4849df0 sched_idletd() at sched_idletd+0x58c/frame 0xfffffe00e4849ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4849f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4849f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100042 td 0xfffff80003c46000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e48d5e40 mi_switch() at mi_switch+0x173/frame 0xfffffe00e48d5e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e48d5ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e48d5f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48d5f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100043 td 0xfffff80003c47740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100045 td 0xfffff80003c48740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100089 td 0xfffff80004211740 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e49fae40 mi_switch() at mi_switch+0x173/frame 0xfffffe00e49fae60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e49faef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e49faf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49faf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100124 td 0xfffff800048a4740 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4edee40 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4edee60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4edeef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4edef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4edef30 --- trap 0x3c0, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xfe80d727facddea4 --- Tracing command intr pid 12 tid 100126 td 0xfffff800048a5740 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4ee8e40 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4ee8e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4ee8ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4ee8f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ee8f30 --- trap 0x1, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0x30646870 --- Tracing command intr pid 12 tid 100132 td 0xfffff80005080740 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4f06e40 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4f06e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4f06ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4f06f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f06f30 --- trap 0x7f, rip = 0x2020900000000, rsp = 0x7000000000, rbp = 0x100020204 --- Tracing command intr pid 12 tid 100143 td 0xfffff800040ef000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100144 td 0xfffff800040f7740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100145 td 0xfffff800040f7000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4f49e40 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4f49e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4f49ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4f49f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f49f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0 --- Tracing command intr pid 12 tid 100199 td 0xfffff8004393b740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100200 td 0xfffff8004393b000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100201 td 0xfffff8004c2c8740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100202 td 0xfffff8004c2c8000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100203 td 0xfffff8004c2c9740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100204 td 0xfffff8004c2c9000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100205 td 0xfffff8004c2ca740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100206 td 0xfffff8004c2ca000 fork_trampoline() at fork_trampoline Tracing command geom pid 13 tid 100091 td 0xfffff80004212740 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4e34dc0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4e34de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4e34e20 _sleep() at _sleep+0x2d6/frame 0xfffffe00e4e34ec0 g_run_events() at g_run_events+0x434/frame 0xfffffe00e4e34ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4e34f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e34f30 --- trap 0x76a6024, rip = 0x44c6565378778d53, rsp = 0x8497ff3c247489, rbp = 0x6814c4834824448b --- Tracing command geom pid 13 tid 100092 td 0xfffff80004212000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e49ffdb0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e49ffdd0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e49ffe10 _sleep() at _sleep+0x2d6/frame 0xfffffe00e49ffeb0 g_io_schedule_up() at g_io_schedule_up+0x3c/frame 0xfffffe00e49ffee0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe00e49ffef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e49fff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49fff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100093 td 0xfffff80004213740 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4e3edb0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4e3edd0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4e3ee10 _sleep() at _sleep+0x2d6/frame 0xfffffe00e4e3eeb0 g_io_schedule_down() at g_io_schedule_down+0x4c/frame 0xfffffe00e4e3eee0 g_down_procbody() at g_down_procbody+0x5c/frame 0xfffffe00e4e3eef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4e3ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e3ef30 --- trap 0xd, rip = 0x1000000e0ffffff, rsp = 0x1000000e0ffffff, rbp = 0xe0ffff07002428 --- Tracing command sequencer 00 pid 14 tid 100094 td 0xfffff80004213000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4e39db0 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4e39dd0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4e39e10 _cv_wait() at _cv_wait+0x165/frame 0xfffffe00e4e39e70 seq_eventthread() at seq_eventthread+0x8c/frame 0xfffffe00e4e39ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4e39f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e39f30 --- trap 0x82e06b32, rip = 0x182bc0ec79e60087, rsp = 0xa366b94a1cbb8a50, rbp = 0xdcb7b2f928208f02 --- Tracing command usb pid 15 tid 100127 td 0xfffff800048a5000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4ee3e00 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4ee3e20 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4ee3e60 _cv_wait() at _cv_wait+0x165/frame 0xfffffe00e4ee3ec0 usb_process() at usb_process+0xb0/frame 0xfffffe00e4ee3ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4ee3f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ee3f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command usb pid 15 tid 100128 td 0xfffff800048a6740 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4ef2e00 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4ef2e20 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4ef2e60 _cv_wait() at _cv_wait+0x165/frame 0xfffffe00e4ef2ec0 usb_process() at usb_process+0xb0/frame 0xfffffe00e4ef2ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4ef2f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ef2f30 --- trap 0x540, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0x50006700630054 --- Tracing command usb pid 15 tid 100129 td 0xfffff800048a6000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4eede00 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4eede20 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4eede60 _cv_wait() at _cv_wait+0x165/frame 0xfffffe00e4eedec0 usb_process() at usb_process+0xb0/frame 0xfffffe00e4eedef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4eedf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4eedf30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xb8664 --- Tracing command usb pid 15 tid 100130 td 0xfffff800048ae740 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4efce00 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4efce20 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4efce60 _cv_wait() at _cv_wait+0x165/frame 0xfffffe00e4efcec0 usb_process() at usb_process+0xb0/frame 0xfffffe00e4efcef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4efcf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4efcf30 --- trap 0x33c80b0a, rip = 0xfee89589d103c80b, rsp = 0xfef0958bfffffee0, rbp = 0x858b02eac1fffffe --- Tracing command usb pid 15 tid 100131 td 0xfffff800048ae000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4ef7e00 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4ef7e20 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4ef7e60 _cv_wait() at _cv_wait+0x165/frame 0xfffffe00e4ef7ec0 usb_process() at usb_process+0xb0/frame 0xfffffe00e4ef7ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4ef7f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ef7f30 --- trap 0xff25, rip = 0xcb888808458b00e2, rsp = 0x45c708c483ffffe6, rbp = 0xc8828808558b --- Tracing command usb pid 15 tid 100133 td 0xfffff80005080000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4f01e00 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4f01e20 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4f01e60 _cv_wait() at _cv_wait+0x165/frame 0xfffffe00e4f01ec0 usb_process() at usb_process+0xb0/frame 0xfffffe00e4f01ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4f01f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f01f30 --- trap 0xffe98130, rip = 0x1000b8057400, rsp = 0x7774c023c07e0f66, rbp = 0xd37e0f0d7406fb83 --- Tracing command usb pid 15 tid 100134 td 0xfffff80005081740 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4f10e00 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4f10e20 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4f10e60 _cv_wait() at _cv_wait+0x165/frame 0xfffffe00e4f10ec0 usb_process() at usb_process+0xb0/frame 0xfffffe00e4f10ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4f10f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f10f30 --- trap 0x8024b4ff, rip = 0x6a00000522e9010f, rsp = 0x70247c836620c7, rbp = 0x896c2474ff016a50 --- Tracing command usb pid 15 tid 100135 td 0xfffff80005081000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4f0be00 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4f0be20 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4f0be60 _cv_wait() at _cv_wait+0x165/frame 0xfffffe00e4f0bec0 usb_process() at usb_process+0xb0/frame 0xfffffe00e4f0bef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4f0bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f0bf30 --- trap 0xb589ffff, rip = 0x8d89fffffde4b589, rsp = 0xfffdf4b589fffffd, rbp = 0xfec4b589fffffef0 --- Tracing command usb pid 15 tid 100136 td 0xfffff80005082740 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4f1ae00 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4f1ae20 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4f1ae60 _cv_wait() at _cv_wait+0x165/frame 0xfffffe00e4f1aec0 usb_process() at usb_process+0xb0/frame 0xfffffe00e4f1aef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4f1af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f1af30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafaf6c617470 --- Tracing command usb pid 15 tid 100137 td 0xfffff80005082000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4f15e00 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4f15e20 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4f15e60 _cv_wait() at _cv_wait+0x165/frame 0xfffffe00e4f15ec0 usb_process() at usb_process+0xb0/frame 0xfffffe00e4f15ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4f15f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f15f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xc8664 --- Tracing command usb pid 15 tid 100138 td 0xfffff800040ed740 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4f30e00 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4f30e20 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4f30e60 _cv_wait() at _cv_wait+0x165/frame 0xfffffe00e4f30ec0 usb_process() at usb_process+0xb0/frame 0xfffffe00e4f30ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4f30f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f30f30 --- trap 0x3fa000, rip = 0x3fc000, rsp = 0x1000, rbp = 0x1000 --- Tracing command usb pid 15 tid 100139 td 0xfffff800040ed000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4f2be00 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4f2be20 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4f2be60 _cv_wait() at _cv_wait+0x165/frame 0xfffffe00e4f2bec0 usb_process() at usb_process+0xb0/frame 0xfffffe00e4f2bef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4f2bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f2bf30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command usb pid 15 tid 100140 td 0xfffff800040ee740 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4f3ae00 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4f3ae20 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4f3ae60 _cv_wait() at _cv_wait+0x165/frame 0xfffffe00e4f3aec0 usb_process() at usb_process+0xb0/frame 0xfffffe00e4f3aef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4f3af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f3af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100141 td 0xfffff800040ee000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4f35e00 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4f35e20 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4f35e60 _cv_wait() at _cv_wait+0x165/frame 0xfffffe00e4f35ec0 usb_process() at usb_process+0xb0/frame 0xfffffe00e4f35ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4f35f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f35f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command usb pid 15 tid 100142 td 0xfffff800040ef740 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4f44e00 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4f44e20 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4f44e60 _cv_wait() at _cv_wait+0x165/frame 0xfffffe00e4f44ec0 usb_process() at usb_process+0xb0/frame 0xfffffe00e4f44ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4f44f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f44f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vmdaemon pid 16 tid 100162 td 0xfffff80043938740 sched_switch() at sched_switch+0x5da/frame 0xfffffe010da66d80 mi_switch() at mi_switch+0x173/frame 0xfffffe010da66da0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe010da66de0 _sleep() at _sleep+0x2d6/frame 0xfffffe010da66e80 vm_daemon() at vm_daemon+0x82/frame 0xfffffe010da66ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010da66f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da66f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100163 td 0xfffff80043938000 sched_switch() at sched_switch+0x5da/frame 0xfffffe010da61d60 mi_switch() at mi_switch+0x173/frame 0xfffffe010da61d80 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe010da61dc0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010da61e00 _sleep() at _sleep+0x2bd/frame 0xfffffe010da61ea0 buf_daemon() at buf_daemon+0x121/frame 0xfffffe010da61ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010da61f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da61f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100164 td 0xfffff80005083740 sched_switch() at sched_switch+0x5da/frame 0xfffffe010e505d40 mi_switch() at mi_switch+0x173/frame 0xfffffe010e505d60 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe010e505da0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010e505de0 _sleep() at _sleep+0x2bd/frame 0xfffffe010e505e80 bufspace_daemon() at bufspace_daemon+0x322/frame 0xfffffe010e505ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010e505f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010e505f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100165 td 0xfffff80005083000 sched_switch() at sched_switch+0x5da/frame 0xfffffe010db78d40 mi_switch() at mi_switch+0x173/frame 0xfffffe010db78d60 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe010db78da0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db78de0 _sleep() at _sleep+0x2bd/frame 0xfffffe010db78e80 bufspace_daemon() at bufspace_daemon+0x322/frame 0xfffffe010db78ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010db78f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db78f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100166 td 0xfffff80005052740 sched_switch() at sched_switch+0x5da/frame 0xfffffe010e50fd40 mi_switch() at mi_switch+0x173/frame 0xfffffe010e50fd60 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe010e50fda0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010e50fde0 _sleep() at _sleep+0x2bd/frame 0xfffffe010e50fe80 bufspace_daemon() at bufspace_daemon+0x322/frame 0xfffffe010e50fef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010e50ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010e50ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100167 td 0xfffff80005052000 sched_switch() at sched_switch+0x5da/frame 0xfffffe010e50ad40 mi_switch() at mi_switch+0x173/frame 0xfffffe010e50ad60 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe010e50ada0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010e50ade0 _sleep() at _sleep+0x2bd/frame 0xfffffe010e50ae80 bufspace_daemon() at bufspace_daemon+0x322/frame 0xfffffe010e50aef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010e50af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010e50af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100168 td 0xfffff80005053740 sched_switch() at sched_switch+0x5da/frame 0xfffffe010db7dd40 mi_switch() at mi_switch+0x173/frame 0xfffffe010db7dd60 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe010db7dda0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db7dde0 _sleep() at _sleep+0x2bd/frame 0xfffffe010db7de80 bufspace_daemon() at bufspace_daemon+0x322/frame 0xfffffe010db7def0 fork_exit() at fork_exit+0x82/frame 0xfffffe010db7df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db7df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100169 td 0xfffff80005053000 (CPU -1) sched_switch() at sched_switch+0x5da/frame 0xfffffe010e918d40 mi_switch() at mi_switch+0x173/frame 0xfffffe010e918d60 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe010e918da0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010e918de0 _sleep() at _sleep+0x2bd/frame 0xfffffe010e918e80 bufspace_daemon() at bufspace_daemon+0x322/frame 0xfffffe010e918ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010e918f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010e918f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100170 td 0xfffff80005054740 sched_switch() at sched_switch+0x5da/frame 0xfffffe010db87d40 mi_switch() at mi_switch+0x173/frame 0xfffffe010db87d60 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe010db87da0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db87de0 _sleep() at _sleep+0x2bd/frame 0xfffffe010db87e80 bufspace_daemon() at bufspace_daemon+0x322/frame 0xfffffe010db87ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010db87f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db87f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100194 td 0xfffff80043839740 sched_switch() at sched_switch+0x5da/frame 0xfffffe0151361d70 mi_switch() at mi_switch+0x173/frame 0xfffffe0151361d90 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe0151361dd0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0151361e10 _sleep() at _sleep+0x2bd/frame 0xfffffe0151361eb0 softdep_flush() at softdep_flush+0x188/frame 0xfffffe0151361ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0151361f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0151361f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100220 td 0xfffff800042c5000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4ecfd70 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4ecfd90 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4ecfdd0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e4ecfe10 _sleep() at _sleep+0x2bd/frame 0xfffffe00e4ecfeb0 softdep_flush() at softdep_flush+0x188/frame 0xfffffe00e4ecfef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4ecff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ecff30 --- trap 0xec8b55c3, rip = 0xc75ff0875ff1875, rsp = 0x75ff560c408b0845, rbp = 0xc95bc0335e714688 --- Tracing command bufdaemon pid 17 tid 101174 td 0xfffff80836aba000 sched_switch() at sched_switch+0x5da/frame 0xfffffe0151390d70 mi_switch() at mi_switch+0x173/frame 0xfffffe0151390d90 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe0151390dd0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0151390e10 _sleep() at _sleep+0x2bd/frame 0xfffffe0151390eb0 softdep_flush() at softdep_flush+0x188/frame 0xfffffe0151390ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0151390f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0151390f30 --- trap 0xa5a5a5a5, rip = 0xa5a5a5a5a5a5a5a5, rsp = 0xa5a5a5a5a5a5a5a5, rbp = 0xa5a5a5a5a5a5a5a5 --- Tracing command vnlru pid 18 tid 100173 td 0xfffff80043939740 sched_switch() at sched_switch+0x5da/frame 0xfffffe010db9bd10 mi_switch() at mi_switch+0x173/frame 0xfffffe010db9bd30 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe010db9bd70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db9bdb0 _sleep() at _sleep+0x2bd/frame 0xfffffe010db9be50 vnlru_proc() at vnlru_proc+0xfb/frame 0xfffffe010db9bef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010db9bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db9bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command syncer pid 19 tid 100174 td 0xfffff80043939000 sched_switch() at sched_switch+0x5da/frame 0xfffffe010db96d50 mi_switch() at mi_switch+0x173/frame 0xfffffe010db96d70 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe010db96db0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db96df0 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x188/frame 0xfffffe010db96e60 sched_sync() at sched_sync+0x6ae/frame 0xfffffe010db96ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010db96f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db96f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command su pid 8445 tid 100525 td 0xfffff806e33e0740 --- swapped out Tracing command csh pid 8446 tid 100549 td 0xfffff8031c191740 --- swapped out Tracing command bash pid 8452 tid 100228 td 0xfffff80043fa4000 sched_switch() at sched_switch+0x5da/frame 0xfffffe0151352a10 mi_switch() at mi_switch+0x173/frame 0xfffffe0151352a30 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe0151352a70 sleepq_catch_signals() at sleepq_catch_signals+0x276/frame 0xfffffe0151352ac0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0151352ad0 _sleep() at _sleep+0x2cc/frame 0xfffffe0151352b70 kern_wait6() at kern_wait6+0x481/frame 0xfffffe0151352c00 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0151352e00 amd64_syscall() at amd64_syscall+0x153/frame 0xfffffe0151352f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0151352f30 --- syscall (7, FreeBSD ELF64, wait4), rip = 0x824a45cca, rsp = 0x82122b9f8, rbp = 0x82122ba50 --- Tracing command dhclient pid 2977 tid 100233 td 0xfffff8004c2cb740 sched_switch() at sched_switch+0x5da/frame 0xfffffe0157a9aab0 mi_switch() at mi_switch+0x173/frame 0xfffffe0157a9aad0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe0157a9ab10 sleepq_catch_signals() at sleepq_catch_signals+0x276/frame 0xfffffe0157a9ab60 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0157a9ab70 _cv_wait_sig() at _cv_wait_sig+0x15f/frame 0xfffffe0157a9abd0 kern_select() at kern_select+0xaeb/frame 0xfffffe0157a9adc0 sys_select() at sys_select+0x57/frame 0xfffffe0157a9ae00 amd64_syscall() at amd64_syscall+0x153/frame 0xfffffe0157a9af30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0157a9af30 --- syscall (93, FreeBSD ELF64, select), rip = 0xd56cc5afb6a, rsp = 0xd56c8519728, rbp = 0xd56c85197e0 --- Tracing command dhclient pid 2980 tid 100229 td 0xfffff80005055000 sched_switch() at sched_switch+0x5da/frame 0xfffffe015137cae0 mi_switch() at mi_switch+0x173/frame 0xfffffe015137cb00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe015137cb40 sleepq_catch_signals() at sleepq_catch_signals+0x276/frame 0xfffffe015137cb90 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe015137cba0 _cv_wait_sig() at _cv_wait_sig+0x15f/frame 0xfffffe015137cc00 kern_poll_kfds() at kern_poll_kfds+0x4cc/frame 0xfffffe015137cc90 kern_poll() at kern_poll+0x99/frame 0xfffffe015137cde0 sys_poll() at sys_poll+0x50/frame 0xfffffe015137ce00 amd64_syscall() at amd64_syscall+0x153/frame 0xfffffe015137cf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe015137cf30 --- syscall (209, FreeBSD ELF64, poll), rip = 0xd56cc5afa6a, rsp = 0xd56c8519968, rbp = 0xd56c85199a0 --- Tracing command dhclient pid 3039 tid 100239 td 0xfffff80043fad740 sched_switch() at sched_switch+0x5da/frame 0xfffffe0157aeaaa0 mi_switch() at mi_switch+0x173/frame 0xfffffe0157aeaac0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe0157aeab00 sleepq_catch_signals() at sleepq_catch_signals+0x276/frame 0xfffffe0157aeab50 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe0157aeab90 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x188/frame 0xfffffe0157aeac00 kern_poll_kfds() at kern_poll_kfds+0x497/frame 0xfffffe0157aeac90 kern_poll() at kern_poll+0x99/frame 0xfffffe0157aeade0 sys_poll() at sys_poll+0x50/frame 0xfffffe0157aeae00 amd64_syscall() at amd64_syscall+0x153/frame 0xfffffe0157aeaf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0157aeaf30 --- syscall (209, FreeBSD ELF64, poll), rip = 0xd56cc5afa6a, rsp = 0xd56c8519968, rbp = 0xd56c85199a0 --- Tracing command devd pid 3054 tid 100231 td 0xfffff80003d81000 sched_switch() at sched_switch+0x5da/frame 0xfffffe0157ab3a70 mi_switch() at mi_switch+0x173/frame 0xfffffe0157ab3a90 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe0157ab3ad0 sleepq_catch_signals() at sleepq_catch_signals+0x276/frame 0xfffffe0157ab3b20 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe0157ab3b60 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x188/frame 0xfffffe0157ab3bd0 kern_select() at kern_select+0xac5/frame 0xfffffe0157ab3dc0 sys_select() at sys_select+0x57/frame 0xfffffe0157ab3e00 amd64_syscall() at amd64_syscall+0x153/frame 0xfffffe0157ab3f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0157ab3f30 --- syscall (93, FreeBSD ELF64, select), rip = 0x3b808c5cdb6a, rsp = 0x3b8086f5da38, rbp = 0x3b8086f5fbd0 --- Tracing command syslogd pid 3249 tid 100198 td 0xfffff80005055740 sched_switch() at sched_switch+0x5da/frame 0xfffffe0151381860 mi_switch() at mi_switch+0x173/frame 0xfffffe0151381880 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe01513818c0 sleepq_catch_signals() at sleepq_catch_signals+0x276/frame 0xfffffe0151381910 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0151381920 _sleep() at _sleep+0x2cc/frame 0xfffffe01513819c0 kqueue_kevent() at kqueue_kevent+0xa8d/frame 0xfffffe0151381c90 kern_kevent_fp() at kern_kevent_fp+0x97/frame 0xfffffe0151381ce0 kern_kevent() at kern_kevent+0x82/frame 0xfffffe0151381d40 kern_kevent_generic() at kern_kevent_generic+0x73/frame 0xfffffe0151381da0 sys_kevent() at sys_kevent+0x61/frame 0xfffffe0151381e00 amd64_syscall() at amd64_syscall+0x153/frame 0xfffffe0151381f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0151381f30 --- syscall (560, FreeBSD ELF64, kevent), rip = 0xc31a4c2e9aa, rsp = 0xc31a31fee88, rbp = 0xc31a31ff370 --- Tracing command watchdogd pid 3269 tid 100196 td 0xfffff8004c17e740 sched_switch() at sched_switch+0x5da/frame 0xfffffe0151377bb0 mi_switch() at mi_switch+0x173/frame 0xfffffe0151377bd0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe0151377c10 sleepq_catch_signals() at sleepq_catch_signals+0x276/frame 0xfffffe0151377c60 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe0151377ca0 _sleep() at _sleep+0x2ae/frame 0xfffffe0151377d40 kern_clock_nanosleep() at kern_clock_nanosleep+0x1cf/frame 0xfffffe0151377dc0 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe0151377e00 amd64_syscall() at amd64_syscall+0x153/frame 0xfffffe0151377f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0151377f30 --- syscall (240, FreeBSD ELF64, nanosleep), rip = 0x2e8b3ed119ea, rsp = 0x2e8b3dee9078, rbp = 0x2e8b3dee90c0 --- Tracing command ntpd pid 3328 tid 100219 td 0xfffff80003d80000 sched_switch() at sched_switch+0x5da/frame 0xfffffe010dbfeab0 mi_switch() at mi_switch+0x173/frame 0xfffffe010dbfead0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe010dbfeb10 sleepq_catch_signals() at sleepq_catch_signals+0x276/frame 0xfffffe010dbfeb60 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe010dbfeb70 _cv_wait_sig() at _cv_wait_sig+0x15f/frame 0xfffffe010dbfebd0 kern_select() at kern_select+0xaeb/frame 0xfffffe010dbfedc0 sys_select() at sys_select+0x57/frame 0xfffffe010dbfee00 amd64_syscall() at amd64_syscall+0x153/frame 0xfffffe010dbfef30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010dbfef30 --- syscall (93, FreeBSD ELF64, select), rip = 0x380fe54a6b6a, rsp = 0x380fe3924428, rbp = 0x380fe3924460 --- Tracing command ntpd pid 3328 tid 101176 td 0xfffff80003d7f000 sched_switch() at sched_switch+0x5da/frame 0xfffffe0157bcbb20 mi_switch() at mi_switch+0x173/frame 0xfffffe0157bcbb40 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe0157bcbb80 sleepq_catch_signals() at sleepq_catch_signals+0x276/frame 0xfffffe0157bcbbd0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0157bcbbe0 _sleep() at _sleep+0x2cc/frame 0xfffffe0157bcbc80 umtxq_sleep() at umtxq_sleep+0x302/frame 0xfffffe0157bcbd00 __umtx_op_sem2_wait() at __umtx_op_sem2_wait+0x3fb/frame 0xfffffe0157bcbdc0 sys__umtx_op() at sys__umtx_op+0x7e/frame 0xfffffe0157bcbe00 amd64_syscall() at amd64_syscall+0x153/frame 0xfffffe0157bcbf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0157bcbf30 --- syscall (454, FreeBSD ELF64, _umtx_op), rip = 0x380fe54a592a, rsp = 0x380fe7771ee8, rbp = 0x380fe7771f60 --- Tracing command powerd pid 3336 tid 100177 td 0xfffff80043d76740 sched_switch() at sched_switch+0x5da/frame 0xfffffe010dbc5a70 mi_switch() at mi_switch+0x173/frame 0xfffffe010dbc5a90 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe010dbc5ad0 sleepq_catch_signals() at sleepq_catch_signals+0x276/frame 0xfffffe010dbc5b20 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe010dbc5b60 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x188/frame 0xfffffe010dbc5bd0 kern_select() at kern_select+0xac5/frame 0xfffffe010dbc5dc0 sys_select() at sys_select+0x57/frame 0xfffffe010dbc5e00 amd64_syscall() at amd64_syscall+0x153/frame 0xfffffe010dbc5f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010dbc5f30 --- syscall (93, FreeBSD ELF64, select), rip = 0xcf3dd200b6a, rsp = 0xcf3dc50cd28, rbp = 0xcf3dc50ce60 --- Tracing command inetd pid 3355 tid 100254 td 0xfffff8004c2b4740 sched_switch() at sched_switch+0x5da/frame 0xfffffe010dbd4ab0 mi_switch() at mi_switch+0x173/frame 0xfffffe010dbd4ad0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe010dbd4b10 sleepq_catch_signals() at sleepq_catch_signals+0x276/frame 0xfffffe010dbd4b60 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe010dbd4b70 _cv_wait_sig() at _cv_wait_sig+0x15f/frame 0xfffffe010dbd4bd0 kern_select() at kern_select+0xaeb/frame 0xfffffe010dbd4dc0 sys_select() at sys_select+0x57/frame 0xfffffe010dbd4e00 amd64_syscall() at amd64_syscall+0x153/frame 0xfffffe010dbd4f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010dbd4f30 --- syscall (93, FreeBSD ELF64, select), rip = 0x339e87a48b6a, rsp = 0x339e85c15f38, rbp = 0x339e85c16dd0 --- Tracing command cron pid 3358 tid 100222 td 0xfffff800042c9740 --- swapped out Tracing command sshd pid 3375 tid 100290 td 0xfffff8004c03b740 sched_switch() at sched_switch+0x5da/frame 0xfffffe0157adbab0 mi_switch() at mi_switch+0x173/frame 0xfffffe0157adbad0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe0157adbb10 sleepq_catch_signals() at sleepq_catch_signals+0x276/frame 0xfffffe0157adbb60 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0157adbb70 _cv_wait_sig() at _cv_wait_sig+0x15f/frame 0xfffffe0157adbbd0 kern_poll_kfds() at kern_poll_kfds+0x4cc/frame 0xfffffe0157adbc60 kern_poll() at kern_poll+0x99/frame 0xfffffe0157adbdb0 sys_ppoll() at sys_ppoll+0x70/frame 0xfffffe0157adbe00 amd64_syscall() at amd64_syscall+0x153/frame 0xfffffe0157adbf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0157adbf30 --- syscall (545, FreeBSD ELF64, ppoll), rip = 0x251c8aa0aa8a, rsp = 0x251c82b710e8, rbp = 0x251c82b71120 --- Tracing command getty pid 3384 tid 100175 td 0xfffff80003d7f740 sched_switch() at sched_switch+0x5da/frame 0xfffffe010dba5ae0 mi_switch() at mi_switch+0x173/frame 0xfffffe010dba5b00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe010dba5b40 sleepq_catch_signals() at sleepq_catch_signals+0x276/frame 0xfffffe010dba5b90 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe010dba5ba0 _cv_wait_sig() at _cv_wait_sig+0x15f/frame 0xfffffe010dba5c00 tty_wait() at tty_wait+0x42/frame 0xfffffe010dba5c30 ttydisc_read() at ttydisc_read+0x1f7/frame 0xfffffe010dba5ca0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe010dba5cd0 devfs_read_f() at devfs_read_f+0xee/frame 0xfffffe010dba5d40 dofileread() at dofileread+0x86/frame 0xfffffe010dba5d90 sys_read() at sys_read+0xc2/frame 0xfffffe010dba5e00 amd64_syscall() at amd64_syscall+0x153/frame 0xfffffe010dba5f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010dba5f30 --- syscall (3, FreeBSD ELF64, read), rip = 0x37d0b0fd5aea, rsp = 0x37d0ae9e8658, rbp = 0x37d0ae9e86a0 --- Tracing command getty pid 3385 tid 100235 td 0xfffff8004c2b1000 sched_switch() at sched_switch+0x5da/frame 0xfffffe0157a9fae0 mi_switch() at mi_switch+0x173/frame 0xfffffe0157a9fb00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe0157a9fb40 sleepq_catch_signals() at sleepq_catch_signals+0x276/frame 0xfffffe0157a9fb90 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0157a9fba0 _cv_wait_sig() at _cv_wait_sig+0x15f/frame 0xfffffe0157a9fc00 tty_wait() at tty_wait+0x42/frame 0xfffffe0157a9fc30 ttydisc_read() at ttydisc_read+0x1f7/frame 0xfffffe0157a9fca0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe0157a9fcd0 devfs_read_f() at devfs_read_f+0xee/frame 0xfffffe0157a9fd40 dofileread() at dofileread+0x86/frame 0xfffffe0157a9fd90 sys_read() at sys_read+0xc2/frame 0xfffffe0157a9fe00 amd64_syscall() at amd64_syscall+0x153/frame 0xfffffe0157a9ff30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0157a9ff30 --- syscall (3, FreeBSD ELF64, read), rip = 0xb4560117aea, rsp = 0xb455da924f8, rbp = 0xb455da92540 --- Tracing command getty pid 3386 tid 100224 td 0xfffff80043839000 sched_switch() at sched_switch+0x5da/frame 0xfffffe015135cae0 mi_switch() at mi_switch+0x173/frame 0xfffffe015135cb00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe015135cb40 sleepq_catch_signals() at sleepq_catch_signals+0x276/frame 0xfffffe015135cb90 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe015135cba0 _cv_wait_sig() at _cv_wait_sig+0x15f/frame 0xfffffe015135cc00 tty_wait() at tty_wait+0x42/frame 0xfffffe015135cc30 ttydisc_read() at ttydisc_read+0x1f7/frame 0xfffffe015135cca0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe015135ccd0 devfs_read_f() at devfs_read_f+0xee/frame 0xfffffe015135cd40 dofileread() at dofileread+0x86/frame 0xfffffe015135cd90 sys_read() at sys_read+0xc2/frame 0xfffffe015135ce00 amd64_syscall() at amd64_syscall+0x153/frame 0xfffffe015135cf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe015135cf30 --- syscall (3, FreeBSD ELF64, read), rip = 0x32c77c51faea, rsp = 0x32c779e922c8, rbp = 0x32c779e92310 --- Tracing command getty pid 3387 tid 100293 td 0xfffff80043fa3000 sched_switch() at sched_switch+0x5da/frame 0xfffffe0157b76ae0 mi_switch() at mi_switch+0x173/frame 0xfffffe0157b76b00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe0157b76b40 sleepq_catch_signals() at sleepq_catch_signals+0x276/frame 0xfffffe0157b76b90 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0157b76ba0 _cv_wait_sig() at _cv_wait_sig+0x15f/frame 0xfffffe0157b76c00 tty_wait() at tty_wait+0x42/frame 0xfffffe0157b76c30 ttydisc_read() at ttydisc_read+0x1f7/frame 0xfffffe0157b76ca0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe0157b76cd0 devfs_read_f() at devfs_read_f+0xee/frame 0xfffffe0157b76d40 dofileread() at dofileread+0x86/frame 0xfffffe0157b76d90 sys_read() at sys_read+0xc2/frame 0xfffffe0157b76e00 amd64_syscall() at amd64_syscall+0x153/frame 0xfffffe0157b76f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0157b76f30 --- syscall (3, FreeBSD ELF64, read), rip = 0x2f3f23a0aea, rsp = 0x2f3f12cf538, rbp = 0x2f3f12cf580 --- Tracing command getty pid 3388 tid 100294 td 0xfffff80043fa3740 sched_switch() at sched_switch+0x5da/frame 0xfffffe0157b71ae0 mi_switch() at mi_switch+0x173/frame 0xfffffe0157b71b00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe0157b71b40 sleepq_catch_signals() at sleepq_catch_signals+0x276/frame 0xfffffe0157b71b90 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0157b71ba0 _cv_wait_sig() at _cv_wait_sig+0x15f/frame 0xfffffe0157b71c00 tty_wait() at tty_wait+0x42/frame 0xfffffe0157b71c30 ttydisc_read() at ttydisc_read+0x1f7/frame 0xfffffe0157b71ca0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe0157b71cd0 devfs_read_f() at devfs_read_f+0xee/frame 0xfffffe0157b71d40 dofileread() at dofileread+0x86/frame 0xfffffe0157b71d90 sys_read() at sys_read+0xc2/frame 0xfffffe0157b71e00 amd64_syscall() at amd64_syscall+0x153/frame 0xfffffe0157b71f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0157b71f30 --- syscall (3, FreeBSD ELF64, read), rip = 0x18243d07aaea, rsp = 0x182439efacd8, rbp = 0x182439efad20 --- Tracing command getty pid 3389 tid 100295 td 0xfffff8006487b740 sched_switch() at sched_switch+0x5da/frame 0xfffffe0157b80ae0 mi_switch() at mi_switch+0x173/frame 0xfffffe0157b80b00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe0157b80b40 sleepq_catch_signals() at sleepq_catch_signals+0x276/frame 0xfffffe0157b80b90 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0157b80ba0 _cv_wait_sig() at _cv_wait_sig+0x15f/frame 0xfffffe0157b80c00 tty_wait() at tty_wait+0x42/frame 0xfffffe0157b80c30 ttydisc_read() at ttydisc_read+0x1f7/frame 0xfffffe0157b80ca0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe0157b80cd0 devfs_read_f() at devfs_read_f+0xee/frame 0xfffffe0157b80d40 dofileread() at dofileread+0x86/frame 0xfffffe0157b80d90 sys_read() at sys_read+0xc2/frame 0xfffffe0157b80e00 amd64_syscall() at amd64_syscall+0x153/frame 0xfffffe0157b80f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0157b80f30 --- syscall (3, FreeBSD ELF64, read), rip = 0x1f387aa95aea, rsp = 0x1f3879c9ad38, rbp = 0x1f3879c9ad80 --- Tracing command getty pid 3390 tid 100296 td 0xfffff8006487b000 sched_switch() at sched_switch+0x5da/frame 0xfffffe0157b7bae0 mi_switch() at mi_switch+0x173/frame 0xfffffe0157b7bb00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe0157b7bb40 sleepq_catch_signals() at sleepq_catch_signals+0x276/frame 0xfffffe0157b7bb90 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0157b7bba0 _cv_wait_sig() at _cv_wait_sig+0x15f/frame 0xfffffe0157b7bc00 tty_wait() at tty_wait+0x42/frame 0xfffffe0157b7bc30 ttydisc_read() at ttydisc_read+0x1f7/frame 0xfffffe0157b7bca0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe0157b7bcd0 devfs_read_f() at devfs_read_f+0xee/frame 0xfffffe0157b7bd40 dofileread() at dofileread+0x86/frame 0xfffffe0157b7bd90 sys_read() at sys_read+0xc2/frame 0xfffffe0157b7be00 amd64_syscall() at amd64_syscall+0x153/frame 0xfffffe0157b7bf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0157b7bf30 --- syscall (3, FreeBSD ELF64, read), rip = 0x1d872a4d5aea, rsp = 0x1d8729a40688, rbp = 0x1d8729a406d0 --- Tracing command getty pid 3391 tid 100297 td 0xfffff800647fe740 sched_switch() at sched_switch+0x5da/frame 0xfffffe0157b8aae0 mi_switch() at mi_switch+0x173/frame 0xfffffe0157b8ab00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe0157b8ab40 sleepq_catch_signals() at sleepq_catch_signals+0x276/frame 0xfffffe0157b8ab90 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0157b8aba0 _cv_wait_sig() at _cv_wait_sig+0x15f/frame 0xfffffe0157b8ac00 tty_wait() at tty_wait+0x42/frame 0xfffffe0157b8ac30 ttydisc_read() at ttydisc_read+0x1f7/frame 0xfffffe0157b8aca0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe0157b8acd0 devfs_read_f() at devfs_read_f+0xee/frame 0xfffffe0157b8ad40 dofileread() at dofileread+0x86/frame 0xfffffe0157b8ad90 sys_read() at sys_read+0xc2/frame 0xfffffe0157b8ae00 amd64_syscall() at amd64_syscall+0x153/frame 0xfffffe0157b8af30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0157b8af30 --- syscall (3, FreeBSD ELF64, read), rip = 0x3c75208f5aea, rsp = 0x3c751e52da78, rbp = 0x3c751e52dac0 --- Tracing command getty pid 3392 tid 100298 td 0xfffff800647fe000 sched_switch() at sched_switch+0x5da/frame 0xfffffe0157b85ae0 mi_switch() at mi_switch+0x173/frame 0xfffffe0157b85b00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe0157b85b40 sleepq_catch_signals() at sleepq_catch_signals+0x276/frame 0xfffffe0157b85b90 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0157b85ba0 _cv_wait_sig() at _cv_wait_sig+0x15f/frame 0xfffffe0157b85c00 tty_wait() at tty_wait+0x42/frame 0xfffffe0157b85c30 ttydisc_read() at ttydisc_read+0x1f7/frame 0xfffffe0157b85ca0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe0157b85cd0 devfs_read_f() at devfs_read_f+0xee/frame 0xfffffe0157b85d40 dofileread() at dofileread+0x86/frame 0xfffffe0157b85d90 sys_read() at sys_read+0xc2/frame 0xfffffe0157b85e00 amd64_syscall() at amd64_syscall+0x153/frame 0xfffffe0157b85f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0157b85f30 --- syscall (3, FreeBSD ELF64, read), rip = 0x45bb60e9aea, rsp = 0x45bb4c28a78, rbp = 0x45bb4c28ac0 --- Tracing command sshd pid 3393 tid 100253 td 0xfffff8006479b740 sched_switch() at sched_switch+0x5da/frame 0xfffffe010dbd9ae0 mi_switch() at mi_switch+0x173/frame 0xfffffe010dbd9b00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe010dbd9b40 sleepq_catch_signals() at sleepq_catch_signals+0x276/frame 0xfffffe010dbd9b90 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe010dbd9ba0 _cv_wait_sig() at _cv_wait_sig+0x15f/frame 0xfffffe010dbd9c00 kern_poll_kfds() at kern_poll_kfds+0x4cc/frame 0xfffffe010dbd9c90 kern_poll() at kern_poll+0x99/frame 0xfffffe010dbd9de0 sys_poll() at sys_poll+0x50/frame 0xfffffe010dbd9e00 amd64_syscall() at amd64_syscall+0x153/frame 0xfffffe010dbd9f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010dbd9f30 --- syscall (209, FreeBSD ELF64, poll), rip = 0x37e3ccabaa6a, rsp = 0x37e3c56a4098, rbp = 0x37e3c56a40c0 --- Tracing command sshd pid 3396 tid 100260 td 0xfffff80043fad000 sched_switch() at sched_switch+0x5da/frame 0xfffffe0157ae5ab0 mi_switch() at mi_switch+0x173/frame 0xfffffe0157ae5ad0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe0157ae5b10 sleepq_catch_signals() at sleepq_catch_signals+0x276/frame 0xfffffe0157ae5b60 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0157ae5b70 _cv_wait_sig() at _cv_wait_sig+0x15f/frame 0xfffffe0157ae5bd0 kern_poll_kfds() at kern_poll_kfds+0x4cc/frame 0xfffffe0157ae5c60 kern_poll() at kern_poll+0x99/frame 0xfffffe0157ae5db0 sys_ppoll() at sys_ppoll+0x70/frame 0xfffffe0157ae5e00 amd64_syscall() at amd64_syscall+0x153/frame 0xfffffe0157ae5f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0157ae5f30 --- syscall (545, FreeBSD ELF64, ppoll), rip = 0x37e3ccabaa8a, rsp = 0x37e3c56a3e48, rbp = 0x37e3c56a3e80 --- Tracing command sh pid 3397 tid 100257 td 0xfffff80043828740 --- swapped out Tracing command su pid 3419 tid 100240 td 0xfffff8004c2b3740 --- swapped out Tracing command csh pid 3420 tid 100255 td 0xfffff8004c2b4000 --- swapped out Tracing command bash pid 3422 tid 100176 td 0xfffff8004393a740 --- swapped out Tracing command sshd pid 4350 tid 100306 td 0xfffff80064617000 sched_switch() at sched_switch+0x5da/frame 0xfffffe0157badae0 mi_switch() at mi_switch+0x173/frame 0xfffffe0157badb00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe0157badb40 sleepq_catch_signals() at sleepq_catch_signals+0x276/frame 0xfffffe0157badb90 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0157badba0 _cv_wait_sig() at _cv_wait_sig+0x15f/frame 0xfffffe0157badc00 kern_poll_kfds() at kern_poll_kfds+0x4cc/frame 0xfffffe0157badc90 kern_poll() at kern_poll+0x99/frame 0xfffffe0157badde0 sys_poll() at sys_poll+0x50/frame 0xfffffe0157bade00 amd64_syscall() at amd64_syscall+0x153/frame 0xfffffe0157badf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0157badf30 --- syscall (209, FreeBSD ELF64, poll), rip = 0x3b9a411c7a6a, rsp = 0x3b9a38084458, rbp = 0x3b9a38084480 --- Tracing command sshd pid 4354 tid 100518 td 0xfffff8004c045740 sched_switch() at sched_switch+0x5da/frame 0xfffffe010da09ab0 mi_switch() at mi_switch+0x173/frame 0xfffffe010da09ad0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe010da09b10 sleepq_catch_signals() at sleepq_catch_signals+0x276/frame 0xfffffe010da09b60 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe010da09b70 _cv_wait_sig() at _cv_wait_sig+0x15f/frame 0xfffffe010da09bd0 kern_poll_kfds() at kern_poll_kfds+0x4cc/frame 0xfffffe010da09c60 kern_poll() at kern_poll+0x99/frame 0xfffffe010da09db0 sys_ppoll() at sys_ppoll+0x70/frame 0xfffffe010da09e00 amd64_syscall() at amd64_syscall+0x153/frame 0xfffffe010da09f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010da09f30 --- syscall (545, FreeBSD ELF64, ppoll), rip = 0x3b9a411c7a8a, rsp = 0x3b9a38084208, rbp = 0x3b9a38084240 --- Tracing command sh pid 4355 tid 100197 td 0xfffff80005054000 --- swapped out Tracing command aiod1 pid 22132 tid 100547 td 0xfffff805924bb000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4fedd60 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4fedd80 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4feddc0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e4fede00 _sleep() at _sleep+0x2bd/frame 0xfffffe00e4fedea0 aio_daemon() at aio_daemon+0x31a/frame 0xfffffe00e4fedef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4fedf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4fedf30 --- trap 0xc, rip = 0x2065f573a7ca, rsp = 0x2065f3e09868, rbp = 0x2065f3e09880 --- Tracing command aiod2 pid 22133 tid 100187 td 0xfffff8004393a000 sched_switch() at sched_switch+0x5da/frame 0xfffffe010dbaad60 mi_switch() at mi_switch+0x173/frame 0xfffffe010dbaad80 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe010dbaadc0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010dbaae00 _sleep() at _sleep+0x2bd/frame 0xfffffe010dbaaea0 aio_daemon() at aio_daemon+0x31a/frame 0xfffffe010dbaaef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010dbaaf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010dbaaf30 --- trap 0xc, rip = 0x294f5565f7ca, rsp = 0x294f5241e5f8, rbp = 0x294f5241e640 --- Tracing command aiod3 pid 22134 tid 100223 td 0xfffff80003d81740 sched_switch() at sched_switch+0x5da/frame 0xfffffe0157ab8d60 mi_switch() at mi_switch+0x173/frame 0xfffffe0157ab8d80 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe0157ab8dc0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0157ab8e00 _sleep() at _sleep+0x2bd/frame 0xfffffe0157ab8ea0 aio_daemon() at aio_daemon+0x31a/frame 0xfffffe0157ab8ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0157ab8f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0157ab8f30 --- trap 0xc, rip = 0x294f5565fb6a, rsp = 0x294f5241e688, rbp = 0x294f5241e740 --- Tracing command aiod4 pid 22135 tid 100893 td 0xfffff80604335000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00e4ff2d60 mi_switch() at mi_switch+0x173/frame 0xfffffe00e4ff2d80 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4ff2dc0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e4ff2e00 _sleep() at _sleep+0x2bd/frame 0xfffffe00e4ff2ea0 aio_daemon() at aio_daemon+0x31a/frame 0xfffffe00e4ff2ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4ff2f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ff2f30 --- trap 0xc, rip = 0x898cd2d47ca, rsp = 0x898ca83eab8, rbp = 0x898ca83ead0 --- Tracing command sh pid 22297 tid 100880 td 0xfffff8031cd10000 sched_switch() at sched_switch+0x5da/frame 0xfffffe00377b0a10 mi_switch() at mi_switch+0x173/frame 0xfffffe00377b0a30 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00377b0a70 sleepq_catch_signals() at sleepq_catch_signals+0x276/frame 0xfffffe00377b0ac0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00377b0ad0 _sleep() at _sleep+0x2cc/frame 0xfffffe00377b0b70 kern_wait6() at kern_wait6+0x481/frame 0xfffffe00377b0c00 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe00377b0e00 amd64_syscall() at amd64_syscall+0x153/frame 0xfffffe00377b0f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00377b0f30 --- syscall (7, FreeBSD ELF64, wait4), rip = 0x24add4101cca, rsp = 0x24add1c46d78, rbp = 0x24add1c46e20 --- Tracing command md10 pid 22312 tid 100491 td 0xfffff8004c55e000 sched_switch() at sched_switch+0x5da/frame 0xfffffe0157b17da0 mi_switch() at mi_switch+0x173/frame 0xfffffe0157b17dc0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe0157b17e00 _sleep() at _sleep+0x2d6/frame 0xfffffe0157b17ea0 md_kthread() at md_kthread+0xd5/frame 0xfffffe0157b17ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0157b17f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0157b17f30 --- trap 0xc, rip = 0x2a07cacd67ca, rsp = 0x2a07c86e3c38, rbp = 0x2a07c86e3c60 --- Tracing command swap pid 22324 tid 101020 td 0xfffff807a31dd000 sched_switch() at sched_switch+0x5da/frame 0xfffffe015b339bb0 mi_switch() at mi_switch+0x173/frame 0xfffffe015b339bd0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe015b339c10 sleepq_catch_signals() at sleepq_catch_signals+0x276/frame 0xfffffe015b339c60 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe015b339ca0 _sleep() at _sleep+0x2ae/frame 0xfffffe015b339d40 kern_clock_nanosleep() at kern_clock_nanosleep+0x1cf/frame 0xfffffe015b339dc0 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe015b339e00 amd64_syscall() at amd64_syscall+0x153/frame 0xfffffe015b339f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe015b339f30 --- syscall (240, FreeBSD ELF64, nanosleep), rip = 0x3d8f5781f9ea, rsp = 0x3d8f56359bb8, rbp = 0x3d8f56359c00 --- Tracing command swap pid 22328 tid 100583 td 0xfffff8004c2cb000 --- swapped out Tracing command swap pid 22329 tid 100221 td 0xfffff8004c03c000 sched_switch() at sched_switch+0x5da/frame 0xfffffe0151348e90 mi_switch() at mi_switch+0x173/frame 0xfffffe0151348eb0 ast_scheduler() at ast_scheduler+0x45/frame 0xfffffe0151348ed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe0151348f10 ast() at ast+0x20/frame 0xfffffe0151348f30 doreti_ast() at doreti_ast+0x1c/frame 0x3d8f56359c00 Tracing command swap pid 22330 tid 100463 td 0xfffff8031c983000 (CPU 7) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ce96df0 ipi_nmi_handler() at ipi_nmi_handler+0x3a/frame 0xfffffe003ce96e00 trap() at trap+0x56/frame 0xfffffe003ce96f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce96f20 --- trap 0x13, rip = 0x3d8735ead57a, rsp = 0x3d8f56359bd0, rbp = 0x3d8f56359c00 --- Tracing command swap pid 22331 tid 100355 td 0xfffff8031ca81740 (CPU 6) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ce87df0 ipi_nmi_handler() at ipi_nmi_handler+0x3a/frame 0xfffffe003ce87e00 trap() at trap+0x56/frame 0xfffffe003ce87f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce87f20 --- trap 0x13, rip = 0x3d8735ead57a, rsp = 0x3d8f56359bd0, rbp = 0x3d8f56359c00 --- Tracing command swap pid 22332 tid 100677 td 0xfffff80499d12740 sched_switch() at sched_switch+0x5da/frame 0xfffffe015139fee0 mi_switch() at mi_switch+0x173/frame 0xfffffe015139ff00 ipi_bitmap_handler() at ipi_bitmap_handler+0x86/frame 0xfffffe015139ff30 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0xb3/frame 0xfffffe015139ff30 --- interrupt, rip = 0x3d8735ead57a, rsp = 0x3d8f56359bd0, rbp = 0x3d8f56359c00 --- Tracing command swap pid 22333 tid 100225 td 0xfffff8004c341740 (CPU 1) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ce3cdf0 ipi_nmi_handler() at ipi_nmi_handler+0x3a/frame 0xfffffe003ce3ce00 trap() at trap+0x56/frame 0xfffffe003ce3cf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce3cf20 --- trap 0x13, rip = 0x3d8735ead574, rsp = 0x3d8f56359bd0, rbp = 0x3d8f56359c00 --- Tracing command swap pid 22334 tid 100227 td 0xfffff8004c341000 (CPU 3) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ce5adf0 ipi_nmi_handler() at ipi_nmi_handler+0x3a/frame 0xfffffe003ce5ae00 trap() at trap+0x56/frame 0xfffffe003ce5af20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce5af20 --- trap 0x13, rip = 0x3d8735ead57a, rsp = 0x3d8f56359bd0, rbp = 0x3d8f56359c00 --- Tracing command swap pid 22335 tid 100308 td 0xfffff8004c344740 sched_switch() at sched_switch+0x5da/frame 0xfffffe0157bc6e90 mi_switch() at mi_switch+0x173/frame 0xfffffe0157bc6eb0 ast_scheduler() at ast_scheduler+0x45/frame 0xfffffe0157bc6ed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe0157bc6f10 ast() at ast+0x20/frame 0xfffffe0157bc6f30 doreti_ast() at doreti_ast+0x1c/frame 0x3d8f56359c00 Tracing command swap pid 22336 tid 100309 td 0xfffff8004c344000 (CPU 10) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003cec3df0 ipi_nmi_handler() at ipi_nmi_handler+0x3a/frame 0xfffffe003cec3e00 trap() at trap+0x56/frame 0xfffffe003cec3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003cec3f20 --- trap 0x13, rip = 0x3d8735ead57a, rsp = 0x3d8f56359bd0, rbp = 0x3d8f56359c00 --- Tracing command swap pid 22337 tid 100310 td 0xfffff8004c55e740 (CPU 5) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ce78df0 ipi_nmi_handler() at ipi_nmi_handler+0x3a/frame 0xfffffe003ce78e00 trap() at trap+0x56/frame 0xfffffe003ce78f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce78f20 --- trap 0x13, rip = 0x3d8735ead574, rsp = 0x3d8f56359bd0, rbp = 0x3d8f56359c00 --- Tracing command swap pid 22338 tid 100483 td 0xfffff80209dda740 (CPU 0) cpustop_handler() at cpustop_handler+0x27/frame 0xffffffff81b0e200 ipi_nmi_handler() at ipi_nmi_handler+0x3a/frame 0xffffffff81b0e210 trap() at trap+0x56/frame 0xffffffff81b0e330 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81b0e330 --- trap 0x13, rip = 0x3d8735ead57a, rsp = 0x3d8f56359bd0, rbp = 0x3d8f56359c00 --- Tracing command swap pid 22339 tid 100484 td 0xfffff8031ca81000 sched_switch() at sched_switch+0x5da/frame 0xfffffe015b280e90 mi_switch() at mi_switch+0x173/frame 0xfffffe015b280eb0 ast_scheduler() at ast_scheduler+0x45/frame 0xfffffe015b280ed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe015b280f10 ast() at ast+0x20/frame 0xfffffe015b280f30 doreti_ast() at doreti_ast+0x1c/frame 0x3d8f56359c00 Tracing command swap pid 22340 tid 100480 td 0xfffff80209fff740 (CPU 8) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003cea5df0 ipi_nmi_handler() at ipi_nmi_handler+0x3a/frame 0xfffffe003cea5e00 trap() at trap+0x56/frame 0xfffffe003cea5f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003cea5f20 --- trap 0x13, rip = 0x3d8735ead574, rsp = 0x3d8f56359bd0, rbp = 0x3d8f56359c00 --- Tracing command swap pid 22341 tid 100481 td 0xfffff80209e94000 (CPU 4) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ce69df0 ipi_nmi_handler() at ipi_nmi_handler+0x3a/frame 0xfffffe003ce69e00 trap() at trap+0x56/frame 0xfffffe003ce69f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce69f20 --- trap 0x13, rip = 0x3d8735ead57a, rsp = 0x3d8f56359bd0, rbp = 0x3d8f56359c00 --- Tracing command swap pid 22342 tid 100466 td 0xfffff8004c239740 (CPU 9) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ceb4df0 ipi_nmi_handler() at ipi_nmi_handler+0x3a/frame 0xfffffe003ceb4e00 trap() at trap+0x56/frame 0xfffffe003ceb4f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ceb4f20 --- trap 0x13, rip = 0x3d8735ead57a, rsp = 0x3d8f56359bd0, rbp = 0x3d8f56359c00 --- Tracing command swap pid 22343 tid 100467 td 0xfffff8004c239000 cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ced2df0 ipi_nmi_handler() at ipi_nmi_handler+0x3a/frame 0xfffffe003ced2e00 trap() at trap+0x56/frame 0xfffffe003ced2f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ced2f20 --- trap 0x13, rip = 0xffffffff81051dc8, rsp = 0xfffffe015b209d88, rbp = 0xfffffe015b209da8 --- pmap_activate_sw_pcid_pti() at pmap_activate_sw_pcid_pti+0x168/frame 0xfffffe015b209da8 pmap_activate_sw() at pmap_activate_sw+0x5a/frame 0xfffffe015b209dd8 ctx_switch_fpusave_done() at ctx_switch_fpusave_done+0x11/frame 0xfffffe015b209ee0 mi_switch() at mi_switch+0x173/frame 0xfffffe015b209f00 ipi_bitmap_handler() at ipi_bitmap_handler+0x86/frame 0xfffffe015b209f30 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0xb3/frame 0xfffffe015b209f30 --- interrupt, rip = 0x3d8735ead57a, rsp = 0x3d8f56359bd0, rbp = 0x3d8f56359c00 --- Tracing command sleep pid 22417 tid 100504 td 0xfffff80064c5e740 sched_switch() at sched_switch+0x5da/frame 0xfffffe0157aa4bb0 mi_switch() at mi_switch+0x173/frame 0xfffffe0157aa4bd0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe0157aa4c10 sleepq_catch_signals() at sleepq_catch_signals+0x276/frame 0xfffffe0157aa4c60 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe0157aa4ca0 _sleep() at _sleep+0x2ae/frame 0xfffffe0157aa4d40 kern_clock_nanosleep() at kern_clock_nanosleep+0x1cf/frame 0xfffffe0157aa4dc0 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe0157aa4e00 amd64_syscall() at amd64_syscall+0x153/frame 0xfffffe0157aa4f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0157aa4f30 --- syscall (240, FreeBSD ELF64, nanosleep), rip = 0x280afbfb29ea, rsp = 0x280af9f414a8, rbp = 0x280af9f41510 --- Tracing command mmap42 pid 22418 tid 100559 td 0xfffff8031c17c740 (CPU 2) kdb_enter() at kdb_enter+0x32/frame 0xfffffe015138b160 vpanic() at vpanic+0x163/frame 0xfffffe015138b290 panic() at panic+0x43/frame 0xfffffe015138b2f0 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x11c/frame 0xfffffe015138b3a0 __lockmgr_args() at __lockmgr_args+0x207/frame 0xfffffe015138b440 getblkx() at getblkx+0x1c6/frame 0xfffffe015138b500 breadn_flags() at breadn_flags+0x44/frame 0xfffffe015138b570 vfs_bio_getpages() at vfs_bio_getpages+0x33c/frame 0xfffffe015138b660 ffs_getpages() at ffs_getpages+0x77/frame 0xfffffe015138b680 VOP_GETPAGES_APV() at VOP_GETPAGES_APV+0x60/frame 0xfffffe015138b6b0 vnode_pager_getpages() at vnode_pager_getpages+0x37/frame 0xfffffe015138b6f0 vm_pager_get_pages() at vm_pager_get_pages+0x5f/frame 0xfffffe015138b740 vm_fault() at vm_fault+0x70c/frame 0xfffffe015138b870 vm_fault_trap() at vm_fault_trap+0x6f/frame 0xfffffe015138b8b0 trap_pfault() at trap_pfault+0x24a/frame 0xfffffe015138b920 calltrap() at calltrap+0x8/frame 0xfffffe015138b920 --- trap 0xc, rip = 0xffffffff8105bce6, rsp = 0xfffffe015138b9f0, rbp = 0xfffffe015138b9f0 --- copyin_nosmap_erms() at copyin_nosmap_erms+0x156/frame 0xfffffe015138b9f0 uiomove_fromphys() at uiomove_fromphys+0x15a/frame 0xfffffe015138ba60 ffs_write() at ffs_write+0x356/frame 0xfffffe015138bb10 VOP_WRITE_APV() at VOP_WRITE_APV+0xcf/frame 0xfffffe015138bc20 vn_write() at vn_write+0x2f4/frame 0xfffffe015138bcb0 vn_io_fault() at vn_io_fault+0x1e2/frame 0xfffffe015138bd40 dofilewrite() at dofilewrite+0x82/frame 0xfffffe015138bd90 sys_write() at sys_write+0xc2/frame 0xfffffe015138be00 amd64_syscall() at amd64_syscall+0x153/frame 0xfffffe015138bf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe015138bf30 --- syscall (4, FreeBSD ELF64, write), rip = 0x82249ad0a, rsp = 0x8205d3578, rbp = 0x8205d36a0 --- db> reset (kgdb) bt #0 __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:57 #1 doadump (textdump=textdump@entry=0x0) at ../../../kern/kern_shutdown.c:403 #2 0xffffffff804a4c5a in db_dump (dummy=, dummy2=, dummy3=, dummy4=) at ../../../ddb/db_command.c:590 #3 0xffffffff804a4a5d in db_command (last_cmdp=, cmd_table=, dopager=0x0) at ../../../ddb/db_command.c:503 #4 0xffffffff804a4ba6 in db_command_script (command=command@entry=0xffffffff817b9750 "dump") at ../../../ddb/db_command.c:568 #5 0xffffffff804a9ef8 in db_script_exec (scriptname=, warnifnotfound=) at ../../../ddb/db_script.c:301 #6 0xffffffff804a4a5d in db_command (last_cmdp=, cmd_table=, dopager=0x0) at ../../../ddb/db_command.c:503 #7 0xffffffff804a4ba6 in db_command_script (command=command@entry=0xffffffff817b96e2 "run pho1") at ../../../ddb/db_command.c:568 #8 0xffffffff804a9ef8 in db_script_exec (scriptname=, warnifnotfound=) at ../../../ddb/db_script.c:301 #9 0xffffffff804a4a5d in db_command (last_cmdp=, cmd_table=, dopager=0x1) at ../../../ddb/db_command.c:503 #10 0xffffffff804a471d in db_command_loop () at ../../../ddb/db_command.c:550 #11 0xffffffff804a7df6 in db_trap (type=, code=) at ../../../ddb/db_main.c:267 #12 0xffffffff80ba3ae3 in kdb_trap (type=type@entry=0x3, code=code@entry=0x0, tf=tf@entry=0xfffffe015138b0a0) at ../../../kern/subr_kdb.c:790 #13 0xffffffff8105e8c9 in trap (frame=0xfffffe015138b0a0) at ../../../amd64/amd64/trap.c:606 #14 #15 kdb_enter (why=, msg=) at ../../../kern/subr_kdb.c:556 #16 0xffffffff80b543b3 in vpanic (fmt=0xffffffff811e6983 "%s: recursing on non recursive lockmgr %p @ %s:%d\n", ap=ap@entry=0xfffffe015138b2d0) at ../../../kern/kern_shutdown.c:953 #17 0xffffffff80b54193 in panic (fmt=0xffffffff81980420 "\342\321\025\201\377\377\377\377") at ../../../kern/kern_shutdown.c:889 #18 0xffffffff80b2179c in lockmgr_xlock_hard (lk=lk@entry=0xfffffe0039029140, flags=flags@entry=0x81900, ilk=0xfffffe01664dfd98, file=, line=0xfc6, lwa=lwa@entry=0xfffffe015138b3d8) at ../../../kern/kern_lock.c:822 #19 0xffffffff80b21fa7 in __lockmgr_args (lk=0xfffffe0039029140, flags=flags@entry=0x81900, ilk=0xf, ilk@entry=0xfffffe01664dfd98, wmesg=, pri=pri@entry=0x40, timo=timo@entry=0x0, file=0xffffffff81263b5a "../../../kern/vfs_bio.c", line=0xfc6) at ../../../kern/kern_lock.c:1376 #20 0xffffffff80c1f1d6 in _lockmgr_args_rw (lk=0xffffffff81980420 , flags=0x81900, prio=0x40, timo=0x0, line=0xfc6, ilk=, wmesg=, file=) at ../../../sys/lockmgr.h:114 #21 getblkx (vp=vp@entry=0xfffffe01664dfc20, blkno=blkno@entry=0xc, dblkno=dblkno@entry=0xc, size=0x8000, slpflag=slpflag@entry=0x0, slptimeo=slptimeo@entry=0x0, flags=0x8, bpp=0xfffffe015138b528) at ../../../kern/vfs_bio.c:4037 #22 0xffffffff80c1ee14 in breadn_flags (vp=0xffffffff81980420 , vp@entry=0xfffffe01664dfc20, blkno=blkno@entry=0xc, dblkno=0xffffffff812a24b4, dblkno@entry=0xc, size=0x812254e4, rablkno=rablkno@entry=0x0, rabsize=rabsize@entry=0x0, cnt=0x0, cred=0xfffff80004766800, flags=0x8, ckhashfunc=0x0, bpp=0xfffffe015138b5b0) at ../../../kern/vfs_bio.c:2236 #23 0xffffffff80c23efc in vfs_bio_getpages (vp=0xfffffe01664dfc20, ma=0xfffffe015138b800, count=0x1, rbehind=, rahead=, get_lblkno=0xffffffff80ecfba0 , get_blksize=0xffffffff80ecfbc0 ) at ../../../kern/vfs_bio.c:5368 #24 0xffffffff80ecda37 in ffs_getpages (ap=0x12) at ../../../ufs/ffs/ffs_vnops.c:1956 #25 0xffffffff81139790 in VOP_GETPAGES_APV (vop=0xffffffff81737518 , a=a@entry=0xfffffe015138b6c0) at vnode_if.c:2957 #26 0xffffffff80f277c7 in VOP_GETPAGES (vp=0x12, m=, count=0x812a24b4, rbehind=0xffffffff812254e4, rahead=0x10) at ./vnode_if.h:1532 #27 vnode_pager_getpages (object=, m=, count=0x812a24b4, rbehind=0xffffffff812254e4, rahead=0x10) at ../../../vm/vnode_pager.c:824 #28 0xffffffff80f1dcaf in vm_pager_get_pages (object=0xfffff8049968a630, m=m@entry=0xfffffe015138b800, count=count@entry=0x1, rbehind=rbehind@entry=0xfffffe015138b794, rahead=rahead@entry=0xfffffe015138b7a4) at ../../../vm/vm_pager.c:330 #29 0xffffffff80ef61cc in vm_fault_getpages (fs=0xfffffe015138b7a8, behindp=0xfffffe015138b794, aheadp=0xfffffe015138b7a4) at ../../../vm/vm_fault.c:1379 #30 vm_fault_object (fs=0xfffffe015138b7a8, behindp=0xfffffe015138b794, aheadp=0xfffffe015138b7a4) at ../../../vm/vm_fault.c:1524 #31 vm_fault (map=map@entry=0xfffff8006403c000, vaddr=vaddr@entry=0x823260000, fault_type=fault_type@entry=0x1, fault_flags=fault_flags@entry=0x0, m_hold=m_hold@entry=0x0) at ../../../vm/vm_fault.c:1636 #32 0xffffffff80ef596f in vm_fault_trap (map=0xfffff8006403c000, vaddr=vaddr@entry=0x823260000, fault_type=, fault_flags=fault_flags@entry=0x0, signo=0x0, ucode=0x0) at ../../../vm/vm_fault.c:710 #33 0xffffffff8105efaa in trap_pfault (frame=0xfffffe015138b930, usermode=0x0, signo=, ucode=) at ../../../amd64/amd64/trap.c:843 #34 #35 copyin_nosmap_erms () at ../../../amd64/amd64/support.S:904 #36 0xffffffff8106020a in uiomove_fromphys (ma=0xfffffe0039029390, offset=0x0, n=0x8000, uio=0xfffffe015138bda0) at ../../../amd64/amd64/uio_machdep.c:103 #37 0xffffffff80c67393 in vn_io_fault_pgmove (ma=0x0, offset=0x823260000, xfersize=0x1000, xfersize@entry=0x8000, uio=0x1000, uio@entry=0xfffffe015138bda0) at ../../../kern/vfs_vnops.c:1589 #38 0xffffffff80ecd236 in ffs_write (ap=0xfffffe015138bc40) at ../../../ufs/ffs/ffs_vnops.c:959 #39 0xffffffff811366df in VOP_WRITE_APV (vop=0xffffffff81737518 , a=a@entry=0xfffffe015138bc40) at vnode_if.c:1167 #40 0xffffffff80c6bc84 in VOP_WRITE (vp=0xfffffe01664dfc20, uio=0xfffffe015138bda0, ioflag=0x7f0001, cred=0x0) at ./vnode_if.h:595 #41 vn_write (fp=fp@entry=0xfffff8064143c5f0, uio=uio@entry=0xfffffe015138bda0, active_cred=active_cred@entry=0xfffff80004766800, flags=, td=td@entry=0xfffff8031c17c740) at ../../../kern/vfs_vnops.c:1191 #42 0xffffffff80c64482 in vn_io_fault (fp=0xfffff8064143c5f0, uio=0xfffffe015138bda0, active_cred=0xfffff80004766800, flags=0x0, td=0xfffff8031c17c740) at ../../../kern/vfs_vnops.c:1502 #43 0xffffffff80bcde32 in fo_write (fp=0xfffff8064143c5f0, uio=0xfffffe015138bda0, active_cred=0x1000, td=0xfffff8031c17c740, flags=) at ../../../sys/file.h:348 #44 dofilewrite (td=td@entry=0xfffff8031c17c740, fd=fd@entry=0x4, fp=0xfffff8064143c5f0, auio=auio@entry=0xfffffe015138bda0, offset=offset@entry=0xffffffffffffffff, flags=flags@entry=0x0) at ../../../kern/sys_generic.c:561 #45 0xffffffff80bcd982 in kern_writev (td=0xfffff8031c17c740, fd=0x4, auio=0xfffffe015138bda0) at ../../../kern/sys_generic.c:488 #46 sys_write (td=0xfffff8031c17c740, uap=) at ../../../kern/sys_generic.c:403 #47 0xffffffff8105f733 in syscallenter (td=0xfffff8031c17c740) at ../../../amd64/amd64/../../kern/subr_syscall.c:186 #48 amd64_syscall (td=0xfffff8031c17c740, traced=0x0) at ../../../amd64/amd64/trap.c:1192 #49 #50 0x000000082249ad0a in ?? () Backtrace stopped: Cannot access memory at address 0x8205d3578 (kgdb) f 18 #18 0xffffffff80b2179c in lockmgr_xlock_hard (lk=lk@entry=0xfffffe0039029140, flags=flags@entry=0x81900, ilk=0xfffffe01664dfd98, file=, line=0xfc6, lwa=lwa@entry=0xfffffe015138b3d8) at ../../../kern/kern_lock.c:822 822 panic("%s: recursing on non recursive lockmgr %p " (kgdb) p *lk $2 = {lock_object = {lo_name = 0xffffffff813c8b40 "bufwait", lo_flags = 0x26730000, lo_data = 0x0, lo_witness = 0xfffff8087fd7b900}, lk_lock = 0xfffff8031c17c740, lk_exslpfail = 0x0, lk_pri = 0x40, lk_timo = 0x0, lk_stack = {depth = 0xe, pcs = {0xffffffff80b21b1e, 0xffffffff80b21fa7, 0xffffffff80c22172, 0xffffffff80c1f62b, 0xffffffff80c21e12, 0xffffffff80e9cff6, 0xffffffff80ecd137, 0xffffffff811366df, 0xffffffff80c6bc84, 0xffffffff80c64482, 0xffffffff80bcde32, 0xffffffff80bcd982, 0xffffffff8105f733, 0xffffffff810314eb, 0x0, 0x0, 0x0, 0x0}}} (kgdb) f 36 #36 0xffffffff8106020a in uiomove_fromphys (ma=0xfffffe0039029390, offset=0x0, n=0x8000, uio=0xfffffe015138bda0) at ../../../amd64/amd64/uio_machdep.c:103 103 error = copyin(iov->iov_base, cp, cnt); (kgdb) l 98 case UIO_USERSPACE: 99 maybe_yield(); 100 if (uio->uio_rw == UIO_READ) 101 error = copyout(cp, iov->iov_base, cnt); 102 else 103 error = copyin(iov->iov_base, cp, cnt); 104 if (error) 105 goto out; 106 break; 107 case UIO_SYSSPACE: (kgdb) info loc td = 0xfffff8031c17c740 error = 0x0 save = mapped = 0x0 cp = 0xfffff80775860000 iov = 0xfffffe015138bdd0 cnt = 0x1000 page_offset = vaddr = (kgdb) p *iov $1 = {iov_base = 0x823260000, iov_len = 0x3430af0e} (kgdb) 20:32 /usr/src/tools/test/stress2/misc $ while ./mmap42.sh; do date; done debug.vn_io_fault_enable: 1 -> 0 swap: run time 0+00:05:00, incarnations 15, load 100, verbose 1 -- Test scenario: src/tools/test/stress2/misc/mmap42.sh (WiP test)