panic: freeing free block: ffff40, size 2, mask 1, vmcore.64 KDB: debugger backends: ddb KDB: current backend: ddb ---<>--- Copyright (c) 1992-2019 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 13.0-CURRENT #2 r349777M: Mon Jul 8 10:09:36 CEST 2019 pho@mercat1.netperf.freebsd.org:/usr/src/sys/amd64/compile/MEMGUARD amd64 FreeBSD clang version 8.0.1 (branches/release_80 363030) (based on LLVM 8.0.1) WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. Entering uma_startup with 10 boot pages configured startup_alloc from "UMA Kegs", 8 boot pages left startup_alloc from "UMA Zones", 7 boot pages left startup_alloc from "UMA Zones", 6 boot pages left startup_alloc from "UMA Zones", 5 boot pages left startup_alloc from "UMA Zones", 4 boot pages left startup_alloc from "UMA Zones", 3 boot pages left startup_alloc from "UMA Hash", 2 boot pages left startup_alloc from "UMA Zones", 1 boot pages left Entering uma_startup1 with 0 boot pages left Entering uma_startup2 with 0 boot pages left MEMGUARD DEBUGGING ALLOCATOR INITIALIZED: MEMGUARD map base: 0xfffffe0000800000 MEMGUARD map size: 65027384 KBytes VT(vga): resolution 640x480 CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.07-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics real memory = 34359738368 (32768 MB) avail memory = 33052356608 (31521 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 12 CPUs FreeBSD/SMP: 1 package(s) x 6 core(s) x 2 hardware threads random: unblocking device. ioapic0 irqs 0-23 on motherboard ioapic1 irqs 24-47 on motherboard Launching APs: 1 10 4 11 9 6 8 3 7 5 2 Timecounter "TSC-low" frequency 1750034980 Hz quality 1000 random: entropy device external interface kbd1 at kbdmux0 module_register_init: MOD_LOAD (vesa, 0xffffffff811303d0, 0) error 19 random: registering fast source Intel Secure Key RNG random: fast provider: "Intel Secure Key RNG" 000.000055 [4254] netmap_init netmap: loaded module [ath_hal] loaded nexus0 vtvga0: on motherboard cryptosoft0: on motherboard acpi0: on motherboard acpi0: Power Button (fixed) cpu0: on acpi0 atrtc0: port 0x70-0x71,0x74-0x77 irq 8 on acpi0 atrtc0: registered as a time-of-day clock, resolution 1.000000s Event timer "RTC" frequency 32768 Hz quality 0 attimer0: port 0x40-0x43,0x50-0x53 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Event timer "HPET" frequency 14318180 Hz quality 350 Event timer "HPET1" frequency 14318180 Hz quality 340 Event timer "HPET2" frequency 14318180 Hz quality 340 Event timer "HPET3" frequency 14318180 Hz quality 340 Event timer "HPET4" frequency 14318180 Hz quality 340 Event timer "HPET5" frequency 14318180 Hz quality 340 Event timer "HPET6" frequency 14318180 Hz quality 340 Event timer "HPET7" frequency 14318180 Hz quality 340 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 pcib0: on acpi0 pci0: on pcib0 pci0: at device 11.1 (no driver attached) pci0: at device 11.2 (no driver attached) pci0: at device 16.1 (no driver attached) pci0: at device 16.6 (no driver attached) pci0: at device 18.1 (no driver attached) acpi_syscontainer0: on acpi0 acpi_syscontainer1: on acpi0 acpi_syscontainer2: on acpi0 acpi_syscontainer3: on acpi0 pcib1: port 0xcf8-0xcff on acpi0 pci1: on pcib1 pcib2: irq 26 at device 1.0 on pci1 pci2: on pcib2 pcib3: irq 32 at device 2.0 on pci1 pci3: on pcib3 pci3: at device 0.0 (no driver attached) pci3: at device 0.1 (no driver attached) pcib4: irq 40 at device 3.0 on pci1 pci4: on pcib4 pci1: at device 17.0 (no driver attached) ahci0: port 0xf110-0xf117,0xf100-0xf103,0xf0f0-0xf0f7,0xf0e0-0xf0e3,0xf020-0xf03f mem 0xfb438000-0xfb4387ff irq 16 at device 17.4 on pci1 ahci0: AHCI v1.30 with 4 6Gbps ports, Port Multiplier not supported ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahcich2: at channel 2 on ahci0 ahcich3: at channel 3 on ahci0 ahciem0: on ahci0 xhci0: mem 0xfb400000-0xfb40ffff irq 19 at device 20.0 on pci1 xhci0: 32 bytes context size, 64-bit DMA usbus0 on xhci0 usbus0: 5.0Gbps Super Speed USB v3.0 pci1: at device 22.0 (no driver attached) pci1: at device 22.1 (no driver attached) ehci0: mem 0xfb434000-0xfb4343ff irq 18 at device 26.0 on pci1 usbus1: EHCI version 1.0 usbus1 on ehci0 usbus1: 480Mbps High Speed USB v2.0 pcib5: irq 16 at device 28.0 on pci1 pci5: on pcib5 pcib6: irq 18 at device 28.2 on pci1 pci6: on pcib6 pcib7: at device 0.0 on pci6 pci7: on pcib7 vgapci0: port 0xe000-0xe07f mem 0xfa000000-0xfaffffff,0xfb000000-0xfb01ffff irq 18 at device 0.0 on pci7 vgapci0: Boot video device pcib8: irq 16 at device 28.4 on pci1 pci8: on pcib8 igb0: port 0xd020-0xd03f mem 0xfb320000-0xfb33ffff,0xfb344000-0xfb347fff irq 16 at device 0.0 on pci8 igb0: Using 1024 TX descriptors and 1024 RX descriptors igb0: queue equality override not set, capping rx_queues at 6 and tx_queues at 6 igb0: Using 6 RX queues 6 TX queues igb0: Und tx_queues at 6 igb1: Using 6 RX queues 6 TX queues igb1: Using MSI-X interrupts with 7 vectors igb1: Ethernet address: 0c:c4:7a:a8:cd:db igb1: netmap queues/slots: TX 6/1024, RX 6/1024 ehci1: mem 0xfb433000-0xfb4333ff irq 18 at device 29.0 on pci1 usbus2: EHCI version 1.0 usbus2 on ehci1 usbus2: 480Mbps High Speed USB v2.0 isab0: at device 31.0 on pci1 isa0: on isab0 ahci1: port 0xf070-0xf077,0xf060-0xf063,0xf050-0xf057,0xf040-0xf043,0xf000-0xf01f mem 0xfb432000-0xfb4327ff irq 16 at device 31.2 on pci1 ahci1: AHCI v1.30 with 6 6Gbps ports, Port Multiplier not supported ahcich4: at channel 0 on ahci1 ahcich5: at channel 1 on ahci1 ahcich6: at channel 2 on ahci1 ahcich7: at channel 3 on ahci1 ahcich8: at channel 4 on ahci1 ahcich9: at channel 5 on ahci1 ahciem1: on ahci1 acpi_button0: on acpi0 uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0 uart1: console (115200,n,8,1) orm0: at iomem 0xc0000-0xc7fff,0xcb000-0xcbfff pnpid ORM0000 on isa0 est0: on cpu0 p4tcc0: on cpu0 NULL mp in getnewvnode(9), tag crossmp Timecounters tick every 1.000 msec ugen0.1: <0x8086 XHCI root HUB> at usbus0 ugen1.1: at usbus1 ugen2.1: at usbus2 uhub0 on usbus0 uhub0: <0x8086 XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0 uhub1 on usbus1 uhub1: on usbus1 uhub2 on usbus2 uhub2: on usbus2 Expensive timeout(9) function: 0xffffffff804dc4d0(0xfffffe101addc000) 0.004926586 s ada0 at ahcich1 bus 0 scbus1 target 0 lun 0 ada0: ACS-2 ATA SATA 3.x device ada0: Serial Number WD-WCC3F3KDDP98 ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes) ada0: Command Queueing enabled ada0: 953869MB (1953525168 512 byte sectors) ada0: quirks=0x1<4K> ses0 at ahciem0 bus 0 scbus4 target 0 lun 0 ses0: SEMB S-E-S 2.00 device ses0: SEMB SES Device ses1 at ahciem1 bus 0 scbus11 target 0 lun 0 ses1: SEMB S-E-S 2.00 device ses1: SEMB SES Device ses0: ada0,pass0 in 'Slot 01', SATA Slot: scbus1 target 0 hwpmc: SOFT/16/64/0x67 TSC/1/64/0x20 IAP/4/48/0x3ff IAF/3/48/0x67 Trying to mount root from ufs:/dev/gpt/work [rw]... WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. Expensive timeout(9) function: 0xffffffff80a404b0(0xffffffff81ae7420) 0.007389021 s WARNING: / was not properly dismounted uhub1: 2 ports with 2 removable, self powered Interface IP-Address Broadcast Setting hostuuid: 00000000-0000-0000-0000-002590c99976. Setting hostid: 0x90b83241. ugen0.3: at usbus0 ukbd0 on uhub4 ukbd0: on usbus0 kbd2 at ukbd0 Starting Network6 options=29 Starting devd. igb0: link state changed to UP Autoloading module: ioat.ko ioat0: mem 0xfb42c000-0xfb42ffff irq 31 at device 4.0 on pci1 ioat0: Capabilities: 2f7 ioat1: mem 0xfb428000-0xfb42bfff irq 39 at device 4.1 on pci1 ioat1: Capabilities: 2f7 ioat2: mem 0xfb424000-0xfb427fff irq 31 at device 4.2 on pci1 ioat2: Capabilities: f7 ioat3: mem 0xfb420000-0xfb423fff irq 39 at device 4.3 on pci1 ioat3: Capabilities: f7 ioat4: mem 0xfb41c000-0xfb41ffff irq 31 at device 4.4 on pci1 ioat4: Capabilities: f7 ioat5: mem 0xfb418000-0xfb41bfff irq 39 at device 4.5 on pci1 ioat5: Capabilities: f7 ioat6: mem 0xfb414000-0xfb417fff irq 31 at device 4.6 on pci1 ioat6: Capabilities: f7 ioat7: mem 0xfb410000-0xfb413fff irq 39 at device 4.7 on pci1 ioat7: Capabilities: f7 Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Starting Network: igb1. igb1: flags=8802 metric 0 mtu 1500 options=e507bb ether 0c:c4:7a:a8:cd:db media: Ethernet autoselect status: no carrier nd6 options=29 Autoloading module: uhid.ko Autoloading module: ums.ko ums0 on uhub4 ums0: on usbus0 ums0: 3 buttons and [Z] coordinates ID=0 Starting dhclient. DHCPREQUEST on igb0 to 255.255.255.255 port 67 DHCPACK from 192if_delmulti_locked: detaching ifnet instance 0xfffff8000e093800 .168.5.1 bound to 192.168.5.171 -- renewal in 300 seconds. add host 127.0.0.1: gateway lo0 fib 0: route already in table add host ::1: gateway lo0 fib 0: route already in table add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Creating and/or trimming log files. Starting syslogd. Setting date via ntp. 8 Jul 10:17:02 ntpdate[2045]: step time server 192.168.5.1 offset -1.297771 sec Starting rpcbind. NFS access cache time=60 Starting watchdogd. No core dumps found. lock order reversal: 1st 0xfffffe0f818b7920 bufwait (bufwait) @ kern/vfs_bio.c:3904 2nd 0xfffff8022f778000 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:289 stack backtrace: #0 0xffffffff80c3a853 at witness_debugger+0x73 #1 0xffffffff80c3a59d at witness_checkorder+0xa7d #2 0xffffffff80bd82c8 at _sx_xlock+0x68 #3 0xffffffff80ee4ccd at ufsdirhash_add+0x4d #4 0xffffffff80ee9666 at ufs_direnter+0x446 #5 0xffffffff80ef1879 at ufs_mkdir+0x8c9 #6 0xffffffff812313ec at VOP_MKDIR_APV+0x8c #7 0xffffffff80cb3ad3 at kern_mkdirat+0x1b3 #8 0xffffffff810aab71 at amd64_syscall+0x291 #9 0xffffffff810830ed at fast_syscall_common+0x101 Clearing /tmp (X related). Starting statd. Starting lockd. fscklock order reversal: 1st 0xfffff8001c3e92e0 ufs (ufs) @ kern/vfs_subr.c:2687 2nd 0xfffffe0f818b7cf8 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:283 3rd 0xfffff8001c9d82e0 ufs (ufs) @ kern/vfs_subr.c:2687 stack backtrace: #0 0xffffffff80c3a853 at witness_debugger+0x73 #1 0xffffffff80c3a59d at witness_checkorder+0xa7d #2 0xffffffff80ba20fb at lockmgr_xlock_hard+0x6b #3 0xffffffff80ba2b6e at __lockmgr_args+0x5fe #4 0xffffffff80edf66c at ffs_lock+0x7c #5 0xffffffff81231f40 at VOP_LOCK1_APV+0x70 #6 0xffffffff80cb6f05 at _vn_lock+0x65 #7 0xffffffff80ca4e96 at vget+0xa6 #8 0xffffffff80c96c4c at vfs_hash_get+0xcc #9 0xffffffff80edaebf at ffs_vgetf+0x3f #10 0xffffffff80ed01ef at softdep_sync_buf+0x56f #11 0xffffffff80ee0484 at ffs_syncvnode+0x234 #12 0xffffffff80eddc2d at ffs_sync+0x20d #13 0xffffffff80c9d59f at dounmount+0x4bf #14 0xffffffff80c9d040 at sys_unmount+0x300 #15 0xffffffff810aab71 at amd64_syscall+0x291 #16 0xffffffff810830ed at fast_syscall_common+0x101 lock order reversal: 1st 0xfffff8001c3a12e0 ufs (ufs) @ kern/vfs_mount.c:1354 2nd 0xfffff8001c3e9558 devfs (devfs) @ ufs/ffs/ffs_vfsops.c:1611 stack backtrace: #0 0xffffffff80c3a853 at witness_debugger+0x73 #1 0xffffffff80c3a59d at witness_checkorder+0xa7d #2 0xffffffff80ba1bfb at lockmgr_lock_fast_path+0x16b #3 0xffffffff81231f40 at VOP_LOCK1_APV+0x70 #4 0xffffffff80cb6f05 at _vn_lock+0x65 #5 0xffffffff80eddcef at ffs_sync+0x2cf #6 0xffffffff80c9d59f at dounmount+0x4bf #7 0xffffffff80c9d040 at sys_unmount+0x300 #8 0xffffffff810aab71 at amd64_syscall+0x291 #9 0xffffffff810830ed at fast_syscall_common+0x101 ** /dev/gpt/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 231 files, 26026 used, 1239381 free (77 frags, 154913 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** Updating motd:. Mounting late filesystems:. Security policy loaded: MAC/ntpd (mac_ntpd) Starting ntpd. Configuring vt: blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting cron. Mon Jul 8 10:17 FreeBSD/amd64 (mercat1.netperf.freebsd.org) (ttyu1) login: root Jul 8 10:17:09 mercat1 login[2325]: ROOT LOGIN (root) ON ttyu1 Last login: Mon Jul 8 07:48:29 on ttyu1 FreeBSD 13.0-CURRENT (MEMGUARD) #2 r349777M: Mon Jul 8 10:09:36 CEST 2019 root@mercat1:~ # cd /stress2/misc root@mercat1:/stress2/misc # cat sort.sh #!/bin/sh # # Copyright (c) 2017 Dell EMC Isilon # All rights reserved. # # Redistribution and use in source and binary forms, with or without # modification, are permitted provided that the following conditions # are met: # 1. Redistributions of source code must retain the above copyright # notice, this list of conditions and the following disclaimer. # 2. Redistributions in binary form must reproduce the above copyright # notice, this list of conditions and the following disclaimer in the # documentation and/or other materials provided with the distribution. # # THIS SOFTWARE IS PROVIDED BY THE AUTHOR AND CONTRIBUTORS ``AS IS'' AND # ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE # IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE # ARE DISCLAIMED. IN NO EVENT SHALL THE AUTHOR OR CONTRIBUTORS BE LIABLE # FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL # DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS # OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) # HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT # LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY # OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF # SUCH DAMAGE. # # $FreeBSD$ # # VM stress. [ `sysctl -n vm.swap_total` -eq 0 ] && exit 0 for i in `jot 6`; do sort /dev/zero & pids="$pids $!" done start=`date '+%s'` while [ $((`date '+%s'` - start)) -lt 180 ]; do sleep 10 pgrep -q sort || break done while pgrep -q sort; do kill -9 $pids > /dev/null 2>&1 sleep 1 done wait exit 0 root@mercat1:/stress2/misc # ./sort.sh swap_pager: out of swap space swp_pager_getswapspace(19): failed Jul 8 10:24:06 mercat1 kernel: pid 2336 (sort), jid 0, uid 0, was killed: out of swap space panic: freeing free block: ffff40, size 2, mask 1 cpuid = 5 time = 1562574250 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe102d8e8080 vpanic() at vpanic+0x19d/frame 0xfffffe102d8e80d0 panic() at panic+0x43/frame 0xfffffe102d8e8130 blst_leaf_free() at blst_leaf_free+0x7c/frame 0xfffffe102d8e8160 blst_meta_free() at blst_meta_free+0x44/frame 0xfffffe102d8e81c0 blst_meta_free() at blst_meta_free+0x158/frame 0xfffffe102d8e8220 blst_meta_free() at blst_meta_free+0x158/frame 0xfffffe102d8e8280 blst_meta_free() at blst_meta_free+0x158/frame 0xfffffe102d8e82e0 blst_meta_free() at blst_meta_free+0x158/frame 0xfffffe102d8e8340 blist_free() at blist_free+0xa1/frame 0xfffffe102d8e8370 swp_pager_freeswapspace() at swp_pager_freeswapspace+0xb0/frame 0xfffffe102d8e83a0 swp_pager_update_freerange() at swp_pager_update_freerange+0x52/frame 0xfffffe102d8e83d0 swp_pager_meta_free_all() at swp_pager_meta_free_all+0xdc/frame 0xfffffe102d8e8410 swap_pager_dealloc() at swap_pager_dealloc+0x20d/frame 0xfffffe102d8e8440 vm_object_terminate() at vm_object_terminate+0x2a5/frame 0xfffffe102d8e8490 vm_object_deallocate() at vm_object_deallocate+0x83b/frame 0xfffffe102d8e8500 vm_map_entry_deallocate() at vm_map_entry_deallocate+0x2f/frame 0xfffffe102d8e8530 vm_map_process_deferred() at vm_map_process_deferred+0x172/frame 0xfffffe102d8e8570 _vm_map_unlock() at _vm_map_unlock+0x7a/frame 0xfffffe102d8e85a0 vm_map_remove() at vm_map_remove+0xbe/frame 0xfffffe102d8e85e0 vmspace_dofree() at vmspace_dofree+0x3f/frame 0xfffffe102d8e8610 vmspace_exit() at vmspace_exit+0x154/frame 0xfffffe102d8e8650 exit1() at exit1+0x5ad/frame 0xfffffe102d8e86c0 sigexit() at sigexit+0xdaf/frame 0xfffffe102d8e89a0 postsig() at postsig+0x336/frame 0xfffffe102d8e8a70 ast() at ast+0x4c7/frame 0xfffffe102d8e8ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe320 KDB: enter: panic [ thread pid 2335 tid 100217 ] Stopped at kdb_enter+0x3b: movq $0,kdb_why db> run pho db:0:pho> set $lines 20000 db:0:pho> run pho1 db:1:pho1> bt Tracing pid 2335 tid 100217 td 0xfffff8001c9d2000 kdb_enter() at kdb_enter+0x3b/frame 0xfffffe102d8e8080 vpanic() at vpanic+0x1ba/frame 0xfffffe102d8e80d0 panic() at panic+0x43/frame 0xfffffe102d8e8130 blst_leaf_free() at blst_leaf_free+0x7c/frame 0xfffffe102d8e8160 blst_meta_free() at blst_meta_free+0x44/frame 0xfffffe102d8e81c0 blst_meta_free() at blst_meta_free+0x158/frame 0xfffffe102d8e8220 blst_meta_free() at blst_meta_free+0x158/frame 0xfffffe102d8e8280 blst_meta_free() at blst_meta_free+0x158/frame 0xfffffe102d8e82e0 blst_meta_free() at blst_meta_free+0x158/frame 0xfffffe102d8e8340 blist_free() at blist_free+0xa1/frame 0xfffffe102d8e8370 swp_pager_freeswapspace() at swp_pager_freeswapspace+0xb0/frame 0xfffffe102d8e83a0 swp_pager_update_freerange() at swp_pager_update_freerange+0x52/frame 0xfffffe102d8e83d0 swp_pager_meta_free_all() at swp_pager_meta_free_all+0xdc/frame 0xfffffe102d8e8410 swap_pager_dealloc() at swap_pager_dealloc+0x20d/frame 0xfffffe102d8e8440 vm_object_terminate() at vm_object_terminate+0x2a5/frame 0xfffffe102d8e8490 vm_object_deallocate() at vm_object_deallocate+0x83b/frame 0xfffffe102d8e8500 vm_map_entry_deallocate() at vm_map_entry_deallocate+0x2f/frame 0xfffffe102d8e8530 vm_map_process_deferred() at vm_map_process_deferred+0x172/frame 0xfffffe102d8e8570 _vm_map_unlock() at _vm_map_unlock+0x7a/frame 0xfffffe102d8e85a0 vm_map_remove() at vm_map_remove+0xbe/frame 0xfffffe102d8e85e0 vmspace_dofree() at vmspace_dofree+0x3f/frame 0xfffffe102d8e8610 vmspace_exit() at vmspace_exit+0x154/frame 0xfffffe102d8e8650 exit1() at exit1+0x5ad/frame 0xfffffe102d8e86c0 sigexit() at sigexit+0xdaf/frame 0xfffffe102d8e89a0 postsig() at postsig+0x336/frame 0xfffffe102d8e8a70 ast() at ast+0x4c7/frame 0xfffffe102d8e8ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe320 db:1:pho1> show allpcpu Current CPU: 5 cpuid = 0 dynamic pcpu = 0xd63800 curthread = 0xfffff8000b30c000: pid 11 tid 100003 "idle: cpu0" curpcb = 0xfffffe0f817e8b80 fpcurthread = none idlethread = 0xfffff8000b30c000: tid 100003 "idle: cpu0" curpmap = 0xffffffff820885f0 tssp = 0xffffffff821bfd20 commontssp = 0xffffffff821bfd20 rsp0 = 0xfffffe0f817e8b80 gs32p = 0xffffffff821c6958 ldt = 0xffffffff821c6998 tss = 0xffffffff821c6988 tlb gen = 3842023 curvnet = 0 spin locks held: cpuid = 1 dynamic pcpu = 0xfffffe1005fe9800 curthread = 0xfffff8000b30b5a0: pid 11 tid 100004 "idle: cpu1" curpcb = 0xfffffe0f817edb80 fpcurthread = none idlethread = 0xfffff8000b30b5a0: tid 100004 "idle: cpu1" curpmap = 0xffffffff820885f0 tssp = 0xffffffff821bfd88 commontssp = 0xffffffff821bfd88 rsp0 = 0xfffffe0f817edb80 gs32p = 0xffffffff821c69c0 ldt = 0xffffffff821c6a00 tss = 0xffffffff821c69f0 tlb gen = 3842023 curvnet = 0 spin locks held: cpuid = 2 dynamic pcpu = 0xfffffe1005ff5800 curthread = 0xfffff8001c9d25a0: pid 2334 tid 100216 "sort" curpcb = 0xfffffe102d8e3b80 fpcurthread = 0xfffff8001c9d25a0: pid 2334 "sort" idlethread = 0xfffff8000b30b000: tid 100005 "idle: cpu2" curpmap = 0xffffffff820885f0 tssp = 0xffffffff821bfdf0 commontssp = 0xffffffff821bfdf0 rsp0 = 0xfffffe102d8e3b80 gs32p = 0xffffffff821c6a28 ldt = 0xffffffff821c6a68 tss = 0xffffffff821c6a58 tlb gen = 3842023 curvnet = 0 spin locks held: cpuid = 3 dynamic pcpu = 0xfffffe1006001800 curthread = 0xfffff8000b30a5a0: pid 11 tid 100006 "idle: cpu3" curpcb = 0xfffffe0f817f7b80 fpcurthread = none idlethread = 0xfffff8000b30a5a0: tid 100006 "idle: cpu3" curpmap = 0xffffffff820885f0 tssp = 0xffffffff821bfe58 commontssp = 0xffffffff821bfe58 rsp0 = 0xfffffe0f817f7b80 gs32p = 0xffffffff821c6a90 ldt = 0xffffffff821c6ad0 tss = 0xffffffff821c6ac0 tlb gen = 3842023 curvnet = 0 spin locks held: cpuid = 4 dynamic pcpu = 0xfffffe100600d800 curthread = 0xfffff8000b30a000: pid 11 tid 100007 "idle: cpu4" curpcb = 0xfffffe0f817fcb80 fpcurthread = none idlethread = 0xfffff8000b30a000: tid 100007 "idle: cpu4" curpmap = 0xffffffff820885f0 tssp = 0xffffffff821bfec0 commontssp = 0xffffffff821bfec0 rsp0 = 0xfffffe0f817fcb80 gs32p = 0xffffffff821c6af8 ldt = 0xffffffff821c6b38 tss = 0xffffffff821c6b28 tlb gen = 3842023 curvnet = 0 spin locks held: cpuid = 5 dynamic pcpu = 0xfffffe1006019800 curthread = 0xfffff8001c9d2000: pid 2335 tid 100217 "sort" curpcb = 0xfffffe102d8e8b80 fpcurthread = 0xfffff8001c9d2000: pid 2335 "sort" idlethread = 0xfffff8000b3095a0: tid 100008 "idle: cpu5" curpmap = 0xffffffff820885f0 tssp = 0xffffffff821bff28 commontssp = 0xffffffff821bff28 rsp0 = 0xfffffe102d8e8b80 gs32p = 0xffffffff821c6b60 ldt = 0xffffffff821c6ba0 tss = 0xffffffff821c6b90 tlb gen = 3842023 curvnet = 0 spin locks held: cpuid = 6 dynamic pcpu = 0xfffffe1006025800 curthread = 0xfffff8001c9d1000: pid 2337 tid 100219 "sort" curpcb = 0xfffffe102d8f2b80 fpcurthread = 0xfffff8001c9d1000: pid 2337 "sort" idlethread = 0xfffff8000b309000: tid 100009 "idle: cpu6" curpmap = 0xffffffff820885f0 tssp = 0xffffffff821bff90 commontssp = 0xffffffff821bff90 rsp0 = 0xfffffe102d8f2b80 gs32p = 0xffffffff821c6bc8 ldt = 0xffffffff821c6c08 tss = 0xffffffff821c6bf8 tlb gen = 3842023 curvnet = 0 spin locks held: cpuid = 7 dynamic pcpu = 0xfffffe1006031800 curthread = 0xfffff8001c9d15a0: pid 2336 tid 100218 "sort" curpcb = 0xfffffe102d8edb80 fpcurthread = 0xfffff8001c9d15a0: pid 2336 "sort" idlethread = 0xfffff8000b31d5a0: tid 100010 "idle: cpu7" curpmap = 0xffffffff820885f0 tssp = 0xffffffff821bfff8 commontssp = 0xffffffff821bfff8 rsp0 = 0xfffffe102d8edb80 gs32p = 0xffffffff821c6c30 ldt = 0xffffffff821c6c70 tss = 0xffffffff821c6c60 tlb gen = 3842023 curvnet = 0 spin locks held: cpuid = 8 dynamic pcpu = 0xfffffe100603d800 curthread = 0xfffff8001c9d05a0: pid 2338 tid 100220 "sort" curpcb = 0xfffffe102d8f7b80 fpcurthread = 0xfffff8001c9d05a0: pid 2338 "sort" idlethread = 0xfffff8000b31d000: tid 100011 "idle: cpu8" curpmap = 0xffffffff820885f0 tssp = 0xffffffff821c0060 commontssp = 0xffffffff821c0060 rsp0 = 0xfffffe102d8f7b80 gs32p = 0xffffffff821c6c98 ldt = 0xffffffff821c6cd8 tss = 0xffffffff821c6cc8 tlb gen = 3842023 curvnet = 0 spin locks held: cpuid = 9 dynamic pcpu = 0xfffffe1006049800 curthread = 0xfffff8000b31c5a0: pid 11 tid 100012 "idle: cpu9" curpcb = 0xfffffe0ff7744b80 fpcurthread = none idlethread = 0xfffff8000b31c5a0: tid 100012 "idle: cpu9" curpmap = 0xffffffff820885f0 tssp = 0xffffffff821c00c8 commontssp = 0xffffffff821c00c8 rsp0 = 0xfffffe0ff7744b80 gs32p = 0xffffffff821c6d00 ldt = 0xffffffff821c6d40 tss = 0xffffffff821c6d30 tlb gen = 3842023 curvnet = 0 spin locks held: cpuid = 10 dynamic pcpu = 0xfffffe1006055800 curthread = 0xfffff8000b31c000: pid 11 tid 100013 "idle: cpu10" curpcb = 0xfffffe0ff7749b80 fpcurthread = none idlethread = 0xfffff8000b31c000: tid 100013 "idle: cpu10" curpmap = 0xffffffff820885f0 tssp = 0xffffffff821c0130 commontssp = 0xffffffff821c0130 rsp0 = 0xfffffe0ff7749b80 gs32p = 0xffffffff821c6d68 ldt = 0xffffffff821c6da8 tss = 0xffffffff821c6d98 tlb gen = 3842017 curvnet = 0 spin locks held: cpuid = 11 dynamic pcpu = 0xfffffe1006061800 curthread = 0xfffff8000b31b5a0: pid 11 tid 100014 "idle: cpu11" curpcb = 0xfffffe0ff774eb80 fpcurthread = none idlethread = 0xfffff8000b31b5a0: tid 100014 "idle: cpu11" curpmap = 0xffffffff820885f0 tssp = 0xffffffff821c0198 commontssp = 0xffffffff821c0198 rsp0 = 0xfffffe0ff774eb80 gs32p = 0xffffffff821c6dd0 ldt = 0xffffffff821c6e10 tss = 0xffffffff821c6e00 tlb gen = 3842023 curvnet = 0 spin locks held: db:1:pho1> show alllocks Process 2338 (sort) thread 0xfffff8001c9d05a0 (100220) exclusive rw vm object (vm object) r = 0 (0xfffff8022f59a400) locked @ vm/vm_object.c:521 Process 2337 (sort) thread 0xfffff8001c9d1000 (100219) exclusive rw vm object (vm object) r = 0 (0xfffff8000b435100) locked @ vm/vm_object.c:521 Process 2336 (sort) thread 0xfffff8001c9d15a0 (100218) exclusive rw vm object (vm object) r = 0 (0xfffff8000bae7400) locked @ vm/vm_object.c:521 Process 2335 (sort) thread 0xfffff8001c9d2000 (100217) exclusive sleep mutex swapdev (swapdev) r = 0 (0xffffffff8204af58) locked @ vm/swap_pager.c:817 exclusive rw vm object (vm object) r = 0 (0xfffff8000feb7300) locked @ vm/vm_object.c:521 Process 2334 (sort) thread 0xfffff8001c9d25a0 (100216) exclusive rw vm object (vm object) r = 0 (0xfffff8022fe8f600) locked @ vm/vm_object.c:521 db:1:pho1> show lockedvnods Locked vnodes db:1:pho1> show allchains chain 1: thread 100205 (pid 2388, sleep) sleeping on 0xffffffff81e900b0 "nanslp" chain 2: thread 100168 (pid 2331, sh) sleeping on 0xfffff8001c2ea000 "wait" chain 3: thread 100202 (pid 2326, csh) sleeping on 0xfffff8001c4435d8 "pause" chain 4: thread 100214 (pid 2325, login) sleeping on 0xfffff8022fc22000 "wait" chain 5: thread 100213 (pid 2324, getty) sleeping on 0xfffff8000e1e54b0 "ttyin" chain 6: thread 100212 (pid 2323, getty) sleeping on 0xfffff8000f9f04b0 "ttyin" chain 7: thread 100204 (pid 2322, getty) sleeping on 0xfffff8000f9f08b0 "ttyin" chain 8: thread 100209 (pid 2321, getty) sleeping on 0xfffff8000f9f0cb0 "ttyin" chain 9: thread 100210 (pid 2320, getty) sleeping on 0xfffff8000f9f10b0 "ttyin" chain 10: thread 100211 (pid 2319, getty) sleeping on 0xfffff8000f9f14b0 "ttyin" chain 11: thread 100170 (pid 2318, getty) sleeping on 0xfffff8000f9f18b0 "ttyin" chain 12: thread 100167 (pid 2317, getty) sleeping on 0xfffff8000f9f1cb0 "ttyin" chain 13: thread 100142 (pid 2316, getty) sleeping on 0xfffff8000f9f20b0 "ttyin" chain 14: thread 100208 (pid 2270, cron) sleeping on 0xffffffff81e900b2 "nanslp" chain 15: thread 100199 (pid 2266, sshd) sleeping on 0xfffff8000bad2940 "select" chain 16: thread 100203 (pid 2237, ntpd) sleeping on 0xfffff8000b427f40 "select" chain 17: thread 100221 (pid 2237, ntpd) sleeping on 0xfffff8000ad82680 "usem" chain 18: thread 100169 (pid 2176, NLM: master) sleeping on 0xfffff8000b357860 "rpcsvc" chain 19: thread 100148 (pid 2173, rpc.statd) sleeping on 0xfffff8000fc4f3c0 "select" chain 20: thread 100198 (pid 2127, watchdogd) sleeping on 0xffffffff81e900b0 "nanslp" chain 21: thread 100196 (pid 2048, rpcbind) sleeping on 0xfffff8001c5cef40 "select" chain 22: thread 100163 (pid 2038, syslogd) sleeping on 0xfffff8000ad81bc0 "select" chain 23: thread 100154 (pid 1967, devd) sleeping on 0xfffff8001cded840 "select" chain 24: thread 100144 (pid 1962, dhclient) sleeping on 0xfffff8000bad2a40 "select" chain 25: thread 100152 (pid 1918, dhclient) sleeping on 0xfffff8000ad81ac0 "select" chain 26: thread 100162 (pid 1915, dhclient) sleeping on 0xfffff8001c3cbc40 "select" chain 27: thread 100141 (pid 34, syncer) sleeping on 0xffffffff82032d00 "syncer" chain 28: thread 100140 (pid 33, vnlru) sleeping on 0xfffff8000f888000 "vlruwt" chain 29: thread 100130 (pid 32, bufdaemon) sleeping on 0xffffffff82032198 "qsleep" chain 30: thread 100133 (pid 32, bufspacedaemon-0) sleeping on 0xffffffff81a0a8c0 "-" chain 31: thread 100134 (pid 32, bufspacedaemon-1) sleeping on 0xffffffff81a12b80 "-" chain 32: thread 100135 (pid 32, bufspacedaemon-2) sleeping on 0xffffffff81a1ae40 "-" chain 33: thread 100136 (pid 32, bufspacedaemon-3) sleeping on 0xffffffff81a23100 "-" chain 34: thread 100137 (pid 32, bufspacedaemon-4) sleeping on 0xffffffff81a2b3c0 "-" chain 35: thread 100138 (pid 32, bufspacedaemon-5) sleeping on 0xffffffff81a33680 "-" chain 36: thread 100139 (pid 32, bufspacedaemon-6) sleeping on 0xffffffff81a3b940 "-" chain 37: thread 100151 (pid 32, / worker) sleeping on 0xfffff8001c3792e8 "sdflush" chain 38: thread 100201 (pid 32, /tmp worker) sleeping on 0xfffff8000f9dc0e8 "sdflush" chain 39: thread 100128 (pid 30, dom0) sleeping on 0xffffffff820b8e18 "psleep" chain 40: thread 100131 (pid 30, laundry: dom0) sleeping on 0xffffffff820b8e24 "launds" chain 41: thread 100132 (pid 30, uma) sleeping on 0xffffffff80effae0 "umarcl" chain 42: thread 100127 (pid 29, enc_daemon1) sleeping on 0xfffff8000f7b4000 "idle" chain 43: thread 100126 (pid 28, enc_daemon0) sleeping on 0xfffff8000f7b4530 "idle" chain 44: thread 100120 (pid 27, rand_harvestq) sleeping on 0xffffffff81cef7a0 "-" chain 45: thread 100119 (pid 26, sctp_iterator) sleeping on 0xffffffff820b74f0 "waiting_for_work" chain 46: thread 100118 (pid 25, soaiod4) sleeping on 0xffffffff82031b9c "-" chain 47: thread 100117 (pid 24, soaiod3) sleeping on 0xffffffff82031b9c "-" chain 48: thread 100116 (pid 23, soaiod2) sleeping on 0xffffffff82031b9c "-" chain 49: thread 100115 (pid 22, soaiod1) sleeping on 0xffffffff82031b9c "-" chain 50: thread 100096 (pid 21, usbus0) sleeping on 0xfffffe101afaa460 "-" chain 51: thread 100097 (pid 21, usbus0) sleeping on 0xfffffe101afaa4b8 "-" chain 52: thread 100098 (pid 21, usbus0) sleeping on 0xfffffe101afaa510 "-" chain 53: thread 100099 (pid 21, usbus0) sleeping on 0xfffffe101afaa568 "-" chain 54: thread 100100 (pid 21, usbus0) sleeping on 0xfffffe101afaa5c0 "-" chain 55: thread 100102 (pid 21, usbus1) sleeping on 0xfffffe0f87dd6d10 "-" chain 56: thread 100103 (pid 21, usbus1) sleeping on 0xfffffe0f87dd6d68 "-" chain 57: thread 100104 (pid 21, usbus1) sleeping on 0xfffffe0f87dd6dc0 "-" chain 58: thread 100105 (pid 21, usbus1) sleeping on 0xfffffe0f87dd6e18 "-" chain 59: thread 100106 (pid 21, usbus1) sleeping on 0xfffffe0f87dd6e70 "-" chain 60: thread 100107 (pid 21, usbus2) sleeping on 0xfffffe101b23dd10 "-" chain 61: thread 100108 (pid 21, usbus2) sleeping on 0xfffffe101b23dd68 "-" chain 62: thread 100109 (pid 21, usbus2) sleeping on 0xfffffe101b23ddc0 "-" chain 63: thread 100110 (pid 21, usbus2) sleeping on 0xfffffe101b23de18 "-" chain 64: thread 100111 (pid 21, usbus2) sleeping on 0xfffffe101b23de70 "-" chain 65: thread 100091 (pid 20, doneq0) sleeping on 0xffffffff81bcab40 "-" chain 66: thread 100092 (pid 20, doneq1) sleeping on 0xffffffff81bcabc0 "-" chain 67: thread 100093 (pid 20, doneq2) sleeping on 0xffffffff81bcac40 "-" chain 68: thread 100125 (pid 20, scanner) sleeping on 0xffffffff81bcaa08 "-" chain 69: thread 100090 (pid 19, crypto returns 11) sleeping on 0xfffff8000b59e450 "crypto_ret_wait" chain 70: thread 100089 (pid 18, crypto returns 10) sleeping on 0xfffff8000b59e3f0 "crypto_ret_wait" chain 71: thread 100088 (pid 17, crypto returns 9) sleeping on 0xfffff8000b59e390 "crypto_ret_wait" chain 72: thread 100087 (pid 16, crypto returns 8) sleeping on 0xfffff8000b59e330 "crypto_ret_wait" chain 73: thread 100086 (pid 15, crypto returns 7) sleeping on 0xfffff8000b59e2d0 "crypto_ret_wait" chain 74: thread 100085 (pid 9, crypto returns 6) sleeping on 0xfffff8000b59e270 "crypto_ret_wait" chain 75: thread 100084 (pid 8, crypto returns 5) sleeping on 0xfffff8000b59e210 "crypto_ret_wait" chain 76: thread 100083 (pid 7, crypto returns 4) sleeping on 0xfffff8000b59e1b0 "crypto_ret_wait" chain 77: thread 100082 (pid 6, crypto returns 3) sleeping on 0xfffff8000b59e150 "crypto_ret_wait" chain 78: thread 100081 (pid 5, crypto returns 2) sleeping on 0xfffff8000b59e0f0 "crypto_ret_wait" chain 79: thread 100080 (pid 4, crypto returns 1) sleeping on 0xfffff8000b59e090 "crypto_ret_wait" chain 80: thread 100079 (pid 3, crypto returns 0) sleeping on 0xfffff8000b59e030 "crypto_ret_wait" chain 81: thread 100078 (pid 2, crypto) sleeping on 0xffffffff82049538 "crypto_wait" chain 82: thread 100065 (pid 14, sequencer 00) sleeping on 0xfffff8000b47c888 "seqstate" chain 83: thread 100062 (pid 13, g_event) sleeping on 0xffffffff82087980 "-" chain 84: thread 100063 (pid 13, g_up) sleeping on 0xffffffff82087990 "-" chain 85: thread 100064 (pid 13, g_down) sleeping on 0xffffffff82087978 "-" chain 86: thread 100002 (pid 1, init) sleeping on 0xfffff8000b308530 "wait" chain 87: thread 100001 (pid 10, audit) sleeping on 0xffffffff820b8210 "audit_worker_cv" chain 88: thread 100000 (pid 0, swapper) sleeping on 0xffffffff820879c0 "swapin" chain 89: thread 100017 (pid 0, thread taskq) sleeping on 0xfffff8000b358d00 "-" chain 90: thread 100019 (pid 0, config_0) sleeping on 0xfffff8000b358b00 "-" chain 91: thread 100020 (pid 0, kqueue_ctx taskq) sleeping on 0xfffff8000b358a00 "-" chain 92: thread 100021 (pid 0, aiod_kick taskq) sleeping on 0xfffff8000b358900 "-" chain 93: thread 100022 (pid 0, if_config_tqg_0) sleeping on 0xfffff8000b358800 "-" chain 94: thread 100023 (pid 0, if_io_tqg_0) sleeping on 0xfffff8000b358700 "-" chain 95: thread 100024 (pid 0, if_io_tqg_1) sleeping on 0xfffff8000b358600 "-" chain 96: thread 100025 (pid 0, if_io_tqg_2) sleeping on 0xfffff8000b358500 "-" chain 97: thread 100026 (pid 0, if_io_tqg_3) sleeping on 0xfffff8000b358400 "-" chain 98: thread 100027 (pid 0, if_io_tqg_4) sleeping on 0xfffff8000b358300 "-" chain 99: thread 100028 (pid 0, if_io_tqg_5) sleeping on 0xfffff8000b358200 "-" chain 100: thread 100029 (pid 0, if_io_tqg_6) sleeping on 0xfffff8000b358100 "-" chain 101: thread 100030 (pid 0, if_io_tqg_7) sleeping on 0xfffff8000b358000 "-" chain 102: thread 100031 (pid 0, if_io_tqg_8) sleeping on 0xfffff8000b357e00 "-" chain 103: thread 100032 (pid 0, if_io_tqg_9) sleeping on 0xfffff8000b357d00 "-" chain 104: thread 100033 (pid 0, if_io_tqg_10) sleeping on 0xfffff8000b357c00 "-" chain 105: thread 100034 (pid 0, if_io_tqg_11) sleeping on 0xfffff8000b357b00 "-" chain 106: thread 100035 (pid 0, softirq_0) sleeping on 0xfffff8000b357a00 "-" chain 107: thread 100036 (pid 0, softirq_1) sleeping on 0xfffff8000b357900 "-" chain 108: thread 100037 (pid 0, softirq_2) sleeping on 0xfffff8000b40e100 "-" chain 109: thread 100038 (pid 0, softirq_3) sleeping on 0xfffff8000b40e000 "-" chain 110: thread 100039 (pid 0, softirq_4) sleeping on 0xfffff8000b40be00 "-" chain 111: thread 100040 (pid 0, softirq_5) sleeping on 0xfffff8000b40bd00 "-" chain 112: thread 100041 (pid 0, softirq_6) sleeping on 0xfffff8000b40bc00 "-" chain 113: thread 100042 (pid 0, softirq_7) sleeping on 0xfffff8000b40bb00 "-" chain 114: thread 100043 (pid 0, softirq_8) sleeping on 0xfffff8000b40ba00 "-" chain 115: thread 100044 (pid 0, softirq_9) sleeping on 0xfffff8000b40b900 "-" chain 116: thread 100045 (pid 0, softirq_10) sleeping on 0xfffff8000b40b800 "-" chain 117: thread 100046 (pid 0, softirq_11) sleeping on 0xfffff8000b40b700 "-" chain 118: thread 100061 (pid 0, firmware taskq) sleeping on 0xfffff8000b4dd200 "-" chain 119: thread 100066 (pid 0, crypto_0) sleeping on 0xfffff8000b4dd000 "-" chain 120: thread 100067 (pid 0, crypto_1) sleeping on 0xfffff8000b4dd000 "-" chain 121: thread 100068 (pid 0, crypto_2) sleeping on 0xfffff8000b4dd000 "-" chain 122: thread 100069 (pid 0, crypto_3) sleeping on 0xfffff8000b4dd000 "-" chain 123: thread 100070 (pid 0, crypto_4) sleeping on 0xfffff8000b4dd000 "-" chain 124: thread 100071 (pid 0, crypto_5) sleeping on 0xfffff8000b4dd000 "-" chain 125: thread 100072 (pid 0, crypto_6) sleeping on 0xfffff8000b4dd000 "-" chain 126: thread 100073 (pid 0, crypto_7) sleeping on 0xfffff8000b4dd000 "-" chain 127: thread 100074 (pid 0, crypto_8) sleeping on 0xfffff8000b4dd000 "-" chain 128: thread 100075 (pid 0, crypto_9) sleeping on 0xfffff8000b4dd000 "-" chain 129: thread 100076 (pid 0, crypto_10) sleeping on 0xfffff8000b4dd000 "-" chain 130: thread 100077 (pid 0, crypto_11) sleeping on 0xfffff8000b4dd000 "-" chain 131: thread 100114 (pid 0, mca taskq) sleeping on 0xfffff8000e80aa00 "-" chain 132: thread 100121 (pid 0, acpi_task_0) sleeping on 0xfffff8000f855d00 "-" chain 133: thread 100122 (pid 0, acpi_task_1) sleeping on 0xfffff8000f855d00 "-" chain 134: thread 100123 (pid 0, acpi_task_2) sleeping on 0xfffff8000f855d00 "-" chain 135: thread 100124 (pid 0, CAM taskq) sleeping on 0xfffff8000b4dcd00 "-" db:1:pho1> show mount 0xfffff8000fc1d000 /dev/gpt/work on / (ufs) 0xfffff8000fc1e000 devfs on /dev (devfs) 0xfffff8022fa4a000 /dev/gpt/tmp on /tmp (ufs) More info: show mount db:1:pho1> show bufqueues bqempty: 104722 Buf domain 0 freebufs 15001 lofreebufs 219 hifreebufs 329 bufspace 2387968 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 1 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 50 (872448) dirtyq count 1 (32768) wakeup 0 lim 25 CPU 12, 5, 12, 4, 0, 8, 5, 7, 8, 3, 7, 10, Locked buffers: 0 space 0 Total buffers: 151 space 2387968 Buf domain 1 freebufs 14812 lofreebufs 219 hifreebufs 329 bufspace 8867840 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 11 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 210 (5750784) dirtyq count 11 (360448) wakeup 0 lim 25 CPU 10, 9, 7, 7, 3, 9, 9, 7, 11, 6, 17, 5, Locked buffers: 0 space 0 Total buffers: 322 space 8867840 Buf domain 2 freebufs 15009 lofreebufs 219 hifreebufs 329 bufspace 2449408 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 50 (942080) dirtyq count 0 (0) wakeup 0 lim 25 CPU 9, 15, 8, 3, 1, 2, 7, 4, 1, 8, 5, 11, Locked buffers: 0 space 0 Total buffers: 124 space 2449408 Buf domain 3 freebufs 15027 lofreebufs 219 hifreebufs 329 bufspace 1675264 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 25 (159744) dirtyq count 0 (0) wakeup 0 lim 25 CPU 9, 14, 6, 9, 1, 0, 3, 5, 8, 4, 11, 11, Locked buffers: 0 space 0 Total buffers: 106 space 1675264 Buf domain 4 freebufs 14988 lofreebufs 219 hifreebufs 329 bufspace 3092480 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 50 (831488) dirtyq count 0 (0) wakeup 0 lim 25 CPU 4, 18, 16, 8, 2, 1, 4, 1, 22, 1, 13, 5, Locked buffers: 0 space 0 Total buffers: 145 space 3092480 Buf domain 5 freebufs 14945 lofreebufs 219 hifreebufs 329 bufspace 4321280 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 99 (2510848) dirtyq count 0 (0) wakeup 0 lim 25 CPU 6, 20, 9, 5, 8, 1, 8, 6, 4, 2, 12, 8, Locked buffers: 0 space 0 Total buffers: 188 space 4321280 Buf domain 6 freebufs 15024 lofreebufs 219 hifreebufs 329 bufspace 1748992 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 25 (122880) dirtyq count 0 (0) wakeup 0 lim 25 CPU 6, 19, 9, 3, 1, 1, 10, 2, 5, 1, 11, 16, Locked buffers: 0 space 0 Total buffers: 111 space 1748992 db:1:pho1> show page vm_cnt.v_free_count: 7932261 vm_cnt.v_inactive_count: 50 vm_cnt.v_active_count: 603 vm_cnt.v_laundry_count: 103 vm_cnt.v_wire_count: 195431 vm_cnt.v_free_reserved: 10649 vm_cnt.v_free_min: 51289 vm_cnt.v_free_target: 173209 vm_cnt.v_inactive_target: 259813 db:1:pho1> show pageq pq_free 7932261 dom 0 page_cnt 8128423 free 7932261 pq_act 603 pq_inact 50 pq_laund 103 pq_unsw 55 db:0:pho> show freepages DOMAIN: 0 FREE LIST 0: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000252 | 000000 11 (008192K) | 000713 | 000000 10 (004096K) | 001888 | 000000 09 (002048K) | 002946 | 000000 08 (001024K) | 003855 | 000000 07 (000512K) | 003780 | 000000 06 (000256K) | 003759 | 000002 05 (000128K) | 003643 | 000069 04 (000064K) | 003845 | 000330 03 (000032K) | 003644 | 000979 02 (000016K) | 003374 | 002654 01 (000008K) | 005868 | 004849 00 (000004K) | 009589 | 006895 FREE LIST 1: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000000 | 000000 09 (002048K) | 000000 | 000000 08 (001024K) | 000000 | 000000 07 (000512K) | 000000 | 000000 06 (000256K) | 000000 | 000000 05 (000128K) | 000002 | 000000 04 (000064K) | 000003 | 000000 03 (000032K) | 000001 | 000000 02 (000016K) | 000002 | 000000 01 (000008K) | 000001 | 000000 00 (000004K) | 000001 | 000001 db:0:pho> show uma Zone Size Used Free Requests Sleeps Bucket FFS2 dinode 256 779 1 1025 0 61 FFS1 dinode 128 0 0 0 0 125 FFS inode 160 779 109 1025 0 61 swblk 136 398035 651302 1049383 0 61 swpctrie 144 26737 43490 70222 0 61 selfd 64 59 623 7027 0 253 rtentry 208 12 121 15 0 61 unpcb 256 16 89 4916 0 61 IPsec SA lft_c 16 0 0 0 0 253 ripcb 488 1 7 1 0 29 udplite_inpcb 488 0 0 0 0 29 sctp_asconf_ack 48 0 0 0 0 253 sctp_asconf 40 0 0 0 0 253 sctp_stream_msg_out 112 0 0 0 0 125 sctp_readq 152 0 0 0 0 61 sctp_chunk 152 0 0 0 0 61 sctp_raddr 736 0 0 0 0 13 sctp_laddr 48 0 0 4 0 253 sctp_asoc 2408 0 0 0 0 3 sctp_ep 1280 0 0 0 0 9 tcp_log_node 120 0 0 0 0 125 tcp_log_bucket 144 0 0 0 0 61 tcp_log 408 0 0 0 0 29 tcpreass 48 0 0 0 0 253 tfo_ccache_entries 80 0 0 0 0 125 tfo 4 0 0 0 0 253 sackhole 32 0 0 0 0 253 hostcache 96 0 0 0 0 125 syncache 168 0 0 0 0 61 tcptw 88 0 0 0 0 125 tcpcb 976 8 12 13 0 13 tcp_inpcb 488 8 32 13 0 29 udpcb 32 20 600 166 0 253 udp_inpcb 488 20 44 166 0 29 ipq 56 0 0 0 0 253 socket 872 47 2989 5106 0 13 KNOTE 160 0 0 0 0 61 itimer 352 0 0 0 0 29 ksiginfo 112 76 414 562 0 125 procdesc 136 1 28 6 0 61 pipe 760 3 12 832 0 13 AIOLIO 280 0 0 0 0 29 AIOCB 752 0 0 0 0 13 AIOP 32 0 0 0 0 253 AIO 208 0 0 0 0 61 Mountpoints 2896 3 3 4 0 3 DIRHASH 1024 9 3 129 0 13 NCLNODE 744 0 0 0 0 13 LTS VFS Cache 368 0 0 0 0 29 L VFS Cache 328 0 0 0 0 29 STS VFS Cache 148 0 0 0 0 61 S VFS Cache 108 836 179 1835 0 125 rentr 24 0 0 2 0 253 NAMEI 1024 0 4 55628 0 13 BUF TRIE 144 184 105764 500 0 61 VNODEPOLL 120 0 0 0 0 125 VNODE 632 886 2 1135 0 13 vtnet_tx_hdr 24 0 0 0 0 253 crypto_session 24 0 0 0 0 253 cryptodesc 120 0 0 0 0 125 cryptop 128 0 0 0 0 125 nvme_request 128 0 0 0 0 125 g_bio 408 0 27 2255573 0 29 FPU_save_area 832 0 0 0 0 13 DMAR_MAP_ENTRY 120 0 0 0 0 125 ttyoutq 256 165 150 274 0 61 ttyinq 160 315 213 525 0 61 epoch_record pcpu 256 4 12 4 0 61 mbuf_extpgs 256 0 0 0 0 61 mbuf_jumbo_16k 16384 0 0 0 0 1 mbuf_jumbo_9k 9216 0 0 0 0 1 mbuf_jumbo_page 4096 0 0 0 0 1 mbuf_cluster 2048 3240 0 5638 0 5 mbuf 256 3223 14 5019 0 253 mbuf_packet 256 3 0 146 0 253 audit_record 1280 0 0 0 0 9 domainset 40 0 0 0 0 253 cpuset 104 27 407 27 0 125 THREAD 1440 219 43 221 0 9 PROC 1328 64 89 2388 0 9 MAC labels 40 0 0 0 0 253 pbuf 984 0 1011 0 0 1 clpbuf 984 0 0 4 0 5 vnpbuf 984 0 0 0 0 13 mdpbuf 984 0 0 0 0 1 nfspbuf 984 0 0 0 0 5 swwbuf 984 0 0 558315 0 1 swrbuf 984 0 0 231 0 5 umtx_shm 88 0 0 0 0 125 umtx pi 96 0 0 0 0 125 rangeset pctrie nodes 144 0 0 0 0 61 rl_entry 40 67 1121 67 0 253 TURNSTILE 136 263 537 263 0 61 filedesc0 1104 60 54 2389 0 9 Files 80 99 1420 23880 0 125 SLEEPQUEUE 88 263 450 263 0 125 65536 65536 2 0 2 0 1 65536 65536 1 0 1 0 1 65536 65536 1 0 59 0 1 65536 65536 2 0 2 0 1 65536 65536 4 0 2166 0 1 65536 65536 0 0 0 0 1 65536 65536 0 0 8 0 1 65536 65536 2 0 2 0 1 32768 32768 12 0 20 0 1 32768 32768 1 0 1 0 1 32768 32768 2 0 2 0 1 32768 32768 0 0 0 0 1 32768 32768 12 0 2549 0 1 32768 32768 12 0 12 0 1 32768 32768 0 0 0 0 1 32768 32768 0 0 0 0 1 16384 16384 1 0 13 0 1 16384 16384 0 0 0 0 1 16384 16384 2 0 225 0 1 16384 16384 2 0 2 0 1 16384 16384 49 0 2878 0 1 16384 16384 4 0 4 0 1 16384 16384 1 0 1 0 1 16384 16384 0 0 0 0 1 8192 8192 13 0 49 0 1 8192 8192 6 0 6 0 1 8192 8192 2 0 2 0 1 8192 8192 1 0 1 0 1 8192 8192 21 0 1684 0 1 8192 8192 88 0 88 0 1 8192 8192 0 0 0 0 1 8192 8192 1 0 1 0 1 4096 4096 2 0 7 0 1 4096 4096 59 1 81 0 1 4096 4096 73 6 2399 0 1 4096 4096 2 0 2 0 1 4096 4096 6 0 92007 0 1 4096 4096 365 0 602 0 1 4096 4096 1 1 276 0 1 4096 4096 0 0 12 0 1 2048 2048 3 3 23 0 5 2048 2048 96 4 97 0 5 2048 2048 2 2 45 0 5 2048 2048 5 5 5 0 5 2048 2048 5 5 503 0 5 2048 2048 4 2 4 0 5 2048 2048 18 16 563351 0 5 2048 2048 2 2 2 0 5 1024 1024 2 6 56 0 13 1024 1024 199 41 226 0 13 1024 1024 1 3 7139 0 13 1024 1024 1 3 1 0 13 1024 1024 33 63 3676 0 13 1024 1024 25 7 91 0 13 1024 1024 16 12 28 0 13 1024 1024 5 15 5714 0 13 512 512 2 12 290 0 29 512 512 137 45 138 0 29 512 512 176 62 2561 0 29 512 512 4 24 4 0 29 512 512 94 74 6348 0 29 512 512 10 39 10 0 29 512 512 21 21 33 0 29 512 512 32 45 48 0 29 256 256 29 166 722 0 61 256 256 434 181 3966 0 61 256 256 33 177 941 0 61 256 256 296 214 2632 0 61 256 256 455 190 4965 0 61 256 256 17 58 17 0 61 256 256 41 214 499 0 61 256 256 24 36 8964 0 61 128 128 18 292 812 0 125 128 128 440 366 29503 0 125 128 128 100 365 3000 0 125 128 128 1145 467 1148 0 125 128 128 2605 402 3507 0 125 128 128 152 437 264 0 125 128 128 413 393 805 0 125 128 128 14383 156 883889 0 125 64 64 24 720 341 0 253 64 64 8635 417 72020 0 253 64 64 165 765 2560 0 253 64 64 76 668 2444 0 253 64 64 1358 625 1804 0 253 64 64 66 554 82 0 253 64 64 65 431 68 0 253 64 64 9285 263 17307 0 253 32 32 116 1372 994 0 253 32 32 245 995 368 0 253 32 32 38 1202 257 0 253 32 32 35 833 126 0 253 32 32 3603 1357 14624 0 253 32 32 11 733 19 0 253 32 32 118 1618 363 0 253 32 32 795 1561 23241 0 253 16 16 15 1728 65 0 253 16 16 192 1800 472 0 253 16 16 89 1654 390 0 253 16 16 42 1950 106 0 253 16 16 3144 2085 24011 0 253 16 16 29 1714 29 0 253 16 16 9 738 10 0 253 16 16 477 768 850115 0 253 mt_zone 24 428 402 428 0 253 mt_stats_zone 64 428 84 428 0 253 64 pcpu 8 3005 1603 3309 0 253 fakepg 104 0 0 0 0 125 VMSPACE 2552 31 38 2356 0 3 MAP ENTRY 112 948 1572 141026 0 125 KMAP ENTRY 112 7 166 7 0 125 MAP 232 2 65 2 0 61 RADIX NODE 144 6788 523210 1853655 0 61 VM OBJECT 256 1240 725 47382 0 61 vmem btag 56 11865 1606 11889 0 253 vmem 1856 0 1 0 0 5 256 Bucket 2048 1 2 2422 0 5 128 Bucket 1024 0 0 3665 0 13 64 Bucket 512 0 0 1826 0 29 32 Bucket 256 -1 0 7154 0 61 16 Bucket 128 13 389 427 0 125 12 Bucket 96 0 0 1490 0 125 8 Bucket 64 -1 0 934 0 253 6 Bucket 48 0 0 259 0 253 4 Bucket 32 19 973 1289 0 253 UMA Hash 256 2 9 7 0 0 UMA Slabs 112 3038 626 7131 0 0 UMA Zones 1960 81 1 81 0 0 UMA Kegs 216 75 4 75 0 0 db:0:pho> show umacache Zone Size Used Free Requests Bucket vm pgcache 104 8334 0 275565 253 buf free cache 984 1125 84 1877 13 buffer arena-65 65536 0 0 670 1 buffer arena-61 61440 0 0 670 1 buffer arena-57 57344 0 0 670 1 buffer arena-53 53248 0 0 670 1 buffer arena-49 49152 0 0 670 1 buffer arena-45 45056 0 0 670 1 buffer arena-40 40960 0 0 670 1 buffer arena-36 36864 0 0 670 1 buffer arena-32 32768 219 8 945 1 buffer arena-28 28672 0 0 670 1 buffer arena-24 24576 0 0 670 1 buffer arena-20 20480 0 0 670 1 buffer arena-16 16384 3 1 680 1 buffer arena-12 12288 0 0 670 1 buffer arena-81 8192 0 0 670 1 buffer arena-40 4096 0 0 670 1 db:0:pho> acttrace Tracing command sort pid 2338 tid 100220 td 0xfffff8001c9d05a0 (CPU 8) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0f87bc7df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0f87bc7e10 trap() at trap+0x48/frame 0xfffffe0f87bc7f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0f87bc7f20 --- trap 0x13, rip = 0xffffffff80c1a050, rsp = 0xfffffe102d8f7280, rbp = 0xfffffe102d8f7290 --- lock_delay() at lock_delay+0x40/frame 0xfffffe102d8f7290 __mtx_lock_sleep() at __mtx_lock_sleep+0xe8/frame 0xfffffe102d8f7320 __mtx_lock_flags() at __mtx_lock_flags+0xee/frame 0xfffffe102d8f7370 swp_pager_freeswapspace() at swp_pager_freeswapspace+0x3a/frame 0xfffffe102d8f73a0 swp_pager_update_freerange() at swp_pager_update_freerange+0x52/frame 0xfffffe102d8f73d0 swp_pager_meta_free_all() at swp_pager_meta_free_all+0xdc/frame 0xfffffe102d8f7410 swap_pager_dealloc() at swap_pager_dealloc+0x20d/frame 0xfffffe102d8f7440 vm_object_terminate() at vm_object_terminate+0x2a5/frame 0xfffffe102d8f7490 vm_object_deallocate() at vm_object_deallocate+0x83b/frame 0xfffffe102d8f7500 vm_map_entry_deallocate() at vm_map_entry_deallocate+0x2f/frame 0xfffffe102d8f7530 vm_map_process_deferred() at vm_map_process_deferred+0x172/frame 0xfffffe102d8f7570 _vm_map_unlock() at _vm_map_unlock+0x7a/frame 0xfffffe102d8f75a0 vm_map_remove() at vm_map_remove+0xbe/frame 0xfffffe102d8f75e0 vmspace_dofree() at vmspace_dofree+0x3f/frame 0xfffffe102d8f7610 vmspace_exit() at vmspace_exit+0x154/frame 0xfffffe102d8f7650 exit1() at exit1+0x5ad/frame 0xfffffe102d8f76c0 sigexit() at sigexit+0xdaf/frame 0xfffffe102d8f79a0 postsig() at postsig+0x336/frame 0xfffffe102d8f7a70 ast() at ast+0x4c7/frame 0xfffffe102d8f7ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe320 Tracing command sort pid 2337 tid 100219 td 0xfffff8001c9d1000 (CPU 6) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0f87bafdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0f87bafe10 trap() at trap+0x48/frame 0xfffffe0f87baff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0f87baff20 --- trap 0x13, rip = 0xffffffff80c3b018, rsp = 0xfffffe102d8f22a0, rbp = 0xfffffe102d8f22d0 --- witness_unlock() at witness_unlock+0x1b8/frame 0xfffffe102d8f22d0 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe102d8f2300 zone_free_item() at zone_free_item+0x129/frame 0xfffffe102d8f2340 uma_zfree_arg() at uma_zfree_arg+0x1aa/frame 0xfffffe102d8f23a0 uma_zfree() at uma_zfree+0x29/frame 0xfffffe102d8f23d0 swp_pager_meta_free_all() at swp_pager_meta_free_all+0x117/frame 0xfffffe102d8f2410 swap_pager_dealloc() at swap_pager_dealloc+0x20d/frame 0xfffffe102d8f2440 vm_object_terminate() at vm_object_terminate+0x2a5/frame 0xfffffe102d8f2490 vm_object_deallocate() at vm_object_deallocate+0x83b/frame 0xfffffe102d8f2500 vm_map_entry_deallocate() at vm_map_entry_deallocate+0x2f/frame 0xfffffe102d8f2530 vm_map_process_deferred() at vm_map_process_deferred+0x172/frame 0xfffffe102d8f2570 _vm_map_unlock() at _vm_map_unlock+0x7a/frame 0xfffffe102d8f25a0 vm_map_remove() at vm_map_remove+0xbe/frame 0xfffffe102d8f25e0 vmspace_dofree() at vmspace_dofree+0x3f/frame 0xfffffe102d8f2610 vmspace_exit() at vmspace_exit+0x154/frame 0xfffffe102d8f2650 exit1() at exit1+0x5ad/frame 0xfffffe102d8f26c0 sigexit() at sigexit+0xdaf/frame 0xfffffe102d8f29a0 postsig() at postsig+0x336/frame 0xfffffe102d8f2a70 ast() at ast+0x4c7/frame 0xfffffe102d8f2ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe320 Tracing command sort pid 2336 tid 100218 td 0xfffff8001c9d15a0 (CPU 7) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0f87bbbdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0f87bbbe10 trap() at trap+0x48/frame 0xfffffe0f87bbbf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0f87bbbf20 --- trap 0x13, rip = 0xffffffff80c1a050, rsp = 0xfffffe102d8ed1b0, rbp = 0xfffffe102d8ed1c0 --- lock_delay() at lock_delay+0x40/frame 0xfffffe102d8ed1c0 __mtx_lock_sleep() at __mtx_lock_sleep+0xe8/frame 0xfffffe102d8ed250 __mtx_lock_flags() at __mtx_lock_flags+0xee/frame 0xfffffe102d8ed2a0 zone_release() at zone_release+0x3c/frame 0xfffffe102d8ed300 zone_free_item() at zone_free_item+0x129/frame 0xfffffe102d8ed340 uma_zfree_arg() at uma_zfree_arg+0x1aa/frame 0xfffffe102d8ed3a0 uma_zfree() at uma_zfree+0x29/frame 0xfffffe102d8ed3d0 swp_pager_meta_free_all() at swp_pager_meta_free_all+0x117/frame 0xfffffe102d8ed410 swap_pager_dealloc() at swap_pager_dealloc+0x20d/frame 0xfffffe102d8ed440 vm_object_terminate() at vm_object_terminate+0x2a5/frame 0xfffffe102d8ed490 vm_object_deallocate() at vm_object_deallocate+0x83b/frame 0xfffffe102d8ed500 vm_map_entry_deallocate() at vm_map_entry_deallocate+0x2f/frame 0xfffffe102d8ed530 vm_map_process_deferred() at vm_map_process_deferred+0x172/frame 0xfffffe102d8ed570 _vm_map_unlock() at _vm_map_unlock+0x7a/frame 0xfffffe102d8ed5a0 vm_map_remove() at vm_map_remove+0xbe/frame 0xfffffe102d8ed5e0 vmspace_dofree() at vmspace_dofree+0x3f/frame 0xfffffe102d8ed610 vmspace_exit() at vmspace_exit+0x154/frame 0xfffffe102d8ed650 exit1() at exit1+0x5ad/frame 0xfffffe102d8ed6c0 sigexit() at sigexit+0xdaf/frame 0xfffffe102d8ed9a0 postsig() at postsig+0x336/frame 0xfffffe102d8eda70 ast() at ast+0x4c7/frame 0xfffffe102d8edab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe320 Tracing command sort pid 2335 tid 100217 td 0xfffff8001c9d2000 (CPU 5) kdb_enter() at kdb_enter+0x3b/frame 0xfffffe102d8e8080 vpanic() at vpanic+0x1ba/frame 0xfffffe102d8e80d0 panic() at panic+0x43/frame 0xfffffe102d8e8130 blst_leaf_free() at blst_leaf_free+0x7c/frame 0xfffffe102d8e8160 blst_meta_free() at blst_meta_free+0x44/frame 0xfffffe102d8e81c0 blst_meta_free() at blst_meta_free+0x158/frame 0xfffffe102d8e8220 blst_meta_free() at blst_meta_free+0x158/frame 0xfffffe102d8e8280 blst_meta_free() at blst_meta_free+0x158/frame 0xfffffe102d8e82e0 blst_meta_free() at blst_meta_free+0x158/frame 0xfffffe102d8e8340 blist_free() at blist_free+0xa1/frame 0xfffffe102d8e8370 swp_pager_freeswapspace() at swp_pager_freeswapspace+0xb0/frame 0xfffffe102d8e83a0 swp_pager_update_freerange() at swp_pager_update_freerange+0x52/frame 0xfffffe102d8e83d0 swp_pager_meta_free_all() at swp_pager_meta_free_all+0xdc/frame 0xfffffe102d8e8410 swap_pager_dealloc() at swap_pager_dealloc+0x20d/frame 0xfffffe102d8e8440 vm_object_terminate() at vm_object_terminate+0x2a5/frame 0xfffffe102d8e8490 vm_object_deallocate() at vm_object_deallocate+0x83b/frame 0xfffffe102d8e8500 vm_map_entry_deallocate() at vm_map_entry_deallocate+0x2f/frame 0xfffffe102d8e8530 vm_map_process_deferred() at vm_map_process_deferred+0x172/frame 0xfffffe102d8e8570 _vm_map_unlock() at _vm_map_unlock+0x7a/frame 0xfffffe102d8e85a0 vm_map_remove() at vm_map_remove+0xbe/frame 0xfffffe102d8e85e0 vmspace_dofree() at vmspace_dofree+0x3f/frame 0xfffffe102d8e8610 vmspace_exit() at vmspace_exit+0x154/frame 0xfffffe102d8e8650 exit1() at exit1+0x5ad/frame 0xfffffe102d8e86c0 sigexit() at sigexit+0xdaf/frame 0xfffffe102d8e89a0 postsig() at postsig+0x336/frame 0xfffffe102d8e8a70 ast() at ast+0x4c7/frame 0xfffffe102d8e8ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe320 Tracing command sort pid 2334 tid 100216 td 0xfffff8001c9d25a0 (CPU 2) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0f87b7fdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0f87b7fe10 trap() at trap+0x48/frame 0xfffffe0f87b7ff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0f87b7ff20 --- trap 0x13, rip = 0xffffffff80c1a052, rsp = 0xfffffe102d8e3220, rbp = 0xfffffe102d8e3230 --- lock_delay() at lock_delay+0x42/frame 0xfffffe102d8e3230 __mtx_lock_sleep() at __mtx_lock_sleep+0xe8/frame 0xfffffe102d8e32c0 __mtx_lock_flags() at __mtx_lock_flags+0xee/frame 0xfffffe102d8e3310 uma_dbg_free() at uma_dbg_free+0x54/frame 0xfffffe102d8e3340 uma_zfree_arg() at uma_zfree_arg+0x141/frame 0xfffffe102d8e33a0 uma_zfree() at uma_zfree+0x29/frame 0xfffffe102d8e33d0 swp_pager_meta_free_all() at swp_pager_meta_free_all+0x117/frame 0xfffffe102d8e3410 swap_pager_dealloc() at swap_pager_dealloc+0x20d/frame 0xfffffe102d8e3440 vm_object_terminate() at vm_object_terminate+0x2a5/frame 0xfffffe102d8e3490 vm_object_deallocate() at vm_object_deallocate+0x83b/frame 0xfffffe102d8e3500 vm_map_entry_deallocate() at vm_map_entry_deallocate+0x2f/frame 0xfffffe102d8e3530 vm_map_process_deferred() at vm_map_process_deferred+0x172/frame 0xfffffe102d8e3570 _vm_map_unlock() at _vm_map_unlock+0x7a/frame 0xfffffe102d8e35a0 vm_map_remove() at vm_map_remove+0xbe/frame 0xfffffe102d8e35e0 vmspace_dofree() at vmspace_dofree+0x3f/frame 0xfffffe102d8e3610 vmspace_exit() at vmspace_exit+0x154/frame 0xfffffe102d8e3650 exit1() at exit1+0x5ad/frame 0xfffffe102d8e36c0 sigexit() at sigexit+0xdaf/frame 0xfffffe102d8e39a0 postsig() at postsig+0x336/frame 0xfffffe102d8e3a70 ast() at ast+0x4c7/frame 0xfffffe102d8e3ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe320 Tracing command idle pid 11 tid 100003 td 0xfffff8000b30c000 (CPU 0) cpustop_handler() at cpustop_handler+0x2d/frame 0xffffffff820533b0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xffffffff820533d0 trap() at trap+0x48/frame 0xffffffff820534e0 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff820534e0 --- trap 0x13, rip = 0xffffffff81214256, rsp = 0xfffffe0f817e8900, rbp = 0xfffffe0f817e8900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0f817e8900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0f817e8950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0f817e8970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0f817e8990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0f817e8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f817e8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f817e8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffff8000b30b5a0 (CPU 1) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0f87b73df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0f87b73e10 trap() at trap+0x48/frame 0xfffffe0f87b73f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0f87b73f20 --- trap 0x13, rip = 0xffffffff81214256, rsp = 0xfffffe0f817ed900, rbp = 0xfffffe0f817ed900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0f817ed900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0f817ed950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0f817ed970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0f817ed990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0f817eda70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f817edab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f817edab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffff8000b30a5a0 (CPU 3) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0f87b8bdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0f87b8be10 trap() at trap+0x48/frame 0xfffffe0f87b8bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0f87b8bf20 --- trap 0x13, rip = 0xffffffff81214256, rsp = 0xfffffe0f817f7900, rbp = 0xfffffe0f817f7900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0f817f7900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0f817f7950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0f817f7970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0f817f7990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0f817f7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f817f7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f817f7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffff8000b30a000 (CPU 4) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0f87b97df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0f87b97e10 trap() at trap+0x48/frame 0xfffffe0f87b97f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0f87b97f20 --- trap 0x13, rip = 0xffffffff81214256, rsp = 0xfffffe0f817fc900, rbp = 0xfffffe0f817fc900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0f817fc900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0f817fc950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0f817fc970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0f817fc990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0f817fca70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f817fcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f817fcab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffff8000b31c5a0 (CPU 9) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0f87bd3df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0f87bd3e10 trap() at trap+0x48/frame 0xfffffe0f87bd3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0f87bd3f20 --- trap 0x13, rip = 0xffffffff81214256, rsp = 0xfffffe0ff7744900, rbp = 0xfffffe0ff7744900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0ff7744900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0ff7744950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0ff7744970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0ff7744990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0ff7744a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0ff7744ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0ff7744ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffff8000b31c000 (CPU 10) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0f87bdfdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0f87bdfe10 trap() at trap+0x48/frame 0xfffffe0f87bdff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0f87bdff20 --- trap 0x13, rip = 0xffffffff81214256, rsp = 0xfffffe0ff7749900, rbp = 0xfffffe0ff7749900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0ff7749900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0ff7749950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0ff7749970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0ff7749990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0ff7749a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0ff7749ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0ff7749ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffff8000b31b5a0 (CPU 11) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0f87bebdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0f87bebe10 trap() at trap+0x48/frame 0xfffffe0f87bebf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0f87bebf20 --- trap 0x13, rip = 0xffffffff81214256, rsp = 0xfffffe0ff774e900, rbp = 0xfffffe0ff774e900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0ff774e900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0ff774e950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0ff774e970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0ff774e990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0ff774ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe0ff774eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0ff774eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:pho> ps pid ppid pgrp uid state wmesg wchan cmd 2388 2331 2331 0 S+ nanslp 0xffffffff81e900b0 sleep 2338 2331 2331 0 RE+ CPU 8 sort 2337 2331 2331 0 RE+ CPU 6 sort 2336 2331 2331 0 RE+ CPU 7 sort 2335 2331 2331 0 RE+ CPU 5 sort 2334 2331 2331 0 RE+ CPU 2 sort 2331 2326 2331 0 S+ wait 0xfffff8001c2ea000 sh 2326 2325 2326 0 SW+ pause 0xfffff8001c4435d8 csh 2325 1 2325 0 SWs+ wait 0xfffff8022fc22000 login 2324 1 2324 0 Ss+ ttyin 0xfffff8000e1e54b0 getty 2323 1 2323 0 Ss+ ttyin 0xfffff8000f9f04b0 getty 2322 1 2322 0 Ss+ ttyin 0xfffff8000f9f08b0 getty 2321 1 2321 0 Ss+ ttyin 0xfffff8000f9f0cb0 getty 2320 1 2320 0 Ss+ ttyin 0xfffff8000f9f10b0 getty 2319 1 2319 0 Ss+ ttyin 0xfffff8000f9f14b0 getty 2318 1 2318 0 Ss+ ttyin 0xfffff8000f9f18b0 getty 2317 1 2317 0 Ss+ ttyin 0xfffff8000f9f1cb0 getty 2316 1 2316 0 Ss+ ttyin 0xfffff8000f9f20b0 getty 2270 1 2270 0 Ss nanslp 0xffffffff81e900b2 cron 2266 1 2266 0 Ss select 0xfffff8000bad2940 sshd 2237 1 2237 123 Ss (threaded) ntpd 100203 S select 0xfffff8000b427f40 ntpd 100221 S usem 0xfffff8000ad82680 ntpd 2176 1 2176 0 Ss rpcsvc 0xfffff8000b357860 NLM: master 2173 1 2173 0 Ss select 0xfffff8000fc4f3c0 rpc.statd 2127 1 2127 0 Ss nanslp 0xffffffff81e900b0 watchdogd 2048 1 2048 0 Ss select 0xfffff8001c5cef40 rpcbind 2038 1 2038 0 Ss select 0xfffff8000ad81bc0 syslogd 1967 1 1967 0 Ss select 0xfffff8001cded840 devd 1962 1 1962 65 Ss select 0xfffff8000bad2a40 dhclient 1918 1 1918 0 Ss select 0xfffff8000ad81ac0 dhclient 1915 1 1915 0 Ss select 0xfffff8001c3cbc40 dhclient 34 0 0 0 DL syncer 0xffffffff82032d00 [syncer] 33 0 0 0 DL vlruwt 0xfffff8000f888000 [vnlru] 32 0 0 0 DL (threaded) [bufdaemon] 100130 D qsleep 0xffffffff82032198 [bufdaemon] 100133 D - 0xffffffff81a0a8c0 [bufspacedaemon-0] 100134 D - 0xffffffff81a12b80 [bufspacedaemon-1] 100135 D - 0xffffffff81a1ae40 [bufspacedaemon-2] 100136 D - 0xffffffff81a23100 [bufspacedaemon-3] 100137 D - 0xffffffff81a2b3c0 [bufspacedaemon-4] 100138 D - 0xffffffff81a33680 [bufspacedaemon-5] 100139 D - 0xffffffff81a3b940 [bufspacedaemon-6] 100151 D sdflush 0xfffff8001c3792e8 [/ worker] 100201 D sdflush 0xfffff8000f9dc0e8 [/tmp worker] 31 0 0 0 RL [vmdaemon] 30 0 0 0 DL (threaded) [pagedaemon] 100128 D psleep 0xffffffff820b8e18 [dom0] 100131 D launds 0xffffffff820b8e24 [laundry: dom0] 100132 D umarcl 0xffffffff80effae0 [uma] 29 0 0 0 DL idle 0xfffff8000f7b4000 [enc_daemon1] 28 0 0 0 DL idle 0xfffff8000f7b4530 [enc_daemon0] 27 0 0 0 DL - 0xffffffff81cef7a0 [rand_harvestq] 26 0 0 0 DL waiting 0xffffffff820b74f0 [sctp_iterator] 25 0 0 0 DL - 0xffffffff82031b9c [soaiod4] 24 0 0 0 DL - 0xffffffff82031b9c [soaiod3] 23 0 0 0 DL - 0xffffffff82031b9c [soaiod2] 22 0 0 0 DL - 0xffffffff82031b9c [soaiod1] 21 0 0 0 DL (threaded) [usb] 100096 D - 0xfffffe101afaa460 [usbus0] 100097 D - 0xfffffe101afaa4b8 [usbus0] 100098 D - 0xfffffe101afaa510 [usbus0] 100099 D - 0xfffffe101afaa568 [usbus0] 100100 D - 0xfffffe101afaa5c0 [usbus0] 100102 D - 0xfffffe0f87dd6d10 [usbus1] 100103 D - 0xfffffe0f87dd6d68 [usbus1] 100104 D - 0xfffffe0f87dd6dc0 [usbus1] 100105 D - 0xfffffe0f87dd6e18 [usbus1] 100106 D - 0xfffffe0f87dd6e70 [usbus1] 100107 D - 0xfffffe101b23dd10 [usbus2] 100108 D - 0xfffffe101b23dd68 [usbus2] 100109 D - 0xfffffe101b23ddc0 [usbus2] 100110 D - 0xfffffe101b23de18 [usbus2] 100111 D - 0xfffffe101b23de70 [usbus2] 20 0 0 0 DL (threaded) [cam] 100091 D - 0xffffffff81bcab40 [doneq0] 100092 D - 0xffffffff81bcabc0 [doneq1] 100093 D - 0xffffffff81bcac40 [doneq2] 100125 D - 0xffffffff81bcaa08 [scanner] 19 0 0 0 DL crypto_ 0xfffff8000b59e450 [crypto returns 11] 18 0 0 0 DL crypto_ 0xfffff8000b59e3f0 [crypto returns 10] 17 0 0 0 DL crypto_ 0xfffff8000b59e390 [crypto returns 9] 16 0 0 0 DL crypto_ 0xfffff8000b59e330 [crypto returns 8] 15 0 0 0 DL crypto_ 0xfffff8000b59e2d0 [crypto returns 7] 9 0 0 0 DL crypto_ 0xfffff8000b59e270 [crypto returns 6] 8 0 0 0 DL crypto_ 0xfffff8000b59e210 [crypto returns 5] 7 0 0 0 DL crypto_ 0xfffff8000b59e1b0 [crypto returns 4] 6 0 0 0 DL crypto_ 0xfffff8000b59e150 [crypto returns 3] 5 0 0 0 DL crypto_ 0xfffff8000b59e0f0 [crypto returns 2] 4 0 0 0 DL crypto_ 0xfffff8000b59e090 [crypto returns 1] 3 0 0 0 DL crypto_ 0xfffff8000b59e030 [crypto returns 0] 2 0 0 0 DL crypto_ 0xffffffff82049538 [crypto] 14 0 0 0 DL seqstat 0xfffff8000b47c888 [sequencer 00] 13 0 0 0 DL (threaded) [geom] 100062 D - 0xffffffff82087980 [g_event] 100063 D - 0xffffffff82087990 [g_up] 100064 D - 0xffffffff82087978 [g_down] 12 0 0 0 WL (threaded) [intr] 100015 I [swi6: task queue] 100016 I [swi6: Giant taskq] 100018 I [swi5: fast taskq] 100047 I [swi4: clock (0)] 100048 I [swi4: clock (1)] 100049 I [swi4: clock (2)] 100050 I [swi4: clock (3)] 100051 I [swi4: clock (4)] 100052 I [swi4: clock (5)] 100053 I [swi4: clock (6)] 100054 I [swi4: clock (7)] 100055 I [swi4: clock (8)] 100056 I [swi4: clock (9)] 100057 I [swi4: clock (10)] 100058 I [swi4: clock (11)] 100059 I [swi1: netisr 0] 100060 I [swi3: vm] 100094 I [irq56: ahci0] 100095 I [irq19: xhci0] 100101 I [irq18: ehci0 ehci1] 100112 I [irq71: ahci1] 100113 I [swi0: uart uart] 100180 I [irq72: ioat0] 100181 I [irq73: ioat1] 100182 I [irq74: ioat2] 100183 I [irq75: ioat3] 100184 I [irq76: ioat4] 100185 I [irq77: ioat5] 100186 I [irq78: ioat6] 100187 I [irq79: ioat7] 11 0 0 0 RL (threaded) [idle] 100003 Run CPU 0 [idle: cpu0] 100004 Run CPU 1 [idle: cpu1] 100005 CanRun [idle: cpu2] 100006 Run CPU 3 [idle: cpu3] 100007 Run CPU 4 [idle: cpu4] 100008 CanRun [idle: cpu5] 100009 CanRun [idle: cpu6] 100010 CanRun [idle: cpu7] 100011 CanRun [idle: cpu8] 100012 Run CPU 9 [idle: cpu9] 100013 Run CPU 10 [idle: cpu10] 100014 Run CPU 11 [idle: cpu11] 1 0 1 0 SLs wait 0xfffff8000b308530 [init] 10 0 0 0 DL audit_w 0xffffffff820b8210 [audit] 0 0 0 0 DLs (threaded) [kernel] 100000 D swapin 0xffffffff820879c0 [swapper] 100017 D - 0xfffff8000b358d00 [thread taskq] 100019 D - 0xfffff8000b358b00 [config_0] 100020 D - 0xfffff8000b358a00 [kqueue_ctx taskq] 100021 D - 0xfffff8000b358900 [aiod_kick taskq] 100022 D - 0xfffff8000b358800 [if_config_tqg_0] 100023 D - 0xfffff8000b358700 [if_io_tqg_0] 100024 D - 0xfffff8000b358600 [if_io_tqg_1] 100025 D - 0xfffff8000b358500 [if_io_tqg_2] 100026 D - 0xfffff8000b358400 [if_io_tqg_3] 100027 D - 0xfffff8000b358300 [if_io_tqg_4] 100028 D - 0xfffff8000b358200 [if_io_tqg_5] 100029 D - 0xfffff8000b358100 [if_io_tqg_6] 100030 D - 0xfffff8000b358000 [if_io_tqg_7] 100031 D - 0xfffff8000b357e00 [if_io_tqg_8] 100032 D - 0xfffff8000b357d00 [if_io_tqg_9] 100033 D - 0xfffff8000b357c00 [if_io_tqg_10] 100034 D - 0xfffff8000b357b00 [if_io_tqg_11] 100035 D - 0xfffff8000b357a00 [softirq_0] 100036 D - 0xfffff8000b357900 [softirq_1] 100037 D - 0xfffff8000b40e100 [softirq_2] 100038 D - 0xfffff8000b40e000 [softirq_3] 100039 D - 0xfffff8000b40be00 [softirq_4] 100040 D - 0xfffff8000b40bd00 [softirq_5] 100041 D - 0xfffff8000b40bc00 [softirq_6] 100042 D - 0xfffff8000b40bb00 [softirq_7] 100043 D - 0xfffff8000b40ba00 [softirq_8] 100044 D - 0xfffff8000b40b900 [softirq_9] 100045 D - 0xfffff8000b40b800 [softirq_10] 100046 D - 0xfffff8000b40b700 [softirq_11] 100061 D - 0xfffff8000b4dd200 [firmware taskq] 100066 D - 0xfffff8000b4dd000 [crypto_0] 100067 D - 0xfffff8000b4dd000 [crypto_1] 100068 D - 0xfffff8000b4dd000 [crypto_2] 100069 D - 0xfffff8000b4dd000 [crypto_3] 100070 D - 0xfffff8000b4dd000 [crypto_4] 100071 D - 0xfffff8000b4dd000 [crypto_5] 100072 D - 0xfffff8000b4dd000 [crypto_6] 100073 D - 0xfffff8000b4dd000 [crypto_7] 100074 D - 0xfffff8000b4dd000 [crypto_8] 100075 D - 0xfffff8000b4dd000 [crypto_9] 100076 D - 0xfffff8000b4dd000 [crypto_10] 100077 D - 0xfffff8000b4dd000 [crypto_11] 100114 D - 0xfffff8000e80aa00 [mca taskq] 100121 D - 0xfffff8000f855d00 [acpi_task_0] 100122 D - 0xfffff8000f855d00 [acpi_task_1] 100123 D - 0xfffff8000f855d00 [acpi_task_2] 100124 D - 0xfffff8000b4dcd00 [CAM taskq] db:0:pho> allt Tracing command sleep pid 2388 tid 100205 td 0xfffff8022fa0f5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe102d8ac720 mi_switch() at mi_switch+0x174/frame 0xfffffe102d8ac750 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe102d8ac790 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe102d8ac7f0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe102d8ac830 _sleep() at _sleep+0x265/frame 0xfffffe102d8ac8d0 kern_clock_nanosleep() at kern_clock_nanosleep+0x206/frame 0xfffffe102d8ac950 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe102d8ac990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe102d8acab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe102d8acab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003a4b6a, rsp = 0x7fffffffeb18, rbp = 0x7fffffffeb60 --- Tracing command sort pid 2338 tid 100220 td 0xfffff8001c9d05a0 (CPU 8) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0f87bc7df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0f87bc7e10 trap() at trap+0x48/frame 0xfffffe0f87bc7f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0f87bc7f20 --- trap 0x13, rip = 0xffffffff80c1a050, rsp = 0xfffffe102d8f7280, rbp = 0xfffffe102d8f7290 --- lock_delay() at lock_delay+0x40/frame 0xfffffe102d8f7290 __mtx_lock_sleep() at __mtx_lock_sleep+0xe8/frame 0xfffffe102d8f7320 __mtx_lock_flags() at __mtx_lock_flags+0xee/frame 0xfffffe102d8f7370 swp_pager_freeswapspace() at swp_pager_freeswapspace+0x3a/frame 0xfffffe102d8f73a0 swp_pager_update_freerange() at swp_pager_update_freerange+0x52/frame 0xfffffe102d8f73d0 swp_pager_meta_free_all() at swp_pager_meta_free_all+0xdc/frame 0xfffffe102d8f7410 swap_pager_dealloc() at swap_pager_dealloc+0x20d/frame 0xfffffe102d8f7440 vm_object_terminate() at vm_object_terminate+0x2a5/frame 0xfffffe102d8f7490 vm_object_deallocate() at vm_object_deallocate+0x83b/frame 0xfffffe102d8f7500 vm_map_entry_deallocate() at vm_map_entry_deallocate+0x2f/frame 0xfffffe102d8f7530 vm_map_process_deferred() at vm_map_process_deferred+0x172/frame 0xfffffe102d8f7570 _vm_map_unlock() at _vm_map_unlock+0x7a/frame 0xfffffe102d8f75a0 vm_map_remove() at vm_map_remove+0xbe/frame 0xfffffe102d8f75e0 vmspace_dofree() at vmspace_dofree+0x3f/frame 0xfffffe102d8f7610 vmspace_exit() at vmspace_exit+0x154/frame 0xfffffe102d8f7650 exit1() at exit1+0x5ad/frame 0xfffffe102d8f76c0 sigexit() at sigexit+0xdaf/frame 0xfffffe102d8f79a0 postsig() at postsig+0x336/frame 0xfffffe102d8f7a70 ast() at ast+0x4c7/frame 0xfffffe102d8f7ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe320 Tracing command sort pid 2337 tid 100219 td 0xfffff8001c9d1000 (CPU 6) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0f87bafdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0f87bafe10 trap() at trap+0x48/frame 0xfffffe0f87baff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0f87baff20 --- trap 0x13, rip = 0xffffffff80c3b018, rsp = 0xfffffe102d8f22a0, rbp = 0xfffffe102d8f22d0 --- witness_unlock() at witness_unlock+0x1b8/frame 0xfffffe102d8f22d0 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe102d8f2300 zone_free_item() at zone_free_item+0x129/frame 0xfffffe102d8f2340 uma_zfree_arg() at uma_zfree_arg+0x1aa/frame 0xfffffe102d8f23a0 uma_zfree() at uma_zfree+0x29/frame 0xfffffe102d8f23d0 swp_pager_meta_free_all() at swp_pager_meta_free_all+0x117/frame 0xfffffe102d8f2410 swap_pager_dealloc() at swap_pager_dealloc+0x20d/frame 0xfffffe102d8f2440 vm_object_terminate() at vm_object_terminate+0x2a5/frame 0xfffffe102d8f2490 vm_object_deallocate() at vm_object_deallocate+0x83b/frame 0xfffffe102d8f2500 vm_map_entry_deallocate() at vm_map_entry_deallocate+0x2f/frame 0xfffffe102d8f2530 vm_map_process_deferred() at vm_map_process_deferred+0x172/frame 0xfffffe102d8f2570 _vm_map_unlock() at _vm_map_unlock+0x7a/frame 0xfffffe102d8f25a0 vm_map_remove() at vm_map_remove+0xbe/frame 0xfffffe102d8f25e0 vmspace_dofree() at vmspace_dofree+0x3f/frame 0xfffffe102d8f2610 vmspace_exit() at vmspace_exit+0x154/frame 0xfffffe102d8f2650 exit1() at exit1+0x5ad/frame 0xfffffe102d8f26c0 sigexit() at sigexit+0xdaf/frame 0xfffffe102d8f29a0 postsig() at postsig+0x336/frame 0xfffffe102d8f2a70 ast() at ast+0x4c7/frame 0xfffffe102d8f2ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe320 Tracing command sort pid 2336 tid 100218 td 0xfffff8001c9d15a0 (CPU 7) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0f87bbbdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0f87bbbe10 trap() at trap+0x48/frame 0xfffffe0f87bbbf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0f87bbbf20 --- trap 0x13, rip = 0xffffffff80c1a050, rsp = 0xfffffe102d8ed1b0, rbp = 0xfffffe102d8ed1c0 --- lock_delay() at lock_delay+0x40/frame 0xfffffe102d8ed1c0 __mtx_lock_sleep() at __mtx_lock_sleep+0xe8/frame 0xfffffe102d8ed250 __mtx_lock_flags() at __mtx_lock_flags+0xee/frame 0xfffffe102d8ed2a0 zone_release() at zone_release+0x3c/frame 0xfffffe102d8ed300 zone_free_item() at zone_free_item+0x129/frame 0xfffffe102d8ed340 uma_zfree_arg() at uma_zfree_arg+0x1aa/frame 0xfffffe102d8ed3a0 uma_zfree() at uma_zfree+0x29/frame 0xfffffe102d8ed3d0 swp_pager_meta_free_all() at swp_pager_meta_free_all+0x117/frame 0xfffffe102d8ed410 swap_pager_dealloc() at swap_pager_dealloc+0x20d/frame 0xfffffe102d8ed440 vm_object_terminate() at vm_object_terminate+0x2a5/frame 0xfffffe102d8ed490 vm_object_deallocate() at vm_object_deallocate+0x83b/frame 0xfffffe102d8ed500 vm_map_entry_deallocate() at vm_map_entry_deallocate+0x2f/frame 0xfffffe102d8ed530 vm_map_process_deferred() at vm_map_process_deferred+0x172/frame 0xfffffe102d8ed570 _vm_map_unlock() at _vm_map_unlock+0x7a/frame 0xfffffe102d8ed5a0 vm_map_remove() at vm_map_remove+0xbe/frame 0xfffffe102d8ed5e0 vmspace_dofree() at vmspace_dofree+0x3f/frame 0xfffffe102d8ed610 vmspace_exit() at vmspace_exit+0x154/frame 0xfffffe102d8ed650 exit1() at exit1+0x5ad/frame 0xfffffe102d8ed6c0 sigexit() at sigexit+0xdaf/frame 0xfffffe102d8ed9a0 postsig() at postsig+0x336/frame 0xfffffe102d8eda70 ast() at ast+0x4c7/frame 0xfffffe102d8edab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe320 Tracing command sort pid 2335 tid 100217 td 0xfffff8001c9d2000 (CPU 5) kdb_enter() at kdb_enter+0x3b/frame 0xfffffe102d8e8080 vpanic() at vpanic+0x1ba/frame 0xfffffe102d8e80d0 panic() at panic+0x43/frame 0xfffffe102d8e8130 blst_leaf_free() at blst_leaf_free+0x7c/frame 0xfffffe102d8e8160 blst_meta_free() at blst_meta_free+0x44/frame 0xfffffe102d8e81c0 blst_meta_free() at blst_meta_free+0x158/frame 0xfffffe102d8e8220 blst_meta_free() at blst_meta_free+0x158/frame 0xfffffe102d8e8280 blst_meta_free() at blst_meta_free+0x158/frame 0xfffffe102d8e82e0 blst_meta_free() at blst_meta_free+0x158/frame 0xfffffe102d8e8340 blist_free() at blist_free+0xa1/frame 0xfffffe102d8e8370 swp_pager_freeswapspace() at swp_pager_freeswapspace+0xb0/frame 0xfffffe102d8e83a0 swp_pager_update_freerange() at swp_pager_update_freerange+0x52/frame 0xfffffe102d8e83d0 swp_pager_meta_free_all() at swp_pager_meta_free_all+0xdc/frame 0xfffffe102d8e8410 swap_pager_dealloc() at swap_pager_dealloc+0x20d/frame 0xfffffe102d8e8440 vm_object_terminate() at vm_object_terminate+0x2a5/frame 0xfffffe102d8e8490 vm_object_deallocate() at vm_object_deallocate+0x83b/frame 0xfffffe102d8e8500 vm_map_entry_deallocate() at vm_map_entry_deallocate+0x2f/frame 0xfffffe102d8e8530 vm_map_process_deferred() at vm_map_process_deferred+0x172/frame 0xfffffe102d8e8570 _vm_map_unlock() at _vm_map_unlock+0x7a/frame 0xfffffe102d8e85a0 vm_map_remove() at vm_map_remove+0xbe/frame 0xfffffe102d8e85e0 vmspace_dofree() at vmspace_dofree+0x3f/frame 0xfffffe102d8e8610 vmspace_exit() at vmspace_exit+0x154/frame 0xfffffe102d8e8650 exit1() at exit1+0x5ad/frame 0xfffffe102d8e86c0 sigexit() at sigexit+0xdaf/frame 0xfffffe102d8e89a0 postsig() at postsig+0x336/frame 0xfffffe102d8e8a70 ast() at ast+0x4c7/frame 0xfffffe102d8e8ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe320 Tracing command sort pid 2334 tid 100216 td 0xfffff8001c9d25a0 (CPU 2) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0f87b7fdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0f87b7fe10 trap() at trap+0x48/frame 0xfffffe0f87b7ff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0f87b7ff20 --- trap 0x13, rip = 0xffffffff80c1a052, rsp = 0xfffffe102d8e3220, rbp = 0xfffffe102d8e3230 --- lock_delay() at lock_delay+0x42/frame 0xfffffe102d8e3230 __mtx_lock_sleep() at __mtx_lock_sleep+0xe8/frame 0xfffffe102d8e32c0 __mtx_lock_flags() at __mtx_lock_flags+0xee/frame 0xfffffe102d8e3310 uma_dbg_free() at uma_dbg_free+0x54/frame 0xfffffe102d8e3340 uma_zfree_arg() at uma_zfree_arg+0x141/frame 0xfffffe102d8e33a0 uma_zfree() at uma_zfree+0x29/frame 0xfffffe102d8e33d0 swp_pager_meta_free_all() at swp_pager_meta_free_all+0x117/frame 0xfffffe102d8e3410 swap_pager_dealloc() at swap_pager_dealloc+0x20d/frame 0xfffffe102d8e3440 vm_object_terminate() at vm_object_terminate+0x2a5/frame 0xfffffe102d8e3490 vm_object_deallocate() at vm_object_deallocate+0x83b/frame 0xfffffe102d8e3500 vm_map_entry_deallocate() at vm_map_entry_deallocate+0x2f/frame 0xfffffe102d8e3530 vm_map_process_deferred() at vm_map_process_deferred+0x172/frame 0xfffffe102d8e3570 _vm_map_unlock() at _vm_map_unlock+0x7a/frame 0xfffffe102d8e35a0 vm_map_remove() at vm_map_remove+0xbe/frame 0xfffffe102d8e35e0 vmspace_dofree() at vmspace_dofree+0x3f/frame 0xfffffe102d8e3610 vmspace_exit() at vmspace_exit+0x154/frame 0xfffffe102d8e3650 exit1() at exit1+0x5ad/frame 0xfffffe102d8e36c0 sigexit() at sigexit+0xdaf/frame 0xfffffe102d8e39a0 postsig() at postsig+0x336/frame 0xfffffe102d8e3a70 ast() at ast+0x4c7/frame 0xfffffe102d8e3ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe320 Tracing command sh pid 2331 tid 100168 td 0xfffff8001c9d35a0 sched_switch() at sched_switch+0x713/frame 0xfffffe102b7a3570 mi_switch() at mi_switch+0x174/frame 0xfffffe102b7a35a0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe102b7a35e0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe102b7a3640 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe102b7a3670 _sleep() at _sleep+0x2d0/frame 0xfffffe102b7a3710 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe102b7a37a0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe102b7a3990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe102b7a3ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe102b7a3ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8004059ea, rsp = 0x7fffffffe718, rbp = 0x7fffffffe7d0 --- Tracing command csh pid 2326 tid 100202 td 0xfffff8001c62d000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe102d8e7890 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe102d8e78a0 trap() at trap+0x5b/frame 0xfffffe102d8e79b0 calltrap() at calltrap+0x8/frame 0xfffffe102d8e79b0 --- trap 0xc, rip = 0xffffffff810809b6, rsp = 0xfffffe102d8e7a80, rbp = 0xfffffe102d8e7a90 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe102d8e7a90 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe102d8e7b30 db_command() at db_command+0x279/frame 0xfffffe102d8e7c00 db_script_exec() at db_script_exec+0x188/frame 0xfffffe102d8e7ca0 db_command() at db_command+0x279/frame 0xfffffe102d8e7d70 db_command_loop() at db_command_loop+0x64/frame 0xfffffe102d8e7d80 db_trap() at db_trap+0xef/frame 0xfffffe102d8e7e10 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe102d8e7e90 trap() at trap+0x811/frame 0xfffffe102d8e7fa0 calltrap() at calltrap+0x8/frame 0xfffffe102d8e7fa0 --- trap 0x3, rip = 0xffffffff80c18a0b, rsp = 0xfffffe102d8e8070, rbp = 0xfffffe102d8e8080 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe102d8e8080 vpanic() at vpanic+0x1ba/frame 0xfffffe102d8e80d0 panic() at panic+0x43/frame 0xfffffe102d8e8130 blst_leaf_free() at blst_leaf_free+0x7c/frame 0xfffffe102d8e8160 blst_meta_free() at blst_meta_free+0x44/frame 0xfffffe102d8e81c0 blst_meta_free() at blst_meta_free+0x158/frame 0xfffffe102d8e8220 blst_meta_free() at blst_meta_free+0x158/frame 0xfffffe102d8e8280 blst_meta_free() at blst_meta_free+0x158/frame 0xfffffe102d8e82e0 blst_meta_free() at blst_meta_free+0x158/frame 0xfffffe102d8e8340 blist_free() at blist_free+0xa1/frame 0xfffffe102d8e8370 swp_pager_freeswapspace() at swp_pager_freeswapspace+0xb0/frame 0xfffffe102d8e83a0 swp_pager_update_freerange() at swp_pager_update_freerange+0x52/frame 0xfffffe102d8e83d0 swp_pager_meta_free_all() at swp_pager_meta_free_all+0xdc/frame 0xfffffe102d8e8410 swap_pager_dealloc() at swap_pager_dealloc+0x20d/frame 0xfffffe102d8e8440 vm_object_terminate() at vm_object_terminate+0x2a5/frame 0xfffffe102d8e8490 vm_object_deallocate() at vm_object_deallocate+0x83b/frame 0xfffffe102d8e8500 vm_map_entry_deallocate() at vm_map_entry_deallocate+0x2f/frame 0xfffffe102d8e8530 vm_map_process_deferred() at vm_map_process_deferred+0x172/frame 0xfffffe102d8e8570 _vm_map_unlock() at _vm_map_unlock+0x7a/frame 0xfffffe102d8e85a0 vm_map_remove() at vm_map_remove+0xbe/frame 0xfffffe102d8e85e0 vmspace_dofree() at vmspace_dofree+0x3f/frame 0xfffffe102d8e8610 vmspace_exit() at vmspace_exit+0x154/frame 0xfffffe102d8e8650 exit1() at exit1+0x5ad/frame 0xfffffe102d8e86c0 sigexit() at sigexit+0xdaf/frame 0xfffffe102d8e89a0 postsig() at postsig+0x336/frame 0xfffffe102d8e8a70 ast() at ast+0x4c7/frame 0xfffffe102d8e8ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe320 Tracing command login pid 2325 tid 100214 td 0xfffff8022fa0c5a0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe102d8e7890 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe102d8e78a0 trap() at trap+0x5b/frame 0xfffffe102d8e79b0 calltrap() at calltrap+0x8/frame 0xfffffe102d8e79b0 --- trap 0xc, rip = 0xffffffff810809b6, rsp = 0xfffffe102d8e7a80, rbp = 0xfffffe102d8e7a90 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe102d8e7a90 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe102d8e7b30 db_command() at db_command+0x279/frame 0xfffffe102d8e7c00 db_script_exec() at db_script_exec+0x188/frame 0xfffffe102d8e7ca0 db_command() at db_command+0x279/frame 0xfffffe102d8e7d70 db_command_loop() at db_command_loop+0x64/frame 0xfffffe102d8e7d80 db_trap() at db_trap+0xef/frame 0xfffffe102d8e7e10 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe102d8e7e90 trap() at trap+0x811/frame 0xfffffe102d8e7fa0 calltrap() at calltrap+0x8/frame 0xfffffe102d8e7fa0 --- trap 0x3, rip = 0xffffffff80c18a0b, rsp = 0xfffffe102d8e8070, rbp = 0xfffffe102d8e8080 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe102d8e8080 vpanic() at vpanic+0x1ba/frame 0xfffffe102d8e80d0 panic() at panic+0x43/frame 0xfffffe102d8e8130 blst_leaf_free() at blst_leaf_free+0x7c/frame 0xfffffe102d8e8160 blst_meta_free() at blst_meta_free+0x44/frame 0xfffffe102d8e81c0 blst_meta_free() at blst_meta_free+0x158/frame 0xfffffe102d8e8220 blst_meta_free() at blst_meta_free+0x158/frame 0xfffffe102d8e8280 blst_meta_free() at blst_meta_free+0x158/frame 0xfffffe102d8e82e0 blst_meta_free() at blst_meta_free+0x158/frame 0xfffffe102d8e8340 blist_free() at blist_free+0xa1/frame 0xfffffe102d8e8370 swp_pager_freeswapspace() at swp_pager_freeswapspace+0xb0/frame 0xfffffe102d8e83a0 swp_pager_update_freerange() at swp_pager_update_freerange+0x52/frame 0xfffffe102d8e83d0 swp_pager_meta_free_all() at swp_pager_meta_free_all+0xdc/frame 0xfffffe102d8e8410 swap_pager_dealloc() at swap_pager_dealloc+0x20d/frame 0xfffffe102d8e8440 vm_object_terminate() at vm_object_terminate+0x2a5/frame 0xfffffe102d8e8490 vm_object_deallocate() at vm_object_deallocate+0x83b/frame 0xfffffe102d8e8500 vm_map_entry_deallocate() at vm_map_entry_deallocate+0x2f/frame 0xfffffe102d8e8530 vm_map_process_deferred() at vm_map_process_deferred+0x172/frame 0xfffffe102d8e8570 _vm_map_unlock() at _vm_map_unlock+0x7a/frame 0xfffffe102d8e85a0 vm_map_remove() at vm_map_remove+0xbe/frame 0xfffffe102d8e85e0 vmspace_dofree() at vmspace_dofree+0x3f/frame 0xfffffe102d8e8610 vmspace_exit() at vmspace_exit+0x154/frame 0xfffffe102d8e8650 exit1() at exit1+0x5ad/frame 0xfffffe102d8e86c0 sigexit() at sigexit+0xdaf/frame 0xfffffe102d8e89a0 postsig() at postsig+0x336/frame 0xfffffe102d8e8a70 ast() at ast+0x4c7/frame 0xfffffe102d8e8ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe320 Tracing command getty pid 2324 tid 100213 td 0xfffff8022fa0d000 sched_switch() at sched_switch+0x713/frame 0xfffffe102d8d4630 mi_switch() at mi_switch+0x174/frame 0xfffffe102d8d4660 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe102d8d46a0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe102d8d4700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe102d8d4730 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe102d8d4790 tty_wait() at tty_wait+0x42/frame 0xfffffe102d8d47c0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe102d8d4820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe102d8d4850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe102d8d48b0 dofileread() at dofileread+0x81/frame 0xfffffe102d8d4900 kern_readv() at kern_readv+0x4a/frame 0xfffffe102d8d4940 sys_read() at sys_read+0x84/frame 0xfffffe102d8d4990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe102d8d4ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe102d8d4ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043122a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2323 tid 100212 td 0xfffff8022fa0d5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe102d8cf630 mi_switch() at mi_switch+0x174/frame 0xfffffe102d8cf660 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe102d8cf6a0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe102d8cf700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe102d8cf730 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe102d8cf790 tty_wait() at tty_wait+0x42/frame 0xfffffe102d8cf7c0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe102d8cf820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe102d8cf850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe102d8cf8b0 dofileread() at dofileread+0x81/frame 0xfffffe102d8cf900 kern_readv() at kern_readv+0x4a/frame 0xfffffe102d8cf940 sys_read() at sys_read+0x84/frame 0xfffffe102d8cf990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe102d8cfab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe102d8cfab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043122a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2322 tid 100204 td 0xfffff8000f8975a0 sched_switch() at sched_switch+0x713/frame 0xfffffe102d8a7630 mi_switch() at mi_switch+0x174/frame 0xfffffe102d8a7660 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe102d8a76a0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe102d8a7700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe102d8a7730 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe102d8a7790 tty_wait() at tty_wait+0x42/frame 0xfffffe102d8a77c0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe102d8a7820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe102d8a7850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe102d8a78b0 dofileread() at dofileread+0x81/frame 0xfffffe102d8a7900 kern_readv() at kern_readv+0x4a/frame 0xfffffe102d8a7940 sys_read() at sys_read+0x84/frame 0xfffffe102d8a7990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe102d8a7ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe102d8a7ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043122a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2321 tid 100209 td 0xfffff8022fa0f000 sched_switch() at sched_switch+0x713/frame 0xfffffe102d8c0630 mi_switch() at mi_switch+0x174/frame 0xfffffe102d8c0660 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe102d8c06a0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe102d8c0700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe102d8c0730 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe102d8c0790 tty_wait() at tty_wait+0x42/frame 0xfffffe102d8c07c0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe102d8c0820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe102d8c0850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe102d8c08b0 dofileread() at dofileread+0x81/frame 0xfffffe102d8c0900 kern_readv() at kern_readv+0x4a/frame 0xfffffe102d8c0940 sys_read() at sys_read+0x84/frame 0xfffffe102d8c0990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe102d8c0ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe102d8c0ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043122a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2320 tid 100210 td 0xfffff8022fa0e5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe102d8c5630 mi_switch() at mi_switch+0x174/frame 0xfffffe102d8c5660 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe102d8c56a0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe102d8c5700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe102d8c5730 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe102d8c5790 tty_wait() at tty_wait+0x42/frame 0xfffffe102d8c57c0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe102d8c5820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe102d8c5850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe102d8c58b0 dofileread() at dofileread+0x81/frame 0xfffffe102d8c5900 kern_readv() at kern_readv+0x4a/frame 0xfffffe102d8c5940 sys_read() at sys_read+0x84/frame 0xfffffe102d8c5990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe102d8c5ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe102d8c5ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043122a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2319 tid 100211 td 0xfffff8022fa0e000 sched_switch() at sched_switch+0x713/frame 0xfffffe102d8ca630 mi_switch() at mi_switch+0x174/frame 0xfffffe102d8ca660 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe102d8ca6a0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe102d8ca700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe102d8ca730 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe102d8ca790 tty_wait() at tty_wait+0x42/frame 0xfffffe102d8ca7c0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe102d8ca820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe102d8ca850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe102d8ca8b0 dofileread() at dofileread+0x81/frame 0xfffffe102d8ca900 kern_readv() at kern_readv+0x4a/frame 0xfffffe102d8ca940 sys_read() at sys_read+0x84/frame 0xfffffe102d8ca990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe102d8caab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe102d8caab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043122a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2318 tid 100170 td 0xfffff8001c3e45a0 sched_switch() at sched_switch+0x713/frame 0xfffffe102b7ad630 mi_switch() at mi_switch+0x174/frame 0xfffffe102b7ad660 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe102b7ad6a0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe102b7ad700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe102b7ad730 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe102b7ad790 tty_wait() at tty_wait+0x42/frame 0xfffffe102b7ad7c0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe102b7ad820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe102b7ad850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe102b7ad8b0 dofileread() at dofileread+0x81/frame 0xfffffe102b7ad900 kern_readv() at kern_readv+0x4a/frame 0xfffffe102b7ad940 sys_read() at sys_read+0x84/frame 0xfffffe102b7ad990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe102b7adab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe102b7adab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043122a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2317 tid 100167 td 0xfffff8000fc27000 sched_switch() at sched_switch+0x713/frame 0xfffffe102b79e630 mi_switch() at mi_switch+0x174/frame 0xfffffe102b79e660 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe102b79e6a0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe102b79e700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe102b79e730 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe102b79e790 tty_wait() at tty_wait+0x42/frame 0xfffffe102b79e7c0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe102b79e820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe102b79e850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe102b79e8b0 dofileread() at dofileread+0x81/frame 0xfffffe102b79e900 kern_readv() at kern_readv+0x4a/frame 0xfffffe102b79e940 sys_read() at sys_read+0x84/frame 0xfffffe102b79e990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe102b79eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe102b79eab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043122a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2316 tid 100142 td 0xfffff8000fe3d5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe1024df3630 mi_switch() at mi_switch+0x174/frame 0xfffffe1024df3660 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe1024df36a0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe1024df3700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe1024df3730 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe1024df3790 tty_wait() at tty_wait+0x42/frame 0xfffffe1024df37c0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe1024df3820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe1024df3850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe1024df38b0 dofileread() at dofileread+0x81/frame 0xfffffe1024df3900 kern_readv() at kern_readv+0x4a/frame 0xfffffe1024df3940 sys_read() at sys_read+0x84/frame 0xfffffe1024df3990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe1024df3ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe1024df3ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043122a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command cron pid 2270 tid 100208 td 0xfffff8001c9d3000 sched_switch() at sched_switch+0x713/frame 0xfffffe102d8bb720 mi_switch() at mi_switch+0x174/frame 0xfffffe102d8bb750 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe102d8bb790 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe102d8bb7f0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe102d8bb830 _sleep() at _sleep+0x265/frame 0xfffffe102d8bb8d0 kern_clock_nanosleep() at kern_clock_nanosleep+0x206/frame 0xfffffe102d8bb950 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe102d8bb990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe102d8bbab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe102d8bbab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003d4b6a, rsp = 0x7fffffffead8, rbp = 0x7fffffffecc0 --- Tracing command sshd pid 2266 tid 100199 td 0xfffff8001c62e000 sched_switch() at sched_switch+0x713/frame 0xfffffe102d8935d0 mi_switch() at mi_switch+0x174/frame 0xfffffe102d893600 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe102d893640 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe102d8936a0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe102d8936d0 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe102d893730 seltdwait() at seltdwait+0x8d/frame 0xfffffe102d893770 kern_select() at kern_select+0x953/frame 0xfffffe102d893950 sys_select() at sys_select+0x56/frame 0xfffffe102d893990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe102d893ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe102d893ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80090220a, rsp = 0x7fffffffe668, rbp = 0x7fffffffe6a0 --- Tracing command ntpd pid 2237 tid 100203 td 0xfffff8000fe3c5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe102d8a25d0 mi_switch() at mi_switch+0x174/frame 0xfffffe102d8a2600 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe102d8a2640 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe102d8a26a0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe102d8a26d0 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe102d8a2730 seltdwait() at seltdwait+0x8d/frame 0xfffffe102d8a2770 kern_select() at kern_select+0x953/frame 0xfffffe102d8a2950 sys_select() at sys_select+0x56/frame 0xfffffe102d8a2990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe102d8a2ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe102d8a2ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80082e20a, rsp = 0x7fffffffdf18, rbp = 0x7fffffffdf50 --- Tracing command ntpd pid 2237 tid 100221 td 0xfffff8000fe3a000 sched_switch() at sched_switch+0x713/frame 0xfffffe102d8de6d0 mi_switch() at mi_switch+0x174/frame 0xfffffe102d8de700 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe102d8de740 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe102d8de7a0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe102d8de7d0 _sleep() at _sleep+0x2d0/frame 0xfffffe102d8de870 umtxq_sleep() at umtxq_sleep+0x153/frame 0xfffffe102d8de8d0 do_sem2_wait() at do_sem2_wait+0x26d/frame 0xfffffe102d8de940 __umtx_op_sem2_wait() at __umtx_op_sem2_wait+0x76/frame 0xfffffe102d8de990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe102d8deab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe102d8deab0 --- syscall (454, FreeBSD ELF64, sys__umtx_op), rip = 0x80072258a, rsp = 0x7fffdffbced8, rbp = 0x7fffdffbcf50 --- Tracing command rpc.lockd pid 2176 tid 100169 td 0xfffff8000fc265a0 sched_switch() at sched_switch+0x713/frame 0xfffffe102b7a84f0 mi_switch() at mi_switch+0x174/frame 0xfffffe102b7a8520 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe102b7a8560 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe102b7a85c0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe102b7a8600 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x185/frame 0xfffffe102b7a8670 svc_run_internal() at svc_run_internal+0xa77/frame 0xfffffe102b7a87b0 svc_run() at svc_run+0x24e/frame 0xfffffe102b7a8810 sys_nlm_syscall() at sys_nlm_syscall+0x77b/frame 0xfffffe102b7a8990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe102b7a8ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe102b7a8ab0 --- syscall (154, FreeBSD ELF64, sys_nlm_syscall), rip = 0x8002f062a, rsp = 0x7fffffffec08, rbp = 0x7fffffffecc0 --- Tracing command rpc.statd pid 2173 tid 100148 td 0xfffff8000fe3d000 sched_switch() at sched_switch+0x713/frame 0xfffffe102b7335b0 mi_switch() at mi_switch+0x174/frame 0xfffffe102b7335e0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe102b733620 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe102b733680 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe102b7336c0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x185/frame 0xfffffe102b733730 seltdwait() at seltdwait+0x6b/frame 0xfffffe102b733770 kern_select() at kern_select+0x953/frame 0xfffffe102b733950 sys_select() at sys_select+0x56/frame 0xfffffe102b733990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe102b733ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe102b733ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80042520a, rsp = 0x7fffffffea98, rbp = 0x7fffffffebe0 --- Tracing command watchdogd pid 2127 tid 100198 td 0xfffff8001c62e5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe102d88e720 mi_switch() at mi_switch+0x174/frame 0xfffffe102d88e750 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe102d88e790 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe102d88e7f0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe102d88e830 _sleep() at _sleep+0x265/frame 0xfffffe102d88e8d0 kern_clock_nanosleep() at kern_clock_nanosleep+0x206/frame 0xfffffe102d88e950 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe102d88e990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe102d88eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe102d88eab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003bdb6a, rsp = 0x7fffffffea98, rbp = 0x7fffffffeae0 --- Tracing command rpcbind pid 2048 tid 100196 td 0xfffff8000fc26000 sched_switch() at sched_switch+0x713/frame 0xfffffe102d86c630 mi_switch() at mi_switch+0x174/frame 0xfffffe102d86c660 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe102d86c6a0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe102d86c700 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe102d86c740 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x185/frame 0xfffffe102d86c7b0 seltdwait() at seltdwait+0x6b/frame 0xfffffe102d86c7f0 kern_poll() at kern_poll+0x448/frame 0xfffffe102d86c970 sys_poll() at sys_poll+0x50/frame 0xfffffe102d86c990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe102d86cab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe102d86cab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003cc35a, rsp = 0x7fffffffca38, rbp = 0x7fffffffec50 --- Tracing command syslogd pid 2038 tid 100163 td 0xfffff8001c5e4000 sched_switch() at sched_switch+0x713/frame 0xfffffe102b77e5d0 mi_switch() at mi_switch+0x174/frame 0xfffffe102b77e600 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe102b77e640 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe102b77e6a0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe102b77e6d0 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe102b77e730 seltdwait() at seltdwait+0x8d/frame 0xfffffe102b77e770 kern_select() at kern_select+0x953/frame 0xfffffe102b77e950 sys_select() at sys_select+0x56/frame 0xfffffe102b77e990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe102b77eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe102b77eab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80043620a, rsp = 0x7fffffffe748, rbp = 0x7fffffffecc0 --- Tracing command devd pid 1967 tid 100154 td 0xfffff8000f7ba000 sched_switch() at sched_switch+0x713/frame 0xfffffe102b7515b0 mi_switch() at mi_switch+0x174/frame 0xfffffe102b7515e0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe102b751620 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe102b751680 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe102b7516c0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x185/frame 0xfffffe102b751730 seltdwait() at seltdwait+0x6b/frame 0xfffffe102b751770 kern_select() at kern_select+0x953/frame 0xfffffe102b751950 sys_select() at sys_select+0x56/frame 0xfffffe102b751990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe102b751ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe102b751ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x2f530a, rsp = 0x7fffffffcb48, rbp = 0x7fffffffece0 --- Tracing command dhclient pid 1962 tid 100144 td 0xfffff8000ff08000 sched_switch() at sched_switch+0x713/frame 0xfffffe1024dfd630 mi_switch() at mi_switch+0x174/frame 0xfffffe1024dfd660 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe1024dfd6a0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe1024dfd700 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe1024dfd740 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x185/frame 0xfffffe1024dfd7b0 seltdwait() at seltdwait+0x6b/frame 0xfffffe1024dfd7f0 kern_poll() at kern_poll+0x448/frame 0xfffffe1024dfd970 sys_poll() at sys_poll+0x50/frame 0xfffffe1024dfd990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe1024dfdab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe1024dfdab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003ef35a, rsp = 0x7fffffffec28, rbp = 0x7fffffffec60 --- Tracing command dhclient pid 1918 tid 100152 td 0xfffff8000f7ba5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe102b747650 mi_switch() at mi_switch+0x174/frame 0xfffffe102b747680 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe102b7476c0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe102b747720 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe102b747750 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe102b7477b0 seltdwait() at seltdwait+0x8d/frame 0xfffffe102b7477f0 kern_poll() at kern_poll+0x448/frame 0xfffffe102b747970 sys_poll() at sys_poll+0x50/frame 0xfffffe102b747990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe102b747ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe102b747ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003ef35a, rsp = 0x7fffffffec38, rbp = 0x7fffffffec60 --- Tracing command dhclient pid 1915 tid 100162 td 0xfffff8001c5f0000 sched_switch() at sched_switch+0x713/frame 0xfffffe102b7795d0 mi_switch() at mi_switch+0x174/frame 0xfffffe102b779600 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe102b779640 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe102b7796a0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe102b7796d0 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe102b779730 seltdwait() at seltdwait+0x8d/frame 0xfffffe102b779770 kern_select() at kern_select+0x953/frame 0xfffffe102b779950 sys_select() at sys_select+0x56/frame 0xfffffe102b779990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe102b779ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe102b779ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80044d20a, rsp = 0x7fffffffe9e8, rbp = 0x7fffffffeaa0 --- Tracing command syncer pid 34 tid 100141 td 0xfffff8000fc285a0 sched_switch() at sched_switch+0x713/frame 0xfffffe1024dee8c0 mi_switch() at mi_switch+0x174/frame 0xfffffe1024dee8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe1024dee930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe1024dee970 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x185/frame 0xfffffe1024dee9e0 sched_sync() at sched_sync+0x609/frame 0xfffffe1024deea70 fork_exit() at fork_exit+0x84/frame 0xfffffe1024deeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1024deeab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vnlru pid 33 tid 100140 td 0xfffff8000fc29000 sched_switch() at sched_switch+0x713/frame 0xfffffe1024de9890 mi_switch() at mi_switch+0x174/frame 0xfffffe1024de98c0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe1024de9900 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe1024de9940 _sleep() at _sleep+0x279/frame 0xfffffe1024de99e0 vnlru_proc() at vnlru_proc+0xa4/frame 0xfffffe1024de9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1024de9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1024de9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100130 td 0xfffff8000fc295a0 sched_switch() at sched_switch+0x713/frame 0xfffffe101bc718d0 mi_switch() at mi_switch+0x174/frame 0xfffffe101bc71900 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe101bc71940 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe101bc71980 _sleep() at _sleep+0x279/frame 0xfffffe101bc71a20 buf_daemon() at buf_daemon+0xc8/frame 0xfffffe101bc71a70 fork_exit() at fork_exit+0x84/frame 0xfffffe101bc71ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe101bc71ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100133 td 0xfffff8000fc64000 sched_switch() at sched_switch+0x713/frame 0xfffffe10244e48c0 mi_switch() at mi_switch+0x174/frame 0xfffffe10244e48f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe10244e4930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe10244e4970 _sleep() at _sleep+0x279/frame 0xfffffe10244e4a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe10244e4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe10244e4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe10244e4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100134 td 0xfffff8000fc625a0 sched_switch() at sched_switch+0x713/frame 0xfffffe10245e98c0 mi_switch() at mi_switch+0x174/frame 0xfffffe10245e98f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe10245e9930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe10245e9970 _sleep() at _sleep+0x279/frame 0xfffffe10245e9a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe10245e9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe10245e9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe10245e9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100135 td 0xfffff8000fc62000 sched_switch() at sched_switch+0x713/frame 0xfffffe10245ee8c0 mi_switch() at mi_switch+0x174/frame 0xfffffe10245ee8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe10245ee930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe10245ee970 _sleep() at _sleep+0x279/frame 0xfffffe10245eea10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe10245eea70 fork_exit() at fork_exit+0x84/frame 0xfffffe10245eeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe10245eeab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100136 td 0xfffff8000fc605a0 sched_switch() at sched_switch+0x713/frame 0xfffffe10245f38c0 mi_switch() at mi_switch+0x174/frame 0xfffffe10245f38f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe10245f3930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe10245f3970 _sleep() at _sleep+0x279/frame 0xfffffe10245f3a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe10245f3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe10245f3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe10245f3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100137 td 0xfffff8000fc60000 sched_switch() at sched_switch+0x713/frame 0xfffffe10245f88c0 mi_switch() at mi_switch+0x174/frame 0xfffffe10245f88f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe10245f8930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe10245f8970 _sleep() at _sleep+0x279/frame 0xfffffe10245f8a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe10245f8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe10245f8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe10245f8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100138 td 0xfffff8000fc5e5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe10245fd8c0 mi_switch() at mi_switch+0x174/frame 0xfffffe10245fd8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe10245fd930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe10245fd970 _sleep() at _sleep+0x279/frame 0xfffffe10245fda10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe10245fda70 fork_exit() at fork_exit+0x84/frame 0xfffffe10245fdab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe10245fdab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100139 td 0xfffff8000fc5e000 sched_switch() at sched_switch+0x713/frame 0xfffffe1024c848c0 mi_switch() at mi_switch+0x174/frame 0xfffffe1024c848f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe1024c84930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe1024c84970 _sleep() at _sleep+0x279/frame 0xfffffe1024c84a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe1024c84a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1024c84ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1024c84ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100151 td 0xfffff8000b7105a0 sched_switch() at sched_switch+0x713/frame 0xfffffe102b7428f0 mi_switch() at mi_switch+0x174/frame 0xfffffe102b742920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe102b742960 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe102b7429a0 _sleep() at _sleep+0x279/frame 0xfffffe102b742a40 softdep_flush() at softdep_flush+0x17f/frame 0xfffffe102b742a70 fork_exit() at fork_exit+0x84/frame 0xfffffe102b742ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe102b742ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100201 td 0xfffff8001c323000 sched_switch() at sched_switch+0x713/frame 0xfffffe102b7568f0 mi_switch() at mi_switch+0x174/frame 0xfffffe102b756920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe102b756960 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe102b7569a0 _sleep() at _sleep+0x279/frame 0xfffffe102b756a40 softdep_flush() at softdep_flush+0x17f/frame 0xfffffe102b756a70 fork_exit() at fork_exit+0x84/frame 0xfffffe102b756ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe102b756ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vmdaemon pid 31 tid 100129 td 0xfffff8000f88a000 sched_switch() at sched_switch+0x713/frame 0xfffffe101bc6c940 mi_switch() at mi_switch+0x174/frame 0xfffffe101bc6c970 sched_bind() at sched_bind+0xdb/frame 0xfffffe101bc6c9a0 vm_page_drain_pqbatch() at vm_page_drain_pqbatch+0x61/frame 0xfffffe101bc6ca00 vm_daemon() at vm_daemon+0xb00/frame 0xfffffe101bc6ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe101bc6cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe101bc6cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100128 td 0xfffff8000f88a5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe101bc67560 mi_switch() at mi_switch+0x174/frame 0xfffffe101bc67590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe101bc675d0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe101bc67610 _sleep() at _sleep+0x279/frame 0xfffffe101bc676b0 vm_pageout_worker() at vm_pageout_worker+0x25b/frame 0xfffffe101bc67a30 vm_pageout() at vm_pageout+0x156/frame 0xfffffe101bc67a70 fork_exit() at fork_exit+0x84/frame 0xfffffe101bc67ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe101bc67ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100131 td 0xfffff8000b7115a0 sched_switch() at sched_switch+0x713/frame 0xfffffe101bc766b0 mi_switch() at mi_switch+0x174/frame 0xfffffe101bc766e0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe101bc76720 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe101bc76750 _sleep() at _sleep+0x2da/frame 0xfffffe101bc767f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0xbcb/frame 0xfffffe101bc76a70 fork_exit() at fork_exit+0x84/frame 0xfffffe101bc76ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe101bc76ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100132 td 0xfffff8000b711000 sched_switch() at sched_switch+0x713/frame 0xfffffe101bdfb8f0 mi_switch() at mi_switch+0x174/frame 0xfffffe101bdfb920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe101bdfb960 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe101bdfb9a0 _sleep() at _sleep+0x279/frame 0xfffffe101bdfba40 uma_reclaim_worker() at uma_reclaim_worker+0xda/frame 0xfffffe101bdfba70 fork_exit() at fork_exit+0x84/frame 0xfffffe101bdfbab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe101bdfbab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon1 pid 29 tid 100127 td 0xfffff8000f7cb000 sched_switch() at sched_switch+0x713/frame 0xfffffe101bc568b0 mi_switch() at mi_switch+0x174/frame 0xfffffe101bc568e0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe101bc56920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe101bc56950 _sleep() at _sleep+0x2da/frame 0xfffffe101bc569f0 enc_daemon() at enc_daemon+0x1cf/frame 0xfffffe101bc56a70 fork_exit() at fork_exit+0x84/frame 0xfffffe101bc56ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe101bc56ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon0 pid 28 tid 100126 td 0xfffff8000f7cb5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe101bc518b0 mi_switch() at mi_switch+0x174/frame 0xfffffe101bc518e0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe101bc51920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe101bc51950 _sleep() at _sleep+0x2da/frame 0xfffffe101bc519f0 enc_daemon() at enc_daemon+0x1cf/frame 0xfffffe101bc51a70 fork_exit() at fork_exit+0x84/frame 0xfffffe101bc51ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe101bc51ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command rand_harvestq pid 27 tid 100120 td 0xfffff8000f8965a0 sched_switch() at sched_switch+0x713/frame 0xfffffe101bc338c0 mi_switch() at mi_switch+0x174/frame 0xfffffe101bc338f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe101bc33930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe101bc33970 _sleep() at _sleep+0x279/frame 0xfffffe101bc33a10 random_kthread() at random_kthread+0x26a/frame 0xfffffe101bc33a70 fork_exit() at fork_exit+0x84/frame 0xfffffe101bc33ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe101bc33ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sctp_iterator pid 26 tid 100119 td 0xfffff8000f897000 sched_switch() at sched_switch+0x713/frame 0xfffffe101bc22910 mi_switch() at mi_switch+0x174/frame 0xfffffe101bc22940 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe101bc22980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe101bc229b0 _sleep() at _sleep+0x2da/frame 0xfffffe101bc22a50 sctp_iterator_thread() at sctp_iterator_thread+0x59/frame 0xfffffe101bc22a70 fork_exit() at fork_exit+0x84/frame 0xfffffe101bc22ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe101bc22ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod4 pid 25 tid 100118 td 0xfffff8000f7cc000 sched_switch() at sched_switch+0x713/frame 0xfffffe101bc1d8e0 mi_switch() at mi_switch+0x174/frame 0xfffffe101bc1d910 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe101bc1d950 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe101bc1d990 _sleep() at _sleep+0x279/frame 0xfffffe101bc1da30 soaio_kproc_loop() at soaio_kproc_loop+0x170/frame 0xfffffe101bc1da70 fork_exit() at fork_exit+0x84/frame 0xfffffe101bc1dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe101bc1dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod3 pid 24 tid 100117 td 0xfffff8000f7cc5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe101bc188e0 mi_switch() at mi_switch+0x174/frame 0xfffffe101bc18910 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe101bc18950 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe101bc18990 _sleep() at _sleep+0x279/frame 0xfffffe101bc18a30 soaio_kproc_loop() at soaio_kproc_loop+0x170/frame 0xfffffe101bc18a70 fork_exit() at fork_exit+0x84/frame 0xfffffe101bc18ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe101bc18ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod2 pid 23 tid 100116 td 0xfffff8000f7cd000 sched_switch() at sched_switch+0x713/frame 0xfffffe101bc138e0 mi_switch() at mi_switch+0x174/frame 0xfffffe101bc13910 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe101bc13950 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe101bc13990 _sleep() at _sleep+0x279/frame 0xfffffe101bc13a30 soaio_kproc_loop() at soaio_kproc_loop+0x170/frame 0xfffffe101bc13a70 fork_exit() at fork_exit+0x84/frame 0xfffffe101bc13ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe101bc13ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod1 pid 22 tid 100115 td 0xfffff8000f7cd5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe101bc0e8e0 mi_switch() at mi_switch+0x174/frame 0xfffffe101bc0e910 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe101bc0e950 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe101bc0e990 _sleep() at _sleep+0x279/frame 0xfffffe101bc0ea30 soaio_kproc_loop() at soaio_kproc_loop+0x170/frame 0xfffffe101bc0ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe101bc0eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe101bc0eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100096 td 0xfffff8000bae4000 sched_switch() at sched_switch+0x713/frame 0xfffffe0000593930 mi_switch() at mi_switch+0x174/frame 0xfffffe0000593960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005939a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005939d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0000593a30 usb_process() at usb_process+0x13b/frame 0xfffffe0000593a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000593ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000593ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100097 td 0xfffff8000bae35a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0000598930 mi_switch() at mi_switch+0x174/frame 0xfffffe0000598960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005989a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005989d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0000598a30 usb_process() at usb_process+0x13b/frame 0xfffffe0000598a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000598ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000598ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100098 td 0xfffff8000bae3000 sched_switch() at sched_switch+0x713/frame 0xfffffe000059d930 mi_switch() at mi_switch+0x174/frame 0xfffffe000059d960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe000059d9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000059d9d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe000059da30 usb_process() at usb_process+0x13b/frame 0xfffffe000059da70 fork_exit() at fork_exit+0x84/frame 0xfffffe000059dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000059dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100099 td 0xfffff8000bae25a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00005a2930 mi_switch() at mi_switch+0x174/frame 0xfffffe00005a2960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005a29a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005a29d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe00005a2a30 usb_process() at usb_process+0x13b/frame 0xfffffe00005a2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005a2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005a2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100100 td 0xfffff8000bae2000 sched_switch() at sched_switch+0x713/frame 0xfffffe00005a7930 mi_switch() at mi_switch+0x174/frame 0xfffffe00005a7960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005a79a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005a79d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe00005a7a30 usb_process() at usb_process+0x13b/frame 0xfffffe00005a7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005a7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005a7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100102 td 0xfffff8000bada000 sched_switch() at sched_switch+0x713/frame 0xfffffe00005b1930 mi_switch() at mi_switch+0x174/frame 0xfffffe00005b1960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005b19a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005b19d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe00005b1a30 usb_process() at usb_process+0x13b/frame 0xfffffe00005b1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005b1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005b1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100103 td 0xfffff8000e07b5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00005b6930 mi_switch() at mi_switch+0x174/frame 0xfffffe00005b6960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005b69a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005b69d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe00005b6a30 usb_process() at usb_process+0x13b/frame 0xfffffe00005b6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005b6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005b6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100104 td 0xfffff8000e07b000 sched_switch() at sched_switch+0x713/frame 0xfffffe00005bb930 mi_switch() at mi_switch+0x174/frame 0xfffffe00005bb960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005bb9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005bb9d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe00005bba30 usb_process() at usb_process+0x13b/frame 0xfffffe00005bba70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005bbab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005bbab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100105 td 0xfffff8000e07a5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00005c0930 mi_switch() at mi_switch+0x174/frame 0xfffffe00005c0960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005c09a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005c09d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe00005c0a30 usb_process() at usb_process+0x13b/frame 0xfffffe00005c0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005c0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005c0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100106 td 0xfffff8000e07a000 sched_switch() at sched_switch+0x713/frame 0xfffffe00005c5930 mi_switch() at mi_switch+0x174/frame 0xfffffe00005c5960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005c59a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005c59d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe00005c5a30 usb_process() at usb_process+0x13b/frame 0xfffffe00005c5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005c5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005c5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100107 td 0xfffff8000e183000 sched_switch() at sched_switch+0x713/frame 0xfffffe00005e2930 mi_switch() at mi_switch+0x174/frame 0xfffffe00005e2960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005e29a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005e29d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe00005e2a30 usb_process() at usb_process+0x13b/frame 0xfffffe00005e2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005e2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005e2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100108 td 0xfffff8000e1825a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00005e7930 mi_switch() at mi_switch+0x174/frame 0xfffffe00005e7960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005e79a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005e79d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe00005e7a30 usb_process() at usb_process+0x13b/frame 0xfffffe00005e7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005e7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005e7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100109 td 0xfffff8000e182000 sched_switch() at sched_switch+0x713/frame 0xfffffe00005ec930 mi_switch() at mi_switch+0x174/frame 0xfffffe00005ec960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005ec9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005ec9d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe00005eca30 usb_process() at usb_process+0x13b/frame 0xfffffe00005eca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005ecab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005ecab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100110 td 0xfffff8000e1815a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00005f1930 mi_switch() at mi_switch+0x174/frame 0xfffffe00005f1960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005f19a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005f19d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe00005f1a30 usb_process() at usb_process+0x13b/frame 0xfffffe00005f1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005f1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005f1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100111 td 0xfffff8000e181000 sched_switch() at sched_switch+0x713/frame 0xfffffe00005f6930 mi_switch() at mi_switch+0x174/frame 0xfffffe00005f6960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005f69a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005f69d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe00005f6a30 usb_process() at usb_process+0x13b/frame 0xfffffe00005f6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005f6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005f6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100091 td 0xfffff8000b5a3000 sched_switch() at sched_switch+0x713/frame 0xfffffe000057a8e0 mi_switch() at mi_switch+0x174/frame 0xfffffe000057a910 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe000057a950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000057a980 _sleep() at _sleep+0x2da/frame 0xfffffe000057aa20 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe000057aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000057aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000057aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100092 td 0xfffff8000b7125a0 sched_switch() at sched_switch+0x713/frame 0xfffffe000057f8e0 mi_switch() at mi_switch+0x174/frame 0xfffffe000057f910 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe000057f950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000057f980 _sleep() at _sleep+0x2da/frame 0xfffffe000057fa20 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe000057fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000057fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000057fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100093 td 0xfffff8000b712000 sched_switch() at sched_switch+0x713/frame 0xfffffe00005848e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0000584910 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0000584950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000584980 _sleep() at _sleep+0x2da/frame 0xfffffe0000584a20 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe0000584a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000584ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000584ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100125 td 0xfffff8000f894000 sched_switch() at sched_switch+0x713/frame 0xfffffe101bc4c8d0 mi_switch() at mi_switch+0x174/frame 0xfffffe101bc4c900 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe101bc4c940 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe101bc4c970 _sleep() at _sleep+0x2da/frame 0xfffffe101bc4ca10 xpt_scanner_thread() at xpt_scanner_thread+0x93/frame 0xfffffe101bc4ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe101bc4cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe101bc4cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 11 pid 19 tid 100090 td 0xfffff8000b5a35a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00005758c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00005758f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0000575930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000575960 _sleep() at _sleep+0x2da/frame 0xfffffe0000575a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0000575a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000575ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000575ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 10 pid 18 tid 100089 td 0xfffff8000b5a4000 sched_switch() at sched_switch+0x713/frame 0xfffffe00005708c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00005708f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0000570930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000570960 _sleep() at _sleep+0x2da/frame 0xfffffe0000570a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0000570a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000570ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000570ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 9 pid 17 tid 100088 td 0xfffff8000b5a45a0 sched_switch() at sched_switch+0x713/frame 0xfffffe000056b8c0 mi_switch() at mi_switch+0x174/frame 0xfffffe000056b8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe000056b930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000056b960 _sleep() at _sleep+0x2da/frame 0xfffffe000056ba00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe000056ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe000056bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000056bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 8 pid 16 tid 100087 td 0xfffff8000b5a5000 sched_switch() at sched_switch+0x713/frame 0xfffffe00005668c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00005668f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0000566930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000566960 _sleep() at _sleep+0x2da/frame 0xfffffe0000566a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0000566a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000566ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000566ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 7 pid 15 tid 100086 td 0xfffff8000b5a55a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00005618c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00005618f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0000561930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000561960 _sleep() at _sleep+0x2da/frame 0xfffffe0000561a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0000561a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000561ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000561ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 6 pid 9 tid 100085 td 0xfffff8000b5a6000 sched_switch() at sched_switch+0x713/frame 0xfffffe000055c8c0 mi_switch() at mi_switch+0x174/frame 0xfffffe000055c8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe000055c930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000055c960 _sleep() at _sleep+0x2da/frame 0xfffffe000055ca00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe000055ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe000055cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000055cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 5 pid 8 tid 100084 td 0xfffff8000b5a65a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00005578c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00005578f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0000557930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000557960 _sleep() at _sleep+0x2da/frame 0xfffffe0000557a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0000557a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000557ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000557ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 4 pid 7 tid 100083 td 0xfffff8000b5a7000 sched_switch() at sched_switch+0x713/frame 0xfffffe00005528c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00005528f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0000552930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000552960 _sleep() at _sleep+0x2da/frame 0xfffffe0000552a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0000552a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000552ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000552ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 3 pid 6 tid 100082 td 0xfffff8000b5815a0 sched_switch() at sched_switch+0x713/frame 0xfffffe000054d8c0 mi_switch() at mi_switch+0x174/frame 0xfffffe000054d8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe000054d930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000054d960 _sleep() at _sleep+0x2da/frame 0xfffffe000054da00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe000054da70 fork_exit() at fork_exit+0x84/frame 0xfffffe000054dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000054dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 2 pid 5 tid 100081 td 0xfffff8000b593000 sched_switch() at sched_switch+0x713/frame 0xfffffe00005488c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00005488f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0000548930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000548960 _sleep() at _sleep+0x2da/frame 0xfffffe0000548a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0000548a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000548ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000548ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 1 pid 4 tid 100080 td 0xfffff8000b5935a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00005438c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00005438f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0000543930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000543960 _sleep() at _sleep+0x2da/frame 0xfffffe0000543a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0000543a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000543ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000543ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 0 pid 3 tid 100079 td 0xfffff8000b594000 sched_switch() at sched_switch+0x713/frame 0xfffffe000053e8c0 mi_switch() at mi_switch+0x174/frame 0xfffffe000053e8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe000053e930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000053e960 _sleep() at _sleep+0x2da/frame 0xfffffe000053ea00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe000053ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe000053eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000053eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 2 tid 100078 td 0xfffff8000b5945a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00005398f0 mi_switch() at mi_switch+0x174/frame 0xfffffe0000539920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0000539960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000539990 _sleep() at _sleep+0x2da/frame 0xfffffe0000539a30 crypto_proc() at crypto_proc+0x2c4/frame 0xfffffe0000539a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000539ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000539ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sequencer 00 pid 14 tid 100065 td 0xfffff8000b581000 sched_switch() at sched_switch+0x713/frame 0xfffffe00004f88f0 mi_switch() at mi_switch+0x174/frame 0xfffffe00004f8920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004f8960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004f8990 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe00004f89f0 seq_eventthread() at seq_eventthread+0xdc/frame 0xfffffe00004f8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004f8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004f8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100062 td 0xfffff8000b46b5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00004dd8f0 mi_switch() at mi_switch+0x174/frame 0xfffffe00004dd920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004dd960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004dd990 _sleep() at _sleep+0x2da/frame 0xfffffe00004dda30 g_run_events() at g_run_events+0x4f/frame 0xfffffe00004dda70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004ddab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004ddab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100063 td 0xfffff8000b46b000 sched_switch() at sched_switch+0x713/frame 0xfffffe00004e28f0 mi_switch() at mi_switch+0x174/frame 0xfffffe00004e2920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004e2960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004e2990 _sleep() at _sleep+0x2da/frame 0xfffffe00004e2a30 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe00004e2a60 g_up_procbody() at g_up_procbody+0x6d/frame 0xfffffe00004e2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004e2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004e2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100064 td 0xfffff8000b4645a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00004e78f0 mi_switch() at mi_switch+0x174/frame 0xfffffe00004e7920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004e7960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004e7990 _sleep() at _sleep+0x2da/frame 0xfffffe00004e7a30 g_io_schedule_down() at g_io_schedule_down+0x14c/frame 0xfffffe00004e7a60 g_down_procbody() at g_down_procbody+0x6d/frame 0xfffffe00004e7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004e7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004e7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100015 td 0xfffff8000b31b000 sched_switch() at sched_switch+0x713/frame 0xfffffe0ff775f9e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0ff775fa10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe0ff775fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0ff775fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0ff775fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100016 td 0xfffff8000b31a5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0ff77649e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0ff7764a10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe0ff7764a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0ff7764ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0ff7764ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100018 td 0xfffff8000b30d5a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100047 td 0xfffff8000b464000 sched_switch() at sched_switch+0x713/frame 0xfffffe000043e9e0 mi_switch() at mi_switch+0x174/frame 0xfffffe000043ea10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe000043ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe000043eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000043eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100048 td 0xfffff8000b4635a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100049 td 0xfffff8000b463000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100050 td 0xfffff8000b4625a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100051 td 0xfffff8000b462000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100052 td 0xfffff8000b4615a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100053 td 0xfffff8000b461000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100054 td 0xfffff8000b4575a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100055 td 0xfffff8000b457000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100056 td 0xfffff8000b46e5a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100057 td 0xfffff8000b46e000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100058 td 0xfffff8000b46d5a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100059 td 0xfffff8000b46d000 sched_switch() at sched_switch+0x713/frame 0xfffffe000047a9e0 mi_switch() at mi_switch+0x174/frame 0xfffffe000047aa10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe000047aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000047aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000047aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100060 td 0xfffff8000b46c5a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100094 td 0xfffff8000bae5000 sched_switch() at sched_switch+0x713/frame 0xfffffe00005899e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0000589a10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe0000589a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000589ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000589ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100095 td 0xfffff8000bae45a0 sched_switch() at sched_switch+0x713/frame 0xfffffe000058e9e0 mi_switch() at mi_switch+0x174/frame 0xfffffe000058ea10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe000058ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe000058eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000058eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100101 td 0xfffff8000bada5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00005ac9e0 mi_switch() at mi_switch+0x174/frame 0xfffffe00005aca10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe00005aca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005acab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005acab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100112 td 0xfffff8000e1805a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100113 td 0xfffff8000e180000 sched_switch() at sched_switch+0x713/frame 0xfffffe101bc049e0 mi_switch() at mi_switch+0x174/frame 0xfffffe101bc04a10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe101bc04a70 fork_exit() at fork_exit+0x84/frame 0xfffffe101bc04ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe101bc04ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100180 td 0xfffff8000e1835a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100181 td 0xfffff8001ccaa000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100182 td 0xfffff8001cca95a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100183 td 0xfffff8001cca9000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100184 td 0xfffff8001cca85a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100185 td 0xfffff8001cca8000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100186 td 0xfffff8001cca75a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100187 td 0xfffff8001cca7000 fork_trampoline() at fork_trampoline Tracing command idle pid 11 tid 100003 td 0xfffff8000b30c000 (CPU 0) cpustop_handler() at cpustop_handler+0x2d/frame 0xffffffff820533b0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xffffffff820533d0 trap() at trap+0x48/frame 0xffffffff820534e0 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff820534e0 --- trap 0x13, rip = 0xffffffff81214256, rsp = 0xfffffe0f817e8900, rbp = 0xfffffe0f817e8900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0f817e8900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0f817e8950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0f817e8970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0f817e8990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0f817e8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f817e8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f817e8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffff8000b30b5a0 (CPU 1) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0f87b73df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0f87b73e10 trap() at trap+0x48/frame 0xfffffe0f87b73f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0f87b73f20 --- trap 0x13, rip = 0xffffffff81214256, rsp = 0xfffffe0f817ed900, rbp = 0xfffffe0f817ed900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0f817ed900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0f817ed950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0f817ed970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0f817ed990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0f817eda70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f817edab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f817edab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffff8000b30b000 sched_switch() at sched_switch+0x713/frame 0xfffffe0f817f2940 mi_switch() at mi_switch+0x174/frame 0xfffffe0f817f2970 critical_exit_preempt() at critical_exit_preempt+0x65/frame 0xfffffe0f817f2990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0f817f2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f817f2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f817f2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffff8000b30a5a0 (CPU 3) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0f87b8bdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0f87b8be10 trap() at trap+0x48/frame 0xfffffe0f87b8bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0f87b8bf20 --- trap 0x13, rip = 0xffffffff81214256, rsp = 0xfffffe0f817f7900, rbp = 0xfffffe0f817f7900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0f817f7900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0f817f7950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0f817f7970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0f817f7990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0f817f7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f817f7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f817f7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffff8000b30a000 (CPU 4) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0f87b97df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0f87b97e10 trap() at trap+0x48/frame 0xfffffe0f87b97f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0f87b97f20 --- trap 0x13, rip = 0xffffffff81214256, rsp = 0xfffffe0f817fc900, rbp = 0xfffffe0f817fc900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0f817fc900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0f817fc950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0f817fc970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0f817fc990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0f817fca70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f817fcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f817fcab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffff8000b3095a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0ff7730940 mi_switch() at mi_switch+0x174/frame 0xfffffe0ff7730970 critical_exit_preempt() at critical_exit_preempt+0x65/frame 0xfffffe0ff7730990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0ff7730a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0ff7730ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0ff7730ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffff8000b309000 sched_switch() at sched_switch+0x713/frame 0xfffffe0ff7735940 mi_switch() at mi_switch+0x174/frame 0xfffffe0ff7735970 critical_exit_preempt() at critical_exit_preempt+0x65/frame 0xfffffe0ff7735990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0ff7735a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0ff7735ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0ff7735ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffff8000b31d5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0ff773a940 mi_switch() at mi_switch+0x174/frame 0xfffffe0ff773a970 critical_exit_preempt() at critical_exit_preempt+0x65/frame 0xfffffe0ff773a990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0ff773aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0ff773aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0ff773aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffff8000b31d000 sched_switch() at sched_switch+0x713/frame 0xfffffe0ff773f940 mi_switch() at mi_switch+0x174/frame 0xfffffe0ff773f970 critical_exit_preempt() at critical_exit_preempt+0x65/frame 0xfffffe0ff773f990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0ff773fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0ff773fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0ff773fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffff8000b31c5a0 (CPU 9) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0f87bd3df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0f87bd3e10 trap() at trap+0x48/frame 0xfffffe0f87bd3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0f87bd3f20 --- trap 0x13, rip = 0xffffffff81214256, rsp = 0xfffffe0ff7744900, rbp = 0xfffffe0ff7744900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0ff7744900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0ff7744950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0ff7744970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0ff7744990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0ff7744a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0ff7744ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0ff7744ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffff8000b31c000 (CPU 10) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0f87bdfdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0f87bdfe10 trap() at trap+0x48/frame 0xfffffe0f87bdff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0f87bdff20 --- trap 0x13, rip = 0xffffffff81214256, rsp = 0xfffffe0ff7749900, rbp = 0xfffffe0ff7749900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0ff7749900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0ff7749950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0ff7749970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0ff7749990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0ff7749a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0ff7749ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0ff7749ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffff8000b31b5a0 (CPU 11) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0f87bebdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0f87bebe10 trap() at trap+0x48/frame 0xfffffe0f87bebf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0f87bebf20 --- trap 0x13, rip = 0xffffffff81214256, rsp = 0xfffffe0ff774e900, rbp = 0xfffffe0ff774e900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0ff774e900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0ff774e950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0ff774e970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0ff774e990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0ff774ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe0ff774eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0ff774eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command init pid 1 tid 100002 td 0xfffff8000b30c5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0f817e3570 mi_switch() at mi_switch+0x174/frame 0xfffffe0f817e35a0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0f817e35e0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe0f817e3640 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe0f817e3670 _sleep() at _sleep+0x2d0/frame 0xfffffe0f817e3710 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe0f817e37a0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe0f817e3990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe0f817e3ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0f817e3ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x2b10da, rsp = 0x7fffffffe778, rbp = 0x7fffffffe7e0 --- Tracing command audit pid 10 tid 100001 td 0xfffff8000b30d000 sched_switch() at sched_switch+0x713/frame 0xfffffe0f817de910 mi_switch() at mi_switch+0x174/frame 0xfffffe0f817de940 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0f817de980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0f817de9b0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0f817dea10 audit_worker() at audit_worker+0x93/frame 0xfffffe0f817dea70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f817deab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f817deab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xffffffff82087f00 sched_switch() at sched_switch+0x713/frame 0xffffffff828ee980 mi_switch() at mi_switch+0x174/frame 0xffffffff828ee9b0 sleepq_switch() at sleepq_switch+0x110/frame 0xffffffff828ee9f0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xffffffff828eea30 _sleep() at _sleep+0x279/frame 0xffffffff828eead0 swapper() at swapper+0x77/frame 0xffffffff828eeb20 mi_startup() at mi_startup+0x2ee/frame 0xffffffff828eeb70 btext() at btext+0x2c Tracing command kernel pid 0 tid 100017 td 0xfffff8000b31a000 sched_switch() at sched_switch+0x713/frame 0xfffffe0ff7769900 mi_switch() at mi_switch+0x174/frame 0xfffffe0ff7769930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0ff7769970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0ff77699a0 _sleep() at _sleep+0x2da/frame 0xfffffe0ff7769a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0ff7769a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0ff7769ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0ff7769ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100019 td 0xfffff8000b362000 sched_switch() at sched_switch+0x713/frame 0xfffffe0ff7773930 mi_switch() at mi_switch+0x174/frame 0xfffffe0ff7773960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0ff77739a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0ff77739d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0ff7773a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0ff7773a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0ff7773ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0ff7773ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xfffff8000b3615a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0ff7778900 mi_switch() at mi_switch+0x174/frame 0xfffffe0ff7778930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0ff7778970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0ff77789a0 _sleep() at _sleep+0x2da/frame 0xfffffe0ff7778a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0ff7778a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0ff7778ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0ff7778ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xfffff8000b361000 sched_switch() at sched_switch+0x713/frame 0xfffffe0ff777d900 mi_switch() at mi_switch+0x174/frame 0xfffffe0ff777d930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0ff777d970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0ff777d9a0 _sleep() at _sleep+0x2da/frame 0xfffffe0ff777da40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0ff777da70 fork_exit() at fork_exit+0x84/frame 0xfffffe0ff777dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0ff777dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xfffff8000b3605a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0ff77b2930 mi_switch() at mi_switch+0x174/frame 0xfffffe0ff77b2960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0ff77b29a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0ff77b29d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0ff77b2a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0ff77b2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0ff77b2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0ff77b2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xfffff8000b360000 sched_switch() at sched_switch+0x713/frame 0xfffffe0ff77b7930 mi_switch() at mi_switch+0x174/frame 0xfffffe0ff77b7960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0ff77b79a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0ff77b79d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0ff77b7a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0ff77b7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0ff77b7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0ff77b7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xfffff8000b35f5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0ff77bc930 mi_switch() at mi_switch+0x174/frame 0xfffffe0ff77bc960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0ff77bc9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0ff77bc9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0ff77bca40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0ff77bca70 fork_exit() at fork_exit+0x84/frame 0xfffffe0ff77bcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0ff77bcab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xfffff8000b35f000 sched_switch() at sched_switch+0x713/frame 0xfffffe0ff77c1930 mi_switch() at mi_switch+0x174/frame 0xfffffe0ff77c1960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0ff77c19a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0ff77c19d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0ff77c1a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0ff77c1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0ff77c1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0ff77c1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100026 td 0xfffff8000b35e5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0ff77c6930 mi_switch() at mi_switch+0x174/frame 0xfffffe0ff77c6960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0ff77c69a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0ff77c69d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0ff77c6a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0ff77c6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0ff77c6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0ff77c6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100027 td 0xfffff8000b35e000 sched_switch() at sched_switch+0x713/frame 0xfffffe0ff77cb930 mi_switch() at mi_switch+0x174/frame 0xfffffe0ff77cb960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0ff77cb9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0ff77cb9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0ff77cba40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0ff77cba70 fork_exit() at fork_exit+0x84/frame 0xfffffe0ff77cbab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0ff77cbab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100028 td 0xfffff8000b3975a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0ff77d0930 mi_switch() at mi_switch+0x174/frame 0xfffffe0ff77d0960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0ff77d09a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0ff77d09d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0ff77d0a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0ff77d0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0ff77d0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0ff77d0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100029 td 0xfffff8000b397000 sched_switch() at sched_switch+0x713/frame 0xfffffe0ff77d5930 mi_switch() at mi_switch+0x174/frame 0xfffffe0ff77d5960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0ff77d59a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0ff77d59d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0ff77d5a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0ff77d5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0ff77d5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0ff77d5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100030 td 0xfffff8000b3965a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0ff77da930 mi_switch() at mi_switch+0x174/frame 0xfffffe0ff77da960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0ff77da9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0ff77da9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0ff77daa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0ff77daa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0ff77daab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0ff77daab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100031 td 0xfffff8000b396000 sched_switch() at sched_switch+0x713/frame 0xfffffe0ff77df930 mi_switch() at mi_switch+0x174/frame 0xfffffe0ff77df960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0ff77df9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0ff77df9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0ff77dfa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0ff77dfa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0ff77dfab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0ff77dfab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100032 td 0xfffff8000b3955a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0ff77e4930 mi_switch() at mi_switch+0x174/frame 0xfffffe0ff77e4960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0ff77e49a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0ff77e49d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0ff77e4a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0ff77e4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0ff77e4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0ff77e4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100033 td 0xfffff8000b395000 sched_switch() at sched_switch+0x713/frame 0xfffffe0ff77e9930 mi_switch() at mi_switch+0x174/frame 0xfffffe0ff77e9960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0ff77e99a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0ff77e99d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0ff77e9a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0ff77e9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0ff77e9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0ff77e9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100034 td 0xfffff8000b3945a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0ff77ee930 mi_switch() at mi_switch+0x174/frame 0xfffffe0ff77ee960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0ff77ee9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0ff77ee9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0ff77eea40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0ff77eea70 fork_exit() at fork_exit+0x84/frame 0xfffffe0ff77eeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0ff77eeab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100035 td 0xfffff8000b394000 sched_switch() at sched_switch+0x713/frame 0xfffffe0ff77f3930 mi_switch() at mi_switch+0x174/frame 0xfffffe0ff77f3960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0ff77f39a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0ff77f39d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0ff77f3a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0ff77f3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0ff77f3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0ff77f3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100036 td 0xfffff8000b3625a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0ff77f8930 mi_switch() at mi_switch+0x174/frame 0xfffffe0ff77f8960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0ff77f89a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0ff77f89d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0ff77f8a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0ff77f8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0ff77f8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0ff77f8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100037 td 0xfffff8000b42f000 sched_switch() at sched_switch+0x713/frame 0xfffffe0ff77fd930 mi_switch() at mi_switch+0x174/frame 0xfffffe0ff77fd960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0ff77fd9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0ff77fd9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0ff77fda40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0ff77fda70 fork_exit() at fork_exit+0x84/frame 0xfffffe0ff77fdab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0ff77fdab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100038 td 0xfffff8000b42e5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0000411930 mi_switch() at mi_switch+0x174/frame 0xfffffe0000411960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004119a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004119d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0000411a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000411a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000411ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000411ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100039 td 0xfffff8000b42e000 sched_switch() at sched_switch+0x713/frame 0xfffffe0000416930 mi_switch() at mi_switch+0x174/frame 0xfffffe0000416960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004169a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004169d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0000416a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000416a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000416ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000416ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100040 td 0xfffff8000b42d5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe000041b930 mi_switch() at mi_switch+0x174/frame 0xfffffe000041b960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe000041b9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000041b9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe000041ba40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000041ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe000041bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000041bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100041 td 0xfffff8000b42d000 sched_switch() at sched_switch+0x713/frame 0xfffffe0000420930 mi_switch() at mi_switch+0x174/frame 0xfffffe0000420960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004209a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004209d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0000420a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000420a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000420ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000420ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100042 td 0xfffff8000b42c5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0000425930 mi_switch() at mi_switch+0x174/frame 0xfffffe0000425960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004259a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004259d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0000425a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000425a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000425ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000425ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100043 td 0xfffff8000b42c000 sched_switch() at sched_switch+0x713/frame 0xfffffe000042a930 mi_switch() at mi_switch+0x174/frame 0xfffffe000042a960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe000042a9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000042a9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe000042aa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000042aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000042aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000042aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100044 td 0xfffff8000b41e5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe000042f930 mi_switch() at mi_switch+0x174/frame 0xfffffe000042f960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe000042f9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000042f9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe000042fa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000042fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000042fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000042fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100045 td 0xfffff8000b41e000 sched_switch() at sched_switch+0x713/frame 0xfffffe0000434930 mi_switch() at mi_switch+0x174/frame 0xfffffe0000434960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004349a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004349d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0000434a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000434a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000434ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000434ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100046 td 0xfffff8000b43d5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0000439930 mi_switch() at mi_switch+0x174/frame 0xfffffe0000439960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004399a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004399d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0000439a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000439a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000439ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000439ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100061 td 0xfffff8000b46c000 sched_switch() at sched_switch+0x713/frame 0xfffffe00004d8900 mi_switch() at mi_switch+0x174/frame 0xfffffe00004d8930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004d8970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004d89a0 _sleep() at _sleep+0x2da/frame 0xfffffe00004d8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00004d8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004d8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004d8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100066 td 0xfffff8000b5805a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00004fd900 mi_switch() at mi_switch+0x174/frame 0xfffffe00004fd930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004fd970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004fd9a0 _sleep() at _sleep+0x2da/frame 0xfffffe00004fda40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00004fda70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004fdab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004fdab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100067 td 0xfffff8000b580000 sched_switch() at sched_switch+0x713/frame 0xfffffe0000502900 mi_switch() at mi_switch+0x174/frame 0xfffffe0000502930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0000502970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005029a0 _sleep() at _sleep+0x2da/frame 0xfffffe0000502a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0000502a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000502ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000502ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100068 td 0xfffff8000b57f5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0000507900 mi_switch() at mi_switch+0x174/frame 0xfffffe0000507930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0000507970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005079a0 _sleep() at _sleep+0x2da/frame 0xfffffe0000507a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0000507a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000507ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000507ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100069 td 0xfffff8000b57f000 sched_switch() at sched_switch+0x713/frame 0xfffffe000050c900 mi_switch() at mi_switch+0x174/frame 0xfffffe000050c930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe000050c970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000050c9a0 _sleep() at _sleep+0x2da/frame 0xfffffe000050ca40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe000050ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe000050cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000050cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100070 td 0xfffff8000b57e5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0000511900 mi_switch() at mi_switch+0x174/frame 0xfffffe0000511930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0000511970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005119a0 _sleep() at _sleep+0x2da/frame 0xfffffe0000511a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0000511a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000511ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000511ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100071 td 0xfffff8000b57e000 sched_switch() at sched_switch+0x713/frame 0xfffffe0000516900 mi_switch() at mi_switch+0x174/frame 0xfffffe0000516930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0000516970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005169a0 _sleep() at _sleep+0x2da/frame 0xfffffe0000516a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0000516a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000516ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000516ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100072 td 0xfffff8000b57d5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe000051b900 mi_switch() at mi_switch+0x174/frame 0xfffffe000051b930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe000051b970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000051b9a0 _sleep() at _sleep+0x2da/frame 0xfffffe000051ba40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe000051ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe000051bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000051bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100073 td 0xfffff8000b57d000 sched_switch() at sched_switch+0x713/frame 0xfffffe0000520900 mi_switch() at mi_switch+0x174/frame 0xfffffe0000520930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0000520970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005209a0 _sleep() at _sleep+0x2da/frame 0xfffffe0000520a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0000520a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000520ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000520ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100074 td 0xfffff8000b5965a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0000525900 mi_switch() at mi_switch+0x174/frame 0xfffffe0000525930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0000525970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005259a0 _sleep() at _sleep+0x2da/frame 0xfffffe0000525a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0000525a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000525ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000525ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100075 td 0xfffff8000b596000 sched_switch() at sched_switch+0x713/frame 0xfffffe000052a900 mi_switch() at mi_switch+0x174/frame 0xfffffe000052a930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe000052a970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000052a9a0 _sleep() at _sleep+0x2da/frame 0xfffffe000052aa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe000052aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000052aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000052aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100076 td 0xfffff8000b5955a0 sched_switch() at sched_switch+0x713/frame 0xfffffe000052f900 mi_switch() at mi_switch+0x174/frame 0xfffffe000052f930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe000052f970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000052f9a0 _sleep() at _sleep+0x2da/frame 0xfffffe000052fa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe000052fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000052fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000052fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100077 td 0xfffff8000b595000 sched_switch() at sched_switch+0x713/frame 0xfffffe0000534900 mi_switch() at mi_switch+0x174/frame 0xfffffe0000534930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0000534970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005349a0 _sleep() at _sleep+0x2da/frame 0xfffffe0000534a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0000534a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000534ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000534ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100114 td 0xfffff8000e1765a0 sched_switch() at sched_switch+0x713/frame 0xfffffe101bc09930 mi_switch() at mi_switch+0x174/frame 0xfffffe101bc09960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe101bc099a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe101bc099d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe101bc09a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe101bc09a70 fork_exit() at fork_exit+0x84/frame 0xfffffe101bc09ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe101bc09ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100121 td 0xfffff8000f896000 sched_switch() at sched_switch+0x713/frame 0xfffffe101bc38930 mi_switch() at mi_switch+0x174/frame 0xfffffe101bc38960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe101bc389a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe101bc389d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe101bc38a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe101bc38a70 fork_exit() at fork_exit+0x84/frame 0xfffffe101bc38ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe101bc38ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100122 td 0xfffff8000f8955a0 sched_switch() at sched_switch+0x713/frame 0xfffffe101bc3d930 mi_switch() at mi_switch+0x174/frame 0xfffffe101bc3d960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe101bc3d9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe101bc3d9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe101bc3da40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe101bc3da70 fork_exit() at fork_exit+0x84/frame 0xfffffe101bc3dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe101bc3dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100123 td 0xfffff8000f895000 sched_switch() at sched_switch+0x713/frame 0xfffffe101bc42930 mi_switch() at mi_switch+0x174/frame 0xfffffe101bc42960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe101bc429a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe101bc429d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe101bc42a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe101bc42a70 fork_exit() at fork_exit+0x84/frame 0xfffffe101bc42ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe101bc42ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100124 td 0xfffff8000f8945a0 sched_switch() at sched_switch+0x713/frame 0xfffffe101bc47900 mi_switch() at mi_switch+0x174/frame 0xfffffe101bc47930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe101bc47970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe101bc479a0 _sleep() at _sleep+0x2da/frame 0xfffffe101bc47a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe101bc47a70 fork_exit() at fork_exit+0x84/frame 0xfffffe101bc47ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe101bc47ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:pho> dump Dumping 1640 out of 32621 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% Dump complete db> (kgdb) bt #0 doadump (textdump=0x0) at include/pcpu.h:246 #1 0xffffffff8049d4db in db_dump (dummy=, dummy3=, dummy4=) at ../../../ddb/db_command.c:575 #2 0xffffffff8049d2a9 in db_command (cmd_table=, dopager=0x0) at ../../../ddb/db_command.c:482 #3 0xffffffff804a2228 in db_script_exec (scriptname=, warnifnotfound=) at ../../../ddb/db_script.c:304 #4 0xffffffff8049d2a9 in db_command (cmd_table=, dopager=0x1) at ../../../ddb/db_command.c:482 #5 0xffffffff8049d024 in db_command_loop () at ../../../ddb/db_command.c:535 #6 0xffffffff804a01cf in db_trap (type=, code=) at ../../../ddb/db_main.c:252 #7 0xffffffff80c192fc in kdb_trap (type=0x3, code=0x0, tf=) at ../../../kern/subr_kdb.c:692 #8 0xffffffff810a9c11 in trap (frame=0xfffffe102d8e7fb0) at ../../../amd64/amd64/trap.c:621 #9 0xffffffff81082805 in calltrap () at ../../../amd64/amd64/exception.S:232 #10 0xffffffff80c18a0b in kdb_enter (why=0xffffffff8133f225 "panic", msg=) at include/cpufunc.h:65 #11 0xffffffff80bcef2a in vpanic (fmt=, ap=) at ../../../kern/kern_shutdown.c:894 #12 0xffffffff80bceca3 in panic (fmt=) at ../../../kern/kern_shutdown.c:832 #13 0xffffffff80c0448c in blst_leaf_free (scan=0xfffffe102bc10410, blk=0xffff40, count=0x2) at ../../../kern/subr_blist.c:906 #14 0xffffffff80c02f34 in blst_meta_free (scan=0xfffffe102bc10410, freeBlk=0xffff40, count=0x2, radix=0x40) at ../../../kern/subr_blist.c:937 #15 0xffffffff80c03048 in blst_meta_free (scan=0xfffffe102bc10030, freeBlk=0xffff40, count=0x2, radix=0x40) at ../../../kern/subr_blist.c:949 #16 0xffffffff80c03048 in blst_meta_free (scan=0xfffffe102bc00030, freeBlk=0xffff22, count=0x20, radix=0x1000) at ../../../kern/subr_blist.c:949 #17 0xffffffff80c03048 in blst_meta_free (scan=0xfffffe102b800030, freeBlk=0xffff22, count=0x20, radix=0x40000) at ../../../kern/subr_blist.c:949 #18 0xffffffff80c03048 in blst_meta_free (scan=0xfffffe102b800020, freeBlk=0xffff22, count=0x20, radix=0x1000000) at ../../../kern/subr_blist.c:949 #19 0xffffffff80c02ed1 in blist_free (bl=0xfffffe102b800000, blkno=0xffff22, count=0x20) at ../../../kern/subr_blist.c:349 #20 0xffffffff80ef6af0 in swp_pager_freeswapspace (blk=0xffff22, npages=0x20) at ../../../vm/swap_pager.c:827 #21 0xffffffff80ef6a22 in swp_pager_update_freerange (start=0xfffffe102d8e83f0, num=0xfffffe102d8e83f8, addr=0xffff65) at ../../../vm/swap_pager.c:436 #22 0xffffffff80ef71fc in swp_pager_meta_free_all (object=0xfffff8000feb7300) at ../../../vm/swap_pager.c:2082 #23 0xffffffff80ef4add in swap_pager_dealloc (object=0xfffff8000feb7300) at ../../../vm/swap_pager.c:700 #24 0xffffffff80f1b6f5 in vm_object_terminate (object=0xfffff8000feb7300) at ../../../vm/vm_object.c:812 #25 0xffffffff80f1a9db in vm_object_deallocate (object=0xfffff8000feb7300) at ../../../vm/vm_object.c:663 #26 0xffffffff80f156df in vm_map_entry_deallocate (entry=0xfffff8000feb1c40, system_map=0x0) at ../../../vm/vm_map.c:3443 #27 0xffffffff80f0afe2 in vm_map_process_deferred () at ../../../vm/vm_map.c:586 #28 0xffffffff80f0ae6a in _vm_map_unlock (map=0xfffff8001c627000, file=0xffffffff812fb362 "../../../vm/vm_map.c", line=0xe3c) at ../../../vm/vm_map.c:599 #29 0xffffffff80f12b6e in vm_map_remove (map=0xfffff8001c627000, start=0x1000, end=0x800000000000) at ../../../vm/vm_map.c:3644 #30 0xffffffff80f0a3bf in vmspace_dofree (vm=0xfffff8001c627000) at ../../../vm/vm_map.c:335 #31 0xffffffff80f0a5e4 in vmspace_exit (td=0xfffff8001c9d2000) at ../../../vm/vm_map.c:416 #32 0xffffffff80b87c3d in exit1 (td=0xfffff8001c9d2000, rval=, signo=0x9) at ../../../kern/kern_exit.c:417 #33 0xffffffff80bd399f in sigexit (td=0xfffff8001c9d2000, sig=) at ../../../kern/kern_sig.c:3160 #34 0xffffffff80bd4156 in postsig (sig=0x9) at ../../../kern/kern_sig.c:3046 #35 0xffffffff80c2fae7 in ast (framep=0xfffffe102d8e8ac0) at ../../../kern/subr_trap.c:320 #36 0xffffffff81085b79 in doreti_ast () at ../../../amd64/amd64/exception.S:1068 #37 0x0000000c2c3ec000 in ?? () #38 0x00000000000000a5 in ?? () #39 0x0000000080000000 in ?? () #40 0x0000000002a428c8 in ?? () #41 0x00000000000000a5 in ?? () : : (kgdb) f 13 #13 0xffffffff80c0448c in blst_leaf_free (scan=0xfffffe102bc10410, blk=0xffff40, count=0x2) at ../../../kern/subr_blist.c:906 906 KASSERT((scan->bm_bitmap & mask) == 0, (kgdb) l 901 * mask=0000111111111110000 902 * \_________/\__/ 903 * count n 904 */ 905 mask = bitrange(blk & BLIST_BMAP_MASK, count); 906 KASSERT((scan->bm_bitmap & mask) == 0, 907 ("freeing free block: %jx, size %d, mask %jx", 908 (uintmax_t)blk, count, (uintmax_t)scan->bm_bitmap & mask)); 909 scan->bm_bitmap |= mask; 910 } (kgdb) info loc mask = 0x3 (kgdb) p *scan $1 = {bm_bitmap = 0x1, bm_bighint = 0x40} (kgdb) f 19 #19 0xffffffff80c02ed1 in blist_free (bl=0xfffffe102b800000, blkno=0xffff22, count=0x20) at ../../../kern/subr_blist.c:349 349 blst_meta_free(bl->bl_root, blkno, count, bl->bl_radix); (kgdb) l 344 { 345 346 KASSERT(blkno >= 0 && blkno + count <= bl->bl_blocks, 347 ("freeing invalid range: blkno %jx, count %d, blocks %jd", 348 (uintmax_t)blkno, (int)count, (uintmax_t)bl->bl_blocks)); 349 blst_meta_free(bl->bl_root, blkno, count, bl->bl_radix); 350 bl->bl_avail += count; 351 } 352 353 /* (kgdb) info loc No locals. (kgdb) p *bl $2 = {bl_blocks = 0x1000000, bl_avail = 0x9efb96, bl_radix = 0x40000000, bl_cursor = 0x3c1e98, bl_root = 0xfffffe102b800020} (kgdb) (kgdb) f 22 #22 0xffffffff80ef71fc in swp_pager_meta_free_all (object=0xfffff8000feb7300) at ../../../vm/swap_pager.c:2082 2082 swp_pager_update_freerange(&s_free, &n_free, sb->d[i]); (kgdb) l 2077 &object->un_pager.swp.swp_blks, pindex)) != NULL;) { 2078 pindex = sb->p + SWAP_META_PAGES; 2079 for (i = 0; i < SWAP_META_PAGES; i++) { 2080 if (sb->d[i] == SWAPBLK_NONE) 2081 continue; 2082 swp_pager_update_freerange(&s_free, &n_free, sb->d[i]); 2083 } 2084 SWAP_PCTRIE_REMOVE(&object->un_pager.swp.swp_blks, sb->p); 2085 uma_zfree(swblk_zone, sb); 2086 } (kgdb) info loc sb = (struct swblk *) 0xfffff807941c15d8 n_free = 0x20 s_free = 0xffff22 pindex = 0x36e7b0 i = 0x0 (kgdb) p *object $4 = {lock = {lock_object = {lo_name = 0xffffffff8129b605 "vm object", lo_flags = 0x25630000, lo_data = 0x0, lo_witness = 0xfffff8087fd6b780}, rw_lock = 0xfffff8001c9d2000}, object_list = {tqe_next = 0xfffff8000feb7400, tqe_prev = 0xfffff8000feb7220}, shadow_head = {lh_first = 0x0}, shadow_list = {le_next = 0x0, le_prev = 0xfffff8001c1d8630}, memq = {tqh_first = 0x0, tqh_last = 0xfffff8000feb7348}, rtree = {rt_root = 0x0}, size = 0x400601, domain = {dr_policy = 0x0, dr_iter = 0x0}, generation = 0x1, ref_count = 0x0, shadow_count = 0x0, memattr = 0x6, type = 0x1, flags = 0x3008, pg_color = 0x1000, paging_in_progress = 0x0, resident_page_count = 0x0, backing_object = 0x0, backing_object_offset = 0x0, pager_object_list = {tqe_next = 0x0, tqe_prev = 0x0}, rvq = {lh_first = 0x0}, handle = 0x0, un_pager = {vnp = {vnp_size = 0x0, writemappings = 0xfffff803773fed80}, devp = {devp_pglist = {tqh_first = 0x0, tqh_last = 0xfffff803773fed80}, ops = 0x0, dev = 0x0}, sgp = {sgp_pglist = {tqh_first = 0x0, tqh_last = 0xfffff803773fed80}}, swp = { swp_tmpfs = 0x0, swp_blks = {pt_root = 0xfffff803773fed80}}}, cred = 0xfffff8001c5d2500, charge = 0x400601000, umtx_data = 0x0} (kgdb) p *sb $5 = {p = 0x36e7a0, d = 0xfffff807941c15e0} (kgdb) Index: src/sys/vm/vm_map.c =================================================================== --- src/sys/vm/vm_map.c (revision 349777) +++ src/sys/vm/vm_map.c (working copy) @@ -2837,6 +2837,47 @@ vm_map_inherit(vm_map_t map, vm_offset_t start, vm } /* + * vm_map_entry_in_transition: + * + * Get another entry not less than start, or entry->start, + * since the current entry is in transition. + */ +static vm_map_entry_t +vm_map_entry_in_transition(vm_map_t map, vm_offset_t in_start, + bool holes_ok, vm_map_entry_t in_entry) +{ + vm_map_entry_t entry; + vm_offset_t start; + unsigned int last_timestamp; + + VM_MAP_ASSERT_LOCKED(map); + KASSERT((in_entry->eflags & MAP_ENTRY_IN_TRANSITION) != 0, + ("not in-tranition map entry %p", in_entry)); + /* + * We have not yet clipped the entry. + */ + start = MAX(in_start, in_entry->start); + in_entry->eflags |= MAP_ENTRY_NEEDS_WAKEUP; + last_timestamp = map->timestamp; + /* Allow interruption of user unwiring? */ + vm_map_unlock_and_wait(map, 0); + vm_map_lock(map); + if (last_timestamp + 1 == map->timestamp) + return (in_entry); + /* + * Look again for the entry because the map was modified while it was + * unlocked. Specifically, the entry may have been clipped, merged, or + * deleted. + */ + if (!vm_map_lookup_entry(map, start, &entry)) { + if (!holes_ok) + return (NULL); + entry = entry->next; + } + return (entry); +} + +/* * vm_map_unwire: * * Implements both kernel and user unwiring. @@ -2846,10 +2887,8 @@ vm_map_unwire(vm_map_t map, vm_offset_t start, vm_ int flags) { vm_map_entry_t entry, first_entry, tmp_entry; - vm_offset_t saved_start; - unsigned int last_timestamp; int rv; - bool holes_ok, need_wakeup, user_unwire; + bool first_pass, holes_ok, need_wakeup, user_unwire; if (start == end) return (KERN_SUCCESS); @@ -2865,7 +2904,7 @@ vm_map_unwire(vm_map_t map, vm_offset_t start, vm_ return (KERN_INVALID_ADDRESS); } } - last_timestamp = map->timestamp; + first_pass = true; entry = first_entry; rv = KERN_SUCCESS; while (entry->start < end) { @@ -2873,48 +2912,22 @@ vm_map_unwire(vm_map_t map, vm_offset_t start, vm_ /* * We have not yet clipped the entry. */ - saved_start = (start >= entry->start) ? start : - entry->start; - entry->eflags |= MAP_ENTRY_NEEDS_WAKEUP; - if (vm_map_unlock_and_wait(map, 0)) { - /* - * Allow interruption of user unwiring? - */ - } - vm_map_lock(map); - if (last_timestamp+1 != map->timestamp) { - /* - * Look again for the entry because the map was - * modified while it was unlocked. - * Specifically, the entry may have been - * clipped, merged, or deleted. - */ - if (!vm_map_lookup_entry(map, saved_start, - &tmp_entry)) { - if (holes_ok) - tmp_entry = tmp_entry->next; - else { - if (saved_start == start) { - /* - * First_entry has been deleted. - */ - vm_map_unlock(map); - return (KERN_INVALID_ADDRESS); - } - end = saved_start; - rv = KERN_INVALID_ADDRESS; - break; - } + tmp_entry = vm_map_entry_in_transition(map, start, + holes_ok, entry); + if (tmp_entry == NULL) { + if (first_pass) { + vm_map_unlock(map); + return (KERN_INVALID_ADDRESS); } - if (entry == first_entry) - first_entry = tmp_entry; - else - first_entry = NULL; - entry = tmp_entry; + end = entry->start; + rv = KERN_INVALID_ADDRESS; + break; } - last_timestamp = map->timestamp; + first_entry = first_pass ? tmp_entry : NULL; + entry = tmp_entry; continue; } + first_pass = false; vm_map_clip_start(map, entry, start); vm_map_clip_end(map, entry, end); /* @@ -3081,7 +3094,7 @@ vm_map_wire_locked(vm_map_t map, vm_offset_t start u_long npages; u_int last_timestamp; int rv; - bool holes_ok, need_wakeup, user_wire; + bool first_pass, holes_ok, need_wakeup, user_wire; vm_prot_t prot; VM_MAP_ASSERT_LOCKED(map); @@ -3100,7 +3113,7 @@ vm_map_wire_locked(vm_map_t map, vm_offset_t start else return (KERN_INVALID_ADDRESS); } - last_timestamp = map->timestamp; + first_pass = true; entry = first_entry; while (entry->start < end) { if (entry->eflags & MAP_ENTRY_IN_TRANSITION) { @@ -3107,47 +3120,20 @@ vm_map_wire_locked(vm_map_t map, vm_offset_t start /* * We have not yet clipped the entry. */ - saved_start = (start >= entry->start) ? start : - entry->start; - entry->eflags |= MAP_ENTRY_NEEDS_WAKEUP; - if (vm_map_unlock_and_wait(map, 0)) { - /* - * Allow interruption of user wiring? - */ + tmp_entry = vm_map_entry_in_transition(map, start, + holes_ok, entry); + if (tmp_entry == NULL) { + if (first_pass) + return (KERN_INVALID_ADDRESS); + end = entry->start; + rv = KERN_INVALID_ADDRESS; + goto done; } - vm_map_lock(map); - if (last_timestamp + 1 != map->timestamp) { - /* - * Look again for the entry because the map was - * modified while it was unlocked. - * Specifically, the entry may have been - * clipped, merged, or deleted. - */ - if (!vm_map_lookup_entry(map, saved_start, - &tmp_entry)) { - if (holes_ok) - tmp_entry = tmp_entry->next; - else { - if (saved_start == start) { - /* - * first_entry has been deleted. - */ - return (KERN_INVALID_ADDRESS); - } - end = saved_start; - rv = KERN_INVALID_ADDRESS; - goto done; - } - } - if (entry == first_entry) - first_entry = tmp_entry; - else - first_entry = NULL; - entry = tmp_entry; - } - last_timestamp = map->timestamp; + first_entry = first_pass ? tmp_entry : NULL; + entry = tmp_entry; continue; } + first_pass = false; vm_map_clip_start(map, entry, start); vm_map_clip_end(map, entry, end); /* @@ -3185,6 +3171,7 @@ vm_map_wire_locked(vm_map_t map, vm_offset_t start */ saved_start = entry->start; saved_end = entry->end; + last_timestamp = map->timestamp; vm_map_busy(map); vm_map_unlock(map); @@ -3230,7 +3217,6 @@ vm_map_wire_locked(vm_map_t map, vm_offset_t start entry = entry->next; } } - last_timestamp = map->timestamp; if (rv != KERN_SUCCESS) { vm_map_wire_entry_failure(map, entry, faddr); if (user_wire) -- Test scenario: misc/sort.sh