panic: lock (sleep mutex) swapdev not locked @ vm/swap_pager.c:867, vmcore.66 KDB: debugger backends: ddb KDB: current backend: ddb ---<>--- Copyright (c) 1992-2019 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 13.0-CURRENT #0 r350191M: Sun Jul 21 08:52:30 CEST 2019 pho@mercat1.netperf.freebsd.org:/usr/src/sys/amd64/compile/KTR amd64 FreeBSD clang version 8.0.1 (branches/release_80 364487) (based on LLVM 8.0.1) WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. Entering uma_startup with 10 boot pages configured startup_alloc from "UMA Kegs", 8 boot pages left startup_alloc from "UMA Zones", 7 boot pages left startup_alloc from "UMA Zones", 6 boot pages left startup_alloc from "UMA Zones", 5 boot pages left startup_alloc from "UMA Zones", 4 boot pages left startup_alloc from "UMA Zones", 3 boot pages left startup_alloc from "UMA Hash", 2 boot pages left startup_alloc from "UMA Zones", 1 boot pages left Entering uma_startup1 with 0 boot pages left Entering uma_startup2 with 0 boot pages left VT(vga): resolution 640x480 CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.06-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics real memory = 34359738368 (32768 MB) avail memory = 33159458816 (31623 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 12 CPUs FreeBSD/SMP: 1 package(s) x 6 core(s) x 2 hardware threads random: unblocking device. ioapic0 irqs 0-23 on motherboard ioapic1 irqs 24-47 on motherboard Launching APs: 1 2 6 11 9 8 5 7 3 10 4 Timecounter "TSC-low" frequency 1750031428 Hz quality 1000 random: entropy device external interface kbd1 at kbdmux0 module_register_init: MOD_LOAD (vesa, 0xffffffff8112c410, 0) error 19 random: registering fast source Intel Secure Key RNG random: fast provider: "Intel Secure Key RNG" 000.000055 [4254] netmap_init netmap: loaded module [ath_hal] loaded nexus0 vtvga0: on motherboard cryptosoft0: on motherboard acpi0: on motherboard acpi0: Power Button (fixed) cpu0: on acpi0 atrtc0: port 0x70-0x71,0x74-0x77 irq 8 on acpi0 atrtc0: registered as a time-of-day clock, resolution 1.000000s Event timer "RTC" frequency 32768 Hz quality 0 attimer0: port 0x40-0x43,0x50-0x53 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Event timer "HPET" frequency 14318180 Hz quality 350 Event timer "HPET1" frequency 14318180 Hz quality 340 Event timer "HPET2" frequency 14318180 Hz quality 340 Event timer "HPET3" frequency 14318180 Hz quality 340 Event timer "HPET4" frequency 14318180 Hz quality 340 Event timer "HPET5" frequency 14318180 Hz quality 340 Event timer "HPET6" frequency 14318180 Hz quality 340 Event timer "HPET7" frequency 14318180 Hz quality 340 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 pcib0: on acpi0 pci0: on pcib0 pci0: at device 11.1 (no driver attached) pci0: at device 11.2 (no driver attached) pci0: at device 16.1 (no driver attached) pci0: at device 16.6 (no driver attached) pci0: at device 18.1 (no driver attached) acpi_syscontainer0: on acpi0 acpi_syscontainer1: on acpi0 acpi_syscontainer2: on acpi0 acpi_syscontainer3: on acpi0 pcib1: port 0xcf8-0xcff on acpi0 pci1: on pcib1 pcib2: irq 26 at device 1.0 on pci1 pci2: on pcib2 pcib3: irq 32 at device 2.0 on pci1 pci3: on pcib3 pci3: at device 0.0 (no driver attached) pci3: at device 0.1 (no driver attached) pcib4: irq 40 at device 3.0 on pci1 pci4: on pcib4 pci1: at device 17.0 (no driver attached) ahci0: port 0xf110-0xf117,0xf100-0xf103,0xf0f0-0xf0f7,0xf0e0-0xf0e3,0xf020-0xf03f mem 0xfb438000-0xfb4387ff irq 16 at device 17.4 on pci1 ahci0: AHCI v1.30 with 4 6Gbps ports, Port Multiplier not supported ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahcich2: at channel 2 on ahci0 ahcich3: at channel 3 on ahci0 ahciem0: on ahci0 xhci0: mem 0xfb400000-0xfb40ffff irq 19 at device 20.0 on pci1 xhci0: 32 bytes context size, 64-bit DMA usbus0 on xhci0 usbus0: 5.0Gbps Super Speed USB v3.0 pci1: at device 22.0 (no driver attached) pci1: at device 22.1 (no driver attached) ehci0: mem 0xfb434000-0xfb4343ff irq 18 at device 26.0 on pci1 usbus1: EHCI version 1.0 usbus1 on ehci0 usbus1: 480Mbps High Speed USB v2.0 pcib5: irq 16 at device 28.0 on pci1 pci5: on pcib5 pcib6: irq 18 at device 28.2 on pci1 pci6: on pcib6 pcib7: at device 0.0 on pci6 pci7: on pcib7 vgapci0: port 0xe000-0xe07f mem 0xfa000000-0xfaffffff,0xfb000000-0xfb01ffff irq 18 at device 0.0 on pci7 vgapci0: Boot video device pcib8: irq 16 at device 28.4 on pci1 pci8: on pcib8 igb0: port 0xd020-0xd03f mem 0xfb320000-0xfb33ffff,0xfb344000-0xfb347fff irq 16 at device 0.0 on pci8 igb0: Using 1024 TX descriptors and 1024 RX descriptors igb0: queue equality override not set, capping rx_queues at 6 and tx_queues at 6 igb0: Using 6 RX queues 6 TX queues igb0: Using MSI-X interrupts with 7 vectors igb0: Ethernet address: 0c:c4:7a:a8:cd:da igb0: netmap queues/slots: TX 6/1024, RX 6/1024 igb1: port 0xd000-0xd01f mem 0xfb300000-0xfb31ffff,0xfb340000-0xfb343fff irq 17 at device 0.1 on pci8 igb1: Using 1024 TX descriptors and 1024 RX descriptors igb1: queue equality override not set, capping rx_queues at 6 and tx_queues at 6 igb1: Using 6 RX queues 6 TX queues igb1: Using MSI-X interrupts with 7 vectors igb1: Ethernet address: 0c:c4:7a:a8:cd:db igb1: netmap queues/slots: TX 6/1024, RX 6/1024 ehci1: mem 0xfb433000-0xfb4333ff irq 18 at device 29.0 on pci1 usbus2: EHCI version 1.0 usbus2 on ehci1 usbus2: 480Mbps High Speed USB v2.0 isab0: at device 31.0 on pci1 isa0: on isab0 ahci1: port 0xf070-0xf077,0xf060-0xf063,0xf050-0xf057,0xf040-0xf043,0xf000-0xf01f mem 0xfb432000-0xfb4327ff irq 16 at device 31.2 on pci1 ahci1: AHCI v1.30 with 6 6Gbps ports, Port Multiplier not supported ahcich4: at channel 0 on ahci1 ahcich5: at channel 1 on ahci1 ahcich6: at channel 2 on ahci1 ahcich7: at channel 3 on ahci1 ahcich8: at channel 4 on ahci1 ahcich9: at channel 5 on ahci1 ahciem1: on ahci1 acpi_button0: on acpi0 uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0 uart1: console (115200,n,8,1) orm0: at iomem 0xc0000-0xc7fff,0xcb000-0xcbfff pnpid ORM0000 on isa0 est0: on cpu0 p4tcc0: on cpu0 NULL mp in getnewvnode(9), tag crossmp Timecounters tick every 1.000 msec ugen1.1: at usbus1 ugen0.1: <0x8086 XHCI root HUB> at usbus0 ugen2.1: at usbus2 uhub0 on usbus1 uhub0: on usbus1 uhub1 on usbus0 uhub2 on usbus2 uhub2: on usbus2 uhub1: <0x8086 XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0 Expensive timeout(9) function: 0xffffffff804dc290(0xfffffe009b5dc000) 0.004261034 s ada0 at ahcich1 bus 0 scbus1 target 0 lun 0 ada0: ACS-2 ATA SATA 3.x device ada0: Serial Number WD-WCC3F3KDDP98 ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes) ada0: Command Queueing enabled ada0: 953869MB (1953525168 512 byte sectors) ada0: quirks=0x1<4K> ses0 at ahciem0 bus 0 scbus4 target 0 lun 0 ses0: SEMB S-E-S 2.00 device ses0: SEMB SES Device ses1 at ahciem1 bus 0 scbus11 target 0 lun 0 ses1: SEMB S-E-S 2.00 device ses1: SEMB SES Device ses0: ada0,pass0 in 'Slot 01', SATA Slot: scbus1 target 0 hwpmc: SOFT/16/64/0x67 TSC/1/64/0x20 IAP/4/48/0x3ff IAF/3/48/0x67 Trying to mount root from ufs:/dev/gpt/work [rw]... WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. Expensive timeout(9) function: 0xffffffff80a3fe40(0xffffffff81ae72b0) 0.007402855 s WARNING: / was not properly dismounted uhub0: 2 ports with 2 removable, self powered Interface IP-Address Broadcast Setting hostuuid: 00000000-0000-0000-0000-002590c99976. Setting hostid: 0x90b83241. lo0: link state changed to UP Starting Network: lo0 igb0 igb1. lo0: flags=8049 metric 0 mtu 16384 options=680003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x3 inet 127.0.0.1 netmask 0xff000000 groups: lo nd6 options=21 igb0: flags=8843 metric 0 mtu 1500 options=e507bb ether 0c:c4:7a:a8:cd:da inet6 fe80::ec4:7aff:fea8:cdda%igb0 prefixlen 64 scopeid 0x1 media: Ethernet autoselect status: no carrier nd6 options=21 igb1: flags=8802 metric 0 mtu 1500 options=e507bb ether 0c:c4:7a:a8:cd:db media: Ethernet autoselect status: no carrier nd6 options=29 Starting devd. igb0: link state changed to UP Autoloading module: ioat.ko ioat0: mem 0xfb42c000-0xfb42ffff irq 31 at device 4.0 on pci1 ioat0: Capabilities: 2f7 ioat1: mem 0xfb428000-0xfb42bfff irq 39 at device 4.1 on pci1 ioat1: Capabilities: 2f7 ioat2: mem 0xfb424000-0xfb427fff irq 31 at device 4.2 on pci1 ioat2: Capabilities: f7 ioat3: mem 0xfb420000-0xfb423fff irq 39 at device 4.3 on pci1 ioat3: Capabilities: f7 ioat4: mem 0xfb41c000-0xfb41ffff irq 31 at device 4.4 on pci1 ioat4: Capabilities: f7 ioat5: mem 0xfb418000-0xfb41bfff irq 39 at device 4.5 on pci1 ioat5: Capabilities: f7 ioat6: mem 0xfb414000-0xfb417fff irq 31 at device 4.6 on pci1 ioat6: Capabilities: f7 ioat7: mem 0xfb410000-0xfb413fff irq 39 at device 4.7 on pci1 ioat7: Capabilities: f7 Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Starting Network: igb1. igb1: flags=8802 metric 0 mtu 1500 options=e507bb ether 0c:c4:7a:a8:cd:db media: Ethernet autoselect status: no carrier nd6 options=29 Autoloading module: uhid.ko Autoloading module: ums.ko ums0 on uhub4 ums0: on usbus0 ums0: 3 buttons and [Z] coordinates ID=0 Starting dhclient. DHCPREQUEST on igb0 to 255.255.255.255 port 67 DHCPACK from 192if_delmulti_locked: detaching ifnet instance 0xfffff8000700c000 .168.5.1 bound to 192.168.5.171 -- renewal in 300 seconds. add host 127.0.0.1: gateway lo0 fib 0: route already in table add host ::1: gateway lo0 fib 0: route already in table add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Creating and/or trimming log files. Starting syslogd. Setting date via ntp. 21 Jul 09:14:45 ntpdate[2055]: step time server 192.168.5.1 offset 564.294435 sec Starting rpcbind. NFS access cache time=60 Starting watchdogd. No core dumps found. lock order reversal: 1st 0xfffffe00022afe20 bufwait (bufwait) @ kern/vfs_bio.c:3904 2nd 0xfffff8004f483600 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:289 stack backtrace: #0 0xffffffff80c3b863 at witness_debugger+0x73 #1 0xffffffff80c3b5ad at witness_checkorder+0xa7d #2 0xffffffff80bd8358 at _sx_xlock+0x68 #3 0xffffffff80ee668d at ufsdirhash_add+0x4d #4 0xffffffff80eeb026 at ufs_direnter+0x446 #5 0xffffffff80ef3239 at ufs_mkdir+0x8c9 #6 0xffffffff8122d55c at VOP_MKDIR_APV+0x8c #7 0xffffffff80cb4c43 at kern_mkdirat+0x1b3 #8 0xffffffff810a6bc6 at amd64_syscall+0x2d6 #9 0xffffffff8107e59d at fast_syscall_common+0x101 Clearing /tmp (X related). Starting statd. Starting lockd. fscklock order reversal: 1st 0xfffff80005496068 ufs (ufs) @ kern/vfs_subr.c:2687 2nd 0xfffffe00022afe20 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:283 3rd 0xfffff8000b448068 ufs (ufs) @ kern/vfs_subr.c:2687 stack backtrace: #0 0xffffffff80c3b863 at witness_debugger+0x73 #1 0xffffffff80c3b5ad at witness_checkorder+0xa7d #2 0xffffffff80ba21fb at lockmgr_xlock_hard+0x6b #3 0xffffffff80ba2c6e at __lockmgr_args+0x5fe #4 0xffffffff80ee0ffc at ffs_lock+0x7c #5 0xffffffff8122e0b0 at VOP_LOCK1_APV+0x70 #6 0xffffffff80cb8075 at _vn_lock+0x65 #7 0xffffffff80ca6006 at vget+0xa6 #8 0xffffffff80c97dbc at vfs_hash_get+0xcc #9 0xffffffff80edc82f at ffs_vgetf+0x3f #10 0xffffffff80ed192f at softdep_sync_buf+0x56f #11 0xffffffff80ee1e14 at ffs_syncvnode+0x234 #12 0xffffffff80edf5bd at ffs_sync+0x20d #13 0xffffffff80c9e70f at dounmount+0x4bf #14 0xffffffff80c9e1b0 at sys_unmount+0x300 #15 0xffffffff810a6bc6 at amd64_syscall+0x2d6 #16 0xffffffff8107e59d at fast_syscall_common+0x101 lock order reversal: 1st 0xfffff8000b253a48 ufs (ufs) @ kern/vfs_mount.c:1354 2nd 0xfffff8000ba96a48 devfs (devfs) @ ufs/ffs/ffs_softdep.c:1926 stack backtrace: #0 0xffffffff80c3b863 at witness_debugger+0x73 #1 0xffffffff80c3b5ad at witness_checkorder+0xa7d #2 0xffffffff80ba1cfb at lockmgr_lock_fast_path+0x16b #3 0xffffffff8122e0b0 at VOP_LOCK1_APV+0x70 #4 0xffffffff80cb8075 at _vn_lock+0x65 #5 0xffffffff80ebe6fd at softdep_flushworklist+0x5d #6 0xffffffff80edf7b6 at ffs_sync+0x406 #7 0xffffffff80c9e70f at dounmount+0x4bf #8 0xffffffff80c9e1b0 at sys_unmount+0x300 #9 0xffffffff810a6bc6 at amd64_syscall+0x2d6 #10 0xffffffff8107e59d at fast_syscall_common+0x101 ** /dev/gpt/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 255 files, 28401 used, 1237006 free (94 frags, 154614 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** Updating motd:. Mounting late filesystems:. Security policy loaded: MAC/ntpd (mac_ntpd) Starting ntpd. Configuring vt: blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting cron. Sun Jul 21 09:14 FreeBSD/amd64 (mercat1.netperf.freebsd.org) (ttyu1) login: root Jul 21 09:14:51 mercat1 login[2346]: ROOT LOGIN (root) ON ttyu1 Last login: Sat Jul 20 16:08:11 on ttyu1 FreeBSD 13.0-CURRENT (KTR) #0 r350191M: Sun Jul 21 08:52:30 CEST 2019 root@mercat1:~ # Jul 21 09:15:01 mercat1 su[2362]: pho to root on /dev/pts/0 20190721 09:15:26 all (1/11): md7.sh Jul 21 09:17:20 mercat1 kernel: pid 3789 (mkdir), uid 0 inumber 22794 on /mnt: out of inodes Jul 21 09:17:40 mercat1 kernel: pid 4946 (rw), uid 0 inumber 107930 on /mnt: filesystem full Jul 21 09:17:50 mercat1 kernel: pid 4993 (rw), uid 0 inumber 13505 on /mnt: filesystem full Jul 21 09:17:59 mercat1 kernel: pid 4936 (mkdir), uid 0 inumber 133020 on /mnt: out of inodes Jul 21 09:18:17 mercat1 kernel: pid 4979 (mkdir), uid 0 inumber 19413 on /mnt: out of inodes Jul 21 09:18:31 mercat1 kernel: pid 5007 (creat), uid 0 inumber 44820 on /mnt: out of inodes Jul 21 09:18:45 mercat1 kernel: pid 4961 (creat), uid 0 inumber 44811 on /mnt: out of inodes Jul 21 09:18:58 mercat1 kernel: pid 4968 (creat), uid 0 inumber 44906 on /mnt: out of inodes Jul 21 09:19:20 mercat1 kernel: pid 4986 (creat), uid 0 inumber 44816 on /mnt: out of inodes Jul 21 09:19:31 mercat1 kernel: pid 4968 (creat), uid 0 inumber 44906 on /mnt: out of inodes 20190721 09:25:55 all (2/11): oom.sh 20190721 09:25:57 all (3/11): sort.sh swap_pager: out of swap space swp_pager_getswapspace(25): failed Jul 21 09:32:42 mercat1 kernel: pid 14635 (sort), jid 0, uid 0, was killed: out of swap space 20190721 09:32:47 all (4/11): stealer.sh swap_pager: out of swap space swp_pager_getswapspace(10): failed panic: lock (sleep mutex) swapdev not locked @ vm/swap_pager.c:867 cpuid = 1 time = 1563694424 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe000891f280 vpanic() at vpanic+0x19d/frame 0xfffffe000891f2d0 panic() at panic+0x43/frame 0xfffffe000891f330 witness_unlock() at witness_unlock+0xea/frame 0xfffffe000891f370 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe000891f3a0 swp_pager_trimswapspace() at swp_pager_trimswapspace+0xd5/frame 0xfffffe000891f400 swap_pager_putpages() at swap_pager_putpages+0x56c/frame 0xfffffe000891f4a0 vm_pageout_flush() at vm_pageout_flush+0xff/frame 0xfffffe000891f580 vm_pageout_cluster() at vm_pageout_cluster+0x3e6/frame 0xfffffe000891f7f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x2f6/frame 0xfffffe000891fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000891fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000891fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- KDB: enter: panic [ thread pid 30 tid 100130 ] Stopped at kdb_enter+0x3b: movq $0,kdb_why db> run pho db:0:pho> set $lines 20000 db:0:pho> run pho1 db:1:pho1> bt Tracing pid 30 tid 100130 td 0xfffff800050b35c0 kdb_enter() at kdb_enter+0x3b/frame 0xfffffe000891f280 vpanic() at vpanic+0x1ba/frame 0xfffffe000891f2d0 panic() at panic+0x43/frame 0xfffffe000891f330 witness_unlock() at witness_unlock+0xea/frame 0xfffffe000891f370 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe000891f3a0 swp_pager_trimswapspace() at swp_pager_trimswapspace+0xd5/frame 0xfffffe000891f400 swap_pager_putpages() at swap_pager_putpages+0x56c/frame 0xfffffe000891f4a0 vm_pageout_flush() at vm_pageout_flush+0xff/frame 0xfffffe000891f580 vm_pageout_cluster() at vm_pageout_cluster+0x3e6/frame 0xfffffe000891f7f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x2f6/frame 0xfffffe000891fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000891fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000891fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:1:pho1> show allpcpu Current CPU: 1 cpuid = 0 dynamic pcpu = 0xd777c0 curthread = 0xfffff8000bb39000: pid 18047 tid 100168 "stealer" curpcb = 0xfffffe00ad65db80 fpcurthread = 0xfffff8000bb39000: pid 18047 "stealer" idlethread = 0xfffff800037c6000: tid 100003 "idle: cpu0" curpmap = 0xfffff8011bf18130 tssp = 0xffffffff821d54a0 commontssp = 0xffffffff821d54a0 rsp0 = 0xfffffe00ad65db80 gs32p = 0xffffffff821dc0d8 ldt = 0xffffffff821dc118 tss = 0xffffffff821dc108 tlb gen = 4678475 curvnet = 0 spin locks held: cpuid = 1 dynamic pcpu = 0xfffffe00869e97c0 curthread = 0xfffff800050b35c0: pid 30 tid 100130 "laundry: dom0" curpcb = 0xfffffe000891fb80 fpcurthread = none idlethread = 0xfffff800037c75c0: tid 100004 "idle: cpu1" curpmap = 0xffffffff82087db0 tssp = 0xffffffff821d5508 commontssp = 0xffffffff821d5508 rsp0 = 0xfffffe000891fb80 gs32p = 0xffffffff821dc140 ldt = 0xffffffff821dc180 tss = 0xffffffff821dc170 tlb gen = 4678472 curvnet = 0 spin locks held: cpuid = 2 dynamic pcpu = 0xfffffe00869f57c0 curthread = 0xfffff804e2a135c0: pid 18204 tid 100493 "stealer" curpcb = 0xfffffe00ad694b80 fpcurthread = 0xfffff804e2a135c0: pid 18204 "stealer" idlethread = 0xfffff800037c7000: tid 100005 "idle: cpu2" curpmap = 0xfffff80477668130 tssp = 0xffffffff821d5570 commontssp = 0xffffffff821d5570 rsp0 = 0xfffffe00ad694b80 gs32p = 0xffffffff821dc1a8 ldt = 0xffffffff821dc1e8 tss = 0xffffffff821dc1d8 tlb gen = 4678475 curvnet = 0 spin locks held: cpuid = 3 dynamic pcpu = 0xfffffe0086a017c0 curthread = 0xfffff805b0623000: pid 18106 tid 100422 "stealer" curpcb = 0xfffffe00aed97b80 fpcurthread = 0xfffff805b0623000: pid 18106 "stealer" idlethread = 0xfffff800037c85c0: tid 100006 "idle: cpu3" curpmap = 0xfffff8011be07130 tssp = 0xffffffff821d55d8 commontssp = 0xffffffff821d55d8 rsp0 = 0xfffffe00aed97b80 gs32p = 0xffffffff821dc210 ldt = 0xffffffff821dc250 tss = 0xffffffff821dc240 tlb gen = 4678475 curvnet = 0 spin locks held: cpuid = 4 dynamic pcpu = 0xfffffe0086a0d7c0 curthread = 0xfffff805b8958000: pid 18216 tid 100503 "stealer" curpcb = 0xfffffe00781eab80 fpcurthread = 0xfffff805b8958000: pid 18216 "stealer" idlethread = 0xfffff800037c8000: tid 100007 "idle: cpu4" curpmap = 0xfffff8052085d130 tssp = 0xffffffff821d5640 commontssp = 0xffffffff821d5640 rsp0 = 0xfffffe00781eab80 gs32p = 0xffffffff821dc278 ldt = 0xffffffff821dc2b8 tss = 0xffffffff821dc2a8 tlb gen = 4678475 curvnet = 0 spin locks held: cpuid = 5 dynamic pcpu = 0xfffffe0086a197c0 curthread = 0xfffff8015717f000: pid 18207 tid 100267 "stealer" curpcb = 0xfffffe00aea90b80 fpcurthread = 0xfffff8015717f000: pid 18207 "stealer" idlethread = 0xfffff800037c95c0: tid 100008 "idle: cpu5" curpmap = 0xfffff80681ef1130 tssp = 0xffffffff821d56a8 commontssp = 0xffffffff821d56a8 rsp0 = 0xfffffe00aea90b80 gs32p = 0xffffffff821dc2e0 ldt = 0xffffffff821dc320 tss = 0xffffffff821dc310 tlb gen = 4678475 curvnet = 0 spin locks held: cpuid = 6 dynamic pcpu = 0xfffffe0086a257c0 curthread = 0xfffff805b2a825c0: pid 18100 tid 100426 "stealer" curpcb = 0xfffffe00aedabb80 fpcurthread = 0xfffff805b2a825c0: pid 18100 "stealer" idlethread = 0xfffff800037c9000: tid 100009 "idle: cpu6" curpmap = 0xfffff80157c5f130 tssp = 0xffffffff821d5710 commontssp = 0xffffffff821d5710 rsp0 = 0xfffffe00aedabb80 gs32p = 0xffffffff821dc348 ldt = 0xffffffff821dc388 tss = 0xffffffff821dc378 tlb gen = 4678475 curvnet = 0 spin locks held: cpuid = 7 dynamic pcpu = 0xfffffe0086a317c0 curthread = 0xfffff800070c8000: pid 18073 tid 100228 "stealer" curpcb = 0xfffffe00ad7ccb80 fpcurthread = 0xfffff800070c8000: pid 18073 "stealer" idlethread = 0xfffff800037b55c0: tid 100010 "idle: cpu7" curpmap = 0xfffff80157715130 tssp = 0xffffffff821d5778 commontssp = 0xffffffff821d5778 rsp0 = 0xfffffe00ad7ccb80 gs32p = 0xffffffff821dc3b0 ldt = 0xffffffff821dc3f0 tss = 0xffffffff821dc3e0 tlb gen = 4678475 curvnet = 0 spin locks held: cpuid = 8 dynamic pcpu = 0xfffffe0086a3d7c0 curthread = 0xfffff80157f3f000: pid 18023 tid 100385 "stealer" curpcb = 0xfffffe00aecdeb80 fpcurthread = 0xfffff80157f3f000: pid 18023 "stealer" idlethread = 0xfffff800037b5000: tid 100011 "idle: cpu8" curpmap = 0xfffff80157759130 tssp = 0xffffffff821d57e0 commontssp = 0xffffffff821d57e0 rsp0 = 0xfffffe00aecdeb80 gs32p = 0xffffffff821dc418 ldt = 0xffffffff821dc458 tss = 0xffffffff821dc448 tlb gen = 4678475 curvnet = 0 spin locks held: cpuid = 9 dynamic pcpu = 0xfffffe0086a497c0 curthread = 0xfffff805c16e55c0: pid 18018 tid 100444 "stealer" curpcb = 0xfffffe00af609b80 fpcurthread = 0xfffff805c16e55c0: pid 18018 "stealer" idlethread = 0xfffff800037b65c0: tid 100012 "idle: cpu9" curpmap = 0xfffff8011b64f130 tssp = 0xffffffff821d5848 commontssp = 0xffffffff821d5848 rsp0 = 0xfffffe00af609b80 gs32p = 0xffffffff821dc480 ldt = 0xffffffff821dc4c0 tss = 0xffffffff821dc4b0 tlb gen = 4678475 curvnet = 0 spin locks held: cpuid = 10 dynamic pcpu = 0xfffffe0086a557c0 curthread = 0xfffff805b8e53000: pid 18151 tid 100447 "stealer" curpcb = 0xfffffe00af613b80 fpcurthread = 0xfffff805b8e53000: pid 18151 "stealer" idlethread = 0xfffff800037b6000: tid 100013 "idle: cpu10" curpmap = 0xfffff8011bc0a130 tssp = 0xffffffff821d58b0 commontssp = 0xffffffff821d58b0 rsp0 = 0xfffffe00af613b80 gs32p = 0xffffffff821dc4e8 ldt = 0xffffffff821dc528 tss = 0xffffffff821dc518 tlb gen = 4678475 curvnet = 0 spin locks held: cpuid = 11 dynamic pcpu = 0xfffffe0086a617c0 curthread = 0xfffff80005894000: pid 30 tid 100128 "dom0" curpcb = 0xfffffe0008915b80 fpcurthread = none idlethread = 0xfffff800037b75c0: tid 100014 "idle: cpu11" curpmap = 0xffffffff82087db0 tssp = 0xffffffff821d5918 commontssp = 0xffffffff821d5918 rsp0 = 0xfffffe0008915b80 gs32p = 0xffffffff821dc550 ldt = 0xffffffff821dc590 tss = 0xffffffff821dc580 tlb gen = 4678475 curvnet = 0 spin locks held: db:1:pho1> show alllocks Process 18207 (stealer) thread 0xfffff8015717f000 (100267) exclusive sleep mutex vm page free queue (vm page free queue) r = 0 (0xffffffff820ce1c0) locked @ vm/vm_page.c:1823 exclusive rw vm object (vm object) r = 0 (0xfffff805af925100) locked @ vm/vm_fault.c:644 shared sx vm map (user) (vm map (user)) r = 0 (0xfffff80681ef1070) locked @ vm/vm_map.c:4527 Process 18100 (stealer) thread 0xfffff805b2a825c0 (100426) shared sx vm map (user) (vm map (user)) r = 0 (0xfffff80157c5f070) locked @ vm/vm_fault.c:1238 Process 18006 (md10) thread 0xfffff8004f5bc5c0 (100335) exclusive lockmgr ufs (ufs) r = 0 (0xfffff8011b33d068) locked @ dev/md/md.c:991 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffff8000b6c6880) locked @ vm/vm_pager.c:379 Process 30 (pagedaemon) thread 0xfffff80005894000 (100128) exclusive sleep mutex vm page (vm page) r = 0 (0xffffffff81a47680) locked @ vm/vm_page.c:1092 Process 30 (pagedaemon) thread 0xfffff800050b35c0 (100130) exclusive sleep mutex async swbuf mutex (async swbuf mutex) r = 0 (0xffffffff8204a700) locked @ vm/swap_pager.c:899 db:1:pho1> show lockedvnods Locked vnodes vnode 0xfffff8011b33d000: tag ufs, type VREG usecount 1, writecount 1, refcount 13 flags (VV_MD|VI_ACTIVE) v_object 0xfffff805b28bd000 ref 0 pages 92 cleanbuf 10 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff8004f5bc5c0 (pid 18006, md10, tid 100335) #0 0xffffffff80ba2529 at lockmgr_xlock_hard+0x399 #1 0xffffffff80ba2c6e at __lockmgr_args+0x5fe #2 0xffffffff80ee0ffc at ffs_lock+0x7c #3 0xffffffff8122e0b0 at VOP_LOCK1_APV+0x70 #4 0xffffffff80cb8075 at _vn_lock+0x65 #5 0xffffffff806ef9ea at mdstart_vnode+0x47a #6 0xffffffff806ed59c at md_kthread+0x20c #7 0xffffffff80b8c9f4 at fork_exit+0x84 #8 0xffffffff8107ecae at fork_trampoline+0xe nlink=1, effnlink=1, size=1073741824, extsize 0 generation=fff67baa, uid=0, gid=0, flags=0x0 ino 217, on dev gpt/tmp db:1:pho1> show allchains chain 1: thread 100291 (pid 18234, sed) sleeping on 0xfffff803df9d4000 "piperd" chain 2: thread 100290 (pid 18233, sh) sleeping on 0xfffff8011ba3978c "swread" chain 3: thread 100394 (pid 18232, sh) sleeping on 0xfffff80157f47000 "wait" chain 4: thread 100219 (pid 18229, sh) sleeping on 0xfffff803c9fe32f8 "piperd" chain 5: thread 100500 (pid 18213, stealer) sleeping on 0xfffff805af11a98c "swread" chain 6: thread 100499 (pid 18212, stealer) sleeping on 0xfffff8015728718c "swread" chain 7: thread 100498 (pid 18211, stealer) sleeping on 0xfffff8059ab16e8c "swread" chain 8: thread 100490 (pid 18201, stealer) sleeping on 0xfffff801a1fb058c "swread" chain 9: thread 100255 (pid 18187, stealer) sleeping on 0xfffff80003ad2a8c "swread" chain 10: thread 100258 (pid 18184, stealer) sleeping on 0xfffff805b093428c "swread" chain 11: thread 100257 (pid 18183, stealer) sleeping on 0xfffff805a513478c "swread" chain 12: thread 100279 (pid 18181, stealer) sleeping on 0xfffff8011bbf5d8c "swread" chain 13: thread 100458 (pid 18177, stealer) sleeping on 0xfffff805a550248c "swread" chain 14: thread 100377 (pid 18173, stealer) sleeping on 0xfffff8022edb9e8c "swread" chain 15: thread 100348 (pid 18169, stealer) sleeping on 0xfffff805ae7d838c "swread" chain 16: thread 100309 (pid 18162, stealer) sleeping on 0xfffff805aee8788c "swread" chain 17: thread 100307 (pid 18161, stealer) sleeping on 0xfffff805a5aaa08c "swread" chain 18: thread 100414 (pid 18157, stealer) sleeping on 0xfffff805b2d8ca8c "swread" chain 19: thread 100410 (pid 18155, stealer) sleeping on 0xfffff8000bb2bd8c "swread" chain 20: thread 100312 (pid 18145, stealer) sleeping on 0xfffff8047f79558c "swread" chain 21: thread 100360 (pid 18144, stealer) sleeping on 0xfffff8000b8cb58c "swread" chain 22: thread 100463 (pid 18142, stealer) sleeping on 0xfffff805b83cbb8c "swread" chain 23: thread 100460 (pid 18140, stealer) sleeping on 0xfffff8059aa63d8c "swread" chain 24: thread 100249 (pid 18136, stealer) sleeping on 0xfffff805ab39348c "swread" chain 25: thread 100431 (pid 18120, stealer) sleeping on 0xfffff8059a00f18c "swread" chain 26: thread 100154 (pid 18107, stealer) sleeping on 0xfffff8011bc9b28c "swread" chain 27: thread 100425 (pid 18103, stealer) sleeping on 0xfffff805b0a0288c "swread" chain 28: thread 100260 (pid 18099, stealer) sleeping on 0xfffff801a105628c "swread" chain 29: thread 100373 (pid 18076, stealer) sleeping on 0xfffff801f916998c "swread" chain 30: thread 100453 (pid 18070, stealer) sleeping on 0xfffff801575ef78c "swread" chain 31: thread 100185 (pid 18064, stealer) sleeping on 0xfffff8015741ae8c "swread" chain 32: thread 100392 (pid 18055, stealer) sleeping on 0xfffff8000537b18c "swread" chain 33: thread 100378 (pid 18052, stealer) sleeping on 0xfffff805a553ad8c "swread" chain 34: thread 100272 (pid 18042, stealer) sleeping on 0xfffff8011ba37e8c "swread" chain 35: thread 100284 (pid 18021, stealer) sleeping on 0xfffff805ab00388c "swread" chain 36: thread 100329 (pid 18017, stealer) sleeping on 0xfffff801573b4000 "wait" chain 37: thread 100296 (pid 18015, su) sleeping on 0xfffff8011b752000 "wait" chain 38: thread 100335 (pid 18006, md10) sleeping on 0xfffffe0002ba0158 "biord" chain 39: thread 100156 (pid 16919, sh) sleeping on 0xfffff800037cb000 "wait" chain 40: thread 100171 (pid 16918, tee) sleeping on 0xfffff8004f87f000 "piperd" chain 41: thread 100145 (pid 16917, sh) sleeping on 0xfffff8000589f530 "wait" chain 42: thread 100153 (pid 2513, sh) sleeping on 0xfffff8004f36e000 "piperd" chain 43: thread 100202 (pid 2511, awk) sleeping on 0xfffff800053765f0 "piperd" chain 44: thread 100217 (pid 2477, sh) sleeping on 0xfffff8004f9b5530 "wait" chain 45: thread 100166 (pid 2367, sh) sleeping on 0xfffff8000589f000 "wait" chain 46: thread 100200 (pid 2364, bash) sleeping on 0xfffff8000b687a60 "wait" chain 47: thread 100150 (pid 2362, csh) sleeping on 0xfffff8000703e5d8 "pause" chain 48: thread 100164 (pid 2361, su) sleeping on 0xfffff8004f0e7a60 "wait" chain 49: thread 100192 (pid 2357, bash) sleeping on 0xfffff8000703f000 "wait" chain 50: thread 100214 (pid 2356, sshd) sleeping on 0xfffff80005417440 "select" chain 51: thread 100170 (pid 2351, sshd) sleeping on 0xfffff800055496c0 "select" chain 52: thread 100213 (pid 2347, csh) sleeping on 0xfffff800072500b0 "ttyin" chain 53: thread 100211 (pid 2346, login) sleeping on 0xfffff8000b66b530 "wait" chain 54: thread 100210 (pid 2345, getty) sleeping on 0xfffff800072504b0 "ttyin" chain 55: thread 100209 (pid 2344, getty) sleeping on 0xfffff800050410b0 "ttyin" chain 56: thread 100208 (pid 2343, getty) sleeping on 0xfffff800050414b0 "ttyin" chain 57: thread 100207 (pid 2342, getty) sleeping on 0xfffff800050418b0 "ttyin" chain 58: thread 100175 (pid 2341, getty) sleeping on 0xfffff80005041cb0 "ttyin" chain 59: thread 100176 (pid 2340, getty) sleeping on 0xfffff800050400b0 "ttyin" chain 60: thread 100169 (pid 2339, getty) sleeping on 0xfffff800050404b0 "ttyin" chain 61: thread 100149 (pid 2338, getty) sleeping on 0xfffff800050408b0 "ttyin" chain 62: thread 100142 (pid 2337, getty) sleeping on 0xfffff80005040cb0 "ttyin" chain 63: thread 100146 (pid 2291, cron) sleeping on 0xffffffff81e90157 "nanslp" chain 64: thread 100147 (pid 2287, sshd) sleeping on 0xfffff80007342a40 "select" chain 65: thread 100197 (pid 2258, ntpd) sleeping on 0xfffff8000713d540 "select" chain 66: thread 100475 (pid 2258, ntpd) sleeping on 0xfffff805b27c0280 "usem" chain 67: thread 100190 (pid 2197, NLM: master) sleeping on 0xfffff8011b66b460 "rpcsvc" chain 68: thread 100196 (pid 2194, rpc.statd) sleeping on 0xfffff800072447c0 "select" chain 69: thread 100194 (pid 2148, watchdogd) sleeping on 0xffffffff81e90152 "nanslp" chain 70: thread 100148 (pid 2058, rpcbind) sleeping on 0xfffff80005926bc0 "select" chain 71: thread 100191 (pid 2048, syslogd) sleeping on 0xfffff8004f1caf40 "select" chain 72: thread 100161 (pid 1977, devd) sleeping on 0xfffff80005417540 "select" chain 73: thread 100193 (pid 1972, dhclient) sleeping on 0xfffff80003c0eb40 "select" chain 74: thread 100189 (pid 1928, dhclient) sleeping on 0xfffff80005417640 "select" chain 75: thread 100187 (pid 1925, dhclient) sleeping on 0xfffff8004f8670c0 "select" chain 76: thread 100141 (pid 34, syncer) sleeping on 0xffffffff82032640 "syncer" chain 77: thread 100140 (pid 33, vnlru) sleeping on 0xfffff8000589e000 "vlruwt" chain 78: thread 100132 (pid 32, bufdaemon) sleeping on 0xffffffff82031ad8 "qsleep" chain 79: thread 100133 (pid 32, bufspacedaemon-0) sleeping on 0xffffffff81a0a8c0 "-" chain 80: thread 100134 (pid 32, bufspacedaemon-1) sleeping on 0xffffffff81a12b80 "-" chain 81: thread 100135 (pid 32, bufspacedaemon-2) sleeping on 0xffffffff81a1ae40 "-" chain 82: thread 100136 (pid 32, bufspacedaemon-3) sleeping on 0xffffffff81a23100 "-" chain 83: thread 100137 (pid 32, bufspacedaemon-4) sleeping on 0xffffffff81a2b3c0 "-" chain 84: thread 100138 (pid 32, bufspacedaemon-5) sleeping on 0xffffffff81a33680 "-" chain 85: thread 100139 (pid 32, bufspacedaemon-6) sleeping on 0xffffffff81a3b940 "-" chain 86: thread 100151 (pid 32, / worker) sleeping on 0xfffff800071ec8e8 "sdflush" chain 87: thread 100199 (pid 32, /tmp worker) sleeping on 0xfffff800038fc8e8 "sdflush" chain 88: thread 100131 (pid 30, uma) sleeping on 0xffffffff80f01900 "umarcl" chain 89: thread 100127 (pid 29, enc_daemon1) sleeping on 0xfffff80003af6000 "idle" chain 90: thread 100126 (pid 28, enc_daemon0) sleeping on 0xfffff80003af6530 "idle" chain 91: thread 100123 (pid 27, rand_harvestq) sleeping on 0xffffffff81cef820 "-" chain 92: thread 100119 (pid 26, sctp_iterator) sleeping on 0xffffffff820cccb0 "waiting_for_work" chain 93: thread 100118 (pid 25, soaiod4) sleeping on 0xffffffff820314dc "-" chain 94: thread 100117 (pid 24, soaiod3) sleeping on 0xffffffff820314dc "-" chain 95: thread 100116 (pid 23, soaiod2) sleeping on 0xffffffff820314dc "-" chain 96: thread 100115 (pid 22, soaiod1) sleeping on 0xffffffff820314dc "-" chain 97: thread 100096 (pid 21, usbus0) sleeping on 0xfffffe009b7aa460 "-" chain 98: thread 100097 (pid 21, usbus0) sleeping on 0xfffffe009b7aa4b8 "-" chain 99: thread 100098 (pid 21, usbus0) sleeping on 0xfffffe009b7aa510 "-" chain 100: thread 100099 (pid 21, usbus0) sleeping on 0xfffffe009b7aa568 "-" chain 101: thread 100100 (pid 21, usbus0) sleeping on 0xfffffe009b7aa5c0 "-" chain 102: thread 100102 (pid 21, usbus1) sleeping on 0xfffffe00087d6d10 "-" chain 103: thread 100103 (pid 21, usbus1) sleeping on 0xfffffe00087d6d68 "-" chain 104: thread 100104 (pid 21, usbus1) sleeping on 0xfffffe00087d6dc0 "-" chain 105: thread 100105 (pid 21, usbus1) sleeping on 0xfffffe00087d6e18 "-" chain 106: thread 100106 (pid 21, usbus1) sleeping on 0xfffffe00087d6e70 "-" chain 107: thread 100107 (pid 21, usbus2) sleeping on 0xfffffe009bc3dd10 "-" chain 108: thread 100108 (pid 21, usbus2) sleeping on 0xfffffe009bc3dd68 "-" chain 109: thread 100109 (pid 21, usbus2) sleeping on 0xfffffe009bc3ddc0 "-" chain 110: thread 100110 (pid 21, usbus2) sleeping on 0xfffffe009bc3de18 "-" chain 111: thread 100111 (pid 21, usbus2) sleeping on 0xfffffe009bc3de70 "-" chain 112: thread 100091 (pid 20, doneq0) sleeping on 0xffffffff81bcabc0 "-" chain 113: thread 100092 (pid 20, doneq1) sleeping on 0xffffffff81bcac40 "-" chain 114: thread 100093 (pid 20, doneq2) sleeping on 0xffffffff81bcacc0 "-" chain 115: thread 100125 (pid 20, scanner) sleeping on 0xffffffff81bcaa88 "-" chain 116: thread 100090 (pid 19, crypto returns 11) sleeping on 0xfffff8000502a450 "crypto_ret_wait" chain 117: thread 100089 (pid 18, crypto returns 10) sleeping on 0xfffff8000502a3f0 "crypto_ret_wait" chain 118: thread 100088 (pid 17, crypto returns 9) sleeping on 0xfffff8000502a390 "crypto_ret_wait" chain 119: thread 100087 (pid 16, crypto returns 8) sleeping on 0xfffff8000502a330 "crypto_ret_wait" chain 120: thread 100086 (pid 15, crypto returns 7) sleeping on 0xfffff8000502a2d0 "crypto_ret_wait" chain 121: thread 100085 (pid 9, crypto returns 6) sleeping on 0xfffff8000502a270 "crypto_ret_wait" chain 122: thread 100084 (pid 8, crypto returns 5) sleeping on 0xfffff8000502a210 "crypto_ret_wait" chain 123: thread 100083 (pid 7, crypto returns 4) sleeping on 0xfffff8000502a1b0 "crypto_ret_wait" chain 124: thread 100082 (pid 6, crypto returns 3) sleeping on 0xfffff8000502a150 "crypto_ret_wait" chain 125: thread 100081 (pid 5, crypto returns 2) sleeping on 0xfffff8000502a0f0 "crypto_ret_wait" chain 126: thread 100080 (pid 4, crypto returns 1) sleeping on 0xfffff8000502a090 "crypto_ret_wait" chain 127: thread 100079 (pid 3, crypto returns 0) sleeping on 0xfffff8000502a030 "crypto_ret_wait" chain 128: thread 100078 (pid 2, crypto) sleeping on 0xffffffff82048e78 "crypto_wait" chain 129: thread 100065 (pid 14, sequencer 00) sleeping on 0xfffff80003c7dc88 "seqstate" chain 130: thread 100062 (pid 13, g_event) sleeping on 0xffffffff82087140 "-" chain 131: thread 100063 (pid 13, g_up) sleeping on 0xffffffff82087150 "-" chain 132: thread 100064 (pid 13, g_down) sleeping on 0xffffffff82087138 "-" chain 133: thread 100002 (pid 1, init) sleeping on 0xfffff800037ca530 "wait" chain 134: thread 100001 (pid 10, audit) sleeping on 0xffffffff820cd9d0 "audit_worker_cv" chain 135: thread 100000 (pid 0, swapper) sleeping on 0xffffffff82087180 "swapin" chain 136: thread 100015 (pid 0, kqueue_ctx taskq) sleeping on 0xfffff800036b8e00 "-" chain 137: thread 100016 (pid 0, aiod_kick taskq) sleeping on 0xfffff800036b8d00 "-" chain 138: thread 100019 (pid 0, thread taskq) sleeping on 0xfffff800036b8a00 "-" chain 139: thread 100021 (pid 0, config_0) sleeping on 0xfffff8000314bc00 "-" chain 140: thread 100022 (pid 0, if_io_tqg_0) sleeping on 0xfffff8000314bb00 "-" chain 141: thread 100023 (pid 0, if_io_tqg_1) sleeping on 0xfffff8000314ba00 "-" chain 142: thread 100024 (pid 0, if_io_tqg_2) sleeping on 0xfffff8000314b900 "-" chain 143: thread 100025 (pid 0, if_io_tqg_3) sleeping on 0xfffff8000314b800 "-" chain 144: thread 100026 (pid 0, if_io_tqg_4) sleeping on 0xfffff8000314b700 "-" chain 145: thread 100027 (pid 0, if_io_tqg_5) sleeping on 0xfffff8000314b600 "-" chain 146: thread 100028 (pid 0, if_io_tqg_6) sleeping on 0xfffff8000314b500 "-" chain 147: thread 100029 (pid 0, if_io_tqg_7) sleeping on 0xfffff8000314b400 "-" chain 148: thread 100030 (pid 0, if_io_tqg_8) sleeping on 0xfffff8000314b300 "-" chain 149: thread 100031 (pid 0, if_io_tqg_9) sleeping on 0xfffff8000314b200 "-" chain 150: thread 100032 (pid 0, if_io_tqg_10) sleeping on 0xfffff8000314b100 "-" chain 151: thread 100033 (pid 0, if_io_tqg_11) sleeping on 0xfffff8000314b000 "-" chain 152: thread 100034 (pid 0, softirq_0) sleeping on 0xfffff8000314ae00 "-" chain 153: thread 100035 (pid 0, softirq_1) sleeping on 0xfffff8000314ad00 "-" chain 154: thread 100036 (pid 0, softirq_2) sleeping on 0xfffff8000314ac00 "-" chain 155: thread 100037 (pid 0, softirq_3) sleeping on 0xfffff8000314ab00 "-" chain 156: thread 100038 (pid 0, softirq_4) sleeping on 0xfffff8000314aa00 "-" chain 157: thread 100039 (pid 0, softirq_5) sleeping on 0xfffff8000314a900 "-" chain 158: thread 100040 (pid 0, softirq_6) sleeping on 0xfffff8000314a800 "-" chain 159: thread 100041 (pid 0, softirq_7) sleeping on 0xfffff8000314a700 "-" chain 160: thread 100042 (pid 0, softirq_8) sleeping on 0xfffff8000314a600 "-" chain 161: thread 100043 (pid 0, softirq_9) sleeping on 0xfffff8000314a500 "-" chain 162: thread 100044 (pid 0, softirq_10) sleeping on 0xfffff8000314a400 "-" chain 163: thread 100045 (pid 0, softirq_11) sleeping on 0xfffff8000314a300 "-" chain 164: thread 100046 (pid 0, if_config_tqg_0) sleeping on 0xfffff80003d22100 "-" chain 165: thread 100061 (pid 0, firmware taskq) sleeping on 0xfffff80003c87100 "-" chain 166: thread 100066 (pid 0, crypto_0) sleeping on 0xfffff80003c87000 "-" chain 167: thread 100067 (pid 0, crypto_1) sleeping on 0xfffff80003c87000 "-" chain 168: thread 100068 (pid 0, crypto_2) sleeping on 0xfffff80003c87000 "-" chain 169: thread 100069 (pid 0, crypto_3) sleeping on 0xfffff80003c87000 "-" chain 170: thread 100070 (pid 0, crypto_4) sleeping on 0xfffff80003c87000 "-" chain 171: thread 100071 (pid 0, crypto_5) sleeping on 0xfffff80003c87000 "-" chain 172: thread 100072 (pid 0, crypto_6) sleeping on 0xfffff80003c87000 "-" chain 173: thread 100073 (pid 0, crypto_7) sleeping on 0xfffff80003c87000 "-" chain 174: thread 100074 (pid 0, crypto_8) sleeping on 0xfffff80003c87000 "-" chain 175: thread 100075 (pid 0, crypto_9) sleeping on 0xfffff80003c87000 "-" chain 176: thread 100076 (pid 0, crypto_10) sleeping on 0xfffff80003c87000 "-" chain 177: thread 100077 (pid 0, crypto_11) sleeping on 0xfffff80003c87000 "-" chain 178: thread 100114 (pid 0, mca taskq) sleeping on 0xfffff80007408200 "-" chain 179: thread 100120 (pid 0, acpi_task_0) sleeping on 0xfffff80005861600 "-" chain 180: thread 100121 (pid 0, acpi_task_1) sleeping on 0xfffff80005861600 "-" chain 181: thread 100122 (pid 0, acpi_task_2) sleeping on 0xfffff80005861600 "-" chain 182: thread 100124 (pid 0, CAM taskq) sleeping on 0xfffff80003c88e00 "-" db:1:pho1> show mount 0xfffff80003726000 /dev/gpt/work on / (ufs) 0xfffff80003725000 devfs on /dev (devfs) 0xfffff80003a48000 /dev/gpt/tmp on /tmp (ufs) More info: show mount db:1:pho1> show bufqueues bqempty: 85785 Buf domain 0 freebufs 14977 lofreebufs 219 hifreebufs 329 bufspace 2805760 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 143 (2625536) dirtyq count 0 (0) wakeup 0 lim 25 CPU 0, 0, 0, 0, 0, 0, 0, 0, 6, 7, 0, 0, Locked buffers: 0 space 0 Total buffers: 1022 space 2805760 Buf domain 1 freebufs 15063 lofreebufs 219 hifreebufs 329 bufspace 2146304 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 8 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 28 (880640) dirtyq count 8 (262144) wakeup 0 lim 25 CPU 1, 4, 0, 3, 0, 9, 0, 1, 1, 1, 4, 8, Locked buffers: 2 space 65536 Total buffers: 13682 space 2146304 Buf domain 2 freebufs 15006 lofreebufs 219 hifreebufs 329 bufspace 2285568 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 2 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 95 (1597440) dirtyq count 2 (40960) wakeup 0 lim 25 CPU 2, 1, 1, 1, 0, 0, 2, 1, 0, 6, 8, 8, Locked buffers: 0 space 0 Total buffers: 757 space 2285568 Buf domain 3 freebufs 13958 lofreebufs 219 hifreebufs 329 bufspace 36245504 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 1137 (35057664) dirtyq count 0 (0) wakeup 0 lim 25 CPU 1, 0, 0, 0, 0, 0, 0, 21, 0, 16, 0, 0, Locked buffers: 0 space 0 Total buffers: 2704 space 36245504 Buf domain 4 freebufs 14965 lofreebufs 219 hifreebufs 329 bufspace 3190784 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 5 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 144 (2641920) dirtyq count 5 (135168) wakeup 0 lim 25 CPU 0, 0, 0, 1, 0, 9, 0, 2, 1, 5, 0, 0, Locked buffers: 1 space 32768 Total buffers: 741 space 3190784 Buf domain 5 freebufs 14240 lofreebufs 219 hifreebufs 329 bufspace 26914816 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 871 (26251264) dirtyq count 0 (0) wakeup 0 lim 25 CPU 2, 1, 0, 0, 11, 0, 1, 1, 5, 1, 0, 0, Locked buffers: 0 space 0 Total buffers: 1374 space 26914816 Buf domain 6 freebufs 14971 lofreebufs 219 hifreebufs 329 bufspace 3104768 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 148 (2961408) dirtyq count 0 (0) wakeup 0 lim 25 CPU 0, 1, 0, 2, 0, 0, 0, 1, 3, 7, 0, 0, Locked buffers: 0 space 0 Total buffers: 3817 space 3104768 db:1:pho1> show page vm_cnt.v_free_count: 91577 vm_cnt.v_inactive_count: 78 vm_cnt.v_active_count: 6914294 vm_cnt.v_laundry_count: 794149 vm_cnt.v_wire_count: 218230 vm_cnt.v_free_reserved: 10649 vm_cnt.v_free_min: 51289 vm_cnt.v_free_target: 173209 vm_cnt.v_inactive_target: 259813 db:1:pho1> show pageq pq_free 91577 dom 0 page_cnt 8128423 free 91577 pq_act 6914294 pq_inact 78 pq_laund 794149 pq_unsw 106727 db:0:pho> show freepages DOMAIN: 0 FREE LIST 0: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000000 | 000000 09 (002048K) | 000000 | 000000 08 (001024K) | 000000 | 000000 07 (000512K) | 000000 | 000000 06 (000256K) | 000001 | 000000 05 (000128K) | 000469 | 000002 04 (000064K) | 000424 | 000009 03 (000032K) | 000728 | 000022 02 (000016K) | 000573 | 000043 01 (000008K) | 000001 | 000053 00 (000004K) | 000001 | 000315 FREE LIST 1: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000000 | 000000 09 (002048K) | 000000 | 000000 08 (001024K) | 000000 | 000000 07 (000512K) | 000000 | 000000 06 (000256K) | 000000 | 000000 05 (000128K) | 000000 | 000000 04 (000064K) | 000000 | 000000 03 (000032K) | 000000 | 000000 02 (000016K) | 000000 | 000000 01 (000008K) | 000000 | 000000 00 (000004K) | 000000 | 000000 db:0:pho> show uma Zone Size Used Free Requests Sleeps Bucket FFS2 dinode 256 1127 463 5812940 0 61 FFS1 dinode 128 0 0 0 0 125 FFS inode 160 1127 673 5812940 0 61 swblk 136 18549 1031106 1068270 0 61 swpctrie 144 1799 68374 71985 0 61 selfd 64 76 792 16866 0 253 rtentry 208 12 121 15 0 61 IPsec SA lft_c 16 0 0 0 0 253 ripcb 488 1 7 3 0 29 udplite_inpcb 488 0 0 0 0 29 sctp_asconf_ack 48 0 0 0 0 253 sctp_asconf 40 0 0 0 0 253 sctp_stream_msg_out 112 0 0 0 0 125 sctp_readq 152 0 0 0 0 61 sctp_chunk 152 0 0 0 0 61 sctp_raddr 736 0 0 0 0 13 sctp_laddr 48 0 0 4 0 253 sctp_asoc 2408 0 0 0 0 3 sctp_ep 1280 0 0 0 0 9 tcp_log_node 120 0 0 0 0 125 tcp_log_bucket 144 0 0 0 0 61 tcp_log 408 0 0 0 0 29 tcpreass 48 0 0 0 0 253 tfo_ccache_entries 80 0 0 0 0 125 tfo 4 0 0 0 0 253 sackhole 32 0 0 0 0 253 hostcache 96 0 0 0 0 125 syncache 168 0 0 1 0 61 tcptw 88 0 0 0 0 125 tcpcb 976 9 15 14 0 13 tcp_inpcb 488 9 39 14 0 29 udpcb 32 20 724 228 0 253 udp_inpcb 488 20 52 228 0 29 ipq 56 0 0 0 0 253 unpcb 256 19 86 4955 0 61 socket 872 51 2985 5213 0 13 KNOTE 160 0 0 0 0 61 itimer 352 0 0 0 0 29 ksiginfo 112 345 635 2404 0 125 pipe 760 11 24 8993 0 13 AIOLIO 280 0 0 0 0 29 AIOCB 752 0 0 0 0 13 AIOP 32 0 0 0 0 253 AIO 208 0 0 0 0 61 Mountpoints 2896 3 6 5 0 3 procdesc 136 1 28 10 0 61 NCLNODE 744 0 0 0 0 13 DIRHASH 1024 25 3 119877 0 13 LTS VFS Cache 368 0 0 0 0 29 L VFS Cache 328 0 0 0 0 29 STS VFS Cache 148 0 0 0 0 61 S VFS Cache 108 1281 1939 3437057 0 125 rentr 24 0 0 3 0 253 NAMEI 1024 0 0 36647617 0 13 BUF TRIE 144 359 105589 1784981 0 61 VNODEPOLL 120 0 0 0 0 125 VNODE 632 1237 113 5813056 0 13 vtnet_tx_hdr 24 0 0 0 0 253 crypto_session 24 0 0 0 0 253 cryptodesc 120 0 0 0 0 125 cryptop 128 0 0 0 0 125 nvme_request 128 0 0 0 0 125 g_bio 408 38 7 6082771 0 29 FPU_save_area 832 0 0 0 0 13 DMAR_MAP_ENTRY 120 0 0 0 0 125 ttyoutq 256 173 112 282 0 61 ttyinq 160 330 222 540 0 61 epoch_record pcpu 256 4 12 4 0 61 mbuf_extpgs 256 0 0 0 0 61 mbuf_jumbo_16k 16384 0 0 0 0 1 mbuf_jumbo_9k 9216 0 0 0 0 1 mbuf_jumbo_page 4096 0 0 2 0 1 mbuf_cluster 2048 5559 3 8818 0 5 mbuf 256 5569 122 10330 0 253 mbuf_packet 256 9 0 400 0 253 audit_record 1280 0 0 0 0 9 domainset 40 0 0 0 0 253 cpuset 104 27 438 27 0 125 THREAD 1472 488 26 506 0 9 PROC 1328 283 95 18234 0 9 MAC labels 40 0 0 0 0 253 pbuf 984 0 975 0 0 1 clpbuf 984 1 0 466496 17582 5 vnpbuf 984 0 0 0 0 13 mdpbuf 984 1 0 11056 0 1 nfspbuf 984 0 0 0 0 5 swwbuf 984 2 0 569701 0 1 swrbuf 984 32 0 2380 0 5 umtx_shm 88 0 0 0 0 125 umtx pi 96 0 0 0 0 125 rl_entry 40 322 1064 322 0 253 TURNSTILE 136 515 405 515 0 61 rangeset pctrie nodes 144 0 0 0 0 61 filedesc0 1104 281 73 18235 0 9 Files 80 127 1882 4306028 0 125 SLEEPQUEUE 88 515 477 515 0 125 65536 65536 0 0 0 0 1 65536 65536 0 0 0 0 1 65536 65536 1 0 1 0 1 65536 65536 2 0 64 0 1 65536 65536 3 0 2157 0 1 65536 65536 0 0 0 0 1 65536 65536 3 0 3 0 1 65536 65536 3 0 55 0 1 32768 32768 0 0 8 0 1 32768 32768 13 0 13 0 1 32768 32768 3 0 4 0 1 32768 32768 0 0 142 0 1 32768 32768 1 0 2491 0 1 32768 32768 12 0 12 0 1 32768 32768 1 0 1 0 1 32768 32768 11 0 129 0 1 16384 16384 0 0 12 0 1 16384 16384 5 0 6 0 1 16384 16384 37 0 37 0 1 16384 16384 5 0 228 0 1 16384 16384 14 0 2851 0 1 16384 16384 0 0 0 0 1 16384 16384 2 0 2 0 1 16384 16384 1 0 2 0 1 8192 8192 0 0 93 0 1 8192 8192 88 0 90 0 1 8192 8192 14 0 18 0 1 8192 8192 2 0 2 0 1 8192 8192 14 0 1674 0 1 8192 8192 12 0 12 0 1 8192 8192 0 0 0 0 1 8192 8192 2 0 4 0 1 4096 4096 0 0 8 0 1 4096 4096 1 0 164872 0 1 4096 4096 46 0 90059 0 1 4096 4096 17 0 74 0 1 4096 4096 369 0 2722 0 1 4096 4096 0 0 13 0 1 4096 4096 0 0 1 0 1 4096 4096 293 0 18244 0 1 2048 2048 0 0 34 0 5 2048 2048 3 3 29 0 5 2048 2048 99 11 100 0 5 2048 2048 2 2 45 0 5 2048 2048 10 2 508 0 5 2048 2048 0 0 0 0 5 2048 2048 2 2 2 0 5 2048 2048 21 17 636843 0 5 1024 1024 2 6 73 0 13 1024 1024 18 14 308 0 13 1024 1024 58 42 1216 0 13 1024 1024 16 8 29705 0 13 1024 1024 186 30 8074 0 13 1024 1024 0 0 0 0 13 1024 1024 1 3 1 0 13 1024 1024 3 9 37 0 13 512 512 13 15 345 0 29 512 512 52 67 21831 0 29 512 512 151 101 6908696 0 29 512 512 11 45 8517 0 29 512 512 22 48 6179 0 29 512 512 52 67 52 0 29 512 512 19 51 38 0 29 512 512 388 32 487 0 29 256 256 32 148 835541 0 61 256 256 1 14 5787696 0 61 256 256 666 234 861255 0 61 256 256 32776 179 4656985 0 61 256 256 265 215 11357 0 61 256 256 515 310 830063 0 61 256 256 59 181 502 0 61 256 256 35 100 54 0 61 128 128 41 300 126576244 0 125 128 128 46 171 6414296 0 125 128 128 1820 4132 11381392 0 125 128 128 2763 337 11367519 0 125 128 128 14520 360 2498968 0 125 128 128 336 253 700 0 125 128 128 42 237 48 0 125 128 128 75 421 107 0 125 64 64 36 584 178329536 0 253 64 64 53 319 8833 0 253 64 64 9539 1186 297503 0 253 64 64 636 666 685 0 253 64 64 9326 532 17263 0 253 64 64 288 1014 18993 0 253 64 64 184 64 829610 0 253 64 64 51 445 312 0 253 32 32 9 363 161 0 253 32 32 37 831 9167 0 253 32 32 391 1593 14556 0 253 32 32 3237 1599 3261 0 253 32 32 680 932 24730 0 253 32 32 68 800 75 0 253 32 32 242 502 307 0 253 32 32 554 1802 684 0 253 16 16 38 1954 243 0 253 16 16 2 247 19411 0 253 16 16 520 2717 20087 0 253 16 16 2860 2369 3099 0 253 16 16 526 1715 851316 0 253 16 16 2 496 3 0 253 16 16 19 1475 51 0 253 16 16 27 1467 56 0 253 mt_zone 24 429 401 429 0 253 mt_stats_zone 64 429 83 429 0 253 64 pcpu 8 3008 1856 3255 0 253 fakepg 104 0 532 24 0 125 VMSPACE 2552 246 40 18200 0 3 MAP ENTRY 112 5656 1274 861231 0 125 KMAP ENTRY 112 7 201 7 0 125 MAP 232 2 65 2 0 61 RADIX NODE 144 533581 4489 4840327 0 90 VM OBJECT 256 3432 120858 5083071 0 61 vmem btag 56 15315 1777 15790 0 253 vmem 1856 0 1 0 0 5 256 Bucket 2048 31 32 161591 0 31 128 Bucket 1024 0 0 133987 0 13 64 Bucket 512 0 0 134289 0 29 32 Bucket 256 608 1536 103869 0 61 16 Bucket 128 239 1155 26038 0 125 12 Bucket 96 2 80 25359 0 125 8 Bucket 64 -1 0 72069 0 253 6 Bucket 48 0 0 3276 0 253 4 Bucket 32 8 736 13827 0 253 UMA Hash 256 1 10 7 0 0 UMA Slabs 112 4441 937 14790 0 0 UMA Zones 1960 82 0 82 0 0 UMA Kegs 216 75 4 75 0 0 db:0:pho> show umacache Zone Size Used Free Requests Bucket vm pgcache 104 63625 2335 1683541 253 vm pgcache 104 2080766 698 18159215 253 buf free cache 984 2783 17395 2629762 26 buffer arena-65 65536 0 0 14116 1 buffer arena-61 61440 0 0 14116 1 buffer arena-57 57344 0 0 14116 1 buffer arena-53 53248 0 0 14116 1 buffer arena-49 49152 0 0 14116 1 buffer arena-45 45056 0 0 14116 1 buffer arena-40 40960 0 0 14116 1 buffer arena-36 36864 0 0 14116 1 buffer arena-32 32768 4656 2997 828757 11 buffer arena-28 28672 0 0 14116 1 buffer arena-24 24576 0 0 14116 1 buffer arena-20 20480 0 0 14116 1 buffer arena-16 16384 2 4 14130 1 buffer arena-12 12288 0 0 14116 1 buffer arena-81 8192 0 0 14116 1 buffer arena-40 4096 0 0 14116 1 db:0:pho> acttrace Tracing command stealer pid 18216 tid 100503 td 0xfffff805b8958000 (CPU 4) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0008597df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0008597e10 trap() at trap+0x48/frame 0xfffffe0008597f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0008597f20 --- trap 0x13, rip = 0x20137d, rsp = 0x7fffffffe690, rbp = 0x7fffffffe6c0 --- Tracing command stealer pid 18207 tid 100267 td 0xfffff8015717f000 (CPU 5) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe00085a3df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe00085a3e10 trap() at trap+0x48/frame 0xfffffe00085a3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00085a3f20 --- trap 0x13, rip = 0xffffffff80c3be71, rsp = 0xfffffe00aea906c0, rbp = 0xfffffe00aea906f0 --- witness_unlock() at witness_unlock+0x1/frame 0xfffffe00aea906f0 vm_page_alloc_domain_after() at vm_page_alloc_domain_after+0x1ae/frame 0xfffffe00aea90760 vm_page_alloc() at vm_page_alloc+0x74/frame 0xfffffe00aea907c0 vm_fault_hold() at vm_fault_hold+0x1281/frame 0xfffffe00aea90910 vm_fault() at vm_fault+0x60/frame 0xfffffe00aea90950 trap_pfault() at trap_pfault+0x188/frame 0xfffffe00aea909a0 trap() at trap+0x46b/frame 0xfffffe00aea90ab0 calltrap() at calltrap+0x8/frame 0xfffffe00aea90ab0 --- trap 0xc, rip = 0x800415885, rsp = 0x7fffffffe338, rbp = 0x7fffffffe380 --- Tracing command stealer pid 18204 tid 100493 td 0xfffff804e2a135c0 (CPU 2) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe000857fdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe000857fe10 trap() at trap+0x48/frame 0xfffffe000857ff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe000857ff20 --- trap 0x13, rip = 0x201381, rsp = 0x7fffffffe690, rbp = 0x7fffffffe6c0 --- Tracing command stealer pid 18151 tid 100447 td 0xfffff805b8e53000 (CPU 10) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe00085dfdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe00085dfe10 trap() at trap+0x48/frame 0xfffffe00085dff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00085dff20 --- trap 0x13, rip = 0x20138a, rsp = 0x7fffffffe690, rbp = 0x7fffffffe6c0 --- Tracing command stealer pid 18106 tid 100422 td 0xfffff805b0623000 (CPU 3) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe000858bdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe000858be10 trap() at trap+0x48/frame 0xfffffe000858bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe000858bf20 --- trap 0x13, rip = 0x20137d, rsp = 0x7fffffffe690, rbp = 0x7fffffffe6c0 --- Tracing command stealer pid 18100 tid 100426 td 0xfffff805b2a825c0 (CPU 6) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe00085afdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe00085afe10 trap() at trap+0x48/frame 0xfffffe00085aff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00085aff20 --- trap 0x13, rip = 0xffffffff80c3ac12, rsp = 0xfffffe00aedab640, rbp = 0xfffffe00aedab6b0 --- witness_checkorder() at witness_checkorder+0xe2/frame 0xfffffe00aedab6b0 __mtx_lock_flags() at __mtx_lock_flags+0x95/frame 0xfffffe00aedab700 pmap_enter() at pmap_enter+0x2ba/frame 0xfffffe00aedab7c0 vm_fault_hold() at vm_fault_hold+0x18e9/frame 0xfffffe00aedab910 vm_fault() at vm_fault+0x60/frame 0xfffffe00aedab950 trap_pfault() at trap_pfault+0x188/frame 0xfffffe00aedab9a0 trap() at trap+0x46b/frame 0xfffffe00aedabab0 calltrap() at calltrap+0x8/frame 0xfffffe00aedabab0 --- trap 0xc, rip = 0x800415885, rsp = 0x7fffffffe338, rbp = 0x7fffffffe380 --- Tracing command stealer pid 18073 tid 100228 td 0xfffff800070c8000 (CPU 7) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe00085bbdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe00085bbe10 trap() at trap+0x48/frame 0xfffffe00085bbf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00085bbf20 --- trap 0x13, rip = 0x201381, rsp = 0x7fffffffe690, rbp = 0x7fffffffe6c0 --- Tracing command stealer pid 18047 tid 100168 td 0xfffff8000bb39000 (CPU 0) cpustop_handler() at cpustop_handler+0x2d/frame 0xffffffff82052b70 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xffffffff82052b90 trap() at trap+0x48/frame 0xffffffff82052ca0 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff82052ca0 --- trap 0x13, rip = 0x20137d, rsp = 0x7fffffffe690, rbp = 0x7fffffffe6c0 --- Tracing command stealer pid 18023 tid 100385 td 0xfffff80157f3f000 (CPU 8) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe00085c7df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe00085c7e10 trap() at trap+0x48/frame 0xfffffe00085c7f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00085c7f20 --- trap 0x13, rip = 0x20137d, rsp = 0x7fffffffe690, rbp = 0x7fffffffe6c0 --- Tracing command stealer pid 18018 tid 100444 td 0xfffff805c16e55c0 (CPU 9) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe00085d3df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe00085d3e10 trap() at trap+0x48/frame 0xfffffe00085d3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00085d3f20 --- trap 0x13, rip = 0x201381, rsp = 0x7fffffffe690, rbp = 0x7fffffffe6c0 --- Tracing command pagedaemon pid 30 tid 100128 td 0xfffff80005894000 (CPU 11) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe00085ebdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe00085ebe10 trap() at trap+0x48/frame 0xfffffe00085ebf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00085ebf20 --- trap 0x13, rip = 0xffffffff80f1d24d, rsp = 0xfffffe0008915650, rbp = 0xfffffe0008915670 --- vm_page_change_lock() at vm_page_change_lock+0xd/frame 0xfffffe0008915670 vm_pageout_worker() at vm_pageout_worker+0xf49/frame 0xfffffe0008915a30 vm_pageout() at vm_pageout+0x156/frame 0xfffffe0008915a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0008915ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0008915ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100130 td 0xfffff800050b35c0 (CPU 1) kdb_enter() at kdb_enter+0x3b/frame 0xfffffe000891f280 vpanic() at vpanic+0x1ba/frame 0xfffffe000891f2d0 panic() at panic+0x43/frame 0xfffffe000891f330 witness_unlock() at witness_unlock+0xea/frame 0xfffffe000891f370 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe000891f3a0 swp_pager_trimswapspace() at swp_pager_trimswapspace+0xd5/frame 0xfffffe000891f400 swap_pager_putpages() at swap_pager_putpages+0x56c/frame 0xfffffe000891f4a0 vm_pageout_flush() at vm_pageout_flush+0xff/frame 0xfffffe000891f580 vm_pageout_cluster() at vm_pageout_cluster+0x3e6/frame 0xfffffe000891f7f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x2f6/frame 0xfffffe000891fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000891fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000891fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:pho> ps pid ppid pgrp uid state wmesg wchan cmd 18234 18232 2477 0 S piperd 0xfffff803df9d4000 sed 18233 18232 2477 0 D swread 0xfffff8011ba3978c sh 18232 18229 2477 0 SW wait 0xfffff80157f47000 sh 18231 16919 2367 0 ?W+ grep 18229 2510 2477 0 S piperd 0xfffff803c9fe32f8 sh 18218 18017 18017 2007 R+ stealer 18217 18017 18017 2007 R+ stealer 18216 18017 18017 2007 R+ CPU 4 stealer 18215 18017 18017 2007 R+ stealer 18214 18017 18017 2007 R+ stealer 18213 18017 18017 2007 D+ swread 0xfffff805af11a98c stealer 18212 18017 18017 2007 D+ swread 0xfffff8015728718c stealer 18211 18017 18017 2007 D+ swread 0xfffff8059ab16e8c stealer 18210 18017 18017 2007 ?W+ stealer 18209 18017 18017 2007 ?W+ stealer 18208 18017 18017 2007 R+ stealer 18207 18017 18017 2007 R+ CPU 5 stealer 18206 18017 18017 2007 ?W+ stealer 18205 18017 18017 2007 R+ stealer 18204 18017 18017 2007 R+ CPU 2 stealer 18203 18017 18017 2007 R+ stealer 18202 18017 18017 2007 R+ stealer 18201 18017 18017 2007 D+ swread 0xfffff801a1fb058c stealer 18200 18017 18017 2007 ?W+ stealer 18199 18017 18017 2007 R+ stealer 18198 18017 18017 2007 R+ stealer 18197 18017 18017 2007 R+ stealer 18196 18017 18017 2007 R+ stealer 18195 18017 18017 2007 R+ stealer 18194 18017 18017 2007 R+ stealer 18193 18017 18017 2007 ?W+ stealer 18192 18017 18017 2007 R+ stealer 18191 18017 18017 2007 R+ stealer 18190 18017 18017 2007 ?W+ stealer 18189 18017 18017 2007 R+ stealer 18188 18017 18017 2007 R+ stealer 18187 18017 18017 2007 D+ swread 0xfffff80003ad2a8c stealer 18186 18017 18017 2007 R+ stealer 18185 18017 18017 2007 R+ stealer 18184 18017 18017 2007 D+ swread 0xfffff805b093428c stealer 18183 18017 18017 2007 D+ swread 0xfffff805a513478c stealer 18182 18017 18017 2007 ?W+ stealer 18181 18017 18017 2007 D+ swread 0xfffff8011bbf5d8c stealer 18180 18017 18017 2007 R+ stealer 18179 18017 18017 2007 R+ stealer 18178 18017 18017 2007 R+ stealer 18177 18017 18017 2007 D+ swread 0xfffff805a550248c stealer 18176 18017 18017 2007 ?W+ stealer 18175 18017 18017 2007 ?W+ stealer 18174 18017 18017 2007 ?W+ stealer 18173 18017 18017 2007 D+ swread 0xfffff8022edb9e8c stealer 18172 18017 18017 2007 R+ stealer 18171 18017 18017 2007 R+ stealer 18170 18017 18017 2007 R+ stealer 18169 18017 18017 2007 D+ swread 0xfffff805ae7d838c stealer 18168 18017 18017 2007 R+ stealer 18167 18017 18017 2007 R+ stealer 18166 18017 18017 2007 ?W+ stealer 18165 18017 18017 2007 R+ stealer 18164 18017 18017 2007 R+ stealer 18163 18017 18017 2007 ?W+ stealer 18162 18017 18017 2007 D+ swread 0xfffff805aee8788c stealer 18161 18017 18017 2007 D+ swread 0xfffff805a5aaa08c stealer 18160 18017 18017 2007 R+ stealer 18159 18017 18017 2007 R+ stealer 18158 18017 18017 2007 ?W+ stealer 18157 18017 18017 2007 D+ swread 0xfffff805b2d8ca8c stealer 18156 18017 18017 2007 ?W+ stealer 18155 18017 18017 2007 D+ swread 0xfffff8000bb2bd8c stealer 18154 18017 18017 2007 ?W+ stealer 18153 18017 18017 2007 R+ stealer 18152 18017 18017 2007 ?W+ stealer 18151 18017 18017 2007 R+ CPU 10 stealer 18150 18017 18017 2007 R+ stealer 18149 18017 18017 2007 R+ stealer 18148 18017 18017 2007 ?W+ stealer 18147 18017 18017 2007 ?W+ stealer 18146 18017 18017 2007 ?W+ stealer 18145 18017 18017 2007 D+ swread 0xfffff8047f79558c stealer 18144 18017 18017 2007 D+ swread 0xfffff8000b8cb58c stealer 18143 18017 18017 2007 R+ stealer 18142 18017 18017 2007 D+ swread 0xfffff805b83cbb8c stealer 18141 18017 18017 2007 R+ stealer 18140 18017 18017 2007 D+ swread 0xfffff8059aa63d8c stealer 18139 18017 18017 2007 R+ stealer 18138 18017 18017 2007 ?W+ stealer 18137 18017 18017 2007 ?W+ stealer 18136 18017 18017 2007 D+ swread 0xfffff805ab39348c stealer 18135 18017 18017 2007 R+ stealer 18134 18017 18017 2007 R+ stealer 18133 18017 18017 2007 ?W+ stealer 18132 18017 18017 2007 R+ stealer 18131 18017 18017 2007 ?W+ stealer 18130 18017 18017 2007 R+ stealer 18129 18017 18017 2007 R+ stealer 18128 18017 18017 2007 R+ stealer 18127 18017 18017 2007 R+ stealer 18126 18017 18017 2007 ?W+ stealer 18125 18017 18017 2007 R+ stealer 18124 18017 18017 2007 R+ stealer 18123 18017 18017 2007 R+ stealer 18122 18017 18017 2007 R+ stealer 18121 18017 18017 2007 R+ stealer 18120 18017 18017 2007 D+ swread 0xfffff8059a00f18c stealer 18119 18017 18017 2007 R+ stealer 18118 18017 18017 2007 R+ stealer 18117 18017 18017 2007 ?W+ stealer 18116 18017 18017 2007 ?W+ stealer 18115 18017 18017 2007 R+ stealer 18114 18017 18017 2007 R+ stealer 18113 18017 18017 2007 R+ stealer 18112 18017 18017 2007 ?W+ stealer 18111 18017 18017 2007 ?W+ stealer 18110 18017 18017 2007 R+ stealer 18109 18017 18017 2007 R+ stealer 18108 18017 18017 2007 R+ stealer 18107 18017 18017 2007 D+ swread 0xfffff8011bc9b28c stealer 18106 18017 18017 2007 R+ CPU 3 stealer 18105 18017 18017 2007 R+ stealer 18104 18017 18017 2007 R+ stealer 18103 18017 18017 2007 D+ swread 0xfffff805b0a0288c stealer 18102 18017 18017 2007 ?W+ stealer 18101 18017 18017 2007 R+ stealer 18100 18017 18017 2007 R+ CPU 6 stealer 18099 18017 18017 2007 D+ swread 0xfffff801a105628c stealer 18098 18017 18017 2007 R+ stealer 18097 18017 18017 2007 R+ stealer 18096 18017 18017 2007 R+ stealer 18095 18017 18017 2007 ?W+ stealer 18094 18017 18017 2007 ?W+ stealer 18093 18017 18017 2007 R+ stealer 18092 18017 18017 2007 R+ stealer 18091 18017 18017 2007 ?W+ stealer 18090 18017 18017 2007 R+ stealer 18089 18017 18017 2007 R+ stealer 18088 18017 18017 2007 R+ stealer 18087 18017 18017 2007 R+ stealer 18086 18017 18017 2007 R+ stealer 18085 18017 18017 2007 R+ stealer 18084 18017 18017 2007 R+ stealer 18083 18017 18017 2007 R+ stealer 18082 18017 18017 2007 R+ stealer 18081 18017 18017 2007 ?W+ stealer 18080 18017 18017 2007 ?W+ stealer 18079 18017 18017 2007 ?W+ stealer 18078 18017 18017 2007 R+ stealer 18077 18017 18017 2007 R+ stealer 18076 18017 18017 2007 D+ swread 0xfffff801f916998c stealer 18075 18017 18017 2007 ?W+ stealer 18074 18017 18017 2007 R+ stealer 18073 18017 18017 2007 R+ CPU 7 stealer 18072 18017 18017 2007 R+ stealer 18071 18017 18017 2007 R+ stealer 18070 18017 18017 2007 D+ swread 0xfffff801575ef78c stealer 18069 18017 18017 2007 R+ stealer 18068 18017 18017 2007 R+ stealer 18067 18017 18017 2007 R+ stealer 18066 18017 18017 2007 ?W+ stealer 18065 18017 18017 2007 R+ stealer 18064 18017 18017 2007 D+ swread 0xfffff8015741ae8c stealer 18063 18017 18017 2007 ?W+ stealer 18062 18017 18017 2007 R+ stealer 18061 18017 18017 2007 R+ stealer 18060 18017 18017 2007 R+ stealer 18059 18017 18017 2007 R+ stealer 18058 18017 18017 2007 R+ stealer 18057 18017 18017 2007 R+ stealer 18056 18017 18017 2007 R+ stealer 18055 18017 18017 2007 D+ swread 0xfffff8000537b18c stealer 18054 18017 18017 2007 R+ stealer 18053 18017 18017 2007 R+ stealer 18052 18017 18017 2007 D+ swread 0xfffff805a553ad8c stealer 18051 18017 18017 2007 R+ stealer 18050 18017 18017 2007 R+ stealer 18049 18017 18017 2007 R+ stealer 18048 18017 18017 2007 R+ stealer 18047 18017 18017 2007 R+ CPU 0 stealer 18046 18017 18017 2007 ?W+ stealer 18045 18017 18017 2007 R+ stealer 18044 18017 18017 2007 ?W+ stealer 18043 18017 18017 2007 ?W+ stealer 18042 18017 18017 2007 D+ swread 0xfffff8011ba37e8c stealer 18041 18017 18017 2007 R+ stealer 18040 18017 18017 2007 R+ stealer 18039 18017 18017 2007 R+ stealer 18038 18017 18017 2007 R+ stealer 18037 18017 18017 2007 ?W+ stealer 18036 18017 18017 2007 R+ stealer 18035 18017 18017 2007 R+ stealer 18034 18017 18017 2007 R+ stealer 18033 18017 18017 2007 R+ stealer 18032 18017 18017 2007 R+ stealer 18031 18017 18017 2007 R+ stealer 18030 18017 18017 2007 ?W+ stealer 18029 18017 18017 2007 R+ stealer 18028 18017 18017 2007 R+ stealer 18027 18017 18017 2007 R+ stealer 18026 18017 18017 2007 R+ stealer 18025 18017 18017 2007 R+ stealer 18024 18017 18017 2007 R+ stealer 18023 18017 18017 2007 R+ CPU 8 stealer 18022 18017 18017 2007 ?W+ stealer 18021 18017 18017 2007 D+ swread 0xfffff805ab00388c stealer 18020 18017 18017 2007 R+ stealer 18019 18017 18017 2007 R+ stealer 18018 18017 18017 2007 R+ CPU 9 stealer 18017 18015 18017 2007 SW+ wait 0xfffff801573b4000 stealer 18015 16919 2367 0 SW+ wait 0xfffff8011b752000 su 18006 0 0 0 DL biord 0xfffffe0002ba0158 [md10] 16919 16917 2367 0 SW+ wait 0xfffff800037cb000 sh 16918 2367 2367 0 S+ piperd 0xfffff8004f87f000 tee 16917 2367 2367 0 SW+ wait 0xfffff8000589f530 sh 2513 2477 2477 0 S piperd 0xfffff8004f36e000 sh 2511 2477 2477 0 S piperd 0xfffff800053765f0 awk 2510 2477 2477 0 ?W sh 2477 1 2477 0 SWs wait 0xfffff8004f9b5530 sh 2367 2364 2367 0 SW+ wait 0xfffff8000589f000 sh 2364 2362 2364 0 SW+ wait 0xfffff8000b687a60 bash 2362 2361 2362 0 SW+ pause 0xfffff8000703e5d8 csh 2361 2357 2361 2006 SW+ wait 0xfffff8004f0e7a60 su 2357 2356 2357 2006 SWs+ wait 0xfffff8000703f000 bash 2356 2351 2351 2006 S select 0xfffff80005417440 sshd 2351 2287 2351 0 Ss select 0xfffff800055496c0 sshd 2347 2346 2347 0 S+ ttyin 0xfffff800072500b0 csh 2346 1 2346 0 SWs+ wait 0xfffff8000b66b530 login 2345 1 2345 0 Ss+ ttyin 0xfffff800072504b0 getty 2344 1 2344 0 Ss+ ttyin 0xfffff800050410b0 getty 2343 1 2343 0 Ss+ ttyin 0xfffff800050414b0 getty 2342 1 2342 0 Ss+ ttyin 0xfffff800050418b0 getty 2341 1 2341 0 Ss+ ttyin 0xfffff80005041cb0 getty 2340 1 2340 0 Ss+ ttyin 0xfffff800050400b0 getty 2339 1 2339 0 Ss+ ttyin 0xfffff800050404b0 getty 2338 1 2338 0 Ss+ ttyin 0xfffff800050408b0 getty 2337 1 2337 0 Ss+ ttyin 0xfffff80005040cb0 getty 2291 1 2291 0 SWs nanslp 0xffffffff81e90157 cron 2287 1 2287 0 Ss select 0xfffff80007342a40 sshd 2258 1 2258 123 Ss (threaded) ntpd 100197 S select 0xfffff8000713d540 ntpd 100475 S usem 0xfffff805b27c0280 ntpd 2197 1 2197 0 Ss rpcsvc 0xfffff8011b66b460 NLM: master 2194 1 2194 0 Ss select 0xfffff800072447c0 rpc.statd 2148 1 2148 0 Ss nanslp 0xffffffff81e90152 watchdogd 2058 1 2058 0 Ss select 0xfffff80005926bc0 rpcbind 2048 1 2048 0 Ss select 0xfffff8004f1caf40 syslogd 1977 1 1977 0 Ss select 0xfffff80005417540 devd 1972 1 1972 65 Ss select 0xfffff80003c0eb40 dhclient 1928 1 1928 0 Ss select 0xfffff80005417640 dhclient 1925 1 1925 0 Ss select 0xfffff8004f8670c0 dhclient 34 0 0 0 DL syncer 0xffffffff82032640 [syncer] 33 0 0 0 DL vlruwt 0xfffff8000589e000 [vnlru] 32 0 0 0 DL (threaded) [bufdaemon] 100132 D qsleep 0xffffffff82031ad8 [bufdaemon] 100133 D - 0xffffffff81a0a8c0 [bufspacedaemon-0] 100134 D - 0xffffffff81a12b80 [bufspacedaemon-1] 100135 D - 0xffffffff81a1ae40 [bufspacedaemon-2] 100136 D - 0xffffffff81a23100 [bufspacedaemon-3] 100137 D - 0xffffffff81a2b3c0 [bufspacedaemon-4] 100138 D - 0xffffffff81a33680 [bufspacedaemon-5] 100139 D - 0xffffffff81a3b940 [bufspacedaemon-6] 100151 D sdflush 0xfffff800071ec8e8 [/ worker] 100199 D sdflush 0xfffff800038fc8e8 [/tmp worker] 31 0 0 0 RL [vmdaemon] 30 0 0 0 RL (threaded) [pagedaemon] 100128 Run CPU 11 [dom0] 100130 Run CPU 1 [laundry: dom0] 100131 D umarcl 0xffffffff80f01900 [uma] 29 0 0 0 DL idle 0xfffff80003af6000 [enc_daemon1] 28 0 0 0 DL idle 0xfffff80003af6530 [enc_daemon0] 27 0 0 0 DL - 0xffffffff81cef820 [rand_harvestq] 26 0 0 0 DL waiting 0xffffffff820cccb0 [sctp_iterator] 25 0 0 0 DL - 0xffffffff820314dc [soaiod4] 24 0 0 0 DL - 0xffffffff820314dc [soaiod3] 23 0 0 0 DL - 0xffffffff820314dc [soaiod2] 22 0 0 0 DL - 0xffffffff820314dc [soaiod1] 21 0 0 0 DL (threaded) [usb] 100096 D - 0xfffffe009b7aa460 [usbus0] 100097 D - 0xfffffe009b7aa4b8 [usbus0] 100098 D - 0xfffffe009b7aa510 [usbus0] 100099 D - 0xfffffe009b7aa568 [usbus0] 100100 D - 0xfffffe009b7aa5c0 [usbus0] 100102 D - 0xfffffe00087d6d10 [usbus1] 100103 D - 0xfffffe00087d6d68 [usbus1] 100104 D - 0xfffffe00087d6dc0 [usbus1] 100105 D - 0xfffffe00087d6e18 [usbus1] 100106 D - 0xfffffe00087d6e70 [usbus1] 100107 D - 0xfffffe009bc3dd10 [usbus2] 100108 D - 0xfffffe009bc3dd68 [usbus2] 100109 D - 0xfffffe009bc3ddc0 [usbus2] 100110 D - 0xfffffe009bc3de18 [usbus2] 100111 D - 0xfffffe009bc3de70 [usbus2] 20 0 0 0 DL (threaded) [cam] 100091 D - 0xffffffff81bcabc0 [doneq0] 100092 D - 0xffffffff81bcac40 [doneq1] 100093 D - 0xffffffff81bcacc0 [doneq2] 100125 D - 0xffffffff81bcaa88 [scanner] 19 0 0 0 DL crypto_ 0xfffff8000502a450 [crypto returns 11] 18 0 0 0 DL crypto_ 0xfffff8000502a3f0 [crypto returns 10] 17 0 0 0 DL crypto_ 0xfffff8000502a390 [crypto returns 9] 16 0 0 0 DL crypto_ 0xfffff8000502a330 [crypto returns 8] 15 0 0 0 DL crypto_ 0xfffff8000502a2d0 [crypto returns 7] 9 0 0 0 DL crypto_ 0xfffff8000502a270 [crypto returns 6] 8 0 0 0 DL crypto_ 0xfffff8000502a210 [crypto returns 5] 7 0 0 0 DL crypto_ 0xfffff8000502a1b0 [crypto returns 4] 6 0 0 0 DL crypto_ 0xfffff8000502a150 [crypto returns 3] 5 0 0 0 DL crypto_ 0xfffff8000502a0f0 [crypto returns 2] 4 0 0 0 DL crypto_ 0xfffff8000502a090 [crypto returns 1] 3 0 0 0 DL crypto_ 0xfffff8000502a030 [crypto returns 0] 2 0 0 0 DL crypto_ 0xffffffff82048e78 [crypto] 14 0 0 0 DL seqstat 0xfffff80003c7dc88 [sequencer 00] 13 0 0 0 DL (threaded) [geom] 100062 D - 0xffffffff82087140 [g_event] 100063 D - 0xffffffff82087150 [g_up] 100064 D - 0xffffffff82087138 [g_down] 12 0 0 0 WL (threaded) [intr] 100017 I [swi6: task queue] 100018 I [swi6: Giant taskq] 100020 I [swi5: fast taskq] 100047 I [swi1: netisr 0] 100048 I [swi3: vm] 100049 I [swi4: clock (0)] 100050 I [swi4: clock (1)] 100051 I [swi4: clock (2)] 100052 I [swi4: clock (3)] 100053 I [swi4: clock (4)] 100054 I [swi4: clock (5)] 100055 I [swi4: clock (6)] 100056 I [swi4: clock (7)] 100057 I [swi4: clock (8)] 100058 I [swi4: clock (9)] 100059 I [swi4: clock (10)] 100060 I [swi4: clock (11)] 100094 I [irq56: ahci0] 100095 I [irq19: xhci0] 100101 I [irq18: ehci0 ehci1] 100112 I [irq71: ahci1] 100113 I [swi0: uart uart] 100177 I [irq72: ioat0] 100178 I [irq73: ioat1] 100179 I [irq74: ioat2] 100180 I [irq75: ioat3] 100181 I [irq76: ioat4] 100182 I [irq77: ioat5] 100183 I [irq78: ioat6] 100184 I [irq79: ioat7] 11 0 0 0 RL (threaded) [idle] 100003 CanRun [idle: cpu0] 100004 CanRun [idle: cpu1] 100005 CanRun [idle: cpu2] 100006 CanRun [idle: cpu3] 100007 CanRun [idle: cpu4] 100008 CanRun [idle: cpu5] 100009 CanRun [idle: cpu6] 100010 CanRun [idle: cpu7] 100011 CanRun [idle: cpu8] 100012 CanRun [idle: cpu9] 100013 CanRun [idle: cpu10] 100014 CanRun [idle: cpu11] 1 0 1 0 SLs wait 0xfffff800037ca530 [init] 10 0 0 0 DL audit_w 0xffffffff820cd9d0 [audit] 0 0 0 0 DLs (threaded) [kernel] 100000 D swapin 0xffffffff82087180 [swapper] 100015 D - 0xfffff800036b8e00 [kqueue_ctx taskq] 100016 D - 0xfffff800036b8d00 [aiod_kick taskq] 100019 D - 0xfffff800036b8a00 [thread taskq] 100021 D - 0xfffff8000314bc00 [config_0] 100022 D - 0xfffff8000314bb00 [if_io_tqg_0] 100023 D - 0xfffff8000314ba00 [if_io_tqg_1] 100024 D - 0xfffff8000314b900 [if_io_tqg_2] 100025 D - 0xfffff8000314b800 [if_io_tqg_3] 100026 D - 0xfffff8000314b700 [if_io_tqg_4] 100027 D - 0xfffff8000314b600 [if_io_tqg_5] 100028 D - 0xfffff8000314b500 [if_io_tqg_6] 100029 D - 0xfffff8000314b400 [if_io_tqg_7] 100030 D - 0xfffff8000314b300 [if_io_tqg_8] 100031 D - 0xfffff8000314b200 [if_io_tqg_9] 100032 D - 0xfffff8000314b100 [if_io_tqg_10] 100033 D - 0xfffff8000314b000 [if_io_tqg_11] 100034 D - 0xfffff8000314ae00 [softirq_0] 100035 D - 0xfffff8000314ad00 [softirq_1] 100036 D - 0xfffff8000314ac00 [softirq_2] 100037 D - 0xfffff8000314ab00 [softirq_3] 100038 D - 0xfffff8000314aa00 [softirq_4] 100039 D - 0xfffff8000314a900 [softirq_5] 100040 D - 0xfffff8000314a800 [softirq_6] 100041 D - 0xfffff8000314a700 [softirq_7] 100042 D - 0xfffff8000314a600 [softirq_8] 100043 D - 0xfffff8000314a500 [softirq_9] 100044 D - 0xfffff8000314a400 [softirq_10] 100045 D - 0xfffff8000314a300 [softirq_11] 100046 D - 0xfffff80003d22100 [if_config_tqg_0] 100061 D - 0xfffff80003c87100 [firmware taskq] 100066 D - 0xfffff80003c87000 [crypto_0] 100067 D - 0xfffff80003c87000 [crypto_1] 100068 D - 0xfffff80003c87000 [crypto_2] 100069 D - 0xfffff80003c87000 [crypto_3] 100070 D - 0xfffff80003c87000 [crypto_4] 100071 D - 0xfffff80003c87000 [crypto_5] 100072 D - 0xfffff80003c87000 [crypto_6] 100073 D - 0xfffff80003c87000 [crypto_7] 100074 D - 0xfffff80003c87000 [crypto_8] 100075 D - 0xfffff80003c87000 [crypto_9] 100076 D - 0xfffff80003c87000 [crypto_10] 100077 D - 0xfffff80003c87000 [crypto_11] 100114 D - 0xfffff80007408200 [mca taskq] 100120 D - 0xfffff80005861600 [acpi_task_0] 100121 D - 0xfffff80005861600 [acpi_task_1] 100122 D - 0xfffff80005861600 [acpi_task_2] 100124 D - 0xfffff80003c88e00 [CAM taskq] 18228 2510 2477 0 Z sed 18227 2510 2477 0 Z sed 18226 2510 2477 0 Z vmstat db:0:pho> allt Tracing command sed pid 18234 tid 100291 td 0xfffff8015795c5c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aeb086a0 mi_switch() at mi_switch+0x174/frame 0xfffffe00aeb086d0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aeb08710 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00aeb08770 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aeb087a0 _sleep() at _sleep+0x2d0/frame 0xfffffe00aeb08840 pipe_read() at pipe_read+0x356/frame 0xfffffe00aeb088a0 dofileread() at dofileread+0x81/frame 0xfffffe00aeb088f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00aeb08930 sys_read() at sys_read+0x84/frame 0xfffffe00aeb08980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00aeb08ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aeb08ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80041d22a, rsp = 0x7fffffffe3c8, rbp = 0x7fffffffe3e0 --- Tracing command sh pid 18233 tid 100290 td 0xfffff801578e7000 sched_switch() at sched_switch+0x713/frame 0xfffffe00aeb03550 mi_switch() at mi_switch+0x174/frame 0xfffffe00aeb03580 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aeb035c0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00aeb03600 _sleep() at _sleep+0x279/frame 0xfffffe00aeb036a0 swap_pager_getpages() at swap_pager_getpages+0x6c2/frame 0xfffffe00aeb03760 vm_pager_get_pages() at vm_pager_get_pages+0x4f/frame 0xfffffe00aeb037c0 vm_fault_hold() at vm_fault_hold+0x1544/frame 0xfffffe00aeb03910 vm_fault() at vm_fault+0x60/frame 0xfffffe00aeb03950 trap_pfault() at trap_pfault+0x188/frame 0xfffffe00aeb039a0 trap() at trap+0x46b/frame 0xfffffe00aeb03ab0 calltrap() at calltrap+0x8/frame 0xfffffe00aeb03ab0 --- trap 0xc, rip = 0x800236a50, rsp = 0x7fffffffd8b0, rbp = 0x7fffffffd900 --- Tracing command sh pid 18232 tid 100394 td 0xfffff80157f40000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe000891ea90 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe000891eaa0 trap() at trap+0x5b/frame 0xfffffe000891ebb0 calltrap() at calltrap+0x8/frame 0xfffffe000891ebb0 --- trap 0xc, rip = 0xffffffff8107be66, rsp = 0xfffffe000891ec80, rbp = 0xfffffe000891ec90 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe000891ec90 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe000891ed30 db_command() at db_command+0x279/frame 0xfffffe000891ee00 db_script_exec() at db_script_exec+0x188/frame 0xfffffe000891eea0 db_command() at db_command+0x279/frame 0xfffffe000891ef70 db_command_loop() at db_command_loop+0x64/frame 0xfffffe000891ef80 db_trap() at db_trap+0xef/frame 0xfffffe000891f010 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe000891f090 trap() at trap+0x811/frame 0xfffffe000891f1a0 calltrap() at calltrap+0x8/frame 0xfffffe000891f1a0 --- trap 0x3, rip = 0xffffffff80c1992b, rsp = 0xfffffe000891f270, rbp = 0xfffffe000891f280 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe000891f280 vpanic() at vpanic+0x1ba/frame 0xfffffe000891f2d0 panic() at panic+0x43/frame 0xfffffe000891f330 witness_unlock() at witness_unlock+0xea/frame 0xfffffe000891f370 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe000891f3a0 swp_pager_trimswapspace() at swp_pager_trimswapspace+0xd5/frame 0xfffffe000891f400 swap_pager_putpages() at swap_pager_putpages+0x56c/frame 0xfffffe000891f4a0 vm_pageout_flush() at vm_pageout_flush+0xff/frame 0xfffffe000891f580 vm_pageout_cluster() at vm_pageout_cluster+0x3e6/frame 0xfffffe000891f7f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x2f6/frame 0xfffffe000891fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000891fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000891fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command grep pid 18231 tid 100506 td 0xfffff805c244e5c0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe000891ea90 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe000891eaa0 trap() at trap+0x5b/frame 0xfffffe000891ebb0 calltrap() at calltrap+0x8/frame 0xfffffe000891ebb0 --- trap 0xc, rip = 0xffffffff8107be66, rsp = 0xfffffe000891ec80, rbp = 0xfffffe000891ec90 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe000891ec90 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe000891ed30 db_command() at db_command+0x279/frame 0xfffffe000891ee00 db_script_exec() at db_script_exec+0x188/frame 0xfffffe000891eea0 db_command() at db_command+0x279/frame 0xfffffe000891ef70 db_command_loop() at db_command_loop+0x64/frame 0xfffffe000891ef80 db_trap() at db_trap+0xef/frame 0xfffffe000891f010 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe000891f090 trap() at trap+0x811/frame 0xfffffe000891f1a0 calltrap() at calltrap+0x8/frame 0xfffffe000891f1a0 --- trap 0x3, rip = 0xffffffff80c1992b, rsp = 0xfffffe000891f270, rbp = 0xfffffe000891f280 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe000891f280 vpanic() at vpanic+0x1ba/frame 0xfffffe000891f2d0 panic() at panic+0x43/frame 0xfffffe000891f330 witness_unlock() at witness_unlock+0xea/frame 0xfffffe000891f370 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe000891f3a0 swp_pager_trimswapspace() at swp_pager_trimswapspace+0xd5/frame 0xfffffe000891f400 swap_pager_putpages() at swap_pager_putpages+0x56c/frame 0xfffffe000891f4a0 vm_pageout_flush() at vm_pageout_flush+0xff/frame 0xfffffe000891f580 vm_pageout_cluster() at vm_pageout_cluster+0x3e6/frame 0xfffffe000891f7f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x2f6/frame 0xfffffe000891fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000891fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000891fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sh pid 18229 tid 100219 td 0xfffff800039515c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00ad79f6a0 mi_switch() at mi_switch+0x174/frame 0xfffffe00ad79f6d0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ad79f710 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ad79f770 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ad79f7a0 _sleep() at _sleep+0x2d0/frame 0xfffffe00ad79f840 pipe_read() at pipe_read+0x356/frame 0xfffffe00ad79f8a0 dofileread() at dofileread+0x81/frame 0xfffffe00ad79f8f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00ad79f930 sys_read() at sys_read+0x84/frame 0xfffffe00ad79f980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00ad79fab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ad79fab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80047622a, rsp = 0x7fffffffdf58, rbp = 0x7fffffffe0a0 --- Tracing command stealer pid 18218 tid 100505 td 0xfffff805b8957000 sched_switch() at sched_switch+0x713/frame 0xfffffe00af695a40 mi_switch() at mi_switch+0x174/frame 0xfffffe00af695a70 ast() at ast+0x28d/frame 0xfffffe00af695ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18217 tid 100504 td 0xfffff805b89575c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00781efa40 mi_switch() at mi_switch+0x174/frame 0xfffffe00781efa70 ast() at ast+0x28d/frame 0xfffffe00781efab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18216 tid 100503 td 0xfffff805b8958000 (CPU 4) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0008597df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0008597e10 trap() at trap+0x48/frame 0xfffffe0008597f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0008597f20 --- trap 0x13, rip = 0x20137d, rsp = 0x7fffffffe690, rbp = 0x7fffffffe6c0 --- Tracing command stealer pid 18215 tid 100502 td 0xfffff805b89585c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00781e5660 mi_switch() at mi_switch+0x174/frame 0xfffffe00781e5690 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00781e56d0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00781e5700 _sleep() at _sleep+0x2da/frame 0xfffffe00781e57a0 vm_waitpfault() at vm_waitpfault+0x6b/frame 0xfffffe00781e57c0 vm_fault_hold() at vm_fault_hold+0xabb/frame 0xfffffe00781e5910 vm_fault() at vm_fault+0x60/frame 0xfffffe00781e5950 trap_pfault() at trap_pfault+0x188/frame 0xfffffe00781e59a0 trap() at trap+0x46b/frame 0xfffffe00781e5ab0 calltrap() at calltrap+0x8/frame 0xfffffe00781e5ab0 --- trap 0xc, rip = 0x20137d, rsp = 0x7fffffffe690, rbp = 0x7fffffffe6c0 --- Tracing command stealer pid 18214 tid 100501 td 0xfffff804e2a10000 sched_switch() at sched_switch+0x713/frame 0xfffffe00781e0a40 mi_switch() at mi_switch+0x174/frame 0xfffffe00781e0a70 ast() at ast+0x28d/frame 0xfffffe00781e0ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18213 tid 100500 td 0xfffff804e2a105c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00781db550 mi_switch() at mi_switch+0x174/frame 0xfffffe00781db580 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00781db5c0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00781db600 _sleep() at _sleep+0x279/frame 0xfffffe00781db6a0 swap_pager_getpages() at swap_pager_getpages+0x6c2/frame 0xfffffe00781db760 vm_pager_get_pages() at vm_pager_get_pages+0x4f/frame 0xfffffe00781db7c0 vm_fault_hold() at vm_fault_hold+0x1544/frame 0xfffffe00781db910 vm_fault() at vm_fault+0x60/frame 0xfffffe00781db950 trap_pfault() at trap_pfault+0x188/frame 0xfffffe00781db9a0 trap() at trap+0x46b/frame 0xfffffe00781dbab0 calltrap() at calltrap+0x8/frame 0xfffffe00781dbab0 --- trap 0xc, rip = 0x20137d, rsp = 0x7fffffffe690, rbp = 0x7fffffffe6c0 --- Tracing command stealer pid 18212 tid 100499 td 0xfffff804e2a0c000 sched_switch() at sched_switch+0x713/frame 0xfffffe00781d6550 mi_switch() at mi_switch+0x174/frame 0xfffffe00781d6580 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00781d65c0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00781d6600 _sleep() at _sleep+0x279/frame 0xfffffe00781d66a0 swap_pager_getpages() at swap_pager_getpages+0x6c2/frame 0xfffffe00781d6760 vm_pager_get_pages() at vm_pager_get_pages+0x4f/frame 0xfffffe00781d67c0 vm_fault_hold() at vm_fault_hold+0x1544/frame 0xfffffe00781d6910 vm_fault() at vm_fault+0x60/frame 0xfffffe00781d6950 trap_pfault() at trap_pfault+0x188/frame 0xfffffe00781d69a0 trap() at trap+0x46b/frame 0xfffffe00781d6ab0 calltrap() at calltrap+0x8/frame 0xfffffe00781d6ab0 --- trap 0xc, rip = 0x20137d, rsp = 0x7fffffffe690, rbp = 0x7fffffffe6c0 --- Tracing command stealer pid 18211 tid 100498 td 0xfffff804e2a0c5c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00781d1550 mi_switch() at mi_switch+0x174/frame 0xfffffe00781d1580 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00781d15c0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00781d1600 _sleep() at _sleep+0x279/frame 0xfffffe00781d16a0 swap_pager_getpages() at swap_pager_getpages+0x6c2/frame 0xfffffe00781d1760 vm_pager_get_pages() at vm_pager_get_pages+0x4f/frame 0xfffffe00781d17c0 vm_fault_hold() at vm_fault_hold+0x1544/frame 0xfffffe00781d1910 vm_fault() at vm_fault+0x60/frame 0xfffffe00781d1950 trap_pfault() at trap_pfault+0x188/frame 0xfffffe00781d19a0 trap() at trap+0x46b/frame 0xfffffe00781d1ab0 calltrap() at calltrap+0x8/frame 0xfffffe00781d1ab0 --- trap 0xc, rip = 0x20137d, rsp = 0x7fffffffe690, rbp = 0x7fffffffe6c0 --- Tracing command stealer pid 18210 tid 100497 td 0xfffff804e2a97000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe000891ea90 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe000891eaa0 trap() at trap+0x5b/frame 0xfffffe000891ebb0 calltrap() at calltrap+0x8/frame 0xfffffe000891ebb0 --- trap 0xc, rip = 0xffffffff8107be66, rsp = 0xfffffe000891ec80, rbp = 0xfffffe000891ec90 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe000891ec90 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe000891ed30 db_command() at db_command+0x279/frame 0xfffffe000891ee00 db_script_exec() at db_script_exec+0x188/frame 0xfffffe000891eea0 db_command() at db_command+0x279/frame 0xfffffe000891ef70 db_command_loop() at db_command_loop+0x64/frame 0xfffffe000891ef80 db_trap() at db_trap+0xef/frame 0xfffffe000891f010 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe000891f090 trap() at trap+0x811/frame 0xfffffe000891f1a0 calltrap() at calltrap+0x8/frame 0xfffffe000891f1a0 --- trap 0x3, rip = 0xffffffff80c1992b, rsp = 0xfffffe000891f270, rbp = 0xfffffe000891f280 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe000891f280 vpanic() at vpanic+0x1ba/frame 0xfffffe000891f2d0 panic() at panic+0x43/frame 0xfffffe000891f330 witness_unlock() at witness_unlock+0xea/frame 0xfffffe000891f370 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe000891f3a0 swp_pager_trimswapspace() at swp_pager_trimswapspace+0xd5/frame 0xfffffe000891f400 swap_pager_putpages() at swap_pager_putpages+0x56c/frame 0xfffffe000891f4a0 vm_pageout_flush() at vm_pageout_flush+0xff/frame 0xfffffe000891f580 vm_pageout_cluster() at vm_pageout_cluster+0x3e6/frame 0xfffffe000891f7f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x2f6/frame 0xfffffe000891fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000891fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000891fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command stealer pid 18209 tid 100496 td 0xfffff805c19e55c0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe000891ea90 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe000891eaa0 trap() at trap+0x5b/frame 0xfffffe000891ebb0 calltrap() at calltrap+0x8/frame 0xfffffe000891ebb0 --- trap 0xc, rip = 0xffffffff8107be66, rsp = 0xfffffe000891ec80, rbp = 0xfffffe000891ec90 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe000891ec90 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe000891ed30 db_command() at db_command+0x279/frame 0xfffffe000891ee00 db_script_exec() at db_script_exec+0x188/frame 0xfffffe000891eea0 db_command() at db_command+0x279/frame 0xfffffe000891ef70 db_command_loop() at db_command_loop+0x64/frame 0xfffffe000891ef80 db_trap() at db_trap+0xef/frame 0xfffffe000891f010 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe000891f090 trap() at trap+0x811/frame 0xfffffe000891f1a0 calltrap() at calltrap+0x8/frame 0xfffffe000891f1a0 --- trap 0x3, rip = 0xffffffff80c1992b, rsp = 0xfffffe000891f270, rbp = 0xfffffe000891f280 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe000891f280 vpanic() at vpanic+0x1ba/frame 0xfffffe000891f2d0 panic() at panic+0x43/frame 0xfffffe000891f330 witness_unlock() at witness_unlock+0xea/frame 0xfffffe000891f370 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe000891f3a0 swp_pager_trimswapspace() at swp_pager_trimswapspace+0xd5/frame 0xfffffe000891f400 swap_pager_putpages() at swap_pager_putpages+0x56c/frame 0xfffffe000891f4a0 vm_pageout_flush() at vm_pageout_flush+0xff/frame 0xfffffe000891f580 vm_pageout_cluster() at vm_pageout_cluster+0x3e6/frame 0xfffffe000891f7f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x2f6/frame 0xfffffe000891fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000891fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000891fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command stealer pid 18208 tid 100495 td 0xfffff805c11175c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00ad69ea40 mi_switch() at mi_switch+0x174/frame 0xfffffe00ad69ea70 ast() at ast+0x28d/frame 0xfffffe00ad69eab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18207 tid 100267 td 0xfffff8015717f000 (CPU 5) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe00085a3df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe00085a3e10 trap() at trap+0x48/frame 0xfffffe00085a3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00085a3f20 --- trap 0x13, rip = 0xffffffff80c3be71, rsp = 0xfffffe00aea906c0, rbp = 0xfffffe00aea906f0 --- witness_unlock() at witness_unlock+0x1/frame 0xfffffe00aea906f0 vm_page_alloc_domain_after() at vm_page_alloc_domain_after+0x1ae/frame 0xfffffe00aea90760 vm_page_alloc() at vm_page_alloc+0x74/frame 0xfffffe00aea907c0 vm_fault_hold() at vm_fault_hold+0x1281/frame 0xfffffe00aea90910 vm_fault() at vm_fault+0x60/frame 0xfffffe00aea90950 trap_pfault() at trap_pfault+0x188/frame 0xfffffe00aea909a0 trap() at trap+0x46b/frame 0xfffffe00aea90ab0 calltrap() at calltrap+0x8/frame 0xfffffe00aea90ab0 --- trap 0xc, rip = 0x800415885, rsp = 0x7fffffffe338, rbp = 0x7fffffffe380 --- Tracing command stealer pid 18206 tid 100265 td 0xfffff8015717f5c0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe000891ea90 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe000891eaa0 trap() at trap+0x5b/frame 0xfffffe000891ebb0 calltrap() at calltrap+0x8/frame 0xfffffe000891ebb0 --- trap 0xc, rip = 0xffffffff8107be66, rsp = 0xfffffe000891ec80, rbp = 0xfffffe000891ec90 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe000891ec90 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe000891ed30 db_command() at db_command+0x279/frame 0xfffffe000891ee00 db_script_exec() at db_script_exec+0x188/frame 0xfffffe000891eea0 db_command() at db_command+0x279/frame 0xfffffe000891ef70 db_command_loop() at db_command_loop+0x64/frame 0xfffffe000891ef80 db_trap() at db_trap+0xef/frame 0xfffffe000891f010 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe000891f090 trap() at trap+0x811/frame 0xfffffe000891f1a0 calltrap() at calltrap+0x8/frame 0xfffffe000891f1a0 --- trap 0x3, rip = 0xffffffff80c1992b, rsp = 0xfffffe000891f270, rbp = 0xfffffe000891f280 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe000891f280 vpanic() at vpanic+0x1ba/frame 0xfffffe000891f2d0 panic() at panic+0x43/frame 0xfffffe000891f330 witness_unlock() at witness_unlock+0xea/frame 0xfffffe000891f370 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe000891f3a0 swp_pager_trimswapspace() at swp_pager_trimswapspace+0xd5/frame 0xfffffe000891f400 swap_pager_putpages() at swap_pager_putpages+0x56c/frame 0xfffffe000891f4a0 vm_pageout_flush() at vm_pageout_flush+0xff/frame 0xfffffe000891f580 vm_pageout_cluster() at vm_pageout_cluster+0x3e6/frame 0xfffffe000891f7f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x2f6/frame 0xfffffe000891fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000891fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000891fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command stealer pid 18205 tid 100494 td 0xfffff805c19d95c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00ad699a40 mi_switch() at mi_switch+0x174/frame 0xfffffe00ad699a70 ast() at ast+0x28d/frame 0xfffffe00ad699ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18204 tid 100493 td 0xfffff804e2a135c0 (CPU 2) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe000857fdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe000857fe10 trap() at trap+0x48/frame 0xfffffe000857ff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe000857ff20 --- trap 0x13, rip = 0x201381, rsp = 0x7fffffffe690, rbp = 0x7fffffffe6c0 --- Tracing command stealer pid 18203 tid 100492 td 0xfffff805c1dd2000 sched_switch() at sched_switch+0x713/frame 0xfffffe00ad68fa40 mi_switch() at mi_switch+0x174/frame 0xfffffe00ad68fa70 ast() at ast+0x28d/frame 0xfffffe00ad68fab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18202 tid 100491 td 0xfffff805c19d9000 sched_switch() at sched_switch+0x713/frame 0xfffffe00ad68aa40 mi_switch() at mi_switch+0x174/frame 0xfffffe00ad68aa70 ast() at ast+0x28d/frame 0xfffffe00ad68aab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18201 tid 100490 td 0xfffff805c19e5000 sched_switch() at sched_switch+0x713/frame 0xfffffe0000446550 mi_switch() at mi_switch+0x174/frame 0xfffffe0000446580 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004465c0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0000446600 _sleep() at _sleep+0x279/frame 0xfffffe00004466a0 swap_pager_getpages() at swap_pager_getpages+0x6c2/frame 0xfffffe0000446760 vm_pager_get_pages() at vm_pager_get_pages+0x4f/frame 0xfffffe00004467c0 vm_fault_hold() at vm_fault_hold+0x1544/frame 0xfffffe0000446910 vm_fault() at vm_fault+0x60/frame 0xfffffe0000446950 trap_pfault() at trap_pfault+0x188/frame 0xfffffe00004469a0 trap() at trap+0x46b/frame 0xfffffe0000446ab0 calltrap() at calltrap+0x8/frame 0xfffffe0000446ab0 --- trap 0xc, rip = 0x20137d, rsp = 0x7fffffffe690, rbp = 0x7fffffffe6c0 --- Tracing command stealer pid 18200 tid 100489 td 0xfffff805c1117000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe000891ea90 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe000891eaa0 trap() at trap+0x5b/frame 0xfffffe000891ebb0 calltrap() at calltrap+0x8/frame 0xfffffe000891ebb0 --- trap 0xc, rip = 0xffffffff8107be66, rsp = 0xfffffe000891ec80, rbp = 0xfffffe000891ec90 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe000891ec90 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe000891ed30 db_command() at db_command+0x279/frame 0xfffffe000891ee00 db_script_exec() at db_script_exec+0x188/frame 0xfffffe000891eea0 db_command() at db_command+0x279/frame 0xfffffe000891ef70 db_command_loop() at db_command_loop+0x64/frame 0xfffffe000891ef80 db_trap() at db_trap+0xef/frame 0xfffffe000891f010 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe000891f090 trap() at trap+0x811/frame 0xfffffe000891f1a0 calltrap() at calltrap+0x8/frame 0xfffffe000891f1a0 --- trap 0x3, rip = 0xffffffff80c1992b, rsp = 0xfffffe000891f270, rbp = 0xfffffe000891f280 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe000891f280 vpanic() at vpanic+0x1ba/frame 0xfffffe000891f2d0 panic() at panic+0x43/frame 0xfffffe000891f330 witness_unlock() at witness_unlock+0xea/frame 0xfffffe000891f370 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe000891f3a0 swp_pager_trimswapspace() at swp_pager_trimswapspace+0xd5/frame 0xfffffe000891f400 swap_pager_putpages() at swap_pager_putpages+0x56c/frame 0xfffffe000891f4a0 vm_pageout_flush() at vm_pageout_flush+0xff/frame 0xfffffe000891f580 vm_pageout_cluster() at vm_pageout_cluster+0x3e6/frame 0xfffffe000891f7f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x2f6/frame 0xfffffe000891fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000891fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000891fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command stealer pid 18199 tid 100488 td 0xfffff805b8956000 sched_switch() at sched_switch+0x713/frame 0xfffffe00aea27a40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aea27a70 ast() at ast+0x28d/frame 0xfffffe00aea27ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18198 tid 100277 td 0xfffff8011b3dc000 sched_switch() at sched_switch+0x713/frame 0xfffffe00aeac2a40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aeac2a70 ast() at ast+0x28d/frame 0xfffffe00aeac2ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18197 tid 100274 td 0xfffff8011b3dc5c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aeab3a40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aeab3a70 ast() at ast+0x28d/frame 0xfffffe00aeab3ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18196 tid 100404 td 0xfffff805b2df4000 sched_switch() at sched_switch+0x713/frame 0xfffffe00aed3da40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aed3da70 ast() at ast+0x28d/frame 0xfffffe00aed3dab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18195 tid 100401 td 0xfffff805b2df45c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aed2ea40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aed2ea70 ast() at ast+0x28d/frame 0xfffffe00aed2eab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18194 tid 100397 td 0xfffff805b2ffd000 sched_switch() at sched_switch+0x713/frame 0xfffffe00aed1aa40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aed1aa70 ast() at ast+0x28d/frame 0xfffffe00aed1aab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18193 tid 100315 td 0xfffff8015789c000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe000891ea90 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe000891eaa0 trap() at trap+0x5b/frame 0xfffffe000891ebb0 calltrap() at calltrap+0x8/frame 0xfffffe000891ebb0 --- trap 0xc, rip = 0xffffffff8107be66, rsp = 0xfffffe000891ec80, rbp = 0xfffffe000891ec90 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe000891ec90 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe000891ed30 db_command() at db_command+0x279/frame 0xfffffe000891ee00 db_script_exec() at db_script_exec+0x188/frame 0xfffffe000891eea0 db_command() at db_command+0x279/frame 0xfffffe000891ef70 db_command_loop() at db_command_loop+0x64/frame 0xfffffe000891ef80 db_trap() at db_trap+0xef/frame 0xfffffe000891f010 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe000891f090 trap() at trap+0x811/frame 0xfffffe000891f1a0 calltrap() at calltrap+0x8/frame 0xfffffe000891f1a0 --- trap 0x3, rip = 0xffffffff80c1992b, rsp = 0xfffffe000891f270, rbp = 0xfffffe000891f280 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe000891f280 vpanic() at vpanic+0x1ba/frame 0xfffffe000891f2d0 panic() at panic+0x43/frame 0xfffffe000891f330 witness_unlock() at witness_unlock+0xea/frame 0xfffffe000891f370 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe000891f3a0 swp_pager_trimswapspace() at swp_pager_trimswapspace+0xd5/frame 0xfffffe000891f400 swap_pager_putpages() at swap_pager_putpages+0x56c/frame 0xfffffe000891f4a0 vm_pageout_flush() at vm_pageout_flush+0xff/frame 0xfffffe000891f580 vm_pageout_cluster() at vm_pageout_cluster+0x3e6/frame 0xfffffe000891f7f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x2f6/frame 0xfffffe000891fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000891fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000891fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command stealer pid 18192 tid 100311 td 0xfffff8015789c5c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aeb6ca40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aeb6ca70 ast() at ast+0x28d/frame 0xfffffe00aeb6cab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18191 tid 100306 td 0xfffff8015789b000 sched_switch() at sched_switch+0x713/frame 0xfffffe00aeb53a40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aeb53a70 ast() at ast+0x28d/frame 0xfffffe00aeb53ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18190 tid 100270 td 0xfffff8011ba03000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe000891ea90 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe000891eaa0 trap() at trap+0x5b/frame 0xfffffe000891ebb0 calltrap() at calltrap+0x8/frame 0xfffffe000891ebb0 --- trap 0xc, rip = 0xffffffff8107be66, rsp = 0xfffffe000891ec80, rbp = 0xfffffe000891ec90 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe000891ec90 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe000891ed30 db_command() at db_command+0x279/frame 0xfffffe000891ee00 db_script_exec() at db_script_exec+0x188/frame 0xfffffe000891eea0 db_command() at db_command+0x279/frame 0xfffffe000891ef70 db_command_loop() at db_command_loop+0x64/frame 0xfffffe000891ef80 db_trap() at db_trap+0xef/frame 0xfffffe000891f010 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe000891f090 trap() at trap+0x811/frame 0xfffffe000891f1a0 calltrap() at calltrap+0x8/frame 0xfffffe000891f1a0 --- trap 0x3, rip = 0xffffffff80c1992b, rsp = 0xfffffe000891f270, rbp = 0xfffffe000891f280 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe000891f280 vpanic() at vpanic+0x1ba/frame 0xfffffe000891f2d0 panic() at panic+0x43/frame 0xfffffe000891f330 witness_unlock() at witness_unlock+0xea/frame 0xfffffe000891f370 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe000891f3a0 swp_pager_trimswapspace() at swp_pager_trimswapspace+0xd5/frame 0xfffffe000891f400 swap_pager_putpages() at swap_pager_putpages+0x56c/frame 0xfffffe000891f4a0 vm_pageout_flush() at vm_pageout_flush+0xff/frame 0xfffffe000891f580 vm_pageout_cluster() at vm_pageout_cluster+0x3e6/frame 0xfffffe000891f7f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x2f6/frame 0xfffffe000891fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000891fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000891fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command stealer pid 18189 tid 100321 td 0xfffff8015789d000 sched_switch() at sched_switch+0x713/frame 0xfffffe00aeb9ea40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aeb9ea70 ast() at ast+0x28d/frame 0xfffffe00aeb9eab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18188 tid 100318 td 0xfffff8015789d5c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aeb8fa40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aeb8fa70 ast() at ast+0x28d/frame 0xfffffe00aeb8fab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18187 tid 100255 td 0xfffff801571f8000 sched_switch() at sched_switch+0x713/frame 0xfffffe00aea54550 mi_switch() at mi_switch+0x174/frame 0xfffffe00aea54580 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aea545c0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00aea54600 _sleep() at _sleep+0x279/frame 0xfffffe00aea546a0 swap_pager_getpages() at swap_pager_getpages+0x6c2/frame 0xfffffe00aea54760 vm_pager_get_pages() at vm_pager_get_pages+0x4f/frame 0xfffffe00aea547c0 vm_fault_hold() at vm_fault_hold+0x1544/frame 0xfffffe00aea54910 vm_fault() at vm_fault+0x60/frame 0xfffffe00aea54950 trap_pfault() at trap_pfault+0x188/frame 0xfffffe00aea549a0 trap() at trap+0x46b/frame 0xfffffe00aea54ab0 calltrap() at calltrap+0x8/frame 0xfffffe00aea54ab0 --- trap 0xc, rip = 0x20137d, rsp = 0x7fffffffe690, rbp = 0x7fffffffe6c0 --- Tracing command stealer pid 18186 tid 100254 td 0xfffff801571f85c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aea4fa30 mi_switch() at mi_switch+0x174/frame 0xfffffe00aea4fa60 critical_exit_preempt() at critical_exit_preempt+0x65/frame 0xfffffe00aea4fa80 ipi_bitmap_handler() at ipi_bitmap_handler+0xa2/frame 0xfffffe00aea4fab0 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0xb0/frame 0xfffffe00aea4fab0 --- interrupt, rip = 0x201381, rsp = 0x7fffffffe690, rbp = 0x7fffffffe6c0 --- Tracing command stealer pid 18185 tid 100253 td 0xfffff801571f7000 sched_switch() at sched_switch+0x713/frame 0xfffffe00aea4aa40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aea4aa70 ast() at ast+0x28d/frame 0xfffffe00aea4aab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18184 tid 100258 td 0xfffff8011b6935c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aea63550 mi_switch() at mi_switch+0x174/frame 0xfffffe00aea63580 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aea635c0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00aea63600 _sleep() at _sleep+0x279/frame 0xfffffe00aea636a0 swap_pager_getpages() at swap_pager_getpages+0x6c2/frame 0xfffffe00aea63760 vm_pager_get_pages() at vm_pager_get_pages+0x4f/frame 0xfffffe00aea637c0 vm_fault_hold() at vm_fault_hold+0x1544/frame 0xfffffe00aea63910 vm_fault() at vm_fault+0x60/frame 0xfffffe00aea63950 trap_pfault() at trap_pfault+0x188/frame 0xfffffe00aea639a0 trap() at trap+0x46b/frame 0xfffffe00aea63ab0 calltrap() at calltrap+0x8/frame 0xfffffe00aea63ab0 --- trap 0xc, rip = 0x20137d, rsp = 0x7fffffffe690, rbp = 0x7fffffffe6c0 --- Tracing command stealer pid 18183 tid 100257 td 0xfffff801571fb000 sched_switch() at sched_switch+0x713/frame 0xfffffe00aea5e550 mi_switch() at mi_switch+0x174/frame 0xfffffe00aea5e580 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aea5e5c0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00aea5e600 _sleep() at _sleep+0x279/frame 0xfffffe00aea5e6a0 swap_pager_getpages() at swap_pager_getpages+0x6c2/frame 0xfffffe00aea5e760 vm_pager_get_pages() at vm_pager_get_pages+0x4f/frame 0xfffffe00aea5e7c0 vm_fault_hold() at vm_fault_hold+0x1544/frame 0xfffffe00aea5e910 vm_fault() at vm_fault+0x60/frame 0xfffffe00aea5e950 trap_pfault() at trap_pfault+0x188/frame 0xfffffe00aea5e9a0 trap() at trap+0x46b/frame 0xfffffe00aea5eab0 calltrap() at calltrap+0x8/frame 0xfffffe00aea5eab0 --- trap 0xc, rip = 0x20137d, rsp = 0x7fffffffe690, rbp = 0x7fffffffe6c0 --- Tracing command stealer pid 18182 tid 100256 td 0xfffff801571fb5c0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe000891ea90 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe000891eaa0 trap() at trap+0x5b/frame 0xfffffe000891ebb0 calltrap() at calltrap+0x8/frame 0xfffffe000891ebb0 --- trap 0xc, rip = 0xffffffff8107be66, rsp = 0xfffffe000891ec80, rbp = 0xfffffe000891ec90 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe000891ec90 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe000891ed30 db_command() at db_command+0x279/frame 0xfffffe000891ee00 db_script_exec() at db_script_exec+0x188/frame 0xfffffe000891eea0 db_command() at db_command+0x279/frame 0xfffffe000891ef70 db_command_loop() at db_command_loop+0x64/frame 0xfffffe000891ef80 db_trap() at db_trap+0xef/frame 0xfffffe000891f010 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe000891f090 trap() at trap+0x811/frame 0xfffffe000891f1a0 calltrap() at calltrap+0x8/frame 0xfffffe000891f1a0 --- trap 0x3, rip = 0xffffffff80c1992b, rsp = 0xfffffe000891f270, rbp = 0xfffffe000891f280 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe000891f280 vpanic() at vpanic+0x1ba/frame 0xfffffe000891f2d0 panic() at panic+0x43/frame 0xfffffe000891f330 witness_unlock() at witness_unlock+0xea/frame 0xfffffe000891f370 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe000891f3a0 swp_pager_trimswapspace() at swp_pager_trimswapspace+0xd5/frame 0xfffffe000891f400 swap_pager_putpages() at swap_pager_putpages+0x56c/frame 0xfffffe000891f4a0 vm_pageout_flush() at vm_pageout_flush+0xff/frame 0xfffffe000891f580 vm_pageout_cluster() at vm_pageout_cluster+0x3e6/frame 0xfffffe000891f7f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x2f6/frame 0xfffffe000891fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000891fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000891fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command stealer pid 18181 tid 100279 td 0xfffff8011be2a5c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aeacc550 mi_switch() at mi_switch+0x174/frame 0xfffffe00aeacc580 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aeacc5c0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00aeacc600 _sleep() at _sleep+0x279/frame 0xfffffe00aeacc6a0 swap_pager_getpages() at swap_pager_getpages+0x6c2/frame 0xfffffe00aeacc760 vm_pager_get_pages() at vm_pager_get_pages+0x4f/frame 0xfffffe00aeacc7c0 vm_fault_hold() at vm_fault_hold+0x1544/frame 0xfffffe00aeacc910 vm_fault() at vm_fault+0x60/frame 0xfffffe00aeacc950 trap_pfault() at trap_pfault+0x188/frame 0xfffffe00aeacc9a0 trap() at trap+0x46b/frame 0xfffffe00aeaccab0 calltrap() at calltrap+0x8/frame 0xfffffe00aeaccab0 --- trap 0xc, rip = 0x20137d, rsp = 0x7fffffffe690, rbp = 0x7fffffffe6c0 --- Tracing command stealer pid 18180 tid 100340 td 0xfffff80157544000 sched_switch() at sched_switch+0x713/frame 0xfffffe00aebfda40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aebfda70 ast() at ast+0x28d/frame 0xfffffe00aebfdab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18179 tid 100339 td 0xfffff801575445c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aebf8a40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aebf8a70 ast() at ast+0x28d/frame 0xfffffe00aebf8ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18178 tid 100459 td 0xfffff8011bdd9000 sched_switch() at sched_switch+0x713/frame 0xfffffe00af64fa40 mi_switch() at mi_switch+0x174/frame 0xfffffe00af64fa70 ast() at ast+0x28d/frame 0xfffffe00af64fab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18177 tid 100458 td 0xfffff8011bdd95c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00af64a550 mi_switch() at mi_switch+0x174/frame 0xfffffe00af64a580 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00af64a5c0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00af64a600 _sleep() at _sleep+0x279/frame 0xfffffe00af64a6a0 swap_pager_getpages() at swap_pager_getpages+0x6c2/frame 0xfffffe00af64a760 vm_pager_get_pages() at vm_pager_get_pages+0x4f/frame 0xfffffe00af64a7c0 vm_fault_hold() at vm_fault_hold+0x1544/frame 0xfffffe00af64a910 vm_fault() at vm_fault+0x60/frame 0xfffffe00af64a950 trap_pfault() at trap_pfault+0x188/frame 0xfffffe00af64a9a0 trap() at trap+0x46b/frame 0xfffffe00af64aab0 calltrap() at calltrap+0x8/frame 0xfffffe00af64aab0 --- trap 0xc, rip = 0x20137d, rsp = 0x7fffffffe690, rbp = 0x7fffffffe6c0 --- Tracing command stealer pid 18176 tid 100457 td 0xfffff8011ba9b000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe000891ea90 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe000891eaa0 trap() at trap+0x5b/frame 0xfffffe000891ebb0 calltrap() at calltrap+0x8/frame 0xfffffe000891ebb0 --- trap 0xc, rip = 0xffffffff8107be66, rsp = 0xfffffe000891ec80, rbp = 0xfffffe000891ec90 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe000891ec90 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe000891ed30 db_command() at db_command+0x279/frame 0xfffffe000891ee00 db_script_exec() at db_script_exec+0x188/frame 0xfffffe000891eea0 db_command() at db_command+0x279/frame 0xfffffe000891ef70 db_command_loop() at db_command_loop+0x64/frame 0xfffffe000891ef80 db_trap() at db_trap+0xef/frame 0xfffffe000891f010 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe000891f090 trap() at trap+0x811/frame 0xfffffe000891f1a0 calltrap() at calltrap+0x8/frame 0xfffffe000891f1a0 --- trap 0x3, rip = 0xffffffff80c1992b, rsp = 0xfffffe000891f270, rbp = 0xfffffe000891f280 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe000891f280 vpanic() at vpanic+0x1ba/frame 0xfffffe000891f2d0 panic() at panic+0x43/frame 0xfffffe000891f330 witness_unlock() at witness_unlock+0xea/frame 0xfffffe000891f370 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe000891f3a0 swp_pager_trimswapspace() at swp_pager_trimswapspace+0xd5/frame 0xfffffe000891f400 swap_pager_putpages() at swap_pager_putpages+0x56c/frame 0xfffffe000891f4a0 vm_pageout_flush() at vm_pageout_flush+0xff/frame 0xfffffe000891f580 vm_pageout_cluster() at vm_pageout_cluster+0x3e6/frame 0xfffffe000891f7f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x2f6/frame 0xfffffe000891fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000891fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000891fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command stealer pid 18175 tid 100398 td 0xfffff805b51c95c0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe000891ea90 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe000891eaa0 trap() at trap+0x5b/frame 0xfffffe000891ebb0 calltrap() at calltrap+0x8/frame 0xfffffe000891ebb0 --- trap 0xc, rip = 0xffffffff8107be66, rsp = 0xfffffe000891ec80, rbp = 0xfffffe000891ec90 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe000891ec90 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe000891ed30 db_command() at db_command+0x279/frame 0xfffffe000891ee00 db_script_exec() at db_script_exec+0x188/frame 0xfffffe000891eea0 db_command() at db_command+0x279/frame 0xfffffe000891ef70 db_command_loop() at db_command_loop+0x64/frame 0xfffffe000891ef80 db_trap() at db_trap+0xef/frame 0xfffffe000891f010 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe000891f090 trap() at trap+0x811/frame 0xfffffe000891f1a0 calltrap() at calltrap+0x8/frame 0xfffffe000891f1a0 --- trap 0x3, rip = 0xffffffff80c1992b, rsp = 0xfffffe000891f270, rbp = 0xfffffe000891f280 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe000891f280 vpanic() at vpanic+0x1ba/frame 0xfffffe000891f2d0 panic() at panic+0x43/frame 0xfffffe000891f330 witness_unlock() at witness_unlock+0xea/frame 0xfffffe000891f370 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe000891f3a0 swp_pager_trimswapspace() at swp_pager_trimswapspace+0xd5/frame 0xfffffe000891f400 swap_pager_putpages() at swap_pager_putpages+0x56c/frame 0xfffffe000891f4a0 vm_pageout_flush() at vm_pageout_flush+0xff/frame 0xfffffe000891f580 vm_pageout_cluster() at vm_pageout_cluster+0x3e6/frame 0xfffffe000891f7f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x2f6/frame 0xfffffe000891fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000891fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000891fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command stealer pid 18174 tid 100380 td 0xfffff80157543000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe000891ea90 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe000891eaa0 trap() at trap+0x5b/frame 0xfffffe000891ebb0 calltrap() at calltrap+0x8/frame 0xfffffe000891ebb0 --- trap 0xc, rip = 0xffffffff8107be66, rsp = 0xfffffe000891ec80, rbp = 0xfffffe000891ec90 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe000891ec90 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe000891ed30 db_command() at db_command+0x279/frame 0xfffffe000891ee00 db_script_exec() at db_script_exec+0x188/frame 0xfffffe000891eea0 db_command() at db_command+0x279/frame 0xfffffe000891ef70 db_command_loop() at db_command_loop+0x64/frame 0xfffffe000891ef80 db_trap() at db_trap+0xef/frame 0xfffffe000891f010 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe000891f090 trap() at trap+0x811/frame 0xfffffe000891f1a0 calltrap() at calltrap+0x8/frame 0xfffffe000891f1a0 --- trap 0x3, rip = 0xffffffff80c1992b, rsp = 0xfffffe000891f270, rbp = 0xfffffe000891f280 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe000891f280 vpanic() at vpanic+0x1ba/frame 0xfffffe000891f2d0 panic() at panic+0x43/frame 0xfffffe000891f330 witness_unlock() at witness_unlock+0xea/frame 0xfffffe000891f370 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe000891f3a0 swp_pager_trimswapspace() at swp_pager_trimswapspace+0xd5/frame 0xfffffe000891f400 swap_pager_putpages() at swap_pager_putpages+0x56c/frame 0xfffffe000891f4a0 vm_pageout_flush() at vm_pageout_flush+0xff/frame 0xfffffe000891f580 vm_pageout_cluster() at vm_pageout_cluster+0x3e6/frame 0xfffffe000891f7f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x2f6/frame 0xfffffe000891fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000891fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000891fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command stealer pid 18173 tid 100377 td 0xfffff801575435c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aecb6550 mi_switch() at mi_switch+0x174/frame 0xfffffe00aecb6580 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aecb65c0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00aecb6600 _sleep() at _sleep+0x279/frame 0xfffffe00aecb66a0 swap_pager_getpages() at swap_pager_getpages+0x6c2/frame 0xfffffe00aecb6760 vm_pager_get_pages() at vm_pager_get_pages+0x4f/frame 0xfffffe00aecb67c0 vm_fault_hold() at vm_fault_hold+0x1544/frame 0xfffffe00aecb6910 vm_fault() at vm_fault+0x60/frame 0xfffffe00aecb6950 trap_pfault() at trap_pfault+0x188/frame 0xfffffe00aecb69a0 trap() at trap+0x46b/frame 0xfffffe00aecb6ab0 calltrap() at calltrap+0x8/frame 0xfffffe00aecb6ab0 --- trap 0xc, rip = 0x20137d, rsp = 0x7fffffffe690, rbp = 0x7fffffffe6c0 --- Tracing command stealer pid 18172 tid 100325 td 0xfffff8015789e5c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aebb2a40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aebb2a70 ast() at ast+0x28d/frame 0xfffffe00aebb2ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18171 tid 100393 td 0xfffff8011bebc5c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aed06a40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aed06a70 ast() at ast+0x28d/frame 0xfffffe00aed06ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18170 tid 100276 td 0xfffff8015708d000 sched_switch() at sched_switch+0x713/frame 0xfffffe00aeabda40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aeabda70 ast() at ast+0x28d/frame 0xfffffe00aeabdab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18169 tid 100348 td 0xfffff80157aa8000 sched_switch() at sched_switch+0x713/frame 0xfffffe00aec25550 mi_switch() at mi_switch+0x174/frame 0xfffffe00aec25580 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aec255c0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00aec25600 _sleep() at _sleep+0x279/frame 0xfffffe00aec256a0 swap_pager_getpages() at swap_pager_getpages+0x6c2/frame 0xfffffe00aec25760 vm_pager_get_pages() at vm_pager_get_pages+0x4f/frame 0xfffffe00aec257c0 vm_fault_hold() at vm_fault_hold+0x1544/frame 0xfffffe00aec25910 vm_fault() at vm_fault+0x60/frame 0xfffffe00aec25950 trap_pfault() at trap_pfault+0x188/frame 0xfffffe00aec259a0 trap() at trap+0x46b/frame 0xfffffe00aec25ab0 calltrap() at calltrap+0x8/frame 0xfffffe00aec25ab0 --- trap 0xc, rip = 0x20137d, rsp = 0x7fffffffe690, rbp = 0x7fffffffe6c0 --- Tracing command stealer pid 18168 tid 100347 td 0xfffff80157aa85c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aec20a40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aec20a70 ast() at ast+0x28d/frame 0xfffffe00aec20ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18167 tid 100346 td 0xfffff8000b7ea5c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aec1ba40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aec1ba70 ast() at ast+0x28d/frame 0xfffffe00aec1bab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18166 tid 100411 td 0xfffff805b26d8000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe000891ea90 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe000891eaa0 trap() at trap+0x5b/frame 0xfffffe000891ebb0 calltrap() at calltrap+0x8/frame 0xfffffe000891ebb0 --- trap 0xc, rip = 0xffffffff8107be66, rsp = 0xfffffe000891ec80, rbp = 0xfffffe000891ec90 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe000891ec90 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe000891ed30 db_command() at db_command+0x279/frame 0xfffffe000891ee00 db_script_exec() at db_script_exec+0x188/frame 0xfffffe000891eea0 db_command() at db_command+0x279/frame 0xfffffe000891ef70 db_command_loop() at db_command_loop+0x64/frame 0xfffffe000891ef80 db_trap() at db_trap+0xef/frame 0xfffffe000891f010 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe000891f090 trap() at trap+0x811/frame 0xfffffe000891f1a0 calltrap() at calltrap+0x8/frame 0xfffffe000891f1a0 --- trap 0x3, rip = 0xffffffff80c1992b, rsp = 0xfffffe000891f270, rbp = 0xfffffe000891f280 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe000891f280 vpanic() at vpanic+0x1ba/frame 0xfffffe000891f2d0 panic() at panic+0x43/frame 0xfffffe000891f330 witness_unlock() at witness_unlock+0xea/frame 0xfffffe000891f370 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe000891f3a0 swp_pager_trimswapspace() at swp_pager_trimswapspace+0xd5/frame 0xfffffe000891f400 swap_pager_putpages() at swap_pager_putpages+0x56c/frame 0xfffffe000891f4a0 vm_pageout_flush() at vm_pageout_flush+0xff/frame 0xfffffe000891f580 vm_pageout_cluster() at vm_pageout_cluster+0x3e6/frame 0xfffffe000891f7f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x2f6/frame 0xfffffe000891fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000891fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000891fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command stealer pid 18165 tid 100406 td 0xfffff805b26d85c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aed47a40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aed47a70 ast() at ast+0x28d/frame 0xfffffe00aed47ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18164 tid 100399 td 0xfffff805b51c9000 sched_switch() at sched_switch+0x713/frame 0xfffffe00aed24a40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aed24a70 ast() at ast+0x28d/frame 0xfffffe00aed24ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18163 tid 100341 td 0xfffff8015753a5c0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe000891ea90 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe000891eaa0 trap() at trap+0x5b/frame 0xfffffe000891ebb0 calltrap() at calltrap+0x8/frame 0xfffffe000891ebb0 --- trap 0xc, rip = 0xffffffff8107be66, rsp = 0xfffffe000891ec80, rbp = 0xfffffe000891ec90 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe000891ec90 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe000891ed30 db_command() at db_command+0x279/frame 0xfffffe000891ee00 db_script_exec() at db_script_exec+0x188/frame 0xfffffe000891eea0 db_command() at db_command+0x279/frame 0xfffffe000891ef70 db_command_loop() at db_command_loop+0x64/frame 0xfffffe000891ef80 db_trap() at db_trap+0xef/frame 0xfffffe000891f010 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe000891f090 trap() at trap+0x811/frame 0xfffffe000891f1a0 calltrap() at calltrap+0x8/frame 0xfffffe000891f1a0 --- trap 0x3, rip = 0xffffffff80c1992b, rsp = 0xfffffe000891f270, rbp = 0xfffffe000891f280 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe000891f280 vpanic() at vpanic+0x1ba/frame 0xfffffe000891f2d0 panic() at panic+0x43/frame 0xfffffe000891f330 witness_unlock() at witness_unlock+0xea/frame 0xfffffe000891f370 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe000891f3a0 swp_pager_trimswapspace() at swp_pager_trimswapspace+0xd5/frame 0xfffffe000891f400 swap_pager_putpages() at swap_pager_putpages+0x56c/frame 0xfffffe000891f4a0 vm_pageout_flush() at vm_pageout_flush+0xff/frame 0xfffffe000891f580 vm_pageout_cluster() at vm_pageout_cluster+0x3e6/frame 0xfffffe000891f7f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x2f6/frame 0xfffffe000891fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000891fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000891fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command stealer pid 18162 tid 100309 td 0xfffff8011b7535c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aeb62550 mi_switch() at mi_switch+0x174/frame 0xfffffe00aeb62580 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aeb625c0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00aeb62600 _sleep() at _sleep+0x279/frame 0xfffffe00aeb626a0 swap_pager_getpages() at swap_pager_getpages+0x6c2/frame 0xfffffe00aeb62760 vm_pager_get_pages() at vm_pager_get_pages+0x4f/frame 0xfffffe00aeb627c0 vm_fault_hold() at vm_fault_hold+0x1544/frame 0xfffffe00aeb62910 vm_fault() at vm_fault+0x60/frame 0xfffffe00aeb62950 trap_pfault() at trap_pfault+0x188/frame 0xfffffe00aeb629a0 trap() at trap+0x46b/frame 0xfffffe00aeb62ab0 calltrap() at calltrap+0x8/frame 0xfffffe00aeb62ab0 --- trap 0xc, rip = 0x20137d, rsp = 0x7fffffffe690, rbp = 0x7fffffffe6c0 --- Tracing command stealer pid 18161 tid 100307 td 0xfffff8011bf21000 sched_switch() at sched_switch+0x713/frame 0xfffffe00aeb58550 mi_switch() at mi_switch+0x174/frame 0xfffffe00aeb58580 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aeb585c0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00aeb58600 _sleep() at _sleep+0x279/frame 0xfffffe00aeb586a0 swap_pager_getpages() at swap_pager_getpages+0x6c2/frame 0xfffffe00aeb58760 vm_pager_get_pages() at vm_pager_get_pages+0x4f/frame 0xfffffe00aeb587c0 vm_fault_hold() at vm_fault_hold+0x1544/frame 0xfffffe00aeb58910 vm_fault() at vm_fault+0x60/frame 0xfffffe00aeb58950 trap_pfault() at trap_pfault+0x188/frame 0xfffffe00aeb589a0 trap() at trap+0x46b/frame 0xfffffe00aeb58ab0 calltrap() at calltrap+0x8/frame 0xfffffe00aeb58ab0 --- trap 0xc, rip = 0x20137d, rsp = 0x7fffffffe690, rbp = 0x7fffffffe6c0 --- Tracing command stealer pid 18160 tid 100173 td 0xfffff80003e995c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00ad676a40 mi_switch() at mi_switch+0x174/frame 0xfffffe00ad676a70 ast() at ast+0x28d/frame 0xfffffe00ad676ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18159 tid 100163 td 0xfffff80003e98000 sched_switch() at sched_switch+0x713/frame 0xfffffe00ad62ca40 mi_switch() at mi_switch+0x174/frame 0xfffffe00ad62ca70 ast() at ast+0x28d/frame 0xfffffe00ad62cab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18158 tid 100143 td 0xfffff80003e985c0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe000891ea90 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe000891eaa0 trap() at trap+0x5b/frame 0xfffffe000891ebb0 calltrap() at calltrap+0x8/frame 0xfffffe000891ebb0 --- trap 0xc, rip = 0xffffffff8107be66, rsp = 0xfffffe000891ec80, rbp = 0xfffffe000891ec90 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe000891ec90 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe000891ed30 db_command() at db_command+0x279/frame 0xfffffe000891ee00 db_script_exec() at db_script_exec+0x188/frame 0xfffffe000891eea0 db_command() at db_command+0x279/frame 0xfffffe000891ef70 db_command_loop() at db_command_loop+0x64/frame 0xfffffe000891ef80 db_trap() at db_trap+0xef/frame 0xfffffe000891f010 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe000891f090 trap() at trap+0x811/frame 0xfffffe000891f1a0 calltrap() at calltrap+0x8/frame 0xfffffe000891f1a0 --- trap 0x3, rip = 0xffffffff80c1992b, rsp = 0xfffffe000891f270, rbp = 0xfffffe000891f280 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe000891f280 vpanic() at vpanic+0x1ba/frame 0xfffffe000891f2d0 panic() at panic+0x43/frame 0xfffffe000891f330 witness_unlock() at witness_unlock+0xea/frame 0xfffffe000891f370 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe000891f3a0 swp_pager_trimswapspace() at swp_pager_trimswapspace+0xd5/frame 0xfffffe000891f400 swap_pager_putpages() at swap_pager_putpages+0x56c/frame 0xfffffe000891f4a0 vm_pageout_flush() at vm_pageout_flush+0xff/frame 0xfffffe000891f580 vm_pageout_cluster() at vm_pageout_cluster+0x3e6/frame 0xfffffe000891f7f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x2f6/frame 0xfffffe000891fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000891fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000891fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command stealer pid 18157 tid 100414 td 0xfffff8000bb445c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aed6f550 mi_switch() at mi_switch+0x174/frame 0xfffffe00aed6f580 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aed6f5c0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00aed6f600 _sleep() at _sleep+0x279/frame 0xfffffe00aed6f6a0 swap_pager_getpages() at swap_pager_getpages+0x6c2/frame 0xfffffe00aed6f760 vm_pager_get_pages() at vm_pager_get_pages+0x4f/frame 0xfffffe00aed6f7c0 vm_fault_hold() at vm_fault_hold+0x1544/frame 0xfffffe00aed6f910 vm_fault() at vm_fault+0x60/frame 0xfffffe00aed6f950 trap_pfault() at trap_pfault+0x188/frame 0xfffffe00aed6f9a0 trap() at trap+0x46b/frame 0xfffffe00aed6fab0 calltrap() at calltrap+0x8/frame 0xfffffe00aed6fab0 --- trap 0xc, rip = 0x20137d, rsp = 0x7fffffffe690, rbp = 0x7fffffffe6c0 --- Tracing command stealer pid 18156 tid 100413 td 0xfffff8004f0ee000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe000891ea90 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe000891eaa0 trap() at trap+0x5b/frame 0xfffffe000891ebb0 calltrap() at calltrap+0x8/frame 0xfffffe000891ebb0 --- trap 0xc, rip = 0xffffffff8107be66, rsp = 0xfffffe000891ec80, rbp = 0xfffffe000891ec90 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe000891ec90 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe000891ed30 db_command() at db_command+0x279/frame 0xfffffe000891ee00 db_script_exec() at db_script_exec+0x188/frame 0xfffffe000891eea0 db_command() at db_command+0x279/frame 0xfffffe000891ef70 db_command_loop() at db_command_loop+0x64/frame 0xfffffe000891ef80 db_trap() at db_trap+0xef/frame 0xfffffe000891f010 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe000891f090 trap() at trap+0x811/frame 0xfffffe000891f1a0 calltrap() at calltrap+0x8/frame 0xfffffe000891f1a0 --- trap 0x3, rip = 0xffffffff80c1992b, rsp = 0xfffffe000891f270, rbp = 0xfffffe000891f280 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe000891f280 vpanic() at vpanic+0x1ba/frame 0xfffffe000891f2d0 panic() at panic+0x43/frame 0xfffffe000891f330 witness_unlock() at witness_unlock+0xea/frame 0xfffffe000891f370 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe000891f3a0 swp_pager_trimswapspace() at swp_pager_trimswapspace+0xd5/frame 0xfffffe000891f400 swap_pager_putpages() at swap_pager_putpages+0x56c/frame 0xfffffe000891f4a0 vm_pageout_flush() at vm_pageout_flush+0xff/frame 0xfffffe000891f580 vm_pageout_cluster() at vm_pageout_cluster+0x3e6/frame 0xfffffe000891f7f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x2f6/frame 0xfffffe000891fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000891fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000891fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command stealer pid 18155 tid 100410 td 0xfffff8004f0ee5c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aed5b550 mi_switch() at mi_switch+0x174/frame 0xfffffe00aed5b580 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aed5b5c0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00aed5b600 _sleep() at _sleep+0x279/frame 0xfffffe00aed5b6a0 swap_pager_getpages() at swap_pager_getpages+0x6c2/frame 0xfffffe00aed5b760 vm_pager_get_pages() at vm_pager_get_pages+0x4f/frame 0xfffffe00aed5b7c0 vm_fault_hold() at vm_fault_hold+0x1544/frame 0xfffffe00aed5b910 vm_fault() at vm_fault+0x60/frame 0xfffffe00aed5b950 trap_pfault() at trap_pfault+0x188/frame 0xfffffe00aed5b9a0 trap() at trap+0x46b/frame 0xfffffe00aed5bab0 calltrap() at calltrap+0x8/frame 0xfffffe00aed5bab0 --- trap 0xc, rip = 0x20137d, rsp = 0x7fffffffe690, rbp = 0x7fffffffe6c0 --- Tracing command stealer pid 18154 tid 100396 td 0xfffff8011bebc000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe000891ea90 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe000891eaa0 trap() at trap+0x5b/frame 0xfffffe000891ebb0 calltrap() at calltrap+0x8/frame 0xfffffe000891ebb0 --- trap 0xc, rip = 0xffffffff8107be66, rsp = 0xfffffe000891ec80, rbp = 0xfffffe000891ec90 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe000891ec90 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe000891ed30 db_command() at db_command+0x279/frame 0xfffffe000891ee00 db_script_exec() at db_script_exec+0x188/frame 0xfffffe000891eea0 db_command() at db_command+0x279/frame 0xfffffe000891ef70 db_command_loop() at db_command_loop+0x64/frame 0xfffffe000891ef80 db_trap() at db_trap+0xef/frame 0xfffffe000891f010 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe000891f090 trap() at trap+0x811/frame 0xfffffe000891f1a0 calltrap() at calltrap+0x8/frame 0xfffffe000891f1a0 --- trap 0x3, rip = 0xffffffff80c1992b, rsp = 0xfffffe000891f270, rbp = 0xfffffe000891f280 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe000891f280 vpanic() at vpanic+0x1ba/frame 0xfffffe000891f2d0 panic() at panic+0x43/frame 0xfffffe000891f330 witness_unlock() at witness_unlock+0xea/frame 0xfffffe000891f370 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe000891f3a0 swp_pager_trimswapspace() at swp_pager_trimswapspace+0xd5/frame 0xfffffe000891f400 swap_pager_putpages() at swap_pager_putpages+0x56c/frame 0xfffffe000891f4a0 vm_pageout_flush() at vm_pageout_flush+0xff/frame 0xfffffe000891f580 vm_pageout_cluster() at vm_pageout_cluster+0x3e6/frame 0xfffffe000891f7f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x2f6/frame 0xfffffe000891fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000891fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000891fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command stealer pid 18153 tid 100248 td 0xfffff800071c75c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aea31a40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aea31a70 ast() at ast+0x28d/frame 0xfffffe00aea31ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18152 tid 100231 td 0xfffff8000b68b000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe000891ea90 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe000891eaa0 trap() at trap+0x5b/frame 0xfffffe000891ebb0 calltrap() at calltrap+0x8/frame 0xfffffe000891ebb0 --- trap 0xc, rip = 0xffffffff8107be66, rsp = 0xfffffe000891ec80, rbp = 0xfffffe000891ec90 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe000891ec90 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe000891ed30 db_command() at db_command+0x279/frame 0xfffffe000891ee00 db_script_exec() at db_script_exec+0x188/frame 0xfffffe000891eea0 db_command() at db_command+0x279/frame 0xfffffe000891ef70 db_command_loop() at db_command_loop+0x64/frame 0xfffffe000891ef80 db_trap() at db_trap+0xef/frame 0xfffffe000891f010 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe000891f090 trap() at trap+0x811/frame 0xfffffe000891f1a0 calltrap() at calltrap+0x8/frame 0xfffffe000891f1a0 --- trap 0x3, rip = 0xffffffff80c1992b, rsp = 0xfffffe000891f270, rbp = 0xfffffe000891f280 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe000891f280 vpanic() at vpanic+0x1ba/frame 0xfffffe000891f2d0 panic() at panic+0x43/frame 0xfffffe000891f330 witness_unlock() at witness_unlock+0xea/frame 0xfffffe000891f370 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe000891f3a0 swp_pager_trimswapspace() at swp_pager_trimswapspace+0xd5/frame 0xfffffe000891f400 swap_pager_putpages() at swap_pager_putpages+0x56c/frame 0xfffffe000891f4a0 vm_pageout_flush() at vm_pageout_flush+0xff/frame 0xfffffe000891f580 vm_pageout_cluster() at vm_pageout_cluster+0x3e6/frame 0xfffffe000891f7f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x2f6/frame 0xfffffe000891fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000891fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000891fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command stealer pid 18151 tid 100447 td 0xfffff805b8e53000 (CPU 10) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe00085dfdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe00085dfe10 trap() at trap+0x48/frame 0xfffffe00085dff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00085dff20 --- trap 0x13, rip = 0x20138a, rsp = 0x7fffffffe690, rbp = 0x7fffffffe6c0 --- Tracing command stealer pid 18150 tid 100446 td 0xfffff805b8e535c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00af60ea40 mi_switch() at mi_switch+0x174/frame 0xfffffe00af60ea70 ast() at ast+0x28d/frame 0xfffffe00af60eab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18149 tid 100445 td 0xfffff805c16e5000 sched_switch() at sched_switch+0x713/frame 0xfffffe00ad77ca40 mi_switch() at mi_switch+0x174/frame 0xfffffe00ad77ca70 ast() at ast+0x28d/frame 0xfffffe00ad77cab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18148 tid 100435 td 0xfffff805c1be55c0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe000891ea90 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe000891eaa0 trap() at trap+0x5b/frame 0xfffffe000891ebb0 calltrap() at calltrap+0x8/frame 0xfffffe000891ebb0 --- trap 0xc, rip = 0xffffffff8107be66, rsp = 0xfffffe000891ec80, rbp = 0xfffffe000891ec90 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe000891ec90 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe000891ed30 db_command() at db_command+0x279/frame 0xfffffe000891ee00 db_script_exec() at db_script_exec+0x188/frame 0xfffffe000891eea0 db_command() at db_command+0x279/frame 0xfffffe000891ef70 db_command_loop() at db_command_loop+0x64/frame 0xfffffe000891ef80 db_trap() at db_trap+0xef/frame 0xfffffe000891f010 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe000891f090 trap() at trap+0x811/frame 0xfffffe000891f1a0 calltrap() at calltrap+0x8/frame 0xfffffe000891f1a0 --- trap 0x3, rip = 0xffffffff80c1992b, rsp = 0xfffffe000891f270, rbp = 0xfffffe000891f280 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe000891f280 vpanic() at vpanic+0x1ba/frame 0xfffffe000891f2d0 panic() at panic+0x43/frame 0xfffffe000891f330 witness_unlock() at witness_unlock+0xea/frame 0xfffffe000891f370 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe000891f3a0 swp_pager_trimswapspace() at swp_pager_trimswapspace+0xd5/frame 0xfffffe000891f400 swap_pager_putpages() at swap_pager_putpages+0x56c/frame 0xfffffe000891f4a0 vm_pageout_flush() at vm_pageout_flush+0xff/frame 0xfffffe000891f580 vm_pageout_cluster() at vm_pageout_cluster+0x3e6/frame 0xfffffe000891f7f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x2f6/frame 0xfffffe000891fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000891fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000891fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command stealer pid 18147 tid 100434 td 0xfffff8011ba035c0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe000891ea90 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe000891eaa0 trap() at trap+0x5b/frame 0xfffffe000891ebb0 calltrap() at calltrap+0x8/frame 0xfffffe000891ebb0 --- trap 0xc, rip = 0xffffffff8107be66, rsp = 0xfffffe000891ec80, rbp = 0xfffffe000891ec90 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe000891ec90 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe000891ed30 db_command() at db_command+0x279/frame 0xfffffe000891ee00 db_script_exec() at db_script_exec+0x188/frame 0xfffffe000891eea0 db_command() at db_command+0x279/frame 0xfffffe000891ef70 db_command_loop() at db_command_loop+0x64/frame 0xfffffe000891ef80 db_trap() at db_trap+0xef/frame 0xfffffe000891f010 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe000891f090 trap() at trap+0x811/frame 0xfffffe000891f1a0 calltrap() at calltrap+0x8/frame 0xfffffe000891f1a0 --- trap 0x3, rip = 0xffffffff80c1992b, rsp = 0xfffffe000891f270, rbp = 0xfffffe000891f280 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe000891f280 vpanic() at vpanic+0x1ba/frame 0xfffffe000891f2d0 panic() at panic+0x43/frame 0xfffffe000891f330 witness_unlock() at witness_unlock+0xea/frame 0xfffffe000891f370 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe000891f3a0 swp_pager_trimswapspace() at swp_pager_trimswapspace+0xd5/frame 0xfffffe000891f400 swap_pager_putpages() at swap_pager_putpages+0x56c/frame 0xfffffe000891f4a0 vm_pageout_flush() at vm_pageout_flush+0xff/frame 0xfffffe000891f580 vm_pageout_cluster() at vm_pageout_cluster+0x3e6/frame 0xfffffe000891f7f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x2f6/frame 0xfffffe000891fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000891fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000891fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command stealer pid 18146 tid 100433 td 0xfffff8011b8d6000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe000891ea90 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe000891eaa0 trap() at trap+0x5b/frame 0xfffffe000891ebb0 calltrap() at calltrap+0x8/frame 0xfffffe000891ebb0 --- trap 0xc, rip = 0xffffffff8107be66, rsp = 0xfffffe000891ec80, rbp = 0xfffffe000891ec90 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe000891ec90 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe000891ed30 db_command() at db_command+0x279/frame 0xfffffe000891ee00 db_script_exec() at db_script_exec+0x188/frame 0xfffffe000891eea0 db_command() at db_command+0x279/frame 0xfffffe000891ef70 db_command_loop() at db_command_loop+0x64/frame 0xfffffe000891ef80 db_trap() at db_trap+0xef/frame 0xfffffe000891f010 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe000891f090 trap() at trap+0x811/frame 0xfffffe000891f1a0 calltrap() at calltrap+0x8/frame 0xfffffe000891f1a0 --- trap 0x3, rip = 0xffffffff80c1992b, rsp = 0xfffffe000891f270, rbp = 0xfffffe000891f280 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe000891f280 vpanic() at vpanic+0x1ba/frame 0xfffffe000891f2d0 panic() at panic+0x43/frame 0xfffffe000891f330 witness_unlock() at witness_unlock+0xea/frame 0xfffffe000891f370 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe000891f3a0 swp_pager_trimswapspace() at swp_pager_trimswapspace+0xd5/frame 0xfffffe000891f400 swap_pager_putpages() at swap_pager_putpages+0x56c/frame 0xfffffe000891f4a0 vm_pageout_flush() at vm_pageout_flush+0xff/frame 0xfffffe000891f580 vm_pageout_cluster() at vm_pageout_cluster+0x3e6/frame 0xfffffe000891f7f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x2f6/frame 0xfffffe000891fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000891fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000891fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command stealer pid 18145 tid 100312 td 0xfffff8011b753000 sched_switch() at sched_switch+0x713/frame 0xfffffe00aeb71550 mi_switch() at mi_switch+0x174/frame 0xfffffe00aeb71580 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aeb715c0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00aeb71600 _sleep() at _sleep+0x279/frame 0xfffffe00aeb716a0 swap_pager_getpages() at swap_pager_getpages+0x6c2/frame 0xfffffe00aeb71760 vm_pager_get_pages() at vm_pager_get_pages+0x4f/frame 0xfffffe00aeb717c0 vm_fault_hold() at vm_fault_hold+0x1544/frame 0xfffffe00aeb71910 vm_fault() at vm_fault+0x60/frame 0xfffffe00aeb71950 trap_pfault() at trap_pfault+0x188/frame 0xfffffe00aeb719a0 trap() at trap+0x46b/frame 0xfffffe00aeb71ab0 calltrap() at calltrap+0x8/frame 0xfffffe00aeb71ab0 --- trap 0xc, rip = 0x20137d, rsp = 0x7fffffffe690, rbp = 0x7fffffffe6c0 --- Tracing command stealer pid 18144 tid 100360 td 0xfffff80157f3d5c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aec61550 mi_switch() at mi_switch+0x174/frame 0xfffffe00aec61580 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aec615c0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00aec61600 _sleep() at _sleep+0x279/frame 0xfffffe00aec616a0 swap_pager_getpages() at swap_pager_getpages+0x6c2/frame 0xfffffe00aec61760 vm_pager_get_pages() at vm_pager_get_pages+0x4f/frame 0xfffffe00aec617c0 vm_fault_hold() at vm_fault_hold+0x1544/frame 0xfffffe00aec61910 vm_fault() at vm_fault+0x60/frame 0xfffffe00aec61950 trap_pfault() at trap_pfault+0x188/frame 0xfffffe00aec619a0 trap() at trap+0x46b/frame 0xfffffe00aec61ab0 calltrap() at calltrap+0x8/frame 0xfffffe00aec61ab0 --- trap 0xc, rip = 0x20137d, rsp = 0x7fffffffe690, rbp = 0x7fffffffe6c0 --- Tracing command stealer pid 18143 tid 100359 td 0xfffff80157f3c000 sched_switch() at sched_switch+0x713/frame 0xfffffe00aec5ca40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aec5ca70 ast() at ast+0x28d/frame 0xfffffe00aec5cab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18142 tid 100463 td 0xfffff805b88425c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00af663550 mi_switch() at mi_switch+0x174/frame 0xfffffe00af663580 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00af6635c0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00af663600 _sleep() at _sleep+0x279/frame 0xfffffe00af6636a0 swap_pager_getpages() at swap_pager_getpages+0x6c2/frame 0xfffffe00af663760 vm_pager_get_pages() at vm_pager_get_pages+0x4f/frame 0xfffffe00af6637c0 vm_fault_hold() at vm_fault_hold+0x1544/frame 0xfffffe00af663910 vm_fault() at vm_fault+0x60/frame 0xfffffe00af663950 trap_pfault() at trap_pfault+0x188/frame 0xfffffe00af6639a0 trap() at trap+0x46b/frame 0xfffffe00af663ab0 calltrap() at calltrap+0x8/frame 0xfffffe00af663ab0 --- trap 0xc, rip = 0x20137d, rsp = 0x7fffffffe690, rbp = 0x7fffffffe6c0 --- Tracing command stealer pid 18141 tid 100462 td 0xfffff805c1878000 sched_switch() at sched_switch+0x713/frame 0xfffffe00af65e660 mi_switch() at mi_switch+0x174/frame 0xfffffe00af65e690 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00af65e6d0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00af65e700 _sleep() at _sleep+0x2da/frame 0xfffffe00af65e7a0 vm_waitpfault() at vm_waitpfault+0x6b/frame 0xfffffe00af65e7c0 vm_fault_hold() at vm_fault_hold+0xabb/frame 0xfffffe00af65e910 vm_fault() at vm_fault+0x60/frame 0xfffffe00af65e950 trap_pfault() at trap_pfault+0x188/frame 0xfffffe00af65e9a0 trap() at trap+0x46b/frame 0xfffffe00af65eab0 calltrap() at calltrap+0x8/frame 0xfffffe00af65eab0 --- trap 0xc, rip = 0x800415885, rsp = 0x7fffffffe338, rbp = 0x7fffffffe380 --- Tracing command stealer pid 18140 tid 100460 td 0xfffff805c18785c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00af654550 mi_switch() at mi_switch+0x174/frame 0xfffffe00af654580 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00af6545c0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00af654600 _sleep() at _sleep+0x279/frame 0xfffffe00af6546a0 swap_pager_getpages() at swap_pager_getpages+0x6c2/frame 0xfffffe00af654760 vm_pager_get_pages() at vm_pager_get_pages+0x4f/frame 0xfffffe00af6547c0 vm_fault_hold() at vm_fault_hold+0x1544/frame 0xfffffe00af654910 vm_fault() at vm_fault+0x60/frame 0xfffffe00af654950 trap_pfault() at trap_pfault+0x188/frame 0xfffffe00af6549a0 trap() at trap+0x46b/frame 0xfffffe00af654ab0 calltrap() at calltrap+0x8/frame 0xfffffe00af654ab0 --- trap 0xc, rip = 0x20137d, rsp = 0x7fffffffe690, rbp = 0x7fffffffe6c0 --- Tracing command stealer pid 18139 tid 100289 td 0xfffff801578e75c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aeafea40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aeafea70 ast() at ast+0x28d/frame 0xfffffe00aeafeab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18138 tid 100288 td 0xfffff8015746c000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe000891ea90 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe000891eaa0 trap() at trap+0x5b/frame 0xfffffe000891ebb0 calltrap() at calltrap+0x8/frame 0xfffffe000891ebb0 --- trap 0xc, rip = 0xffffffff8107be66, rsp = 0xfffffe000891ec80, rbp = 0xfffffe000891ec90 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe000891ec90 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe000891ed30 db_command() at db_command+0x279/frame 0xfffffe000891ee00 db_script_exec() at db_script_exec+0x188/frame 0xfffffe000891eea0 db_command() at db_command+0x279/frame 0xfffffe000891ef70 db_command_loop() at db_command_loop+0x64/frame 0xfffffe000891ef80 db_trap() at db_trap+0xef/frame 0xfffffe000891f010 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe000891f090 trap() at trap+0x811/frame 0xfffffe000891f1a0 calltrap() at calltrap+0x8/frame 0xfffffe000891f1a0 --- trap 0x3, rip = 0xffffffff80c1992b, rsp = 0xfffffe000891f270, rbp = 0xfffffe000891f280 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe000891f280 vpanic() at vpanic+0x1ba/frame 0xfffffe000891f2d0 panic() at panic+0x43/frame 0xfffffe000891f330 witness_unlock() at witness_unlock+0xea/frame 0xfffffe000891f370 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe000891f3a0 swp_pager_trimswapspace() at swp_pager_trimswapspace+0xd5/frame 0xfffffe000891f400 swap_pager_putpages() at swap_pager_putpages+0x56c/frame 0xfffffe000891f4a0 vm_pageout_flush() at vm_pageout_flush+0xff/frame 0xfffffe000891f580 vm_pageout_cluster() at vm_pageout_cluster+0x3e6/frame 0xfffffe000891f7f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x2f6/frame 0xfffffe000891fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000891fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000891fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command stealer pid 18137 tid 100287 td 0xfffff8015746c5c0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe000891ea90 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe000891eaa0 trap() at trap+0x5b/frame 0xfffffe000891ebb0 calltrap() at calltrap+0x8/frame 0xfffffe000891ebb0 --- trap 0xc, rip = 0xffffffff8107be66, rsp = 0xfffffe000891ec80, rbp = 0xfffffe000891ec90 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe000891ec90 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe000891ed30 db_command() at db_command+0x279/frame 0xfffffe000891ee00 db_script_exec() at db_script_exec+0x188/frame 0xfffffe000891eea0 db_command() at db_command+0x279/frame 0xfffffe000891ef70 db_command_loop() at db_command_loop+0x64/frame 0xfffffe000891ef80 db_trap() at db_trap+0xef/frame 0xfffffe000891f010 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe000891f090 trap() at trap+0x811/frame 0xfffffe000891f1a0 calltrap() at calltrap+0x8/frame 0xfffffe000891f1a0 --- trap 0x3, rip = 0xffffffff80c1992b, rsp = 0xfffffe000891f270, rbp = 0xfffffe000891f280 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe000891f280 vpanic() at vpanic+0x1ba/frame 0xfffffe000891f2d0 panic() at panic+0x43/frame 0xfffffe000891f330 witness_unlock() at witness_unlock+0xea/frame 0xfffffe000891f370 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe000891f3a0 swp_pager_trimswapspace() at swp_pager_trimswapspace+0xd5/frame 0xfffffe000891f400 swap_pager_putpages() at swap_pager_putpages+0x56c/frame 0xfffffe000891f4a0 vm_pageout_flush() at vm_pageout_flush+0xff/frame 0xfffffe000891f580 vm_pageout_cluster() at vm_pageout_cluster+0x3e6/frame 0xfffffe000891f7f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x2f6/frame 0xfffffe000891fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000891fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000891fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command stealer pid 18136 tid 100249 td 0xfffff80157323000 sched_switch() at sched_switch+0x713/frame 0xfffffe00aea36550 mi_switch() at mi_switch+0x174/frame 0xfffffe00aea36580 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aea365c0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00aea36600 _sleep() at _sleep+0x279/frame 0xfffffe00aea366a0 swap_pager_getpages() at swap_pager_getpages+0x6c2/frame 0xfffffe00aea36760 vm_pager_get_pages() at vm_pager_get_pages+0x4f/frame 0xfffffe00aea367c0 vm_fault_hold() at vm_fault_hold+0x1544/frame 0xfffffe00aea36910 vm_fault() at vm_fault+0x60/frame 0xfffffe00aea36950 trap_pfault() at trap_pfault+0x188/frame 0xfffffe00aea369a0 trap() at trap+0x46b/frame 0xfffffe00aea36ab0 calltrap() at calltrap+0x8/frame 0xfffffe00aea36ab0 --- trap 0xc, rip = 0x20137d, rsp = 0x7fffffffe690, rbp = 0x7fffffffe6c0 --- Tracing command stealer pid 18135 tid 100302 td 0xfffff8011b06f000 sched_switch() at sched_switch+0x713/frame 0xfffffe00aeb3fa40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aeb3fa70 ast() at ast+0x28d/frame 0xfffffe00aeb3fab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18134 tid 100298 td 0xfffff8011b06f5c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aeb2ba40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aeb2ba70 ast() at ast+0x28d/frame 0xfffffe00aeb2bab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18133 tid 100441 td 0xfffff805c1988000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe000891ea90 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe000891eaa0 trap() at trap+0x5b/frame 0xfffffe000891ebb0 calltrap() at calltrap+0x8/frame 0xfffffe000891ebb0 --- trap 0xc, rip = 0xffffffff8107be66, rsp = 0xfffffe000891ec80, rbp = 0xfffffe000891ec90 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe000891ec90 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe000891ed30 db_command() at db_command+0x279/frame 0xfffffe000891ee00 db_script_exec() at db_script_exec+0x188/frame 0xfffffe000891eea0 db_command() at db_command+0x279/frame 0xfffffe000891ef70 db_command_loop() at db_command_loop+0x64/frame 0xfffffe000891ef80 db_trap() at db_trap+0xef/frame 0xfffffe000891f010 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe000891f090 trap() at trap+0x811/frame 0xfffffe000891f1a0 calltrap() at calltrap+0x8/frame 0xfffffe000891f1a0 --- trap 0x3, rip = 0xffffffff80c1992b, rsp = 0xfffffe000891f270, rbp = 0xfffffe000891f280 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe000891f280 vpanic() at vpanic+0x1ba/frame 0xfffffe000891f2d0 panic() at panic+0x43/frame 0xfffffe000891f330 witness_unlock() at witness_unlock+0xea/frame 0xfffffe000891f370 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe000891f3a0 swp_pager_trimswapspace() at swp_pager_trimswapspace+0xd5/frame 0xfffffe000891f400 swap_pager_putpages() at swap_pager_putpages+0x56c/frame 0xfffffe000891f4a0 vm_pageout_flush() at vm_pageout_flush+0xff/frame 0xfffffe000891f580 vm_pageout_cluster() at vm_pageout_cluster+0x3e6/frame 0xfffffe000891f7f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x2f6/frame 0xfffffe000891fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000891fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000891fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command stealer pid 18132 tid 100440 td 0xfffff805c19885c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aedf1a40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aedf1a70 ast() at ast+0x28d/frame 0xfffffe00aedf1ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18131 tid 100436 td 0xfffff801575415c0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe000891ea90 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe000891eaa0 trap() at trap+0x5b/frame 0xfffffe000891ebb0 calltrap() at calltrap+0x8/frame 0xfffffe000891ebb0 --- trap 0xc, rip = 0xffffffff8107be66, rsp = 0xfffffe000891ec80, rbp = 0xfffffe000891ec90 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe000891ec90 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe000891ed30 db_command() at db_command+0x279/frame 0xfffffe000891ee00 db_script_exec() at db_script_exec+0x188/frame 0xfffffe000891eea0 db_command() at db_command+0x279/frame 0xfffffe000891ef70 db_command_loop() at db_command_loop+0x64/frame 0xfffffe000891ef80 db_trap() at db_trap+0xef/frame 0xfffffe000891f010 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe000891f090 trap() at trap+0x811/frame 0xfffffe000891f1a0 calltrap() at calltrap+0x8/frame 0xfffffe000891f1a0 --- trap 0x3, rip = 0xffffffff80c1992b, rsp = 0xfffffe000891f270, rbp = 0xfffffe000891f280 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe000891f280 vpanic() at vpanic+0x1ba/frame 0xfffffe000891f2d0 panic() at panic+0x43/frame 0xfffffe000891f330 witness_unlock() at witness_unlock+0xea/frame 0xfffffe000891f370 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe000891f3a0 swp_pager_trimswapspace() at swp_pager_trimswapspace+0xd5/frame 0xfffffe000891f400 swap_pager_putpages() at swap_pager_putpages+0x56c/frame 0xfffffe000891f4a0 vm_pageout_flush() at vm_pageout_flush+0xff/frame 0xfffffe000891f580 vm_pageout_cluster() at vm_pageout_cluster+0x3e6/frame 0xfffffe000891f7f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x2f6/frame 0xfffffe000891fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000891fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000891fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command stealer pid 18130 tid 100280 td 0xfffff8004f7cd000 sched_switch() at sched_switch+0x713/frame 0xfffffe00aead1a30 mi_switch() at mi_switch+0x174/frame 0xfffffe00aead1a60 critical_exit_preempt() at critical_exit_preempt+0x65/frame 0xfffffe00aead1a80 ipi_bitmap_handler() at ipi_bitmap_handler+0xa2/frame 0xfffffe00aead1ab0 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0xb0/frame 0xfffffe00aead1ab0 --- interrupt, rip = 0x201381, rsp = 0x7fffffffe690, rbp = 0x7fffffffe6c0 --- Tracing command stealer pid 18129 tid 100278 td 0xfffff8004f7cd5c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aeac7a40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aeac7a70 ast() at ast+0x28d/frame 0xfffffe00aeac7ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18128 tid 100275 td 0xfffff8000bb61000 sched_switch() at sched_switch+0x713/frame 0xfffffe00aeab8a40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aeab8a70 ast() at ast+0x28d/frame 0xfffffe00aeab8ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18127 tid 100361 td 0xfffff80157f3d000 sched_switch() at sched_switch+0x713/frame 0xfffffe00aec66a40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aec66a70 ast() at ast+0x28d/frame 0xfffffe00aec66ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18126 tid 100381 td 0xfffff804e9315000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe000891ea90 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe000891eaa0 trap() at trap+0x5b/frame 0xfffffe000891ebb0 calltrap() at calltrap+0x8/frame 0xfffffe000891ebb0 --- trap 0xc, rip = 0xffffffff8107be66, rsp = 0xfffffe000891ec80, rbp = 0xfffffe000891ec90 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe000891ec90 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe000891ed30 db_command() at db_command+0x279/frame 0xfffffe000891ee00 db_script_exec() at db_script_exec+0x188/frame 0xfffffe000891eea0 db_command() at db_command+0x279/frame 0xfffffe000891ef70 db_command_loop() at db_command_loop+0x64/frame 0xfffffe000891ef80 db_trap() at db_trap+0xef/frame 0xfffffe000891f010 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe000891f090 trap() at trap+0x811/frame 0xfffffe000891f1a0 calltrap() at calltrap+0x8/frame 0xfffffe000891f1a0 --- trap 0x3, rip = 0xffffffff80c1992b, rsp = 0xfffffe000891f270, rbp = 0xfffffe000891f280 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe000891f280 vpanic() at vpanic+0x1ba/frame 0xfffffe000891f2d0 panic() at panic+0x43/frame 0xfffffe000891f330 witness_unlock() at witness_unlock+0xea/frame 0xfffffe000891f370 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe000891f3a0 swp_pager_trimswapspace() at swp_pager_trimswapspace+0xd5/frame 0xfffffe000891f400 swap_pager_putpages() at swap_pager_putpages+0x56c/frame 0xfffffe000891f4a0 vm_pageout_flush() at vm_pageout_flush+0xff/frame 0xfffffe000891f580 vm_pageout_cluster() at vm_pageout_cluster+0x3e6/frame 0xfffffe000891f7f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x2f6/frame 0xfffffe000891fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000891fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000891fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command stealer pid 18125 tid 100379 td 0xfffff804e93155c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aecc0a40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aecc0a70 ast() at ast+0x28d/frame 0xfffffe00aecc0ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18124 tid 100430 td 0xfffff805b25d8000 sched_switch() at sched_switch+0x713/frame 0xfffffe00aedbf660 mi_switch() at mi_switch+0x174/frame 0xfffffe00aedbf690 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aedbf6d0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00aedbf700 _sleep() at _sleep+0x2da/frame 0xfffffe00aedbf7a0 vm_waitpfault() at vm_waitpfault+0x6b/frame 0xfffffe00aedbf7c0 vm_fault_hold() at vm_fault_hold+0xabb/frame 0xfffffe00aedbf910 vm_fault() at vm_fault+0x60/frame 0xfffffe00aedbf950 trap_pfault() at trap_pfault+0x188/frame 0xfffffe00aedbf9a0 trap() at trap+0x46b/frame 0xfffffe00aedbfab0 calltrap() at calltrap+0x8/frame 0xfffffe00aedbfab0 --- trap 0xc, rip = 0x20137d, rsp = 0x7fffffffe690, rbp = 0x7fffffffe6c0 --- Tracing command stealer pid 18123 tid 100429 td 0xfffff805b25d85c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aedbaa40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aedbaa70 ast() at ast+0x28d/frame 0xfffffe00aedbaab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18122 tid 100427 td 0xfffff805b2a82000 sched_switch() at sched_switch+0x713/frame 0xfffffe00aedb0a40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aedb0a70 ast() at ast+0x28d/frame 0xfffffe00aedb0ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18121 tid 100432 td 0xfffff8011b8d65c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aedc9a40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aedc9a70 ast() at ast+0x28d/frame 0xfffffe00aedc9ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18120 tid 100431 td 0xfffff8011bebd000 sched_switch() at sched_switch+0x713/frame 0xfffffe00aedc4550 mi_switch() at mi_switch+0x174/frame 0xfffffe00aedc4580 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aedc45c0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00aedc4600 _sleep() at _sleep+0x279/frame 0xfffffe00aedc46a0 swap_pager_getpages() at swap_pager_getpages+0x6c2/frame 0xfffffe00aedc4760 vm_pager_get_pages() at vm_pager_get_pages+0x4f/frame 0xfffffe00aedc47c0 vm_fault_hold() at vm_fault_hold+0x1544/frame 0xfffffe00aedc4910 vm_fault() at vm_fault+0x60/frame 0xfffffe00aedc4950 trap_pfault() at trap_pfault+0x188/frame 0xfffffe00aedc49a0 trap() at trap+0x46b/frame 0xfffffe00aedc4ab0 calltrap() at calltrap+0x8/frame 0xfffffe00aedc4ab0 --- trap 0xc, rip = 0x20137d, rsp = 0x7fffffffe690, rbp = 0x7fffffffe6c0 --- Tracing command stealer pid 18119 tid 100428 td 0xfffff8011bebd5c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aedb5a40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aedb5a70 ast() at ast+0x28d/frame 0xfffffe00aedb5ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18118 tid 100304 td 0xfffff8011bf215c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aeb49a40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aeb49a70 ast() at ast+0x28d/frame 0xfffffe00aeb49ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18117 tid 100418 td 0xfffff805b0c58000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe000891ea90 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe000891eaa0 trap() at trap+0x5b/frame 0xfffffe000891ebb0 calltrap() at calltrap+0x8/frame 0xfffffe000891ebb0 --- trap 0xc, rip = 0xffffffff8107be66, rsp = 0xfffffe000891ec80, rbp = 0xfffffe000891ec90 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe000891ec90 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe000891ed30 db_command() at db_command+0x279/frame 0xfffffe000891ee00 db_script_exec() at db_script_exec+0x188/frame 0xfffffe000891eea0 db_command() at db_command+0x279/frame 0xfffffe000891ef70 db_command_loop() at db_command_loop+0x64/frame 0xfffffe000891ef80 db_trap() at db_trap+0xef/frame 0xfffffe000891f010 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe000891f090 trap() at trap+0x811/frame 0xfffffe000891f1a0 calltrap() at calltrap+0x8/frame 0xfffffe000891f1a0 --- trap 0x3, rip = 0xffffffff80c1992b, rsp = 0xfffffe000891f270, rbp = 0xfffffe000891f280 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe000891f280 vpanic() at vpanic+0x1ba/frame 0xfffffe000891f2d0 panic() at panic+0x43/frame 0xfffffe000891f330 witness_unlock() at witness_unlock+0xea/frame 0xfffffe000891f370 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe000891f3a0 swp_pager_trimswapspace() at swp_pager_trimswapspace+0xd5/frame 0xfffffe000891f400 swap_pager_putpages() at swap_pager_putpages+0x56c/frame 0xfffffe000891f4a0 vm_pageout_flush() at vm_pageout_flush+0xff/frame 0xfffffe000891f580 vm_pageout_cluster() at vm_pageout_cluster+0x3e6/frame 0xfffffe000891f7f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x2f6/frame 0xfffffe000891fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000891fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000891fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command stealer pid 18116 tid 100405 td 0xfffff805b0c585c0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe000891ea90 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe000891eaa0 trap() at trap+0x5b/frame 0xfffffe000891ebb0 calltrap() at calltrap+0x8/frame 0xfffffe000891ebb0 --- trap 0xc, rip = 0xffffffff8107be66, rsp = 0xfffffe000891ec80, rbp = 0xfffffe000891ec90 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe000891ec90 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe000891ed30 db_command() at db_command+0x279/frame 0xfffffe000891ee00 db_script_exec() at db_script_exec+0x188/frame 0xfffffe000891eea0 db_command() at db_command+0x279/frame 0xfffffe000891ef70 db_command_loop() at db_command_loop+0x64/frame 0xfffffe000891ef80 db_trap() at db_trap+0xef/frame 0xfffffe000891f010 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe000891f090 trap() at trap+0x811/frame 0xfffffe000891f1a0 calltrap() at calltrap+0x8/frame 0xfffffe000891f1a0 --- trap 0x3, rip = 0xffffffff80c1992b, rsp = 0xfffffe000891f270, rbp = 0xfffffe000891f280 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe000891f280 vpanic() at vpanic+0x1ba/frame 0xfffffe000891f2d0 panic() at panic+0x43/frame 0xfffffe000891f330 witness_unlock() at witness_unlock+0xea/frame 0xfffffe000891f370 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe000891f3a0 swp_pager_trimswapspace() at swp_pager_trimswapspace+0xd5/frame 0xfffffe000891f400 swap_pager_putpages() at swap_pager_putpages+0x56c/frame 0xfffffe000891f4a0 vm_pageout_flush() at vm_pageout_flush+0xff/frame 0xfffffe000891f580 vm_pageout_cluster() at vm_pageout_cluster+0x3e6/frame 0xfffffe000891f7f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x2f6/frame 0xfffffe000891fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000891fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000891fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command stealer pid 18115 tid 100310 td 0xfffff8011b0fa5c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aeb67a40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aeb67a70 ast() at ast+0x28d/frame 0xfffffe00aeb67ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18114 tid 100308 td 0xfffff8000bb6f000 sched_switch() at sched_switch+0x713/frame 0xfffffe00aeb5da40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aeb5da70 ast() at ast+0x28d/frame 0xfffffe00aeb5dab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18113 tid 100201 td 0xfffff8000bb6f5c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00ad745a40 mi_switch() at mi_switch+0x174/frame 0xfffffe00ad745a70 ast() at ast+0x28d/frame 0xfffffe00ad745ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18112 tid 100387 td 0xfffff8000b45a000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe000891ea90 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe000891eaa0 trap() at trap+0x5b/frame 0xfffffe000891ebb0 calltrap() at calltrap+0x8/frame 0xfffffe000891ebb0 --- trap 0xc, rip = 0xffffffff8107be66, rsp = 0xfffffe000891ec80, rbp = 0xfffffe000891ec90 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe000891ec90 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe000891ed30 db_command() at db_command+0x279/frame 0xfffffe000891ee00 db_script_exec() at db_script_exec+0x188/frame 0xfffffe000891eea0 db_command() at db_command+0x279/frame 0xfffffe000891ef70 db_command_loop() at db_command_loop+0x64/frame 0xfffffe000891ef80 db_trap() at db_trap+0xef/frame 0xfffffe000891f010 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe000891f090 trap() at trap+0x811/frame 0xfffffe000891f1a0 calltrap() at calltrap+0x8/frame 0xfffffe000891f1a0 --- trap 0x3, rip = 0xffffffff80c1992b, rsp = 0xfffffe000891f270, rbp = 0xfffffe000891f280 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe000891f280 vpanic() at vpanic+0x1ba/frame 0xfffffe000891f2d0 panic() at panic+0x43/frame 0xfffffe000891f330 witness_unlock() at witness_unlock+0xea/frame 0xfffffe000891f370 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe000891f3a0 swp_pager_trimswapspace() at swp_pager_trimswapspace+0xd5/frame 0xfffffe000891f400 swap_pager_putpages() at swap_pager_putpages+0x56c/frame 0xfffffe000891f4a0 vm_pageout_flush() at vm_pageout_flush+0xff/frame 0xfffffe000891f580 vm_pageout_cluster() at vm_pageout_cluster+0x3e6/frame 0xfffffe000891f7f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x2f6/frame 0xfffffe000891fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000891fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000891fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command stealer pid 18111 tid 100386 td 0xfffff8000b45a5c0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe000891ea90 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe000891eaa0 trap() at trap+0x5b/frame 0xfffffe000891ebb0 calltrap() at calltrap+0x8/frame 0xfffffe000891ebb0 --- trap 0xc, rip = 0xffffffff8107be66, rsp = 0xfffffe000891ec80, rbp = 0xfffffe000891ec90 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe000891ec90 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe000891ed30 db_command() at db_command+0x279/frame 0xfffffe000891ee00 db_script_exec() at db_script_exec+0x188/frame 0xfffffe000891eea0 db_command() at db_command+0x279/frame 0xfffffe000891ef70 db_command_loop() at db_command_loop+0x64/frame 0xfffffe000891ef80 db_trap() at db_trap+0xef/frame 0xfffffe000891f010 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe000891f090 trap() at trap+0x811/frame 0xfffffe000891f1a0 calltrap() at calltrap+0x8/frame 0xfffffe000891f1a0 --- trap 0x3, rip = 0xffffffff80c1992b, rsp = 0xfffffe000891f270, rbp = 0xfffffe000891f280 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe000891f280 vpanic() at vpanic+0x1ba/frame 0xfffffe000891f2d0 panic() at panic+0x43/frame 0xfffffe000891f330 witness_unlock() at witness_unlock+0xea/frame 0xfffffe000891f370 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe000891f3a0 swp_pager_trimswapspace() at swp_pager_trimswapspace+0xd5/frame 0xfffffe000891f400 swap_pager_putpages() at swap_pager_putpages+0x56c/frame 0xfffffe000891f4a0 vm_pageout_flush() at vm_pageout_flush+0xff/frame 0xfffffe000891f580 vm_pageout_cluster() at vm_pageout_cluster+0x3e6/frame 0xfffffe000891f7f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x2f6/frame 0xfffffe000891fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000891fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000891fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command stealer pid 18110 tid 100313 td 0xfffff8000b9ee000 sched_switch() at sched_switch+0x713/frame 0xfffffe00aeb76a40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aeb76a70 ast() at ast+0x28d/frame 0xfffffe00aeb76ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18109 tid 100382 td 0xfffff804e93165c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aeccfa40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aeccfa70 ast() at ast+0x28d/frame 0xfffffe00aeccfab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18108 tid 100155 td 0xfffff80003945000 sched_switch() at sched_switch+0x713/frame 0xfffffe00ad604a40 mi_switch() at mi_switch+0x174/frame 0xfffffe00ad604a70 ast() at ast+0x28d/frame 0xfffffe00ad604ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18107 tid 100154 td 0xfffff800039455c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00abdfb550 mi_switch() at mi_switch+0x174/frame 0xfffffe00abdfb580 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00abdfb5c0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00abdfb600 _sleep() at _sleep+0x279/frame 0xfffffe00abdfb6a0 swap_pager_getpages() at swap_pager_getpages+0x6c2/frame 0xfffffe00abdfb760 vm_pager_get_pages() at vm_pager_get_pages+0x4f/frame 0xfffffe00abdfb7c0 vm_fault_hold() at vm_fault_hold+0x1544/frame 0xfffffe00abdfb910 vm_fault() at vm_fault+0x60/frame 0xfffffe00abdfb950 trap_pfault() at trap_pfault+0x188/frame 0xfffffe00abdfb9a0 trap() at trap+0x46b/frame 0xfffffe00abdfbab0 calltrap() at calltrap+0x8/frame 0xfffffe00abdfbab0 --- trap 0xc, rip = 0x20137d, rsp = 0x7fffffffe690, rbp = 0x7fffffffe6c0 --- Tracing command stealer pid 18106 tid 100422 td 0xfffff805b0623000 (CPU 3) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe000858bdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe000858be10 trap() at trap+0x48/frame 0xfffffe000858bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe000858bf20 --- trap 0x13, rip = 0x20137d, rsp = 0x7fffffffe690, rbp = 0x7fffffffe6c0 --- Tracing command stealer pid 18105 tid 100421 td 0xfffff805b06235c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aed92a40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aed92a70 ast() at ast+0x28d/frame 0xfffffe00aed92ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18104 tid 100420 td 0xfffff805b0984000 sched_switch() at sched_switch+0x713/frame 0xfffffe00aed8da30 mi_switch() at mi_switch+0x174/frame 0xfffffe00aed8da60 critical_exit_preempt() at critical_exit_preempt+0x65/frame 0xfffffe00aed8da80 ipi_bitmap_handler() at ipi_bitmap_handler+0xa2/frame 0xfffffe00aed8dab0 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0xb0/frame 0xfffffe00aed8dab0 --- interrupt, rip = 0x20137d, rsp = 0x7fffffffe690, rbp = 0x7fffffffe6c0 --- Tracing command stealer pid 18103 tid 100425 td 0xfffff804e93145c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aeda6550 mi_switch() at mi_switch+0x174/frame 0xfffffe00aeda6580 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aeda65c0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00aeda6600 _sleep() at _sleep+0x279/frame 0xfffffe00aeda66a0 swap_pager_getpages() at swap_pager_getpages+0x6c2/frame 0xfffffe00aeda6760 vm_pager_get_pages() at vm_pager_get_pages+0x4f/frame 0xfffffe00aeda67c0 vm_fault_hold() at vm_fault_hold+0x1544/frame 0xfffffe00aeda6910 vm_fault() at vm_fault+0x60/frame 0xfffffe00aeda6950 trap_pfault() at trap_pfault+0x188/frame 0xfffffe00aeda69a0 trap() at trap+0x46b/frame 0xfffffe00aeda6ab0 calltrap() at calltrap+0x8/frame 0xfffffe00aeda6ab0 --- trap 0xc, rip = 0x20137d, rsp = 0x7fffffffe690, rbp = 0x7fffffffe6c0 --- Tracing command stealer pid 18102 tid 100424 td 0xfffff805b0509000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe000891ea90 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe000891eaa0 trap() at trap+0x5b/frame 0xfffffe000891ebb0 calltrap() at calltrap+0x8/frame 0xfffffe000891ebb0 --- trap 0xc, rip = 0xffffffff8107be66, rsp = 0xfffffe000891ec80, rbp = 0xfffffe000891ec90 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe000891ec90 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe000891ed30 db_command() at db_command+0x279/frame 0xfffffe000891ee00 db_script_exec() at db_script_exec+0x188/frame 0xfffffe000891eea0 db_command() at db_command+0x279/frame 0xfffffe000891ef70 db_command_loop() at db_command_loop+0x64/frame 0xfffffe000891ef80 db_trap() at db_trap+0xef/frame 0xfffffe000891f010 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe000891f090 trap() at trap+0x811/frame 0xfffffe000891f1a0 calltrap() at calltrap+0x8/frame 0xfffffe000891f1a0 --- trap 0x3, rip = 0xffffffff80c1992b, rsp = 0xfffffe000891f270, rbp = 0xfffffe000891f280 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe000891f280 vpanic() at vpanic+0x1ba/frame 0xfffffe000891f2d0 panic() at panic+0x43/frame 0xfffffe000891f330 witness_unlock() at witness_unlock+0xea/frame 0xfffffe000891f370 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe000891f3a0 swp_pager_trimswapspace() at swp_pager_trimswapspace+0xd5/frame 0xfffffe000891f400 swap_pager_putpages() at swap_pager_putpages+0x56c/frame 0xfffffe000891f4a0 vm_pageout_flush() at vm_pageout_flush+0xff/frame 0xfffffe000891f580 vm_pageout_cluster() at vm_pageout_cluster+0x3e6/frame 0xfffffe000891f7f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x2f6/frame 0xfffffe000891fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000891fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000891fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command stealer pid 18101 tid 100423 td 0xfffff805b05095c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aed9ca40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aed9ca70 ast() at ast+0x28d/frame 0xfffffe00aed9cab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18100 tid 100426 td 0xfffff805b2a825c0 (CPU 6) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe00085afdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe00085afe10 trap() at trap+0x48/frame 0xfffffe00085aff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00085aff20 --- trap 0x13, rip = 0xffffffff80c3ac12, rsp = 0xfffffe00aedab640, rbp = 0xfffffe00aedab6b0 --- witness_checkorder() at witness_checkorder+0xe2/frame 0xfffffe00aedab6b0 __mtx_lock_flags() at __mtx_lock_flags+0x95/frame 0xfffffe00aedab700 pmap_enter() at pmap_enter+0x2ba/frame 0xfffffe00aedab7c0 vm_fault_hold() at vm_fault_hold+0x18e9/frame 0xfffffe00aedab910 vm_fault() at vm_fault+0x60/frame 0xfffffe00aedab950 trap_pfault() at trap_pfault+0x188/frame 0xfffffe00aedab9a0 trap() at trap+0x46b/frame 0xfffffe00aedabab0 calltrap() at calltrap+0x8/frame 0xfffffe00aedabab0 --- trap 0xc, rip = 0x800415885, rsp = 0x7fffffffe338, rbp = 0x7fffffffe380 --- Tracing command stealer pid 18099 tid 100260 td 0xfffff8011b4b15c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aea6d550 mi_switch() at mi_switch+0x174/frame 0xfffffe00aea6d580 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aea6d5c0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00aea6d600 _sleep() at _sleep+0x279/frame 0xfffffe00aea6d6a0 swap_pager_getpages() at swap_pager_getpages+0x6c2/frame 0xfffffe00aea6d760 vm_pager_get_pages() at vm_pager_get_pages+0x4f/frame 0xfffffe00aea6d7c0 vm_fault_hold() at vm_fault_hold+0x1544/frame 0xfffffe00aea6d910 vm_fault() at vm_fault+0x60/frame 0xfffffe00aea6d950 trap_pfault() at trap_pfault+0x188/frame 0xfffffe00aea6d9a0 trap() at trap+0x46b/frame 0xfffffe00aea6dab0 calltrap() at calltrap+0x8/frame 0xfffffe00aea6dab0 --- trap 0xc, rip = 0x20137d, rsp = 0x7fffffffe690, rbp = 0x7fffffffe6c0 --- Tracing command stealer pid 18098 tid 100259 td 0xfffff8011b693000 sched_switch() at sched_switch+0x713/frame 0xfffffe00aea68a40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aea68a70 ast() at ast+0x28d/frame 0xfffffe00aea68ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18097 tid 100400 td 0xfffff8000bb38000 sched_switch() at sched_switch+0x713/frame 0xfffffe00aed29a40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aed29a70 ast() at ast+0x28d/frame 0xfffffe00aed29ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18096 tid 100395 td 0xfffff8000bb385c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aed10a40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aed10a70 ast() at ast+0x28d/frame 0xfffffe00aed10ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18095 tid 100300 td 0xfffff8000bb3a000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe000891ea90 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe000891eaa0 trap() at trap+0x5b/frame 0xfffffe000891ebb0 calltrap() at calltrap+0x8/frame 0xfffffe000891ebb0 --- trap 0xc, rip = 0xffffffff8107be66, rsp = 0xfffffe000891ec80, rbp = 0xfffffe000891ec90 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe000891ec90 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe000891ed30 db_command() at db_command+0x279/frame 0xfffffe000891ee00 db_script_exec() at db_script_exec+0x188/frame 0xfffffe000891eea0 db_command() at db_command+0x279/frame 0xfffffe000891ef70 db_command_loop() at db_command_loop+0x64/frame 0xfffffe000891ef80 db_trap() at db_trap+0xef/frame 0xfffffe000891f010 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe000891f090 trap() at trap+0x811/frame 0xfffffe000891f1a0 calltrap() at calltrap+0x8/frame 0xfffffe000891f1a0 --- trap 0x3, rip = 0xffffffff80c1992b, rsp = 0xfffffe000891f270, rbp = 0xfffffe000891f280 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe000891f280 vpanic() at vpanic+0x1ba/frame 0xfffffe000891f2d0 panic() at panic+0x43/frame 0xfffffe000891f330 witness_unlock() at witness_unlock+0xea/frame 0xfffffe000891f370 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe000891f3a0 swp_pager_trimswapspace() at swp_pager_trimswapspace+0xd5/frame 0xfffffe000891f400 swap_pager_putpages() at swap_pager_putpages+0x56c/frame 0xfffffe000891f4a0 vm_pageout_flush() at vm_pageout_flush+0xff/frame 0xfffffe000891f580 vm_pageout_cluster() at vm_pageout_cluster+0x3e6/frame 0xfffffe000891f7f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x2f6/frame 0xfffffe000891fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000891fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000891fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command stealer pid 18094 tid 100437 td 0xfffff805b28a15c0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe000891ea90 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe000891eaa0 trap() at trap+0x5b/frame 0xfffffe000891ebb0 calltrap() at calltrap+0x8/frame 0xfffffe000891ebb0 --- trap 0xc, rip = 0xffffffff8107be66, rsp = 0xfffffe000891ec80, rbp = 0xfffffe000891ec90 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe000891ec90 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe000891ed30 db_command() at db_command+0x279/frame 0xfffffe000891ee00 db_script_exec() at db_script_exec+0x188/frame 0xfffffe000891eea0 db_command() at db_command+0x279/frame 0xfffffe000891ef70 db_command_loop() at db_command_loop+0x64/frame 0xfffffe000891ef80 db_trap() at db_trap+0xef/frame 0xfffffe000891f010 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe000891f090 trap() at trap+0x811/frame 0xfffffe000891f1a0 calltrap() at calltrap+0x8/frame 0xfffffe000891f1a0 --- trap 0x3, rip = 0xffffffff80c1992b, rsp = 0xfffffe000891f270, rbp = 0xfffffe000891f280 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe000891f280 vpanic() at vpanic+0x1ba/frame 0xfffffe000891f2d0 panic() at panic+0x43/frame 0xfffffe000891f330 witness_unlock() at witness_unlock+0xea/frame 0xfffffe000891f370 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe000891f3a0 swp_pager_trimswapspace() at swp_pager_trimswapspace+0xd5/frame 0xfffffe000891f400 swap_pager_putpages() at swap_pager_putpages+0x56c/frame 0xfffffe000891f4a0 vm_pageout_flush() at vm_pageout_flush+0xff/frame 0xfffffe000891f580 vm_pageout_cluster() at vm_pageout_cluster+0x3e6/frame 0xfffffe000891f7f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x2f6/frame 0xfffffe000891fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000891fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000891fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command stealer pid 18093 tid 100416 td 0xfffff805b0ca8000 sched_switch() at sched_switch+0x713/frame 0xfffffe00aed79a40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aed79a70 ast() at ast+0x28d/frame 0xfffffe00aed79ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18092 tid 100415 td 0xfffff805b0ca85c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aed74a40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aed74a70 ast() at ast+0x28d/frame 0xfffffe00aed74ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18091 tid 100186 td 0xfffff800039465c0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe000891ea90 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe000891eaa0 trap() at trap+0x5b/frame 0xfffffe000891ebb0 calltrap() at calltrap+0x8/frame 0xfffffe000891ebb0 --- trap 0xc, rip = 0xffffffff8107be66, rsp = 0xfffffe000891ec80, rbp = 0xfffffe000891ec90 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe000891ec90 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe000891ed30 db_command() at db_command+0x279/frame 0xfffffe000891ee00 db_script_exec() at db_script_exec+0x188/frame 0xfffffe000891eea0 db_command() at db_command+0x279/frame 0xfffffe000891ef70 db_command_loop() at db_command_loop+0x64/frame 0xfffffe000891ef80 db_trap() at db_trap+0xef/frame 0xfffffe000891f010 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe000891f090 trap() at trap+0x811/frame 0xfffffe000891f1a0 calltrap() at calltrap+0x8/frame 0xfffffe000891f1a0 --- trap 0x3, rip = 0xffffffff80c1992b, rsp = 0xfffffe000891f270, rbp = 0xfffffe000891f280 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe000891f280 vpanic() at vpanic+0x1ba/frame 0xfffffe000891f2d0 panic() at panic+0x43/frame 0xfffffe000891f330 witness_unlock() at witness_unlock+0xea/frame 0xfffffe000891f370 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe000891f3a0 swp_pager_trimswapspace() at swp_pager_trimswapspace+0xd5/frame 0xfffffe000891f400 swap_pager_putpages() at swap_pager_putpages+0x56c/frame 0xfffffe000891f4a0 vm_pageout_flush() at vm_pageout_flush+0xff/frame 0xfffffe000891f580 vm_pageout_cluster() at vm_pageout_cluster+0x3e6/frame 0xfffffe000891f7f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x2f6/frame 0xfffffe000891fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000891fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000891fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command stealer pid 18090 tid 100227 td 0xfffff800070c85c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00ad7c7a40 mi_switch() at mi_switch+0x174/frame 0xfffffe00ad7c7a70 ast() at ast+0x28d/frame 0xfffffe00ad7c7ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18089 tid 100226 td 0xfffff800070c7000 sched_switch() at sched_switch+0x713/frame 0xfffffe00ad7c2a40 mi_switch() at mi_switch+0x174/frame 0xfffffe00ad7c2a70 ast() at ast+0x28d/frame 0xfffffe00ad7c2ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18088 tid 100456 td 0xfffff8011ba9b5c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00af640a40 mi_switch() at mi_switch+0x174/frame 0xfffffe00af640a70 ast() at ast+0x28d/frame 0xfffffe00af640ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18087 tid 100455 td 0xfffff8011ba9a000 sched_switch() at sched_switch+0x713/frame 0xfffffe00af63ba40 mi_switch() at mi_switch+0x174/frame 0xfffffe00af63ba70 ast() at ast+0x28d/frame 0xfffffe00af63bab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18086 tid 100454 td 0xfffff8011ba9a5c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00af636a40 mi_switch() at mi_switch+0x174/frame 0xfffffe00af636a70 ast() at ast+0x28d/frame 0xfffffe00af636ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18085 tid 100469 td 0xfffff8011be5b5c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00af681a40 mi_switch() at mi_switch+0x174/frame 0xfffffe00af681a70 ast() at ast+0x28d/frame 0xfffffe00af681ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18084 tid 100468 td 0xfffff8011b9f0000 sched_switch() at sched_switch+0x713/frame 0xfffffe00af67ca40 mi_switch() at mi_switch+0x174/frame 0xfffffe00af67ca70 ast() at ast+0x28d/frame 0xfffffe00af67cab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18083 tid 100467 td 0xfffff8011b9f05c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00af677a40 mi_switch() at mi_switch+0x174/frame 0xfffffe00af677a70 ast() at ast+0x28d/frame 0xfffffe00af677ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18082 tid 100262 td 0xfffff8011b4b1000 sched_switch() at sched_switch+0x713/frame 0xfffffe00aea77a40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aea77a70 ast() at ast+0x28d/frame 0xfffffe00aea77ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18081 tid 100167 td 0xfffff800070c65c0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe000891ea90 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe000891eaa0 trap() at trap+0x5b/frame 0xfffffe000891ebb0 calltrap() at calltrap+0x8/frame 0xfffffe000891ebb0 --- trap 0xc, rip = 0xffffffff8107be66, rsp = 0xfffffe000891ec80, rbp = 0xfffffe000891ec90 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe000891ec90 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe000891ed30 db_command() at db_command+0x279/frame 0xfffffe000891ee00 db_script_exec() at db_script_exec+0x188/frame 0xfffffe000891eea0 db_command() at db_command+0x279/frame 0xfffffe000891ef70 db_command_loop() at db_command_loop+0x64/frame 0xfffffe000891ef80 db_trap() at db_trap+0xef/frame 0xfffffe000891f010 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe000891f090 trap() at trap+0x811/frame 0xfffffe000891f1a0 calltrap() at calltrap+0x8/frame 0xfffffe000891f1a0 --- trap 0x3, rip = 0xffffffff80c1992b, rsp = 0xfffffe000891f270, rbp = 0xfffffe000891f280 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe000891f280 vpanic() at vpanic+0x1ba/frame 0xfffffe000891f2d0 panic() at panic+0x43/frame 0xfffffe000891f330 witness_unlock() at witness_unlock+0xea/frame 0xfffffe000891f370 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe000891f3a0 swp_pager_trimswapspace() at swp_pager_trimswapspace+0xd5/frame 0xfffffe000891f400 swap_pager_putpages() at swap_pager_putpages+0x56c/frame 0xfffffe000891f4a0 vm_pageout_flush() at vm_pageout_flush+0xff/frame 0xfffffe000891f580 vm_pageout_cluster() at vm_pageout_cluster+0x3e6/frame 0xfffffe000891f7f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x2f6/frame 0xfffffe000891fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000891fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000891fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command stealer pid 18080 tid 100152 td 0xfffff800070c3000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe000891ea90 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe000891eaa0 trap() at trap+0x5b/frame 0xfffffe000891ebb0 calltrap() at calltrap+0x8/frame 0xfffffe000891ebb0 --- trap 0xc, rip = 0xffffffff8107be66, rsp = 0xfffffe000891ec80, rbp = 0xfffffe000891ec90 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe000891ec90 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe000891ed30 db_command() at db_command+0x279/frame 0xfffffe000891ee00 db_script_exec() at db_script_exec+0x188/frame 0xfffffe000891eea0 db_command() at db_command+0x279/frame 0xfffffe000891ef70 db_command_loop() at db_command_loop+0x64/frame 0xfffffe000891ef80 db_trap() at db_trap+0xef/frame 0xfffffe000891f010 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe000891f090 trap() at trap+0x811/frame 0xfffffe000891f1a0 calltrap() at calltrap+0x8/frame 0xfffffe000891f1a0 --- trap 0x3, rip = 0xffffffff80c1992b, rsp = 0xfffffe000891f270, rbp = 0xfffffe000891f280 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe000891f280 vpanic() at vpanic+0x1ba/frame 0xfffffe000891f2d0 panic() at panic+0x43/frame 0xfffffe000891f330 witness_unlock() at witness_unlock+0xea/frame 0xfffffe000891f370 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe000891f3a0 swp_pager_trimswapspace() at swp_pager_trimswapspace+0xd5/frame 0xfffffe000891f400 swap_pager_putpages() at swap_pager_putpages+0x56c/frame 0xfffffe000891f4a0 vm_pageout_flush() at vm_pageout_flush+0xff/frame 0xfffffe000891f580 vm_pageout_cluster() at vm_pageout_cluster+0x3e6/frame 0xfffffe000891f7f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x2f6/frame 0xfffffe000891fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000891fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000891fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command stealer pid 18079 tid 100338 td 0xfffff80157541000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe000891ea90 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe000891eaa0 trap() at trap+0x5b/frame 0xfffffe000891ebb0 calltrap() at calltrap+0x8/frame 0xfffffe000891ebb0 --- trap 0xc, rip = 0xffffffff8107be66, rsp = 0xfffffe000891ec80, rbp = 0xfffffe000891ec90 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe000891ec90 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe000891ed30 db_command() at db_command+0x279/frame 0xfffffe000891ee00 db_script_exec() at db_script_exec+0x188/frame 0xfffffe000891eea0 db_command() at db_command+0x279/frame 0xfffffe000891ef70 db_command_loop() at db_command_loop+0x64/frame 0xfffffe000891ef80 db_trap() at db_trap+0xef/frame 0xfffffe000891f010 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe000891f090 trap() at trap+0x811/frame 0xfffffe000891f1a0 calltrap() at calltrap+0x8/frame 0xfffffe000891f1a0 --- trap 0x3, rip = 0xffffffff80c1992b, rsp = 0xfffffe000891f270, rbp = 0xfffffe000891f280 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe000891f280 vpanic() at vpanic+0x1ba/frame 0xfffffe000891f2d0 panic() at panic+0x43/frame 0xfffffe000891f330 witness_unlock() at witness_unlock+0xea/frame 0xfffffe000891f370 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe000891f3a0 swp_pager_trimswapspace() at swp_pager_trimswapspace+0xd5/frame 0xfffffe000891f400 swap_pager_putpages() at swap_pager_putpages+0x56c/frame 0xfffffe000891f4a0 vm_pageout_flush() at vm_pageout_flush+0xff/frame 0xfffffe000891f580 vm_pageout_cluster() at vm_pageout_cluster+0x3e6/frame 0xfffffe000891f7f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x2f6/frame 0xfffffe000891fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000891fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000891fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command stealer pid 18078 tid 100337 td 0xfffff8011ba565c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aebeea40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aebeea70 ast() at ast+0x28d/frame 0xfffffe00aebeeab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18077 tid 100336 td 0xfffff8011b747000 sched_switch() at sched_switch+0x713/frame 0xfffffe00aebe9a40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aebe9a70 ast() at ast+0x28d/frame 0xfffffe00aebe9ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18076 tid 100373 td 0xfffff80157d445c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aeca2550 mi_switch() at mi_switch+0x174/frame 0xfffffe00aeca2580 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aeca25c0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00aeca2600 _sleep() at _sleep+0x279/frame 0xfffffe00aeca26a0 swap_pager_getpages() at swap_pager_getpages+0x6c2/frame 0xfffffe00aeca2760 vm_pager_get_pages() at vm_pager_get_pages+0x4f/frame 0xfffffe00aeca27c0 vm_fault_hold() at vm_fault_hold+0x1544/frame 0xfffffe00aeca2910 vm_fault() at vm_fault+0x60/frame 0xfffffe00aeca2950 trap_pfault() at trap_pfault+0x188/frame 0xfffffe00aeca29a0 trap() at trap+0x46b/frame 0xfffffe00aeca2ab0 calltrap() at calltrap+0x8/frame 0xfffffe00aeca2ab0 --- trap 0xc, rip = 0x20137d, rsp = 0x7fffffffe690, rbp = 0x7fffffffe6c0 --- Tracing command stealer pid 18075 tid 100372 td 0xfffff80157d43000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe000891ea90 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe000891eaa0 trap() at trap+0x5b/frame 0xfffffe000891ebb0 calltrap() at calltrap+0x8/frame 0xfffffe000891ebb0 --- trap 0xc, rip = 0xffffffff8107be66, rsp = 0xfffffe000891ec80, rbp = 0xfffffe000891ec90 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe000891ec90 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe000891ed30 db_command() at db_command+0x279/frame 0xfffffe000891ee00 db_script_exec() at db_script_exec+0x188/frame 0xfffffe000891eea0 db_command() at db_command+0x279/frame 0xfffffe000891ef70 db_command_loop() at db_command_loop+0x64/frame 0xfffffe000891ef80 db_trap() at db_trap+0xef/frame 0xfffffe000891f010 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe000891f090 trap() at trap+0x811/frame 0xfffffe000891f1a0 calltrap() at calltrap+0x8/frame 0xfffffe000891f1a0 --- trap 0x3, rip = 0xffffffff80c1992b, rsp = 0xfffffe000891f270, rbp = 0xfffffe000891f280 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe000891f280 vpanic() at vpanic+0x1ba/frame 0xfffffe000891f2d0 panic() at panic+0x43/frame 0xfffffe000891f330 witness_unlock() at witness_unlock+0xea/frame 0xfffffe000891f370 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe000891f3a0 swp_pager_trimswapspace() at swp_pager_trimswapspace+0xd5/frame 0xfffffe000891f400 swap_pager_putpages() at swap_pager_putpages+0x56c/frame 0xfffffe000891f4a0 vm_pageout_flush() at vm_pageout_flush+0xff/frame 0xfffffe000891f580 vm_pageout_cluster() at vm_pageout_cluster+0x3e6/frame 0xfffffe000891f7f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x2f6/frame 0xfffffe000891fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000891fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000891fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command stealer pid 18074 tid 100371 td 0xfffff80157d435c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aec98a40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aec98a70 ast() at ast+0x28d/frame 0xfffffe00aec98ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18073 tid 100228 td 0xfffff800070c8000 (CPU 7) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe00085bbdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe00085bbe10 trap() at trap+0x48/frame 0xfffffe00085bbf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00085bbf20 --- trap 0x13, rip = 0x201381, rsp = 0x7fffffffe690, rbp = 0x7fffffffe6c0 --- Tracing command stealer pid 18072 tid 100391 td 0xfffff80157aaf5c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aecfca40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aecfca70 ast() at ast+0x28d/frame 0xfffffe00aecfcab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18071 tid 100355 td 0xfffff80157aac000 sched_switch() at sched_switch+0x713/frame 0xfffffe00aec48a40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aec48a70 ast() at ast+0x28d/frame 0xfffffe00aec48ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18070 tid 100453 td 0xfffff8011b6f4000 sched_switch() at sched_switch+0x713/frame 0xfffffe00af631550 mi_switch() at mi_switch+0x174/frame 0xfffffe00af631580 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00af6315c0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00af631600 _sleep() at _sleep+0x279/frame 0xfffffe00af6316a0 swap_pager_getpages() at swap_pager_getpages+0x6c2/frame 0xfffffe00af631760 vm_pager_get_pages() at vm_pager_get_pages+0x4f/frame 0xfffffe00af6317c0 vm_fault_hold() at vm_fault_hold+0x1544/frame 0xfffffe00af631910 vm_fault() at vm_fault+0x60/frame 0xfffffe00af631950 trap_pfault() at trap_pfault+0x188/frame 0xfffffe00af6319a0 trap() at trap+0x46b/frame 0xfffffe00af631ab0 calltrap() at calltrap+0x8/frame 0xfffffe00af631ab0 --- trap 0xc, rip = 0x20137d, rsp = 0x7fffffffe690, rbp = 0x7fffffffe6c0 --- Tracing command stealer pid 18069 tid 100452 td 0xfffff8011b6f45c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00af62ca40 mi_switch() at mi_switch+0x174/frame 0xfffffe00af62ca70 ast() at ast+0x28d/frame 0xfffffe00af62cab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18068 tid 100451 td 0xfffff8026c38d000 sched_switch() at sched_switch+0x713/frame 0xfffffe00af627a40 mi_switch() at mi_switch+0x174/frame 0xfffffe00af627a70 ast() at ast+0x28d/frame 0xfffffe00af627ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18067 tid 100354 td 0xfffff80003ebc5c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aec43a40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aec43a70 ast() at ast+0x28d/frame 0xfffffe00aec43ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18066 tid 100352 td 0xfffff80003eb6000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe000891ea90 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe000891eaa0 trap() at trap+0x5b/frame 0xfffffe000891ebb0 calltrap() at calltrap+0x8/frame 0xfffffe000891ebb0 --- trap 0xc, rip = 0xffffffff8107be66, rsp = 0xfffffe000891ec80, rbp = 0xfffffe000891ec90 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe000891ec90 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe000891ed30 db_command() at db_command+0x279/frame 0xfffffe000891ee00 db_script_exec() at db_script_exec+0x188/frame 0xfffffe000891eea0 db_command() at db_command+0x279/frame 0xfffffe000891ef70 db_command_loop() at db_command_loop+0x64/frame 0xfffffe000891ef80 db_trap() at db_trap+0xef/frame 0xfffffe000891f010 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe000891f090 trap() at trap+0x811/frame 0xfffffe000891f1a0 calltrap() at calltrap+0x8/frame 0xfffffe000891f1a0 --- trap 0x3, rip = 0xffffffff80c1992b, rsp = 0xfffffe000891f270, rbp = 0xfffffe000891f280 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe000891f280 vpanic() at vpanic+0x1ba/frame 0xfffffe000891f2d0 panic() at panic+0x43/frame 0xfffffe000891f330 witness_unlock() at witness_unlock+0xea/frame 0xfffffe000891f370 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe000891f3a0 swp_pager_trimswapspace() at swp_pager_trimswapspace+0xd5/frame 0xfffffe000891f400 swap_pager_putpages() at swap_pager_putpages+0x56c/frame 0xfffffe000891f4a0 vm_pageout_flush() at vm_pageout_flush+0xff/frame 0xfffffe000891f580 vm_pageout_cluster() at vm_pageout_cluster+0x3e6/frame 0xfffffe000891f7f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x2f6/frame 0xfffffe000891fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000891fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000891fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command stealer pid 18065 tid 100350 td 0xfffff80003eb65c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aec2fa40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aec2fa70 ast() at ast+0x28d/frame 0xfffffe00aec2fab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18064 tid 100185 td 0xfffff800070c6000 sched_switch() at sched_switch+0x713/frame 0xfffffe00ad6e2550 mi_switch() at mi_switch+0x174/frame 0xfffffe00ad6e2580 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ad6e25c0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00ad6e2600 _sleep() at _sleep+0x279/frame 0xfffffe00ad6e26a0 swap_pager_getpages() at swap_pager_getpages+0x6c2/frame 0xfffffe00ad6e2760 vm_pager_get_pages() at vm_pager_get_pages+0x4f/frame 0xfffffe00ad6e27c0 vm_fault_hold() at vm_fault_hold+0x1544/frame 0xfffffe00ad6e2910 vm_fault() at vm_fault+0x60/frame 0xfffffe00ad6e2950 trap_pfault() at trap_pfault+0x188/frame 0xfffffe00ad6e29a0 trap() at trap+0x46b/frame 0xfffffe00ad6e2ab0 calltrap() at calltrap+0x8/frame 0xfffffe00ad6e2ab0 --- trap 0xc, rip = 0x20137d, rsp = 0x7fffffffe690, rbp = 0x7fffffffe6c0 --- Tracing command stealer pid 18063 tid 100363 td 0xfffff80157f3e000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe000891ea90 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe000891eaa0 trap() at trap+0x5b/frame 0xfffffe000891ebb0 calltrap() at calltrap+0x8/frame 0xfffffe000891ebb0 --- trap 0xc, rip = 0xffffffff8107be66, rsp = 0xfffffe000891ec80, rbp = 0xfffffe000891ec90 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe000891ec90 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe000891ed30 db_command() at db_command+0x279/frame 0xfffffe000891ee00 db_script_exec() at db_script_exec+0x188/frame 0xfffffe000891eea0 db_command() at db_command+0x279/frame 0xfffffe000891ef70 db_command_loop() at db_command_loop+0x64/frame 0xfffffe000891ef80 db_trap() at db_trap+0xef/frame 0xfffffe000891f010 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe000891f090 trap() at trap+0x811/frame 0xfffffe000891f1a0 calltrap() at calltrap+0x8/frame 0xfffffe000891f1a0 --- trap 0x3, rip = 0xffffffff80c1992b, rsp = 0xfffffe000891f270, rbp = 0xfffffe000891f280 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe000891f280 vpanic() at vpanic+0x1ba/frame 0xfffffe000891f2d0 panic() at panic+0x43/frame 0xfffffe000891f330 witness_unlock() at witness_unlock+0xea/frame 0xfffffe000891f370 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe000891f3a0 swp_pager_trimswapspace() at swp_pager_trimswapspace+0xd5/frame 0xfffffe000891f400 swap_pager_putpages() at swap_pager_putpages+0x56c/frame 0xfffffe000891f4a0 vm_pageout_flush() at vm_pageout_flush+0xff/frame 0xfffffe000891f580 vm_pageout_cluster() at vm_pageout_cluster+0x3e6/frame 0xfffffe000891f7f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x2f6/frame 0xfffffe000891fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000891fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000891fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command stealer pid 18062 tid 100362 td 0xfffff80157f3e5c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aec6ba40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aec6ba70 ast() at ast+0x28d/frame 0xfffffe00aec6bab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18061 tid 100252 td 0xfffff801571f75c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aea45a40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aea45a70 ast() at ast+0x28d/frame 0xfffffe00aea45ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18060 tid 100251 td 0xfffff8015713b000 sched_switch() at sched_switch+0x713/frame 0xfffffe00aea40a40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aea40a70 ast() at ast+0x28d/frame 0xfffffe00aea40ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18059 tid 100250 td 0xfffff8015713b5c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aea3ba40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aea3ba70 ast() at ast+0x28d/frame 0xfffffe00aea3bab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18058 tid 100244 td 0xfffff8011b7465c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aea1d660 mi_switch() at mi_switch+0x174/frame 0xfffffe00aea1d690 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aea1d6d0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00aea1d700 _sleep() at _sleep+0x2da/frame 0xfffffe00aea1d7a0 vm_waitpfault() at vm_waitpfault+0x6b/frame 0xfffffe00aea1d7c0 vm_fault_hold() at vm_fault_hold+0xabb/frame 0xfffffe00aea1d910 vm_fault() at vm_fault+0x60/frame 0xfffffe00aea1d950 trap_pfault() at trap_pfault+0x188/frame 0xfffffe00aea1d9a0 trap() at trap+0x46b/frame 0xfffffe00aea1dab0 calltrap() at calltrap+0x8/frame 0xfffffe00aea1dab0 --- trap 0xc, rip = 0x800415885, rsp = 0x7fffffffe338, rbp = 0x7fffffffe380 --- Tracing command stealer pid 18057 tid 100243 td 0xfffff800050b5000 sched_switch() at sched_switch+0x713/frame 0xfffffe00aea18a40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aea18a70 ast() at ast+0x28d/frame 0xfffffe00aea18ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18056 tid 100242 td 0xfffff800050b55c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aea13a40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aea13a70 ast() at ast+0x28d/frame 0xfffffe00aea13ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18055 tid 100392 td 0xfffff80157aaf000 sched_switch() at sched_switch+0x713/frame 0xfffffe00aed01550 mi_switch() at mi_switch+0x174/frame 0xfffffe00aed01580 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aed015c0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00aed01600 _sleep() at _sleep+0x279/frame 0xfffffe00aed016a0 swap_pager_getpages() at swap_pager_getpages+0x6c2/frame 0xfffffe00aed01760 vm_pager_get_pages() at vm_pager_get_pages+0x4f/frame 0xfffffe00aed017c0 vm_fault_hold() at vm_fault_hold+0x1544/frame 0xfffffe00aed01910 vm_fault() at vm_fault+0x60/frame 0xfffffe00aed01950 trap_pfault() at trap_pfault+0x188/frame 0xfffffe00aed019a0 trap() at trap+0x46b/frame 0xfffffe00aed01ab0 calltrap() at calltrap+0x8/frame 0xfffffe00aed01ab0 --- trap 0xc, rip = 0x20137d, rsp = 0x7fffffffe690, rbp = 0x7fffffffe6c0 --- Tracing command stealer pid 18054 tid 100407 td 0xfffff80003ea4000 sched_switch() at sched_switch+0x713/frame 0xfffffe00aed4ca40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aed4ca70 ast() at ast+0x28d/frame 0xfffffe00aed4cab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18053 tid 100237 td 0xfffff80003ea45c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00ad7f9a40 mi_switch() at mi_switch+0x174/frame 0xfffffe00ad7f9a70 ast() at ast+0x28d/frame 0xfffffe00ad7f9ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18052 tid 100378 td 0xfffff804e9314000 sched_switch() at sched_switch+0x713/frame 0xfffffe00aecbb550 mi_switch() at mi_switch+0x174/frame 0xfffffe00aecbb580 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aecbb5c0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00aecbb600 _sleep() at _sleep+0x279/frame 0xfffffe00aecbb6a0 swap_pager_getpages() at swap_pager_getpages+0x6c2/frame 0xfffffe00aecbb760 vm_pager_get_pages() at vm_pager_get_pages+0x4f/frame 0xfffffe00aecbb7c0 vm_fault_hold() at vm_fault_hold+0x1544/frame 0xfffffe00aecbb910 vm_fault() at vm_fault+0x60/frame 0xfffffe00aecbb950 trap_pfault() at trap_pfault+0x188/frame 0xfffffe00aecbb9a0 trap() at trap+0x46b/frame 0xfffffe00aecbbab0 calltrap() at calltrap+0x8/frame 0xfffffe00aecbbab0 --- trap 0xc, rip = 0x20137d, rsp = 0x7fffffffe690, rbp = 0x7fffffffe6c0 --- Tracing command stealer pid 18051 tid 100375 td 0xfffff80157f3c5c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aecaca40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aecaca70 ast() at ast+0x28d/frame 0xfffffe00aecacab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18050 tid 100374 td 0xfffff80157d44000 sched_switch() at sched_switch+0x713/frame 0xfffffe00aeca7a40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aeca7a70 ast() at ast+0x28d/frame 0xfffffe00aeca7ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18049 tid 100269 td 0xfffff800054d15c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aea9aa40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aea9aa70 ast() at ast+0x28d/frame 0xfffffe00aea9aab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18048 tid 100174 td 0xfffff8000bb3a5c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00ad67ba40 mi_switch() at mi_switch+0x174/frame 0xfffffe00ad67ba70 ast() at ast+0x28d/frame 0xfffffe00ad67bab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18047 tid 100168 td 0xfffff8000bb39000 (CPU 0) cpustop_handler() at cpustop_handler+0x2d/frame 0xffffffff82052b70 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xffffffff82052b90 trap() at trap+0x48/frame 0xffffffff82052ca0 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff82052ca0 --- trap 0x13, rip = 0x20137d, rsp = 0x7fffffffe690, rbp = 0x7fffffffe6c0 --- Tracing command stealer pid 18046 tid 100384 td 0xfffff80157f3f5c0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe000891ea90 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe000891eaa0 trap() at trap+0x5b/frame 0xfffffe000891ebb0 calltrap() at calltrap+0x8/frame 0xfffffe000891ebb0 --- trap 0xc, rip = 0xffffffff8107be66, rsp = 0xfffffe000891ec80, rbp = 0xfffffe000891ec90 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe000891ec90 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe000891ed30 db_command() at db_command+0x279/frame 0xfffffe000891ee00 db_script_exec() at db_script_exec+0x188/frame 0xfffffe000891eea0 db_command() at db_command+0x279/frame 0xfffffe000891ef70 db_command_loop() at db_command_loop+0x64/frame 0xfffffe000891ef80 db_trap() at db_trap+0xef/frame 0xfffffe000891f010 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe000891f090 trap() at trap+0x811/frame 0xfffffe000891f1a0 calltrap() at calltrap+0x8/frame 0xfffffe000891f1a0 --- trap 0x3, rip = 0xffffffff80c1992b, rsp = 0xfffffe000891f270, rbp = 0xfffffe000891f280 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe000891f280 vpanic() at vpanic+0x1ba/frame 0xfffffe000891f2d0 panic() at panic+0x43/frame 0xfffffe000891f330 witness_unlock() at witness_unlock+0xea/frame 0xfffffe000891f370 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe000891f3a0 swp_pager_trimswapspace() at swp_pager_trimswapspace+0xd5/frame 0xfffffe000891f400 swap_pager_putpages() at swap_pager_putpages+0x56c/frame 0xfffffe000891f4a0 vm_pageout_flush() at vm_pageout_flush+0xff/frame 0xfffffe000891f580 vm_pageout_cluster() at vm_pageout_cluster+0x3e6/frame 0xfffffe000891f7f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x2f6/frame 0xfffffe000891fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000891fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000891fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command stealer pid 18045 tid 100438 td 0xfffff805c1e6f000 sched_switch() at sched_switch+0x713/frame 0xfffffe00aede7a40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aede7a70 ast() at ast+0x28d/frame 0xfffffe00aede7ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18044 tid 100229 td 0xfffff800070db5c0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe000891ea90 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe000891eaa0 trap() at trap+0x5b/frame 0xfffffe000891ebb0 calltrap() at calltrap+0x8/frame 0xfffffe000891ebb0 --- trap 0xc, rip = 0xffffffff8107be66, rsp = 0xfffffe000891ec80, rbp = 0xfffffe000891ec90 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe000891ec90 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe000891ed30 db_command() at db_command+0x279/frame 0xfffffe000891ee00 db_script_exec() at db_script_exec+0x188/frame 0xfffffe000891eea0 db_command() at db_command+0x279/frame 0xfffffe000891ef70 db_command_loop() at db_command_loop+0x64/frame 0xfffffe000891ef80 db_trap() at db_trap+0xef/frame 0xfffffe000891f010 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe000891f090 trap() at trap+0x811/frame 0xfffffe000891f1a0 calltrap() at calltrap+0x8/frame 0xfffffe000891f1a0 --- trap 0x3, rip = 0xffffffff80c1992b, rsp = 0xfffffe000891f270, rbp = 0xfffffe000891f280 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe000891f280 vpanic() at vpanic+0x1ba/frame 0xfffffe000891f2d0 panic() at panic+0x43/frame 0xfffffe000891f330 witness_unlock() at witness_unlock+0xea/frame 0xfffffe000891f370 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe000891f3a0 swp_pager_trimswapspace() at swp_pager_trimswapspace+0xd5/frame 0xfffffe000891f400 swap_pager_putpages() at swap_pager_putpages+0x56c/frame 0xfffffe000891f4a0 vm_pageout_flush() at vm_pageout_flush+0xff/frame 0xfffffe000891f580 vm_pageout_cluster() at vm_pageout_cluster+0x3e6/frame 0xfffffe000891f7f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x2f6/frame 0xfffffe000891fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000891fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000891fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command stealer pid 18043 tid 100273 td 0xfffff8015708d5c0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe000891ea90 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe000891eaa0 trap() at trap+0x5b/frame 0xfffffe000891ebb0 calltrap() at calltrap+0x8/frame 0xfffffe000891ebb0 --- trap 0xc, rip = 0xffffffff8107be66, rsp = 0xfffffe000891ec80, rbp = 0xfffffe000891ec90 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe000891ec90 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe000891ed30 db_command() at db_command+0x279/frame 0xfffffe000891ee00 db_script_exec() at db_script_exec+0x188/frame 0xfffffe000891eea0 db_command() at db_command+0x279/frame 0xfffffe000891ef70 db_command_loop() at db_command_loop+0x64/frame 0xfffffe000891ef80 db_trap() at db_trap+0xef/frame 0xfffffe000891f010 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe000891f090 trap() at trap+0x811/frame 0xfffffe000891f1a0 calltrap() at calltrap+0x8/frame 0xfffffe000891f1a0 --- trap 0x3, rip = 0xffffffff80c1992b, rsp = 0xfffffe000891f270, rbp = 0xfffffe000891f280 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe000891f280 vpanic() at vpanic+0x1ba/frame 0xfffffe000891f2d0 panic() at panic+0x43/frame 0xfffffe000891f330 witness_unlock() at witness_unlock+0xea/frame 0xfffffe000891f370 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe000891f3a0 swp_pager_trimswapspace() at swp_pager_trimswapspace+0xd5/frame 0xfffffe000891f400 swap_pager_putpages() at swap_pager_putpages+0x56c/frame 0xfffffe000891f4a0 vm_pageout_flush() at vm_pageout_flush+0xff/frame 0xfffffe000891f580 vm_pageout_cluster() at vm_pageout_cluster+0x3e6/frame 0xfffffe000891f7f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x2f6/frame 0xfffffe000891fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000891fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000891fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command stealer pid 18042 tid 100272 td 0xfffff801573235c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aeaa9550 mi_switch() at mi_switch+0x174/frame 0xfffffe00aeaa9580 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aeaa95c0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00aeaa9600 _sleep() at _sleep+0x279/frame 0xfffffe00aeaa96a0 swap_pager_getpages() at swap_pager_getpages+0x6c2/frame 0xfffffe00aeaa9760 vm_pager_get_pages() at vm_pager_get_pages+0x4f/frame 0xfffffe00aeaa97c0 vm_fault_hold() at vm_fault_hold+0x1544/frame 0xfffffe00aeaa9910 vm_fault() at vm_fault+0x60/frame 0xfffffe00aeaa9950 trap_pfault() at trap_pfault+0x188/frame 0xfffffe00aeaa99a0 trap() at trap+0x46b/frame 0xfffffe00aeaa9ab0 calltrap() at calltrap+0x8/frame 0xfffffe00aeaa9ab0 --- trap 0xc, rip = 0x20137d, rsp = 0x7fffffffe690, rbp = 0x7fffffffe6c0 --- Tracing command stealer pid 18041 tid 100271 td 0xfffff8011bc2f000 sched_switch() at sched_switch+0x713/frame 0xfffffe00aeaa4a40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aeaa4a70 ast() at ast+0x28d/frame 0xfffffe00aeaa4ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18040 tid 100353 td 0xfffff80157aac5c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aec3ea40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aec3ea70 ast() at ast+0x28d/frame 0xfffffe00aec3eab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18039 tid 100351 td 0xfffff801578b7000 sched_switch() at sched_switch+0x713/frame 0xfffffe00aec34a40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aec34a70 ast() at ast+0x28d/frame 0xfffffe00aec34ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18038 tid 100349 td 0xfffff801578b75c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aec2aa40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aec2aa70 ast() at ast+0x28d/frame 0xfffffe00aec2aab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18037 tid 100417 td 0xfffff8000b7f85c0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe000891ea90 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe000891eaa0 trap() at trap+0x5b/frame 0xfffffe000891ebb0 calltrap() at calltrap+0x8/frame 0xfffffe000891ebb0 --- trap 0xc, rip = 0xffffffff8107be66, rsp = 0xfffffe000891ec80, rbp = 0xfffffe000891ec90 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe000891ec90 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe000891ed30 db_command() at db_command+0x279/frame 0xfffffe000891ee00 db_script_exec() at db_script_exec+0x188/frame 0xfffffe000891eea0 db_command() at db_command+0x279/frame 0xfffffe000891ef70 db_command_loop() at db_command_loop+0x64/frame 0xfffffe000891ef80 db_trap() at db_trap+0xef/frame 0xfffffe000891f010 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe000891f090 trap() at trap+0x811/frame 0xfffffe000891f1a0 calltrap() at calltrap+0x8/frame 0xfffffe000891f1a0 --- trap 0x3, rip = 0xffffffff80c1992b, rsp = 0xfffffe000891f270, rbp = 0xfffffe000891f280 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe000891f280 vpanic() at vpanic+0x1ba/frame 0xfffffe000891f2d0 panic() at panic+0x43/frame 0xfffffe000891f330 witness_unlock() at witness_unlock+0xea/frame 0xfffffe000891f370 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe000891f3a0 swp_pager_trimswapspace() at swp_pager_trimswapspace+0xd5/frame 0xfffffe000891f400 swap_pager_putpages() at swap_pager_putpages+0x56c/frame 0xfffffe000891f4a0 vm_pageout_flush() at vm_pageout_flush+0xff/frame 0xfffffe000891f580 vm_pageout_cluster() at vm_pageout_cluster+0x3e6/frame 0xfffffe000891f7f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x2f6/frame 0xfffffe000891fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000891fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000891fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command stealer pid 18036 tid 100465 td 0xfffff8011b9fe5c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00af66da40 mi_switch() at mi_switch+0x174/frame 0xfffffe00af66da70 ast() at ast+0x28d/frame 0xfffffe00af66dab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18035 tid 100464 td 0xfffff8011b9fa000 sched_switch() at sched_switch+0x713/frame 0xfffffe00af668a40 mi_switch() at mi_switch+0x174/frame 0xfffffe00af668a70 ast() at ast+0x28d/frame 0xfffffe00af668ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18034 tid 100230 td 0xfffff8004f3ed000 sched_switch() at sched_switch+0x713/frame 0xfffffe00ad7d6a40 mi_switch() at mi_switch+0x174/frame 0xfffffe00ad7d6a70 ast() at ast+0x28d/frame 0xfffffe00ad7d6ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18033 tid 100206 td 0xfffff8004f3ed5c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00ad75ea40 mi_switch() at mi_switch+0x174/frame 0xfffffe00ad75ea70 ast() at ast+0x28d/frame 0xfffffe00ad75eab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18032 tid 100205 td 0xfffff8004f3ec000 sched_switch() at sched_switch+0x713/frame 0xfffffe00ad759a40 mi_switch() at mi_switch+0x174/frame 0xfffffe00ad759a70 ast() at ast+0x28d/frame 0xfffffe00ad759ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18031 tid 100334 td 0xfffff8011b7475c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aebdfa40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aebdfa70 ast() at ast+0x28d/frame 0xfffffe00aebdfab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18030 tid 100332 td 0xfffff8004fd1d000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe000891ea90 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe000891eaa0 trap() at trap+0x5b/frame 0xfffffe000891ebb0 calltrap() at calltrap+0x8/frame 0xfffffe000891ebb0 --- trap 0xc, rip = 0xffffffff8107be66, rsp = 0xfffffe000891ec80, rbp = 0xfffffe000891ec90 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe000891ec90 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe000891ed30 db_command() at db_command+0x279/frame 0xfffffe000891ee00 db_script_exec() at db_script_exec+0x188/frame 0xfffffe000891eea0 db_command() at db_command+0x279/frame 0xfffffe000891ef70 db_command_loop() at db_command_loop+0x64/frame 0xfffffe000891ef80 db_trap() at db_trap+0xef/frame 0xfffffe000891f010 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe000891f090 trap() at trap+0x811/frame 0xfffffe000891f1a0 calltrap() at calltrap+0x8/frame 0xfffffe000891f1a0 --- trap 0x3, rip = 0xffffffff80c1992b, rsp = 0xfffffe000891f270, rbp = 0xfffffe000891f280 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe000891f280 vpanic() at vpanic+0x1ba/frame 0xfffffe000891f2d0 panic() at panic+0x43/frame 0xfffffe000891f330 witness_unlock() at witness_unlock+0xea/frame 0xfffffe000891f370 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe000891f3a0 swp_pager_trimswapspace() at swp_pager_trimswapspace+0xd5/frame 0xfffffe000891f400 swap_pager_putpages() at swap_pager_putpages+0x56c/frame 0xfffffe000891f4a0 vm_pageout_flush() at vm_pageout_flush+0xff/frame 0xfffffe000891f580 vm_pageout_cluster() at vm_pageout_cluster+0x3e6/frame 0xfffffe000891f7f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x2f6/frame 0xfffffe000891fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000891fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000891fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command stealer pid 18029 tid 100330 td 0xfffff8004fd1d5c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aebcba40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aebcba70 ast() at ast+0x28d/frame 0xfffffe00aebcbab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18028 tid 100439 td 0xfffff805c11085c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aedeca40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aedeca70 ast() at ast+0x28d/frame 0xfffffe00aedecab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18027 tid 100264 td 0xfffff8000bc435c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aea81a40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aea81a70 ast() at ast+0x28d/frame 0xfffffe00aea81ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18026 tid 100293 td 0xfffff8015795c000 sched_switch() at sched_switch+0x713/frame 0xfffffe00aeb12a40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aeb12a70 ast() at ast+0x28d/frame 0xfffffe00aeb12ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18025 tid 100403 td 0xfffff804e9317000 sched_switch() at sched_switch+0x713/frame 0xfffffe00aed38a40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aed38a70 ast() at ast+0x28d/frame 0xfffffe00aed38ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18024 tid 100390 td 0xfffff80157f405c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aecf7a40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aecf7a70 ast() at ast+0x28d/frame 0xfffffe00aecf7ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18023 tid 100385 td 0xfffff80157f3f000 (CPU 8) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe00085c7df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe00085c7e10 trap() at trap+0x48/frame 0xfffffe00085c7f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00085c7f20 --- trap 0x13, rip = 0x20137d, rsp = 0x7fffffffe690, rbp = 0x7fffffffe6c0 --- Tracing command stealer pid 18022 tid 100286 td 0xfffff8000b9ee5c0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe000891ea90 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe000891eaa0 trap() at trap+0x5b/frame 0xfffffe000891ebb0 calltrap() at calltrap+0x8/frame 0xfffffe000891ebb0 --- trap 0xc, rip = 0xffffffff8107be66, rsp = 0xfffffe000891ec80, rbp = 0xfffffe000891ec90 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe000891ec90 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe000891ed30 db_command() at db_command+0x279/frame 0xfffffe000891ee00 db_script_exec() at db_script_exec+0x188/frame 0xfffffe000891eea0 db_command() at db_command+0x279/frame 0xfffffe000891ef70 db_command_loop() at db_command_loop+0x64/frame 0xfffffe000891ef80 db_trap() at db_trap+0xef/frame 0xfffffe000891f010 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe000891f090 trap() at trap+0x811/frame 0xfffffe000891f1a0 calltrap() at calltrap+0x8/frame 0xfffffe000891f1a0 --- trap 0x3, rip = 0xffffffff80c1992b, rsp = 0xfffffe000891f270, rbp = 0xfffffe000891f280 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe000891f280 vpanic() at vpanic+0x1ba/frame 0xfffffe000891f2d0 panic() at panic+0x43/frame 0xfffffe000891f330 witness_unlock() at witness_unlock+0xea/frame 0xfffffe000891f370 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe000891f3a0 swp_pager_trimswapspace() at swp_pager_trimswapspace+0xd5/frame 0xfffffe000891f400 swap_pager_putpages() at swap_pager_putpages+0x56c/frame 0xfffffe000891f4a0 vm_pageout_flush() at vm_pageout_flush+0xff/frame 0xfffffe000891f580 vm_pageout_cluster() at vm_pageout_cluster+0x3e6/frame 0xfffffe000891f7f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x2f6/frame 0xfffffe000891fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000891fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000891fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command stealer pid 18021 tid 100284 td 0xfffff8000bc32000 sched_switch() at sched_switch+0x713/frame 0xfffffe00aeae5550 mi_switch() at mi_switch+0x174/frame 0xfffffe00aeae5580 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aeae55c0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00aeae5600 _sleep() at _sleep+0x279/frame 0xfffffe00aeae56a0 swap_pager_getpages() at swap_pager_getpages+0x6c2/frame 0xfffffe00aeae5760 vm_pager_get_pages() at vm_pager_get_pages+0x4f/frame 0xfffffe00aeae57c0 vm_fault_hold() at vm_fault_hold+0x1544/frame 0xfffffe00aeae5910 vm_fault() at vm_fault+0x60/frame 0xfffffe00aeae5950 trap_pfault() at trap_pfault+0x188/frame 0xfffffe00aeae59a0 trap() at trap+0x46b/frame 0xfffffe00aeae5ab0 calltrap() at calltrap+0x8/frame 0xfffffe00aeae5ab0 --- trap 0xc, rip = 0x20137d, rsp = 0x7fffffffe690, rbp = 0x7fffffffe6c0 --- Tracing command stealer pid 18020 tid 100282 td 0xfffff8000bc325c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aeadba40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aeadba70 ast() at ast+0x28d/frame 0xfffffe00aeadbab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18019 tid 100245 td 0xfffff8011ba495c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aea22a40 mi_switch() at mi_switch+0x174/frame 0xfffffe00aea22a70 ast() at ast+0x28d/frame 0xfffffe00aea22ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6c0 Tracing command stealer pid 18018 tid 100444 td 0xfffff805c16e55c0 (CPU 9) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe00085d3df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe00085d3e10 trap() at trap+0x48/frame 0xfffffe00085d3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00085d3f20 --- trap 0x13, rip = 0x201381, rsp = 0x7fffffffe690, rbp = 0x7fffffffe6c0 --- Tracing command stealer pid 18017 tid 100329 td 0xfffff8004f53b000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe000891ea90 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe000891eaa0 trap() at trap+0x5b/frame 0xfffffe000891ebb0 calltrap() at calltrap+0x8/frame 0xfffffe000891ebb0 --- trap 0xc, rip = 0xffffffff8107be66, rsp = 0xfffffe000891ec80, rbp = 0xfffffe000891ec90 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe000891ec90 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe000891ed30 db_command() at db_command+0x279/frame 0xfffffe000891ee00 db_script_exec() at db_script_exec+0x188/frame 0xfffffe000891eea0 db_command() at db_command+0x279/frame 0xfffffe000891ef70 db_command_loop() at db_command_loop+0x64/frame 0xfffffe000891ef80 db_trap() at db_trap+0xef/frame 0xfffffe000891f010 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe000891f090 trap() at trap+0x811/frame 0xfffffe000891f1a0 calltrap() at calltrap+0x8/frame 0xfffffe000891f1a0 --- trap 0x3, rip = 0xffffffff80c1992b, rsp = 0xfffffe000891f270, rbp = 0xfffffe000891f280 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe000891f280 vpanic() at vpanic+0x1ba/frame 0xfffffe000891f2d0 panic() at panic+0x43/frame 0xfffffe000891f330 witness_unlock() at witness_unlock+0xea/frame 0xfffffe000891f370 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe000891f3a0 swp_pager_trimswapspace() at swp_pager_trimswapspace+0xd5/frame 0xfffffe000891f400 swap_pager_putpages() at swap_pager_putpages+0x56c/frame 0xfffffe000891f4a0 vm_pageout_flush() at vm_pageout_flush+0xff/frame 0xfffffe000891f580 vm_pageout_cluster() at vm_pageout_cluster+0x3e6/frame 0xfffffe000891f7f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x2f6/frame 0xfffffe000891fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000891fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000891fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command su pid 18015 tid 100296 td 0xfffff8011bf2a000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe000891ea90 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe000891eaa0 trap() at trap+0x5b/frame 0xfffffe000891ebb0 calltrap() at calltrap+0x8/frame 0xfffffe000891ebb0 --- trap 0xc, rip = 0xffffffff8107be66, rsp = 0xfffffe000891ec80, rbp = 0xfffffe000891ec90 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe000891ec90 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe000891ed30 db_command() at db_command+0x279/frame 0xfffffe000891ee00 db_script_exec() at db_script_exec+0x188/frame 0xfffffe000891eea0 db_command() at db_command+0x279/frame 0xfffffe000891ef70 db_command_loop() at db_command_loop+0x64/frame 0xfffffe000891ef80 db_trap() at db_trap+0xef/frame 0xfffffe000891f010 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe000891f090 trap() at trap+0x811/frame 0xfffffe000891f1a0 calltrap() at calltrap+0x8/frame 0xfffffe000891f1a0 --- trap 0x3, rip = 0xffffffff80c1992b, rsp = 0xfffffe000891f270, rbp = 0xfffffe000891f280 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe000891f280 vpanic() at vpanic+0x1ba/frame 0xfffffe000891f2d0 panic() at panic+0x43/frame 0xfffffe000891f330 witness_unlock() at witness_unlock+0xea/frame 0xfffffe000891f370 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe000891f3a0 swp_pager_trimswapspace() at swp_pager_trimswapspace+0xd5/frame 0xfffffe000891f400 swap_pager_putpages() at swap_pager_putpages+0x56c/frame 0xfffffe000891f4a0 vm_pageout_flush() at vm_pageout_flush+0xff/frame 0xfffffe000891f580 vm_pageout_cluster() at vm_pageout_cluster+0x3e6/frame 0xfffffe000891f7f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x2f6/frame 0xfffffe000891fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000891fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000891fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command md10 pid 18006 tid 100335 td 0xfffff8004f5bc5c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00aebe45e0 mi_switch() at mi_switch+0x174/frame 0xfffffe00aebe4610 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aebe4650 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00aebe4680 _sleep() at _sleep+0x2da/frame 0xfffffe00aebe4720 bufwait() at bufwait+0x84/frame 0xfffffe00aebe4760 cluster_read() at cluster_read+0x7c4/frame 0xfffffe00aebe4850 ffs_read() at ffs_read+0x1b2/frame 0xfffffe00aebe4900 VOP_READ_APV() at VOP_READ_APV+0x82/frame 0xfffffe00aebe4920 mdstart_vnode() at mdstart_vnode+0x4b7/frame 0xfffffe00aebe4a10 md_kthread() at md_kthread+0x20c/frame 0xfffffe00aebe4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00aebe4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00aebe4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sh pid 16919 tid 100156 td 0xfffff8000b7f95c0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe000891ea90 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe000891eaa0 trap() at trap+0x5b/frame 0xfffffe000891ebb0 calltrap() at calltrap+0x8/frame 0xfffffe000891ebb0 --- trap 0xc, rip = 0xffffffff8107be66, rsp = 0xfffffe000891ec80, rbp = 0xfffffe000891ec90 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe000891ec90 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe000891ed30 db_command() at db_command+0x279/frame 0xfffffe000891ee00 db_script_exec() at db_script_exec+0x188/frame 0xfffffe000891eea0 db_command() at db_command+0x279/frame 0xfffffe000891ef70 db_command_loop() at db_command_loop+0x64/frame 0xfffffe000891ef80 db_trap() at db_trap+0xef/frame 0xfffffe000891f010 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe000891f090 trap() at trap+0x811/frame 0xfffffe000891f1a0 calltrap() at calltrap+0x8/frame 0xfffffe000891f1a0 --- trap 0x3, rip = 0xffffffff80c1992b, rsp = 0xfffffe000891f270, rbp = 0xfffffe000891f280 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe000891f280 vpanic() at vpanic+0x1ba/frame 0xfffffe000891f2d0 panic() at panic+0x43/frame 0xfffffe000891f330 witness_unlock() at witness_unlock+0xea/frame 0xfffffe000891f370 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe000891f3a0 swp_pager_trimswapspace() at swp_pager_trimswapspace+0xd5/frame 0xfffffe000891f400 swap_pager_putpages() at swap_pager_putpages+0x56c/frame 0xfffffe000891f4a0 vm_pageout_flush() at vm_pageout_flush+0xff/frame 0xfffffe000891f580 vm_pageout_cluster() at vm_pageout_cluster+0x3e6/frame 0xfffffe000891f7f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x2f6/frame 0xfffffe000891fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000891fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000891fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command tee pid 16918 tid 100171 td 0xfffff80003af05c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00ad66c6a0 mi_switch() at mi_switch+0x174/frame 0xfffffe00ad66c6d0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ad66c710 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ad66c770 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ad66c7a0 _sleep() at _sleep+0x2d0/frame 0xfffffe00ad66c840 pipe_read() at pipe_read+0x356/frame 0xfffffe00ad66c8a0 dofileread() at dofileread+0x81/frame 0xfffffe00ad66c8f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00ad66c930 sys_read() at sys_read+0x84/frame 0xfffffe00ad66c980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00ad66cab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ad66cab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80041522a, rsp = 0x7fffffffe6b8, rbp = 0x7fffffffe700 --- Tracing command sh pid 16917 tid 100145 td 0xfffff8000b3675c0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe000891ea90 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe000891eaa0 trap() at trap+0x5b/frame 0xfffffe000891ebb0 calltrap() at calltrap+0x8/frame 0xfffffe000891ebb0 --- trap 0xc, rip = 0xffffffff8107be66, rsp = 0xfffffe000891ec80, rbp = 0xfffffe000891ec90 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe000891ec90 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe000891ed30 db_command() at db_command+0x279/frame 0xfffffe000891ee00 db_script_exec() at db_script_exec+0x188/frame 0xfffffe000891eea0 db_command() at db_command+0x279/frame 0xfffffe000891ef70 db_command_loop() at db_command_loop+0x64/frame 0xfffffe000891ef80 db_trap() at db_trap+0xef/frame 0xfffffe000891f010 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe000891f090 trap() at trap+0x811/frame 0xfffffe000891f1a0 calltrap() at calltrap+0x8/frame 0xfffffe000891f1a0 --- trap 0x3, rip = 0xffffffff80c1992b, rsp = 0xfffffe000891f270, rbp = 0xfffffe000891f280 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe000891f280 vpanic() at vpanic+0x1ba/frame 0xfffffe000891f2d0 panic() at panic+0x43/frame 0xfffffe000891f330 witness_unlock() at witness_unlock+0xea/frame 0xfffffe000891f370 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe000891f3a0 swp_pager_trimswapspace() at swp_pager_trimswapspace+0xd5/frame 0xfffffe000891f400 swap_pager_putpages() at swap_pager_putpages+0x56c/frame 0xfffffe000891f4a0 vm_pageout_flush() at vm_pageout_flush+0xff/frame 0xfffffe000891f580 vm_pageout_cluster() at vm_pageout_cluster+0x3e6/frame 0xfffffe000891f7f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x2f6/frame 0xfffffe000891fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000891fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000891fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sh pid 2513 tid 100153 td 0xfffff800071c8000 sched_switch() at sched_switch+0x713/frame 0xfffffe00abdf66a0 mi_switch() at mi_switch+0x174/frame 0xfffffe00abdf66d0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00abdf6710 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00abdf6770 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00abdf67a0 _sleep() at _sleep+0x2d0/frame 0xfffffe00abdf6840 pipe_read() at pipe_read+0x356/frame 0xfffffe00abdf68a0 dofileread() at dofileread+0x81/frame 0xfffffe00abdf68f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00abdf6930 sys_read() at sys_read+0x84/frame 0xfffffe00abdf6980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00abdf6ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00abdf6ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80047622a, rsp = 0x7fffffffe228, rbp = 0x7fffffffe330 --- Tracing command awk pid 2511 tid 100202 td 0xfffff8004f3355c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00ad74a6a0 mi_switch() at mi_switch+0x174/frame 0xfffffe00ad74a6d0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ad74a710 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ad74a770 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ad74a7a0 _sleep() at _sleep+0x2d0/frame 0xfffffe00ad74a840 pipe_read() at pipe_read+0x356/frame 0xfffffe00ad74a8a0 dofileread() at dofileread+0x81/frame 0xfffffe00ad74a8f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00ad74a930 sys_read() at sys_read+0x84/frame 0xfffffe00ad74a980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00ad74aab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ad74aab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80047922a, rsp = 0x7fffffffe328, rbp = 0x7fffffffe340 --- Tracing command sh pid 2510 tid 100203 td 0xfffff8004f335000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe000891ea90 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe000891eaa0 trap() at trap+0x5b/frame 0xfffffe000891ebb0 calltrap() at calltrap+0x8/frame 0xfffffe000891ebb0 --- trap 0xc, rip = 0xffffffff8107be66, rsp = 0xfffffe000891ec80, rbp = 0xfffffe000891ec90 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe000891ec90 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe000891ed30 db_command() at db_command+0x279/frame 0xfffffe000891ee00 db_script_exec() at db_script_exec+0x188/frame 0xfffffe000891eea0 db_command() at db_command+0x279/frame 0xfffffe000891ef70 db_command_loop() at db_command_loop+0x64/frame 0xfffffe000891ef80 db_trap() at db_trap+0xef/frame 0xfffffe000891f010 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe000891f090 trap() at trap+0x811/frame 0xfffffe000891f1a0 calltrap() at calltrap+0x8/frame 0xfffffe000891f1a0 --- trap 0x3, rip = 0xffffffff80c1992b, rsp = 0xfffffe000891f270, rbp = 0xfffffe000891f280 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe000891f280 vpanic() at vpanic+0x1ba/frame 0xfffffe000891f2d0 panic() at panic+0x43/frame 0xfffffe000891f330 witness_unlock() at witness_unlock+0xea/frame 0xfffffe000891f370 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe000891f3a0 swp_pager_trimswapspace() at swp_pager_trimswapspace+0xd5/frame 0xfffffe000891f400 swap_pager_putpages() at swap_pager_putpages+0x56c/frame 0xfffffe000891f4a0 vm_pageout_flush() at vm_pageout_flush+0xff/frame 0xfffffe000891f580 vm_pageout_cluster() at vm_pageout_cluster+0x3e6/frame 0xfffffe000891f7f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x2f6/frame 0xfffffe000891fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000891fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000891fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sh pid 2477 tid 100217 td 0xfffff8011ba995c0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe000891ea90 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe000891eaa0 trap() at trap+0x5b/frame 0xfffffe000891ebb0 calltrap() at calltrap+0x8/frame 0xfffffe000891ebb0 --- trap 0xc, rip = 0xffffffff8107be66, rsp = 0xfffffe000891ec80, rbp = 0xfffffe000891ec90 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe000891ec90 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe000891ed30 db_command() at db_command+0x279/frame 0xfffffe000891ee00 db_script_exec() at db_script_exec+0x188/frame 0xfffffe000891eea0 db_command() at db_command+0x279/frame 0xfffffe000891ef70 db_command_loop() at db_command_loop+0x64/frame 0xfffffe000891ef80 db_trap() at db_trap+0xef/frame 0xfffffe000891f010 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe000891f090 trap() at trap+0x811/frame 0xfffffe000891f1a0 calltrap() at calltrap+0x8/frame 0xfffffe000891f1a0 --- trap 0x3, rip = 0xffffffff80c1992b, rsp = 0xfffffe000891f270, rbp = 0xfffffe000891f280 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe000891f280 vpanic() at vpanic+0x1ba/frame 0xfffffe000891f2d0 panic() at panic+0x43/frame 0xfffffe000891f330 witness_unlock() at witness_unlock+0xea/frame 0xfffffe000891f370 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe000891f3a0 swp_pager_trimswapspace() at swp_pager_trimswapspace+0xd5/frame 0xfffffe000891f400 swap_pager_putpages() at swap_pager_putpages+0x56c/frame 0xfffffe000891f4a0 vm_pageout_flush() at vm_pageout_flush+0xff/frame 0xfffffe000891f580 vm_pageout_cluster() at vm_pageout_cluster+0x3e6/frame 0xfffffe000891f7f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x2f6/frame 0xfffffe000891fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000891fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000891fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sh pid 2367 tid 100166 td 0xfffff8000b367000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe000891ea90 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe000891eaa0 trap() at trap+0x5b/frame 0xfffffe000891ebb0 calltrap() at calltrap+0x8/frame 0xfffffe000891ebb0 --- trap 0xc, rip = 0xffffffff8107be66, rsp = 0xfffffe000891ec80, rbp = 0xfffffe000891ec90 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe000891ec90 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe000891ed30 db_command() at db_command+0x279/frame 0xfffffe000891ee00 db_script_exec() at db_script_exec+0x188/frame 0xfffffe000891eea0 db_command() at db_command+0x279/frame 0xfffffe000891ef70 db_command_loop() at db_command_loop+0x64/frame 0xfffffe000891ef80 db_trap() at db_trap+0xef/frame 0xfffffe000891f010 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe000891f090 trap() at trap+0x811/frame 0xfffffe000891f1a0 calltrap() at calltrap+0x8/frame 0xfffffe000891f1a0 --- trap 0x3, rip = 0xffffffff80c1992b, rsp = 0xfffffe000891f270, rbp = 0xfffffe000891f280 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe000891f280 vpanic() at vpanic+0x1ba/frame 0xfffffe000891f2d0 panic() at panic+0x43/frame 0xfffffe000891f330 witness_unlock() at witness_unlock+0xea/frame 0xfffffe000891f370 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe000891f3a0 swp_pager_trimswapspace() at swp_pager_trimswapspace+0xd5/frame 0xfffffe000891f400 swap_pager_putpages() at swap_pager_putpages+0x56c/frame 0xfffffe000891f4a0 vm_pageout_flush() at vm_pageout_flush+0xff/frame 0xfffffe000891f580 vm_pageout_cluster() at vm_pageout_cluster+0x3e6/frame 0xfffffe000891f7f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x2f6/frame 0xfffffe000891fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000891fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000891fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bash pid 2364 tid 100200 td 0xfffff800054cf5c0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe000891ea90 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe000891eaa0 trap() at trap+0x5b/frame 0xfffffe000891ebb0 calltrap() at calltrap+0x8/frame 0xfffffe000891ebb0 --- trap 0xc, rip = 0xffffffff8107be66, rsp = 0xfffffe000891ec80, rbp = 0xfffffe000891ec90 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe000891ec90 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe000891ed30 db_command() at db_command+0x279/frame 0xfffffe000891ee00 db_script_exec() at db_script_exec+0x188/frame 0xfffffe000891eea0 db_command() at db_command+0x279/frame 0xfffffe000891ef70 db_command_loop() at db_command_loop+0x64/frame 0xfffffe000891ef80 db_trap() at db_trap+0xef/frame 0xfffffe000891f010 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe000891f090 trap() at trap+0x811/frame 0xfffffe000891f1a0 calltrap() at calltrap+0x8/frame 0xfffffe000891f1a0 --- trap 0x3, rip = 0xffffffff80c1992b, rsp = 0xfffffe000891f270, rbp = 0xfffffe000891f280 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe000891f280 vpanic() at vpanic+0x1ba/frame 0xfffffe000891f2d0 panic() at panic+0x43/frame 0xfffffe000891f330 witness_unlock() at witness_unlock+0xea/frame 0xfffffe000891f370 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe000891f3a0 swp_pager_trimswapspace() at swp_pager_trimswapspace+0xd5/frame 0xfffffe000891f400 swap_pager_putpages() at swap_pager_putpages+0x56c/frame 0xfffffe000891f4a0 vm_pageout_flush() at vm_pageout_flush+0xff/frame 0xfffffe000891f580 vm_pageout_cluster() at vm_pageout_cluster+0x3e6/frame 0xfffffe000891f7f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x2f6/frame 0xfffffe000891fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000891fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000891fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command csh pid 2362 tid 100150 td 0xfffff800059e85c0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe000891ea90 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe000891eaa0 trap() at trap+0x5b/frame 0xfffffe000891ebb0 calltrap() at calltrap+0x8/frame 0xfffffe000891ebb0 --- trap 0xc, rip = 0xffffffff8107be66, rsp = 0xfffffe000891ec80, rbp = 0xfffffe000891ec90 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe000891ec90 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe000891ed30 db_command() at db_command+0x279/frame 0xfffffe000891ee00 db_script_exec() at db_script_exec+0x188/frame 0xfffffe000891eea0 db_command() at db_command+0x279/frame 0xfffffe000891ef70 db_command_loop() at db_command_loop+0x64/frame 0xfffffe000891ef80 db_trap() at db_trap+0xef/frame 0xfffffe000891f010 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe000891f090 trap() at trap+0x811/frame 0xfffffe000891f1a0 calltrap() at calltrap+0x8/frame 0xfffffe000891f1a0 --- trap 0x3, rip = 0xffffffff80c1992b, rsp = 0xfffffe000891f270, rbp = 0xfffffe000891f280 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe000891f280 vpanic() at vpanic+0x1ba/frame 0xfffffe000891f2d0 panic() at panic+0x43/frame 0xfffffe000891f330 witness_unlock() at witness_unlock+0xea/frame 0xfffffe000891f370 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe000891f3a0 swp_pager_trimswapspace() at swp_pager_trimswapspace+0xd5/frame 0xfffffe000891f400 swap_pager_putpages() at swap_pager_putpages+0x56c/frame 0xfffffe000891f4a0 vm_pageout_flush() at vm_pageout_flush+0xff/frame 0xfffffe000891f580 vm_pageout_cluster() at vm_pageout_cluster+0x3e6/frame 0xfffffe000891f7f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x2f6/frame 0xfffffe000891fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000891fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000891fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command su pid 2361 tid 100164 td 0xfffff8000bb425c0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe000891ea90 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe000891eaa0 trap() at trap+0x5b/frame 0xfffffe000891ebb0 calltrap() at calltrap+0x8/frame 0xfffffe000891ebb0 --- trap 0xc, rip = 0xffffffff8107be66, rsp = 0xfffffe000891ec80, rbp = 0xfffffe000891ec90 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe000891ec90 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe000891ed30 db_command() at db_command+0x279/frame 0xfffffe000891ee00 db_script_exec() at db_script_exec+0x188/frame 0xfffffe000891eea0 db_command() at db_command+0x279/frame 0xfffffe000891ef70 db_command_loop() at db_command_loop+0x64/frame 0xfffffe000891ef80 db_trap() at db_trap+0xef/frame 0xfffffe000891f010 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe000891f090 trap() at trap+0x811/frame 0xfffffe000891f1a0 calltrap() at calltrap+0x8/frame 0xfffffe000891f1a0 --- trap 0x3, rip = 0xffffffff80c1992b, rsp = 0xfffffe000891f270, rbp = 0xfffffe000891f280 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe000891f280 vpanic() at vpanic+0x1ba/frame 0xfffffe000891f2d0 panic() at panic+0x43/frame 0xfffffe000891f330 witness_unlock() at witness_unlock+0xea/frame 0xfffffe000891f370 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe000891f3a0 swp_pager_trimswapspace() at swp_pager_trimswapspace+0xd5/frame 0xfffffe000891f400 swap_pager_putpages() at swap_pager_putpages+0x56c/frame 0xfffffe000891f4a0 vm_pageout_flush() at vm_pageout_flush+0xff/frame 0xfffffe000891f580 vm_pageout_cluster() at vm_pageout_cluster+0x3e6/frame 0xfffffe000891f7f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x2f6/frame 0xfffffe000891fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000891fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000891fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bash pid 2357 tid 100192 td 0xfffff800059ea5c0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe000891ea90 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe000891eaa0 trap() at trap+0x5b/frame 0xfffffe000891ebb0 calltrap() at calltrap+0x8/frame 0xfffffe000891ebb0 --- trap 0xc, rip = 0xffffffff8107be66, rsp = 0xfffffe000891ec80, rbp = 0xfffffe000891ec90 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe000891ec90 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe000891ed30 db_command() at db_command+0x279/frame 0xfffffe000891ee00 db_script_exec() at db_script_exec+0x188/frame 0xfffffe000891eea0 db_command() at db_command+0x279/frame 0xfffffe000891ef70 db_command_loop() at db_command_loop+0x64/frame 0xfffffe000891ef80 db_trap() at db_trap+0xef/frame 0xfffffe000891f010 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe000891f090 trap() at trap+0x811/frame 0xfffffe000891f1a0 calltrap() at calltrap+0x8/frame 0xfffffe000891f1a0 --- trap 0x3, rip = 0xffffffff80c1992b, rsp = 0xfffffe000891f270, rbp = 0xfffffe000891f280 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe000891f280 vpanic() at vpanic+0x1ba/frame 0xfffffe000891f2d0 panic() at panic+0x43/frame 0xfffffe000891f330 witness_unlock() at witness_unlock+0xea/frame 0xfffffe000891f370 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe000891f3a0 swp_pager_trimswapspace() at swp_pager_trimswapspace+0xd5/frame 0xfffffe000891f400 swap_pager_putpages() at swap_pager_putpages+0x56c/frame 0xfffffe000891f4a0 vm_pageout_flush() at vm_pageout_flush+0xff/frame 0xfffffe000891f580 vm_pageout_cluster() at vm_pageout_cluster+0x3e6/frame 0xfffffe000891f7f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x2f6/frame 0xfffffe000891fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000891fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000891fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sshd pid 2356 tid 100214 td 0xfffff80003947000 sched_switch() at sched_switch+0x713/frame 0xfffffe00ad7865c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00ad7865f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ad786630 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ad786690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ad7866c0 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00ad786720 seltdwait() at seltdwait+0x8d/frame 0xfffffe00ad786760 kern_select() at kern_select+0x953/frame 0xfffffe00ad786940 sys_select() at sys_select+0x56/frame 0xfffffe00ad786980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00ad786ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ad786ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80090220a, rsp = 0x7fffffffa578, rbp = 0x7fffffffa5b0 --- Tracing command sshd pid 2351 tid 100170 td 0xfffff800059e95c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00ad667640 mi_switch() at mi_switch+0x174/frame 0xfffffe00ad667670 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ad6676b0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ad667710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ad667740 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00ad6677a0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00ad6677e0 kern_poll() at kern_poll+0x448/frame 0xfffffe00ad667960 sys_poll() at sys_poll+0x50/frame 0xfffffe00ad667980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00ad667ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ad667ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8008a435a, rsp = 0x7fffffffe5d8, rbp = 0x7fffffffe610 --- Tracing command csh pid 2347 tid 100213 td 0xfffff800039475c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00ad781620 mi_switch() at mi_switch+0x174/frame 0xfffffe00ad781650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ad781690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ad7816f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ad781720 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00ad781780 tty_wait() at tty_wait+0x42/frame 0xfffffe00ad7817b0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00ad781810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00ad781840 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00ad7818a0 dofileread() at dofileread+0x81/frame 0xfffffe00ad7818f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00ad781930 sys_read() at sys_read+0x84/frame 0xfffffe00ad781980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00ad781ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ad781ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004fa22a, rsp = 0x7fffffffe1f8, rbp = 0x7fffffffe220 --- Tracing command login pid 2346 tid 100211 td 0xfffff8011ba94000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe000891ea90 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe000891eaa0 trap() at trap+0x5b/frame 0xfffffe000891ebb0 calltrap() at calltrap+0x8/frame 0xfffffe000891ebb0 --- trap 0xc, rip = 0xffffffff8107be66, rsp = 0xfffffe000891ec80, rbp = 0xfffffe000891ec90 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe000891ec90 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe000891ed30 db_command() at db_command+0x279/frame 0xfffffe000891ee00 db_script_exec() at db_script_exec+0x188/frame 0xfffffe000891eea0 db_command() at db_command+0x279/frame 0xfffffe000891ef70 db_command_loop() at db_command_loop+0x64/frame 0xfffffe000891ef80 db_trap() at db_trap+0xef/frame 0xfffffe000891f010 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe000891f090 trap() at trap+0x811/frame 0xfffffe000891f1a0 calltrap() at calltrap+0x8/frame 0xfffffe000891f1a0 --- trap 0x3, rip = 0xffffffff80c1992b, rsp = 0xfffffe000891f270, rbp = 0xfffffe000891f280 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe000891f280 vpanic() at vpanic+0x1ba/frame 0xfffffe000891f2d0 panic() at panic+0x43/frame 0xfffffe000891f330 witness_unlock() at witness_unlock+0xea/frame 0xfffffe000891f370 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe000891f3a0 swp_pager_trimswapspace() at swp_pager_trimswapspace+0xd5/frame 0xfffffe000891f400 swap_pager_putpages() at swap_pager_putpages+0x56c/frame 0xfffffe000891f4a0 vm_pageout_flush() at vm_pageout_flush+0xff/frame 0xfffffe000891f580 vm_pageout_cluster() at vm_pageout_cluster+0x3e6/frame 0xfffffe000891f7f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x2f6/frame 0xfffffe000891fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000891fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000891fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command getty pid 2345 tid 100210 td 0xfffff8000b7fc000 sched_switch() at sched_switch+0x713/frame 0xfffffe00ad772620 mi_switch() at mi_switch+0x174/frame 0xfffffe00ad772650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ad772690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ad7726f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ad772720 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00ad772780 tty_wait() at tty_wait+0x42/frame 0xfffffe00ad7727b0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00ad772810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00ad772840 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00ad7728a0 dofileread() at dofileread+0x81/frame 0xfffffe00ad7728f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00ad772930 sys_read() at sys_read+0x84/frame 0xfffffe00ad772980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00ad772ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ad772ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043122a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2344 tid 100209 td 0xfffff8000b7fc5c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00ad76d620 mi_switch() at mi_switch+0x174/frame 0xfffffe00ad76d650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ad76d690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ad76d6f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ad76d720 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00ad76d780 tty_wait() at tty_wait+0x42/frame 0xfffffe00ad76d7b0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00ad76d810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00ad76d840 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00ad76d8a0 dofileread() at dofileread+0x81/frame 0xfffffe00ad76d8f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00ad76d930 sys_read() at sys_read+0x84/frame 0xfffffe00ad76d980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00ad76dab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ad76dab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043122a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2343 tid 100208 td 0xfffff8000b7fb000 sched_switch() at sched_switch+0x713/frame 0xfffffe00ad768620 mi_switch() at mi_switch+0x174/frame 0xfffffe00ad768650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ad768690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ad7686f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ad768720 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00ad768780 tty_wait() at tty_wait+0x42/frame 0xfffffe00ad7687b0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00ad768810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00ad768840 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00ad7688a0 dofileread() at dofileread+0x81/frame 0xfffffe00ad7688f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00ad768930 sys_read() at sys_read+0x84/frame 0xfffffe00ad768980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00ad768ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ad768ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043122a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2342 tid 100207 td 0xfffff8000b7fb5c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00ad763620 mi_switch() at mi_switch+0x174/frame 0xfffffe00ad763650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ad763690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ad7636f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ad763720 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00ad763780 tty_wait() at tty_wait+0x42/frame 0xfffffe00ad7637b0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00ad763810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00ad763840 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00ad7638a0 dofileread() at dofileread+0x81/frame 0xfffffe00ad7638f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00ad763930 sys_read() at sys_read+0x84/frame 0xfffffe00ad763980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00ad763ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ad763ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043122a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2341 tid 100175 td 0xfffff8000b7fa5c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00ad680620 mi_switch() at mi_switch+0x174/frame 0xfffffe00ad680650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ad680690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ad6806f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ad680720 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00ad680780 tty_wait() at tty_wait+0x42/frame 0xfffffe00ad6807b0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00ad680810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00ad680840 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00ad6808a0 dofileread() at dofileread+0x81/frame 0xfffffe00ad6808f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00ad680930 sys_read() at sys_read+0x84/frame 0xfffffe00ad680980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00ad680ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ad680ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043122a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2340 tid 100176 td 0xfffff8000b7fa000 sched_switch() at sched_switch+0x713/frame 0xfffffe00ad685620 mi_switch() at mi_switch+0x174/frame 0xfffffe00ad685650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ad685690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ad6856f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ad685720 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00ad685780 tty_wait() at tty_wait+0x42/frame 0xfffffe00ad6857b0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00ad685810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00ad685840 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00ad6858a0 dofileread() at dofileread+0x81/frame 0xfffffe00ad6858f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00ad685930 sys_read() at sys_read+0x84/frame 0xfffffe00ad685980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00ad685ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ad685ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043122a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2339 tid 100169 td 0xfffff800059e8000 sched_switch() at sched_switch+0x713/frame 0xfffffe00ad662620 mi_switch() at mi_switch+0x174/frame 0xfffffe00ad662650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ad662690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ad6626f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ad662720 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00ad662780 tty_wait() at tty_wait+0x42/frame 0xfffffe00ad6627b0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00ad662810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00ad662840 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00ad6628a0 dofileread() at dofileread+0x81/frame 0xfffffe00ad6628f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00ad662930 sys_read() at sys_read+0x84/frame 0xfffffe00ad662980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00ad662ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ad662ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043122a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2338 tid 100149 td 0xfffff80003ae2000 sched_switch() at sched_switch+0x713/frame 0xfffffe00abde2620 mi_switch() at mi_switch+0x174/frame 0xfffffe00abde2650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00abde2690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00abde26f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00abde2720 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00abde2780 tty_wait() at tty_wait+0x42/frame 0xfffffe00abde27b0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00abde2810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00abde2840 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00abde28a0 dofileread() at dofileread+0x81/frame 0xfffffe00abde28f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00abde2930 sys_read() at sys_read+0x84/frame 0xfffffe00abde2980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00abde2ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00abde2ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043122a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2337 tid 100142 td 0xfffff8000b7f8000 sched_switch() at sched_switch+0x713/frame 0xfffffe00a45fd620 mi_switch() at mi_switch+0x174/frame 0xfffffe00a45fd650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a45fd690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00a45fd6f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a45fd720 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00a45fd780 tty_wait() at tty_wait+0x42/frame 0xfffffe00a45fd7b0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00a45fd810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00a45fd840 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00a45fd8a0 dofileread() at dofileread+0x81/frame 0xfffffe00a45fd8f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a45fd930 sys_read() at sys_read+0x84/frame 0xfffffe00a45fd980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00a45fdab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a45fdab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043122a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command cron pid 2291 tid 100146 td 0xfffff800071c7000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe000891ea90 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe000891eaa0 trap() at trap+0x5b/frame 0xfffffe000891ebb0 calltrap() at calltrap+0x8/frame 0xfffffe000891ebb0 --- trap 0xc, rip = 0xffffffff8107be66, rsp = 0xfffffe000891ec80, rbp = 0xfffffe000891ec90 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe000891ec90 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe000891ed30 db_command() at db_command+0x279/frame 0xfffffe000891ee00 db_script_exec() at db_script_exec+0x188/frame 0xfffffe000891eea0 db_command() at db_command+0x279/frame 0xfffffe000891ef70 db_command_loop() at db_command_loop+0x64/frame 0xfffffe000891ef80 db_trap() at db_trap+0xef/frame 0xfffffe000891f010 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe000891f090 trap() at trap+0x811/frame 0xfffffe000891f1a0 calltrap() at calltrap+0x8/frame 0xfffffe000891f1a0 --- trap 0x3, rip = 0xffffffff80c1992b, rsp = 0xfffffe000891f270, rbp = 0xfffffe000891f280 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe000891f280 vpanic() at vpanic+0x1ba/frame 0xfffffe000891f2d0 panic() at panic+0x43/frame 0xfffffe000891f330 witness_unlock() at witness_unlock+0xea/frame 0xfffffe000891f370 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe000891f3a0 swp_pager_trimswapspace() at swp_pager_trimswapspace+0xd5/frame 0xfffffe000891f400 swap_pager_putpages() at swap_pager_putpages+0x56c/frame 0xfffffe000891f4a0 vm_pageout_flush() at vm_pageout_flush+0xff/frame 0xfffffe000891f580 vm_pageout_cluster() at vm_pageout_cluster+0x3e6/frame 0xfffffe000891f7f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x2f6/frame 0xfffffe000891fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000891fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000891fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sshd pid 2287 tid 100147 td 0xfffff8000536a5c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00abdd85c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00abdd85f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00abdd8630 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00abdd8690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00abdd86c0 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00abdd8720 seltdwait() at seltdwait+0x8d/frame 0xfffffe00abdd8760 kern_select() at kern_select+0x953/frame 0xfffffe00abdd8940 sys_select() at sys_select+0x56/frame 0xfffffe00abdd8980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00abdd8ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00abdd8ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80090220a, rsp = 0x7fffffffe668, rbp = 0x7fffffffe6a0 --- Tracing command ntpd pid 2258 tid 100197 td 0xfffff8004fbb35c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00ad7365c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00ad7365f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ad736630 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ad736690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ad7366c0 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00ad736720 seltdwait() at seltdwait+0x8d/frame 0xfffffe00ad736760 kern_select() at kern_select+0x953/frame 0xfffffe00ad736940 sys_select() at sys_select+0x56/frame 0xfffffe00ad736980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00ad736ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ad736ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80082e20a, rsp = 0x7fffffffdf18, rbp = 0x7fffffffdf50 --- Tracing command ntpd pid 2258 tid 100475 td 0xfffff805c1be5000 sched_switch() at sched_switch+0x713/frame 0xfffffe00af6596b0 mi_switch() at mi_switch+0x174/frame 0xfffffe00af6596e0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00af659720 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00af659780 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00af6597b0 _sleep() at _sleep+0x2d0/frame 0xfffffe00af659850 umtxq_sleep() at umtxq_sleep+0x153/frame 0xfffffe00af6598b0 do_sem2_wait() at do_sem2_wait+0x41c/frame 0xfffffe00af659930 __umtx_op_sem2_wait() at __umtx_op_sem2_wait+0x76/frame 0xfffffe00af659980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00af659ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00af659ab0 --- syscall (454, FreeBSD ELF64, sys__umtx_op), rip = 0x80072258a, rsp = 0x7fffdfef9ed8, rbp = 0x7fffdfef9f50 --- Tracing command rpc.lockd pid 2197 tid 100190 td 0xfffff80003e99000 sched_switch() at sched_switch+0x713/frame 0xfffffe00ad7074e0 mi_switch() at mi_switch+0x174/frame 0xfffffe00ad707510 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ad707550 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ad7075b0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00ad7075f0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x185/frame 0xfffffe00ad707660 svc_run_internal() at svc_run_internal+0xa77/frame 0xfffffe00ad7077a0 svc_run() at svc_run+0x24e/frame 0xfffffe00ad707800 sys_nlm_syscall() at sys_nlm_syscall+0x77b/frame 0xfffffe00ad707980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00ad707ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ad707ab0 --- syscall (154, FreeBSD ELF64, sys_nlm_syscall), rip = 0x8002f062a, rsp = 0x7fffffffec08, rbp = 0x7fffffffecc0 --- Tracing command rpc.statd pid 2194 tid 100196 td 0xfffff800054d1000 sched_switch() at sched_switch+0x713/frame 0xfffffe00ad7315a0 mi_switch() at mi_switch+0x174/frame 0xfffffe00ad7315d0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ad731610 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ad731670 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00ad7316b0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x185/frame 0xfffffe00ad731720 seltdwait() at seltdwait+0x6b/frame 0xfffffe00ad731760 kern_select() at kern_select+0x953/frame 0xfffffe00ad731940 sys_select() at sys_select+0x56/frame 0xfffffe00ad731980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00ad731ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ad731ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80042520a, rsp = 0x7fffffffea98, rbp = 0x7fffffffebe0 --- Tracing command watchdogd pid 2148 tid 100194 td 0xfffff8000b3695c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00ad71b710 mi_switch() at mi_switch+0x174/frame 0xfffffe00ad71b740 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ad71b780 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ad71b7e0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00ad71b820 _sleep() at _sleep+0x265/frame 0xfffffe00ad71b8c0 kern_clock_nanosleep() at kern_clock_nanosleep+0x206/frame 0xfffffe00ad71b940 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00ad71b980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00ad71bab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ad71bab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003bdb6a, rsp = 0x7fffffffea98, rbp = 0x7fffffffeae0 --- Tracing command rpcbind pid 2058 tid 100148 td 0xfffff8000536a000 sched_switch() at sched_switch+0x713/frame 0xfffffe00abddd620 mi_switch() at mi_switch+0x174/frame 0xfffffe00abddd650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00abddd690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00abddd6f0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00abddd730 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x185/frame 0xfffffe00abddd7a0 seltdwait() at seltdwait+0x6b/frame 0xfffffe00abddd7e0 kern_poll() at kern_poll+0x448/frame 0xfffffe00abddd960 sys_poll() at sys_poll+0x50/frame 0xfffffe00abddd980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00abdddab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00abdddab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003cc35a, rsp = 0x7fffffffca38, rbp = 0x7fffffffec50 --- Tracing command syslogd pid 2048 tid 100191 td 0xfffff80003e9a5c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00ad70c5c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00ad70c5f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ad70c630 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ad70c690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ad70c6c0 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00ad70c720 seltdwait() at seltdwait+0x8d/frame 0xfffffe00ad70c760 kern_select() at kern_select+0x953/frame 0xfffffe00ad70c940 sys_select() at sys_select+0x56/frame 0xfffffe00ad70c980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00ad70cab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ad70cab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80043620a, rsp = 0x7fffffffe748, rbp = 0x7fffffffecc0 --- Tracing command devd pid 1977 tid 100161 td 0xfffff8000bb44000 sched_switch() at sched_switch+0x713/frame 0xfffffe00ad6225a0 mi_switch() at mi_switch+0x174/frame 0xfffffe00ad6225d0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ad622610 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ad622670 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00ad6226b0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x185/frame 0xfffffe00ad622720 seltdwait() at seltdwait+0x6b/frame 0xfffffe00ad622760 kern_select() at kern_select+0x953/frame 0xfffffe00ad622940 sys_select() at sys_select+0x56/frame 0xfffffe00ad622980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00ad622ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ad622ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x2f530a, rsp = 0x7fffffffcb48, rbp = 0x7fffffffece0 --- Tracing command dhclient pid 1972 tid 100193 td 0xfffff8000b368000 sched_switch() at sched_switch+0x713/frame 0xfffffe00ad716620 mi_switch() at mi_switch+0x174/frame 0xfffffe00ad716650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ad716690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ad7166f0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00ad716730 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x185/frame 0xfffffe00ad7167a0 seltdwait() at seltdwait+0x6b/frame 0xfffffe00ad7167e0 kern_poll() at kern_poll+0x448/frame 0xfffffe00ad716960 sys_poll() at sys_poll+0x50/frame 0xfffffe00ad716980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00ad716ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ad716ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003ef35a, rsp = 0x7fffffffec28, rbp = 0x7fffffffec60 --- Tracing command dhclient pid 1928 tid 100189 td 0xfffff8000b3685c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00ad6f6640 mi_switch() at mi_switch+0x174/frame 0xfffffe00ad6f6670 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ad6f66b0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ad6f6710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ad6f6740 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00ad6f67a0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00ad6f67e0 kern_poll() at kern_poll+0x448/frame 0xfffffe00ad6f6960 sys_poll() at sys_poll+0x50/frame 0xfffffe00ad6f6980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00ad6f6ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ad6f6ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003ef35a, rsp = 0x7fffffffec38, rbp = 0x7fffffffec60 --- Tracing command dhclient pid 1925 tid 100187 td 0xfffff800059e9000 sched_switch() at sched_switch+0x713/frame 0xfffffe00ad6ec5c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00ad6ec5f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ad6ec630 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ad6ec690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ad6ec6c0 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00ad6ec720 seltdwait() at seltdwait+0x8d/frame 0xfffffe00ad6ec760 kern_select() at kern_select+0x953/frame 0xfffffe00ad6ec940 sys_select() at sys_select+0x56/frame 0xfffffe00ad6ec980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe00ad6ecab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ad6ecab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80044d20a, rsp = 0x7fffffffe9e8, rbp = 0x7fffffffeaa0 --- Tracing command syncer pid 34 tid 100141 td 0xfffff8000b366000 sched_switch() at sched_switch+0x713/frame 0xfffffe00a45f88c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00a45f88f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a45f8930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00a45f8970 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x185/frame 0xfffffe00a45f89e0 sched_sync() at sched_sync+0x609/frame 0xfffffe00a45f8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a45f8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a45f8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vnlru pid 33 tid 100140 td 0xfffff8000b3665c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00a45f3890 mi_switch() at mi_switch+0x174/frame 0xfffffe00a45f38c0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a45f3900 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00a45f3940 _sleep() at _sleep+0x279/frame 0xfffffe00a45f39e0 vnlru_proc() at vnlru_proc+0xa4/frame 0xfffffe00a45f3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a45f3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a45f3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100132 td 0xfffff8000b365000 sched_switch() at sched_switch+0x713/frame 0xfffffe00089298d0 mi_switch() at mi_switch+0x174/frame 0xfffffe0008929900 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0008929940 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0008929980 _sleep() at _sleep+0x279/frame 0xfffffe0008929a20 buf_daemon() at buf_daemon+0xc8/frame 0xfffffe0008929a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0008929ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0008929ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100133 td 0xfffff80007026000 sched_switch() at sched_switch+0x713/frame 0xfffffe00089ee8c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00089ee8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00089ee930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00089ee970 _sleep() at _sleep+0x279/frame 0xfffffe00089eea10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe00089eea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00089eeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00089eeab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100134 td 0xfffff800070275c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00089f38c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00089f38f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00089f3930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00089f3970 _sleep() at _sleep+0x279/frame 0xfffffe00089f3a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe00089f3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00089f3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00089f3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100135 td 0xfffff80007027000 sched_switch() at sched_switch+0x713/frame 0xfffffe00089f88c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00089f88f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00089f8930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00089f8970 _sleep() at _sleep+0x279/frame 0xfffffe00089f8a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe00089f8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00089f8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00089f8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100136 td 0xfffff800070285c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00089fd8c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00089fd8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00089fd930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00089fd970 _sleep() at _sleep+0x279/frame 0xfffffe00089fda10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe00089fda70 fork_exit() at fork_exit+0x84/frame 0xfffffe00089fdab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00089fdab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100137 td 0xfffff80007028000 sched_switch() at sched_switch+0x713/frame 0xfffffe00a45a48c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00a45a48f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a45a4930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00a45a4970 _sleep() at _sleep+0x279/frame 0xfffffe00a45a4a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe00a45a4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a45a4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a45a4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100138 td 0xfffff800059e75c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00a45e98c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00a45e98f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a45e9930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00a45e9970 _sleep() at _sleep+0x279/frame 0xfffffe00a45e9a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe00a45e9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a45e9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a45e9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100139 td 0xfffff800059e7000 sched_switch() at sched_switch+0x713/frame 0xfffffe00a45ee8c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00a45ee8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a45ee930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00a45ee970 _sleep() at _sleep+0x279/frame 0xfffffe00a45eea10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe00a45eea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a45eeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a45eeab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100151 td 0xfffff800071c85c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00abdec8f0 mi_switch() at mi_switch+0x174/frame 0xfffffe00abdec920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00abdec960 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00abdec9a0 _sleep() at _sleep+0x279/frame 0xfffffe00abdeca40 softdep_flush() at softdep_flush+0x17f/frame 0xfffffe00abdeca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00abdecab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00abdecab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100199 td 0xfffff80003946000 sched_switch() at sched_switch+0x713/frame 0xfffffe00ad6188f0 mi_switch() at mi_switch+0x174/frame 0xfffffe00ad618920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ad618960 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00ad6189a0 _sleep() at _sleep+0x279/frame 0xfffffe00ad618a40 softdep_flush() at softdep_flush+0x17f/frame 0xfffffe00ad618a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00ad618ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ad618ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vmdaemon pid 31 tid 100129 td 0xfffff80003adf5c0 sched_switch() at sched_switch+0x713/frame 0xfffffe000891a940 mi_switch() at mi_switch+0x174/frame 0xfffffe000891a970 sched_bind() at sched_bind+0xdb/frame 0xfffffe000891a9a0 vm_page_drain_pqbatch() at vm_page_drain_pqbatch+0x61/frame 0xfffffe000891aa00 vm_daemon() at vm_daemon+0xb00/frame 0xfffffe000891aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000891aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000891aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100128 td 0xfffff80005894000 (CPU 11) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe00085ebdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe00085ebe10 trap() at trap+0x48/frame 0xfffffe00085ebf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00085ebf20 --- trap 0x13, rip = 0xffffffff80f1d24d, rsp = 0xfffffe0008915650, rbp = 0xfffffe0008915670 --- vm_page_change_lock() at vm_page_change_lock+0xd/frame 0xfffffe0008915670 vm_pageout_worker() at vm_pageout_worker+0xf49/frame 0xfffffe0008915a30 vm_pageout() at vm_pageout+0x156/frame 0xfffffe0008915a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0008915ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0008915ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100130 td 0xfffff800050b35c0 (CPU 1) kdb_enter() at kdb_enter+0x3b/frame 0xfffffe000891f280 vpanic() at vpanic+0x1ba/frame 0xfffffe000891f2d0 panic() at panic+0x43/frame 0xfffffe000891f330 witness_unlock() at witness_unlock+0xea/frame 0xfffffe000891f370 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe000891f3a0 swp_pager_trimswapspace() at swp_pager_trimswapspace+0xd5/frame 0xfffffe000891f400 swap_pager_putpages() at swap_pager_putpages+0x56c/frame 0xfffffe000891f4a0 vm_pageout_flush() at vm_pageout_flush+0xff/frame 0xfffffe000891f580 vm_pageout_cluster() at vm_pageout_cluster+0x3e6/frame 0xfffffe000891f7f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x2f6/frame 0xfffffe000891fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000891fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000891fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100131 td 0xfffff800050b3000 sched_switch() at sched_switch+0x713/frame 0xfffffe00089248f0 mi_switch() at mi_switch+0x174/frame 0xfffffe0008924920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0008924960 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00089249a0 _sleep() at _sleep+0x279/frame 0xfffffe0008924a40 uma_reclaim_worker() at uma_reclaim_worker+0xda/frame 0xfffffe0008924a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0008924ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0008924ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon1 pid 29 tid 100127 td 0xfffff80003ae25c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00089108b0 mi_switch() at mi_switch+0x174/frame 0xfffffe00089108e0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0008910920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0008910950 _sleep() at _sleep+0x2da/frame 0xfffffe00089109f0 enc_daemon() at enc_daemon+0x1cf/frame 0xfffffe0008910a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0008910ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0008910ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon0 pid 28 tid 100126 td 0xfffff80003ae1000 sched_switch() at sched_switch+0x713/frame 0xfffffe000890b8b0 mi_switch() at mi_switch+0x174/frame 0xfffffe000890b8e0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe000890b920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000890b950 _sleep() at _sleep+0x2da/frame 0xfffffe000890b9f0 enc_daemon() at enc_daemon+0x1cf/frame 0xfffffe000890ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe000890bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000890bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command rand_harvestq pid 27 tid 100123 td 0xfffff800058885c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00088fc8c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00088fc8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00088fc930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00088fc970 _sleep() at _sleep+0x279/frame 0xfffffe00088fca10 random_kthread() at random_kthread+0x26a/frame 0xfffffe00088fca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00088fcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00088fcab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sctp_iterator pid 26 tid 100119 td 0xfffff800058845c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00088dc910 mi_switch() at mi_switch+0x174/frame 0xfffffe00088dc940 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00088dc980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00088dc9b0 _sleep() at _sleep+0x2da/frame 0xfffffe00088dca50 sctp_iterator_thread() at sctp_iterator_thread+0x59/frame 0xfffffe00088dca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00088dcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00088dcab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod4 pid 25 tid 100118 td 0xfffff80003ae15c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00088cb8e0 mi_switch() at mi_switch+0x174/frame 0xfffffe00088cb910 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00088cb950 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00088cb990 _sleep() at _sleep+0x279/frame 0xfffffe00088cba30 soaio_kproc_loop() at soaio_kproc_loop+0x170/frame 0xfffffe00088cba70 fork_exit() at fork_exit+0x84/frame 0xfffffe00088cbab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00088cbab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod3 pid 24 tid 100117 td 0xfffff80003ae0000 sched_switch() at sched_switch+0x713/frame 0xfffffe00088c68e0 mi_switch() at mi_switch+0x174/frame 0xfffffe00088c6910 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00088c6950 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00088c6990 _sleep() at _sleep+0x279/frame 0xfffffe00088c6a30 soaio_kproc_loop() at soaio_kproc_loop+0x170/frame 0xfffffe00088c6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00088c6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00088c6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod2 pid 23 tid 100116 td 0xfffff80003ae05c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00088c18e0 mi_switch() at mi_switch+0x174/frame 0xfffffe00088c1910 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00088c1950 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00088c1990 _sleep() at _sleep+0x279/frame 0xfffffe00088c1a30 soaio_kproc_loop() at soaio_kproc_loop+0x170/frame 0xfffffe00088c1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00088c1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00088c1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod1 pid 22 tid 100115 td 0xfffff80003adf000 sched_switch() at sched_switch+0x713/frame 0xfffffe00088bc8e0 mi_switch() at mi_switch+0x174/frame 0xfffffe00088bc910 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00088bc950 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00088bc990 _sleep() at _sleep+0x279/frame 0xfffffe00088bca30 soaio_kproc_loop() at soaio_kproc_loop+0x170/frame 0xfffffe00088bca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00088bcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00088bcab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100096 td 0xfffff80003b6e5c0 sched_switch() at sched_switch+0x713/frame 0xfffffe0008845930 mi_switch() at mi_switch+0x174/frame 0xfffffe0008845960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00088459a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00088459d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0008845a30 usb_process() at usb_process+0x13b/frame 0xfffffe0008845a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0008845ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0008845ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100097 td 0xfffff80003b6e000 sched_switch() at sched_switch+0x713/frame 0xfffffe000884a930 mi_switch() at mi_switch+0x174/frame 0xfffffe000884a960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe000884a9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000884a9d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe000884aa30 usb_process() at usb_process+0x13b/frame 0xfffffe000884aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000884aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000884aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100098 td 0xfffff80003b6f5c0 sched_switch() at sched_switch+0x713/frame 0xfffffe000884f930 mi_switch() at mi_switch+0x174/frame 0xfffffe000884f960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe000884f9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000884f9d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe000884fa30 usb_process() at usb_process+0x13b/frame 0xfffffe000884fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000884fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000884fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100099 td 0xfffff80003b6f000 sched_switch() at sched_switch+0x713/frame 0xfffffe0008854930 mi_switch() at mi_switch+0x174/frame 0xfffffe0008854960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00088549a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00088549d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0008854a30 usb_process() at usb_process+0x13b/frame 0xfffffe0008854a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0008854ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0008854ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100100 td 0xfffff80003b795c0 sched_switch() at sched_switch+0x713/frame 0xfffffe0008859930 mi_switch() at mi_switch+0x174/frame 0xfffffe0008859960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00088599a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00088599d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0008859a30 usb_process() at usb_process+0x13b/frame 0xfffffe0008859a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0008859ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0008859ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100102 td 0xfffff800050b15c0 sched_switch() at sched_switch+0x713/frame 0xfffffe0008863930 mi_switch() at mi_switch+0x174/frame 0xfffffe0008863960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00088639a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00088639d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0008863a30 usb_process() at usb_process+0x13b/frame 0xfffffe0008863a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0008863ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0008863ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100103 td 0xfffff80007024000 sched_switch() at sched_switch+0x713/frame 0xfffffe0008868930 mi_switch() at mi_switch+0x174/frame 0xfffffe0008868960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00088689a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00088689d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0008868a30 usb_process() at usb_process+0x13b/frame 0xfffffe0008868a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0008868ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0008868ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100104 td 0xfffff800070255c0 sched_switch() at sched_switch+0x713/frame 0xfffffe000886d930 mi_switch() at mi_switch+0x174/frame 0xfffffe000886d960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe000886d9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000886d9d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe000886da30 usb_process() at usb_process+0x13b/frame 0xfffffe000886da70 fork_exit() at fork_exit+0x84/frame 0xfffffe000886dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000886dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100105 td 0xfffff80007025000 sched_switch() at sched_switch+0x713/frame 0xfffffe0008872930 mi_switch() at mi_switch+0x174/frame 0xfffffe0008872960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00088729a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00088729d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0008872a30 usb_process() at usb_process+0x13b/frame 0xfffffe0008872a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0008872ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0008872ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100106 td 0xfffff800070265c0 sched_switch() at sched_switch+0x713/frame 0xfffffe0008877930 mi_switch() at mi_switch+0x174/frame 0xfffffe0008877960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00088779a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00088779d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0008877a30 usb_process() at usb_process+0x13b/frame 0xfffffe0008877a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0008877ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0008877ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100107 td 0xfffff800072975c0 sched_switch() at sched_switch+0x713/frame 0xfffffe0008894930 mi_switch() at mi_switch+0x174/frame 0xfffffe0008894960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00088949a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00088949d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0008894a30 usb_process() at usb_process+0x13b/frame 0xfffffe0008894a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0008894ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0008894ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100108 td 0xfffff80007297000 sched_switch() at sched_switch+0x713/frame 0xfffffe0008899930 mi_switch() at mi_switch+0x174/frame 0xfffffe0008899960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00088999a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00088999d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0008899a30 usb_process() at usb_process+0x13b/frame 0xfffffe0008899a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0008899ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0008899ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100109 td 0xfffff800072985c0 sched_switch() at sched_switch+0x713/frame 0xfffffe000889e930 mi_switch() at mi_switch+0x174/frame 0xfffffe000889e960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe000889e9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000889e9d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe000889ea30 usb_process() at usb_process+0x13b/frame 0xfffffe000889ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe000889eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000889eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100110 td 0xfffff80007298000 sched_switch() at sched_switch+0x713/frame 0xfffffe00088a3930 mi_switch() at mi_switch+0x174/frame 0xfffffe00088a3960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00088a39a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00088a39d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe00088a3a30 usb_process() at usb_process+0x13b/frame 0xfffffe00088a3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00088a3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00088a3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100111 td 0xfffff800072995c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00088a8930 mi_switch() at mi_switch+0x174/frame 0xfffffe00088a8960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00088a89a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00088a89d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe00088a8a30 usb_process() at usb_process+0x13b/frame 0xfffffe00088a8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00088a8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00088a8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100091 td 0xfffff800050b1000 sched_switch() at sched_switch+0x713/frame 0xfffffe000882c8e0 mi_switch() at mi_switch+0x174/frame 0xfffffe000882c910 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe000882c950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000882c980 _sleep() at _sleep+0x2da/frame 0xfffffe000882ca20 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe000882ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe000882cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000882cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100092 td 0xfffff800050b25c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00088318e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0008831910 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0008831950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0008831980 _sleep() at _sleep+0x2da/frame 0xfffffe0008831a20 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe0008831a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0008831ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0008831ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100093 td 0xfffff800050b2000 sched_switch() at sched_switch+0x713/frame 0xfffffe00088368e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0008836910 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0008836950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0008836980 _sleep() at _sleep+0x2da/frame 0xfffffe0008836a20 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe0008836a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0008836ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0008836ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100125 td 0xfffff800058945c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00089068d0 mi_switch() at mi_switch+0x174/frame 0xfffffe0008906900 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0008906940 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0008906970 _sleep() at _sleep+0x2da/frame 0xfffffe0008906a10 xpt_scanner_thread() at xpt_scanner_thread+0x93/frame 0xfffffe0008906a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0008906ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0008906ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 11 pid 19 tid 100090 td 0xfffff800050365c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00088278c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00088278f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0008827930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0008827960 _sleep() at _sleep+0x2da/frame 0xfffffe0008827a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0008827a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0008827ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0008827ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 10 pid 18 tid 100089 td 0xfffff80005025000 sched_switch() at sched_switch+0x713/frame 0xfffffe00088228c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00088228f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0008822930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0008822960 _sleep() at _sleep+0x2da/frame 0xfffffe0008822a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0008822a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0008822ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0008822ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 9 pid 17 tid 100088 td 0xfffff800050255c0 sched_switch() at sched_switch+0x713/frame 0xfffffe000881d8c0 mi_switch() at mi_switch+0x174/frame 0xfffffe000881d8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe000881d930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000881d960 _sleep() at _sleep+0x2da/frame 0xfffffe000881da00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe000881da70 fork_exit() at fork_exit+0x84/frame 0xfffffe000881dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000881dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 8 pid 16 tid 100087 td 0xfffff80005024000 sched_switch() at sched_switch+0x713/frame 0xfffffe00088188c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00088188f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0008818930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0008818960 _sleep() at _sleep+0x2da/frame 0xfffffe0008818a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0008818a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0008818ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0008818ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 7 pid 15 tid 100086 td 0xfffff800050245c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00088138c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00088138f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0008813930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0008813960 _sleep() at _sleep+0x2da/frame 0xfffffe0008813a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0008813a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0008813ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0008813ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 6 pid 9 tid 100085 td 0xfffff80005023000 sched_switch() at sched_switch+0x713/frame 0xfffffe000880e8c0 mi_switch() at mi_switch+0x174/frame 0xfffffe000880e8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe000880e930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000880e960 _sleep() at _sleep+0x2da/frame 0xfffffe000880ea00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe000880ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe000880eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000880eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 5 pid 8 tid 100084 td 0xfffff800050235c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00088098c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00088098f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0008809930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0008809960 _sleep() at _sleep+0x2da/frame 0xfffffe0008809a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0008809a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0008809ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0008809ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 4 pid 7 tid 100083 td 0xfffff80005022000 sched_switch() at sched_switch+0x713/frame 0xfffffe00088048c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00088048f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0008804930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0008804960 _sleep() at _sleep+0x2da/frame 0xfffffe0008804a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0008804a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0008804ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0008804ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 3 pid 6 tid 100082 td 0xfffff800050225c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00005fd8c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00005fd8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005fd930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005fd960 _sleep() at _sleep+0x2da/frame 0xfffffe00005fda00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00005fda70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005fdab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005fdab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 2 pid 5 tid 100081 td 0xfffff8000503a000 sched_switch() at sched_switch+0x713/frame 0xfffffe00005f88c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00005f88f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005f8930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005f8960 _sleep() at _sleep+0x2da/frame 0xfffffe00005f8a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00005f8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005f8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005f8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 1 pid 4 tid 100080 td 0xfffff8000503a5c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00005f38c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00005f38f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005f3930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005f3960 _sleep() at _sleep+0x2da/frame 0xfffffe00005f3a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00005f3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005f3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005f3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 0 pid 3 tid 100079 td 0xfffff80005039000 sched_switch() at sched_switch+0x713/frame 0xfffffe00005ee8c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00005ee8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005ee930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005ee960 _sleep() at _sleep+0x2da/frame 0xfffffe00005eea00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00005eea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005eeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005eeab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 2 tid 100078 td 0xfffff800050395c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00005e98f0 mi_switch() at mi_switch+0x174/frame 0xfffffe00005e9920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005e9960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005e9990 _sleep() at _sleep+0x2da/frame 0xfffffe00005e9a30 crypto_proc() at crypto_proc+0x2c4/frame 0xfffffe00005e9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005e9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005e9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sequencer 00 pid 14 tid 100065 td 0xfffff80003c63000 sched_switch() at sched_switch+0x713/frame 0xfffffe00005a88f0 mi_switch() at mi_switch+0x174/frame 0xfffffe00005a8920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005a8960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005a8990 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe00005a89f0 seq_eventthread() at seq_eventthread+0xdc/frame 0xfffffe00005a8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005a8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005a8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100062 td 0xfffff80003cfe5c0 sched_switch() at sched_switch+0x713/frame 0xfffffe000058d8f0 mi_switch() at mi_switch+0x174/frame 0xfffffe000058d920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe000058d960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000058d990 _sleep() at _sleep+0x2da/frame 0xfffffe000058da30 g_run_events() at g_run_events+0x4f/frame 0xfffffe000058da70 fork_exit() at fork_exit+0x84/frame 0xfffffe000058dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000058dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100063 td 0xfffff80003cfe000 sched_switch() at sched_switch+0x713/frame 0xfffffe00005928f0 mi_switch() at mi_switch+0x174/frame 0xfffffe0000592920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0000592960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000592990 _sleep() at _sleep+0x2da/frame 0xfffffe0000592a30 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0000592a60 g_up_procbody() at g_up_procbody+0x6d/frame 0xfffffe0000592a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000592ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000592ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100064 td 0xfffff80003c635c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00005978f0 mi_switch() at mi_switch+0x174/frame 0xfffffe0000597920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0000597960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000597990 _sleep() at _sleep+0x2da/frame 0xfffffe0000597a30 g_io_schedule_down() at g_io_schedule_down+0x14c/frame 0xfffffe0000597a60 g_down_procbody() at g_down_procbody+0x6d/frame 0xfffffe0000597a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000597ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000597ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100017 td 0xfffff800037b8000 sched_switch() at sched_switch+0x713/frame 0xfffffe00781b89e0 mi_switch() at mi_switch+0x174/frame 0xfffffe00781b8a10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe00781b8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00781b8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00781b8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100018 td 0xfffff800037c55c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00781bd9e0 mi_switch() at mi_switch+0x174/frame 0xfffffe00781bda10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe00781bda70 fork_exit() at fork_exit+0x84/frame 0xfffffe00781bdab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00781bdab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100020 td 0xfffff8000377e5c0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100047 td 0xfffff80003d0d000 sched_switch() at sched_switch+0x713/frame 0xfffffe00004ee9e0 mi_switch() at mi_switch+0x174/frame 0xfffffe00004eea10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe00004eea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004eeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004eeab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100048 td 0xfffff80003d0e5c0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100049 td 0xfffff80003d0e000 sched_switch() at sched_switch+0x713/frame 0xfffffe00004f89e0 mi_switch() at mi_switch+0x174/frame 0xfffffe00004f8a10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe00004f8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004f8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004f8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100050 td 0xfffff80003d0f5c0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100051 td 0xfffff80003d0f000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100052 td 0xfffff80003d1d5c0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100053 td 0xfffff80003d1d000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100054 td 0xfffff8000373e5c0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100055 td 0xfffff80003cfa000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100056 td 0xfffff80003cfb5c0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100057 td 0xfffff80003cfb000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100058 td 0xfffff80003cfc5c0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100059 td 0xfffff80003cfc000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100060 td 0xfffff80003cfd5c0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100094 td 0xfffff80003b6d5c0 sched_switch() at sched_switch+0x713/frame 0xfffffe000883b9e0 mi_switch() at mi_switch+0x174/frame 0xfffffe000883ba10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe000883ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe000883bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000883bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100095 td 0xfffff80003b6d000 sched_switch() at sched_switch+0x713/frame 0xfffffe00088409e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0008840a10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe0008840a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0008840ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0008840ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100101 td 0xfffff80003b79000 sched_switch() at sched_switch+0x713/frame 0xfffffe000885e9e0 mi_switch() at mi_switch+0x174/frame 0xfffffe000885ea10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe000885ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe000885eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000885eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100112 td 0xfffff80007299000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100113 td 0xfffff800072a35c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00088b29e0 mi_switch() at mi_switch+0x174/frame 0xfffffe00088b2a10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe00088b2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00088b2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00088b2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100177 td 0xfffff800071c9000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100178 td 0xfffff800071ca5c0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100179 td 0xfffff800071ca000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100180 td 0xfffff800071d25c0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100181 td 0xfffff800071d2000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100182 td 0xfffff8004f33d000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100183 td 0xfffff8004f3345c0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100184 td 0xfffff8004f334000 fork_trampoline() at fork_trampoline Tracing command idle pid 11 tid 100003 td 0xfffff800037c6000 sched_switch() at sched_switch+0x713/frame 0xfffffe0078166940 mi_switch() at mi_switch+0x174/frame 0xfffffe0078166970 critical_exit_preempt() at critical_exit_preempt+0x65/frame 0xfffffe0078166990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0078166a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078166ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078166ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffff800037c75c0 sched_switch() at sched_switch+0x713/frame 0xfffffe007816b940 mi_switch() at mi_switch+0x174/frame 0xfffffe007816b970 critical_exit_preempt() at critical_exit_preempt+0x65/frame 0xfffffe007816b990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe007816ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe007816bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007816bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffff800037c7000 sched_switch() at sched_switch+0x713/frame 0xfffffe0078170940 mi_switch() at mi_switch+0x174/frame 0xfffffe0078170970 critical_exit_preempt() at critical_exit_preempt+0x65/frame 0xfffffe0078170990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0078170a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078170ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078170ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffff800037c85c0 sched_switch() at sched_switch+0x713/frame 0xfffffe0078175940 mi_switch() at mi_switch+0x174/frame 0xfffffe0078175970 critical_exit_preempt() at critical_exit_preempt+0x65/frame 0xfffffe0078175990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0078175a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078175ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078175ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffff800037c8000 sched_switch() at sched_switch+0x713/frame 0xfffffe007817a940 mi_switch() at mi_switch+0x174/frame 0xfffffe007817a970 critical_exit_preempt() at critical_exit_preempt+0x65/frame 0xfffffe007817a990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe007817aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe007817aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007817aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffff800037c95c0 sched_switch() at sched_switch+0x713/frame 0xfffffe007817f940 mi_switch() at mi_switch+0x174/frame 0xfffffe007817f970 critical_exit_preempt() at critical_exit_preempt+0x65/frame 0xfffffe007817f990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe007817fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe007817fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007817fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffff800037c9000 sched_switch() at sched_switch+0x713/frame 0xfffffe0078184940 mi_switch() at mi_switch+0x174/frame 0xfffffe0078184970 critical_exit_preempt() at critical_exit_preempt+0x65/frame 0xfffffe0078184990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0078184a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078184ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078184ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffff800037b55c0 sched_switch() at sched_switch+0x713/frame 0xfffffe0078189940 mi_switch() at mi_switch+0x174/frame 0xfffffe0078189970 critical_exit_preempt() at critical_exit_preempt+0x65/frame 0xfffffe0078189990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0078189a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078189ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078189ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffff800037b5000 sched_switch() at sched_switch+0x713/frame 0xfffffe007818e940 mi_switch() at mi_switch+0x174/frame 0xfffffe007818e970 critical_exit_preempt() at critical_exit_preempt+0x65/frame 0xfffffe007818e990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe007818ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe007818eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007818eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffff800037b65c0 sched_switch() at sched_switch+0x713/frame 0xfffffe0078193940 mi_switch() at mi_switch+0x174/frame 0xfffffe0078193970 critical_exit_preempt() at critical_exit_preempt+0x65/frame 0xfffffe0078193990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0078193a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078193ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078193ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffff800037b6000 sched_switch() at sched_switch+0x713/frame 0xfffffe0078198940 mi_switch() at mi_switch+0x174/frame 0xfffffe0078198970 critical_exit_preempt() at critical_exit_preempt+0x65/frame 0xfffffe0078198990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0078198a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078198ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078198ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffff800037b75c0 sched_switch() at sched_switch+0x713/frame 0xfffffe007819d940 mi_switch() at mi_switch+0x174/frame 0xfffffe007819d970 critical_exit_preempt() at critical_exit_preempt+0x65/frame 0xfffffe007819d990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe007819da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007819dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007819dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command init pid 1 tid 100002 td 0xfffff800037c65c0 sched_switch() at sched_switch+0x713/frame 0xfffffe0078161560 mi_switch() at mi_switch+0x174/frame 0xfffffe0078161590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00781615d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe0078161630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe0078161660 _sleep() at _sleep+0x2d0/frame 0xfffffe0078161700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe0078161790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe0078161980 amd64_syscall() at amd64_syscall+0x2d6/frame 0xfffffe0078161ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0078161ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x2b10da, rsp = 0x7fffffffe778, rbp = 0x7fffffffe7e0 --- Tracing command audit pid 10 tid 100001 td 0xfffff800037c5000 sched_switch() at sched_switch+0x713/frame 0xfffffe007815c910 mi_switch() at mi_switch+0x174/frame 0xfffffe007815c940 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe007815c980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe007815c9b0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe007815ca10 audit_worker() at audit_worker+0x93/frame 0xfffffe007815ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe007815cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007815cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xffffffff820876c0 sched_switch() at sched_switch+0x713/frame 0xffffffff82902980 mi_switch() at mi_switch+0x174/frame 0xffffffff829029b0 sleepq_switch() at sleepq_switch+0x110/frame 0xffffffff829029f0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xffffffff82902a30 _sleep() at _sleep+0x279/frame 0xffffffff82902ad0 swapper() at swapper+0x77/frame 0xffffffff82902b20 mi_startup() at mi_startup+0x2ee/frame 0xffffffff82902b70 btext() at btext+0x2c Tracing command kernel pid 0 tid 100015 td 0xfffff800037b7000 sched_switch() at sched_switch+0x713/frame 0xfffffe00781ae900 mi_switch() at mi_switch+0x174/frame 0xfffffe00781ae930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00781ae970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00781ae9a0 _sleep() at _sleep+0x2da/frame 0xfffffe00781aea40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00781aea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00781aeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00781aeab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100016 td 0xfffff800037b85c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00781b3900 mi_switch() at mi_switch+0x174/frame 0xfffffe00781b3930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00781b3970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00781b39a0 _sleep() at _sleep+0x2da/frame 0xfffffe00781b3a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00781b3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00781b3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00781b3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100019 td 0xfffff8000377d000 sched_switch() at sched_switch+0x713/frame 0xfffffe00781c2900 mi_switch() at mi_switch+0x174/frame 0xfffffe00781c2930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00781c2970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00781c29a0 _sleep() at _sleep+0x2da/frame 0xfffffe00781c2a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00781c2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00781c2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00781c2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xfffff8000377e000 sched_switch() at sched_switch+0x713/frame 0xfffffe00781cc930 mi_switch() at mi_switch+0x174/frame 0xfffffe00781cc960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00781cc9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00781cc9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00781cca40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00781cca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00781ccab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00781ccab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xfffff8000377f5c0 sched_switch() at sched_switch+0x713/frame 0xfffffe0000471930 mi_switch() at mi_switch+0x174/frame 0xfffffe0000471960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004719a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004719d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0000471a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000471a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000471ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000471ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xfffff8000377f000 sched_switch() at sched_switch+0x713/frame 0xfffffe0000476930 mi_switch() at mi_switch+0x174/frame 0xfffffe0000476960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004769a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004769d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0000476a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000476a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000476ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000476ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xfffff800037805c0 sched_switch() at sched_switch+0x713/frame 0xfffffe000047b930 mi_switch() at mi_switch+0x174/frame 0xfffffe000047b960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe000047b9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000047b9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe000047ba40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000047ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe000047bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000047bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xfffff80003780000 sched_switch() at sched_switch+0x713/frame 0xfffffe0000480930 mi_switch() at mi_switch+0x174/frame 0xfffffe0000480960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004809a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004809d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0000480a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000480a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000480ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000480ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100026 td 0xfffff800037815c0 sched_switch() at sched_switch+0x713/frame 0xfffffe0000485930 mi_switch() at mi_switch+0x174/frame 0xfffffe0000485960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004859a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004859d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0000485a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000485a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000485ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000485ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100027 td 0xfffff80003781000 sched_switch() at sched_switch+0x713/frame 0xfffffe000048a930 mi_switch() at mi_switch+0x174/frame 0xfffffe000048a960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe000048a9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000048a9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe000048aa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000048aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000048aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000048aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100028 td 0xfffff800037435c0 sched_switch() at sched_switch+0x713/frame 0xfffffe000048f930 mi_switch() at mi_switch+0x174/frame 0xfffffe000048f960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe000048f9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000048f9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe000048fa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000048fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000048fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000048fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100029 td 0xfffff80003743000 sched_switch() at sched_switch+0x713/frame 0xfffffe0000494930 mi_switch() at mi_switch+0x174/frame 0xfffffe0000494960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004949a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004949d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0000494a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000494a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000494ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000494ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100030 td 0xfffff800037445c0 sched_switch() at sched_switch+0x713/frame 0xfffffe0000499930 mi_switch() at mi_switch+0x174/frame 0xfffffe0000499960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004999a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004999d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0000499a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000499a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000499ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000499ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100031 td 0xfffff80003744000 sched_switch() at sched_switch+0x713/frame 0xfffffe000049e930 mi_switch() at mi_switch+0x174/frame 0xfffffe000049e960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe000049e9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000049e9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe000049ea40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000049ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe000049eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000049eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100032 td 0xfffff800037455c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00004a3930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004a3960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004a39a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004a39d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004a3a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004a3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004a3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004a3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100033 td 0xfffff80003745000 sched_switch() at sched_switch+0x713/frame 0xfffffe00004a8930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004a8960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004a89a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004a89d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004a8a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004a8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004a8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004a8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100034 td 0xfffff800037465c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00004ad930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004ad960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004ad9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004ad9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004ada40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004ada70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004adab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004adab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100035 td 0xfffff80003746000 sched_switch() at sched_switch+0x713/frame 0xfffffe00004b2930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004b2960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004b29a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004b29d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004b2a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004b2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004b2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004b2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100036 td 0xfffff8000377d5c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00004b7930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004b7960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004b79a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004b79d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004b7a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004b7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004b7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004b7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100037 td 0xfffff8000373e000 sched_switch() at sched_switch+0x713/frame 0xfffffe00004bc930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004bc960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004bc9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004bc9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004bca40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004bca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004bcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004bcab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100038 td 0xfffff8000373f5c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00004c1930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004c1960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004c19a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004c19d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004c1a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004c1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004c1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004c1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100039 td 0xfffff8000373f000 sched_switch() at sched_switch+0x713/frame 0xfffffe00004c6930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004c6960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004c69a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004c69d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004c6a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004c6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004c6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004c6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100040 td 0xfffff800037405c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00004cb930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004cb960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004cb9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004cb9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004cba40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004cba70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004cbab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004cbab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100041 td 0xfffff80003740000 sched_switch() at sched_switch+0x713/frame 0xfffffe00004d0930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004d0960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004d09a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004d09d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004d0a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004d0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004d0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004d0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100042 td 0xfffff800037415c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00004d5930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004d5960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004d59a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004d59d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004d5a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004d5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004d5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004d5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100043 td 0xfffff80003741000 sched_switch() at sched_switch+0x713/frame 0xfffffe00004da930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004da960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004da9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004da9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004daa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004daa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004daab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004daab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100044 td 0xfffff800037425c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00004df930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004df960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004df9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004df9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004dfa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004dfa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004dfab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004dfab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100045 td 0xfffff80003742000 sched_switch() at sched_switch+0x713/frame 0xfffffe00004e4930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004e4960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004e49a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004e49d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004e4a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004e4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004e4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004e4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100046 td 0xfffff80003d0d5c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00004e9930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004e9960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004e99a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004e99d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004e9a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004e9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004e9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004e9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100061 td 0xfffff80003cfd000 sched_switch() at sched_switch+0x713/frame 0xfffffe0000588900 mi_switch() at mi_switch+0x174/frame 0xfffffe0000588930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0000588970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005889a0 _sleep() at _sleep+0x2da/frame 0xfffffe0000588a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0000588a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000588ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000588ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100066 td 0xfffff80003c645c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00005ad900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005ad930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005ad970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005ad9a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005ada40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005ada70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005adab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005adab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100067 td 0xfffff80003c64000 sched_switch() at sched_switch+0x713/frame 0xfffffe00005b2900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005b2930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005b2970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005b29a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005b2a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005b2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005b2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005b2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100068 td 0xfffff80003c655c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00005b7900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005b7930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005b7970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005b79a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005b7a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005b7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005b7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005b7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100069 td 0xfffff80003c65000 sched_switch() at sched_switch+0x713/frame 0xfffffe00005bc900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005bc930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005bc970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005bc9a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005bca40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005bca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005bcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005bcab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100070 td 0xfffff80003c665c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00005c1900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005c1930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005c1970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005c19a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005c1a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005c1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005c1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005c1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100071 td 0xfffff80003c66000 sched_switch() at sched_switch+0x713/frame 0xfffffe00005c6900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005c6930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005c6970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005c69a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005c6a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005c6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005c6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005c6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100072 td 0xfffff80003cfa5c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00005cb900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005cb930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005cb970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005cb9a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005cba40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005cba70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005cbab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005cbab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100073 td 0xfffff80005036000 sched_switch() at sched_switch+0x713/frame 0xfffffe00005d0900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005d0930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005d0970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005d09a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005d0a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005d0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005d0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005d0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100074 td 0xfffff800050375c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00005d5900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005d5930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005d5970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005d59a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005d5a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005d5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005d5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005d5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100075 td 0xfffff80005037000 sched_switch() at sched_switch+0x713/frame 0xfffffe00005da900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005da930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005da970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005da9a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005daa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005daa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005daab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005daab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100076 td 0xfffff800050385c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00005df900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005df930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005df970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005df9a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005dfa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005dfa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005dfab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005dfab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100077 td 0xfffff80005038000 sched_switch() at sched_switch+0x713/frame 0xfffffe00005e4900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005e4930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005e4970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005e49a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005e4a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005e4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005e4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005e4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100114 td 0xfffff800072a3000 sched_switch() at sched_switch+0x713/frame 0xfffffe00088b7930 mi_switch() at mi_switch+0x174/frame 0xfffffe00088b7960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00088b79a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00088b79d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00088b7a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00088b7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00088b7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00088b7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100120 td 0xfffff80005884000 sched_switch() at sched_switch+0x713/frame 0xfffffe00088ed930 mi_switch() at mi_switch+0x174/frame 0xfffffe00088ed960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00088ed9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00088ed9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00088eda40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00088eda70 fork_exit() at fork_exit+0x84/frame 0xfffffe00088edab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00088edab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100121 td 0xfffff800058875c0 sched_switch() at sched_switch+0x713/frame 0xfffffe00088f2930 mi_switch() at mi_switch+0x174/frame 0xfffffe00088f2960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00088f29a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00088f29d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00088f2a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00088f2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00088f2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00088f2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100122 td 0xfffff80005887000 sched_switch() at sched_switch+0x713/frame 0xfffffe00088f7930 mi_switch() at mi_switch+0x174/frame 0xfffffe00088f7960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00088f79a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00088f79d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00088f7a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00088f7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00088f7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00088f7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100124 td 0xfffff80005888000 sched_switch() at sched_switch+0x713/frame 0xfffffe0008901900 mi_switch() at mi_switch+0x174/frame 0xfffffe0008901930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0008901970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00089019a0 _sleep() at _sleep+0x2da/frame 0xfffffe0008901a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0008901a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0008901ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0008901ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:pho> dump Dumping 1631 out of 32621 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% Dump complete db> (kgdb) bt #0 doadump (textdump=0x0) at include/pcpu.h:246 #1 0xffffffff8049d29b in db_dump (dummy=, dummy3=, dummy4=) at ../../../ddb/db_command.c:575 #2 0xffffffff8049d069 in db_command (cmd_table=, dopager=0x0) at ../../../ddb/db_command.c:482 #3 0xffffffff804a1fe8 in db_script_exec (scriptname=, warnifnotfound=) at ../../../ddb/db_script.c:304 #4 0xffffffff8049d069 in db_command (cmd_table=, dopager=0x1) at ../../../ddb/db_command.c:482 #5 0xffffffff8049cde4 in db_command_loop () at ../../../ddb/db_command.c:535 #6 0xffffffff8049ff8f in db_trap (type=, code=) at ../../../ddb/db_main.c:252 #7 0xffffffff80c1a21c in kdb_trap (type=0x3, code=0x0, tf=) at ../../../kern/subr_kdb.c:692 #8 0xffffffff810a5c21 in trap (frame=0xfffffe000891f1b0) at ../../../amd64/amd64/trap.c:621 #9 0xffffffff8107dcb5 in calltrap () at ../../../amd64/amd64/exception.S:232 #10 0xffffffff80c1992b in kdb_enter (why=0xffffffff8133b41c "panic", msg=) at include/cpufunc.h:65 #11 0xffffffff80bcef7a in vpanic (fmt=, ap=) at ../../../kern/kern_shutdown.c:894 #12 0xffffffff80bcecf3 in panic (fmt=) at ../../../kern/kern_shutdown.c:832 #13 0xffffffff80c3bf5a in witness_unlock (lock=0xffffffff81e89918, flags=0x80, file=0xfffffe000891f170 "", line=0x363) at ../../../kern/subr_witness.c:1635 #14 0xffffffff80baddad in __mtx_unlock_flags (c=0xffffffff8204a830, opts=0x0, file=, line=) at ../../../kern/kern_mutex.c:278 #15 0xffffffff80ef85f5 in swp_pager_trimswapspace () at ../../../vm/swap_pager.c:867 #16 0xffffffff80ef72ac in swap_pager_putpages (object=0xfffff80003ad2a00, ma=0xfffffe000891f5e8, count=0x16, flags=0x4, rtvals=0xfffffe000891f4b0) at ../../../vm/swap_pager.c:1589 #17 0xffffffff80f23a3f in vm_pageout_flush (mc=0xfffffe000891f5e8, count=0x16, flags=0x4, mreq=0x0, prunlen=0x0, eio=0x0) at vm_pager.h:131 #18 0xffffffff80f27166 in vm_pageout_cluster (m=) at ../../../vm/vm_pageout.c:421 #19 0xffffffff80f25eb6 in vm_pageout_laundry_worker (arg=) at ../../../vm/vm_pageout.c:667 #20 0xffffffff80b8c9f4 in fork_exit (callout=0xffffffff80f25bc0 , arg=0x0, frame=0xfffffe000891fac0) at ../../../kern/kern_fork.c:1057 #21 0xffffffff8107ecae in fork_trampoline () at ../../../amd64/amd64/exception.S:996 #22 0x0000000000000000 in ?? () Current language: auto; currently minimal (kgdb) f 15 #15 0xffffffff80ef85f5 in swp_pager_trimswapspace () at ../../../vm/swap_pager.c:867 867 mtx_unlock(&sw_dev_mtx); (kgdb) l 862 &npages, max_trim_alloc); 863 864 /* Quit if there's nothing free. */ 865 if (blk == SWAPBLK_NONE) 866 break; 867 mtx_unlock(&sw_dev_mtx); 868 CTR5(KTR_SPARE5, "%s: cursor %p blk %p " 869 "size %5d trimmer %p", __func__, 870 (void*)cursor, (void*)blk, npages, 871 (void*)sp->sw_trimmer); (kgdb) info loc sp = (struct swdevt *) 0xfffff806f730b500 bp = (struct buf *) 0xfffff8000b6dc800 blk = 0xae65 cursor = 0x270a nblks = 0x40000 npages = 0x1 (kgdb) p *sp $1 = {sw_flags = 0x1, sw_nblks = 0x40000, sw_used = 0x3ffc0, sw_dev = 0xa5, sw_vp = 0xfffff805a5cb44f0, sw_id = 0xfffff806f730b580, sw_first = 0x0, sw_end = 0x40000, sw_blist = 0xfffffe009b800000, sw_cursor = 0x270a, sw_trimmer = 0xae66, sw_list = {tqe_next = 0x0, tqe_prev = 0xffffffff81b590f8}, sw_strategy = 0xffffffff80efc770 , sw_close = 0xffffffff80efca00 } (kgdb) p *bp $2 = {b_bufobj = 0x0, b_bcount = 0x1000, b_caller1 = 0xfffff8047cd79198, b_data = 0x0, b_error = 0x0, b_iocmd = 0x3, b_ioflags = 0x0, b_iooffset = 0x11bb90000, b_resid = 0x0, b_iodone = 0xffffffff80efa920 , b_ckhashcalc = 0, b_ckhash = 0x0, b_blkno = 0x9458, b_offset = 0x0, b_bobufs = {tqe_next = 0x0, tqe_prev = 0x0}, b_vflags = 0x0, b_qindex = 0x0, b_domain = 0x0, b_subqueue = 0x0, b_flags = 0x4, b_xflags = 0x0, b_lock = {lock_object = {lo_name = 0xffffffff81375eb1 "bufwait", lo_flags = 0x26730000, lo_data = 0x0, lo_witness = 0xfffff8087fd71300}, lk_lock = 0xfffffffffffffff0, lk_exslpfail = 0x0, lk_timo = 0x0, lk_pri = 0x60, lk_stack = {depth = 0x8, pcs = 0xfffff8000b6dc8b8}}, b_bufsize = 0x1000, b_runningbufspace = 0x0, b_kvasize = 0x20000, b_dirtyoff = 0x0, b_dirtyend = 0x20000, b_kvabase = 0xfffffe00ab2c0000
, b_lblkno = 0x7e10, b_vp = 0x0, b_rcred = 0xfffff800036ac000, b_wcred = 0xfffff800036ac000, {b_freelist = {tqe_next = 0x0, tqe_prev = 0x600000000}, {b_pgiodone = 0, b_pgbefore = 0x0, b_pgafter = 0x6}}, b_cluster = {cluster_head = {tqh_first = 0xfffffe0003273ca0, tqh_last = 0xfffffe000304a260}, cluster_entry = {tqe_next = 0xfffffe0003273ca0, tqe_prev = 0xfffffe000304a260}}, b_pages = 0xfffff8000b6dc9a8, b_npages = 0x1, b_dep = {lh_first = 0x0}, b_fsprivate1 = 0xfffff806f730b500, b_fsprivate2 = 0x0, b_fsprivate3 = 0x0, b_io_tracking = 0xfffff8000b6dcad0, b_io_tcnt = 0xbac7} (kgdb) Index: src/sys/kern/subr_blist.c =================================================================== --- src/sys/kern/subr_blist.c (revision 350191) +++ src/sys/kern/subr_blist.c (working copy) @@ -295,7 +295,7 @@ blist_destroy(blist_t bl) * not be allocated. */ daddr_t -blist_alloc(blist_t bl, int *count, int maxcount) +blist_alloc(blist_t bl, daddr_t *io_cursor, int *count, int maxcount) { daddr_t blk, cursor; @@ -310,14 +310,14 @@ daddr_t * non-zero. When the cursor is zero, an allocation failure will * stop further iterations. */ - for (cursor = bl->bl_cursor;; cursor = 0) { + for (cursor = *io_cursor;; cursor = 0) { blk = blst_meta_alloc(bl->bl_root, cursor, count, maxcount, bl->bl_radix); if (blk != SWAPBLK_NONE) { bl->bl_avail -= *count; - bl->bl_cursor = blk + *count; - if (bl->bl_cursor == bl->bl_blocks) - bl->bl_cursor = 0; + *io_cursor = blk + *count; + if (*io_cursor == bl->bl_blocks) + *io_cursor = 0; return (blk); } if (cursor == 0) @@ -404,8 +404,7 @@ blist_resize(blist_t *pbl, daddr_t count, int free void blist_print(blist_t bl) { - printf("BLIST avail = %jd, cursor = %08jx {\n", - (uintmax_t)bl->bl_avail, (uintmax_t)bl->bl_cursor); + printf("BLIST avail = %jd {\n", (uintmax_t)bl->bl_avail); if (bl->bl_root->bm_bitmap != 0) blst_radix_print(bl->bl_root, 0, bl->bl_radix, 4); Index: src/sys/sys/blist.h =================================================================== --- src/sys/sys/blist.h (revision 350191) +++ src/sys/sys/blist.h (working copy) @@ -81,7 +81,6 @@ typedef struct blist { daddr_t bl_blocks; /* area of coverage */ daddr_t bl_avail; /* # available blocks */ u_daddr_t bl_radix; /* coverage radix */ - daddr_t bl_cursor; /* next-fit search starts at */ blmeta_t bl_root[1]; /* root of radix tree */ } *blist_t; @@ -92,7 +91,7 @@ typedef struct blist { struct sbuf; -daddr_t blist_alloc(blist_t blist, int *count, int maxcount); +daddr_t blist_alloc(blist_t blist, daddr_t *cursor, int *count, int maxcount); daddr_t blist_avail(blist_t blist); blist_t blist_create(daddr_t blocks, int flags); void blist_destroy(blist_t blist); Index: src/sys/vm/swap_pager.c =================================================================== --- src/sys/vm/swap_pager.c (revision 350191) +++ src/sys/vm/swap_pager.c (working copy) @@ -737,7 +737,8 @@ swp_pager_getswapspace(int *io_npages, int limit) if (sp == NULL) sp = TAILQ_FIRST(&swtailq); if ((sp->sw_flags & SW_CLOSING) == 0) - blk = blist_alloc(sp->sw_blist, &npages, mpages); + blk = blist_alloc(sp->sw_blist, &sp->sw_cursor, + &npages, mpages); if (blk != SWAPBLK_NONE) break; sp = TAILQ_NEXT(sp, sw_list); @@ -800,7 +801,108 @@ swp_pager_strategy(struct buf *bp) } +static void +swp_pager_async_trimdone(struct buf *bp) +{ + struct swdevt *sp; + daddr_t blk; + int npages; + + sp = (struct swdevt *)bp->b_fsprivate1; + blk = bp->b_blkno; + npages = bp->b_npages; + uma_zfree(swwbuf_zone, bp); + + mtx_lock(&swbuf_mtx); + if (++nsw_wcount_async == 1) + wakeup(&nsw_wcount_async); + mtx_unlock(&swbuf_mtx); + + mtx_lock(&sw_dev_mtx); + blk -= sp->sw_first; + blist_free(sp->sw_blist, blk, npages); + mtx_unlock(&sw_dev_mtx); +} + +static int trimzone_numer = 1; +static int trimzone_denom = 8; +static int min_trim_alloc = 1; +static int max_trim_alloc = 32768; /* + * The 'trim zone' is the small range of addresses just ahead of the cursor + * likely to be allocated soon. When the trimmer falls into the trim zone, + * we allocate blocks with the trimmer. + */ +static bool +swapdev_in_trim_zone(daddr_t start, daddr_t end, daddr_t nblks) +{ + return ((end + nblks - start) % nblks / trimzone_numer < + nblks / trimzone_denom); +} + +/* find a swap device that needs trimming, and start trimming */ +static void +swp_pager_trimswapspace(void) +{ + struct swdevt *sp; + struct buf *bp; + daddr_t blk, cursor; + u_long nblks; + int npages; + + mtx_lock(&sw_dev_mtx); + TAILQ_FOREACH(sp, &swtailq, sw_list) { + /* Quit if the cursor is too far behind the trimmer. */ + nblks = sp->sw_nblks; + cursor = sp->sw_cursor; + while (swapdev_in_trim_zone(cursor, sp->sw_trimmer, nblks)) { + /* Grab free space allocated long ago. */ + npages = min_trim_alloc; + blk = blist_alloc(sp->sw_blist, &sp->sw_trimmer, + &npages, max_trim_alloc); + + /* Quit if there's nothing free. */ + if (blk == SWAPBLK_NONE) + break; + mtx_unlock(&sw_dev_mtx); + CTR5(KTR_SPARE5, "%s: cursor %p blk %p " + "size %5d trimmer %p", __func__, + (void*)cursor, (void*)blk, npages, + (void*)sp->sw_trimmer); + blk += sp->sw_first; + mtx_lock(&swbuf_mtx); + if (nsw_wcount_async == 0) { + mtx_unlock(&swbuf_mtx); + mtx_lock(&sw_dev_mtx); + break; + } + nsw_wcount_async--; + mtx_unlock(&swbuf_mtx); + bp = uma_zalloc(swwbuf_zone, M_NOWAIT); + if (bp == NULL) { + mtx_lock(&sw_dev_mtx); + break; + } + bp->b_flags = B_ASYNC; + bp->b_data = NULL; + bp->b_iocmd = BIO_DELETE; + bp->b_rcred = crhold(thread0.td_ucred); + bp->b_wcred = crhold(thread0.td_ucred); + bp->b_bcount = PAGE_SIZE * npages; + bp->b_bufsize = PAGE_SIZE * npages; + bp->b_blkno = blk; + bp->b_npages = npages; + bp->b_iodone = swp_pager_async_trimdone; + bp->b_fsprivate1 = sp; + BUF_KERNPROC(bp); + sp->sw_strategy(bp,sp); + mtx_lock(&swbuf_mtx); + } + } + mtx_unlock(&sw_dev_mtx); +} + +/* * SWP_PAGER_FREESWAPSPACE() - free raw swap space * * This routine returns the specified swap blocks back to the bitmap. @@ -908,8 +1010,7 @@ swap_pager_reserve(vm_object_t object, vm_pindex_t blk = swp_pager_getswapspace(&n, 1); if (blk == SWAPBLK_NONE) { swp_pager_meta_free(object, start, i); - VM_OBJECT_WUNLOCK(object); - return (-1); + break; } for (j = 0; j < n; ++j) { addr = swp_pager_meta_build(object, @@ -919,9 +1020,10 @@ swap_pager_reserve(vm_object_t object, vm_pindex_t addr); } } + VM_OBJECT_WUNLOCK(object); swp_pager_freeswapspace(s_free, n_free); - VM_OBJECT_WUNLOCK(object); - return (0); + swp_pager_trimswapspace(); + return (i == size ? 0 : -1); } /* @@ -1343,7 +1445,6 @@ swap_pager_putpages(vm_object_t object, vm_page_t boolean_t sync; daddr_t addr, n_free, s_free; - swp_pager_init_freerange(&s_free, &n_free); if (count && ma[0]->object != object) { panic("swap_pager_putpages: object mismatch %p/%p", object, @@ -1366,6 +1467,7 @@ swap_pager_putpages(vm_object_t object, vm_page_t VM_OBJECT_WUNLOCK(object); n = 0; + swp_pager_init_freerange(&s_free, &n_free); if (curproc != pageproc) sync = TRUE; else @@ -1483,8 +1585,9 @@ swap_pager_putpages(vm_object_t object, vm_page_t */ swp_pager_async_iodone(bp); } + swp_pager_freeswapspace(s_free, n_free); + swp_pager_trimswapspace(); VM_OBJECT_WLOCK(object); - swp_pager_freeswapspace(s_free, n_free); } /* @@ -2310,6 +2413,8 @@ swaponsomething(struct vnode *vp, void *id, u_long sp->sw_flags = flags; sp->sw_blist = blist_create(nblks, M_WAITOK); + sp->sw_cursor = 0; + sp->sw_trimmer = 0; /* * Do not free the first two block in order to avoid overwriting * any bsd label at the front of the partition @@ -2749,7 +2854,7 @@ swapgeom_strategy(struct buf *bp, struct swdevt *s } swapgeom_acquire(cp); mtx_unlock(&sw_dev_mtx); - if (bp->b_iocmd == BIO_WRITE) + if (bp->b_iocmd == BIO_WRITE || bp->b_iocmd == BIO_DELETE) bio = g_new_bio(); else bio = g_alloc_bio(); Index: src/sys/vm/swap_pager.h =================================================================== --- src/sys/vm/swap_pager.h (revision 350191) +++ src/sys/vm/swap_pager.h (working copy) @@ -65,6 +65,8 @@ struct swdevt { swblk_t sw_first; swblk_t sw_end; struct blist *sw_blist; + daddr_t sw_cursor; /* next-fit search starts at */ + daddr_t sw_trimmer; /* where to look for free space to trim */ TAILQ_ENTRY(swdevt) sw_list; sw_strategy_t *sw_strategy; sw_close_t *sw_close; -- Test scenario: misc/stealer.sh