panic: handle_written_filepage: not started, vmcore.20 KDB: debugger backends: ddb KDB: current backend: ddb ---<>--- Copyright (c) 1992-2019 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 13.0-CURRENT #1 r344247: Mon Feb 18 20:48:39 CET 2019 pho@mercat1.netperf.freebsd.org:/usr/src/sys/amd64/compile/PHO amd64 FreeBSD clang version 7.0.1 (tags/RELEASE_701/final 349250) (based on LLVM 7.0.1) WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. Entering uma_startup with 10 boot pages configured startup_alloc from "UMA Kegs", 8 boot pages left startup_alloc from "UMA Zones", 7 boot pages left startup_alloc from "UMA Zones", 6 boot pages left startup_alloc from "UMA Zones", 5 boot pages left startup_alloc from "UMA Zones", 4 boot pages left startup_alloc from "UMA Zones", 3 boot pages left startup_alloc from "UMA Hash", 2 boot pages left startup_alloc from "UMA Zones", 1 boot pages left Entering uma_startup1 with 0 boot pages left Entering uma_startup2 with 0 boot pages left VT(vga): resolution 640x480 CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.07-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics real memory = 34359738368 (32768 MB) avail memory = 33182670848 (31645 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 12 CPUs FreeBSD/SMP: 1 package(s) x 6 core(s) x 2 hardware threads random: unblocking device. ioapic0 irqs 0-23 on motherboard ioapic1 irqs 24-47 on motherboard Launching APs: 1 2 6 5 4 11 9 7 10 3 8 Timecounter "TSC-low" frequency 1750035390 Hz quality 1000 random: entropy device external interface [ath_hal] loaded kbd1 at kbdmux0 module_register_init: MOD_LOAD (vesa, 0xffffffff8114d690, 0) error 19 random: registering fast source Intel Secure Key RNG random: fast provider: "Intel Secure Key RNG" 000.000061 [4212] netmap_init netmap: loaded module nexus0 vtvga0: on motherboard cryptosoft0: on motherboard acpi0: on motherboard acpi0: Power Button (fixed) cpu0: on acpi0 atrtc0: port 0x70-0x71,0x74-0x77 irq 8 on acpi0 atrtc0: registered as a time-of-day clock, resolution 1.000000s Event timer "RTC" frequency 32768 Hz quality 0 attimer0: port 0x40-0x43,0x50-0x53 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Event timer "HPET" frequency 14318180 Hz quality 350 Event timer "HPET1" frequency 14318180 Hz quality 340 Event timer "HPET2" frequency 14318180 Hz quality 340 Event timer "HPET3" frequency 14318180 Hz quality 340 Event timer "HPET4" frequency 14318180 Hz quality 340 Event timer "HPET5" frequency 14318180 Hz quality 340 Event timer "HPET6" frequency 14318180 Hz quality 340 Event timer "HPET7" frequency 14318180 Hz quality 340 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 pcib0: on acpi0 pci0: on pcib0 pci0: at device 11.1 (no driver attached) pci0: at device 11.2 (no driver attached) pci0: at device 16.1 (no driver attached) pci0: at device 16.6 (no driver attached) pci0: at device 18.1 (no driver attached) acpi_syscontainer0: on acpi0 acpi_syscontainer1: on acpi0 acpi_syscontainer2: on acpi0 acpi_syscontainer3: on acpi0 pcib1: port 0xcf8-0xcff on acpi0 pci1: on pcib1 pcib2: irq 26 at device 1.0 on pci1 pci2: on pcib2 pcib3: irq 32 at device 2.0 on pci1 pci3: on pcib3 pci3: at device 0.0 (no driver attached) pci3: at device 0.1 (no driver attached) pcib4: irq 40 at device 3.0 on pci1 pci4: on pcib4 pci1: at device 17.0 (no driver attached) ahci0: port 0xf110-0xf117,0xf100-0xf103,0xf0f0-0xf0f7,0xf0e0-0xf0e3,0xf020-0xf03f mem 0xfb438000-0xfb4387ff irq 16 at device 17.4 on pci1 ahci0: AHCI v1.30 with 4 6Gbps ports, Port Multiplier not supported ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahcich2: at channel 2 on ahci0 ahcich3: at channel 3 on ahci0 ahciem0: on ahci0 xhci0: mem 0xfb400000-0xfb40ffff irq 19 at device 20.0 on pci1 xhci0: 32 bytes context size, 64-bit DMA usbus0 on xhci0 usbus0: 5.0Gbps Super Speed USB v3.0 pci1: at device 22.0 (no driver attached) pci1: at device 22.1 (no driver attached) ehci0: mem 0xfb434000-0xfb4343ff irq 18 at device 26.0 on pci1 usbus1: EHCI version 1.0 usbus1 on ehci0 usbus1: 480Mbps High Speed USB v2.0 pcib5: irq 16 at device 28.0 on pci1 pci5: on pcib5 pcib6: irq 18 at device 28.2 on pci1 pci6: on pcib6 pcib7: at device 0.0 on pci6 pci7: on pcib7 vgapci0: port 0xe000-0xe07f mem 0xfa000000-0xfaffffff,0xfb000000-0xfb01ffff irq 18 at device 0.0 on pci7 vgapci0: Boot video device pcib8: irq 16 at device 28.4 on pci1 pci8: on pcib8 igb0: port 0xd020-0xd03f mem 0xfb320000-0xfb33ffff,0xfb344000-0xfb347fff irq 16 at device 0.0 on pci8 igb0: Using 1024 tx descriptors and 1024 rx descriptors igb0: queue equality override not set, capping rx_queues at 6 and tx_queues at 6 igb0: Using 6 rx queues 6 tx queues igb0: Using MSI-X interrupts with 7 vectors igb0:ugen0.3: at usbus0 ukbd0 on uhub5 ukbd0: on usbus0 kbd2 at ukbd0 . lo0: link state changed to UP Autoloading module: ioat.ko ioat0: mem 0xfb42c000-0xfb42ffff irq 31 at device 4.0 on pci1 ioat0: Capabilities: 2f7 ioat1: mem 0xfb428000-0xfb42bfff irq 39 at device 4.1 on pci1 ioat1: Capabilities: 2f7 ioat2: mem 0xfb424000-0xfb427fff irq 31 at device 4.2 on pci1 ioat2: Capabilities: f7 ioat3: mem 0xfb420000-0xfb423fff irq 39 at device 4.3 on pci1 ioat3: Capabilities: f7 ioat4: mem 0xfb41c000-0xfb41ffff irq 31 at device 4.4 on pci1 ioat4: Capabilities: f7 ioat5: mem 0xfb418000-0xfb41bfff irq 39 at device 4.5 on pci1 ioat5: Capabilities: f7 ioat6: mem 0xfb414000-0xfb417fff irq 31 at device 4.6 on pci1 ioat6: Capabilities: f7 ioat7: mem 0xfb410000-0xfb413fff irq 39 at device 4.7 on pci1 ioat7: Capabilities: f7 Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Starting Network: igb1. igb1: flags=8802 metric 0 mtu 1500 options=e507bb ether 0c:c4:7a:a8:cd:db media: Ethernet autoselect status: no carrier nd6 options=29 Autoloading module: uhid.ko Autoloading module: ums.ko ums0 on uhub5 ums0: on usbus0 ums0: 3 buttons and [Z] coordinates ID=0 Starting dhclient. DHCPREQUEST on igb0 to 255.255.255.255 port 67 DHCPACK from 192if_delmulti_locked: detaching ifnet instance 0xfffff80003fdb000 .168.5.1 bound to 192.168.5.171 -- renewal in 300 seconds. add host 127.0.0.1: gateway lo0 fib 0: route already in table add host ::1: gateway lo0 fib 0: route already in table add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Creating and/or trimming log files. Starting syslogd. Setting date via ntp. 18 Feb 20:54:03 ntpdate[2051]: step time server 192.168.5.1 offset -0.474030 sec Starting rpcbind. NFS access cache time=60 Starting watchdogd. No core dumps found. lock order reversal: 1st 0xfffffe00008afa48 bufwait (bufwait) @ kern/vfs_bio.c:3906 2nd 0xfffff8013e71cc00 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:289 stack backtrace: #0 0xffffffff80c4a863 at witness_debugger+0x73 #1 0xffffffff80c4a5b3 at witness_checkorder+0xac3 #2 0xffffffff80beb148 at _sx_xlock+0x68 #3 0xffffffff80f0d1ad at ufsdirhash_add+0x4d #4 0xffffffff80f11ac6 at ufs_direnter+0x446 #5 0xffffffff80f19d49 at ufs_mkdir+0x8c9 #6 0xffffffff8124c9cc at VOP_MKDIR_APV+0x8c #7 0xffffffff80cc3883 at kern_mkdirat+0x1b3 #8 0xffffffff810c7eb1 at amd64_syscall+0x291 #9 0xffffffff810a1bed at fast_syscall_common+0x101 Clearing /tmp (X related). Starting statd. Starting lockd. fscklock order reversal: 1st 0xfffff8000aeb6558 ufs (ufs) @ kern/vfs_subr.c:2590 2nd 0xfffffe00008afa48 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:282 3rd 0xfffff8013e3107d0 ufs (ufs) @ kern/vfs_subr.c:2590 stack backtrace: #0 0xffffffff80c4a863 at witness_debugger+0x73 #1 0xffffffff80c4a5b3 at witness_checkorder+0xac3 #2 0xffffffff80bb677b at lockmgr_xlock_hard+0x6b #3 0xffffffff80bb7203 at __lockmgr_args+0x5f3 #4 0xffffffff80f080ac at ffs_lock+0x7c #5 0xffffffff8124d520 at VOP_LOCK1_APV+0x70 #6 0xffffffff80cc6a05 at _vn_lock+0x65 #7 0xffffffff80cb4e46 at vget+0xa6 #8 0xffffffff80ca6b7c at vfs_hash_get+0xcc #9 0xffffffff80f039ef at ffs_vgetf+0x3f #10 0xffffffff80eeeabe at flush_pagedep_deps+0x33e #11 0xffffffff80eee65a at softdep_sync_buf+0x43a #12 0xffffffff80f08e34 at ffs_syncvnode+0x224 #13 0xffffffff80f0667d at ffs_sync+0x20d #14 0xffffffff80cad482 at dounmount+0x462 #15 0xffffffff80cacf80 at sys_unmount+0x300 #16 0xffffffff810c7eb1 at amd64_syscall+0x291 #17 0xffffffff810a1bed at fast_syscall_common+0x101 lock order reversal: 1st 0xfffff8000ad06558 ufs (ufs) @ kern/vfs_mount.c:1353 2nd 0xfffff8000ae942e0 devfs (devfs) @ ufs/ffs/ffs_softdep.c:1914 stack backtrace: #0 0xffffffff80c4a863 at witness_debugger+0x73 #1 0xffffffff80c4a5b3 at witness_checkorder+0xac3 #2 0xffffffff80bb627b at lockmgr_lock_fast_path+0x16b #3 0xffffffff8124d520 at VOP_LOCK1_APV+0x70 #4 0xffffffff80cc6a05 at _vn_lock+0x65 #5 0xffffffff80ed718f at softdep_flushworklist+0x7f #6 0xffffffff80f06876 at ffs_sync+0x406 #7 0xffffffff80cad482 at dounmount+0x462 #8 0xffffffff80cacf80 at sys_unmount+0x300 #9 0xffffffff810c7eb1 at amd64_syscall+0x291 #10 0xffffffff810a1bed at fast_syscall_common+0x101 ** /dev/gpt/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 1798 files, 1130820 used, 134587 free (147 frags, 16805 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** Updating motd:. Mounting late filesystems:. Configuring vt: blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting cron. Mon Feb 18 20:54 FreeBSD/amd64 (mercat1.netperf.freebsd.org) (ttyu1) login: root Feb 18 20:54:11 mercat1 login[2320]: ROOT LOGIN (root) ON ttyu1 Last login: Mon Feb 18 09:41:47 on ttyu1 FreeBSD 13.0-CURRENT (PHO) #1 r344247: Mon Feb 18 20:48:39 CET 2019 root@mercat1:~ # Feb 18 20:54:20 mercat1 su[2331]: pho to root on /dev/pts/0 20190218 20:54:46 all (1/1): pageout.sh lock order reversal: 1st 0xfffffe000093c2e0 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:282 2nd 0xfffff8025f84c030 snaplk (snaplk) @ ufs/ffs/ffs_snapshot.c:2317 stack backtrace: #0 0xffffffff80c4a863 at witness_debugger+0x73 #1 0xffffffff80c4a5b3 at witness_checkorder+0xac3 #2 0xffffffff80bb677b at lockmgr_xlock_hard+0x6b #3 0xffffffff80bb7203 at __lockmgr_args+0x5f3 #4 0xffffffff80ed6016 at ffs_copyonwrite+0x176 #5 0xffffffff80f0713d at ffs_geom_strategy+0x8d #6 0xffffffff80f1a243 at ufs_strategy+0x83 #7 0xffffffff8124d960 at VOP_STRATEGY_APV+0x90 #8 0xffffffff80c91164 at bufstrategy+0x44 #9 0xffffffff80c90ff9 at bufwrite+0x249 #10 0xffffffff80f08ebe at ffs_syncvnode+0x2ae #11 0xffffffff80f07f62 at ffs_fsync+0x22 #12 0xffffffff8124c358 at VOP_FSYNC_APV+0x88 #13 0xffffffff80f17e7f at ufs_remove+0xdf #14 0xffffffff8124c4fc at VOP_REMOVE_APV+0xac #15 0xffffffff80cbfd27 at kern_unlinkat+0x1e7 #16 0xffffffff810c7eb1 at amd64_syscall+0x291 #17 0xffffffff810a1bed at fast_syscall_common+0x101 lock order reversal: 1st 0xfffff8025f84c030 snaplk (snaplk) @ ufs/ufs/ufs_vnops.c:918 2nd 0xfffff801ac2667d0 ufs (ufs) @ ufs/ffs/ffs_snapshot.c:1640 stack backtrace: #0 0xffffffff80c4a863 at witness_debugger+0x73 #1 0xffffffff80c4a5b3 at witness_checkorder+0xac3 #2 0xffffffff80bb677b at lockmgr_xlock_hard+0x6b #3 0xffffffff80bb7203 at __lockmgr_args+0x5f3 #4 0xffffffff80ed4555 at ffs_snapremove+0xe5 #5 0xffffffff80ecec38 at ffs_truncate+0x268 #6 0xffffffff80f102ad at ufs_inactive+0x1cd #7 0xffffffff8124d238 at VOP_INACTIVE_APV+0x88 #8 0xffffffff80cb5288 at vinactive+0xe8 #9 0xffffffff80cb5899 at vputx+0x309 #10 0xffffffff80cbfd69 at kern_unlinkat+0x229 #11 0xffffffff810c7eb1 at amd64_syscall+0x291 #12 0xffffffff810a1bed at fast_syscall_common+0x101 Feb 18 20:54:57 mercat1 su[4775]: pho to root on /dev/pts/1 lock order reversal: 1st 0xfffff801ac1eea48 syncer (syncer) @ kern/vfs_subr.c:2170 2nd 0xfffff801ac3ffa48 ufs (ufs) @ kern/vfs_subr.c:2590 stack backtrace: #0 0xffffffff80c4a863 at witness_debugger+0x73 #1 0xffffffff80c4a5b3 at witness_checkorder+0xac3 #2 0xffffffff80bb677b at lockmgr_xlock_hard+0x6b #3 0xffffffff80bb7203 at __lockmgr_args+0x5f3 #4 0xffffffff80f080ac at ffs_lock+0x7c #5 0xffffffff8124d520 at VOP_LOCK1_APV+0x70 #6 0xffffffff80cc6a05 at _vn_lock+0x65 #7 0xffffffff80cb4e46 at vget+0xa6 #8 0xffffffff80cb7026 at vfs_msync+0xa6 #9 0xffffffff80cbbfe5 at sync_fsync+0xc5 #10 0xffffffff8124c358 at VOP_FSYNC_APV+0x88 #11 0xffffffff80cb9e04 at sched_sync+0x284 #12 0xffffffff80ba19b4 at fork_exit+0x84 #13 0xffffffff810a22fe at fork_trampoline+0xe Feb 18 20:58:29 mercat1 kernel: pid 3576 (swap), jid 0, uid 0, was killed: out of swap space pts leak: 1/2 20190218 21:04:51 all (1/1): pageout.sh 20190218 21:14:55 all (1/1): pageout.sh 20190218 21:24:58 all (1/1): pageout.sh 20190218 21:35:00 all (1/1): pageout.sh 20190218 21:45:04 all (1/1): pageout.sh 20190218 21:55:06 all (1/1): pageout.sh 20190218 22:05:08 all (1/1): pageout.sh 20190218 22:15:12 all (1/1): pageout.sh Feb 18 22:19:47 mercat1 kernel: pid 74143 (swap), jid 0, uid 0, was killed: out of swap space 20190218 22:25:15 all (1/1): pageout.sh 20190218 22:35:18 all (1/1): pageout.sh 20190218 22:45:22 all (1/1): pageout.sh 20190218 22:55:26 all (1/1): pageout.sh 20190218 23:05:29 all (1/1): pageout.sh panic: handle_written_filepage: not started cpuid = 3 time = 1550527654 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00aa9482d0 vpanic() at vpanic+0x1b4/frame 0xfffffe00aa948330 panic() at panic+0x43/frame 0xfffffe00aa948390 handle_written_filepage() at handle_written_filepage+0x3e/frame 0xfffffe00aa948400 softdep_disk_write_complete() at softdep_disk_write_complete+0xdd/frame 0xfffffe00aa9484a0 bufdone() at bufdone+0x3bb/frame 0xfffffe00aa948520 ufs_strategy() at ufs_strategy+0x83/frame 0xfffffe00aa948550 VOP_STRATEGY_APV() at VOP_STRATEGY_APV+0x90/frame 0xfffffe00aa948570 bufstrategy() at bufstrategy+0x44/frame 0xfffffe00aa9485a0 bufwrite() at bufwrite+0x249/frame 0xfffffe00aa9485f0 ffs_syncvnode() at ffs_syncvnode+0x2ae/frame 0xfffffe00aa948670 ffs_fsync() at ffs_fsync+0x22/frame 0xfffffe00aa9486b0 VOP_FSYNC_APV() at VOP_FSYNC_APV+0x88/frame 0xfffffe00aa9486d0 ufs_remove() at ufs_remove+0xdf/frame 0xfffffe00aa948730 VOP_REMOVE_APV() at VOP_REMOVE_APV+0xac/frame 0xfffffe00aa948750 kern_unlinkat() at kern_unlinkat+0x1e7/frame 0xfffffe00aa948990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa948ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa948ab0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x800415e9a, rsp = 0x7fffffffe4b8, rbp = 0x7fffffffe5d0 --- KDB: enter: panic [ thread pid 87724 tid 100196 ] Stopped at kdb_enter+0x3b: movq $0,kdb_why db> run pho db:0:pho> set $lines 20000 db:0:pho> run pho1 db:1:pho1> bt Tracing pid 87724 tid 100196 td 0xfffff800037a65a0 kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00aa9482d0 vpanic() at vpanic+0x1d1/frame 0xfffffe00aa948330 panic() at panic+0x43/frame 0xfffffe00aa948390 handle_written_filepage() at handle_written_filepage+0x3e/frame 0xfffffe00aa948400 softdep_disk_write_complete() at softdep_disk_write_complete+0xdd/frame 0xfffffe00aa9484a0 bufdone() at bufdone+0x3bb/frame 0xfffffe00aa948520 ufs_strategy() at ufs_strategy+0x83/frame 0xfffffe00aa948550 VOP_STRATEGY_APV() at VOP_STRATEGY_APV+0x90/frame 0xfffffe00aa948570 bufstrategy() at bufstrategy+0x44/frame 0xfffffe00aa9485a0 bufwrite() at bufwrite+0x249/frame 0xfffffe00aa9485f0 ffs_syncvnode() at ffs_syncvnode+0x2ae/frame 0xfffffe00aa948670 ffs_fsync() at ffs_fsync+0x22/frame 0xfffffe00aa9486b0 VOP_FSYNC_APV() at VOP_FSYNC_APV+0x88/frame 0xfffffe00aa9486d0 ufs_remove() at ufs_remove+0xdf/frame 0xfffffe00aa948730 VOP_REMOVE_APV() at VOP_REMOVE_APV+0xac/frame 0xfffffe00aa948750 kern_unlinkat() at kern_unlinkat+0x1e7/frame 0xfffffe00aa948990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa948ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa948ab0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x800415e9a, rsp = 0x7fffffffe4b8, rbp = 0x7fffffffe5d0 --- db:1:pho1> show allpcpu Current CPU: 3 cpuid = 0 dynamic pcpu = 0xd65680 curthread = 0xfffff801d11ea000: pid 85404 tid 100389 "swap" curpcb = 0xfffffe00acbfdb80 fpcurthread = 0xfffff801d11ea000: pid 85404 "swap" idlethread = 0xfffff800036bb000: tid 100003 "idle: cpu0" curpmap = 0xfffff8000aa06138 tssp = 0xffffffff821cc4a0 commontssp = 0xffffffff821cc4a0 rsp0 = 0xfffffe00acbfdb80 gs32p = 0xffffffff821d30d8 ldt = 0xffffffff821d3118 tss = 0xffffffff821d3108 tlb gen = 130954740 curvnet = 0 spin locks held: cpuid = 1 dynamic pcpu = 0xfffffe0084fdd680 curthread = 0xfffff806fd709000: pid 85398 tid 100368 "swap" curpcb = 0xfffffe00acbd5b80 fpcurthread = 0xfffff806fd709000: pid 85398 "swap" idlethread = 0xfffff800036ba5a0: tid 100004 "idle: cpu1" curpmap = 0xfffff801ac3e6138 tssp = 0xffffffff821cc508 commontssp = 0xffffffff821cc508 rsp0 = 0xfffffe00acbd5b80 gs32p = 0xffffffff821d3140 ldt = 0xffffffff821d3180 tss = 0xffffffff821d3170 tlb gen = 130954740 curvnet = 0 spin locks held: cpuid = 2 dynamic pcpu = 0xfffffe0084fe9680 curthread = 0xfffff8000a6ab5a0: pid 85396 tid 100173 "swap" curpcb = 0xfffffe00aa899b80 fpcurthread = 0xfffff8000a6ab5a0: pid 85396 "swap" idlethread = 0xfffff800036ba000: tid 100005 "idle: cpu2" curpmap = 0xfffff80787ad2138 tssp = 0xffffffff821cc570 commontssp = 0xffffffff821cc570 rsp0 = 0xfffffe00aa899b80 gs32p = 0xffffffff821d31a8 ldt = 0xffffffff821d31e8 tss = 0xffffffff821d31d8 tlb gen = 130970801 curvnet = 0 spin locks held: cpuid = 3 dynamic pcpu = 0xfffffe0084ff5680 curthread = 0xfffff800037a65a0: pid 87724 tid 100196 "rm" curpcb = 0xfffffe00aa948b80 fpcurthread = 0xfffff800037a65a0: pid 87724 "rm" idlethread = 0xfffff800036b95a0: tid 100006 "idle: cpu3" curpmap = 0xfffff8000a9d7138 tssp = 0xffffffff821cc5d8 commontssp = 0xffffffff821cc5d8 rsp0 = 0xfffffe00aa948b80 gs32p = 0xffffffff821d3210 ldt = 0xffffffff821d3250 tss = 0xffffffff821d3240 tlb gen = 130954740 curvnet = 0 spin locks held: cpuid = 4 dynamic pcpu = 0xfffffe0085001680 curthread = 0xfffff801d10695a0: pid 85394 tid 100321 "swap" curpcb = 0xfffffe00acb2bb80 fpcurthread = 0xfffff801d10695a0: pid 85394 "swap" idlethread = 0xfffff800036b9000: tid 100007 "idle: cpu4" curpmap = 0xfffff8068a2d6138 tssp = 0xffffffff821cc640 commontssp = 0xffffffff821cc640 rsp0 = 0xfffffe00acb2bb80 gs32p = 0xffffffff821d3278 ldt = 0xffffffff821d32b8 tss = 0xffffffff821d32a8 tlb gen = 130973925 curvnet = 0 spin locks held: cpuid = 5 dynamic pcpu = 0xfffffe008500d680 curthread = 0xfffff8000a3a05a0: pid 30 tid 100128 "dom0" curpcb = 0xfffffe0006f2eb80 fpcurthread = none idlethread = 0xfffff800036b85a0: tid 100008 "idle: cpu5" curpmap = 0xffffffff82094da0 tssp = 0xffffffff821cc6a8 commontssp = 0xffffffff821cc6a8 rsp0 = 0xfffffe0006f2eb80 gs32p = 0xffffffff821d32e0 ldt = 0xffffffff821d3320 tss = 0xffffffff821d3310 tlb gen = 130954740 curvnet = 0 spin locks held: cpuid = 6 dynamic pcpu = 0xfffffe0085019680 curthread = 0xfffff800036cb000: pid 0 tid 100015 "thread taskq" curpcb = 0xfffffe00767aeb80 fpcurthread = none idlethread = 0xfffff800036b8000: tid 100009 "idle: cpu6" curpmap = 0xffffffff82094da0 tssp = 0xffffffff821cc710 commontssp = 0xffffffff821cc710 rsp0 = 0xfffffe00767aeb80 gs32p = 0xffffffff821d3348 ldt = 0xffffffff821d3388 tss = 0xffffffff821d3378 tlb gen = 130954740 curvnet = 0 spin locks held: cpuid = 7 dynamic pcpu = 0xfffffe0085025680 curthread = 0xfffff800037a85a0: pid 85400 tid 100144 "swap" curpcb = 0xfffffe00aa7eeb80 fpcurthread = 0xfffff800037a85a0: pid 85400 "swap" idlethread = 0xfffff800036cd5a0: tid 100010 "idle: cpu7" curpmap = 0xfffff8011f212138 tssp = 0xffffffff821cc778 commontssp = 0xffffffff821cc778 rsp0 = 0xfffffe00aa7eeb80 gs32p = 0xffffffff821d33b0 ldt = 0xffffffff821d33f0 tss = 0xffffffff821d33e0 tlb gen = 130973934 curvnet = 0 spin locks held: cpuid = 8 dynamic pcpu = 0xfffffe0085031680 curthread = 0xfffff8025f2f6000: pid 85401 tid 100275 "swap" curpcb = 0xfffffe00aca95b80 fpcurthread = 0xfffff8025f2f6000: pid 85401 "swap" idlethread = 0xfffff800036cd000: tid 100011 "idle: cpu8" curpmap = 0xfffff801ac35d138 tssp = 0xffffffff821cc7e0 commontssp = 0xffffffff821cc7e0 rsp0 = 0xfffffe00aca95b80 gs32p = 0xffffffff821d3418 ldt = 0xffffffff821d3458 tss = 0xffffffff821d3448 tlb gen = 130967757 curvnet = 0 spin locks held: cpuid = 9 dynamic pcpu = 0xfffffe008503d680 curthread = 0xfffff8025f2f5000: pid 85395 tid 100277 "swap" curpcb = 0xfffffe00aca9fb80 fpcurthread = 0xfffff8025f2f5000: pid 85395 "swap" idlethread = 0xfffff800036cc5a0: tid 100012 "idle: cpu9" curpmap = 0xfffff801ac3e7138 tssp = 0xffffffff821cc848 commontssp = 0xffffffff821cc848 rsp0 = 0xfffffe00aca9fb80 gs32p = 0xffffffff821d3480 ldt = 0xffffffff821d34c0 tss = 0xffffffff821d34b0 tlb gen = 130973918 curvnet = 0 spin locks held: cpuid = 10 dynamic pcpu = 0xfffffe0085049680 curthread = 0xfffff8000a6ab000: pid 85397 tid 100219 "swap" curpcb = 0xfffffe00aa9b6b80 fpcurthread = 0xfffff8000a6ab000: pid 85397 "swap" idlethread = 0xfffff800036cc000: tid 100013 "idle: cpu10" curpmap = 0xfffff807164d0138 tssp = 0xffffffff821cc8b0 commontssp = 0xffffffff821cc8b0 rsp0 = 0xfffffe00aa9b6b80 gs32p = 0xffffffff821d34e8 ldt = 0xffffffff821d3528 tss = 0xffffffff821d3518 tlb gen = 130968084 curvnet = 0 spin locks held: cpuid = 11 dynamic pcpu = 0xfffffe0085055680 curthread = 0xfffff8000a6b55a0: pid 32 tid 100139 "bufspacedaemon-6" curpcb = 0xfffffe00a39f3b80 fpcurthread = none idlethread = 0xfffff800036cb5a0: tid 100014 "idle: cpu11" curpmap = 0xffffffff82094da0 tssp = 0xffffffff821cc918 commontssp = 0xffffffff821cc918 rsp0 = 0xfffffe00a39f3b80 gs32p = 0xffffffff821d3550 ldt = 0xffffffff821d3590 tss = 0xffffffff821d3580 tlb gen = 130973284 curvnet = 0 spin locks held: db:1:pho1> show alllocks Process 87724 (rm) thread 0xfffff800037a65a0 (100196) exclusive rw Per-Filesystem Softdep Lock (Per-Filesystem Softdep Lock) r = 0 (0xfffff80112e6cc00) locked @ ufs/ffs/ffs_softdep.c:11050 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe000222a3f0) locked @ ufs/ffs/ffs_vnops.c:282 exclusive lockmgr ufs (ufs) r = 0 (0xfffff806b66d7068) locked @ kern/vfs_subr.c:2590 Process 87723 (ls) thread 0xfffff800216bf000 (100177) shared lockmgr ufs (ufs) r = 0 (0xfffff8076ab002e0) locked @ kern/vfs_lookup.c:713 Process 85397 (swap) thread 0xfffff8000a6ab000 (100219) exclusive rw vm object (vm object) r = 0 (0xfffff801ac3d8d00) locked @ vm/vm_fault.c:630 shared sx vm map (user) (vm map (user)) r = 0 (0xfffff807164d0078) locked @ vm/vm_map.c:4197 Process 34 (syncer) thread 0xfffff8000a68a5a0 (100141) exclusive lockmgr ufs (ufs) r = 0 (0xfffff8000ae61558) locked @ kern/vfs_subr.c:2590 exclusive lockmgr syncer (syncer) r = 0 (0xfffff805f6703068) locked @ kern/vfs_subr.c:2170 Process 32 (bufdaemon) thread 0xfffff8000a6b55a0 (100139) exclusive sleep mutex vm inactive pagequeue (vm pagequeue) r = 0 (0xffffffff820c4f80) locked @ vm/vm_page.c:3194 exclusive sleep mutex vm page (vm page) r = 0 (0xffffffff81a47680) locked @ kern/vfs_bio.c:2908 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0004cc9b10) locked @ kern/vfs_bio.c:1738 Process 30 (pagedaemon) thread 0xfffff8000a3a05a0 (100128) exclusive sleep mutex pmap (pmap) r = 0 (0xfffff8011f212138) locked @ amd64/amd64/pmap.c:6757 exclusive rw pmap pv list (pmap pv list) r = 0 (0xffffffff81a49a80) locked @ amd64/amd64/pmap.c:6642 exclusive sleep mutex vm page (vm page) r = 0 (0xffffffff81a47580) locked @ vm/vm_page.c:1103 Process 0 (kernel) thread 0xfffff800036cb000 (100015) exclusive sleep mutex kernel arena domain (kernel arena domain) r = 0 (0xfffff80003007000) locked @ kern/subr_vmem.c:763 exclusive sleep mutex vmem list lock (vmem list lock) r = 0 (0xffffffff81a02500) locked @ kern/subr_vmem.c:758 db:1:pho1> show lockedvnods Locked vnodes vnode 0xfffff8076ab00278: tag ufs, type VDIR usecount 3, writecount 0, refcount 6 mountedhere 0 flags (VV_ROOT|VI_ACTIVE) v_object 0xfffff802ca096e00 ref 0 pages 1 cleanbuf 1 dirtybuf 0 lock type ufs: SHARED (count 1) #0 0xffffffff80bb66ac at lockmgr_slock_hard+0x34c #1 0xffffffff80bb7355 at __lockmgr_args+0x745 #2 0xffffffff80f080ac at ffs_lock+0x7c #3 0xffffffff8124d520 at VOP_LOCK1_APV+0x70 #4 0xffffffff80cc6a05 at _vn_lock+0x65 #5 0xffffffff80cb4e46 at vget+0xa6 #6 0xffffffff80ca6b7c at vfs_hash_get+0xcc #7 0xffffffff80f039ef at ffs_vgetf+0x3f #8 0xffffffff80f16092 at ufs_root+0x22 #9 0xffffffff80ca92f9 at lookup+0x7f9 #10 0xffffffff80ca8571 at namei+0x501 #11 0xffffffff80cbfbc0 at kern_unlinkat+0x80 #12 0xffffffff810c7eb1 at amd64_syscall+0x291 #13 0xffffffff810a1bed at fast_syscall_common+0x101 ino 2, on dev md10a vnode 0xfffff805f6703000: tag syncer, type VNON usecount 1, writecount 0, refcount 2 flags (VI_ACTIVE) lock type syncer: EXCL by thread 0xfffff8000a68a5a0 (pid 34, syncer, tid 100141) #0 0xffffffff80bb62d6 at lockmgr_lock_fast_path+0x1c6 #1 0xffffffff8124d520 at VOP_LOCK1_APV+0x70 #2 0xffffffff80cc6a05 at _vn_lock+0x65 #3 0xffffffff80cb9dd6 at sched_sync+0x256 #4 0xffffffff80ba19b4 at fork_exit+0x84 #5 0xffffffff810a22fe at fork_trampoline+0xe vnode 0xfffff8000ae614f0: tag ufs, type VREG usecount 3, writecount 2, refcount 7402 flags (VI_ACTIVE) v_object 0xfffff801ac30a900 ref 1 pages 262216 cleanbuf 6605 dirtybuf 792 lock type ufs: EXCL by thread 0xfffff8000a68a5a0 (pid 34, syncer, tid 100141) with shared waiters pending #0 0xffffffff80bb6aae at lockmgr_xlock_hard+0x39e #1 0xffffffff80bb7203 at __lockmgr_args+0x5f3 #2 0xffffffff80f080ac at ffs_lock+0x7c #3 0xffffffff8124d520 at VOP_LOCK1_APV+0x70 #4 0xffffffff80cc6a05 at _vn_lock+0x65 #5 0xffffffff80cb4e46 at vget+0xa6 #6 0xffffffff80cb7026 at vfs_msync+0xa6 #7 0xffffffff80cbbfe5 at sync_fsync+0xc5 #8 0xffffffff8124c358 at VOP_FSYNC_APV+0x88 #9 0xffffffff80cb9e04 at sched_sync+0x284 #10 0xffffffff80ba19b4 at fork_exit+0x84 #11 0xffffffff810a22fe at fork_trampoline+0xe ino 4, on dev md10a vnode 0xfffff806b66d7000: tag ufs, type VDIR usecount 1, writecount 0, refcount 3 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff805d1dd1900 ref 0 pages 1 cleanbuf 1 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff800037a65a0 (pid 87724, rm, tid 100196) #0 0xffffffff80bb66ac at lockmgr_slock_hard+0x34c #1 0xffffffff80bb7355 at __lockmgr_args+0x745 #2 0xffffffff80f080ac at ffs_lock+0x7c #3 0xffffffff8124d520 at VOP_LOCK1_APV+0x70 #4 0xffffffff80cc6a05 at _vn_lock+0x65 #5 0xffffffff80cb4e46 at vget+0xa6 #6 0xffffffff80c9a5b2 at cache_lookup+0x582 #7 0xffffffff80c9f29c at vfs_cache_lookup+0xac #8 0xffffffff8124a6e6 at VOP_LOOKUP_APV+0x86 #9 0xffffffff80ca9101 at lookup+0x601 #10 0xffffffff80ca8571 at namei+0x501 #11 0xffffffff80cbfbc0 at kern_unlinkat+0x80 #12 0xffffffff810c7eb1 at amd64_syscall+0x291 #13 0xffffffff810a1bed at fast_syscall_common+0x101 ino 3, on dev md10a db:1:pho1> show allchains chain 1: thread 100177 (pid 87723, ls) blocked on lockmgr ufsEXCL thread 100141 (pid 34, syncer) is on a run queue chain 2: thread 100179 (pid 87722, sh) sleeping on 0xfffff800216ba000 "wait" chain 3: thread 100323 (pid 87721, sh) sleeping on 0xfffff8000adb98e8 "piperd" chain 4: thread 100170 (pid 87720, sed) sleeping on 0xfffff8000adb9be0 "piperd" chain 5: thread 100194 (pid 87719, sed) sleeping on 0xfffff8000ae00000 "piperd" chain 6: thread 100281 (pid 85403, swap) sleeping on 0xfffff800217e168c "swread" chain 7: thread 100171 (pid 85390, swap) sleeping on 0xfffff801ac32738c "swread" chain 8: thread 100195 (pid 85388, swap) sleeping on 0xfffff806e384958c "swread" chain 9: thread 100236 (pid 85385, swap) sleeping on 0xfffff8000ae22000 "wait" chain 10: thread 100231 (pid 85382, swap) sleeping on 0xffffffff81e9d03b "nanslp" chain 11: thread 100390 (pid 85374, md10) sleeping on 0xfffff80346fb1000 "mdwait" chain 12: thread 100333 (pid 85356, sh) blocked on lockmgr 0EXCL thread 0 (pid -512, ) is inactive chain 13: thread 100164 (pid 85355, tee) sleeping on 0xfffff80468e598e8 "piperd" chain 14: thread 100252 (pid 85354, sh) sleeping on 0xfffff80003f9e530 "wait" chain 15: thread 100143 (pid 4775, csh) sleeping on 0xfffff8000ad778b0 "ttyin" chain 16: thread 100254 (pid 4774, su) sleeping on 0xfffff800210b8a60 "wait" chain 17: thread 100253 (pid 4773, bash) sleeping on 0xfffff800210b9000 "wait" chain 18: thread 100256 (pid 4772, sshd) sleeping on 0xfffff800036b08c0 "select" chain 19: thread 100270 (pid 4711, sshd) sleeping on 0xfffff800036b07c0 "select" chain 20: thread 100234 (pid 2444, sh) sleeping on 0xfffff8000adba000 "piperd" chain 21: thread 100233 (pid 2442, awk) sleeping on 0xfffff8000a976000 "piperd" chain 22: thread 100203 (pid 2441, sh) sleeping on 0xfffff8013e71a530 "wait" chain 23: thread 100224 (pid 2406, sh) sleeping on 0xfffff80003f9ea60 "wait" chain 24: thread 100205 (pid 2334, sh) sleeping on 0xfffff80003f9fa60 "wait" chain 25: thread 100201 (pid 2333, bash) sleeping on 0xfffff8000add2530 "wait" chain 26: thread 100174 (pid 2331, csh) sleeping on 0xfffff8000acc70a8 "pause" chain 27: thread 100197 (pid 2330, su) sleeping on 0xfffff8000acc6530 "wait" chain 28: thread 100154 (pid 2329, bash) sleeping on 0xfffff8000ae23a60 "wait" chain 29: thread 100206 (pid 2328, sshd) sleeping on 0xfffff80003ffb540 "select" chain 30: thread 100215 (pid 2325, sshd) sleeping on 0xfffff80006008540 "select" chain 31: thread 100145 (pid 2321, csh) sleeping on 0xfffff800060658b0 "ttyin" chain 32: thread 100214 (pid 2320, login) sleeping on 0xfffff8013eba5530 "wait" chain 33: thread 100213 (pid 2319, getty) sleeping on 0xfffff80006065cb0 "ttyin" chain 34: thread 100212 (pid 2318, getty) sleeping on 0xfffff8000a4cb0b0 "ttyin" chain 35: thread 100211 (pid 2317, getty) sleeping on 0xfffff8000a4cb4b0 "ttyin" chain 36: thread 100149 (pid 2316, getty) sleeping on 0xfffff8000a4cb8b0 "ttyin" chain 37: thread 100207 (pid 2315, getty) sleeping on 0xfffff8000a4cbcb0 "ttyin" chain 38: thread 100208 (pid 2314, getty) sleeping on 0xfffff8000a4cd0b0 "ttyin" chain 39: thread 100209 (pid 2313, getty) sleeping on 0xfffff8000a4cd4b0 "ttyin" chain 40: thread 100210 (pid 2312, getty) sleeping on 0xfffff8000a4cd8b0 "ttyin" chain 41: thread 100142 (pid 2311, getty) sleeping on 0xfffff8000a4cdcb0 "ttyin" chain 42: thread 100182 (pid 2265, cron) sleeping on 0xffffffff81e9d030 "nanslp" chain 43: thread 100193 (pid 2261, sshd) sleeping on 0xfffff80021760d40 "select" chain 44: thread 100200 (pid 2182, NLM: master) sleeping on 0xfffff8013e8d0660 "rpcsvc" chain 45: thread 100181 (pid 2179, rpc.statd) sleeping on 0xfffff800060144c0 "select" chain 46: thread 100156 (pid 2133, watchdogd) sleeping on 0xfffff8000a395000 "wait" chain 47: thread 100178 (pid 2054, rpcbind) sleeping on 0xfffff80003d123c0 "select" chain 48: thread 100192 (pid 2044, syslogd) sleeping on 0xfffff80003d12440 "select" chain 49: thread 100165 (pid 1973, devd) sleeping on 0xfffff8002102be40 "select" chain 50: thread 100152 (pid 1968, dhclient) sleeping on 0xfffff800060089c0 "select" chain 51: thread 100151 (pid 1924, dhclient) sleeping on 0xfffff800060086c0 "select" chain 52: thread 100168 (pid 1921, dhclient) sleeping on 0xfffff800060088c0 "select" chain 53: thread 100140 (pid 33, vnlru) sleeping on 0xfffff8000a39e000 "vlruwt" chain 54: thread 100130 (pid 32, bufdaemon) sleeping on 0xffffffff8203e928 "qsleep" chain 55: thread 100133 (pid 32, bufspacedaemon-0) sleeping on 0xffffffff81a0a880 "-" chain 56: thread 100134 (pid 32, bufspacedaemon-1) sleeping on 0xffffffff81a12b40 "-" chain 57: thread 100135 (pid 32, bufspacedaemon-2) sleeping on 0xffffffff81a1ae00 "-" chain 58: thread 100136 (pid 32, bufspacedaemon-3) sleeping on 0xffffffff81a230c0 "-" chain 59: thread 100137 (pid 32, bufspacedaemon-4) sleeping on 0xffffffff81a2b380 "-" chain 60: thread 100138 (pid 32, bufspacedaemon-5) sleeping on 0xffffffff81a33640 "-" chain 61: thread 100153 (pid 32, / worker) sleeping on 0xfffff8000366cce8 "sdflush" chain 62: thread 100202 (pid 32, /tmp worker) sleeping on 0xfffff8000366c8e8 "sdflush" chain 63: thread 100537 (pid 32, /mnt worker) sleeping on 0xfffff80112e6cce8 "sdflush" chain 64: thread 100131 (pid 30, laundry: dom0) sleeping on 0xffffffff820576a4 "swbufa" chain 65: thread 100132 (pid 30, uma) sleeping on 0xffffffff80f25c60 "umarcl" chain 66: thread 100127 (pid 29, enc_daemon1) sleeping on 0xfffff8000a2a1000 "idle" chain 67: thread 100126 (pid 28, enc_daemon0) sleeping on 0xfffff8000a2a1530 "idle" chain 68: thread 100123 (pid 27, rand_harvestq) sleeping on 0xffffffff81cfc6a8 "-" chain 69: thread 100119 (pid 26, sctp_iterator) sleeping on 0xffffffff820c3c80 "waiting_for_work" chain 70: thread 100118 (pid 25, soaiod4) sleeping on 0xffffffff8203e31c "-" chain 71: thread 100117 (pid 24, soaiod3) sleeping on 0xffffffff8203e31c "-" chain 72: thread 100116 (pid 23, soaiod2) sleeping on 0xffffffff8203e31c "-" chain 73: thread 100115 (pid 22, soaiod1) sleeping on 0xffffffff8203e31c "-" chain 74: thread 100096 (pid 21, usbus0) sleeping on 0xfffffe009a1aa460 "-" chain 75: thread 100097 (pid 21, usbus0) sleeping on 0xfffffe009a1aa4b8 "-" chain 76: thread 100098 (pid 21, usbus0) sleeping on 0xfffffe009a1aa510 "-" chain 77: thread 100099 (pid 21, usbus0) sleeping on 0xfffffe009a1aa568 "-" chain 78: thread 100100 (pid 21, usbus0) sleeping on 0xfffffe009a1aa5c0 "-" chain 79: thread 100102 (pid 21, usbus1) sleeping on 0xfffffe0006dd6d10 "-" chain 80: thread 100103 (pid 21, usbus1) sleeping on 0xfffffe0006dd6d68 "-" chain 81: thread 100104 (pid 21, usbus1) sleeping on 0xfffffe0006dd6dc0 "-" chain 82: thread 100105 (pid 21, usbus1) sleeping on 0xfffffe0006dd6e18 "-" chain 83: thread 100106 (pid 21, usbus1) sleeping on 0xfffffe0006dd6e70 "-" chain 84: thread 100107 (pid 21, usbus2) sleeping on 0xfffffe009a63bd10 "-" chain 85: thread 100108 (pid 21, usbus2) sleeping on 0xfffffe009a63bd68 "-" chain 86: thread 100109 (pid 21, usbus2) sleeping on 0xfffffe009a63bdc0 "-" chain 87: thread 100110 (pid 21, usbus2) sleeping on 0xfffffe009a63be18 "-" chain 88: thread 100111 (pid 21, usbus2) sleeping on 0xfffffe009a63be70 "-" chain 89: thread 100091 (pid 20, doneq0) sleeping on 0xffffffff81bd7940 "-" chain 90: thread 100092 (pid 20, doneq1) sleeping on 0xffffffff81bd79c0 "-" chain 91: thread 100093 (pid 20, doneq2) sleeping on 0xffffffff81bd7a40 "-" chain 92: thread 100125 (pid 20, scanner) sleeping on 0xffffffff81bd7808 "-" chain 93: thread 100090 (pid 19, crypto returns 11) sleeping on 0xfffff80003937450 "crypto_ret_wait" chain 94: thread 100089 (pid 18, crypto returns 10) sleeping on 0xfffff800039373f0 "crypto_ret_wait" chain 95: thread 100088 (pid 17, crypto returns 9) sleeping on 0xfffff80003937390 "crypto_ret_wait" chain 96: thread 100087 (pid 16, crypto returns 8) sleeping on 0xfffff80003937330 "crypto_ret_wait" chain 97: thread 100086 (pid 15, crypto returns 7) sleeping on 0xfffff800039372d0 "crypto_ret_wait" chain 98: thread 100085 (pid 9, crypto returns 6) sleeping on 0xfffff80003937270 "crypto_ret_wait" chain 99: thread 100084 (pid 8, crypto returns 5) sleeping on 0xfffff80003937210 "crypto_ret_wait" chain 100: thread 100083 (pid 7, crypto returns 4) sleeping on 0xfffff800039371b0 "crypto_ret_wait" chain 101: thread 100082 (pid 6, crypto returns 3) sleeping on 0xfffff80003937150 "crypto_ret_wait" chain 102: thread 100081 (pid 5, crypto returns 2) sleeping on 0xfffff800039370f0 "crypto_ret_wait" chain 103: thread 100080 (pid 4, crypto returns 1) sleeping on 0xfffff80003937090 "crypto_ret_wait" chain 104: thread 100079 (pid 3, crypto returns 0) sleeping on 0xfffff80003937030 "crypto_ret_wait" chain 105: thread 100078 (pid 2, crypto) sleeping on 0xffffffff82055db0 "crypto_wait" chain 106: thread 100065 (pid 14, sequencer 00) sleeping on 0xfffff800038a7c88 "seqstate" chain 107: thread 100061 (pid 13, g_event) sleeping on 0xffffffff82094140 "-" chain 108: thread 100062 (pid 13, g_up) sleeping on 0xffffffff82094150 "-" chain 109: thread 100063 (pid 13, g_down) sleeping on 0xffffffff82094138 "-" chain 110: thread 100002 (pid 1, init) sleeping on 0xfffff800036b7530 "wait" chain 111: thread 100001 (pid 10, audit) sleeping on 0xffffffff820c49a0 "audit_worker_cv" chain 112: thread 100000 (pid 0, swapper) sleeping on 0xfffff80003678b8c "swread" chain 113: thread 100017 (pid 0, config_0) sleeping on 0xfffff8000369db00 "-" chain 114: thread 100018 (pid 0, kqueue_ctx taskq) sleeping on 0xfffff80003128a00 "-" chain 115: thread 100019 (pid 0, aiod_kick taskq) sleeping on 0xfffff80003128900 "-" chain 116: thread 100022 (pid 0, if_config_tqg_0) sleeping on 0xfffff8000369d800 "-" chain 117: thread 100023 (pid 0, softirq_0) sleeping on 0xfffff8000369d700 "-" chain 118: thread 100024 (pid 0, softirq_1) sleeping on 0xfffff8000369d600 "-" chain 119: thread 100025 (pid 0, softirq_2) sleeping on 0xfffff8000369d500 "-" chain 120: thread 100026 (pid 0, softirq_3) sleeping on 0xfffff8000369d400 "-" chain 121: thread 100027 (pid 0, softirq_4) sleeping on 0xfffff8000369d300 "-" chain 122: thread 100028 (pid 0, softirq_5) sleeping on 0xfffff8000369d200 "-" chain 123: thread 100029 (pid 0, softirq_6) sleeping on 0xfffff8000369d100 "-" chain 124: thread 100030 (pid 0, softirq_7) sleeping on 0xfffff8000369d000 "-" chain 125: thread 100031 (pid 0, softirq_8) sleeping on 0xfffff8000372b100 "-" chain 126: thread 100032 (pid 0, softirq_9) sleeping on 0xfffff8000372b000 "-" chain 127: thread 100033 (pid 0, softirq_10) sleeping on 0xfffff8000372ae00 "-" chain 128: thread 100034 (pid 0, softirq_11) sleeping on 0xfffff8000372ad00 "-" chain 129: thread 100035 (pid 0, if_io_tqg_0) sleeping on 0xfffff8000372ac00 "-" chain 130: thread 100036 (pid 0, if_io_tqg_1) sleeping on 0xfffff8000372ab00 "-" chain 131: thread 100037 (pid 0, if_io_tqg_2) sleeping on 0xfffff8000372aa00 "-" chain 132: thread 100038 (pid 0, if_io_tqg_3) sleeping on 0xfffff8000372a900 "-" chain 133: thread 100039 (pid 0, if_io_tqg_4) sleeping on 0xfffff8000372a800 "-" chain 134: thread 100040 (pid 0, if_io_tqg_5) sleeping on 0xfffff8000372a700 "-" chain 135: thread 100041 (pid 0, if_io_tqg_6) sleeping on 0xfffff8000372a600 "-" chain 136: thread 100042 (pid 0, if_io_tqg_7) sleeping on 0xfffff8000372a500 "-" chain 137: thread 100043 (pid 0, if_io_tqg_8) sleeping on 0xfffff8000372a400 "-" chain 138: thread 100044 (pid 0, if_io_tqg_9) sleeping on 0xfffff8000372a300 "-" chain 139: thread 100045 (pid 0, if_io_tqg_10) sleeping on 0xfffff8000372a200 "-" chain 140: thread 100046 (pid 0, if_io_tqg_11) sleeping on 0xfffff8000372a100 "-" chain 141: thread 100064 (pid 0, firmware taskq) sleeping on 0xfffff800038a1100 "-" chain 142: thread 100066 (pid 0, crypto_0) sleeping on 0xfffff800038a0e00 "-" chain 143: thread 100067 (pid 0, crypto_1) sleeping on 0xfffff800038a0e00 "-" chain 144: thread 100068 (pid 0, crypto_2) sleeping on 0xfffff800038a0e00 "-" chain 145: thread 100069 (pid 0, crypto_3) sleeping on 0xfffff800038a0e00 "-" chain 146: thread 100070 (pid 0, crypto_4) sleeping on 0xfffff800038a0e00 "-" chain 147: thread 100071 (pid 0, crypto_5) sleeping on 0xfffff800038a0e00 "-" chain 148: thread 100072 (pid 0, crypto_6) sleeping on 0xfffff800038a0e00 "-" chain 149: thread 100073 (pid 0, crypto_7) sleeping on 0xfffff800038a0e00 "-" chain 150: thread 100074 (pid 0, crypto_8) sleeping on 0xfffff800038a0e00 "-" chain 151: thread 100075 (pid 0, crypto_9) sleeping on 0xfffff800038a0e00 "-" chain 152: thread 100076 (pid 0, crypto_10) sleeping on 0xfffff800038a0e00 "-" chain 153: thread 100077 (pid 0, crypto_11) sleeping on 0xfffff800038a0e00 "-" chain 154: thread 100114 (pid 0, mca taskq) blocked on lockmgr (null)EXCL KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00aa9479e0 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00aa9479f0 trap() at trap+0x5b/frame 0xfffffe00aa947b00 calltrap() at calltrap+0x8/frame 0xfffffe00aa947b00 --- trap 0xc, rip = 0xffffffff80c4268a, rsp = 0xfffffe00aa947bd0, rbp = 0xfffffe00aa947bf0 --- print_lockchain() at print_lockchain+0x3a/frame 0xfffffe00aa947bf0 db_show_allchains() at db_show_allchains+0x80/frame 0xfffffe00aa947c20 db_command() at db_command+0x279/frame 0xfffffe00aa947cf0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00aa947d90 db_command() at db_command+0x279/frame 0xfffffe00aa947e60 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00aa947f00 db_command() at db_command+0x279/frame 0xfffffe00aa947fd0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00aa947fe0 db_trap() at db_trap+0xef/frame 0xfffffe00aa948070 kdb_trap() at kdb_trap+0x174/frame 0xfffffe00aa9480e0 trap() at trap+0x80b/frame 0xfffffe00aa9481f0 calltrap() at calltrap+0x8/frame 0xfffffe00aa9481f0 --- trap 0x3, rip = 0xffffffff80c29dfb, rsp = 0xfffffe00aa9482c0, rbp = 0xfffffe00aa9482d0 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00aa9482d0 vpanic() at vpanic+0x1d1/frame 0xfffffe00aa948330 panic() at panic+0x43/frame 0xfffffe00aa948390 handle_written_filepage() at handle_written_filepage+0x3e/frame 0xfffffe00aa948400 softdep_disk_write_complete() at softdep_disk_write_complete+0xdd/frame 0xfffffe00aa9484a0 bufdone() at bufdone+0x3bb/frame 0xfffffe00aa948520 ufs_strategy() at ufs_strategy+0x83/frame 0xfffffe00aa948550 VOP_STRATEGY_APV() at VOP_STRATEGY_APV+0x90/frame 0xfffffe00aa948570 bufstrategy() at bufstrategy+0x44/frame 0xfffffe00aa9485a0 bufwrite() at bufwrite+0x249/frame 0xfffffe00aa9485f0 ffs_syncvnode() at ffs_syncvnode+0x2ae/frame 0xfffffe00aa948670 ffs_fsync() at ffs_fsync+0x22/frame 0xfffffe00aa9486b0 VOP_FSYNC_APV() at VOP_FSYNC_APV+0x88/frame 0xfffffe00aa9486d0 ufs_remove() at ufs_remove+0xdf/frame 0xfffffe00aa948730 VOP_REMOVE_APV() at VOP_REMOVE_APV+0xac/frame 0xfffffe00aa948750 kern_unlinkat() at kern_unlinkat+0x1e7/frame 0xfffffe00aa948990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa948ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa948ab0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x800415e9a, rsp = 0x7fffffffe4b8, rbp = 0x7fffffffe5d0 --- Script command 'show allchains' returned error db:1:pho1> show mount 0xfffff8000a666000 /dev/gpt/work on / (ufs) 0xfffff8000a667000 devfs on /dev (devfs) 0xfffff8000a665000 /dev/gpt/tmp on /tmp (ufs) 0xfffff801ac4a2000 /dev/md10a on /mnt (ufs) More info: show mount db:1:pho1> show bufqueues bqempty: 90060 Buf domain 0 freebufs 15075 lofreebufs 219 hifreebufs 329 bufspace 1294336 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 4 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 42 (786432) dirtyq count 4 (114688) wakeup 0 lim 25 CPU 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, Locked buffers: 11 space 360448 Total buffers: 436 space 1294336 Buf domain 1 freebufs 14573 lofreebufs 219 hifreebufs 329 bufspace 17698816 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 16 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 523 (16523264) dirtyq count 16 (495616) wakeup 0 lim 25 CPU 0, 0, 0, 0, 0, 0, 0, 19, 2, 0, 0, 0, Locked buffers: 0 space 0 Total buffers: 582 space 17698816 Buf domain 2 freebufs 15105 lofreebufs 219 hifreebufs 329 bufspace 499712 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 1 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 21 (364544) dirtyq count 2 (12288) wakeup 0 lim 25 CPU 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 2, 2, Locked buffers: 1 space 4096 Total buffers: 31166 space 499712 Buf domain 3 freebufs 15076 lofreebufs 219 hifreebufs 329 bufspace 1277952 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 1 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 56 (1273856) dirtyq count 1 (4096) wakeup 0 lim 25 CPU 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, Locked buffers: 0 space 0 Total buffers: 57 space 1277952 Buf domain 4 freebufs 7877 lofreebufs 219 hifreebufs 329 bufspace 237707264 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 13 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 7074 (231800832) dirtyq count 13 (368640) wakeup 0 lim 25 CPU 15, 2, 16, 8, 23, 3, 24, 14, 16, 8, 18, 22, Locked buffers: 0 space 0 Total buffers: 31763 space 237707264 Buf domain 5 freebufs 15054 lofreebufs 219 hifreebufs 329 bufspace 2011136 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 2 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 76 (1974272) dirtyq count 2 (28672) wakeup 0 lim 25 CPU 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, Locked buffers: 0 space 0 Total buffers: 2878 space 2011136 Buf domain 6 freebufs 7727 lofreebufs 219 hifreebufs 329 bufspace 242515968 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 792 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 6485 (212336640) dirtyq count 796 (26083328) wakeup 0 lim 25 CPU 19, 5, 1, 9, 4, 9, 0, 20, 9, 11, 19, 18, Locked buffers: 5 space 163840 Total buffers: 39049 space 242515968 db:1:pho1> show page vm_cnt.v_free_count: 61701 vm_cnt.v_inactive_count: 176911 vm_cnt.v_active_count: 7310471 vm_cnt.v_laundry_count: 363012 vm_cnt.v_wire_count: 269337 vm_cnt.v_free_reserved: 10649 vm_cnt.v_free_min: 51289 vm_cnt.v_free_target: 173209 vm_cnt.v_inactive_target: 259813 db:1:pho1> show pageq pq_free 61701 dom 0 page_cnt 8128423 free 61701 pq_act 7310471 pq_inact 176911 pq_laund 363012 pq_unsw 0 db:0:pho> show freepages DOMAIN: 0 FREE LIST 0: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000000 | 000000 09 (002048K) | 000000 | 000000 08 (001024K) | 000002 | 000000 07 (000512K) | 000001 | 000001 06 (000256K) | 000001 | 000001 05 (000128K) | 000001 | 000001 04 (000064K) | 000000 | 000001 03 (000032K) | 000001 | 000001 02 (000016K) | 000000 | 000000 01 (000008K) | 000000 | 000001 00 (000004K) | 000001 | 000001 FREE LIST 1: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000000 | 000000 09 (002048K) | 000000 | 000000 08 (001024K) | 000000 | 000000 07 (000512K) | 000000 | 000000 06 (000256K) | 000000 | 000000 05 (000128K) | 000000 | 000000 04 (000064K) | 000000 | 000000 03 (000032K) | 000000 | 000000 02 (000016K) | 000000 | 000000 01 (000008K) | 000000 | 000000 00 (000004K) | 000000 | 000000 db:0:pho> acttrace Tracing command rm pid 87724 tid 100196 td 0xfffff800037a65a0 (CPU 3) kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00aa9482d0 vpanic() at vpanic+0x1d1/frame 0xfffffe00aa948330 panic() at panic+0x43/frame 0xfffffe00aa948390 handle_written_filepage() at handle_written_filepage+0x3e/frame 0xfffffe00aa948400 softdep_disk_write_complete() at softdep_disk_write_complete+0xdd/frame 0xfffffe00aa9484a0 bufdone() at bufdone+0x3bb/frame 0xfffffe00aa948520 ufs_strategy() at ufs_strategy+0x83/frame 0xfffffe00aa948550 VOP_STRATEGY_APV() at VOP_STRATEGY_APV+0x90/frame 0xfffffe00aa948570 bufstrategy() at bufstrategy+0x44/frame 0xfffffe00aa9485a0 bufwrite() at bufwrite+0x249/frame 0xfffffe00aa9485f0 ffs_syncvnode() at ffs_syncvnode+0x2ae/frame 0xfffffe00aa948670 ffs_fsync() at ffs_fsync+0x22/frame 0xfffffe00aa9486b0 VOP_FSYNC_APV() at VOP_FSYNC_APV+0x88/frame 0xfffffe00aa9486d0 ufs_remove() at ufs_remove+0xdf/frame 0xfffffe00aa948730 VOP_REMOVE_APV() at VOP_REMOVE_APV+0xac/frame 0xfffffe00aa948750 kern_unlinkat() at kern_unlinkat+0x1e7/frame 0xfffffe00aa948990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa948ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa948ab0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x800415e9a, rsp = 0x7fffffffe4b8, rbp = 0x7fffffffe5d0 --- Tracing command swap pid 85404 tid 100389 td 0xfffff801d11ea000 (CPU 0) cpustop_handler() at cpustop_handler+0x28/frame 0xffffffff8205fb30 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xffffffff8205fb50 trap() at trap+0x48/frame 0xffffffff8205fc60 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff8205fc60 --- trap 0x13, rip = 0xffffffff810a12cf, rsp = 0xfffffe00acbfdac0, rbp = 0x7fffffffe200 --- alltraps_pushregs_no_rax() at alltraps_pushregs_no_rax+0x4c/frame 0x7fffffffe200 Tracing command swap pid 85401 tid 100275 td 0xfffff8025f2f6000 (CPU 8) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006bc7df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006bc7e10 trap() at trap+0x48/frame 0xfffffe0006bc7f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bc7f20 --- trap 0x13, rip = 0x203709, rsp = 0x7fffffffe510, rbp = 0x7fffffffe530 --- Tracing command swap pid 85400 tid 100144 td 0xfffff800037a85a0 (CPU 7) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006bbbdf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006bbbe10 trap() at trap+0x48/frame 0xfffffe0006bbbf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bbbf20 --- trap 0x13, rip = 0xffffffff810ae8f6, rsp = 0xfffffe00aa7eeaa0, rbp = 0xfffffe00aa7eeab0 --- invlpg_invpcid_handler() at invlpg_invpcid_handler+0x66/frame 0xfffffe00aa7eeab0 Xinvlpg_invpcid() at Xinvlpg_invpcid+0xab/frame 0x7fffffffe530 Tracing command swap pid 85398 tid 100368 td 0xfffff806fd709000 (CPU 1) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006b73df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006b73e10 trap() at trap+0x48/frame 0xfffffe0006b73f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006b73f20 --- trap 0x13, rip = 0x203709, rsp = 0x7fffffffe510, rbp = 0x7fffffffe530 --- Tracing command swap pid 85397 tid 100219 td 0xfffff8000a6ab000 (CPU 10) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006bdfdf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006bdfe10 trap() at trap+0x48/frame 0xfffffe0006bdff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bdff20 --- trap 0x13, rip = 0xffffffff80f3dd00, rsp = 0xfffffe00aa9b6798, rbp = 0xfffffe00aa9b67d0 --- vm_object_set_writeable_dirty() at vm_object_set_writeable_dirty/frame 0xfffffe00aa9b67d0 vm_fault_hold() at vm_fault_hold+0x1980/frame 0xfffffe00aa9b6910 vm_fault() at vm_fault+0x60/frame 0xfffffe00aa9b6950 trap_pfault() at trap_pfault+0x189/frame 0xfffffe00aa9b69a0 trap() at trap+0x460/frame 0xfffffe00aa9b6ab0 calltrap() at calltrap+0x8/frame 0xfffffe00aa9b6ab0 --- trap 0xc, rip = 0x8004376c5, rsp = 0x7fffffffe1b8, rbp = 0x7fffffffe200 --- Tracing command swap pid 85396 tid 100173 td 0xfffff8000a6ab5a0 (CPU 2) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006b7fdf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006b7fe10 trap() at trap+0x48/frame 0xfffffe0006b7ff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006b7ff20 --- trap 0x13, rip = 0xffffffff80c3f622, rsp = 0xfffffe00aa899950, rbp = 0xfffffe00aa8999a0 --- userret() at userret+0x32/frame 0xfffffe00aa8999a0 trap() at trap+0x738/frame 0xfffffe00aa899ab0 calltrap() at calltrap+0x8/frame 0xfffffe00aa899ab0 --- trap 0xc, rip = 0x8004376c5, rsp = 0x7fffffffe1b8, rbp = 0x7fffffffe200 --- Tracing command swap pid 85395 tid 100277 td 0xfffff8025f2f5000 (CPU 9) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006bd3df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006bd3e10 trap() at trap+0x48/frame 0xfffffe0006bd3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bd3f20 --- trap 0x13, rip = 0x203709, rsp = 0x7fffffffe510, rbp = 0x7fffffffe530 --- Tracing command swap pid 85394 tid 100321 td 0xfffff801d10695a0 (CPU 4) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006b97df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006b97e10 trap() at trap+0x48/frame 0xfffffe0006b97f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006b97f20 --- trap 0x13, rip = 0x20370e, rsp = 0x7fffffffe510, rbp = 0x7fffffffe530 --- Tracing command bufdaemon pid 32 tid 100139 td 0xfffff8000a6b55a0 (CPU 11) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006bebdf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006bebe10 trap() at trap+0x48/frame 0xfffffe0006bebf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bebf20 --- trap 0x13, rip = 0xffffffff80f46cde, rsp = 0xfffffe00a39f3820, rbp = 0xfffffe00a39f3850 --- vm_pqbatch_process_page() at vm_pqbatch_process_page+0x25e/frame 0xfffffe00a39f3850 vm_pqbatch_submit_page() at vm_pqbatch_submit_page+0x23c/frame 0xfffffe00a39f38c0 vfs_vmio_unwire() at vfs_vmio_unwire+0x9c/frame 0xfffffe00a39f38e0 allocbuf() at allocbuf+0x4fd/frame 0xfffffe00a39f3960 brelse() at brelse+0x421/frame 0xfffffe00a39f39b0 buf_recycle() at buf_recycle+0x2bb/frame 0xfffffe00a39f3a10 bufspace_daemon() at bufspace_daemon+0xd1/frame 0xfffffe00a39f3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a39f3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a39f3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100128 td 0xfffff8000a3a05a0 (CPU 5) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006ba3df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006ba3e10 trap() at trap+0x48/frame 0xfffffe0006ba3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006ba3f20 --- trap 0x13, rip = 0xffffffff81240e48, rsp = 0xfffffe0006f2e520, rbp = 0xfffffe0006f2e580 --- smp_targeted_tlb_shootdown() at smp_targeted_tlb_shootdown+0x328/frame 0xfffffe0006f2e580 smp_masked_invlpg() at smp_masked_invlpg+0x3e/frame 0xfffffe0006f2e5b0 pmap_invalidate_page() at pmap_invalidate_page+0x160/frame 0xfffffe0006f2e620 pmap_ts_referenced() at pmap_ts_referenced+0x78d/frame 0xfffffe0006f2e6b0 vm_pageout_worker() at vm_pageout_worker+0xf54/frame 0xfffffe0006f2ea30 vm_pageout() at vm_pageout+0x156/frame 0xfffffe0006f2ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f2eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f2eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100015 td 0xfffff800036cb000 (CPU 6) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006bafdf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006bafe10 trap() at trap+0x48/frame 0xfffffe0006baff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006baff20 --- trap 0x13, rip = 0xffffffff80c47b80, rsp = 0xfffffe00767ae9a0, rbp = 0xfffffe00767ae9e0 --- vmem_periodic() at vmem_periodic+0x100/frame 0xfffffe00767ae9e0 taskqueue_run_locked() at taskqueue_run_locked+0x10c/frame 0xfffffe00767aea40 taskqueue_thread_loop() at taskqueue_thread_loop+0x88/frame 0xfffffe00767aea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00767aeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00767aeab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:pho> ps pid ppid pgrp uid state wmesg wchan cmd 87724 85356 2334 0 R+ CPU 3 rm 87723 87722 2133 0 D ufs 0xfffff8000ae61558 ls 87722 2133 2133 0 S wait 0xfffff800216ba000 sh 87721 2441 2406 0 S piperd 0xfffff8000adb98e8 sh 87720 2441 2406 0 S piperd 0xfffff8000adb9be0 sed 87719 2441 2406 0 S piperd 0xfffff8000ae00000 sed 87718 2441 2406 0 ?W vmstat 85405 85385 85382 0 R swap 85404 85385 85382 0 R CPU 0 swap 85403 85385 85382 0 D swread 0xfffff800217e168c swap 85402 85385 85382 0 R swap 85401 85385 85382 0 R CPU 8 swap 85400 85385 85382 0 R CPU 7 swap 85399 85385 85382 0 R swap 85398 85385 85382 0 R CPU 1 swap 85397 85385 85382 0 R CPU 10 swap 85396 85385 85382 0 R CPU 2 swap 85395 85385 85382 0 R CPU 9 swap 85394 85385 85382 0 R CPU 4 swap 85393 85385 85382 0 R swap 85392 85385 85382 0 R swap 85391 85385 85382 0 ?WL swap 85390 85385 85382 0 D swread 0xfffff801ac32738c swap 85389 85385 85382 0 ?W swap 85388 85385 85382 0 D swread 0xfffff806e384958c swap 85387 85385 85382 0 ?W swap 85386 85385 85382 0 ?W swap 85385 85382 85382 0 SW wait 0xfffff8000ae22000 swap 85383 85356 2334 0 R+ pageout 85382 1 85382 0 Ss nanslp 0xffffffff81e9d03b swap 85374 0 0 0 DL mdwait 0xfffff80346fb1000 [md10] 85356 85354 2334 0 S+ wait 0xfffff80112e6d000 sh 85355 2334 2334 0 S+ piperd 0xfffff80468e598e8 tee 85354 2334 2334 0 SW+ wait 0xfffff80003f9e530 sh 4775 4774 4775 0 S+ ttyin 0xfffff8000ad778b0 csh 4774 4773 4774 2006 SW+ wait 0xfffff800210b8a60 su 4773 4772 4773 2006 SWs+ wait 0xfffff800210b9000 bash 4772 4711 4711 2006 S select 0xfffff800036b08c0 sshd 4711 2261 4711 0 Ss select 0xfffff800036b07c0 sshd 2444 2406 2406 0 S piperd 0xfffff8000adba000 sh 2442 2406 2406 0 S piperd 0xfffff8000a976000 awk 2441 2406 2406 0 SW wait 0xfffff8013e71a530 sh 2406 1 2406 0 SWs wait 0xfffff80003f9ea60 sh 2334 2333 2334 0 SW+ wait 0xfffff80003f9fa60 sh 2333 2331 2333 0 SW+ wait 0xfffff8000add2530 bash 2331 2330 2331 0 SW+ pause 0xfffff8000acc70a8 csh 2330 2329 2330 2006 SW+ wait 0xfffff8000acc6530 su 2329 2328 2329 2006 SWs+ wait 0xfffff8000ae23a60 bash 2328 2325 2325 2006 S select 0xfffff80003ffb540 sshd 2325 2261 2325 0 Ss select 0xfffff80006008540 sshd 2321 2320 2321 0 S+ ttyin 0xfffff800060658b0 csh 2320 1 2320 0 SWs+ wait 0xfffff8013eba5530 login 2319 1 2319 0 Ss+ ttyin 0xfffff80006065cb0 getty 2318 1 2318 0 Ss+ ttyin 0xfffff8000a4cb0b0 getty 2317 1 2317 0 Ss+ ttyin 0xfffff8000a4cb4b0 getty 2316 1 2316 0 Ss+ ttyin 0xfffff8000a4cb8b0 getty 2315 1 2315 0 Ss+ ttyin 0xfffff8000a4cbcb0 getty 2314 1 2314 0 Ss+ ttyin 0xfffff8000a4cd0b0 getty 2313 1 2313 0 Ss+ ttyin 0xfffff8000a4cd4b0 getty 2312 1 2312 0 Ss+ ttyin 0xfffff8000a4cd8b0 getty 2311 1 2311 0 Ss+ ttyin 0xfffff8000a4cdcb0 getty 2265 1 2265 0 Ss nanslp 0xffffffff81e9d030 cron 2261 1 2261 0 Ss select 0xfffff80021760d40 sshd 2182 1 2182 0 Ss rpcsvc 0xfffff8013e8d0660 NLM: master 2179 1 2179 0 Ss select 0xfffff800060144c0 rpc.statd 2133 1 2133 0 Ss wait 0xfffff8000a395000 watchdogd 2054 1 2054 0 Ss select 0xfffff80003d123c0 rpcbind 2044 1 2044 0 Ss select 0xfffff80003d12440 syslogd 1973 1 1973 0 Ss select 0xfffff8002102be40 devd 1968 1 1968 65 Ss select 0xfffff800060089c0 dhclient 1924 1 1924 0 Ss select 0xfffff800060086c0 dhclient 1921 1 1921 0 Ss select 0xfffff800060088c0 dhclient 34 0 0 0 RL [syncer] 33 0 0 0 DL vlruwt 0xfffff8000a39e000 [vnlru] 32 0 0 0 RL (threaded) [bufdaemon] 100130 D qsleep 0xffffffff8203e928 [bufdaemon] 100133 D - 0xffffffff81a0a880 [bufspacedaemon-0] 100134 D - 0xffffffff81a12b40 [bufspacedaemon-1] 100135 D - 0xffffffff81a1ae00 [bufspacedaemon-2] 100136 D - 0xffffffff81a230c0 [bufspacedaemon-3] 100137 D - 0xffffffff81a2b380 [bufspacedaemon-4] 100138 D - 0xffffffff81a33640 [bufspacedaemon-5] 100139 Run CPU 11 [bufspacedaemon-6] 100153 D sdflush 0xfffff8000366cce8 [/ worker] 100202 D sdflush 0xfffff8000366c8e8 [/tmp worker] 100537 D sdflush 0xfffff80112e6cce8 [/mnt worker] 31 0 0 0 RL [vmdaemon] 30 0 0 0 RL (threaded) [pagedaemon] 100128 Run CPU 5 [dom0] 100131 D swbufa 0xffffffff820576a4 [laundry: dom0] 100132 D umarcl 0xffffffff80f25c60 [uma] 29 0 0 0 DL idle 0xfffff8000a2a1000 [enc_daemon1] 28 0 0 0 DL idle 0xfffff8000a2a1530 [enc_daemon0] 27 0 0 0 DL - 0xffffffff81cfc6a8 [rand_harvestq] 26 0 0 0 DL waiting 0xffffffff820c3c80 [sctp_iterator] 25 0 0 0 DL - 0xffffffff8203e31c [soaiod4] 24 0 0 0 DL - 0xffffffff8203e31c [soaiod3] 23 0 0 0 DL - 0xffffffff8203e31c [soaiod2] 22 0 0 0 DL - 0xffffffff8203e31c [soaiod1] 21 0 0 0 DL (threaded) [usb] 100096 D - 0xfffffe009a1aa460 [usbus0] 100097 D - 0xfffffe009a1aa4b8 [usbus0] 100098 D - 0xfffffe009a1aa510 [usbus0] 100099 D - 0xfffffe009a1aa568 [usbus0] 100100 D - 0xfffffe009a1aa5c0 [usbus0] 100102 D - 0xfffffe0006dd6d10 [usbus1] 100103 D - 0xfffffe0006dd6d68 [usbus1] 100104 D - 0xfffffe0006dd6dc0 [usbus1] 100105 D - 0xfffffe0006dd6e18 [usbus1] 100106 D - 0xfffffe0006dd6e70 [usbus1] 100107 D - 0xfffffe009a63bd10 [usbus2] 100108 D - 0xfffffe009a63bd68 [usbus2] 100109 D - 0xfffffe009a63bdc0 [usbus2] 100110 D - 0xfffffe009a63be18 [usbus2] 100111 D - 0xfffffe009a63be70 [usbus2] 20 0 0 0 DL (threaded) [cam] 100091 D - 0xffffffff81bd7940 [doneq0] 100092 D - 0xffffffff81bd79c0 [doneq1] 100093 D - 0xffffffff81bd7a40 [doneq2] 100125 D - 0xffffffff81bd7808 [scanner] 19 0 0 0 DL crypto_ 0xfffff80003937450 [crypto returns 11] 18 0 0 0 DL crypto_ 0xfffff800039373f0 [crypto returns 10] 17 0 0 0 DL crypto_ 0xfffff80003937390 [crypto returns 9] 16 0 0 0 DL crypto_ 0xfffff80003937330 [crypto returns 8] 15 0 0 0 DL crypto_ 0xfffff800039372d0 [crypto returns 7] 9 0 0 0 DL crypto_ 0xfffff80003937270 [crypto returns 6] 8 0 0 0 DL crypto_ 0xfffff80003937210 [crypto returns 5] 7 0 0 0 DL crypto_ 0xfffff800039371b0 [crypto returns 4] 6 0 0 0 DL crypto_ 0xfffff80003937150 [crypto returns 3] 5 0 0 0 DL crypto_ 0xfffff800039370f0 [crypto returns 2] 4 0 0 0 DL crypto_ 0xfffff80003937090 [crypto returns 1] 3 0 0 0 DL crypto_ 0xfffff80003937030 [crypto returns 0] 2 0 0 0 DL crypto_ 0xffffffff82055db0 [crypto] 14 0 0 0 DL seqstat 0xfffff800038a7c88 [sequencer 00] 13 0 0 0 DL (threaded) [geom] 100061 D - 0xffffffff82094140 [g_event] 100062 D - 0xffffffff82094150 [g_up] 100063 D - 0xffffffff82094138 [g_down] 12 0 0 0 WL (threaded) [intr] 100016 I [swi5: fast taskq] 100020 I [swi6: task queue] 100021 I [swi6: Giant taskq] 100047 I [swi4: clock (0)] 100048 I [swi4: clock (1)] 100049 I [swi4: clock (2)] 100050 I [swi4: clock (3)] 100051 I [swi4: clock (4)] 100052 I [swi4: clock (5)] 100053 I [swi4: clock (6)] 100054 I [swi4: clock (7)] 100055 I [swi4: clock (8)] 100056 I [swi4: clock (9)] 100057 I [swi4: clock (10)] 100058 I [swi4: clock (11)] 100059 I [swi3: vm] 100060 I [swi1: netisr 0] 100094 I [irq56: ahci0] 100095 I [irq19: xhci0] 100101 I [irq18: ehci0 ehci1] 100112 I [irq71: ahci1] 100113 I [swi0: uart uart] 100183 I [irq72: ioat0] 100184 I [irq73: ioat1] 100185 I [irq74: ioat2] 100186 I [irq75: ioat3] 100187 I [irq76: ioat4] 100188 I [irq77: ioat5] 100189 I [irq78: ioat6] 100190 I [irq79: ioat7] 11 0 0 0 RL (threaded) [idle] 100003 CanRun [idle: cpu0] 100004 CanRun [idle: cpu1] 100005 CanRun [idle: cpu2] 100006 CanRun [idle: cpu3] 100007 CanRun [idle: cpu4] 100008 CanRun [idle: cpu5] 100009 CanRun [idle: cpu6] 100010 CanRun [idle: cpu7] 100011 CanRun [idle: cpu8] 100012 CanRun [idle: cpu9] 100013 CanRun [idle: cpu10] 100014 CanRun [idle: cpu11] 1 0 1 0 SLs wait 0xfffff800036b7530 [init] 10 0 0 0 DL audit_w 0xffffffff820c49a0 [audit] 0 0 0 0 RLs (threaded) [kernel] 100000 D swread 0xfffff80003678b8c [swapper] 100015 Run CPU 6 [thread taskq] 100017 D - 0xfffff8000369db00 [config_0] 100018 D - 0xfffff80003128a00 [kqueue_ctx taskq] 100019 D - 0xfffff80003128900 [aiod_kick taskq] 100022 D - 0xfffff8000369d800 [if_config_tqg_0] 100023 D - 0xfffff8000369d700 [softirq_0] 100024 D - 0xfffff8000369d600 [softirq_1] 100025 D - 0xfffff8000369d500 [softirq_2] 100026 D - 0xfffff8000369d400 [softirq_3] 100027 D - 0xfffff8000369d300 [softirq_4] 100028 D - 0xfffff8000369d200 [softirq_5] 100029 D - 0xfffff8000369d100 [softirq_6] 100030 D - 0xfffff8000369d000 [softirq_7] 100031 D - 0xfffff8000372b100 [softirq_8] 100032 D - 0xfffff8000372b000 [softirq_9] 100033 D - 0xfffff8000372ae00 [softirq_10] 100034 D - 0xfffff8000372ad00 [softirq_11] 100035 D - 0xfffff8000372ac00 [if_io_tqg_0] 100036 D - 0xfffff8000372ab00 [if_io_tqg_1] 100037 D - 0xfffff8000372aa00 [if_io_tqg_2] 100038 D - 0xfffff8000372a900 [if_io_tqg_3] 100039 D - 0xfffff8000372a800 [if_io_tqg_4] 100040 D - 0xfffff8000372a700 [if_io_tqg_5] 100041 D - 0xfffff8000372a600 [if_io_tqg_6] 100042 D - 0xfffff8000372a500 [if_io_tqg_7] 100043 D - 0xfffff8000372a400 [if_io_tqg_8] 100044 D - 0xfffff8000372a300 [if_io_tqg_9] 100045 D - 0xfffff8000372a200 [if_io_tqg_10] 100046 D - 0xfffff8000372a100 [if_io_tqg_11] 100064 D - 0xfffff800038a1100 [firmware taskq] 100066 D - 0xfffff800038a0e00 [crypto_0] 100067 D - 0xfffff800038a0e00 [crypto_1] 100068 D - 0xfffff800038a0e00 [crypto_2] 100069 D - 0xfffff800038a0e00 [crypto_3] 100070 D - 0xfffff800038a0e00 [crypto_4] 100071 D - 0xfffff800038a0e00 [crypto_5] 100072 D - 0xfffff800038a0e00 [crypto_6] 100073 D - 0xfffff800038a0e00 [crypto_7] 100074 D - 0xfffff800038a0e00 [crypto_8] 100075 D - 0xfffff800038a0e00 [crypto_9] 100076 D - 0xfffff800038a0e00 [crypto_10] 100077 D - 0xfffff800038a0e00 [crypto_11] 100114 D - 0xfffff80006119200 [mca taskq] 100120 D - 0xfffff8000a3d9600 [acpi_task_0] 100121 D - 0xfffff8000a3d9600 [acpi_task_1] 100122 D - 0xfffff8000a3d9600 [acpi_task_2] 100124 D - 0xfffff800038a0c00 [CAM taskq] db:0:pho> allt Tracing command rm pid 87724 tid 100196 td 0xfffff800037a65a0 (CPU 3) kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00aa9482d0 vpanic() at vpanic+0x1d1/frame 0xfffffe00aa948330 panic() at panic+0x43/frame 0xfffffe00aa948390 handle_written_filepage() at handle_written_filepage+0x3e/frame 0xfffffe00aa948400 softdep_disk_write_complete() at softdep_disk_write_complete+0xdd/frame 0xfffffe00aa9484a0 bufdone() at bufdone+0x3bb/frame 0xfffffe00aa948520 ufs_strategy() at ufs_strategy+0x83/frame 0xfffffe00aa948550 VOP_STRATEGY_APV() at VOP_STRATEGY_APV+0x90/frame 0xfffffe00aa948570 bufstrategy() at bufstrategy+0x44/frame 0xfffffe00aa9485a0 bufwrite() at bufwrite+0x249/frame 0xfffffe00aa9485f0 ffs_syncvnode() at ffs_syncvnode+0x2ae/frame 0xfffffe00aa948670 ffs_fsync() at ffs_fsync+0x22/frame 0xfffffe00aa9486b0 VOP_FSYNC_APV() at VOP_FSYNC_APV+0x88/frame 0xfffffe00aa9486d0 ufs_remove() at ufs_remove+0xdf/frame 0xfffffe00aa948730 VOP_REMOVE_APV() at VOP_REMOVE_APV+0xac/frame 0xfffffe00aa948750 kern_unlinkat() at kern_unlinkat+0x1e7/frame 0xfffffe00aa948990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa948ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa948ab0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x800415e9a, rsp = 0x7fffffffe4b8, rbp = 0x7fffffffe5d0 --- Tracing command ls pid 87723 tid 100177 td 0xfffff800216bf000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00aa8ad130 mi_switch() at mi_switch+0x174/frame 0xfffffe00aa8ad160 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00aa8ad1a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00aa8ad1d0 sleeplk() at sleeplk+0x109/frame 0xfffffe00aa8ad230 lockmgr_slock_hard() at lockmgr_slock_hard+0x1db/frame 0xfffffe00aa8ad2c0 __lockmgr_args() at __lockmgr_args+0x745/frame 0xfffffe00aa8ad360 ffs_lock() at ffs_lock+0x7c/frame 0xfffffe00aa8ad3b0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x70/frame 0xfffffe00aa8ad3d0 _vn_lock() at _vn_lock+0x65/frame 0xfffffe00aa8ad430 vget() at vget+0xa6/frame 0xfffffe00aa8ad480 cache_lookup() at cache_lookup+0x582/frame 0xfffffe00aa8ad560 vfs_cache_lookup() at vfs_cache_lookup+0xac/frame 0xfffffe00aa8ad5c0 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x86/frame 0xfffffe00aa8ad5e0 lookup() at lookup+0x601/frame 0xfffffe00aa8ad680 namei() at namei+0x501/frame 0xfffffe00aa8ad770 kern_statat() at kern_statat+0x84/frame 0xfffffe00aa8ad890 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00aa8ad990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa8adab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa8adab0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x80049732a, rsp = 0x7fffffffe338, rbp = 0x7fffffffe3f0 --- Tracing command sh pid 87722 tid 100179 td 0xfffff800216be000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00aa8b7570 mi_switch() at mi_switch+0x174/frame 0xfffffe00aa8b75a0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00aa8b75e0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00aa8b7640 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aa8b7670 _sleep() at _sleep+0x2d0/frame 0xfffffe00aa8b7710 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00aa8b77a0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00aa8b7990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa8b7ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa8b7ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040d0da, rsp = 0x7fffffffe858, rbp = 0x7fffffffe910 --- Tracing command sh pid 87721 tid 100323 td 0xfffff801d11ed5a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00acb356b0 mi_switch() at mi_switch+0x174/frame 0xfffffe00acb356e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00acb35720 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00acb35780 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00acb357b0 _sleep() at _sleep+0x2d0/frame 0xfffffe00acb35850 pipe_read() at pipe_read+0x35a/frame 0xfffffe00acb358b0 dofileread() at dofileread+0x81/frame 0xfffffe00acb35900 kern_readv() at kern_readv+0x4a/frame 0xfffffe00acb35940 sys_read() at sys_read+0x86/frame 0xfffffe00acb35990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00acb35ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00acb35ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80047e06a, rsp = 0x7fffffffe078, rbp = 0x7fffffffe180 --- Tracing command sed pid 87720 tid 100170 td 0xfffff800211cc000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00aa87e6b0 mi_switch() at mi_switch+0x174/frame 0xfffffe00aa87e6e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00aa87e720 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00aa87e780 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aa87e7b0 _sleep() at _sleep+0x2d0/frame 0xfffffe00aa87e850 pipe_read() at pipe_read+0x35a/frame 0xfffffe00aa87e8b0 dofileread() at dofileread+0x81/frame 0xfffffe00aa87e900 kern_readv() at kern_readv+0x4a/frame 0xfffffe00aa87e940 sys_read() at sys_read+0x86/frame 0xfffffe00aa87e990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa87eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa87eab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80042406a, rsp = 0x7fffffffe3a8, rbp = 0x7fffffffe3c0 --- Tracing command sed pid 87719 tid 100194 td 0xfffff800037a75a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00aa9326b0 mi_switch() at mi_switch+0x174/frame 0xfffffe00aa9326e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00aa932720 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00aa932780 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aa9327b0 _sleep() at _sleep+0x2d0/frame 0xfffffe00aa932850 pipe_read() at pipe_read+0x35a/frame 0xfffffe00aa9328b0 dofileread() at dofileread+0x81/frame 0xfffffe00aa932900 kern_readv() at kern_readv+0x4a/frame 0xfffffe00aa932940 sys_read() at sys_read+0x86/frame 0xfffffe00aa932990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa932ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa932ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80042406a, rsp = 0x7fffffffe3d8, rbp = 0x7fffffffe3f0 --- Tracing command vmstat pid 87718 tid 100176 td 0xfffff800211c25a0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00aa947af0 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00aa947b00 trap() at trap+0x5b/frame 0xfffffe00aa947c10 calltrap() at calltrap+0x8/frame 0xfffffe00aa947c10 --- trap 0xc, rip = 0xffffffff8109f4d6, rsp = 0xfffffe00aa947ce0, rbp = 0xfffffe00aa947cf0 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00aa947cf0 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe00aa947d90 db_command() at db_command+0x279/frame 0xfffffe00aa947e60 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00aa947f00 db_command() at db_command+0x279/frame 0xfffffe00aa947fd0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00aa947fe0 db_trap() at db_trap+0xef/frame 0xfffffe00aa948070 kdb_trap() at kdb_trap+0x174/frame 0xfffffe00aa9480e0 trap() at trap+0x80b/frame 0xfffffe00aa9481f0 calltrap() at calltrap+0x8/frame 0xfffffe00aa9481f0 --- trap 0x3, rip = 0xffffffff80c29dfb, rsp = 0xfffffe00aa9482c0, rbp = 0xfffffe00aa9482d0 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00aa9482d0 vpanic() at vpanic+0x1d1/frame 0xfffffe00aa948330 panic() at panic+0x43/frame 0xfffffe00aa948390 handle_written_filepage() at handle_written_filepage+0x3e/frame 0xfffffe00aa948400 softdep_disk_write_complete() at softdep_disk_write_complete+0xdd/frame 0xfffffe00aa9484a0 bufdone() at bufdone+0x3bb/frame 0xfffffe00aa948520 ufs_strategy() at ufs_strategy+0x83/frame 0xfffffe00aa948550 VOP_STRATEGY_APV() at VOP_STRATEGY_APV+0x90/frame 0xfffffe00aa948570 bufstrategy() at bufstrategy+0x44/frame 0xfffffe00aa9485a0 bufwrite() at bufwrite+0x249/frame 0xfffffe00aa9485f0 ffs_syncvnode() at ffs_syncvnode+0x2ae/frame 0xfffffe00aa948670 ffs_fsync() at ffs_fsync+0x22/frame 0xfffffe00aa9486b0 VOP_FSYNC_APV() at VOP_FSYNC_APV+0x88/frame 0xfffffe00aa9486d0 ufs_remove() at ufs_remove+0xdf/frame 0xfffffe00aa948730 VOP_REMOVE_APV() at VOP_REMOVE_APV+0xac/frame 0xfffffe00aa948750 kern_unlinkat() at kern_unlinkat+0x1e7/frame 0xfffffe00aa948990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa948ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa948ab0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x800415e9a, rsp = 0x7fffffffe4b8, rbp = 0x7fffffffe5d0 --- Tracing command swap pid 85405 tid 100239 td 0xfffff800216bd000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00aca1da30 mi_switch() at mi_switch+0x174/frame 0xfffffe00aca1da60 critical_exit_preempt() at critical_exit_preempt+0x66/frame 0xfffffe00aca1da80 ipi_bitmap_handler() at ipi_bitmap_handler+0x9d/frame 0xfffffe00aca1dab0 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0xb0/frame 0xfffffe00aca1dab0 --- interrupt, rip = 0x203707, rsp = 0x7fffffffe510, rbp = 0x7fffffffe530 --- Tracing command swap pid 85404 tid 100389 td 0xfffff801d11ea000 (CPU 0) cpustop_handler() at cpustop_handler+0x28/frame 0xffffffff8205fb30 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xffffffff8205fb50 trap() at trap+0x48/frame 0xffffffff8205fc60 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff8205fc60 --- trap 0x13, rip = 0xffffffff810a12cf, rsp = 0xfffffe00acbfdac0, rbp = 0x7fffffffe200 --- alltraps_pushregs_no_rax() at alltraps_pushregs_no_rax+0x4c/frame 0x7fffffffe200 Tracing command swap pid 85403 tid 100281 td 0xfffff8025f2f3000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00acab35c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00acab35f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00acab3630 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00acab3670 _sleep() at _sleep+0x279/frame 0xfffffe00acab3710 swap_pager_getpages() at swap_pager_getpages+0x49e/frame 0xfffffe00acab3780 vm_pager_get_pages() at vm_pager_get_pages+0x4e/frame 0xfffffe00acab37d0 vm_fault_hold() at vm_fault_hold+0x1567/frame 0xfffffe00acab3910 vm_fault() at vm_fault+0x60/frame 0xfffffe00acab3950 trap_pfault() at trap_pfault+0x189/frame 0xfffffe00acab39a0 trap() at trap+0x460/frame 0xfffffe00acab3ab0 calltrap() at calltrap+0x8/frame 0xfffffe00acab3ab0 --- trap 0xc, rip = 0x203709, rsp = 0x7fffffffe510, rbp = 0x7fffffffe530 --- Tracing command swap pid 85402 tid 100274 td 0xfffff8025f2f65a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00aca90a30 mi_switch() at mi_switch+0x174/frame 0xfffffe00aca90a60 critical_exit_preempt() at critical_exit_preempt+0x66/frame 0xfffffe00aca90a80 ipi_bitmap_handler() at ipi_bitmap_handler+0x9d/frame 0xfffffe00aca90ab0 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0xb0/frame 0xfffffe00aca90ab0 --- interrupt, rip = 0x203707, rsp = 0x7fffffffe510, rbp = 0x7fffffffe530 --- Tracing command swap pid 85401 tid 100275 td 0xfffff8025f2f6000 (CPU 8) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006bc7df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006bc7e10 trap() at trap+0x48/frame 0xfffffe0006bc7f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bc7f20 --- trap 0x13, rip = 0x203709, rsp = 0x7fffffffe510, rbp = 0x7fffffffe530 --- Tracing command swap pid 85400 tid 100144 td 0xfffff800037a85a0 (CPU 7) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006bbbdf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006bbbe10 trap() at trap+0x48/frame 0xfffffe0006bbbf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bbbf20 --- trap 0x13, rip = 0xffffffff810ae8f6, rsp = 0xfffffe00aa7eeaa0, rbp = 0xfffffe00aa7eeab0 --- invlpg_invpcid_handler() at invlpg_invpcid_handler+0x66/frame 0xfffffe00aa7eeab0 Xinvlpg_invpcid() at Xinvlpg_invpcid+0xab/frame 0x7fffffffe530 Tracing command swap pid 85399 tid 100325 td 0xfffff801d11ca5a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00acb3f690 mi_switch() at mi_switch+0x174/frame 0xfffffe00acb3f6c0 critical_exit_preempt() at critical_exit_preempt+0x66/frame 0xfffffe00acb3f6e0 ipi_bitmap_handler() at ipi_bitmap_handler+0x9d/frame 0xfffffe00acb3f710 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0xb0/frame 0xfffffe00acb3f710 --- interrupt, rip = 0xffffffff80f2b088, rsp = 0xfffffe00acb3f7e0, rbp = 0xfffffe00acb3f910 --- vm_fault_hold() at vm_fault_hold+0x16e8/frame 0xfffffe00acb3f910 vm_fault() at vm_fault+0x60/frame 0xfffffe00acb3f950 trap_pfault() at trap_pfault+0x189/frame 0xfffffe00acb3f9a0 trap() at trap+0x460/frame 0xfffffe00acb3fab0 calltrap() at calltrap+0x8/frame 0xfffffe00acb3fab0 --- trap 0xc, rip = 0x8004376c5, rsp = 0x7fffffffe1b8, rbp = 0x7fffffffe200 --- Tracing command swap pid 85398 tid 100368 td 0xfffff806fd709000 (CPU 1) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006b73df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006b73e10 trap() at trap+0x48/frame 0xfffffe0006b73f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006b73f20 --- trap 0x13, rip = 0x203709, rsp = 0x7fffffffe510, rbp = 0x7fffffffe530 --- Tracing command swap pid 85397 tid 100219 td 0xfffff8000a6ab000 (CPU 10) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006bdfdf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006bdfe10 trap() at trap+0x48/frame 0xfffffe0006bdff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bdff20 --- trap 0x13, rip = 0xffffffff80f3dd00, rsp = 0xfffffe00aa9b6798, rbp = 0xfffffe00aa9b67d0 --- vm_object_set_writeable_dirty() at vm_object_set_writeable_dirty/frame 0xfffffe00aa9b67d0 vm_fault_hold() at vm_fault_hold+0x1980/frame 0xfffffe00aa9b6910 vm_fault() at vm_fault+0x60/frame 0xfffffe00aa9b6950 trap_pfault() at trap_pfault+0x189/frame 0xfffffe00aa9b69a0 trap() at trap+0x460/frame 0xfffffe00aa9b6ab0 calltrap() at calltrap+0x8/frame 0xfffffe00aa9b6ab0 --- trap 0xc, rip = 0x8004376c5, rsp = 0x7fffffffe1b8, rbp = 0x7fffffffe200 --- Tracing command swap pid 85396 tid 100173 td 0xfffff8000a6ab5a0 (CPU 2) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006b7fdf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006b7fe10 trap() at trap+0x48/frame 0xfffffe0006b7ff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006b7ff20 --- trap 0x13, rip = 0xffffffff80c3f622, rsp = 0xfffffe00aa899950, rbp = 0xfffffe00aa8999a0 --- userret() at userret+0x32/frame 0xfffffe00aa8999a0 trap() at trap+0x738/frame 0xfffffe00aa899ab0 calltrap() at calltrap+0x8/frame 0xfffffe00aa899ab0 --- trap 0xc, rip = 0x8004376c5, rsp = 0x7fffffffe1b8, rbp = 0x7fffffffe200 --- Tracing command swap pid 85395 tid 100277 td 0xfffff8025f2f5000 (CPU 9) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006bd3df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006bd3e10 trap() at trap+0x48/frame 0xfffffe0006bd3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bd3f20 --- trap 0x13, rip = 0x203709, rsp = 0x7fffffffe510, rbp = 0x7fffffffe530 --- Tracing command swap pid 85394 tid 100321 td 0xfffff801d10695a0 (CPU 4) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006b97df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006b97e10 trap() at trap+0x48/frame 0xfffffe0006b97f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006b97f20 --- trap 0x13, rip = 0x20370e, rsp = 0x7fffffffe510, rbp = 0x7fffffffe530 --- Tracing command swap pid 85393 tid 100293 td 0xfffff8013eba65a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00acaef670 mi_switch() at mi_switch+0x174/frame 0xfffffe00acaef6a0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00acaef6e0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00acaef710 _sleep() at _sleep+0x2da/frame 0xfffffe00acaef7b0 vm_waitpfault() at vm_waitpfault+0x6b/frame 0xfffffe00acaef7d0 vm_fault_hold() at vm_fault_hold+0xb00/frame 0xfffffe00acaef910 vm_fault() at vm_fault+0x60/frame 0xfffffe00acaef950 trap_pfault() at trap_pfault+0x189/frame 0xfffffe00acaef9a0 trap() at trap+0x460/frame 0xfffffe00acaefab0 calltrap() at calltrap+0x8/frame 0xfffffe00acaefab0 --- trap 0xc, rip = 0x8004376c5, rsp = 0x7fffffffe1b8, rbp = 0x7fffffffe200 --- Tracing command swap pid 85392 tid 100346 td 0xfffff80112efc5a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00acba8670 mi_switch() at mi_switch+0x174/frame 0xfffffe00acba86a0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00acba86e0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00acba8710 _sleep() at _sleep+0x2da/frame 0xfffffe00acba87b0 vm_waitpfault() at vm_waitpfault+0x6b/frame 0xfffffe00acba87d0 vm_fault_hold() at vm_fault_hold+0xb00/frame 0xfffffe00acba8910 vm_fault() at vm_fault+0x60/frame 0xfffffe00acba8950 trap_pfault() at trap_pfault+0x189/frame 0xfffffe00acba89a0 trap() at trap+0x460/frame 0xfffffe00acba8ab0 calltrap() at calltrap+0x8/frame 0xfffffe00acba8ab0 --- trap 0xc, rip = 0x8004376c5, rsp = 0x7fffffffe1b8, rbp = 0x7fffffffe200 --- Tracing command swap pid 85391 tid 100158 td 0xfffff80003fb75a0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00aa947af0 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00aa947b00 trap() at trap+0x5b/frame 0xfffffe00aa947c10 calltrap() at calltrap+0x8/frame 0xfffffe00aa947c10 --- trap 0xc, rip = 0xffffffff8109f4d6, rsp = 0xfffffe00aa947ce0, rbp = 0xfffffe00aa947cf0 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00aa947cf0 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe00aa947d90 db_command() at db_command+0x279/frame 0xfffffe00aa947e60 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00aa947f00 db_command() at db_command+0x279/frame 0xfffffe00aa947fd0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00aa947fe0 db_trap() at db_trap+0xef/frame 0xfffffe00aa948070 kdb_trap() at kdb_trap+0x174/frame 0xfffffe00aa9480e0 trap() at trap+0x80b/frame 0xfffffe00aa9481f0 calltrap() at calltrap+0x8/frame 0xfffffe00aa9481f0 --- trap 0x3, rip = 0xffffffff80c29dfb, rsp = 0xfffffe00aa9482c0, rbp = 0xfffffe00aa9482d0 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00aa9482d0 vpanic() at vpanic+0x1d1/frame 0xfffffe00aa948330 panic() at panic+0x43/frame 0xfffffe00aa948390 handle_written_filepage() at handle_written_filepage+0x3e/frame 0xfffffe00aa948400 softdep_disk_write_complete() at softdep_disk_write_complete+0xdd/frame 0xfffffe00aa9484a0 bufdone() at bufdone+0x3bb/frame 0xfffffe00aa948520 ufs_strategy() at ufs_strategy+0x83/frame 0xfffffe00aa948550 VOP_STRATEGY_APV() at VOP_STRATEGY_APV+0x90/frame 0xfffffe00aa948570 bufstrategy() at bufstrategy+0x44/frame 0xfffffe00aa9485a0 bufwrite() at bufwrite+0x249/frame 0xfffffe00aa9485f0 ffs_syncvnode() at ffs_syncvnode+0x2ae/frame 0xfffffe00aa948670 ffs_fsync() at ffs_fsync+0x22/frame 0xfffffe00aa9486b0 VOP_FSYNC_APV() at VOP_FSYNC_APV+0x88/frame 0xfffffe00aa9486d0 ufs_remove() at ufs_remove+0xdf/frame 0xfffffe00aa948730 VOP_REMOVE_APV() at VOP_REMOVE_APV+0xac/frame 0xfffffe00aa948750 kern_unlinkat() at kern_unlinkat+0x1e7/frame 0xfffffe00aa948990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa948ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa948ab0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x800415e9a, rsp = 0x7fffffffe4b8, rbp = 0x7fffffffe5d0 --- Tracing command swap pid 85390 tid 100171 td 0xfffff800211c35a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00aa8835c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00aa8835f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00aa883630 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00aa883670 _sleep() at _sleep+0x279/frame 0xfffffe00aa883710 swap_pager_getpages() at swap_pager_getpages+0x49e/frame 0xfffffe00aa883780 vm_pager_get_pages() at vm_pager_get_pages+0x4e/frame 0xfffffe00aa8837d0 vm_fault_hold() at vm_fault_hold+0x1567/frame 0xfffffe00aa883910 vm_fault() at vm_fault+0x60/frame 0xfffffe00aa883950 trap_pfault() at trap_pfault+0x189/frame 0xfffffe00aa8839a0 trap() at trap+0x460/frame 0xfffffe00aa883ab0 calltrap() at calltrap+0x8/frame 0xfffffe00aa883ab0 --- trap 0xc, rip = 0x203709, rsp = 0x7fffffffe510, rbp = 0x7fffffffe530 --- Tracing command swap pid 85389 tid 100284 td 0xfffff8025f3d35a0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00aa947af0 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00aa947b00 trap() at trap+0x5b/frame 0xfffffe00aa947c10 calltrap() at calltrap+0x8/frame 0xfffffe00aa947c10 --- trap 0xc, rip = 0xffffffff8109f4d6, rsp = 0xfffffe00aa947ce0, rbp = 0xfffffe00aa947cf0 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00aa947cf0 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe00aa947d90 db_command() at db_command+0x279/frame 0xfffffe00aa947e60 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00aa947f00 db_command() at db_command+0x279/frame 0xfffffe00aa947fd0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00aa947fe0 db_trap() at db_trap+0xef/frame 0xfffffe00aa948070 kdb_trap() at kdb_trap+0x174/frame 0xfffffe00aa9480e0 trap() at trap+0x80b/frame 0xfffffe00aa9481f0 calltrap() at calltrap+0x8/frame 0xfffffe00aa9481f0 --- trap 0x3, rip = 0xffffffff80c29dfb, rsp = 0xfffffe00aa9482c0, rbp = 0xfffffe00aa9482d0 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00aa9482d0 vpanic() at vpanic+0x1d1/frame 0xfffffe00aa948330 panic() at panic+0x43/frame 0xfffffe00aa948390 handle_written_filepage() at handle_written_filepage+0x3e/frame 0xfffffe00aa948400 softdep_disk_write_complete() at softdep_disk_write_complete+0xdd/frame 0xfffffe00aa9484a0 bufdone() at bufdone+0x3bb/frame 0xfffffe00aa948520 ufs_strategy() at ufs_strategy+0x83/frame 0xfffffe00aa948550 VOP_STRATEGY_APV() at VOP_STRATEGY_APV+0x90/frame 0xfffffe00aa948570 bufstrategy() at bufstrategy+0x44/frame 0xfffffe00aa9485a0 bufwrite() at bufwrite+0x249/frame 0xfffffe00aa9485f0 ffs_syncvnode() at ffs_syncvnode+0x2ae/frame 0xfffffe00aa948670 ffs_fsync() at ffs_fsync+0x22/frame 0xfffffe00aa9486b0 VOP_FSYNC_APV() at VOP_FSYNC_APV+0x88/frame 0xfffffe00aa9486d0 ufs_remove() at ufs_remove+0xdf/frame 0xfffffe00aa948730 VOP_REMOVE_APV() at VOP_REMOVE_APV+0xac/frame 0xfffffe00aa948750 kern_unlinkat() at kern_unlinkat+0x1e7/frame 0xfffffe00aa948990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa948ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa948ab0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x800415e9a, rsp = 0x7fffffffe4b8, rbp = 0x7fffffffe5d0 --- Tracing command swap pid 85388 tid 100195 td 0xfffff800037a7000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00aa9435c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00aa9435f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00aa943630 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00aa943670 _sleep() at _sleep+0x279/frame 0xfffffe00aa943710 swap_pager_getpages() at swap_pager_getpages+0x49e/frame 0xfffffe00aa943780 vm_pager_get_pages() at vm_pager_get_pages+0x4e/frame 0xfffffe00aa9437d0 vm_fault_hold() at vm_fault_hold+0x1567/frame 0xfffffe00aa943910 vm_fault() at vm_fault+0x60/frame 0xfffffe00aa943950 trap_pfault() at trap_pfault+0x189/frame 0xfffffe00aa9439a0 trap() at trap+0x460/frame 0xfffffe00aa943ab0 calltrap() at calltrap+0x8/frame 0xfffffe00aa943ab0 --- trap 0xc, rip = 0x203709, rsp = 0x7fffffffe510, rbp = 0x7fffffffe530 --- Tracing command swap pid 85387 tid 100244 td 0xfffff8013eba85a0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00aa947af0 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00aa947b00 trap() at trap+0x5b/frame 0xfffffe00aa947c10 calltrap() at calltrap+0x8/frame 0xfffffe00aa947c10 --- trap 0xc, rip = 0xffffffff8109f4d6, rsp = 0xfffffe00aa947ce0, rbp = 0xfffffe00aa947cf0 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00aa947cf0 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe00aa947d90 db_command() at db_command+0x279/frame 0xfffffe00aa947e60 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00aa947f00 db_command() at db_command+0x279/frame 0xfffffe00aa947fd0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00aa947fe0 db_trap() at db_trap+0xef/frame 0xfffffe00aa948070 kdb_trap() at kdb_trap+0x174/frame 0xfffffe00aa9480e0 trap() at trap+0x80b/frame 0xfffffe00aa9481f0 calltrap() at calltrap+0x8/frame 0xfffffe00aa9481f0 --- trap 0x3, rip = 0xffffffff80c29dfb, rsp = 0xfffffe00aa9482c0, rbp = 0xfffffe00aa9482d0 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00aa9482d0 vpanic() at vpanic+0x1d1/frame 0xfffffe00aa948330 panic() at panic+0x43/frame 0xfffffe00aa948390 handle_written_filepage() at handle_written_filepage+0x3e/frame 0xfffffe00aa948400 softdep_disk_write_complete() at softdep_disk_write_complete+0xdd/frame 0xfffffe00aa9484a0 bufdone() at bufdone+0x3bb/frame 0xfffffe00aa948520 ufs_strategy() at ufs_strategy+0x83/frame 0xfffffe00aa948550 VOP_STRATEGY_APV() at VOP_STRATEGY_APV+0x90/frame 0xfffffe00aa948570 bufstrategy() at bufstrategy+0x44/frame 0xfffffe00aa9485a0 bufwrite() at bufwrite+0x249/frame 0xfffffe00aa9485f0 ffs_syncvnode() at ffs_syncvnode+0x2ae/frame 0xfffffe00aa948670 ffs_fsync() at ffs_fsync+0x22/frame 0xfffffe00aa9486b0 VOP_FSYNC_APV() at VOP_FSYNC_APV+0x88/frame 0xfffffe00aa9486d0 ufs_remove() at ufs_remove+0xdf/frame 0xfffffe00aa948730 VOP_REMOVE_APV() at VOP_REMOVE_APV+0xac/frame 0xfffffe00aa948750 kern_unlinkat() at kern_unlinkat+0x1e7/frame 0xfffffe00aa948990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa948ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa948ab0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x800415e9a, rsp = 0x7fffffffe4b8, rbp = 0x7fffffffe5d0 --- Tracing command swap pid 85386 tid 100369 td 0xfffff8025f3d1000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00aa947af0 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00aa947b00 trap() at trap+0x5b/frame 0xfffffe00aa947c10 calltrap() at calltrap+0x8/frame 0xfffffe00aa947c10 --- trap 0xc, rip = 0xffffffff8109f4d6, rsp = 0xfffffe00aa947ce0, rbp = 0xfffffe00aa947cf0 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00aa947cf0 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe00aa947d90 db_command() at db_command+0x279/frame 0xfffffe00aa947e60 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00aa947f00 db_command() at db_command+0x279/frame 0xfffffe00aa947fd0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00aa947fe0 db_trap() at db_trap+0xef/frame 0xfffffe00aa948070 kdb_trap() at kdb_trap+0x174/frame 0xfffffe00aa9480e0 trap() at trap+0x80b/frame 0xfffffe00aa9481f0 calltrap() at calltrap+0x8/frame 0xfffffe00aa9481f0 --- trap 0x3, rip = 0xffffffff80c29dfb, rsp = 0xfffffe00aa9482c0, rbp = 0xfffffe00aa9482d0 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00aa9482d0 vpanic() at vpanic+0x1d1/frame 0xfffffe00aa948330 panic() at panic+0x43/frame 0xfffffe00aa948390 handle_written_filepage() at handle_written_filepage+0x3e/frame 0xfffffe00aa948400 softdep_disk_write_complete() at softdep_disk_write_complete+0xdd/frame 0xfffffe00aa9484a0 bufdone() at bufdone+0x3bb/frame 0xfffffe00aa948520 ufs_strategy() at ufs_strategy+0x83/frame 0xfffffe00aa948550 VOP_STRATEGY_APV() at VOP_STRATEGY_APV+0x90/frame 0xfffffe00aa948570 bufstrategy() at bufstrategy+0x44/frame 0xfffffe00aa9485a0 bufwrite() at bufwrite+0x249/frame 0xfffffe00aa9485f0 ffs_syncvnode() at ffs_syncvnode+0x2ae/frame 0xfffffe00aa948670 ffs_fsync() at ffs_fsync+0x22/frame 0xfffffe00aa9486b0 VOP_FSYNC_APV() at VOP_FSYNC_APV+0x88/frame 0xfffffe00aa9486d0 ufs_remove() at ufs_remove+0xdf/frame 0xfffffe00aa948730 VOP_REMOVE_APV() at VOP_REMOVE_APV+0xac/frame 0xfffffe00aa948750 kern_unlinkat() at kern_unlinkat+0x1e7/frame 0xfffffe00aa948990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa948ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa948ab0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x800415e9a, rsp = 0x7fffffffe4b8, rbp = 0x7fffffffe5d0 --- Tracing command swap pid 85385 tid 100236 td 0xfffff8000ae4c000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00aa947af0 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00aa947b00 trap() at trap+0x5b/frame 0xfffffe00aa947c10 calltrap() at calltrap+0x8/frame 0xfffffe00aa947c10 --- trap 0xc, rip = 0xffffffff8109f4d6, rsp = 0xfffffe00aa947ce0, rbp = 0xfffffe00aa947cf0 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00aa947cf0 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe00aa947d90 db_command() at db_command+0x279/frame 0xfffffe00aa947e60 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00aa947f00 db_command() at db_command+0x279/frame 0xfffffe00aa947fd0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00aa947fe0 db_trap() at db_trap+0xef/frame 0xfffffe00aa948070 kdb_trap() at kdb_trap+0x174/frame 0xfffffe00aa9480e0 trap() at trap+0x80b/frame 0xfffffe00aa9481f0 calltrap() at calltrap+0x8/frame 0xfffffe00aa9481f0 --- trap 0x3, rip = 0xffffffff80c29dfb, rsp = 0xfffffe00aa9482c0, rbp = 0xfffffe00aa9482d0 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00aa9482d0 vpanic() at vpanic+0x1d1/frame 0xfffffe00aa948330 panic() at panic+0x43/frame 0xfffffe00aa948390 handle_written_filepage() at handle_written_filepage+0x3e/frame 0xfffffe00aa948400 softdep_disk_write_complete() at softdep_disk_write_complete+0xdd/frame 0xfffffe00aa9484a0 bufdone() at bufdone+0x3bb/frame 0xfffffe00aa948520 ufs_strategy() at ufs_strategy+0x83/frame 0xfffffe00aa948550 VOP_STRATEGY_APV() at VOP_STRATEGY_APV+0x90/frame 0xfffffe00aa948570 bufstrategy() at bufstrategy+0x44/frame 0xfffffe00aa9485a0 bufwrite() at bufwrite+0x249/frame 0xfffffe00aa9485f0 ffs_syncvnode() at ffs_syncvnode+0x2ae/frame 0xfffffe00aa948670 ffs_fsync() at ffs_fsync+0x22/frame 0xfffffe00aa9486b0 VOP_FSYNC_APV() at VOP_FSYNC_APV+0x88/frame 0xfffffe00aa9486d0 ufs_remove() at ufs_remove+0xdf/frame 0xfffffe00aa948730 VOP_REMOVE_APV() at VOP_REMOVE_APV+0xac/frame 0xfffffe00aa948750 kern_unlinkat() at kern_unlinkat+0x1e7/frame 0xfffffe00aa948990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa948ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa948ab0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x800415e9a, rsp = 0x7fffffffe4b8, rbp = 0x7fffffffe5d0 --- Tracing command pageout pid 85383 tid 100308 td 0xfffff8000adaa5a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00767dba40 mi_switch() at mi_switch+0x174/frame 0xfffffe00767dba70 ast() at ast+0x28d/frame 0xfffffe00767dbab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe6e0 Tracing command swap pid 85382 tid 100231 td 0xfffff8000a95f5a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00aa9f2710 mi_switch() at mi_switch+0x174/frame 0xfffffe00aa9f2740 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00aa9f2780 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00aa9f27e0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00aa9f2820 _sleep() at _sleep+0x265/frame 0xfffffe00aa9f28c0 kern_clock_nanosleep() at kern_clock_nanosleep+0x207/frame 0xfffffe00aa9f2950 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00aa9f2990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa9f2ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa9f2ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003c625a, rsp = 0x7fffffffe548, rbp = 0x7fffffffe590 --- Tracing command md10 pid 85374 tid 100390 td 0xfffff801d11cb5a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00ae4048d0 mi_switch() at mi_switch+0x174/frame 0xfffffe00ae404900 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00ae404940 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00ae404970 _sleep() at _sleep+0x2da/frame 0xfffffe00ae404a10 md_kthread() at md_kthread+0x1e5/frame 0xfffffe00ae404a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00ae404ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ae404ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sh pid 85356 tid 100333 td 0xfffff80112ef45a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00acb67570 mi_switch() at mi_switch+0x174/frame 0xfffffe00acb675a0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00acb675e0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00acb67640 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00acb67670 _sleep() at _sleep+0x2d0/frame 0xfffffe00acb67710 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00acb677a0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00acb67990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00acb67ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00acb67ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040d0da, rsp = 0x7fffffffe2d8, rbp = 0x7fffffffe390 --- Tracing command tee pid 85355 tid 100164 td 0xfffff8000ae4d5a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00aa8546b0 mi_switch() at mi_switch+0x174/frame 0xfffffe00aa8546e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00aa854720 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00aa854780 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aa8547b0 _sleep() at _sleep+0x2d0/frame 0xfffffe00aa854850 pipe_read() at pipe_read+0x35a/frame 0xfffffe00aa8548b0 dofileread() at dofileread+0x81/frame 0xfffffe00aa854900 kern_readv() at kern_readv+0x4a/frame 0xfffffe00aa854940 sys_read() at sys_read+0x86/frame 0xfffffe00aa854990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa854ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa854ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80041c06a, rsp = 0x7fffffffe6b8, rbp = 0x7fffffffe700 --- Tracing command sh pid 85354 tid 100252 td 0xfffff801ac28b000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00aa947af0 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00aa947b00 trap() at trap+0x5b/frame 0xfffffe00aa947c10 calltrap() at calltrap+0x8/frame 0xfffffe00aa947c10 --- trap 0xc, rip = 0xffffffff8109f4d6, rsp = 0xfffffe00aa947ce0, rbp = 0xfffffe00aa947cf0 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00aa947cf0 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe00aa947d90 db_command() at db_command+0x279/frame 0xfffffe00aa947e60 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00aa947f00 db_command() at db_command+0x279/frame 0xfffffe00aa947fd0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00aa947fe0 db_trap() at db_trap+0xef/frame 0xfffffe00aa948070 kdb_trap() at kdb_trap+0x174/frame 0xfffffe00aa9480e0 trap() at trap+0x80b/frame 0xfffffe00aa9481f0 calltrap() at calltrap+0x8/frame 0xfffffe00aa9481f0 --- trap 0x3, rip = 0xffffffff80c29dfb, rsp = 0xfffffe00aa9482c0, rbp = 0xfffffe00aa9482d0 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00aa9482d0 vpanic() at vpanic+0x1d1/frame 0xfffffe00aa948330 panic() at panic+0x43/frame 0xfffffe00aa948390 handle_written_filepage() at handle_written_filepage+0x3e/frame 0xfffffe00aa948400 softdep_disk_write_complete() at softdep_disk_write_complete+0xdd/frame 0xfffffe00aa9484a0 bufdone() at bufdone+0x3bb/frame 0xfffffe00aa948520 ufs_strategy() at ufs_strategy+0x83/frame 0xfffffe00aa948550 VOP_STRATEGY_APV() at VOP_STRATEGY_APV+0x90/frame 0xfffffe00aa948570 bufstrategy() at bufstrategy+0x44/frame 0xfffffe00aa9485a0 bufwrite() at bufwrite+0x249/frame 0xfffffe00aa9485f0 ffs_syncvnode() at ffs_syncvnode+0x2ae/frame 0xfffffe00aa948670 ffs_fsync() at ffs_fsync+0x22/frame 0xfffffe00aa9486b0 VOP_FSYNC_APV() at VOP_FSYNC_APV+0x88/frame 0xfffffe00aa9486d0 ufs_remove() at ufs_remove+0xdf/frame 0xfffffe00aa948730 VOP_REMOVE_APV() at VOP_REMOVE_APV+0xac/frame 0xfffffe00aa948750 kern_unlinkat() at kern_unlinkat+0x1e7/frame 0xfffffe00aa948990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa948ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa948ab0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x800415e9a, rsp = 0x7fffffffe4b8, rbp = 0x7fffffffe5d0 --- Tracing command csh pid 4775 tid 100143 td 0xfffff8000a961000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00aa7e9630 mi_switch() at mi_switch+0x174/frame 0xfffffe00aa7e9660 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00aa7e96a0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00aa7e9700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aa7e9730 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00aa7e9790 tty_wait() at tty_wait+0x42/frame 0xfffffe00aa7e97c0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00aa7e9820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00aa7e9850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00aa7e98b0 dofileread() at dofileread+0x81/frame 0xfffffe00aa7e9900 kern_readv() at kern_readv+0x4a/frame 0xfffffe00aa7e9940 sys_read() at sys_read+0x86/frame 0xfffffe00aa7e9990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa7e9ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa7e9ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80050206a, rsp = 0x7fffffffe0e8, rbp = 0x7fffffffe110 --- Tracing command su pid 4774 tid 100254 td 0xfffff8000a68d000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00aa947af0 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00aa947b00 trap() at trap+0x5b/frame 0xfffffe00aa947c10 calltrap() at calltrap+0x8/frame 0xfffffe00aa947c10 --- trap 0xc, rip = 0xffffffff8109f4d6, rsp = 0xfffffe00aa947ce0, rbp = 0xfffffe00aa947cf0 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00aa947cf0 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe00aa947d90 db_command() at db_command+0x279/frame 0xfffffe00aa947e60 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00aa947f00 db_command() at db_command+0x279/frame 0xfffffe00aa947fd0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00aa947fe0 db_trap() at db_trap+0xef/frame 0xfffffe00aa948070 kdb_trap() at kdb_trap+0x174/frame 0xfffffe00aa9480e0 trap() at trap+0x80b/frame 0xfffffe00aa9481f0 calltrap() at calltrap+0x8/frame 0xfffffe00aa9481f0 --- trap 0x3, rip = 0xffffffff80c29dfb, rsp = 0xfffffe00aa9482c0, rbp = 0xfffffe00aa9482d0 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00aa9482d0 vpanic() at vpanic+0x1d1/frame 0xfffffe00aa948330 panic() at panic+0x43/frame 0xfffffe00aa948390 handle_written_filepage() at handle_written_filepage+0x3e/frame 0xfffffe00aa948400 softdep_disk_write_complete() at softdep_disk_write_complete+0xdd/frame 0xfffffe00aa9484a0 bufdone() at bufdone+0x3bb/frame 0xfffffe00aa948520 ufs_strategy() at ufs_strategy+0x83/frame 0xfffffe00aa948550 VOP_STRATEGY_APV() at VOP_STRATEGY_APV+0x90/frame 0xfffffe00aa948570 bufstrategy() at bufstrategy+0x44/frame 0xfffffe00aa9485a0 bufwrite() at bufwrite+0x249/frame 0xfffffe00aa9485f0 ffs_syncvnode() at ffs_syncvnode+0x2ae/frame 0xfffffe00aa948670 ffs_fsync() at ffs_fsync+0x22/frame 0xfffffe00aa9486b0 VOP_FSYNC_APV() at VOP_FSYNC_APV+0x88/frame 0xfffffe00aa9486d0 ufs_remove() at ufs_remove+0xdf/frame 0xfffffe00aa948730 VOP_REMOVE_APV() at VOP_REMOVE_APV+0xac/frame 0xfffffe00aa948750 kern_unlinkat() at kern_unlinkat+0x1e7/frame 0xfffffe00aa948990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa948ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa948ab0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x800415e9a, rsp = 0x7fffffffe4b8, rbp = 0x7fffffffe5d0 --- Tracing command bash pid 4773 tid 100253 td 0xfffff8000a68d5a0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00aa947af0 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00aa947b00 trap() at trap+0x5b/frame 0xfffffe00aa947c10 calltrap() at calltrap+0x8/frame 0xfffffe00aa947c10 --- trap 0xc, rip = 0xffffffff8109f4d6, rsp = 0xfffffe00aa947ce0, rbp = 0xfffffe00aa947cf0 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00aa947cf0 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe00aa947d90 db_command() at db_command+0x279/frame 0xfffffe00aa947e60 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00aa947f00 db_command() at db_command+0x279/frame 0xfffffe00aa947fd0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00aa947fe0 db_trap() at db_trap+0xef/frame 0xfffffe00aa948070 kdb_trap() at kdb_trap+0x174/frame 0xfffffe00aa9480e0 trap() at trap+0x80b/frame 0xfffffe00aa9481f0 calltrap() at calltrap+0x8/frame 0xfffffe00aa9481f0 --- trap 0x3, rip = 0xffffffff80c29dfb, rsp = 0xfffffe00aa9482c0, rbp = 0xfffffe00aa9482d0 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00aa9482d0 vpanic() at vpanic+0x1d1/frame 0xfffffe00aa948330 panic() at panic+0x43/frame 0xfffffe00aa948390 handle_written_filepage() at handle_written_filepage+0x3e/frame 0xfffffe00aa948400 softdep_disk_write_complete() at softdep_disk_write_complete+0xdd/frame 0xfffffe00aa9484a0 bufdone() at bufdone+0x3bb/frame 0xfffffe00aa948520 ufs_strategy() at ufs_strategy+0x83/frame 0xfffffe00aa948550 VOP_STRATEGY_APV() at VOP_STRATEGY_APV+0x90/frame 0xfffffe00aa948570 bufstrategy() at bufstrategy+0x44/frame 0xfffffe00aa9485a0 bufwrite() at bufwrite+0x249/frame 0xfffffe00aa9485f0 ffs_syncvnode() at ffs_syncvnode+0x2ae/frame 0xfffffe00aa948670 ffs_fsync() at ffs_fsync+0x22/frame 0xfffffe00aa9486b0 VOP_FSYNC_APV() at VOP_FSYNC_APV+0x88/frame 0xfffffe00aa9486d0 ufs_remove() at ufs_remove+0xdf/frame 0xfffffe00aa948730 VOP_REMOVE_APV() at VOP_REMOVE_APV+0xac/frame 0xfffffe00aa948750 kern_unlinkat() at kern_unlinkat+0x1e7/frame 0xfffffe00aa948990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa948ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa948ab0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x800415e9a, rsp = 0x7fffffffe4b8, rbp = 0x7fffffffe5d0 --- Tracing command sshd pid 4772 tid 100256 td 0xfffff8013eba8000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00aca725d0 mi_switch() at mi_switch+0x174/frame 0xfffffe00aca72600 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00aca72640 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00aca726a0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aca726d0 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00aca72730 seltdwait() at seltdwait+0x8d/frame 0xfffffe00aca72770 kern_select() at kern_select+0x953/frame 0xfffffe00aca72950 sys_select() at sys_select+0x56/frame 0xfffffe00aca72990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aca72ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aca72ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80090b04a, rsp = 0x7fffffffa578, rbp = 0x7fffffffa5b0 --- Tracing command sshd pid 4711 tid 100270 td 0xfffff8013eba75a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00aca7c650 mi_switch() at mi_switch+0x174/frame 0xfffffe00aca7c680 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00aca7c6c0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00aca7c720 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aca7c750 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00aca7c7b0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00aca7c7f0 kern_poll() at kern_poll+0x439/frame 0xfffffe00aca7c970 sys_poll() at sys_poll+0x50/frame 0xfffffe00aca7c990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aca7cab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aca7cab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8008ac7da, rsp = 0x7fffffffe5d8, rbp = 0x7fffffffe610 --- Tracing command sh pid 2444 tid 100234 td 0xfffff801ac2de5a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00aca046b0 mi_switch() at mi_switch+0x174/frame 0xfffffe00aca046e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00aca04720 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00aca04780 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aca047b0 _sleep() at _sleep+0x2d0/frame 0xfffffe00aca04850 pipe_read() at pipe_read+0x35a/frame 0xfffffe00aca048b0 dofileread() at dofileread+0x81/frame 0xfffffe00aca04900 kern_readv() at kern_readv+0x4a/frame 0xfffffe00aca04940 sys_read() at sys_read+0x86/frame 0xfffffe00aca04990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aca04ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aca04ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80047e06a, rsp = 0x7fffffffe228, rbp = 0x7fffffffe330 --- Tracing command awk pid 2442 tid 100233 td 0xfffff8000a3af5a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00aa9fc6b0 mi_switch() at mi_switch+0x174/frame 0xfffffe00aa9fc6e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00aa9fc720 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00aa9fc780 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aa9fc7b0 _sleep() at _sleep+0x2d0/frame 0xfffffe00aa9fc850 pipe_read() at pipe_read+0x35a/frame 0xfffffe00aa9fc8b0 dofileread() at dofileread+0x81/frame 0xfffffe00aa9fc900 kern_readv() at kern_readv+0x4a/frame 0xfffffe00aa9fc940 sys_read() at sys_read+0x86/frame 0xfffffe00aa9fc990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa9fcab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa9fcab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80047f06a, rsp = 0x7fffffffe328, rbp = 0x7fffffffe340 --- Tracing command sh pid 2441 tid 100203 td 0xfffff8000a6845a0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00aa947af0 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00aa947b00 trap() at trap+0x5b/frame 0xfffffe00aa947c10 calltrap() at calltrap+0x8/frame 0xfffffe00aa947c10 --- trap 0xc, rip = 0xffffffff8109f4d6, rsp = 0xfffffe00aa947ce0, rbp = 0xfffffe00aa947cf0 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00aa947cf0 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe00aa947d90 db_command() at db_command+0x279/frame 0xfffffe00aa947e60 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00aa947f00 db_command() at db_command+0x279/frame 0xfffffe00aa947fd0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00aa947fe0 db_trap() at db_trap+0xef/frame 0xfffffe00aa948070 kdb_trap() at kdb_trap+0x174/frame 0xfffffe00aa9480e0 trap() at trap+0x80b/frame 0xfffffe00aa9481f0 calltrap() at calltrap+0x8/frame 0xfffffe00aa9481f0 --- trap 0x3, rip = 0xffffffff80c29dfb, rsp = 0xfffffe00aa9482c0, rbp = 0xfffffe00aa9482d0 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00aa9482d0 vpanic() at vpanic+0x1d1/frame 0xfffffe00aa948330 panic() at panic+0x43/frame 0xfffffe00aa948390 handle_written_filepage() at handle_written_filepage+0x3e/frame 0xfffffe00aa948400 softdep_disk_write_complete() at softdep_disk_write_complete+0xdd/frame 0xfffffe00aa9484a0 bufdone() at bufdone+0x3bb/frame 0xfffffe00aa948520 ufs_strategy() at ufs_strategy+0x83/frame 0xfffffe00aa948550 VOP_STRATEGY_APV() at VOP_STRATEGY_APV+0x90/frame 0xfffffe00aa948570 bufstrategy() at bufstrategy+0x44/frame 0xfffffe00aa9485a0 bufwrite() at bufwrite+0x249/frame 0xfffffe00aa9485f0 ffs_syncvnode() at ffs_syncvnode+0x2ae/frame 0xfffffe00aa948670 ffs_fsync() at ffs_fsync+0x22/frame 0xfffffe00aa9486b0 VOP_FSYNC_APV() at VOP_FSYNC_APV+0x88/frame 0xfffffe00aa9486d0 ufs_remove() at ufs_remove+0xdf/frame 0xfffffe00aa948730 VOP_REMOVE_APV() at VOP_REMOVE_APV+0xac/frame 0xfffffe00aa948750 kern_unlinkat() at kern_unlinkat+0x1e7/frame 0xfffffe00aa948990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa948ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa948ab0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x800415e9a, rsp = 0x7fffffffe4b8, rbp = 0x7fffffffe5d0 --- Tracing command sh pid 2406 tid 100224 td 0xfffff801ac28b5a0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00aa947af0 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00aa947b00 trap() at trap+0x5b/frame 0xfffffe00aa947c10 calltrap() at calltrap+0x8/frame 0xfffffe00aa947c10 --- trap 0xc, rip = 0xffffffff8109f4d6, rsp = 0xfffffe00aa947ce0, rbp = 0xfffffe00aa947cf0 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00aa947cf0 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe00aa947d90 db_command() at db_command+0x279/frame 0xfffffe00aa947e60 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00aa947f00 db_command() at db_command+0x279/frame 0xfffffe00aa947fd0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00aa947fe0 db_trap() at db_trap+0xef/frame 0xfffffe00aa948070 kdb_trap() at kdb_trap+0x174/frame 0xfffffe00aa9480e0 trap() at trap+0x80b/frame 0xfffffe00aa9481f0 calltrap() at calltrap+0x8/frame 0xfffffe00aa9481f0 --- trap 0x3, rip = 0xffffffff80c29dfb, rsp = 0xfffffe00aa9482c0, rbp = 0xfffffe00aa9482d0 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00aa9482d0 vpanic() at vpanic+0x1d1/frame 0xfffffe00aa948330 panic() at panic+0x43/frame 0xfffffe00aa948390 handle_written_filepage() at handle_written_filepage+0x3e/frame 0xfffffe00aa948400 softdep_disk_write_complete() at softdep_disk_write_complete+0xdd/frame 0xfffffe00aa9484a0 bufdone() at bufdone+0x3bb/frame 0xfffffe00aa948520 ufs_strategy() at ufs_strategy+0x83/frame 0xfffffe00aa948550 VOP_STRATEGY_APV() at VOP_STRATEGY_APV+0x90/frame 0xfffffe00aa948570 bufstrategy() at bufstrategy+0x44/frame 0xfffffe00aa9485a0 bufwrite() at bufwrite+0x249/frame 0xfffffe00aa9485f0 ffs_syncvnode() at ffs_syncvnode+0x2ae/frame 0xfffffe00aa948670 ffs_fsync() at ffs_fsync+0x22/frame 0xfffffe00aa9486b0 VOP_FSYNC_APV() at VOP_FSYNC_APV+0x88/frame 0xfffffe00aa9486d0 ufs_remove() at ufs_remove+0xdf/frame 0xfffffe00aa948730 VOP_REMOVE_APV() at VOP_REMOVE_APV+0xac/frame 0xfffffe00aa948750 kern_unlinkat() at kern_unlinkat+0x1e7/frame 0xfffffe00aa948990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa948ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa948ab0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x800415e9a, rsp = 0x7fffffffe4b8, rbp = 0x7fffffffe5d0 --- Tracing command sh pid 2334 tid 100205 td 0xfffff80003fb7000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00aa947af0 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00aa947b00 trap() at trap+0x5b/frame 0xfffffe00aa947c10 calltrap() at calltrap+0x8/frame 0xfffffe00aa947c10 --- trap 0xc, rip = 0xffffffff8109f4d6, rsp = 0xfffffe00aa947ce0, rbp = 0xfffffe00aa947cf0 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00aa947cf0 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe00aa947d90 db_command() at db_command+0x279/frame 0xfffffe00aa947e60 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00aa947f00 db_command() at db_command+0x279/frame 0xfffffe00aa947fd0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00aa947fe0 db_trap() at db_trap+0xef/frame 0xfffffe00aa948070 kdb_trap() at kdb_trap+0x174/frame 0xfffffe00aa9480e0 trap() at trap+0x80b/frame 0xfffffe00aa9481f0 calltrap() at calltrap+0x8/frame 0xfffffe00aa9481f0 --- trap 0x3, rip = 0xffffffff80c29dfb, rsp = 0xfffffe00aa9482c0, rbp = 0xfffffe00aa9482d0 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00aa9482d0 vpanic() at vpanic+0x1d1/frame 0xfffffe00aa948330 panic() at panic+0x43/frame 0xfffffe00aa948390 handle_written_filepage() at handle_written_filepage+0x3e/frame 0xfffffe00aa948400 softdep_disk_write_complete() at softdep_disk_write_complete+0xdd/frame 0xfffffe00aa9484a0 bufdone() at bufdone+0x3bb/frame 0xfffffe00aa948520 ufs_strategy() at ufs_strategy+0x83/frame 0xfffffe00aa948550 VOP_STRATEGY_APV() at VOP_STRATEGY_APV+0x90/frame 0xfffffe00aa948570 bufstrategy() at bufstrategy+0x44/frame 0xfffffe00aa9485a0 bufwrite() at bufwrite+0x249/frame 0xfffffe00aa9485f0 ffs_syncvnode() at ffs_syncvnode+0x2ae/frame 0xfffffe00aa948670 ffs_fsync() at ffs_fsync+0x22/frame 0xfffffe00aa9486b0 VOP_FSYNC_APV() at VOP_FSYNC_APV+0x88/frame 0xfffffe00aa9486d0 ufs_remove() at ufs_remove+0xdf/frame 0xfffffe00aa948730 VOP_REMOVE_APV() at VOP_REMOVE_APV+0xac/frame 0xfffffe00aa948750 kern_unlinkat() at kern_unlinkat+0x1e7/frame 0xfffffe00aa948990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa948ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa948ab0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x800415e9a, rsp = 0x7fffffffe4b8, rbp = 0x7fffffffe5d0 --- Tracing command bash pid 2333 tid 100201 td 0xfffff800211c1000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00aa947af0 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00aa947b00 trap() at trap+0x5b/frame 0xfffffe00aa947c10 calltrap() at calltrap+0x8/frame 0xfffffe00aa947c10 --- trap 0xc, rip = 0xffffffff8109f4d6, rsp = 0xfffffe00aa947ce0, rbp = 0xfffffe00aa947cf0 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00aa947cf0 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe00aa947d90 db_command() at db_command+0x279/frame 0xfffffe00aa947e60 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00aa947f00 db_command() at db_command+0x279/frame 0xfffffe00aa947fd0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00aa947fe0 db_trap() at db_trap+0xef/frame 0xfffffe00aa948070 kdb_trap() at kdb_trap+0x174/frame 0xfffffe00aa9480e0 trap() at trap+0x80b/frame 0xfffffe00aa9481f0 calltrap() at calltrap+0x8/frame 0xfffffe00aa9481f0 --- trap 0x3, rip = 0xffffffff80c29dfb, rsp = 0xfffffe00aa9482c0, rbp = 0xfffffe00aa9482d0 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00aa9482d0 vpanic() at vpanic+0x1d1/frame 0xfffffe00aa948330 panic() at panic+0x43/frame 0xfffffe00aa948390 handle_written_filepage() at handle_written_filepage+0x3e/frame 0xfffffe00aa948400 softdep_disk_write_complete() at softdep_disk_write_complete+0xdd/frame 0xfffffe00aa9484a0 bufdone() at bufdone+0x3bb/frame 0xfffffe00aa948520 ufs_strategy() at ufs_strategy+0x83/frame 0xfffffe00aa948550 VOP_STRATEGY_APV() at VOP_STRATEGY_APV+0x90/frame 0xfffffe00aa948570 bufstrategy() at bufstrategy+0x44/frame 0xfffffe00aa9485a0 bufwrite() at bufwrite+0x249/frame 0xfffffe00aa9485f0 ffs_syncvnode() at ffs_syncvnode+0x2ae/frame 0xfffffe00aa948670 ffs_fsync() at ffs_fsync+0x22/frame 0xfffffe00aa9486b0 VOP_FSYNC_APV() at VOP_FSYNC_APV+0x88/frame 0xfffffe00aa9486d0 ufs_remove() at ufs_remove+0xdf/frame 0xfffffe00aa948730 VOP_REMOVE_APV() at VOP_REMOVE_APV+0xac/frame 0xfffffe00aa948750 kern_unlinkat() at kern_unlinkat+0x1e7/frame 0xfffffe00aa948990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa948ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa948ab0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x800415e9a, rsp = 0x7fffffffe4b8, rbp = 0x7fffffffe5d0 --- Tracing command csh pid 2331 tid 100174 td 0xfffff8002170d5a0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00aa947af0 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00aa947b00 trap() at trap+0x5b/frame 0xfffffe00aa947c10 calltrap() at calltrap+0x8/frame 0xfffffe00aa947c10 --- trap 0xc, rip = 0xffffffff8109f4d6, rsp = 0xfffffe00aa947ce0, rbp = 0xfffffe00aa947cf0 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00aa947cf0 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe00aa947d90 db_command() at db_command+0x279/frame 0xfffffe00aa947e60 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00aa947f00 db_command() at db_command+0x279/frame 0xfffffe00aa947fd0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00aa947fe0 db_trap() at db_trap+0xef/frame 0xfffffe00aa948070 kdb_trap() at kdb_trap+0x174/frame 0xfffffe00aa9480e0 trap() at trap+0x80b/frame 0xfffffe00aa9481f0 calltrap() at calltrap+0x8/frame 0xfffffe00aa9481f0 --- trap 0x3, rip = 0xffffffff80c29dfb, rsp = 0xfffffe00aa9482c0, rbp = 0xfffffe00aa9482d0 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00aa9482d0 vpanic() at vpanic+0x1d1/frame 0xfffffe00aa948330 panic() at panic+0x43/frame 0xfffffe00aa948390 handle_written_filepage() at handle_written_filepage+0x3e/frame 0xfffffe00aa948400 softdep_disk_write_complete() at softdep_disk_write_complete+0xdd/frame 0xfffffe00aa9484a0 bufdone() at bufdone+0x3bb/frame 0xfffffe00aa948520 ufs_strategy() at ufs_strategy+0x83/frame 0xfffffe00aa948550 VOP_STRATEGY_APV() at VOP_STRATEGY_APV+0x90/frame 0xfffffe00aa948570 bufstrategy() at bufstrategy+0x44/frame 0xfffffe00aa9485a0 bufwrite() at bufwrite+0x249/frame 0xfffffe00aa9485f0 ffs_syncvnode() at ffs_syncvnode+0x2ae/frame 0xfffffe00aa948670 ffs_fsync() at ffs_fsync+0x22/frame 0xfffffe00aa9486b0 VOP_FSYNC_APV() at VOP_FSYNC_APV+0x88/frame 0xfffffe00aa9486d0 ufs_remove() at ufs_remove+0xdf/frame 0xfffffe00aa948730 VOP_REMOVE_APV() at VOP_REMOVE_APV+0xac/frame 0xfffffe00aa948750 kern_unlinkat() at kern_unlinkat+0x1e7/frame 0xfffffe00aa948990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa948ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa948ab0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x800415e9a, rsp = 0x7fffffffe4b8, rbp = 0x7fffffffe5d0 --- Tracing command su pid 2330 tid 100197 td 0xfffff800218d7000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00aa947af0 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00aa947b00 trap() at trap+0x5b/frame 0xfffffe00aa947c10 calltrap() at calltrap+0x8/frame 0xfffffe00aa947c10 --- trap 0xc, rip = 0xffffffff8109f4d6, rsp = 0xfffffe00aa947ce0, rbp = 0xfffffe00aa947cf0 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00aa947cf0 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe00aa947d90 db_command() at db_command+0x279/frame 0xfffffe00aa947e60 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00aa947f00 db_command() at db_command+0x279/frame 0xfffffe00aa947fd0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00aa947fe0 db_trap() at db_trap+0xef/frame 0xfffffe00aa948070 kdb_trap() at kdb_trap+0x174/frame 0xfffffe00aa9480e0 trap() at trap+0x80b/frame 0xfffffe00aa9481f0 calltrap() at calltrap+0x8/frame 0xfffffe00aa9481f0 --- trap 0x3, rip = 0xffffffff80c29dfb, rsp = 0xfffffe00aa9482c0, rbp = 0xfffffe00aa9482d0 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00aa9482d0 vpanic() at vpanic+0x1d1/frame 0xfffffe00aa948330 panic() at panic+0x43/frame 0xfffffe00aa948390 handle_written_filepage() at handle_written_filepage+0x3e/frame 0xfffffe00aa948400 softdep_disk_write_complete() at softdep_disk_write_complete+0xdd/frame 0xfffffe00aa9484a0 bufdone() at bufdone+0x3bb/frame 0xfffffe00aa948520 ufs_strategy() at ufs_strategy+0x83/frame 0xfffffe00aa948550 VOP_STRATEGY_APV() at VOP_STRATEGY_APV+0x90/frame 0xfffffe00aa948570 bufstrategy() at bufstrategy+0x44/frame 0xfffffe00aa9485a0 bufwrite() at bufwrite+0x249/frame 0xfffffe00aa9485f0 ffs_syncvnode() at ffs_syncvnode+0x2ae/frame 0xfffffe00aa948670 ffs_fsync() at ffs_fsync+0x22/frame 0xfffffe00aa9486b0 VOP_FSYNC_APV() at VOP_FSYNC_APV+0x88/frame 0xfffffe00aa9486d0 ufs_remove() at ufs_remove+0xdf/frame 0xfffffe00aa948730 VOP_REMOVE_APV() at VOP_REMOVE_APV+0xac/frame 0xfffffe00aa948750 kern_unlinkat() at kern_unlinkat+0x1e7/frame 0xfffffe00aa948990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa948ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa948ab0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x800415e9a, rsp = 0x7fffffffe4b8, rbp = 0x7fffffffe5d0 --- Tracing command bash pid 2329 tid 100154 td 0xfffff8000ae4e5a0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00aa947af0 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00aa947b00 trap() at trap+0x5b/frame 0xfffffe00aa947c10 calltrap() at calltrap+0x8/frame 0xfffffe00aa947c10 --- trap 0xc, rip = 0xffffffff8109f4d6, rsp = 0xfffffe00aa947ce0, rbp = 0xfffffe00aa947cf0 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00aa947cf0 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe00aa947d90 db_command() at db_command+0x279/frame 0xfffffe00aa947e60 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00aa947f00 db_command() at db_command+0x279/frame 0xfffffe00aa947fd0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00aa947fe0 db_trap() at db_trap+0xef/frame 0xfffffe00aa948070 kdb_trap() at kdb_trap+0x174/frame 0xfffffe00aa9480e0 trap() at trap+0x80b/frame 0xfffffe00aa9481f0 calltrap() at calltrap+0x8/frame 0xfffffe00aa9481f0 --- trap 0x3, rip = 0xffffffff80c29dfb, rsp = 0xfffffe00aa9482c0, rbp = 0xfffffe00aa9482d0 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00aa9482d0 vpanic() at vpanic+0x1d1/frame 0xfffffe00aa948330 panic() at panic+0x43/frame 0xfffffe00aa948390 handle_written_filepage() at handle_written_filepage+0x3e/frame 0xfffffe00aa948400 softdep_disk_write_complete() at softdep_disk_write_complete+0xdd/frame 0xfffffe00aa9484a0 bufdone() at bufdone+0x3bb/frame 0xfffffe00aa948520 ufs_strategy() at ufs_strategy+0x83/frame 0xfffffe00aa948550 VOP_STRATEGY_APV() at VOP_STRATEGY_APV+0x90/frame 0xfffffe00aa948570 bufstrategy() at bufstrategy+0x44/frame 0xfffffe00aa9485a0 bufwrite() at bufwrite+0x249/frame 0xfffffe00aa9485f0 ffs_syncvnode() at ffs_syncvnode+0x2ae/frame 0xfffffe00aa948670 ffs_fsync() at ffs_fsync+0x22/frame 0xfffffe00aa9486b0 VOP_FSYNC_APV() at VOP_FSYNC_APV+0x88/frame 0xfffffe00aa9486d0 ufs_remove() at ufs_remove+0xdf/frame 0xfffffe00aa948730 VOP_REMOVE_APV() at VOP_REMOVE_APV+0xac/frame 0xfffffe00aa948750 kern_unlinkat() at kern_unlinkat+0x1e7/frame 0xfffffe00aa948990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa948ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa948ab0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x800415e9a, rsp = 0x7fffffffe4b8, rbp = 0x7fffffffe5d0 --- Tracing command sshd pid 2328 tid 100206 td 0xfffff800211c05a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00aa9755d0 mi_switch() at mi_switch+0x174/frame 0xfffffe00aa975600 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00aa975640 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00aa9756a0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aa9756d0 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00aa975730 seltdwait() at seltdwait+0x8d/frame 0xfffffe00aa975770 kern_select() at kern_select+0x953/frame 0xfffffe00aa975950 sys_select() at sys_select+0x56/frame 0xfffffe00aa975990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa975ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa975ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80090b04a, rsp = 0x7fffffffa578, rbp = 0x7fffffffa5b0 --- Tracing command sshd pid 2325 tid 100215 td 0xfffff8013eba9000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00aa9a2650 mi_switch() at mi_switch+0x174/frame 0xfffffe00aa9a2680 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00aa9a26c0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00aa9a2720 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aa9a2750 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00aa9a27b0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00aa9a27f0 kern_poll() at kern_poll+0x439/frame 0xfffffe00aa9a2970 sys_poll() at sys_poll+0x50/frame 0xfffffe00aa9a2990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa9a2ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa9a2ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8008ac7da, rsp = 0x7fffffffe5d8, rbp = 0x7fffffffe610 --- Tracing command csh pid 2321 tid 100145 td 0xfffff8000a2a35a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00aa7f3630 mi_switch() at mi_switch+0x174/frame 0xfffffe00aa7f3660 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00aa7f36a0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00aa7f3700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aa7f3730 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00aa7f3790 tty_wait() at tty_wait+0x42/frame 0xfffffe00aa7f37c0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00aa7f3820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00aa7f3850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00aa7f38b0 dofileread() at dofileread+0x81/frame 0xfffffe00aa7f3900 kern_readv() at kern_readv+0x4a/frame 0xfffffe00aa7f3940 sys_read() at sys_read+0x86/frame 0xfffffe00aa7f3990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa7f3ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa7f3ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80050206a, rsp = 0x7fffffffe1e8, rbp = 0x7fffffffe210 --- Tracing command login pid 2320 tid 100214 td 0xfffff8013eba95a0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00aa947af0 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe00aa947b00 trap() at trap+0x5b/frame 0xfffffe00aa947c10 calltrap() at calltrap+0x8/frame 0xfffffe00aa947c10 --- trap 0xc, rip = 0xffffffff8109f4d6, rsp = 0xfffffe00aa947ce0, rbp = 0xfffffe00aa947cf0 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe00aa947cf0 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe00aa947d90 db_command() at db_command+0x279/frame 0xfffffe00aa947e60 db_script_exec() at db_script_exec+0x188/frame 0xfffffe00aa947f00 db_command() at db_command+0x279/frame 0xfffffe00aa947fd0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe00aa947fe0 db_trap() at db_trap+0xef/frame 0xfffffe00aa948070 kdb_trap() at kdb_trap+0x174/frame 0xfffffe00aa9480e0 trap() at trap+0x80b/frame 0xfffffe00aa9481f0 calltrap() at calltrap+0x8/frame 0xfffffe00aa9481f0 --- trap 0x3, rip = 0xffffffff80c29dfb, rsp = 0xfffffe00aa9482c0, rbp = 0xfffffe00aa9482d0 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe00aa9482d0 vpanic() at vpanic+0x1d1/frame 0xfffffe00aa948330 panic() at panic+0x43/frame 0xfffffe00aa948390 handle_written_filepage() at handle_written_filepage+0x3e/frame 0xfffffe00aa948400 softdep_disk_write_complete() at softdep_disk_write_complete+0xdd/frame 0xfffffe00aa9484a0 bufdone() at bufdone+0x3bb/frame 0xfffffe00aa948520 ufs_strategy() at ufs_strategy+0x83/frame 0xfffffe00aa948550 VOP_STRATEGY_APV() at VOP_STRATEGY_APV+0x90/frame 0xfffffe00aa948570 bufstrategy() at bufstrategy+0x44/frame 0xfffffe00aa9485a0 bufwrite() at bufwrite+0x249/frame 0xfffffe00aa9485f0 ffs_syncvnode() at ffs_syncvnode+0x2ae/frame 0xfffffe00aa948670 ffs_fsync() at ffs_fsync+0x22/frame 0xfffffe00aa9486b0 VOP_FSYNC_APV() at VOP_FSYNC_APV+0x88/frame 0xfffffe00aa9486d0 ufs_remove() at ufs_remove+0xdf/frame 0xfffffe00aa948730 VOP_REMOVE_APV() at VOP_REMOVE_APV+0xac/frame 0xfffffe00aa948750 kern_unlinkat() at kern_unlinkat+0x1e7/frame 0xfffffe00aa948990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa948ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa948ab0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x800415e9a, rsp = 0x7fffffffe4b8, rbp = 0x7fffffffe5d0 --- Tracing command getty pid 2319 tid 100213 td 0xfffff8013ebaa000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00aa998630 mi_switch() at mi_switch+0x174/frame 0xfffffe00aa998660 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00aa9986a0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00aa998700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aa998730 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00aa998790 tty_wait() at tty_wait+0x42/frame 0xfffffe00aa9987c0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00aa998820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00aa998850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00aa9988b0 dofileread() at dofileread+0x81/frame 0xfffffe00aa998900 kern_readv() at kern_readv+0x4a/frame 0xfffffe00aa998940 sys_read() at sys_read+0x86/frame 0xfffffe00aa998990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa998ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa998ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043806a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2318 tid 100212 td 0xfffff8000a9615a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00aa993630 mi_switch() at mi_switch+0x174/frame 0xfffffe00aa993660 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00aa9936a0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00aa993700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aa993730 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00aa993790 tty_wait() at tty_wait+0x42/frame 0xfffffe00aa9937c0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00aa993820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00aa993850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00aa9938b0 dofileread() at dofileread+0x81/frame 0xfffffe00aa993900 kern_readv() at kern_readv+0x4a/frame 0xfffffe00aa993940 sys_read() at sys_read+0x86/frame 0xfffffe00aa993990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa993ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa993ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043806a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2317 tid 100211 td 0xfffff8000ad5b000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00aa98e630 mi_switch() at mi_switch+0x174/frame 0xfffffe00aa98e660 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00aa98e6a0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00aa98e700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aa98e730 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00aa98e790 tty_wait() at tty_wait+0x42/frame 0xfffffe00aa98e7c0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00aa98e820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00aa98e850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00aa98e8b0 dofileread() at dofileread+0x81/frame 0xfffffe00aa98e900 kern_readv() at kern_readv+0x4a/frame 0xfffffe00aa98e940 sys_read() at sys_read+0x86/frame 0xfffffe00aa98e990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa98eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa98eab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043806a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2316 tid 100149 td 0xfffff8000ad67000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00aa809630 mi_switch() at mi_switch+0x174/frame 0xfffffe00aa809660 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00aa8096a0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00aa809700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aa809730 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00aa809790 tty_wait() at tty_wait+0x42/frame 0xfffffe00aa8097c0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00aa809820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00aa809850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00aa8098b0 dofileread() at dofileread+0x81/frame 0xfffffe00aa809900 kern_readv() at kern_readv+0x4a/frame 0xfffffe00aa809940 sys_read() at sys_read+0x86/frame 0xfffffe00aa809990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa809ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa809ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043806a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2315 tid 100207 td 0xfffff8000ad66000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00aa97a630 mi_switch() at mi_switch+0x174/frame 0xfffffe00aa97a660 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00aa97a6a0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00aa97a700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aa97a730 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00aa97a790 tty_wait() at tty_wait+0x42/frame 0xfffffe00aa97a7c0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00aa97a820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00aa97a850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00aa97a8b0 dofileread() at dofileread+0x81/frame 0xfffffe00aa97a900 kern_readv() at kern_readv+0x4a/frame 0xfffffe00aa97a940 sys_read() at sys_read+0x86/frame 0xfffffe00aa97a990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa97aab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa97aab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043806a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2314 tid 100208 td 0xfffff8000ad655a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00aa97f630 mi_switch() at mi_switch+0x174/frame 0xfffffe00aa97f660 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00aa97f6a0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00aa97f700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aa97f730 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00aa97f790 tty_wait() at tty_wait+0x42/frame 0xfffffe00aa97f7c0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00aa97f820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00aa97f850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00aa97f8b0 dofileread() at dofileread+0x81/frame 0xfffffe00aa97f900 kern_readv() at kern_readv+0x4a/frame 0xfffffe00aa97f940 sys_read() at sys_read+0x86/frame 0xfffffe00aa97f990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa97fab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa97fab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043806a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2313 tid 100209 td 0xfffff8000ad65000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00aa984630 mi_switch() at mi_switch+0x174/frame 0xfffffe00aa984660 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00aa9846a0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00aa984700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aa984730 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00aa984790 tty_wait() at tty_wait+0x42/frame 0xfffffe00aa9847c0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00aa984820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00aa984850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00aa9848b0 dofileread() at dofileread+0x81/frame 0xfffffe00aa984900 kern_readv() at kern_readv+0x4a/frame 0xfffffe00aa984940 sys_read() at sys_read+0x86/frame 0xfffffe00aa984990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa984ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa984ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043806a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2312 tid 100210 td 0xfffff8000ad5b5a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00aa989630 mi_switch() at mi_switch+0x174/frame 0xfffffe00aa989660 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00aa9896a0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00aa989700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aa989730 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00aa989790 tty_wait() at tty_wait+0x42/frame 0xfffffe00aa9897c0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00aa989820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00aa989850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00aa9898b0 dofileread() at dofileread+0x81/frame 0xfffffe00aa989900 kern_readv() at kern_readv+0x4a/frame 0xfffffe00aa989940 sys_read() at sys_read+0x86/frame 0xfffffe00aa989990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa989ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa989ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043806a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2311 tid 100142 td 0xfffff800037a9000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00aa7e4630 mi_switch() at mi_switch+0x174/frame 0xfffffe00aa7e4660 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00aa7e46a0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00aa7e4700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aa7e4730 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00aa7e4790 tty_wait() at tty_wait+0x42/frame 0xfffffe00aa7e47c0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00aa7e4820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00aa7e4850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00aa7e48b0 dofileread() at dofileread+0x81/frame 0xfffffe00aa7e4900 kern_readv() at kern_readv+0x4a/frame 0xfffffe00aa7e4940 sys_read() at sys_read+0x86/frame 0xfffffe00aa7e4990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa7e4ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa7e4ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043806a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command cron pid 2265 tid 100182 td 0xfffff8002170d000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00aa8c6710 mi_switch() at mi_switch+0x174/frame 0xfffffe00aa8c6740 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00aa8c6780 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00aa8c67e0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00aa8c6820 _sleep() at _sleep+0x265/frame 0xfffffe00aa8c68c0 kern_clock_nanosleep() at kern_clock_nanosleep+0x207/frame 0xfffffe00aa8c6950 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00aa8c6990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa8c6ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa8c6ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003db25a, rsp = 0x7fffffffead8, rbp = 0x7fffffffecc0 --- Tracing command sshd pid 2261 tid 100193 td 0xfffff8000adc8000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00aa92d5d0 mi_switch() at mi_switch+0x174/frame 0xfffffe00aa92d600 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00aa92d640 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00aa92d6a0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aa92d6d0 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00aa92d730 seltdwait() at seltdwait+0x8d/frame 0xfffffe00aa92d770 kern_select() at kern_select+0x953/frame 0xfffffe00aa92d950 sys_select() at sys_select+0x56/frame 0xfffffe00aa92d990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa92dab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa92dab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80090b04a, rsp = 0x7fffffffe668, rbp = 0x7fffffffe6a0 --- Tracing command rpc.lockd pid 2182 tid 100200 td 0xfffff800211c15a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00aa95c4f0 mi_switch() at mi_switch+0x174/frame 0xfffffe00aa95c520 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00aa95c560 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00aa95c5c0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00aa95c600 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x185/frame 0xfffffe00aa95c670 svc_run_internal() at svc_run_internal+0xa94/frame 0xfffffe00aa95c7b0 svc_run() at svc_run+0x1ee/frame 0xfffffe00aa95c810 sys_nlm_syscall() at sys_nlm_syscall+0x75b/frame 0xfffffe00aa95c990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa95cab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa95cab0 --- syscall (154, FreeBSD ELF64, sys_nlm_syscall), rip = 0x8002f625a, rsp = 0x7fffffffec08, rbp = 0x7fffffffecc0 --- Tracing command rpc.statd pid 2179 tid 100181 td 0xfffff80003a8d000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00aa8c15b0 mi_switch() at mi_switch+0x174/frame 0xfffffe00aa8c15e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00aa8c1620 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00aa8c1680 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00aa8c16c0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x185/frame 0xfffffe00aa8c1730 seltdwait() at seltdwait+0x6b/frame 0xfffffe00aa8c1770 kern_select() at kern_select+0x953/frame 0xfffffe00aa8c1950 sys_select() at sys_select+0x56/frame 0xfffffe00aa8c1990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa8c1ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa8c1ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80042c04a, rsp = 0x7fffffffea98, rbp = 0x7fffffffebe0 --- Tracing command watchdogd pid 2133 tid 100156 td 0xfffff8000a6885a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00aa82c570 mi_switch() at mi_switch+0x174/frame 0xfffffe00aa82c5a0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00aa82c5e0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00aa82c640 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aa82c670 _sleep() at _sleep+0x2d0/frame 0xfffffe00aa82c710 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00aa82c7a0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00aa82c990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa82cab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa82cab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003c40da, rsp = 0x7fffffffea28, rbp = 0x7fffffffeae0 --- Tracing command rpcbind pid 2054 tid 100178 td 0xfffff800216be5a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00aa8b2630 mi_switch() at mi_switch+0x174/frame 0xfffffe00aa8b2660 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00aa8b26a0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00aa8b2700 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00aa8b2740 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x185/frame 0xfffffe00aa8b27b0 seltdwait() at seltdwait+0x6b/frame 0xfffffe00aa8b27f0 kern_poll() at kern_poll+0x439/frame 0xfffffe00aa8b2970 sys_poll() at sys_poll+0x50/frame 0xfffffe00aa8b2990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa8b2ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa8b2ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003d27da, rsp = 0x7fffffffca38, rbp = 0x7fffffffec50 --- Tracing command syslogd pid 2044 tid 100192 td 0xfffff8000ad665a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00aa9285d0 mi_switch() at mi_switch+0x174/frame 0xfffffe00aa928600 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00aa928640 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00aa9286a0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aa9286d0 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00aa928730 seltdwait() at seltdwait+0x8d/frame 0xfffffe00aa928770 kern_select() at kern_select+0x953/frame 0xfffffe00aa928950 sys_select() at sys_select+0x56/frame 0xfffffe00aa928990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa928ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa928ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80043d04a, rsp = 0x7fffffffe6a8, rbp = 0x7fffffffecc0 --- Tracing command devd pid 1973 tid 100165 td 0xfffff8000adc85a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00aa8595b0 mi_switch() at mi_switch+0x174/frame 0xfffffe00aa8595e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00aa859620 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00aa859680 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00aa8596c0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x185/frame 0xfffffe00aa859730 seltdwait() at seltdwait+0x6b/frame 0xfffffe00aa859770 kern_select() at kern_select+0x953/frame 0xfffffe00aa859950 sys_select() at sys_select+0x56/frame 0xfffffe00aa859990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa859ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa859ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x2fd3ca, rsp = 0x7fffffffcb48, rbp = 0x7fffffffece0 --- Tracing command dhclient pid 1968 tid 100152 td 0xfffff8000a68a000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00aa818630 mi_switch() at mi_switch+0x174/frame 0xfffffe00aa818660 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00aa8186a0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00aa818700 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00aa818740 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x185/frame 0xfffffe00aa8187b0 seltdwait() at seltdwait+0x6b/frame 0xfffffe00aa8187f0 kern_poll() at kern_poll+0x439/frame 0xfffffe00aa818970 sys_poll() at sys_poll+0x50/frame 0xfffffe00aa818990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa818ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa818ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003f57da, rsp = 0x7fffffffec28, rbp = 0x7fffffffec60 --- Tracing command dhclient pid 1924 tid 100151 td 0xfffff8000609e000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00aa813650 mi_switch() at mi_switch+0x174/frame 0xfffffe00aa813680 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00aa8136c0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00aa813720 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aa813750 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00aa8137b0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00aa8137f0 kern_poll() at kern_poll+0x439/frame 0xfffffe00aa813970 sys_poll() at sys_poll+0x50/frame 0xfffffe00aa813990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa813ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa813ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003f57da, rsp = 0x7fffffffec38, rbp = 0x7fffffffec60 --- Tracing command dhclient pid 1921 tid 100168 td 0xfffff8000a960000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00aa8745d0 mi_switch() at mi_switch+0x174/frame 0xfffffe00aa874600 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00aa874640 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00aa8746a0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aa8746d0 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00aa874730 seltdwait() at seltdwait+0x8d/frame 0xfffffe00aa874770 kern_select() at kern_select+0x953/frame 0xfffffe00aa874950 sys_select() at sys_select+0x56/frame 0xfffffe00aa874990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aa874ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa874ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80045404a, rsp = 0x7fffffffe9e8, rbp = 0x7fffffffeaa0 --- Tracing command syncer pid 34 tid 100141 td 0xfffff8000a68a5a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00a39fcdd0 mi_switch() at mi_switch+0x174/frame 0xfffffe00a39fce00 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a39fce40 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00a39fce70 sleeplk() at sleeplk+0x109/frame 0xfffffe00a39fced0 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x1cc/frame 0xfffffe00a39fcf50 __lockmgr_args() at __lockmgr_args+0x5f3/frame 0xfffffe00a39fcff0 ffs_copyonwrite() at ffs_copyonwrite+0x176/frame 0xfffffe00a39fd0a0 ffs_geom_strategy() at ffs_geom_strategy+0xf7/frame 0xfffffe00a39fd0d0 ufs_strategy() at ufs_strategy+0x83/frame 0xfffffe00a39fd100 VOP_STRATEGY_APV() at VOP_STRATEGY_APV+0x90/frame 0xfffffe00a39fd120 bufstrategy() at bufstrategy+0x44/frame 0xfffffe00a39fd150 bufwrite() at bufwrite+0x249/frame 0xfffffe00a39fd1a0 cluster_wbuild() at cluster_wbuild+0x514/frame 0xfffffe00a39fd250 cluster_write() at cluster_write+0x13e/frame 0xfffffe00a39fd320 ffs_write() at ffs_write+0x41d/frame 0xfffffe00a39fd3c0 VOP_WRITE_APV() at VOP_WRITE_APV+0x101/frame 0xfffffe00a39fd4d0 vnode_pager_generic_putpages() at vnode_pager_generic_putpages+0x8f9/frame 0xfffffe00a39fd5b0 VOP_PUTPAGES_APV() at VOP_PUTPAGES_APV+0x88/frame 0xfffffe00a39fd5d0 vnode_pager_putpages() at vnode_pager_putpages+0x7d/frame 0xfffffe00a39fd640 vm_pageout_flush() at vm_pageout_flush+0xfb/frame 0xfffffe00a39fd740 vm_object_page_collect_flush() at vm_object_page_collect_flush+0x239/frame 0xfffffe00a39fd8b0 vm_object_page_clean() at vm_object_page_clean+0x179/frame 0xfffffe00a39fd920 vfs_msync() at vfs_msync+0xee/frame 0xfffffe00a39fd980 sync_fsync() at sync_fsync+0xc5/frame 0xfffffe00a39fd9c0 VOP_FSYNC_APV() at VOP_FSYNC_APV+0x88/frame 0xfffffe00a39fd9e0 sched_sync() at sched_sync+0x284/frame 0xfffffe00a39fda70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a39fdab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a39fdab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vnlru pid 33 tid 100140 td 0xfffff8000a68c000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00a39f8890 mi_switch() at mi_switch+0x174/frame 0xfffffe00a39f88c0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a39f8900 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00a39f8940 _sleep() at _sleep+0x279/frame 0xfffffe00a39f89e0 vnlru_proc() at vnlru_proc+0x94/frame 0xfffffe00a39f8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a39f8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a39f8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100130 td 0xfffff8000a68c5a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006f448d0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006f44900 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f44940 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006f44980 _sleep() at _sleep+0x279/frame 0xfffffe0006f44a20 buf_daemon() at buf_daemon+0xc8/frame 0xfffffe0006f44a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f44ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f44ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100133 td 0xfffff8000a6df5a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006ff38c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ff38f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006ff3930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006ff3970 _sleep() at _sleep+0x279/frame 0xfffffe0006ff3a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe0006ff3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ff3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ff3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100134 td 0xfffff8000a6df000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006ff88c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ff88f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006ff8930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006ff8970 _sleep() at _sleep+0x279/frame 0xfffffe0006ff8a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe0006ff8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ff8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ff8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100135 td 0xfffff8000a6dd5a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006ffd8c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ffd8f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006ffd930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006ffd970 _sleep() at _sleep+0x279/frame 0xfffffe0006ffda10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe0006ffda70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ffdab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ffdab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100136 td 0xfffff8000a6dd000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00a39048c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00a39048f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a3904930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00a3904970 _sleep() at _sleep+0x279/frame 0xfffffe00a3904a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe00a3904a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a3904ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a3904ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100137 td 0xfffff8000a6da5a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00a39e98c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00a39e98f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a39e9930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00a39e9970 _sleep() at _sleep+0x279/frame 0xfffffe00a39e9a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe00a39e9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a39e9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a39e9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100138 td 0xfffff8000a6da000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00a39ee8c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00a39ee8f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a39ee930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00a39ee970 _sleep() at _sleep+0x279/frame 0xfffffe00a39eea10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe00a39eea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a39eeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a39eeab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100139 td 0xfffff8000a6b55a0 (CPU 11) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006bebdf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006bebe10 trap() at trap+0x48/frame 0xfffffe0006bebf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bebf20 --- trap 0x13, rip = 0xffffffff80f46cde, rsp = 0xfffffe00a39f3820, rbp = 0xfffffe00a39f3850 --- vm_pqbatch_process_page() at vm_pqbatch_process_page+0x25e/frame 0xfffffe00a39f3850 vm_pqbatch_submit_page() at vm_pqbatch_submit_page+0x23c/frame 0xfffffe00a39f38c0 vfs_vmio_unwire() at vfs_vmio_unwire+0x9c/frame 0xfffffe00a39f38e0 allocbuf() at allocbuf+0x4fd/frame 0xfffffe00a39f3960 brelse() at brelse+0x421/frame 0xfffffe00a39f39b0 buf_recycle() at buf_recycle+0x2bb/frame 0xfffffe00a39f3a10 bufspace_daemon() at bufspace_daemon+0xd1/frame 0xfffffe00a39f3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a39f3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a39f3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100153 td 0xfffff800037a8000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00aa81d8b0 mi_switch() at mi_switch+0x174/frame 0xfffffe00aa81d8e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00aa81d920 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00aa81d960 _sleep() at _sleep+0x279/frame 0xfffffe00aa81da00 softdep_flush() at softdep_flush+0x287/frame 0xfffffe00aa81da70 fork_exit() at fork_exit+0x84/frame 0xfffffe00aa81dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00aa81dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100202 td 0xfffff800037a6000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00aa8318b0 mi_switch() at mi_switch+0x174/frame 0xfffffe00aa8318e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00aa831920 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00aa831960 _sleep() at _sleep+0x279/frame 0xfffffe00aa831a00 softdep_flush() at softdep_flush+0x287/frame 0xfffffe00aa831a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00aa831ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00aa831ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100537 td 0xfffff80387b075a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00aca818b0 mi_switch() at mi_switch+0x174/frame 0xfffffe00aca818e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00aca81920 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00aca81960 _sleep() at _sleep+0x279/frame 0xfffffe00aca81a00 softdep_flush() at softdep_flush+0x287/frame 0xfffffe00aca81a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00aca81ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00aca81ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vmdaemon pid 31 tid 100129 td 0xfffff8000a3a0000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006f33930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006f33960 sched_bind() at sched_bind+0xdb/frame 0xfffffe0006f33990 vm_page_drain_pqbatch() at vm_page_drain_pqbatch+0x61/frame 0xfffffe0006f339f0 vm_daemon() at vm_daemon+0xae7/frame 0xfffffe0006f33a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f33ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f33ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100128 td 0xfffff8000a3a05a0 (CPU 5) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006ba3df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006ba3e10 trap() at trap+0x48/frame 0xfffffe0006ba3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006ba3f20 --- trap 0x13, rip = 0xffffffff81240e48, rsp = 0xfffffe0006f2e520, rbp = 0xfffffe0006f2e580 --- smp_targeted_tlb_shootdown() at smp_targeted_tlb_shootdown+0x328/frame 0xfffffe0006f2e580 smp_masked_invlpg() at smp_masked_invlpg+0x3e/frame 0xfffffe0006f2e5b0 pmap_invalidate_page() at pmap_invalidate_page+0x160/frame 0xfffffe0006f2e620 pmap_ts_referenced() at pmap_ts_referenced+0x78d/frame 0xfffffe0006f2e6b0 vm_pageout_worker() at vm_pageout_worker+0xf54/frame 0xfffffe0006f2ea30 vm_pageout() at vm_pageout+0x156/frame 0xfffffe0006f2ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f2eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f2eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100131 td 0xfffff8000a6b1000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006fe92a0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006fe92d0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006fe9310 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006fe9340 _sleep() at _sleep+0x2da/frame 0xfffffe0006fe93e0 swap_pager_putpages() at swap_pager_putpages+0x1ec/frame 0xfffffe0006fe9480 vm_pageout_flush() at vm_pageout_flush+0xfb/frame 0xfffffe0006fe9580 vm_pageout_cluster() at vm_pageout_cluster+0x43f/frame 0xfffffe0006fe97f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x30a/frame 0xfffffe0006fe9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006fe9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006fe9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100132 td 0xfffff8000a6ad5a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006fee8f0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006fee920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006fee960 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006fee9a0 _sleep() at _sleep+0x279/frame 0xfffffe0006feea40 uma_reclaim_worker() at uma_reclaim_worker+0xda/frame 0xfffffe0006feea70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006feeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006feeab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon1 pid 29 tid 100127 td 0xfffff8000a2b1000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006f1d8b0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006f1d8e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f1d920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006f1d950 _sleep() at _sleep+0x2da/frame 0xfffffe0006f1d9f0 enc_daemon() at enc_daemon+0x1cf/frame 0xfffffe0006f1da70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f1dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f1dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon0 pid 28 tid 100126 td 0xfffff8000a2b15a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006f188b0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006f188e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f18920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006f18950 _sleep() at _sleep+0x2da/frame 0xfffffe0006f189f0 enc_daemon() at enc_daemon+0x1cf/frame 0xfffffe0006f18a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f18ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f18ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command rand_harvestq pid 27 tid 100123 td 0xfffff8000a3ad000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006f098c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006f098f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f09930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006f09970 _sleep() at _sleep+0x279/frame 0xfffffe0006f09a10 random_kthread() at random_kthread+0x27a/frame 0xfffffe0006f09a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f09ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f09ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sctp_iterator pid 26 tid 100119 td 0xfffff8000a3af000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006ee9910 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ee9940 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006ee9980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006ee99b0 _sleep() at _sleep+0x2da/frame 0xfffffe0006ee9a50 sctp_iterator_thread() at sctp_iterator_thread+0x59/frame 0xfffffe0006ee9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ee9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ee9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod4 pid 25 tid 100118 td 0xfffff8000a2b2000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006ed88e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ed8910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006ed8950 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006ed8990 _sleep() at _sleep+0x279/frame 0xfffffe0006ed8a30 soaio_kproc_loop() at soaio_kproc_loop+0x170/frame 0xfffffe0006ed8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ed8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ed8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod3 pid 24 tid 100117 td 0xfffff8000a2b25a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006ed38e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ed3910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006ed3950 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006ed3990 _sleep() at _sleep+0x279/frame 0xfffffe0006ed3a30 soaio_kproc_loop() at soaio_kproc_loop+0x170/frame 0xfffffe0006ed3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ed3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ed3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod2 pid 23 tid 100116 td 0xfffff8000a2b3000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006ece8e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ece910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006ece950 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006ece990 _sleep() at _sleep+0x279/frame 0xfffffe0006ecea30 soaio_kproc_loop() at soaio_kproc_loop+0x170/frame 0xfffffe0006ecea70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006eceab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006eceab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod1 pid 22 tid 100115 td 0xfffff8000a2b35a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006ec98e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ec9910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006ec9950 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006ec9990 _sleep() at _sleep+0x279/frame 0xfffffe0006ec9a30 soaio_kproc_loop() at soaio_kproc_loop+0x170/frame 0xfffffe0006ec9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ec9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ec9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100096 td 0xfffff80003e46000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e5e930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e5e960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e5e9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e5e9d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e5ea30 usb_process() at usb_process+0x12b/frame 0xfffffe0006e5ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e5eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e5eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100097 td 0xfffff80003e455a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e63930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e63960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e639a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e639d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e63a30 usb_process() at usb_process+0x12b/frame 0xfffffe0006e63a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e63ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e63ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100098 td 0xfffff80003e45000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e68930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e68960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e689a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e689d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e68a30 usb_process() at usb_process+0x12b/frame 0xfffffe0006e68a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e68ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e68ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100099 td 0xfffff80003e445a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e6d930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e6d960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e6d9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e6d9d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e6da30 usb_process() at usb_process+0x12b/frame 0xfffffe0006e6da70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e6dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e6dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100100 td 0xfffff80003e44000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e72930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e72960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e729a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e729d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e72a30 usb_process() at usb_process+0x12b/frame 0xfffffe0006e72a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e72ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e72ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100102 td 0xfffff80003e3a000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e7c930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e7c960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e7c9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e7c9d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e7ca30 usb_process() at usb_process+0x12b/frame 0xfffffe0006e7ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e7cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e7cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100103 td 0xfffff80003fba5a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e81930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e81960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e819a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e819d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e81a30 usb_process() at usb_process+0x12b/frame 0xfffffe0006e81a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e81ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e81ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100104 td 0xfffff80003fba000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e86930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e86960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e869a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e869d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e86a30 usb_process() at usb_process+0x12b/frame 0xfffffe0006e86a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e86ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e86ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100105 td 0xfffff80003fb95a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e8b930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e8b960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e8b9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e8b9d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e8ba30 usb_process() at usb_process+0x12b/frame 0xfffffe0006e8ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e8bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e8bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100106 td 0xfffff80003fb9000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e90930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e90960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e909a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e909d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e90a30 usb_process() at usb_process+0x12b/frame 0xfffffe0006e90a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e90ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e90ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100107 td 0xfffff800060a9000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006ea1930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ea1960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006ea19a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006ea19d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006ea1a30 usb_process() at usb_process+0x12b/frame 0xfffffe0006ea1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ea1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ea1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100108 td 0xfffff800060a85a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006ea6930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ea6960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006ea69a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006ea69d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006ea6a30 usb_process() at usb_process+0x12b/frame 0xfffffe0006ea6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ea6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ea6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100109 td 0xfffff800060a8000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006eab930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006eab960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006eab9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006eab9d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006eaba30 usb_process() at usb_process+0x12b/frame 0xfffffe0006eaba70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006eabab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006eabab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100110 td 0xfffff800060a75a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006eb0930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006eb0960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006eb09a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006eb09d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006eb0a30 usb_process() at usb_process+0x12b/frame 0xfffffe0006eb0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006eb0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006eb0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100111 td 0xfffff800060a7000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006eb5930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006eb5960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006eb59a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006eb59d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006eb5a30 usb_process() at usb_process+0x12b/frame 0xfffffe0006eb5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006eb5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006eb5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100091 td 0xfffff8000393c000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e458e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e45910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e45950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e45980 _sleep() at _sleep+0x2da/frame 0xfffffe0006e45a20 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe0006e45a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e45ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e45ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100092 td 0xfffff80003a905a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e4a8e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e4a910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e4a950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e4a980 _sleep() at _sleep+0x2da/frame 0xfffffe0006e4aa20 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe0006e4aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e4aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e4aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100093 td 0xfffff80003a90000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e4f8e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e4f910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e4f950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e4f980 _sleep() at _sleep+0x2da/frame 0xfffffe0006e4fa20 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe0006e4fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e4fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e4fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100125 td 0xfffff8000a3ac000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006f138d0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006f13900 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f13940 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006f13970 _sleep() at _sleep+0x2da/frame 0xfffffe0006f13a10 xpt_scanner_thread() at xpt_scanner_thread+0x93/frame 0xfffffe0006f13a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f13ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f13ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 11 pid 19 tid 100090 td 0xfffff8000393c5a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e408c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e408f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e40930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e40960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e40a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e40a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e40ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e40ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 10 pid 18 tid 100089 td 0xfffff8000393d000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e3b8c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e3b8f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e3b930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e3b960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e3ba00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e3ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e3bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e3bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 9 pid 17 tid 100088 td 0xfffff8000393d5a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e368c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e368f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e36930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e36960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e36a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e36a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e36ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e36ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 8 pid 16 tid 100087 td 0xfffff8000393e000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e318c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e318f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e31930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e31960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e31a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e31a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e31ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e31ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 7 pid 15 tid 100086 td 0xfffff8000393e5a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e2c8c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e2c8f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e2c930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e2c960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e2ca00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e2ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e2cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e2cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 6 pid 9 tid 100085 td 0xfffff8000393f000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e278c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e278f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e27930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e27960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e27a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e27a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e27ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e27ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 5 pid 8 tid 100084 td 0xfffff8000393f5a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e228c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e228f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e22930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e22960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e22a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e22a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e22ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e22ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 4 pid 7 tid 100083 td 0xfffff80003940000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e1d8c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e1d8f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e1d930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e1d960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e1da00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e1da70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e1dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e1dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 3 pid 6 tid 100082 td 0xfffff8000391d5a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e188c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e188f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e18930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e18960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e18a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e18a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e18ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e18ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 2 pid 5 tid 100081 td 0xfffff80003929000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e138c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e138f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e13930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e13960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e13a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e13a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e13ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e13ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 1 pid 4 tid 100080 td 0xfffff800039295a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e0e8c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e0e8f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e0e930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e0e960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e0ea00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e0ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e0eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e0eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 0 pid 3 tid 100079 td 0xfffff8000392a000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e098c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e098f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e09930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e09960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e09a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e09a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e09ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e09ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 2 tid 100078 td 0xfffff8000392a5a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e048f0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e04920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e04960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e04990 _sleep() at _sleep+0x2da/frame 0xfffffe0006e04a30 crypto_proc() at crypto_proc+0x2c4/frame 0xfffffe0006e04a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e04ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e04ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sequencer 00 pid 14 tid 100065 td 0xfffff8000391d000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00005c08f0 mi_switch() at mi_switch+0x174/frame 0xfffffe00005c0920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005c0960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005c0990 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe00005c09f0 seq_eventthread() at seq_eventthread+0xdc/frame 0xfffffe00005c0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005c0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005c0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100061 td 0xfffff800037dc000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00005948f0 mi_switch() at mi_switch+0x174/frame 0xfffffe0000594920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000594960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000594990 _sleep() at _sleep+0x2da/frame 0xfffffe0000594a30 g_run_events() at g_run_events+0x4f/frame 0xfffffe0000594a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000594ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000594ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100062 td 0xfffff800037db5a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00005998f0 mi_switch() at mi_switch+0x174/frame 0xfffffe0000599920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000599960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000599990 _sleep() at _sleep+0x2da/frame 0xfffffe0000599a30 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0000599a60 g_up_procbody() at g_up_procbody+0x6d/frame 0xfffffe0000599a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000599ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000599ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100063 td 0xfffff800037db000 sched_switch() at sched_switch+0x71a/frame 0xfffffe000059e8f0 mi_switch() at mi_switch+0x174/frame 0xfffffe000059e920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000059e960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000059e990 _sleep() at _sleep+0x2da/frame 0xfffffe000059ea30 g_io_schedule_down() at g_io_schedule_down+0x14c/frame 0xfffffe000059ea60 g_down_procbody() at g_down_procbody+0x6d/frame 0xfffffe000059ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe000059eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000059eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100016 td 0xfffff800036ca5a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100020 td 0xfffff800036f15a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00767c79e0 mi_switch() at mi_switch+0x174/frame 0xfffffe00767c7a10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe00767c7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00767c7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00767c7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100021 td 0xfffff800036f1000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00767cc9e0 mi_switch() at mi_switch+0x174/frame 0xfffffe00767cca10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe00767cca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00767ccab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00767ccab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100047 td 0xfffff800037d0000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00004ee9e0 mi_switch() at mi_switch+0x174/frame 0xfffffe00004eea10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe00004eea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004eeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004eeab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100048 td 0xfffff800037cf5a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100049 td 0xfffff800037cf000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100050 td 0xfffff800037ce5a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100051 td 0xfffff800037ce000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100052 td 0xfffff800037cd5a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100053 td 0xfffff800037cd000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100054 td 0xfffff800037bf5a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100055 td 0xfffff800037bf000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100056 td 0xfffff800037de5a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100057 td 0xfffff800037de000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100058 td 0xfffff800037dd5a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100059 td 0xfffff800037dd000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100060 td 0xfffff800037dc5a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe000052f9e0 mi_switch() at mi_switch+0x174/frame 0xfffffe000052fa10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe000052fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000052fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000052fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100094 td 0xfffff80003e47000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e549e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e54a10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe0006e54a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e54ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e54ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100095 td 0xfffff80003e465a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e599e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e59a10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe0006e59a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e59ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e59ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100101 td 0xfffff80003e3a5a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006e779e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e77a10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe0006e77a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e77ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e77ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100112 td 0xfffff800060a65a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100113 td 0xfffff800060a6000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006ebf9e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ebfa10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe0006ebfa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ebfab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ebfab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100183 td 0xfffff8002170c5a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100184 td 0xfffff8002170c000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100185 td 0xfffff8002170b5a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100186 td 0xfffff8002170b000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100187 td 0xfffff8002170a5a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100188 td 0xfffff8002170a000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100189 td 0xfffff800211cc5a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100190 td 0xfffff800218d75a0 fork_trampoline() at fork_trampoline Tracing command idle pid 11 tid 100003 td 0xfffff800036bb000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0076766940 mi_switch() at mi_switch+0x174/frame 0xfffffe0076766970 critical_exit_preempt() at critical_exit_preempt+0x66/frame 0xfffffe0076766990 sched_idletd() at sched_idletd+0x482/frame 0xfffffe0076766a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076766ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076766ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffff800036ba5a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe007676b940 mi_switch() at mi_switch+0x174/frame 0xfffffe007676b970 critical_exit_preempt() at critical_exit_preempt+0x66/frame 0xfffffe007676b990 sched_idletd() at sched_idletd+0x482/frame 0xfffffe007676ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe007676bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007676bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffff800036ba000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0076770940 mi_switch() at mi_switch+0x174/frame 0xfffffe0076770970 critical_exit_preempt() at critical_exit_preempt+0x66/frame 0xfffffe0076770990 sched_idletd() at sched_idletd+0x482/frame 0xfffffe0076770a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076770ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076770ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffff800036b95a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe0076775940 mi_switch() at mi_switch+0x174/frame 0xfffffe0076775970 critical_exit_preempt() at critical_exit_preempt+0x66/frame 0xfffffe0076775990 sched_idletd() at sched_idletd+0x482/frame 0xfffffe0076775a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076775ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076775ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffff800036b9000 sched_switch() at sched_switch+0x71a/frame 0xfffffe007677a960 mi_switch() at mi_switch+0x174/frame 0xfffffe007677a990 sched_idletd() at sched_idletd+0xb6/frame 0xfffffe007677aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe007677aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007677aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffff800036b85a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe007677f960 mi_switch() at mi_switch+0x174/frame 0xfffffe007677f990 sched_idletd() at sched_idletd+0xb6/frame 0xfffffe007677fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe007677fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007677fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffff800036b8000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0076784960 mi_switch() at mi_switch+0x174/frame 0xfffffe0076784990 sched_idletd() at sched_idletd+0x4d4/frame 0xfffffe0076784a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076784ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076784ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffff800036cd5a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe0076789940 mi_switch() at mi_switch+0x174/frame 0xfffffe0076789970 critical_exit_preempt() at critical_exit_preempt+0x66/frame 0xfffffe0076789990 sched_idletd() at sched_idletd+0x482/frame 0xfffffe0076789a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076789ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076789ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffff800036cd000 sched_switch() at sched_switch+0x71a/frame 0xfffffe007678e940 mi_switch() at mi_switch+0x174/frame 0xfffffe007678e970 critical_exit_preempt() at critical_exit_preempt+0x66/frame 0xfffffe007678e990 sched_idletd() at sched_idletd+0x482/frame 0xfffffe007678ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe007678eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007678eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffff800036cc5a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe0076793940 mi_switch() at mi_switch+0x174/frame 0xfffffe0076793970 critical_exit_preempt() at critical_exit_preempt+0x66/frame 0xfffffe0076793990 sched_idletd() at sched_idletd+0x482/frame 0xfffffe0076793a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076793ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076793ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffff800036cc000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0076798940 mi_switch() at mi_switch+0x174/frame 0xfffffe0076798970 critical_exit_preempt() at critical_exit_preempt+0x66/frame 0xfffffe0076798990 sched_idletd() at sched_idletd+0x482/frame 0xfffffe0076798a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076798ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076798ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffff800036cb5a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe007679d940 mi_switch() at mi_switch+0x174/frame 0xfffffe007679d970 critical_exit_preempt() at critical_exit_preempt+0x66/frame 0xfffffe007679d990 sched_idletd() at sched_idletd+0x482/frame 0xfffffe007679da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007679dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007679dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command init pid 1 tid 100002 td 0xfffff800036bb5a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe0076761570 mi_switch() at mi_switch+0x174/frame 0xfffffe00767615a0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00767615e0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe0076761640 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe0076761670 _sleep() at _sleep+0x2d0/frame 0xfffffe0076761710 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00767617a0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe0076761990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe0076761ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0076761ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x2b249a, rsp = 0x7fffffffe778, rbp = 0x7fffffffe7e0 --- Tracing command audit pid 10 tid 100001 td 0xfffff800036bc000 sched_switch() at sched_switch+0x71a/frame 0xfffffe007675c910 mi_switch() at mi_switch+0x174/frame 0xfffffe007675c940 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe007675c980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe007675c9b0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe007675ca10 audit_worker() at audit_worker+0x93/frame 0xfffffe007675ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe007675cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007675cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xffffffff820946c0 sched_switch() at sched_switch+0x71a/frame 0xffffffff828fc720 mi_switch() at mi_switch+0x174/frame 0xffffffff828fc750 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffffff828fc790 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xffffffff828fc7d0 _sleep() at _sleep+0x279/frame 0xffffffff828fc870 swap_pager_getpages() at swap_pager_getpages+0x49e/frame 0xffffffff828fc8e0 vm_pager_get_pages() at vm_pager_get_pages+0x4e/frame 0xffffffff828fc930 faultin() at faultin+0x273/frame 0xffffffff828fcad0 swapper() at swapper+0x2e1/frame 0xffffffff828fcb20 mi_startup() at mi_startup+0x2e7/frame 0xffffffff828fcb70 btext() at btext+0x2c Tracing command kernel pid 0 tid 100015 td 0xfffff800036cb000 (CPU 6) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006bafdf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006bafe10 trap() at trap+0x48/frame 0xfffffe0006baff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006baff20 --- trap 0x13, rip = 0xffffffff80c47b80, rsp = 0xfffffe00767ae9a0, rbp = 0xfffffe00767ae9e0 --- vmem_periodic() at vmem_periodic+0x100/frame 0xfffffe00767ae9e0 taskqueue_run_locked() at taskqueue_run_locked+0x10c/frame 0xfffffe00767aea40 taskqueue_thread_loop() at taskqueue_thread_loop+0x88/frame 0xfffffe00767aea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00767aeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00767aeab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100017 td 0xfffff800036ca000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00767b8930 mi_switch() at mi_switch+0x174/frame 0xfffffe00767b8960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00767b89a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00767b89d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe00767b8a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00767b8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00767b8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00767b8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100018 td 0xfffff800036bc5a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00767bd900 mi_switch() at mi_switch+0x174/frame 0xfffffe00767bd930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00767bd970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00767bd9a0 _sleep() at _sleep+0x2da/frame 0xfffffe00767bda40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00767bda70 fork_exit() at fork_exit+0x84/frame 0xfffffe00767bdab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00767bdab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100019 td 0xfffff800036f2000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00767c2900 mi_switch() at mi_switch+0x174/frame 0xfffffe00767c2930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00767c2970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00767c29a0 _sleep() at _sleep+0x2da/frame 0xfffffe00767c2a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00767c2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00767c2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00767c2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xfffff800036f05a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe0000471930 mi_switch() at mi_switch+0x174/frame 0xfffffe0000471960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004719a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004719d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe0000471a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000471a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000471ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000471ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xfffff800036f0000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0000476930 mi_switch() at mi_switch+0x174/frame 0xfffffe0000476960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004769a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004769d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe0000476a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000476a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000476ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000476ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xfffff800036ef5a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe000047b930 mi_switch() at mi_switch+0x174/frame 0xfffffe000047b960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000047b9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000047b9d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe000047ba40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000047ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe000047bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000047bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xfffff800036ef000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0000480930 mi_switch() at mi_switch+0x174/frame 0xfffffe0000480960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004809a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004809d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe0000480a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000480a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000480ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000480ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100026 td 0xfffff800036ee5a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe0000485930 mi_switch() at mi_switch+0x174/frame 0xfffffe0000485960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004859a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004859d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe0000485a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000485a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000485ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000485ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100027 td 0xfffff800036ee000 sched_switch() at sched_switch+0x71a/frame 0xfffffe000048a930 mi_switch() at mi_switch+0x174/frame 0xfffffe000048a960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000048a9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000048a9d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe000048aa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000048aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000048aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000048aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100028 td 0xfffff800037275a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe000048f930 mi_switch() at mi_switch+0x174/frame 0xfffffe000048f960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000048f9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000048f9d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe000048fa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000048fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000048fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000048fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100029 td 0xfffff80003727000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0000494930 mi_switch() at mi_switch+0x174/frame 0xfffffe0000494960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004949a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004949d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe0000494a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000494a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000494ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000494ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100030 td 0xfffff800037265a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe0000499930 mi_switch() at mi_switch+0x174/frame 0xfffffe0000499960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004999a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004999d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe0000499a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000499a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000499ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000499ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100031 td 0xfffff80003726000 sched_switch() at sched_switch+0x71a/frame 0xfffffe000049e930 mi_switch() at mi_switch+0x174/frame 0xfffffe000049e960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000049e9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000049e9d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe000049ea40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000049ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe000049eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000049eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100032 td 0xfffff800037255a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00004a3930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004a3960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004a39a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004a39d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe00004a3a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004a3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004a3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004a3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100033 td 0xfffff80003725000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00004a8930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004a8960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004a89a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004a89d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe00004a8a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004a8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004a8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004a8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100034 td 0xfffff800037245a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00004ad930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004ad960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004ad9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004ad9d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe00004ada40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004ada70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004adab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004adab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100035 td 0xfffff80003724000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00004b2930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004b2960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004b29a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004b29d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe00004b2a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004b2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004b2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004b2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100036 td 0xfffff800036f25a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00004b7930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004b7960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004b79a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004b79d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe00004b7a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004b7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004b7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004b7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100037 td 0xfffff800037a1000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00004bc930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004bc960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004bc9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004bc9d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe00004bca40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004bca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004bcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004bcab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100038 td 0xfffff800037a05a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00004c1930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004c1960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004c19a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004c19d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe00004c1a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004c1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004c1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004c1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100039 td 0xfffff800037a0000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00004c6930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004c6960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004c69a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004c69d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe00004c6a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004c6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004c6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004c6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100040 td 0xfffff8000379f5a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00004cb930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004cb960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004cb9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004cb9d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe00004cba40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004cba70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004cbab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004cbab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100041 td 0xfffff8000379f000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00004d0930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004d0960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004d09a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004d09d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe00004d0a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004d0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004d0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004d0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100042 td 0xfffff8000379e5a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00004d5930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004d5960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004d59a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004d59d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe00004d5a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004d5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004d5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004d5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100043 td 0xfffff8000379e000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00004da930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004da960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004da9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004da9d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe00004daa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004daa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004daab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004daab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100044 td 0xfffff8000379d5a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00004df930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004df960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004df9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004df9d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe00004dfa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004dfa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004dfab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004dfab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100045 td 0xfffff8000379d000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00004e4930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004e4960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004e49a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004e49d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe00004e4a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004e4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004e4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004e4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100046 td 0xfffff800037a95a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00004e9930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004e9960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004e99a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004e99d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe00004e9a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004e9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004e9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004e9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100064 td 0xfffff800037d05a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00005af900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005af930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005af970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005af9a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005afa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005afa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005afab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005afab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100066 td 0xfffff8000391c5a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00005c5900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005c5930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005c5970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005c59a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005c5a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005c5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005c5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005c5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100067 td 0xfffff8000391c000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00005ca900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005ca930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005ca970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005ca9a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005caa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005caa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005caab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005caab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100068 td 0xfffff8000391b5a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00005cf900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005cf930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005cf970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005cf9a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005cfa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005cfa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005cfab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005cfab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100069 td 0xfffff8000391b000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00005d4900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005d4930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005d4970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005d49a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005d4a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005d4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005d4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005d4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100070 td 0xfffff8000391a5a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00005d9900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005d9930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005d9970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005d99a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005d9a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005d9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005d9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005d9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100071 td 0xfffff8000391a000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00005de900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005de930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005de970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005de9a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005dea40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005dea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005deab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005deab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100072 td 0xfffff800039195a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00005e3900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005e3930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005e3970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005e39a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005e3a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005e3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005e3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005e3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100073 td 0xfffff80003919000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00005e8900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005e8930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005e8970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005e89a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005e8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005e8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005e8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005e8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100074 td 0xfffff800039305a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00005ed900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005ed930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005ed970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005ed9a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005eda40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005eda70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005edab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005edab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100075 td 0xfffff80003930000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00005f2900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005f2930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005f2970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005f29a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005f2a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005f2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005f2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005f2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100076 td 0xfffff8000392f5a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe00005f7900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005f7930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005f7970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005f79a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005f7a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005f7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005f7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005f7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100077 td 0xfffff8000392f000 sched_switch() at sched_switch+0x71a/frame 0xfffffe00005fc900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005fc930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005fc970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005fc9a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005fca40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005fca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005fcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005fcab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100114 td 0xfffff8000609e5a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006ec4930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ec4960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006ec49a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006ec49d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe0006ec4a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0006ec4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ec4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ec4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100120 td 0xfffff8000a3ae5a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006efa930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006efa960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006efa9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006efa9d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe0006efaa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0006efaa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006efaab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006efaab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100121 td 0xfffff8000a3ae000 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006eff930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006eff960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006eff9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006eff9d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe0006effa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0006effa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006effab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006effab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100122 td 0xfffff8000a3ad5a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006f04930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006f04960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f049a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006f049d0 msleep_spin_sbt() at msleep_spin_sbt+0x143/frame 0xfffffe0006f04a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0006f04a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f04ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f04ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100124 td 0xfffff8000a3ac5a0 sched_switch() at sched_switch+0x71a/frame 0xfffffe0006f0e900 mi_switch() at mi_switch+0x174/frame 0xfffffe0006f0e930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f0e970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006f0e9a0 _sleep() at _sleep+0x2da/frame 0xfffffe0006f0ea40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0006f0ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f0eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f0eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:pho> dump Dumping 1675 out of 32621 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% Dump complete db> (kgdb) bt #0 doadump (textdump=) at pcpu.h:230 #1 0xffffffff8049badb in db_dump (dummy=, dummy2=, dummy3=, dummy4=) at ../../../ddb/db_command.c:574 #2 0xffffffff8049b8a9 in db_command (cmd_table=, dopager=0x0) at ../../../ddb/db_command.c:481 #3 0xffffffff804a07c8 in db_script_exec (scriptname=, warnifnotfound=) at ../../../ddb/db_script.c:304 #4 0xffffffff8049b8a9 in db_command (cmd_table=, dopager=0x1) at ../../../ddb/db_command.c:481 #5 0xffffffff8049b624 in db_command_loop () at ../../../ddb/db_command.c:534 #6 0xffffffff8049e7df in db_trap (type=, code=) at ../../../ddb/db_main.c:252 #7 0xffffffff80c2a6f4 in kdb_trap (type=0x3, code=0x0, tf=) at ../../../kern/subr_kdb.c:692 #8 0xffffffff810c6f9b in trap (frame=0xfffffe00aa948200) at ../../../amd64/amd64/trap.c:619 #9 0xffffffff810a1305 in calltrap () at ../../../amd64/amd64/exception.S:232 #10 0xffffffff80c29dfb in kdb_enter (why=0xffffffff81359562 "panic", msg=) at cpufunc.h:65 #11 0xffffffff80be2221 in vpanic (fmt=, ap=0xfffffe00aa948370) at ../../../kern/kern_shutdown.c:866 #12 0xffffffff80be1fb3 in panic (fmt=) at ../../../kern/kern_shutdown.c:804 #13 0xffffffff80efdb1e in handle_written_filepage (pagedep=0xfffff80427631200, bp=0xfffffe000222a370, flags=0x0) at ../../../ufs/ffs/ffs_softdep.c:12122 #14 0xffffffff80ed840d in softdep_disk_write_complete (bp=0xfffffe000222a370) at ../../../ufs/ffs/ffs_softdep.c:11056 #15 0xffffffff80c9664b in bufdone (bp=) at buf.h:439 #16 0xffffffff80f1a243 in ufs_strategy (ap=) at ../../../ufs/ufs/ufs_vnops.c:2325 #17 0xffffffff8124d960 in VOP_STRATEGY_APV (vop=0xffffffff81b655c0, a=0xfffffe00aa948580) at vnode_if.c:2246 #18 0xffffffff80c91164 in bufstrategy (bo=, bp=0xfffffe000222a370) at vnode_if.h:940 #19 0xffffffff80c90ff9 in bufwrite (bp=0xfffffe000222a370) at buf.h:425 #20 0xffffffff80f08ebe in ffs_syncvnode (vp=0xfffff806b66d7000, waitfor=0x1, flags=0x0) at buf.h:413 #21 0xffffffff80f07f62 in ffs_fsync (ap=0xfffffe00aa9486e8) at ../../../ufs/ffs/ffs_vnops.c:201 #22 0xffffffff8124c358 in VOP_FSYNC_APV (vop=0xffffffff81b64880, a=0xfffffe00aa9486e8) at vnode_if.c:1312 #23 0xffffffff80f17e7f in ufs_remove (ap=0xfffffe00aa948930) at vnode_if.h:549 #24 0xffffffff8124c4fc in VOP_REMOVE_APV (vop=0xffffffff81b655c0, a=0xfffffe00aa948930) at vnode_if.c:1380 #25 0xffffffff80cbfd27 in kern_unlinkat (td=0xfffff800037a65a0, fd=0xffffff9c, path=0x7fffffffeb16
, pathseg=UIO_USERSPACE, flag=, oldinum=) at vnode_if.h:575 #26 0xffffffff810c7eb1 in amd64_syscall (td=0xfffff800037a65a0, traced=0x0) at subr_syscall.c:135 #27 0xffffffff810a1bed in fast_syscall_common () at ../../../amd64/amd64/exception.S:504 #28 0x0000000800415e9a in ?? () Previous frame inner to this frame (corrupt stack?) Current language: auto; currently minimal (kgdb) f 13 #13 0xffffffff80efdb1e in handle_written_filepage (pagedep=0xfffff80427631200, bp=0xfffffe000222a370, flags=0x0) at ../../../ufs/ffs/ffs_softdep.c:12122 12122 panic("handle_written_filepage: not started"); (kgdb) l 12117 struct diradd *dap, *nextdap; 12118 struct direct *ep; 12119 int i, chgs; 12120 12121 if ((pagedep->pd_state & IOSTARTED) == 0) 12122 panic("handle_written_filepage: not started"); 12123 pagedep->pd_state &= ~IOSTARTED; 12124 if ((flags & WRITESUCCEEDED) == 0) 12125 goto rollforward; 12126 /* (kgdb) info loc dirrem = (struct dirrem *) 0xfffffe000222a370 dap = (struct diradd *) 0xfffff80112e6cc18 nextdap = (struct diradd *) 0xffffffff80bdcf93 ep = (struct direct *) 0xfffffe00aa948400 i = 0xffffffff chgs = 0x812d6f47 (kgdb) p *pagedep $1 = {pd_list = {wk_list = {le_next = 0x0, le_prev = 0xfffffe000222a620}, wk_mp = 0xfffff801ac4a2000, wk_type = 0x1, wk_state = 0x8000}, pd_hash = {le_next = 0x0, le_prev = 0xfffffe00ad20c018}, pd_ino = 0x3, pd_lbn = 0x0, pd_newdirblk = 0x0, pd_dirremhd = {lh_first = 0xfffff8000a5ac880}, pd_diraddhd = 0xfffff80427631250, pd_pendinghd = {lh_first = 0x0}, pd_jmvrefhd = {lh_first = 0x0}} (kgdb) #define ONWORKLIST 0x008000 (kgdb) f 14 #14 0xffffffff80ed840d in softdep_disk_write_complete (bp=0xfffffe000222a370) at ../../../ufs/ffs/ffs_softdep.c:11056 11056 handle_written_filepage(WK_PAGEDEP(wk), bp, 0); (kgdb) l 11051 if ((bp->b_ioflags & BIO_ERROR) != 0 && (bp->b_flags & B_INVAL) == 0) { 11052 LIST_FOREACH(wk, &bp->b_dep, wk_list) { 11053 switch (wk->wk_type) { 11054 11055 case D_PAGEDEP: 11056 handle_written_filepage(WK_PAGEDEP(wk), bp, 0); 11057 continue; 11058 11059 case D_INODEDEP: 11060 handle_written_inodeblock(WK_INODEDEP(wk), (kgdb) info loc wk = (struct worklist *) 0xfffff80427631200 owk = (struct worklist *) 0xffffffff80bdda59 ump = (struct ufsmount *) 0xfffff8000a88fa00 reattach = {lh_first = 0xfffff8086bc86a90} freeblks = (struct freeblks *) 0xfffff805d1dd1918 sbp = (struct buf *) 0x0 (kgdb) p *bp $2 = {b_bufobj = 0xfffff806b66d7168, b_bcount = 0x1000, b_caller1 = 0x0, b_data = 0xfffffe0008600000 "\003", b_error = 0x1c, b_iocmd = 0x2, b_ioflags = 0x1, b_iooffset = 0x1038000, b_resid = 0x0, b_iodone = 0, b_ckhashcalc = 0, b_ckhash = 0x0, b_blkno = 0x81c0, b_offset = 0x0, b_bobufs = {tqe_next = 0x0, tqe_prev = 0xfffff806b66d71b0}, b_vflags = 0x1, b_qindex = 0x2, b_domain = 0x2, b_subqueue = 0xffff, b_flags = 0xa0000020, b_xflags = 0x2, b_lock = {lock_object = { lo_name = 0xffffffff81393d68 "bufwait", lo_flags = 0x26730000, lo_data = 0x0, lo_witness = 0xfffff8087fd71200}, lk_lock = 0xfffff800037a65a0, lk_exslpfail = 0x0, lk_timo = 0x0, lk_pri = 0x60, lk_stack = {depth = 0xa, pcs = 0xfffffe000222a428}}, b_bufsize = 0x1000, b_runningbufspace = 0x0, b_kvasize = 0x8000, b_dirtyoff = 0x0, b_dirtyend = 0x0, b_kvabase = 0xfffffe0008600000 "\003", b_lblkno = 0x0, b_vp = 0xfffff806b66d7000, b_rcred = 0x0, b_wcred = 0x0, {b_freelist = {tqe_next = 0x0, tqe_prev = 0xfffffe000085ba00}, {b_pgiodone = 0, b_pgbefore = 0x85ba00, b_pgafter = 0xfffffe00}}, b_cluster = {cluster_head = {tqh_first = 0xfffffe00020ea390, tqh_last = 0xfffff8000a81c598}, cluster_entry = {tqe_next = 0xfffffe00020ea390, tqe_prev = 0xfffff8000a81c598}}, b_pages = 0xfffffe000222a518, b_npages = 0x1, b_dep = { lh_first = 0xfffff80427631200}, b_fsprivate1 = 0x0, b_fsprivate2 = 0x0, b_fsprivate3 = 0x0, b_io_tracking = 0xfffffe000222a640, b_io_tcnt = 0x2560f} (kgdb) p *wk $3 = {wk_list = {le_next = 0x0, le_prev = 0xfffffe000222a620}, wk_mp = 0xfffff801ac4a2000, wk_type = 0x1, wk_state = 0x8000} (kgdb) p *bp $4 = {b_bufobj = 0xfffff806b66d7168, b_bcount = 0x1000, b_caller1 = 0x0, b_data = 0xfffffe0008600000 "\003", b_error = 0x1c, b_iocmd = 0x2, b_ioflags = 0x1, b_iooffset = 0x1038000, b_resid = 0x0, b_iodone = 0, b_ckhashcalc = 0, b_ckhash = 0x0, b_blkno = 0x81c0, b_offset = 0x0, b_bobufs = {tqe_next = 0x0, tqe_prev = 0xfffff806b66d71b0}, b_vflags = 0x1, b_qindex = 0x2, b_domain = 0x2, b_subqueue = 0xffff, b_flags = 0xa0000020, b_xflags = 0x2, b_lock = {lock_object = { lo_name = 0xffffffff81393d68 "bufwait", lo_flags = 0x26730000, lo_data = 0x0, lo_witness = 0xfffff8087fd71200}, lk_lock = 0xfffff800037a65a0, lk_exslpfail = 0x0, lk_timo = 0x0, lk_pri = 0x60, lk_stack = {depth = 0xa, pcs = 0xfffffe000222a428}}, b_bufsize = 0x1000, b_runningbufspace = 0x0, b_kvasize = 0x8000, b_dirtyoff = 0x0, b_dirtyend = 0x0, b_kvabase = 0xfffffe0008600000 "\003", b_lblkno = 0x0, b_vp = 0xfffff806b66d7000, b_rcred = 0x0, b_wcred = 0x0, {b_freelist = {tqe_next = 0x0, tqe_prev = 0xfffffe000085ba00}, {b_pgiodone = 0, b_pgbefore = 0x85ba00, b_pgafter = 0xfffffe00}}, b_cluster = {cluster_head = {tqh_first = 0xfffffe00020ea390, tqh_last = 0xfffff8000a81c598}, cluster_entry = {tqe_next = 0xfffffe00020ea390, tqe_prev = 0xfffff8000a81c598}}, b_pages = 0xfffffe000222a518, b_npages = 0x1, b_dep = { lh_first = 0xfffff80427631200}, b_fsprivate1 = 0x0, b_fsprivate2 = 0x0, b_fsprivate3 = 0x0, b_io_tracking = 0xfffffe000222a640, b_io_tcnt = 0x2560f} (kgdb) p *ump $5 = {um_mountp = 0xfffff801ac4a2000, um_dev = 0xfffff800036e3000, um_cp = 0xfffff8002107f800, um_bo = 0xfffff8000ae618d0, um_devvp = 0xfffff8000ae61768, um_fstype = 0x2, um_fs = 0xfffffe00ad304000, um_extattr = {uepm_lock = {lock_object = {lo_name = 0xffffffff81264015 "ufs_extattr_sx", lo_flags = 0x2330000, lo_data = 0x0, lo_witness = 0xfffff8087fd78600}, sx_lock = 0x1}, uepm_list = {lh_first = 0x0}, uepm_ucred = 0x0, uepm_flags = 0x1}, um_nindir = 0x1000, um_bptrtodb = 0x3, um_seqinc = 0x8, um_lock = {lock_object = {lo_name = 0xffffffff8127937d "FFS", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xfffff8087fd78580}, mtx_lock = 0x0}, um_fsckpid = 0x0, um_softdep = 0xfffff80112e6cc00, um_quotas = 0xfffff8000a88fab8, um_cred = 0xfffff8000a88fac8, um_btime = 0xfffff8000a88fad8, um_itime = 0xfffff8000a88fae8, um_qflags = 0xfffff8000a88faf8 "", um_savedmaxfilesize = 0x0, um_flags = 0x0, um_trim_inflight = 0x0, um_trim_inflight_blks = 0x0, um_trim_total = 0x0, um_trim_total_blks = 0x0, um_trim_tq = 0x0, um_trimhash = 0x0, um_trimlisthashsize = 0x0, um_balloc = 0xffffffff80eccb10 , um_blkatoff = 0xffffffff80f02050 , um_truncate = 0xffffffff80ece9d0 , um_update = 0xffffffff80ece680 , um_valloc = 0xffffffff80ec7470 , um_vfree = 0xffffffff80ec8250 , um_ifree = 0xffffffff80f06d90 , um_rdonly = 0xffffffff80ed0560 , um_snapgone = 0xffffffff80ed41e0 } (kgdb) -- Test scenario: misc/pageout.sh