panic: bio_completed can't be greater than bio_length, vmcore.149 KDB: debugger backends: ddb KDB: current backend: ddb ---<>--- Copyright (c) 1992-2020 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 13.0-CURRENT #0 r357112: Sat Jan 25 11:08:51 CET 2020 pho@mercat1.netperf.freebsd.org:/usr/src/sys/amd64/compile/PHO amd64 FreeBSD clang version 9.0.1 (git@github.com:llvm/llvm-project.git c1a0a213378a458fbea1a5c77b315c7dce08fd05) (based on LLVM 9.0.1) WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. VT(vga): resolution 640x480 CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.07-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics real memory = 34359738368 (32768 MB) avail memory = 33163776000 (31627 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 12 CPUs FreeBSD/SMP: 1 package(s) x 6 core(s) x 2 hardware threads random: registering fast source Intel Secure Key RNG random: fast provider: "Intel Secure Key RNG" random: unblocking device. ioapic0 irqs 0-23 ioapic1 irqs 24-47 Launching APs: 1 9 11 8 4 2 10 7 5 3 6 Timecounter "TSC-low" frequency 1750032720 Hz quality 1000 random: entropy device external interface WARNING: Device "kbd" is Giant locked and may be deleted before FreeBSD 13.0. kbd1 at kbdmux0 000.000055 [4341] netmap_init netmap: loaded module [ath_hal] loaded nexus0 vtvga0: cryptosoft0: acpi0: acpi0: Power Button (fixed) cpu0: on acpi0 atrtc0: port 0x70-0x71,0x74-0x77 irq 8 on acpi0 atrtc0: registered as a time-of-day clock, resolution 1.000000s Event timer "RTC" frequency 32768 Hz quality 0 attimer0: port 0x40-0x43,0x50-0x53 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Event timer "HPET" frequency 14318180 Hz quality 350 Event timer "HPET1" frequency 14318180 Hz quality 340 Event timer "HPET2" frequency 14318180 Hz quality 340 Event timer "HPET3" frequency 14318180 Hz quality 340 Event timer "HPET4" frequency 14318180 Hz quality 340 Event timer "HPET5" frequency 14318180 Hz quality 340 Event timer "HPET6" frequency 14318180 Hz quality 340 Event timer "HPET7" frequency 14318180 Hz quality 340 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 pcib0: on acpi0 pci0: on pcib0 pci0: at device 11.1 (no driver attached) pci0: at device 11.2 (no driver attached) pci0: at device 16.1 (no driver attached) pci0: at device 16.6 (no driver attached) pci0: at device 18.1 (no driver attached) acpi_syscontainer0: on acpi0 acpi_syscontainer1: on acpi0 acpi_syscontainer2: on acpi0 acpi_syscontainer3: on acpi0 pcib1: port 0xcf8-0xcff on acpi0 pci1: on pcib1 pcib2: irq 26 at device 1.0 on pci1 pci2: on pcib2 pcib3: irq 32 at device 2.0 on pci1 pci3: on pcib3 pci3: at device 0.0 (no driver attached) pci3: at device 0.1 (no driver attached) pcib4: irq 40 at device 3.0 on pci1 pci4: on pcib4 pci1: at device 17.0 (no driver attached) ahci0: port 0xf110-0xf117,0xf100-0xf103,0xf0f0-0xf0f7,0xf0e0-0xf0e3,0xf020-0xf03f mem 0xfb438000-0xfb4387ff irq 16 at device 17.4 on pci1 ahci0: AHCI v1.30 with 4 6Gbps ports, Port Multiplier not supported ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahcich2: at channel 2 on ahci0 ahcich3: at channel 3 on ahci0 ahciem0: on ahci0 xhci0: mem 0xfb400000-0xfb40ffff irq 19 at device 20.0 on pci1 xhci0: 32 bytes context size, 64-bit DMA usbus0 on xhci0 usbus0: 5.0Gbps Super Speed USB v3.0 pci1: at device 22.0 (no driver attached) pci1: at device 22.1 (no driver attached) ehci0: mem 0xfb434000-0xfb4343ff irq 18 at device 26.0 on pci1 usbus1: EHCI version 1.0 usbus1 on ehci0 usbus1: 480Mbps High Speed USB v2.0 pcib5: irq 16 at device 28.0 on pci1 pci5: on pcib5 pcib6: irq 18 at device 28.2 on pci1 pci6: on pcib6 pcib7: at device 0.0 on pci6 pci7: on pcib7 vgapci0: port 0xe000-0xe07f mem 0xfa000000-0xfaffffff,0xfb000000-0xfb01ffff irq 18 at device 0.0 on pci7 vgapci0: Boot video device pcib8: irq 16 at device 28.4 on pci1 pci8: on pcib8 igb0: port 0xd020-0xd03f mem 0xfb320000-0xfb33ffff,0xfb344000-0xfb347fff irq 16 at device 0.0 on pci8 igb0: Using 1024 TX descriptors and 1024 RX descriptors igb0: queue equality override not set, nd 1024 RX descriptors igb1: queue equality override not set, capping rx_queues at 6 and tx_queues at 6 igb1: Using 6 RX queues 6 TX queues igb1: Using MSI-X interrupts with 7 vectors igb1: Ethernet address: 0c:c4:7a:a8:cd:db igb1: netmap queues/slots: TX 6/1024, RX 6/1024 ehci1: mem 0xfb433000-0xfb4333ff irq 18 at device 29.0 on pci1 usbus2: EHCI version 1.0 usbus2 on ehci1 usbus2: 480Mbps High Speed USB v2.0 isab0: at device 31.0 on pci1 isa0: on isab0 ahci1: port 0xf070-0xf077,0xf060-0xf063,0xf050-0xf057,0xf040-0xf043,0xf000-0xf01f mem 0xfb432000-0xfb4327ff irq 16 at device 31.2 on pci1 ahci1: AHCI v1.30 with 6 6Gbps ports, Port Multiplier not supported ahcich4: at channel 0 on ahci1 ahcich5: at channel 1 on ahci1 ahcich6: at channel 2 on ahci1 ahcich7: at channel 3 on ahci1 ahcich8: at channel 4 on ahci1 ahcich9: at channel 5 on ahci1 ahciem1: on ahci1 acpi_button0: on acpi0 uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0 uart1: console (115200,n,8,1) orm0: at iomem 0xc0000-0xc7fff,0xcb000-0xcbfff pnpid ORM0000 on isa0 est0: on cpu0 p4tcc0: on cpu0 NULL mp in getnewvnode(9), tag crossmp Timecounters tick every 1.000 msec Obsolete code will be removed soon: random(9) is the obsolete Park-Miller LCG from 1988 Expensive timeout(9) function: 0xffffffff804da8c0(0xfffffe00d2a34000) 0.004037815 s ses0 at ahciem0 bus 0 scbus4 target 0 lun 0 ses0: SEMB S-E-S 2.00 device ses0: SEMB SES Device ses1 at ahciem1 bus 0 scbus11 target 0 lun 0 ses1: SEMB S-E-S 2.00 device ses1: SEMB SES Device ses0: pass0 in 'Slot 01', SATA Slot: scbus1 target 0 ada0 at ahcich1 bus 0 scbus1 target 0 lun 0 ada0: ACS-2 ATA SATA 3.x device ada0: Serial Number WD-WCC3F3KDDP98 ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes) ada0: Command Queueing enabled ada0: 953869MB (1953525168 512 byte sectors) ada0: quirks=0x1<4K> hwpmc:Expensive timeout(9) function: 0xffffffff80a323f0(0xffffffff818e6248) 0.007397064 s SOFT/16/64/0x67 TSC/1/64/0x20 IAP/4/48/0x3ff IAF/3/48/0x67 Trying to mount root from ufs:/dev/gpt/work [rw]... WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. ugen2.1: at usbus2 ugen0.1: <0x8086 XHCI root HUB> at usbus0 ugen1.1: at usbus1 uhub0 on usbus2 uhub1 on usbus1 uhub1: on usbus1 uhub2 on usbus0 uhub2: <0x8086 XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0 uhub0: on usbus2 WARNING: / was not properly dismounted Interface IP-Address Broadcast lo0: link state changed to UP Starting Network: lo0 igb0 igb1. lo0: flags=8049 metric 0 mtu 16384 options=680003 inet6 ::1 prefixlen 128 inet6 lect status: no carrier nd6 options=29 Starting devd. igb0: link state changed to UP Autoloading module: ioat.ko ioat0: mem 0xfb42c000-0xfb42ffff irq 31 at device 4.0 on pci1 ioat0: Capabilities: 2f7 ioat1: mem 0xfb428000-0xfb42bfff irq 39 at device 4.1 on pci1 ioat1: Capabilities: 2f7 ioat2: mem 0xfb424000-0xfb427fff irq 31 at device 4.2 on pci1 ioat2: Capabilities: f7 ioat3: mem 0xfb420000-0xfb423fff irq 39 at device 4.3 on pci1 ioat3: Capabilities: f7 ioat4: mem 0xfb41c000-0xfb41ffff irq 31 at device 4.4 on pci1 ioat4: Capabilities: f7 ioat5: mem 0xfb418000-0xfb41bfff irq 39 at device 4.5 on pci1 ioat5: Capabilities: f7 ioat6: mem 0xfb414000-0xfb417fff irq 31 at device 4.6 on pci1 ioat6: Capabilities: f7 ioat7: mem 0xfb410000-0xfb413fff irq 39 at device 4.7 on pci1 ioat7: Capabilities: f7 Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Starting Network: igb1. igb1: flags=8802 metric 0 mtu 1500 options=4e507bb ether 0c:c4:7a:a8:cd:db media: Ethernet autoselect status: no carrier nd6 options=29 Autoloading module: uhid.ko Autoloading module: ums.ko ums0 on uhub3 ums0: on usbus0 ums0: 3 buttons and [Z] coordinates ID=0 Starting dhclient. DHCPREQUEST on igb0 to 255.255.255.255 port 67 DHCPACK from 192if_delmulti_locked: detaching ifnet instance 0xfffff80005037800 .168.5.1 bound to 192.168.5.171 -- renewal in 300 seconds. add host 127.0.0.1: gateway lo0 fib 0: route already in table add host ::1: gateway lo0 fib 0: route already in table add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Creating and/or trimming log files. Starting syslogd. Setting date via ntp. 25 Jan 22:07:24 ntpdate[2058]: step time server 192.168.5.1 offset -1.280928 sec Starting rpcbind. NFS access cache time=60 Starting watchdogd. No core dumps found. Clearing /tmp (X related). Starting statd. Starting lockd. Recovering vi editor sessions:. fscklock order reversal: 1st 0xfffff8001dde3ce8 ufs (ufs) @ kern/vfs_mount.c:1606 2nd 0xfffff8001d9412e8 devfs (devfs) @ ufs/ffs/ffs_vfsops.c:1404 stack backtrace: #0 0xffffffff80c35a41 at witness_debugger+0x71 #1 0xffffffff80c357b6 at witness_checkorder+0xad6 #2 0xffffffff80b9b968 at lockmgr_lock_fast_path+0x178 #3 0xffffffff810f1978 at VOP_LOCK1_APV+0x48 #4 0xffffffff80cb7bbf at _vn_lock+0x4f #5 0xffffffff80ee7c63 at ffs_flushfiles+0xa3 #6 0xffffffff80ec9ded at softdep_flushfiles+0xad #7 0xffffffff80eea497 at ffs_unmount+0xd7 #8 0xffffffff80c9a55a at dounmount+0x42a #9 0xffffffff80c9a0d9 at kern_unmount+0x2c9 #10 0xffffffff81074a01 at amd64_syscall+0x2f1 #11 0xffffffff8104a7d0 at fast_syscall_common+0x101 ** /dev/gpt/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 290 files, 36180 used, 1229227 free (107 frags, 153640 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** Updating motd:. Mounting late filesystems:. Security policy loaded: MAC/ntpd (mac_ntpd) Starting ntpd. Starting powerd. Configuring vt: blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting cron. Sat Jan 25 22:07 FreeBSD/amd64 (mercat1.netperf.freebsd.org) (ttyu1) login: root Jan 25 22:07:30 mercat1 login[2340]: ROOT LOGIN (root) ON ttyu1 Last login: Sat Jan 25 20:20:09 on ttyu1 FreeBSD 13.0-CURRENT (PHO) #0 r357112: Sat Jan 25 11:08:51 CET 2020 root@mercat1:~ # Jan 25 22:07:42 mercat1 su[2355]: pho to root on /dev/pts/0 20200125 22:08:17 all (1/9): graid0.sh GEOM_STRIPE: Device data created (id=834529707). GEOM_STRIPE: Disk md10 attached to data. GEOM_STRIPE: Disk md11 attached to data. GEOM_STRIPE: Disk md12 attached to data. GEOM_STRIPE: Device stripe/data activated. Jan 25 22:08:41 mercat1 kernel: pid 3747 (swap), jid 0, uid 2007, was killed: out of swap space Jan 25 22:08:51 mercat1 kernel: pid 3746 (swap), jid 0, uid 2007, was killed: out of swap space Jan 25 22:10:36 mercat1 kernel: pid 6076 (swap), jid 0, uid 2007, was killed: out of swap space lock order reversal: 1st 0xfffff8014f7aca68 syncer (syncer) @ kern/vfs_subr.c:2474 2nd 0xfffff8032c169a68 ufs (ufs) @ kern/vfs_subr.c:3199 stack backtrace: #0 0xffffffff80c35a41 at witness_debugger+0x71 #1 0xffffffff80c357b6 at witness_checkorder+0xad6 #2 0xffffffff80b9bf4e at lockmgr_xlock_hard+0x6e #3 0xffffffff80b9cb4c at __lockmgr_args+0x62c #4 0xffffffff80eec63c at ffs_lock+0x7c #5 0xffffffff810f1978 at VOP_LOCK1_APV+0x48 #6 0xffffffff80cb7bbf at _vn_lock+0x4f #7 0xffffffff80ca2af9 at vputx+0x189 #8 0xffffffff80ca2058 at vget_finish+0x98 #9 0xffffffff80eeaed1 at ffs_sync+0x531 #10 0xffffffff80cac2cb at sync_fsync+0xeb #11 0xffffffff810f0770 at VOP_FSYNC_APV+0x60 #12 0xffffffff80ca9c62 at sched_sync+0x3f2 #13 0xffffffff80b86e50 at fork_exit+0x80 #14 0xffffffff8104aeee at fork_trampoline+0xe g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 Jan 25 22:13:01 mercat1 kernel: pid 10286 (swap), jid 0, uid 2007, was killed: out of swap space Jan 25 22:13:14 mercat1 kernel: pid 10364 (swap), jid 0, uid 2007, was killed: out of swap space Jan 25 22:15:12 mercat1 kernel: pid 11844 (swap), jid 0, uid 2007, was killed: out of swap space Jan 25 22:15:23 mercat1 kernel: pid 11868 (swap), jid 0, uid 2007, was killed: out of swap space Jan 25 22:15:54 mercat1 kernel: pid 11923 (swap), jid 0, uid 2007, was killed: out of swap space g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 Jan 25 22:17:15 mercat1 kernel: pid 14991 (swap), jid 0, uid 2007, was killed: out of swap space g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 g_vfs_done():stripe/data[UNKNOWN()]error = 45 GEOM_STRIPE: Disk md12 removed from data. GEOM_STRIPE: Device stripe/data deactivated. GEOM_STRIPE: Disk md11 removed from data. GEOM_STRIPE: Disk md10 removed from data. GEOM_STRIPE: Device data destroyed. 20200125 22:19:20 all (2/9): graid1.sh g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 Jan 25 22:19:30 mercat1 kernel: pid 21542 (rw), uid 2007 inumber 126987 on /mnt: filesystem full g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 Jan 25 22:19:33 mercat1 kernel: pid 21561 (swap), jid 0, uid 2007, was killed: out of swap space g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 Jan 25 22:19:36 mercat1 kernel: pid 21551 (rw), uid 2007 inumber 123637 on /mnt: filesystem full g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 Jan 25 22:20:10 mercat1 kernel: pid 21600 (symlink), uid 2007 inumber 98330 on /mnt: out of inodes Jan 25 22:20:25 mercat1 kernel: pid 21634 (mkdir), uid 2007 inumber 31476 on /mnt: out of inodes Jan 25 22:20:32 mercat1 kernel: pid 21580 (creat), uid 2007 inumber 98324 on /mnt: out of inodes Jan 25 22:20:38 mercat1 kernel: pid 21632 (mkdir), uid 2007 inumber 63152 on /mnt: out of inodes Jan 25 22:20:44 mercat1 kernel: pid 21631 (mkdir), uid 2007 inumber 97269 on /mnt: out of inodes Jan 25 22:20:50 mercat1 kernel: pid 21583 (creat), uid 2007 inumber 98325 on /mnt: out of inodes Jan 25 22:20:56 mercat1 kernel: pid 21577 (creat), uid 2007 inumber 98323 on /mnt: out of inodes Jan 25 22:21:01 mercat1 kernel: pid 21567 (creat), uid 2007 inumber 98320 on /mnt: out of inodes Jan 25 22:21:11 mercat1 kernel: pid 21560 (creat), uid 2007 inumber 98318 on /mnt: out of inodes Jan 25 22:21:18 mercat1 kernel: pid 21636 (mkdir), uid 2007 inumber 53757 on /mnt: out of inodes Jan 25 22:21:39 mercat1 kernel: pid 24788 (swap), jid 0, uid 2007, was killed: out of swap space Jan 25 22:21:51 mercat1 kernel: pid 24863 (swap), jid 0, uid 2007, was killed: out of swap space Jan 25 22:22:02 mercat1 kernel: pid 24804 (swap), jid 0, uid 2007, was killed: out of swap space Jan 25 22:22:14 mercat1 kernel: pid 24866 (swap), jid 0, uid 2007, was killed: out of swap space Jan 25 22:22:33 mercat1 kernel: pid 24838 (creat), uid 2007 inumber 98589 on /mnt: out of inodes Jan 25 22:22:37 mercat1 kernel: pid 24830 (openat), uid 2007 inumber 98592 on /mnt: out of inodes Jan 25 22:22:54 mercat1 kernel: pid 24841 (creat), uid 2007 inumber 98536 on /mnt: out of inodes Jan 25 22:23:02 mercat1 kernel: pid 24844 (creat), uid 2007 inumber 98545 on /mnt: out of inodes Jan 25 22:23:08 mercat1 kernel: pid 24783 (openat), uid 2007 inumber 98533 on /mnt: out of inodes g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/dataJan 25 22:23:40 [UNKNOWN()]error = 45 g_vfs_done():mirror/data[Umercat1 kernel: NKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 pid 26220 (rw), g_vfs_done():mirror/data[UNKNOWN()]error = 45 uid 2007 inumberg_vfs_done():mirror/data[UNKNOWN()]error = 45 109637 on /mnt: filesystem full g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 Jan 25 22:23:55 mercat1 kernel: pid 26253 (mkdir), uid 2007 inumber 65403 on /mnt: out of inodes Jan 25 22:24:01 mercat1 kernel: pid 26267 (creat), uid 2007 inumber 98320 on /mnt: out of inodes Jan 25 22:24:07 mercat1 kernel: pid 26271 (creat), uid 2007 inumber 98324 on /mnt: out of inodes Jan 25 22:24:13 mercat1 kernel: pid 26264 (creat), uid 2007 inumber 98317 on /mnt: out of inodes Jan 25 22:24:19 mercat1 kernel: pid 26271 (creat), uid 2007 inumber 98324 on /mnt: out of inodes Jan 25 22:24:24 mercat1 kernel: pid 26272 (creat), uid 2007 inumber 98325 on /mnt: out of inodes Jan 25 22:24:34 mercat1 kernel: pid 26268 (creat), uid 2007 inumber 98321 on /mnt: out of inodes Jan 25 22:24:38 mercat1 kernel: pid 26271 (creat), uid 2007 inumber 98324 on /mnt: out of inodes Jan 25 22:24:42 mercat1 kernel: pid 26263 (creat), uid 2007 inumber 98344 on /mnt: out of inodes Jan 25 22:24:47 mercat1 kernel: pid 26268 (creat), uid 2007 inumber 98321 on /mnt: out of inodes Jan 25 22:24:52 mercat1 kernel: pid 26263 (creat), uid 2007 inumber 98344 on /mnt: out of inodes Jan 25 22:24:57 mercat1 kernel: pid 26271 (creat), uid 2007 inumber 98324 on /mnt: out of inodes Jan 25 22:25:03 mercat1 kernel: pid 26266 (creat), uid 2007 inumber 98319 on /mnt: out of inodes Jan 25 22:25:07 mercat1 kernel: pid 26264 (creat), uid 2007 inumber 98317 on /mnt: out of inodes Jan 25 22:25:12 mercat1 kernel: pid 26271 (creat), uid 2007 inumber 98324 on /mnt: out of inodes Jan 25 22:25:18 mercat1 kernel: pid 26272 (creat), uid 2007 inumber 98325 on /mnt: out of inodes Jan 25 22:25:23 mercat1 syslogd: last message repeated 1 times Jan 25 22:25:28 mercat1 kernel: pid 26263 (creat), uid 2007 inumber 98344 on /mnt: out of inodes g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 Jan 25 22:25:38 mercat1 kernel: pid 43626 (mkdir), uid 2007 inumber 17608 on /mngt: filesystem fu_vfs_done():mirror/data[UNKNOWN()]error = 45 ll g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 Jan 25 22:25:46 g_vfs_done():mirror/data[UNKNOWN()]error = 45 mercat1 kernel: g_vfs_done():mirror/data[UNKNOWN()]error = 45 pid 43568 (rw), uid 2007 inumberg_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 32855 on /mnt: g_vfs_done():mirror/data[UNKNOWN()]error = 45 filesystem fullg_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 Jan 25 22:26:04 mercat1 kernel: pid 43586 (swap), jid 0, uid 2007, was killed: out of swap space Jan 25 22:26:26 mercat1 kernel: pid 43531 (openat), uid 2007 inumber 32797 on /mnt: out of inodes Jan 25 22:26:55 mercat1 kernel: pid 43615 (creat), uid 2007 inumber 32784 on /mnt: out of inodes g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 Jan 25 22:27:42 mercat1 kernel: pid 47795 (rw), uid 2007 inumber 129601 on /mnt: filesystem full g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 Jan 25 22:27:45 mercat1 kernel: pid 47754 (rw), uid 2007 inumber 5460 on /mnt: filesystem full g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 Jan 25 22:27:48 mercat1 kernel: pid 47821 (rw), uid 2007 inumber 2245 on /mnt: filesystem full g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 g_vfs_done():mirror/data[UNKNOWN()]error = 45 Jan 25 22:27:59 mercat1 kernel: pid 47823 (creat), uid 2007 inumber 99066 on /mnt: out of inodes Jan 25 22:28:03 mercat1 kernel: pid 47762 (swap), jid 0, uid 2007, was killed: out of swap space Jan 25 22:28:07 mercat1 kernel: pid 47790 (creat), uid 2007 inumber 98438 on /mnt: out of inodes Jan 25 22:28:12 mercat1 kernel: pid 47782 (creat), uid 2007 inumber 98445 on /mnt: out of inodes Jan 25 22:28:21 mercat1 kernel: pid 47774 (creat), uid 2007 inumber 99065 on /mnt: out of inodes Jan 25 22:28:25 mercat1 kernel: pid 47782 (creat), uid 2007 inumber 98445 on /mnt: out of inodes Jan 25 22:28:30 mercat1 kernel: pid 47774 (creat), uid 2007 inumber 99065 on /mnt: out of inodes Jan 25 22:28:34 mercat1 kernel: pid 47800 (creat), uid 2007 inumber 98449 on /mnt: out of inodes Jan 25 22:28:39 mercat1 syslogd: last message repeated 1 times Jan 25 22:28:45 mercat1 kernel: pid 47823 (creat), uid 2007 inumber 99066 on /mnt: out of inodes Jan 25 22:28:49 mercat1 kernel: pid 47782 (creat), uid 2007 inumber 98445 on /mnt: out of inodes Jan 25 22:28:54 mercat1 kernel: pid 47774 (creat), uid 2007 inumber 99065 on /mnt: out of inodes Jan 25 22:28:59 mercat1 kernel: pid 47823 (creat), uid 2007 inumber 99066 on /mnt: out of inodes Jan 25 22:29:04 mercat1 kernel: pid 47760 (creat), uid 2007 inumber 98400 on /mnt: out of inodes Jan 25 22:29:08 mercat1 kernel: pid 47814 (creat), uid 2007 inumber 98436 on /mnt: out of inodes Jan 25 22:29:13 mercat1 syslogd: last message repeated 1 times Jan 25 22:29:22 mercat1 kernel: pid 47823 (creat), uid 2007 inumber 99066 on /mnt: out of inodes Jan 25 22:29:28 mercat1 syslogd: last message repeated 1 times Jan 25 22:29:34 mercat1 kernel: pid 47806 (creat), uid 2007 inumber 98442 on /mnt: out of inodes 20200125 22:29:46 all (3/9): graid1_10.sh 20200125 22:31:53 all (4/9): graid1_2.sh freework leak: 3/11. 20200125 22:37:04 all (5/9): graid1_3.sh freework leak: 17/28. 20200125 22:39:07 all (6/9): graid1_5.sh GEOM_NOP: Device md11.nop created. GEOM_NOP: Device md12.nop created. Jan 25 22:39:25 mercat1 kernel: pid 56897 (swap), jid 0, uid 2007, was killed: out of swap space GEOM_NOP: Device md11.nop removed. GEOM_NOP: Device md12.nop removed. 20200125 22:45:24 all (7/9): graid1_6.sh Jan 25 22:45:47 mercat1 kernel: pid 68886 (swap), jid 0, uid 2007, was killed: out of swap space Jan 25 22:46:07 mercat1 kernel: pid 68866 (swap), jid 0, uid 2007, was killed: out of swap space Jan 25 22:46:31 mercat1 kernel: pid 68885 (swap), jid 0, uid 2007, was killed: out of swap space g_vfs_done():mirror/test[UNKNOWN()]error = 45 g_vfs_done():mirror/test[UNKNOWN()]error = 45 g_vfs_done():mirror/test[UNKNOWN()]error = 45 g_vfs_done():mirror/test[UNKNOWN()]error = 45 g_vfs_done():mirror/test[UNKNOWN()]error = 45 g_vfs_done():mirror/test[UNKNOWN()]error = 45 g_vfs_done():mirror/test[UNKNOWN()]error = 45 g_vfs_done():mirror/test[UNKNOWN()]error = 45 g_vfs_done():mirror/test[UNKNOWN()]error = 45 g_vfs_done():mirror/test[UNKNOWN()]error = 45 g_vfs_done():mirror/test[UNKNOWN()]error = 45 g_vfs_done():mirror/test[UNKNOWN()]error = 45 g_vfs_done():mirror/test[UNKNOWN()]error = 45 g_vfs_done():mirror/test[UNKNOWN()]error = 45 g_vfs_done():mirror/test[UNKNOWN()]error = 45 g_vfs_done():mirror/test[UNKNOWN()]error = 45 g_vfs_done():mirror/test[UNKNOWN()]error = 45 g_vfs_done():mirror/test[UNKNOWN()]error = 45 g_vfs_done():mirror/test[UNKNOWN()]error = 45 g_vfs_done():mirror/test[UNKNOWN()]error = 45 g_vfs_done():mirror/test[UNKNOWN()]error = 45 g_vfs_done():mirror/test[UNKNOWN()]error = 45 g_vfs_done():mirror/test[UNKNOWN()]error = 45 g_vfs_done():mirror/test[UNKNOWN()]error = 45 g_vfs_done():mirror/test[UNKNOWN()]error = 45 g_vfs_done():mirror/test[UNKNOWN()]error = 45 g_vfs_done():mirror/test[UNKNOWN()]error = 45 g_vfs_done():mirror/test[UNKNOWN()]error = 45 g_vfs_done():mirror/test[UNKNOWN()]error = 45 g_vfs_done():mirror/test[UNKNOWN()]error = 45 g_vfs_done():mirror/test[UNKNOWN()]error = 45 g_vfs_done():mirror/test[UNKNOWN()]error = 45 g_vfs_done():mirror/test[UNKNOWN()]error = 45 g_vfs_done():mirror/test[UNKNOWN()]error = 45 g_vfs_done():mirror/test[UNKNOWN()]error = 45 g_vfs_done():mirror/test[UNKNOWN()]error = 45 g_vfs_done():mirror/test[UNKNOWN()]error = 45 g_vfs_done():mirror/test[UNKNOWN()]error = 45 g_vfs_done():mirror/test[UNKNOWN()]error = 45 Jan 25 22:48:06 mercat1 kernel: pid 71204 (rw), uid 2007 inumber 54728 on /mnt: filesystem full g_vfs_done():mirror/test[UNKNOWN()]error = 45 g_vfs_done():mirror/test[UNKNOWN()]error = 45 g_vfs_done():mirror/test[UNKNOWN()]error = 45 g_vfs_done():mirror/test[UNKNOWN()]error = 45 Jan 25 22:48:25 mercat1 kernel: pid 71240 (mkdir), uid 2007 inumber 49152 on /mnt: out of inodes Jan 25 22:48:31 mercat1 kernel: pid 71278 (mkdir), uid 2007 inumber 49275 on /mnt: out of inodes Jan 25 22:48:42 mercat1 kernel: pid 71271 (mkdir), uid 2007 inumber 32720 on /mnt: out of inodes Jan 25 22:49:08 mercat1 kernel: pid 71222 (mkdir), uid 2007 inumber 49081 on /mnt: out of inodes freework leak: 4/32. 20200125 22:50:00 all (8/9): graid1_7.sh 20200125 22:56:08 all (9/9): graid3.sh GEOM_RAID3: Device raid3/data launched (3/3). Jan 25 22:56:32 mercat1 kernel: pid 68241 (swap), jid 0, uid 2007, was killed: out of swap space Jan 25 22:57:00 mercat1 kernel: pid 68240 (swap), jid 0, uid 2007, was killed: out of swap space Jan 25 22:57:13 mercat1 kernel: pid 68174 (swap), jid 0, uid 2007, was killed: out of swap space panic: bio_completed can't be greater than bio_length cpuid = 9 time = 1579989454 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0037a73a60 vpanic() at vpanic+0x185/frame 0xfffffe0037a73ac0 panic() at panic+0x43/frame 0xfffffe0037a73b20 g_io_deliver() at g_io_deliver+0x386/frame 0xfffffe0037a73b70 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0037a73ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe0037a73bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a73bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a73bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- KDB: enter: panic [ thread pid 13 tid 100063 ] Stopped at kdb_enter+0x37: movq $0,0x1084fa6(%rip) db> run pho db:0:pho> set $lines 20000 db:0:pho> run pho1 db:1:pho1> dump Dumping 2007 out of 32626 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% Dump complete db:1:pho1> bt Tracing pid 13 tid 100063 td 0xfffff80003b1d000 kdb_enter() at kdb_enter+0x37/frame 0xfffffe0037a73a60 vpanic() at vpanic+0x1a1/frame 0xfffffe0037a73ac0 panic() at panic+0x43/frame 0xfffffe0037a73b20 g_io_deliver() at g_io_deliver+0x386/frame 0xfffffe0037a73b70 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0037a73ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe0037a73bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a73bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a73bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:1:pho1> show allpcpu Current CPU: 9 cpuid = 0 dynamic pcpu = 0x977d80 curthread = 0xfffff8014fcd2000: pid 68196 tid 100384 critnest 0 "creat" curpcb = 0xfffff8014fcd24f0 fpcurthread = 0xfffff8014fcd2000: pid 68196 "creat" idlethread = 0xfffff8000394b000: tid 100003 "idle: cpu0" self = 0xffffffff82410000 curpmap = 0xfffff80488f53120 tssp = 0xffffffff82410384 rsp0 = 0xfffffe00addd1cc0 kcr3 = 0x80000005c7ed5275 ucr3 = 0x8000000731038a75 scr3 = 0x1a57d0aa1 gs32p = 0xffffffff82410404 ldt = 0xffffffff82410444 tss = 0xffffffff82410434 tlb gen = 16267073 curvnet = 0 spin locks held: cpuid = 1 dynamic pcpu = 0xfffffe00bc7ebd80 curthread = 0xfffff801a54ab000: pid 68192 tid 100342 critnest 0 "rw" curpcb = 0xfffff801a54ab4f0 fpcurthread = 0xfffff801a54ab000: pid 68192 "rw" idlethread = 0xfffff800039456e0: tid 100004 "idle: cpu1" self = 0xffffffff82411000 curpmap = 0xfffff8001db7f120 tssp = 0xffffffff82411384 rsp0 = 0xfffffe00e7413cc0 kcr3 = 0x8000000308c603d0 ucr3 = 0x80000005da1c7bd0 scr3 = 0x442fd7c14 gs32p = 0xffffffff82411404 ldt = 0xffffffff82411444 tss = 0xffffffff82411434 tlb gen = 16267073 curvnet = 0 spin locks held: cpuid = 2 dynamic pcpu = 0xfffffe00bc7f7d80 curthread = 0xfffff803e2f15000: pid 68165 tid 100421 critnest 0 "swap" curpcb = 0xfffff803e2f154f0 fpcurthread = 0xfffff803e2f15000: pid 68165 "swap" idlethread = 0xfffff80003945000: tid 100005 "idle: cpu2" self = 0xffffffff82412000 curpmap = 0xfffff8046fb9c120 tssp = 0xffffffff82412384 rsp0 = 0xfffffe00e752bcc0 kcr3 = 0x8000000308a8a53e ucr3 = 0x8000000003ffcd3e scr3 = 0x442fd7d72 gs32p = 0xffffffff82412404 ldt = 0xffffffff82412444 tss = 0xffffffff82412434 tlb gen = 16267073 curvnet = 0 spin locks held: cpuid = 3 dynamic pcpu = 0xfffffe00bc803d80 curthread = 0xfffff8014fb43000: pid 68181 tid 100239 critnest 0 "fts" curpcb = 0xfffff8014fb434f0 fpcurthread = 0xfffff8014fb43000: pid 68181 "fts" idlethread = 0xfffff8000395a6e0: tid 100006 "idle: cpu3" self = 0xffffffff82413000 curpmap = 0xfffff801a5295120 tssp = 0xffffffff82413384 rsp0 = 0xfffffe00e57d9cc0 kcr3 = 0x8000000842fb629b ucr3 = 0x80000004e99e6a9b scr3 = 0x1a57d0ad6 gs32p = 0xffffffff82413404 ldt = 0xffffffff82413444 tss = 0xffffffff82413434 tlb gen = 16267073 curvnet = 0 spin locks held: cpuid = 4 dynamic pcpu = 0xfffffe00bc80fd80 curthread = 0xfffff8014feba000: pid 68125 tid 100284 critnest 0 "rw" curpcb = 0xfffff8014feba4f0 fpcurthread = 0xfffff8014feba000: pid 68125 "rw" idlethread = 0xfffff8000395a000: tid 100007 "idle: cpu4" self = 0xffffffff82414000 curpmap = 0xfffff8014ff84120 tssp = 0xffffffff82414384 rsp0 = 0xfffffe00e62edcc0 kcr3 = 0x80000003c3d375f0 ucr3 = 0x80000006e0189df0 scr3 = 0x1ad5cce57 gs32p = 0xffffffff82414404 ldt = 0xffffffff82414444 tss = 0xffffffff82414434 tlb gen = 16267073 curvnet = 0 spin locks held: cpuid = 5 dynamic pcpu = 0xfffffe00bc81bd80 curthread = 0xfffff801ea4a7000: pid 68187 tid 100473 critnest 0 "swap" curpcb = 0xfffff801ea4a74f0 fpcurthread = 0xfffff801ea4a7000: pid 68187 "swap" idlethread = 0xfffff800039596e0: tid 100008 "idle: cpu5" self = 0xffffffff82415000 curpmap = 0xfffff80554322120 tssp = 0xffffffff82415384 rsp0 = 0xfffffe00e762acc0 kcr3 = 0x80000007a4be725d ucr3 = 0x80000005a4d2aa5d scr3 = 0x215cd6932 gs32p = 0xffffffff82415404 ldt = 0xffffffff82415444 tss = 0xffffffff82415434 tlb gen = 16267073 curvnet = 0 spin locks held: cpuid = 6 dynamic pcpu = 0xfffffe00bc827d80 curthread = 0xfffff80003b1e6e0: pid 13 tid 100064 critnest 0 "g_down" curpcb = 0xfffff80003b1ebd0 fpcurthread = none idlethread = 0xfffff80003959000: tid 100009 "idle: cpu6" self = 0xffffffff82416000 curpmap = 0xffffffff81d9e9b0 tssp = 0xffffffff82416384 rsp0 = 0xfffffe0037a78cc0 kcr3 = 0x8000000002307029 ucr3 = 0xffffffffffffffff scr3 = 0x215cd6f2c gs32p = 0xffffffff82416404 ldt = 0xffffffff82416444 tss = 0xffffffff82416434 tlb gen = 16267073 curvnet = 0 spin locks held: cpuid = 7 dynamic pcpu = 0xfffffe00bc833d80 curthread = 0xfffff801a54ad000: pid 68117 tid 100380 critnest 0 "rw" curpcb = 0xfffff801a54ad4f0 fpcurthread = 0xfffff801a54ad000: pid 68117 "rw" idlethread = 0xfffff8000394c6e0: tid 100010 "idle: cpu7" self = 0xffffffff82417000 curpmap = 0xfffff801a5352120 tssp = 0xffffffff82417384 rsp0 = 0xfffffe00e567ecc0 kcr3 = 0x800000025ceb2688 ucr3 = 0x80000002a1fa1e88 scr3 = 0x7acd2be99 gs32p = 0xffffffff82417404 ldt = 0xffffffff82417444 tss = 0xffffffff82417434 tlb gen = 16267073 curvnet = 0 spin locks held: cpuid = 8 dynamic pcpu = 0xfffffe00bc83fd80 curthread = 0xfffff8001d455000: pid 30 tid 100128 critnest 0 "dom0" curpcb = 0xfffff8001d4554f0 fpcurthread = none idlethread = 0xfffff8000395d000: tid 100011 "idle: cpu8" self = 0xffffffff82418000 curpmap = 0xffffffff81d9e9b0 tssp = 0xffffffff82418384 rsp0 = 0xfffffe0037bd0cc0 kcr3 = 0x8000000002307004 ucr3 = 0xffffffffffffffff scr3 = 0x53fe3d956 gs32p = 0xffffffff82418404 ldt = 0xffffffff82418444 tss = 0xffffffff82418434 tlb gen = 16267073 curvnet = 0 spin locks held: cpuid = 9 dynamic pcpu = 0xfffffe00bc84bd80 curthread = 0xfffff80003b1d000: pid 13 tid 100063 critnest 1 "g_up" curpcb = 0xfffff80003b1d4f0 fpcurthread = none idlethread = 0xfffff8000395c6e0: tid 100012 "idle: cpu9" self = 0xffffffff82419000 curpmap = 0xffffffff81d9e9b0 tssp = 0xffffffff82419384 rsp0 = 0xfffffe0037a73cc0 kcr3 = 0x8000000002307002 ucr3 = 0xffffffffffffffff scr3 = 0x5c16ebba4 gs32p = 0xffffffff82419404 ldt = 0xffffffff82419444 tss = 0xffffffff82419434 tlb gen = 16267073 curvnet = 0 spin locks held: cpuid = 10 dynamic pcpu = 0xfffffe00bc857d80 curthread = 0xfffff801a51586e0: pid 68222 tid 100308 critnest 0 "swap" curpcb = 0xfffff801a5158bd0 fpcurthread = 0xfffff801a51586e0: pid 68222 "swap" idlethread = 0xfffff8000395c000: tid 100013 "idle: cpu10" self = 0xffffffff8241a000 curpmap = 0xfffff802505a9120 tssp = 0xffffffff8241a384 rsp0 = 0xfffffe00e6365cc0 kcr3 = 0x800000036ea8b25d ucr3 = 0x800000084269fa5d scr3 = 0x5c16eb982 gs32p = 0xffffffff8241a404 ldt = 0xffffffff8241a444 tss = 0xffffffff8241a434 tlb gen = 16267065 curvnet = 0 spin locks held: cpuid = 11 dynamic pcpu = 0xfffffe00bc863d80 curthread = 0xfffff8001ddb5000: pid 68072 tid 100449 critnest 0 "g_raid3 data" curpcb = 0xfffff8001ddb54f0 fpcurthread = none idlethread = 0xfffff8000395b6e0: tid 100014 "idle: cpu11" self = 0xffffffff8241b000 curpmap = 0xffffffff81d9e9b0 tssp = 0xffffffff8241b384 rsp0 = 0xfffffe00e577acc0 kcr3 = 0x800000000230701b ucr3 = 0xffffffffffffffff scr3 = 0x2ded00be1 gs32p = 0xffffffff8241b404 ldt = 0xffffffff8241b444 tss = 0xffffffff8241b434 tlb gen = 16267073 curvnet = 0 spin locks held: db:1:pho1> show alllocks Process 68237 (mkdir) thread 0xfffff805c0bf46e0 (100518) exclusive lockmgr ufs (ufs) r = 0 (0xfffff804e12c7ce8) locked @ ufs/ffs/ffs_vfsops.c:1737 exclusive lockmgr ufs (ufs) r = 0 (0xfffff807556fa7e8) locked @ kern/vfs_lookup.c:714 Process 68236 (mkdir) thread 0xfffff804fa4aa000 (100444) exclusive lockmgr ufs (ufs) r = 0 (0xfffff803524982e8) locked @ ufs/ffs/ffs_vfsops.c:1737 exclusive lockmgr ufs (ufs) r = 0 (0xfffff803ffc9a2e8) locked @ kern/vfs_lookup.c:714 Process 68234 (mkdir) thread 0xfffff80289153000 (100373) exclusive lockmgr ufs (ufs) r = 0 (0xfffff80412f26068) locked @ ufs/ffs/ffs_vfsops.c:1737 exclusive lockmgr ufs (ufs) r = 0 (0xfffff80412edea68) locked @ kern/vfs_lookup.c:714 Process 68230 (mkdir) thread 0xfffff802d0f62000 (100462) exclusive lockmgr ufs (ufs) r = 0 (0xfffff80412cfece8) locked @ kern/vfs_lookup.c:714 Process 68227 (mkdir) thread 0xfffff801a52b76e0 (100328) exclusive lockmgr ufs (ufs) r = 0 (0xfffff804e12c77e8) locked @ ufs/ffs/ffs_vfsops.c:1737 exclusive lockmgr ufs (ufs) r = 0 (0xfffff807555b4568) locked @ kern/vfs_lookup.c:714 Process 68224 (mkdir) thread 0xfffff801a506f6e0 (100300) exclusive lockmgr ufs (ufs) r = 0 (0xfffff804e1322568) locked @ kern/vfs_lookup.c:714 Process 68221 (symlink) thread 0xfffff800351126e0 (100189) exclusive lockmgr ufs (ufs) r = 0 (0xfffff80755571068) locked @ ufs/ffs/ffs_vfsops.c:1737 exclusive lockmgr ufs (ufs) r = 0 (0xfffff802be4842e8) locked @ kern/vfs_lookup.c:714 Process 68220 (mkdir) thread 0xfffff801850fa6e0 (100389) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe003e13bdb0) locked @ kern/vfs_bio.c:1665 exclusive lockmgr ufs (ufs) r = 0 (0xfffff803fc4cc068) locked @ ufs/ffs/ffs_vfsops.c:1737 exclusive lockmgr ufs (ufs) r = 0 (0xfffff804e1321ce8) locked @ kern/vfs_lookup.c:714 Process 68217 (symlink) thread 0xfffff8001d811000 (100179) exclusive lockmgr ufs (ufs) r = 0 (0xfffff80755591a68) locked @ ufs/ffs/ffs_vfsops.c:1737 exclusive lockmgr ufs (ufs) r = 0 (0xfffff8049d048068) locked @ kern/vfs_lookup.c:714 Process 68212 (symlink) thread 0xfffff8014fa2e000 (100276) exclusive lockmgr ufs (ufs) r = 0 (0xfffff80755571a68) locked @ ufs/ffs/ffs_vfsops.c:1737 exclusive lockmgr ufs (ufs) r = 0 (0xfffff804872c8068) locked @ kern/vfs_lookup.c:714 Process 68211 (mkdir) thread 0xfffff80842e62000 (100355) exclusive lockmgr ufs (ufs) r = 0 (0xfffff807555992e8) locked @ ufs/ffs/ffs_vfsops.c:1737 exclusive lockmgr ufs (ufs) r = 0 (0xfffff807556e2a68) locked @ kern/vfs_lookup.c:714 Process 68208 (rw) thread 0xfffff8023e8096e0 (100482) exclusive lockmgr ufs (ufs) r = 0 (0xfffff80475450068) locked @ kern/vfs_vnops.c:877 Process 68206 (link) thread 0xfffff803bc7e7000 (100522) exclusive lockmgr ufs (ufs) r = 0 (0xfffff80446f30ce8) locked @ kern/vfs_subr.c:2914 exclusive lockmgr ufs (ufs) r = 0 (0xfffff80729324a68) locked @ kern/vfs_lookup.c:714 Process 68205 (creat) thread 0xfffff8014febb6e0 (100285) exclusive lockmgr ufs (ufs) r = 0 (0xfffff804b1f92068) locked @ kern/vfs_lookup.c:714 Process 68204 (symlink) thread 0xfffff8001d80f6e0 (100171) exclusive lockmgr ufs (ufs) r = 0 (0xfffff80412cff068) locked @ ufs/ffs/ffs_vfsops.c:1737 exclusive lockmgr ufs (ufs) r = 0 (0xfffff805e572ace8) locked @ kern/vfs_lookup.c:714 Process 68203 (mkdir) thread 0xfffff80488ea06e0 (100386) exclusive lockmgr ufs (ufs) r = 0 (0xfffff8033d50b2e8) locked @ ufs/ffs/ffs_vfsops.c:1737 exclusive lockmgr ufs (ufs) r = 0 (0xfffff80705f9b2e8) locked @ kern/vfs_lookup.c:714 Process 68202 (rw) thread 0xfffff801a52b6000 (100326) exclusive lockmgr ufs (ufs) r = 0 (0xfffff8003c87d7e8) locked @ kern/vfs_vnops.c:877 Process 68199 (symlink) thread 0xfffff8046af4d000 (100408) exclusive lockmgr ufs (ufs) r = 0 (0xfffff8073cd14a68) locked @ ufs/ffs/ffs_vfsops.c:1737 exclusive lockmgr ufs (ufs) r = 0 (0xfffff804f0439068) locked @ kern/vfs_lookup.c:714 Process 68196 (creat) thread 0xfffff8014fcd2000 (100384) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe00386dc158) locked @ kern/vfs_bio.c:3889 exclusive lockmgr ufs (ufs) r = 0 (0xfffff8043f2a2068) locked @ kern/vfs_lookup.c:714 Process 68195 (mkdir) thread 0xfffff8014fa356e0 (100277) exclusive lockmgr ufs (ufs) r = 0 (0xfffff80412ede7e8) locked @ kern/vfs_lookup.c:714 Process 68193 (link) thread 0xfffff8014fb4e000 (100255) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe003a182fb0) locked @ kern/vfs_bio.c:3889 exclusive lockmgr ufs (ufs) r = 0 (0xfffff80044c332e8) locked @ kern/vfs_subr.c:2914 exclusive lockmgr ufs (ufs) r = 0 (0xfffff80783adace8) locked @ kern/vfs_lookup.c:714 Process 68190 (creat) thread 0xfffff8014fa2e6e0 (100246) exclusive lockmgr ufs (ufs) r = 0 (0xfffff803eec4a568) locked @ kern/vfs_lookup.c:714 Process 68189 (symlink) thread 0xfffff806f2967000 (100487) exclusive lockmgr ufs (ufs) r = 0 (0xfffff8025e592ce8) locked @ ufs/ffs/ffs_vfsops.c:1737 exclusive lockmgr ufs (ufs) r = 0 (0xfffff80049206568) locked @ kern/vfs_lookup.c:714 Process 68188 (mkdir) thread 0xfffff801850f9000 (100508) exclusive lockmgr ufs (ufs) r = 0 (0xfffff802581197e8) locked @ kern/vfs_subr.c:3199 Process 68185 (link) thread 0xfffff80545568000 (100451) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe003adf7218) locked @ kern/vfs_bio.c:3889 exclusive lockmgr ufs (ufs) r = 1 (0xfffff80784765068) locked @ kern/vfs_subr.c:2914 exclusive lockmgr ufs (ufs) r = 0 (0xfffff801a89652e8) locked @ kern/vfs_lookup.c:714 Process 68184 (rw) thread 0xfffff8001d6f06e0 (100149) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe003818be08) locked @ kern/vfs_bio.c:3889 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe003b936198) locked @ kern/vfs_bio.c:3889 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0038bc6ac0) locked @ kern/vfs_bio.c:3889 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe003c068750) locked @ kern/vfs_bio.c:3889 exclusive lockmgr ufs (ufs) r = 0 (0xfffff80596b40068) locked @ kern/vfs_vnops.c:877 Process 68183 (mkdir) thread 0xfffff80842e636e0 (100385) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe003a511f30) locked @ kern/vfs_bio.c:1665 exclusive lockmgr ufs (ufs) r = 0 (0xfffff803fc4d3568) locked @ ufs/ffs/ffs_vfsops.c:1737 exclusive lockmgr ufs (ufs) r = 0 (0xfffff807557067e8) locked @ kern/vfs_lookup.c:714 Process 68181 (fts) thread 0xfffff8014fb43000 (100239) exclusive sleep mutex vnode interlock (vnode interlock) r = 0 (0xfffff806fbeacdb0) locked @ kern/vfs_subr.c:3172 Process 68180 (link) thread 0xfffff8014fb2c6e0 (100240) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0039a4ef10) locked @ kern/vfs_bio.c:3889 exclusive lockmgr ufs (ufs) r = 0 (0xfffff802be48b7e8) locked @ kern/vfs_subr.c:2914 exclusive lockmgr ufs (ufs) r = 0 (0xfffff8004923c7e8) locked @ kern/vfs_lookup.c:714 Process 68179 (symlink) thread 0xfffff801a5159000 (100316) exclusive lockmgr ufs (ufs) r = 0 (0xfffff805d88a7068) locked @ ufs/ffs/ffs_vfsops.c:1737 exclusive lockmgr ufs (ufs) r = 0 (0xfffff804c05f4068) locked @ kern/vfs_lookup.c:714 Process 68177 (creat) thread 0xfffff801a51ee6e0 (100325) exclusive lockmgr ufs (ufs) r = 0 (0xfffff807557057e8) locked @ ufs/ffs/ffs_vfsops.c:1737 exclusive lockmgr ufs (ufs) r = 0 (0xfffff8023e3517e8) locked @ kern/vfs_lookup.c:714 Process 68176 (mkdir) thread 0xfffff8014fcd1000 (100404) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe003a9d6948) locked @ kern/vfs_bio.c:3889 exclusive lockmgr ufs (ufs) r = 0 (0xfffff804e13377e8) locked @ ufs/ffs/ffs_vfsops.c:1737 exclusive lockmgr ufs (ufs) r = 0 (0xfffff807556fa568) locked @ kern/vfs_lookup.c:714 Process 68173 (rw) thread 0xfffff8014fd556e0 (100283) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe003984be10) locked @ kern/vfs_bio.c:3889 exclusive lockmgr ufs (ufs) r = 0 (0xfffff8010c30bce8) locked @ kern/vfs_vnops.c:877 Process 68172 (symlink) thread 0xfffff80285002000 (100517) exclusive lockmgr ufs (ufs) r = 0 (0xfffff803fc4cda68) locked @ ufs/ffs/ffs_vfsops.c:1737 exclusive lockmgr ufs (ufs) r = 0 (0xfffff804846c52e8) locked @ kern/vfs_lookup.c:714 Process 68169 (creat) thread 0xfffff805b3f1c6e0 (100474) exclusive lockmgr ufs (ufs) r = 0 (0xfffff8075557d568) locked @ ufs/ffs/ffs_vfsops.c:1737 exclusive lockmgr ufs (ufs) r = 0 (0xfffff804ae0e9ce8) locked @ kern/vfs_lookup.c:714 Process 68163 (rw) thread 0xfffff8014f8606e0 (100371) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe003bd780b0) locked @ kern/vfs_bio.c:3889 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe003dc45bc8) locked @ kern/vfs_bio.c:3889 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe003af16ee8) locked @ kern/vfs_bio.c:3889 exclusive lockmgr ufs (ufs) r = 0 (0xfffff8018be1a568) locked @ kern/vfs_vnops.c:877 Process 68162 (symlink) thread 0xfffff801be39d6e0 (100520) exclusive lockmgr ufs (ufs) r = 0 (0xfffff80201b7a2e8) locked @ ufs/ffs/ffs_vfsops.c:1737 exclusive lockmgr ufs (ufs) r = 0 (0xfffff806d9bf0ce8) locked @ kern/vfs_lookup.c:714 Process 68160 (mkdir) thread 0xfffff801a50ee6e0 (100304) exclusive lockmgr ufs (ufs) r = 0 (0xfffff803fc4cdce8) locked @ kern/vfs_lookup.c:714 Process 68159 (creat) thread 0xfffff80436f82000 (100405) exclusive lockmgr ufs (ufs) r = 0 (0xfffff8062921b568) locked @ kern/vfs_lookup.c:714 Process 68156 (rw) thread 0xfffff8014febb000 (100286) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe00394ccc40) locked @ kern/vfs_bio.c:3889 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe003a7a33b0) locked @ kern/vfs_bio.c:3889 exclusive lockmgr ufs (ufs) r = 0 (0xfffff8018be0dce8) locked @ kern/vfs_vnops.c:877 Process 68155 (symlink) thread 0xfffff8001dec56e0 (100161) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe003b374808) locked @ kern/vfs_bio.c:3889 exclusive lockmgr ufs (ufs) r = 0 (0xfffff806a6982568) locked @ kern/vfs_subr.c:2914 Process 68153 (creat) thread 0xfffff80434b806e0 (100417) exclusive lockmgr ufs (ufs) r = 0 (0xfffff807f3e9d068) locked @ ufs/ffs/ffs_vfsops.c:1737 exclusive lockmgr ufs (ufs) r = 0 (0xfffff80604afa068) locked @ kern/vfs_lookup.c:714 Process 68150 (rw) thread 0xfffff802fd8036e0 (100463) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe003c6411e0) locked @ kern/vfs_bio.c:3889 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe003a07a008) locked @ kern/vfs_bio.c:3889 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe003ab49808) locked @ kern/vfs_bio.c:3889 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe003a71c380) locked @ kern/vfs_bio.c:3889 exclusive lockmgr ufs (ufs) r = 0 (0xfffff80623b032e8) locked @ kern/vfs_vnops.c:877 Process 68148 (symlink) thread 0xfffff8043bd40000 (100470) exclusive lockmgr ufs (ufs) r = 0 (0xfffff80412cfe7e8) locked @ ufs/ffs/ffs_vfsops.c:1737 exclusive lockmgr ufs (ufs) r = 0 (0xfffff8059aadc7e8) locked @ kern/vfs_lookup.c:714 Process 68146 (mkdir) thread 0xfffff8048f965000 (100476) exclusive lockmgr ufs (ufs) r = 0 (0xfffff80412edece8) locked @ kern/vfs_lookup.c:714 Process 68144 (rw) thread 0xfffff8046afde6e0 (100419) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe003d322930) locked @ kern/vfs_bio.c:3889 exclusive lockmgr ufs (ufs) r = 0 (0xfffff8054b32aa68) locked @ kern/vfs_vnops.c:877 Process 68143 (link) thread 0xfffff8014fb4e6e0 (100244) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe003bb7f4f8) locked @ kern/vfs_bio.c:3889 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe003abf1e80) locked @ kern/vfs_bio.c:3889 exclusive lockmgr ufs (ufs) r = 1 (0xfffff8028b7e7a68) locked @ kern/vfs_subr.c:2914 exclusive lockmgr ufs (ufs) r = 0 (0xfffff801a8844ce8) locked @ kern/vfs_lookup.c:714 Process 68142 (symlink) thread 0xfffff8001dce6000 (100152) exclusive lockmgr ufs (ufs) r = 0 (0xfffff8075557d2e8) locked @ ufs/ffs/ffs_vfsops.c:1737 exclusive lockmgr ufs (ufs) r = 0 (0xfffff8063a8d22e8) locked @ kern/vfs_lookup.c:714 Process 68138 (rw) thread 0xfffff804fa4a9000 (100442) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe00396c0ef0) locked @ kern/vfs_bio.c:3889 exclusive lockmgr ufs (ufs) r = 0 (0xfffff801a3e87ce8) locked @ kern/vfs_vnops.c:877 Process 68137 (link) thread 0xfffff805455686e0 (100452) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe003b70c998) locked @ kern/vfs_bio.c:3889 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe003a3c66d0) locked @ kern/vfs_bio.c:3889 exclusive lockmgr ufs (ufs) r = 1 (0xfffff805536f8068) locked @ kern/vfs_subr.c:2914 exclusive lockmgr ufs (ufs) r = 0 (0xfffff805c9eef068) locked @ kern/vfs_lookup.c:714 Process 68136 (symlink) thread 0xfffff8033fb00000 (100395) exclusive lockmgr ufs (ufs) r = 0 (0xfffff804ae0e02e8) locked @ ufs/ffs/ffs_vfsops.c:1737 exclusive lockmgr ufs (ufs) r = 0 (0xfffff807fc0d72e8) locked @ kern/vfs_lookup.c:714 Process 68133 (rw) thread 0xfffff8043a5526e0 (100415) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0037f1e640) locked @ kern/vfs_bio.c:3889 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe003cbd73b8) locked @ kern/vfs_bio.c:3889 exclusive lockmgr ufs (ufs) r = 0 (0xfffff807e1c74a68) locked @ kern/vfs_vnops.c:877 Process 68131 (link) thread 0xfffff801a51f06e0 (100317) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe003b4ab5d8) locked @ kern/vfs_bio.c:3889 exclusive lockmgr ufs (ufs) r = 0 (0xfffff805d284e068) locked @ kern/vfs_syscalls.c:1546 exclusive lockmgr ufs (ufs) r = 0 (0xfffff8079b16b568) locked @ kern/vfs_lookup.c:714 Process 68130 (symlink) thread 0xfffff80390b8e000 (100468) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe003a00c748) locked @ kern/vfs_bio.c:3889 exclusive lockmgr ufs (ufs) r = 0 (0xfffff8000850b2e8) locked @ kern/vfs_subr.c:2914 Process 68129 (rw) thread 0xfffff8001d9db6e0 (100175) exclusive lockmgr ufs (ufs) r = 0 (0xfffff804a7f0e2e8) locked @ kern/vfs_vnops.c:877 Process 68126 (symlink) thread 0xfffff80434b80000 (100418) exclusive lockmgr ufs (ufs) r = 0 (0xfffff807557062e8) locked @ ufs/ffs/ffs_vfsops.c:1737 exclusive lockmgr ufs (ufs) r = 0 (0xfffff804872067e8) locked @ kern/vfs_lookup.c:714 Process 68125 (rw) thread 0xfffff8014feba000 (100284) exclusive rw per-fs softdep (per-fs softdep) r = 0 (0xfffff804dc5b2e00) locked @ ufs/ffs/ffs_softdep.c:10083 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe003adc37b0) locked @ kern/vfs_bio.c:3889 exclusive lockmgr ufs (ufs) r = 0 (0xfffff807070e57e8) locked @ kern/vfs_vnops.c:877 Process 68121 (rw) thread 0xfffff8014ffd16e0 (100311) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe003aecbfa8) locked @ kern/vfs_bio.c:3889 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe003dee0258) locked @ kern/vfs_bio.c:3889 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe003d3bd490) locked @ kern/vfs_bio.c:3889 exclusive lockmgr ufs (ufs) r = 0 (0xfffff801ef486a68) locked @ kern/vfs_vnops.c:877 Process 68119 (symlink) thread 0xfffff8014f8a16e0 (100350) exclusive lockmgr ufs (ufs) r = 0 (0xfffff80412edd068) locked @ ufs/ffs/ffs_vfsops.c:1737 exclusive lockmgr ufs (ufs) r = 0 (0xfffff805e24e3a68) locked @ kern/vfs_lookup.c:714 Process 68117 (rw) thread 0xfffff801a54ad000 (100380) shared rw bufobj interlock (bufobj interlock) r = 0 (0xfffff800492d6178) locked @ kern/vfs_bio.c:3875 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe003d4cdb60) locked @ kern/vfs_bio.c:3889 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe003967fd48) locked @ kern/vfs_bio.c:3889 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe003cc5eb98) locked @ kern/vfs_bio.c:3889 exclusive lockmgr ufs (ufs) r = 0 (0xfffff807232a97e8) locked @ kern/vfs_vnops.c:877 Process 68116 (symlink) thread 0xfffff8043bd406e0 (100464) exclusive lockmgr ufs (ufs) r = 0 (0xfffff80412ede2e8) locked @ ufs/ffs/ffs_vfsops.c:1737 exclusive lockmgr ufs (ufs) r = 0 (0xfffff8001d916ce8) locked @ kern/vfs_lookup.c:714 Process 68115 (openat) thread 0xfffff8036eda56e0 (100378) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0039daa428) locked @ kern/vfs_bio.c:3889 exclusive lockmgr ufs (ufs) r = 1 (0xfffff804e13217e8) locked @ kern/vfs_subr.c:2914 exclusive lockmgr ufs (ufs) r = 0 (0xfffff80444646568) locked @ kern/vfs_subr.c:2914 Process 68114 (rw) thread 0xfffff8003f1916e0 (100200) exclusive lockmgr ufs (ufs) r = 0 (0xfffff80412ce77e8) locked @ ufs/ffs/ffs_vfsops.c:1737 exclusive lockmgr ufs (ufs) r = 0 (0xfffff80783a45568) locked @ kern/vfs_lookup.c:714 Process 68112 (symlink) thread 0xfffff801ea4a76e0 (100465) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe003ab988a0) locked @ kern/vfs_bio.c:3889 exclusive lockmgr ufs (ufs) r = 0 (0xfffff8078a333a68) locked @ kern/vfs_subr.c:2914 Process 68111 (openat) thread 0xfffff804fa3e6000 (100446) exclusive lockmgr ufs (ufs) r = 0 (0xfffff804e1321a68) locked @ kern/vfs_subr.c:2914 Process 68110 (rw) thread 0xfffff80488f28000 (100450) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe003a2ad5a0) locked @ kern/vfs_bio.c:3889 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe003a0b36b0) locked @ kern/vfs_bio.c:3889 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe003c065558) locked @ kern/vfs_bio.c:3889 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe003abd1b70) locked @ kern/vfs_bio.c:3889 exclusive lockmgr ufs (ufs) r = 0 (0xfffff8069d3c7a68) locked @ kern/vfs_vnops.c:877 Process 68109 (symlink) thread 0xfffff8014f9db6e0 (100290) exclusive lockmgr ufs (ufs) r = 0 (0xfffff805d9d53a68) locked @ kern/vfs_lookup.c:714 Process 68108 (openat) thread 0xfffff800356e96e0 (100254) exclusive lockmgr ufs (ufs) r = 0 (0xfffff807556fa2e8) locked @ kern/vfs_subr.c:2914 Process 68106 (lockf2) thread 0xfffff801c0b006e0 (100456) exclusive sx ls_lock (ls_lock) r = 0 (0xfffff8037687e010) locked @ kern/kern_lockf.c:654 Process 68072 (g_raid3 data) thread 0xfffff8001ddb5000 (100449) exclusive sx graid3:lock (graid3:lock) r = 0 (0xfffff80044ea0c38) locked @ /usr/src/sys/geom/raid3/g_raid3.c:2118 Process 30 (pagedaemon) thread 0xfffff8001d455000 (100128) exclusive rw pmap pv list (pmap pv list) r = 0 (0xfffffe0037699a00) locked @ amd64/amd64/pmap.c:7673 db:1:pho1> show lockedvnods Locked vnodes vnode 0xfffff803ffc9a280: type VDIR usecount 94, writecount 0, refcount 4 mountedhere 0 flags (VMP_LAZYLIST) v_object 0xfffff80216b5a210 ref 0 pages 7 cleanbuf 0 dirtybuf 2 lock type ufs: EXCL by thread 0xfffff804fa4aa000 (pid 68236, mkdir, tid 100444) with exclusive waiters pending with shared waiters pending #0 0xffffffff80b9bdf4 at lockmgr_slock_hard+0x354 #1 0xffffffff80b9ccb8 at __lockmgr_args+0x798 #2 0xffffffff80eec63c at ffs_lock+0x7c #3 0xffffffff810f1978 at VOP_LOCK1_APV+0x48 #4 0xffffffff80cb7bbf at _vn_lock+0x4f #5 0xffffffff80c952a1 at lookup+0xe1 #6 0xffffffff80c94c61 at namei+0x4f1 #7 0xffffffff80cb3a62 at kern_mkdirat+0x92 #8 0xffffffff81074a01 at amd64_syscall+0x2f1 #9 0xffffffff8104a7d0 at fast_syscall_common+0x101 nlink=680, effnlink=80, size=60928, extsize 0 generation=67923ea8, uid=2007, gid=0, flags=0x0 ino 131072, on dev raid3/data vnode 0xfffff80444646500: type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VMP_LAZYLIST) v_object 0xfffff80554397210 ref 0 pages 0 cleanbuf 0 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff8036eda56e0 (pid 68115, openat, tid 100378) #0 0xffffffff80b9bdf4 at lockmgr_slock_hard+0x354 #1 0xffffffff80b9ccb8 at __lockmgr_args+0x798 #2 0xffffffff80eec63c at ffs_lock+0x7c #3 0xffffffff810f1978 at VOP_LOCK1_APV+0x48 #4 0xffffffff80cb7bbf at _vn_lock+0x4f #5 0xffffffff80ca2041 at vget_finish+0x81 #6 0xffffffff80c869d0 at cache_lookup+0x570 #7 0xffffffff80c8b2d8 at vfs_cache_lookup+0xa8 #8 0xffffffff810eec9d at VOP_LOOKUP_APV+0x5d #9 0xffffffff80c957d1 at lookup+0x611 #10 0xffffffff80c94c61 at namei+0x4f1 #11 0xffffffff80caff09 at kern_funlinkat+0xb9 #12 0xffffffff80cafe48 at sys_unlink+0x28 #13 0xffffffff81074a01 at amd64_syscall+0x2f1 #14 0xffffffff8104a7d0 at fast_syscall_common+0x101 nlink=2, effnlink=2, size=512, extsize 0 generation=8be83ed1, uid=2007, gid=0, flags=0x0 ino 131083, on dev raid3/data vnode 0xfffff80729324a00: type VDIR usecount 2, writecount 0, refcount 13 mountedhere 0 flags (VMP_LAZYLIST) v_object 0xfffff80336e9e630 ref 0 pages 70 cleanbuf 0 dirtybuf 10 lock type ufs: EXCL by thread 0xfffff803bc7e7000 (pid 68206, link, tid 100522) #0 0xffffffff80b9bdf4 at lockmgr_slock_hard+0x354 #1 0xffffffff80b9ccb8 at __lockmgr_args+0x798 #2 0xffffffff80eec63c at ffs_lock+0x7c #3 0xffffffff810f1978 at VOP_LOCK1_APV+0x48 #4 0xffffffff80cb7bbf at _vn_lock+0x4f #5 0xffffffff80c952a1 at lookup+0xe1 #6 0xffffffff80c94c61 at namei+0x4f1 #7 0xffffffff80caff09 at kern_funlinkat+0xb9 #8 0xffffffff80cafe48 at sys_unlink+0x28 #9 0xffffffff81074a01 at amd64_syscall+0x2f1 #10 0xffffffff8104a7d0 at fast_syscall_common+0x101 nlink=2, effnlink=2, size=317952, extsize 0 generation=177402ed, uid=2007, gid=0, flags=0x0 ino 131096, on dev raid3/data vnode 0xfffff805c9eef000: type VDIR usecount 2, writecount 0, refcount 13 mountedhere 0 flags (VMP_LAZYLIST) v_object 0xfffff802eae0d738 ref 0 pages 70 cleanbuf 0 dirtybuf 10 lock type ufs: EXCL by thread 0xfffff805455686e0 (pid 68137, link, tid 100452) #0 0xffffffff80b9bdf4 at lockmgr_slock_hard+0x354 #1 0xffffffff80b9ccb8 at __lockmgr_args+0x798 #2 0xffffffff80eec63c at ffs_lock+0x7c #3 0xffffffff810f1978 at VOP_LOCK1_APV+0x48 #4 0xffffffff80cb7bbf at _vn_lock+0x4f #5 0xffffffff80c952a1 at lookup+0xe1 #6 0xffffffff80c94c61 at namei+0x4f1 #7 0xffffffff80caff09 at kern_funlinkat+0xb9 #8 0xffffffff80cafe48 at sys_unlink+0x28 #9 0xffffffff81074a01 at amd64_syscall+0x2f1 #10 0xffffffff8104a7d0 at fast_syscall_common+0x101 nlink=2, effnlink=2, size=317952, extsize 0 generation=a70a62fe, uid=2007, gid=0, flags=0x0 ino 131097, on dev raid3/data vnode 0xfffff80783a45500: type VDIR usecount 3, writecount 0, refcount 2 mountedhere 0 flags (VMP_LAZYLIST) v_object 0xfffff8033790eb58 ref 0 pages 0 cleanbuf 0 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff8003f1916e0 (pid 68114, rw, tid 100200) #0 0xffffffff80b9bdf4 at lockmgr_slock_hard+0x354 #1 0xffffffff80b9ccb8 at __lockmgr_args+0x798 #2 0xffffffff80eec63c at ffs_lock+0x7c #3 0xffffffff810f1978 at VOP_LOCK1_APV+0x48 #4 0xffffffff80cb7bbf at _vn_lock+0x4f #5 0xffffffff80c952a1 at lookup+0xe1 #6 0xffffffff80c94c61 at namei+0x4f1 #7 0xffffffff80cb6f41 at vn_open_cred+0xf1 #8 0xffffffff80caeaf3 at kern_openat+0x1f3 #9 0xffffffff81074a01 at amd64_syscall+0x2f1 #10 0xffffffff8104a7d0 at fast_syscall_common+0x101 nlink=2, effnlink=2, size=512, extsize 0 generation=680ffda1, uid=2007, gid=0, flags=0x0 ino 131100, on dev raid3/data vnode 0xfffff80604afa000: type VDIR usecount 2, writecount 0, refcount 3 mountedhere 0 flags (VMP_LAZYLIST) v_object 0xfffff801a5d9f528 ref 0 pages 0 cleanbuf 0 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff80434b806e0 (pid 68153, creat, tid 100417) #0 0xffffffff80b9bdf4 at lockmgr_slock_hard+0x354 #1 0xffffffff80b9ccb8 at __lockmgr_args+0x798 #2 0xffffffff80eec63c at ffs_lock+0x7c #3 0xffffffff810f1978 at VOP_LOCK1_APV+0x48 #4 0xffffffff80cb7bbf at _vn_lock+0x4f #5 0xffffffff80c952a1 at lookup+0xe1 #6 0xffffffff80c94c61 at namei+0x4f1 #7 0xffffffff80cb6f41 at vn_open_cred+0xf1 #8 0xffffffff80caeaf3 at kern_openat+0x1f3 #9 0xffffffff81074a01 at amd64_syscall+0x2f1 #10 0xffffffff8104a7d0 at fast_syscall_common+0x101 nlink=2, effnlink=2, size=9216, extsize 0 generation=3fc242a7, uid=2007, gid=0, flags=0x0 ino 131101, on dev raid3/data vnode 0xfffff805d9d53a00: type VDIR usecount 2, writecount 0, refcount 9 mountedhere 0 flags (VMP_LAZYLIST) v_object 0xfffff804377c9528 ref 0 pages 34 cleanbuf 0 dirtybuf 6 lock type ufs: EXCL by thread 0xfffff8014f9db6e0 (pid 68109, symlink, tid 100290) #0 0xffffffff80b9bdf4 at lockmgr_slock_hard+0x354 #1 0xffffffff80b9ccb8 at __lockmgr_args+0x798 #2 0xffffffff80eec63c at ffs_lock+0x7c #3 0xffffffff810f1978 at VOP_LOCK1_APV+0x48 #4 0xffffffff80cb7bbf at _vn_lock+0x4f #5 0xffffffff80c952a1 at lookup+0xe1 #6 0xffffffff80c94c61 at namei+0x4f1 #7 0xffffffff80cafa9b at kern_symlinkat+0xcb #8 0xffffffff81074a01 at amd64_syscall+0x2f1 #9 0xffffffff8104a7d0 at fast_syscall_common+0x101 nlink=2, effnlink=2, size=170496, extsize 0 generation=52372d41, uid=2007, gid=0, flags=0x0 ino 131102, on dev raid3/data vnode 0xfffff805e24e3a00: type VDIR usecount 2, writecount 0, refcount 3 mountedhere 0 flags (VMP_LAZYLIST) v_object 0xfffff803d7da7e70 ref 0 pages 0 cleanbuf 0 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff8014f8a16e0 (pid 68119, symlink, tid 100350) #0 0xffffffff80b9bdf4 at lockmgr_slock_hard+0x354 #1 0xffffffff80b9ccb8 at __lockmgr_args+0x798 #2 0xffffffff80eec63c at ffs_lock+0x7c #3 0xffffffff810f1978 at VOP_LOCK1_APV+0x48 #4 0xffffffff80cb7bbf at _vn_lock+0x4f #5 0xffffffff80c952a1 at lookup+0xe1 #6 0xffffffff80c94c61 at namei+0x4f1 #7 0xffffffff80cafa9b at kern_symlinkat+0xcb #8 0xffffffff81074a01 at amd64_syscall+0x2f1 #9 0xffffffff8104a7d0 at fast_syscall_common+0x101 nlink=2, effnlink=2, size=8192, extsize 0 generation=4eb10975, uid=2007, gid=0, flags=0x0 ino 131106, on dev raid3/data vnode 0xfffff80487206780: type VDIR usecount 2, writecount 0, refcount 9 mountedhere 0 flags (VMP_LAZYLIST) v_object 0xfffff80593e44528 ref 0 pages 35 cleanbuf 0 dirtybuf 6 lock type ufs: EXCL by thread 0xfffff80434b80000 (pid 68126, symlink, tid 100418) #0 0xffffffff80b9bdf4 at lockmgr_slock_hard+0x354 #1 0xffffffff80b9ccb8 at __lockmgr_args+0x798 #2 0xffffffff80eec63c at ffs_lock+0x7c #3 0xffffffff810f1978 at VOP_LOCK1_APV+0x48 #4 0xffffffff80cb7bbf at _vn_lock+0x4f #5 0xffffffff80c952a1 at lookup+0xe1 #6 0xffffffff80c94c61 at namei+0x4f1 #7 0xffffffff80cafa9b at kern_symlinkat+0xcb #8 0xffffffff81074a01 at amd64_syscall+0x2f1 #9 0xffffffff8104a7d0 at fast_syscall_common+0x101 nlink=2, effnlink=2, size=175616, extsize 0 generation=4353cb58, uid=2007, gid=0, flags=0x0 ino 131107, on dev raid3/data vnode 0xfffff807fc0d7280: type VDIR usecount 2, writecount 0, refcount 9 mountedhere 0 flags (VMP_LAZYLIST) v_object 0xfffff8027b9b9e70 ref 0 pages 37 cleanbuf 0 dirtybuf 6 lock type ufs: EXCL by thread 0xfffff8033fb00000 (pid 68136, symlink, tid 100395) #0 0xffffffff80b9bdf4 at lockmgr_slock_hard+0x354 #1 0xffffffff80b9ccb8 at __lockmgr_args+0x798 #2 0xffffffff80eec63c at ffs_lock+0x7c #3 0xffffffff810f1978 at VOP_LOCK1_APV+0x48 #4 0xffffffff80cb7bbf at _vn_lock+0x4f #5 0xffffffff80c952a1 at lookup+0xe1 #6 0xffffffff80c94c61 at namei+0x4f1 #7 0xffffffff80cafa9b at kern_symlinkat+0xcb #8 0xffffffff81074a01 at amd64_syscall+0x2f1 #9 0xffffffff8104a7d0 at fast_syscall_common+0x101 nlink=2, effnlink=2, size=183296, extsize 0 generation=e8fcf312, uid=2007, gid=0, flags=0x0 ino 131108, on dev raid3/data vnode 0xfffff8079b16b500: type VDIR usecount 2, writecount 0, refcount 3 mountedhere 0 flags (VMP_LAZYLIST) v_object 0xfffff805eedfc630 ref 0 pages 0 cleanbuf 0 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff801a51f06e0 (pid 68131, link, tid 100317) #0 0xffffffff80b9bdf4 at lockmgr_slock_hard+0x354 #1 0xffffffff80b9ccb8 at __lockmgr_args+0x798 #2 0xffffffff80eec63c at ffs_lock+0x7c #3 0xffffffff810f1978 at VOP_LOCK1_APV+0x48 #4 0xffffffff80cb7bbf at _vn_lock+0x4f #5 0xffffffff80c952a1 at lookup+0xe1 #6 0xffffffff80c94c61 at namei+0x4f1 #7 0xffffffff80caf6dd at kern_linkat_vp+0x6d #8 0xffffffff80caf4a2 at sys_link+0x92 #9 0xffffffff81074a01 at amd64_syscall+0x2f1 #10 0xffffffff8104a7d0 at fast_syscall_common+0x101 nlink=2, effnlink=2, size=8704, extsize 0 generation=198451bf, uid=2007, gid=0, flags=0x0 ino 131111, on dev raid3/data vnode 0xfffff8001d916c80: type VDIR usecount 2, writecount 0, refcount 9 mountedhere 0 flags (VMP_LAZYLIST) v_object 0xfffff803f44c0840 ref 0 pages 45 cleanbuf 0 dirtybuf 7 lock type ufs: EXCL by thread 0xfffff8043bd406e0 (pid 68116, symlink, tid 100464) #0 0xffffffff80b9bdf4 at lockmgr_slock_hard+0x354 #1 0xffffffff80b9ccb8 at __lockmgr_args+0x798 #2 0xffffffff80eec63c at ffs_lock+0x7c #3 0xffffffff810f1978 at VOP_LOCK1_APV+0x48 #4 0xffffffff80cb7bbf at _vn_lock+0x4f #5 0xffffffff80c952a1 at lookup+0xe1 #6 0xffffffff80c94c61 at namei+0x4f1 #7 0xffffffff80cafa9b at kern_symlinkat+0xcb #8 0xffffffff81074a01 at amd64_syscall+0x2f1 #9 0xffffffff8104a7d0 at fast_syscall_common+0x101 nlink=2, effnlink=2, size=214528, extsize 0 generation=2d2c1423, uid=2007, gid=0, flags=0x0 ino 131112, on dev raid3/data vnode 0xfffff8059aadc780: type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VMP_LAZYLIST) v_object 0xfffff8029bf2d738 ref 0 pages 0 cleanbuf 0 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff8043bd40000 (pid 68148, symlink, tid 100470) #0 0xffffffff80b9bdf4 at lockmgr_slock_hard+0x354 #1 0xffffffff80b9ccb8 at __lockmgr_args+0x798 #2 0xffffffff80eec63c at ffs_lock+0x7c #3 0xffffffff810f1978 at VOP_LOCK1_APV+0x48 #4 0xffffffff80cb7bbf at _vn_lock+0x4f #5 0xffffffff80c952a1 at lookup+0xe1 #6 0xffffffff80c94c61 at namei+0x4f1 #7 0xffffffff80cafa9b at kern_symlinkat+0xcb #8 0xffffffff81074a01 at amd64_syscall+0x2f1 #9 0xffffffff8104a7d0 at fast_syscall_common+0x101 nlink=2, effnlink=2, size=27648, extsize 0 generation=11b81176, uid=2007, gid=0, flags=0x0 ino 131113, on dev raid3/data vnode 0xfffff801a8844c80: type VDIR usecount 2, writecount 0, refcount 13 mountedhere 0 flags (VMP_LAZYLIST) v_object 0xfffff80432456420 ref 0 pages 70 cleanbuf 0 dirtybuf 10 lock type ufs: EXCL by thread 0xfffff8014fb4e6e0 (pid 68143, link, tid 100244) #0 0xffffffff80b9bdf4 at lockmgr_slock_hard+0x354 #1 0xffffffff80b9ccb8 at __lockmgr_args+0x798 #2 0xffffffff80eec63c at ffs_lock+0x7c #3 0xffffffff810f1978 at VOP_LOCK1_APV+0x48 #4 0xffffffff80cb7bbf at _vn_lock+0x4f #5 0xffffffff80c952a1 at lookup+0xe1 #6 0xffffffff80c94c61 at namei+0x4f1 #7 0xffffffff80caff09 at kern_funlinkat+0xb9 #8 0xffffffff80cafe48 at sys_unlink+0x28 #9 0xffffffff81074a01 at amd64_syscall+0x2f1 #10 0xffffffff8104a7d0 at fast_syscall_common+0x101 nlink=2, effnlink=2, size=317952, extsize 0 generation=fcfb5624, uid=2007, gid=0, flags=0x0 ino 131114, on dev raid3/data vnode 0xfffff8062921b500: type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VMP_LAZYLIST) v_object 0xfffff803f4eaf318 ref 0 pages 0 cleanbuf 0 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff80436f82000 (pid 68159, creat, tid 100405) #0 0xffffffff80b9bdf4 at lockmgr_slock_hard+0x354 #1 0xffffffff80b9ccb8 at __lockmgr_args+0x798 #2 0xffffffff80eec63c at ffs_lock+0x7c #3 0xffffffff810f1978 at VOP_LOCK1_APV+0x48 #4 0xffffffff80cb7bbf at _vn_lock+0x4f #5 0xffffffff80c952a1 at lookup+0xe1 #6 0xffffffff80c94c61 at namei+0x4f1 #7 0xffffffff80cb6f41 at vn_open_cred+0xf1 #8 0xffffffff80caeaf3 at kern_openat+0x1f3 #9 0xffffffff81074a01 at amd64_syscall+0x2f1 #10 0xffffffff8104a7d0 at fast_syscall_common+0x101 nlink=2, effnlink=2, size=512, extsize 0 generation=a43032d, uid=2007, gid=0, flags=0x0 ino 131119, on dev raid3/data vnode 0xfffff804f0439000: type VDIR usecount 2, writecount 0, refcount 8 mountedhere 0 flags (VMP_LAZYLIST) v_object 0xfffff8060570b528 ref 0 pages 37 cleanbuf 0 dirtybuf 6 lock type ufs: EXCL by thread 0xfffff8046af4d000 (pid 68199, symlink, tid 100408) #0 0xffffffff80b9bdf4 at lockmgr_slock_hard+0x354 #1 0xffffffff80b9ccb8 at __lockmgr_args+0x798 #2 0xffffffff80eec63c at ffs_lock+0x7c #3 0xffffffff810f1978 at VOP_LOCK1_APV+0x48 #4 0xffffffff80cb7bbf at _vn_lock+0x4f #5 0xffffffff80c952a1 at lookup+0xe1 #6 0xffffffff80c94c61 at namei+0x4f1 #7 0xffffffff80cafa9b at kern_symlinkat+0xcb #8 0xffffffff81074a01 at amd64_syscall+0x2f1 #9 0xffffffff8104a7d0 at fast_syscall_common+0x101 nlink=2, effnlink=2, size=181248, extsize 0 generation=37c440bb, uid=2007, gid=0, flags=0x0 ino 131122, on dev raid3/data vnode 0xfffff801a8965280: type VDIR usecount 2, writecount 0, refcount 13 mountedhere 0 flags (VMP_LAZYLIST) v_object 0xfffff804e80fed68 ref 0 pages 70 cleanbuf 0 dirtybuf 10 lock type ufs: EXCL by thread 0xfffff80545568000 (pid 68185, link, tid 100451) #0 0xffffffff80b9bdf4 at lockmgr_slock_hard+0x354 #1 0xffffffff80b9ccb8 at __lockmgr_args+0x798 #2 0xffffffff80eec63c at ffs_lock+0x7c #3 0xffffffff810f1978 at VOP_LOCK1_APV+0x48 #4 0xffffffff80cb7bbf at _vn_lock+0x4f #5 0xffffffff80c952a1 at lookup+0xe1 #6 0xffffffff80c94c61 at namei+0x4f1 #7 0xffffffff80caff09 at kern_funlinkat+0xb9 #8 0xffffffff80cafe48 at sys_unlink+0x28 #9 0xffffffff81074a01 at amd64_syscall+0x2f1 #10 0xffffffff8104a7d0 at fast_syscall_common+0x101 nlink=2, effnlink=2, size=317952, extsize 0 generation=bb8f3b8c, uid=2007, gid=0, flags=0x0 ino 131123, on dev raid3/data vnode 0xfffff8023e351780: type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VMP_LAZYLIST) v_object 0xfffff805d27c2420 ref 0 pages 0 cleanbuf 0 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff801a51ee6e0 (pid 68177, creat, tid 100325) #0 0xffffffff80b9bdf4 at lockmgr_slock_hard+0x354 #1 0xffffffff80b9ccb8 at __lockmgr_args+0x798 #2 0xffffffff80eec63c at ffs_lock+0x7c #3 0xffffffff810f1978 at VOP_LOCK1_APV+0x48 #4 0xffffffff80cb7bbf at _vn_lock+0x4f #5 0xffffffff80c952a1 at lookup+0xe1 #6 0xffffffff80c94c61 at namei+0x4f1 #7 0xffffffff80cb6f41 at vn_open_cred+0xf1 #8 0xffffffff80caeaf3 at kern_openat+0x1f3 #9 0xffffffff81074a01 at amd64_syscall+0x2f1 #10 0xffffffff8104a7d0 at fast_syscall_common+0x101 nlink=2, effnlink=2, size=6144, extsize 0 generation=9524bcc8, uid=2007, gid=0, flags=0x0 ino 131124, on dev raid3/data vnode 0xfffff80049206500: type VDIR usecount 2, writecount 0, refcount 8 mountedhere 0 flags (VMP_LAZYLIST) v_object 0xfffff8025cd14840 ref 0 pages 36 cleanbuf 0 dirtybuf 6 lock type ufs: EXCL by thread 0xfffff806f2967000 (pid 68189, symlink, tid 100487) #0 0xffffffff80b9bdf4 at lockmgr_slock_hard+0x354 #1 0xffffffff80b9ccb8 at __lockmgr_args+0x798 #2 0xffffffff80eec63c at ffs_lock+0x7c #3 0xffffffff810f1978 at VOP_LOCK1_APV+0x48 #4 0xffffffff80cb7bbf at _vn_lock+0x4f #5 0xffffffff80c952a1 at lookup+0xe1 #6 0xffffffff80c94c61 at namei+0x4f1 #7 0xffffffff80cafa9b at kern_symlinkat+0xcb #8 0xffffffff81074a01 at amd64_syscall+0x2f1 #9 0xffffffff8104a7d0 at fast_syscall_common+0x101 nlink=2, effnlink=2, size=177664, extsize 0 generation=b928e1a1, uid=2007, gid=0, flags=0x0 ino 131125, on dev raid3/data vnode 0xfffff804ae0e9c80: type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VMP_LAZYLIST) v_object 0xfffff805cab1f738 ref 0 pages 0 cleanbuf 0 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff805b3f1c6e0 (pid 68169, creat, tid 100474) #0 0xffffffff80b9bdf4 at lockmgr_slock_hard+0x354 #1 0xffffffff80b9ccb8 at __lockmgr_args+0x798 #2 0xffffffff80eec63c at ffs_lock+0x7c #3 0xffffffff810f1978 at VOP_LOCK1_APV+0x48 #4 0xffffffff80cb7bbf at _vn_lock+0x4f #5 0xffffffff80c952a1 at lookup+0xe1 #6 0xffffffff80c94c61 at namei+0x4f1 #7 0xffffffff80cb6f41 at vn_open_cred+0xf1 #8 0xffffffff80caeaf3 at kern_openat+0x1f3 #9 0xffffffff81074a01 at amd64_syscall+0x2f1 #10 0xffffffff8104a7d0 at fast_syscall_common+0x101 nlink=2, effnlink=2, size=6144, extsize 0 generation=185fa36, uid=2007, gid=0, flags=0x0 ino 131126, on dev raid3/data vnode 0xfffff803eec4a500: type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VMP_LAZYLIST) v_object 0xfffff802d7d07420 ref 0 pages 0 cleanbuf 0 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff8014fa2e6e0 (pid 68190, creat, tid 100246) #0 0xffffffff80b9bdf4 at lockmgr_slock_hard+0x354 #1 0xffffffff80b9ccb8 at __lockmgr_args+0x798 #2 0xffffffff80eec63c at ffs_lock+0x7c #3 0xffffffff810f1978 at VOP_LOCK1_APV+0x48 #4 0xffffffff80cb7bbf at _vn_lock+0x4f #5 0xffffffff80c952a1 at lookup+0xe1 #6 0xffffffff80c94c61 at namei+0x4f1 #7 0xffffffff80cb6f41 at vn_open_cred+0xf1 #8 0xffffffff80caeaf3 at kern_openat+0x1f3 #9 0xffffffff81074a01 at amd64_syscall+0x2f1 #10 0xffffffff8104a7d0 at fast_syscall_common+0x101 nlink=2, effnlink=2, size=512, extsize 0 generation=42980ffa, uid=2007, gid=0, flags=0x0 ino 131127, on dev raid3/data vnode 0xfffff806d9bf0c80: type VDIR usecount 2, writecount 0, refcount 8 mountedhere 0 flags (VMP_LAZYLIST) v_object 0xfffff801183dd420 ref 0 pages 37 cleanbuf 0 dirtybuf 6 lock type ufs: EXCL by thread 0xfffff801be39d6e0 (pid 68162, symlink, tid 100520) #0 0xffffffff80b9bdf4 at lockmgr_slock_hard+0x354 #1 0xffffffff80b9ccb8 at __lockmgr_args+0x798 #2 0xffffffff80eec63c at ffs_lock+0x7c #3 0xffffffff810f1978 at VOP_LOCK1_APV+0x48 #4 0xffffffff80cb7bbf at _vn_lock+0x4f #5 0xffffffff80c952a1 at lookup+0xe1 #6 0xffffffff80c94c61 at namei+0x4f1 #7 0xffffffff80cafa9b at kern_symlinkat+0xcb #8 0xffffffff81074a01 at amd64_syscall+0x2f1 #9 0xffffffff8104a7d0 at fast_syscall_common+0x101 nlink=2, effnlink=2, size=181760, extsize 0 generation=5d9a5618, uid=2007, gid=0, flags=0x0 ino 131129, on dev raid3/data vnode 0xfffff804c05f4000: type VDIR usecount 2, writecount 0, refcount 9 mountedhere 0 flags (VMP_LAZYLIST) v_object 0xfffff801a54f3b58 ref 0 pages 43 cleanbuf 0 dirtybuf 7 lock type ufs: EXCL by thread 0xfffff801a5159000 (pid 68179, symlink, tid 100316) #0 0xffffffff80b9bdf4 at lockmgr_slock_hard+0x354 #1 0xffffffff80b9ccb8 at __lockmgr_args+0x798 #2 0xffffffff80eec63c at ffs_lock+0x7c #3 0xffffffff810f1978 at VOP_LOCK1_APV+0x48 #4 0xffffffff80cb7bbf at _vn_lock+0x4f #5 0xffffffff80c952a1 at lookup+0xe1 #6 0xffffffff80c94c61 at namei+0x4f1 #7 0xffffffff80cafa9b at kern_symlinkat+0xcb #8 0xffffffff81074a01 at amd64_syscall+0x2f1 #9 0xffffffff8104a7d0 at fast_syscall_common+0x101 nlink=2, effnlink=2, size=208896, extsize 0 generation=4a423795, uid=2007, gid=0, flags=0x0 ino 131131, on dev raid3/data vnode 0xfffff80783adac80: type VDIR usecount 2, writecount 0, refcount 13 mountedhere 0 flags (VMP_LAZYLIST) v_object 0xfffff805d9cdf108 ref 0 pages 70 cleanbuf 0 dirtybuf 10 lock type ufs: EXCL by thread 0xfffff8014fb4e000 (pid 68193, link, tid 100255) #0 0xffffffff80b9bdf4 at lockmgr_slock_hard+0x354 #1 0xffffffff80b9ccb8 at __lockmgr_args+0x798 #2 0xffffffff80eec63c at ffs_lock+0x7c #3 0xffffffff810f1978 at VOP_LOCK1_APV+0x48 #4 0xffffffff80cb7bbf at _vn_lock+0x4f #5 0xffffffff80c952a1 at lookup+0xe1 #6 0xffffffff80c94c61 at namei+0x4f1 #7 0xffffffff80caff09 at kern_funlinkat+0xb9 #8 0xffffffff80cafe48 at sys_unlink+0x28 #9 0xffffffff81074a01 at amd64_syscall+0x2f1 #10 0xffffffff8104a7d0 at fast_syscall_common+0x101 nlink=2, effnlink=2, size=317952, extsize 0 generation=f60ac635, uid=2007, gid=0, flags=0x0 ino 131135, on dev raid3/data vnode 0xfffff8063a8d2280: type VDIR usecount 2, writecount 0, refcount 8 mountedhere 0 flags (VMP_LAZYLIST) v_object 0xfffff80337fe8000 ref 0 pages 38 cleanbuf 0 dirtybuf 6 lock type ufs: EXCL by thread 0xfffff8001dce6000 (pid 68142, symlink, tid 100152) #0 0xffffffff80b9bdf4 at lockmgr_slock_hard+0x354 #1 0xffffffff80b9ccb8 at __lockmgr_args+0x798 #2 0xffffffff80eec63c at ffs_lock+0x7c #3 0xffffffff810f1978 at VOP_LOCK1_APV+0x48 #4 0xffffffff80cb7bbf at _vn_lock+0x4f #5 0xffffffff80c952a1 at lookup+0xe1 #6 0xffffffff80c94c61 at namei+0x4f1 #7 0xffffffff80cafa9b at kern_symlinkat+0xcb #8 0xffffffff81074a01 at amd64_syscall+0x2f1 #9 0xffffffff8104a7d0 at fast_syscall_common+0x101 nlink=2, effnlink=2, size=188416, extsize 0 generation=aa7ab413, uid=2007, gid=0, flags=0x0 ino 131137, on dev raid3/data vnode 0xfffff804872c8000: type VDIR usecount 2, writecount 0, refcount 8 mountedhere 0 flags (VMP_LAZYLIST) v_object 0xfffff80731533e70 ref 0 pages 39 cleanbuf 0 dirtybuf 6 lock type ufs: EXCL by thread 0xfffff8014fa2e000 (pid 68212, symlink, tid 100276) #0 0xffffffff80b9bdf4 at lockmgr_slock_hard+0x354 #1 0xffffffff80b9ccb8 at __lockmgr_args+0x798 #2 0xffffffff80eec63c at ffs_lock+0x7c #3 0xffffffff810f1978 at VOP_LOCK1_APV+0x48 #4 0xffffffff80cb7bbf at _vn_lock+0x4f #5 0xffffffff80c952a1 at lookup+0xe1 #6 0xffffffff80c94c61 at namei+0x4f1 #7 0xffffffff80cafa9b at kern_symlinkat+0xcb #8 0xffffffff81074a01 at amd64_syscall+0x2f1 #9 0xffffffff8104a7d0 at fast_syscall_common+0x101 nlink=2, effnlink=2, size=189440, extsize 0 generation=2daf6bd3, uid=2007, gid=0, flags=0x0 ino 131139, on dev raid3/data vnode 0xfffff8004923c780: type VDIR usecount 2, writecount 0, refcount 13 mountedhere 0 flags (VMP_LAZYLIST) v_object 0xfffff801eae69840 ref 0 pages 70 cleanbuf 0 dirtybuf 10 lock type ufs: EXCL by thread 0xfffff8014fb2c6e0 (pid 68180, link, tid 100240) #0 0xffffffff80b9bdf4 at lockmgr_slock_hard+0x354 #1 0xffffffff80b9ccb8 at __lockmgr_args+0x798 #2 0xffffffff80eec63c at ffs_lock+0x7c #3 0xffffffff810f1978 at VOP_LOCK1_APV+0x48 #4 0xffffffff80cb7bbf at _vn_lock+0x4f #5 0xffffffff80c952a1 at lookup+0xe1 #6 0xffffffff80c94c61 at namei+0x4f1 #7 0xffffffff80caff09 at kern_funlinkat+0xb9 #8 0xffffffff80cafe48 at sys_unlink+0x28 #9 0xffffffff81074a01 at amd64_syscall+0x2f1 #10 0xffffffff8104a7d0 at fast_syscall_common+0x101 nlink=2, effnlink=2, size=317952, extsize 0 generation=1210c208, uid=2007, gid=0, flags=0x0 ino 131142, on dev raid3/data vnode 0xfffff802be484280: type VDIR usecount 2, writecount 0, refcount 8 mountedhere 0 flags (VMP_LAZYLIST) v_object 0xfffff806f9996a50 ref 0 pages 39 cleanbuf 0 dirtybuf 6 lock type ufs: EXCL by thread 0xfffff800351126e0 (pid 68221, symlink, tid 100189) #0 0xffffffff80b9bdf4 at lockmgr_slock_hard+0x354 #1 0xffffffff80b9ccb8 at __lockmgr_args+0x798 #2 0xffffffff80eec63c at ffs_lock+0x7c #3 0xffffffff810f1978 at VOP_LOCK1_APV+0x48 #4 0xffffffff80cb7bbf at _vn_lock+0x4f #5 0xffffffff80c952a1 at lookup+0xe1 #6 0xffffffff80c94c61 at namei+0x4f1 #7 0xffffffff80cafa9b at kern_symlinkat+0xcb #8 0xffffffff81074a01 at amd64_syscall+0x2f1 #9 0xffffffff8104a7d0 at fast_syscall_common+0x101 nlink=2, effnlink=2, size=189952, extsize 0 generation=30baaa1f, uid=2007, gid=0, flags=0x0 ino 131144, on dev raid3/data vnode 0xfffff804846c5280: type VDIR usecount 2, writecount 0, refcount 7 mountedhere 0 flags (VMP_LAZYLIST) v_object 0xfffff80337beec60 ref 0 pages 31 cleanbuf 0 dirtybuf 5 lock type ufs: EXCL by thread 0xfffff80285002000 (pid 68172, symlink, tid 100517) #0 0xffffffff80b9bdf4 at lockmgr_slock_hard+0x354 #1 0xffffffff80b9ccb8 at __lockmgr_args+0x798 #2 0xffffffff80eec63c at ffs_lock+0x7c #3 0xffffffff810f1978 at VOP_LOCK1_APV+0x48 #4 0xffffffff80cb7bbf at _vn_lock+0x4f #5 0xffffffff80c952a1 at lookup+0xe1 #6 0xffffffff80c94c61 at namei+0x4f1 #7 0xffffffff80cafa9b at kern_symlinkat+0xcb #8 0xffffffff81074a01 at amd64_syscall+0x2f1 #9 0xffffffff8104a7d0 at fast_syscall_common+0x101 nlink=2, effnlink=2, size=159744, extsize 0 generation=8ff79513, uid=2007, gid=0, flags=0x0 ino 131146, on dev raid3/data vnode 0xfffff805e572ac80: type VDIR usecount 2, writecount 0, refcount 8 mountedhere 0 flags (VMP_LAZYLIST) v_object 0xfffff806f98ba630 ref 0 pages 36 cleanbuf 0 dirtybuf 6 lock type ufs: EXCL by thread 0xfffff8001d80f6e0 (pid 68204, symlink, tid 100171) #0 0xffffffff80b9bdf4 at lockmgr_slock_hard+0x354 #1 0xffffffff80b9ccb8 at __lockmgr_args+0x798 #2 0xffffffff80eec63c at ffs_lock+0x7c #3 0xffffffff810f1978 at VOP_LOCK1_APV+0x48 #4 0xffffffff80cb7bbf at _vn_lock+0x4f #5 0xffffffff80c952a1 at lookup+0xe1 #6 0xffffffff80c94c61 at namei+0x4f1 #7 0xffffffff80cafa9b at kern_symlinkat+0xcb #8 0xffffffff81074a01 at amd64_syscall+0x2f1 #9 0xffffffff8104a7d0 at fast_syscall_common+0x101 nlink=2, effnlink=2, size=179712, extsize 0 generation=25a78a24, uid=2007, gid=0, flags=0x0 ino 131148, on dev raid3/data vnode 0xfffff8049d048000: type VDIR usecount 2, writecount 0, refcount 9 mountedhere 0 flags (VMP_LAZYLIST) v_object 0xfffff8047b617948 ref 0 pages 43 cleanbuf 0 dirtybuf 7 lock type ufs: EXCL by thread 0xfffff8001d811000 (pid 68217, symlink, tid 100179) #0 0xffffffff80b9bdf4 at lockmgr_slock_hard+0x354 #1 0xffffffff80b9ccb8 at __lockmgr_args+0x798 #2 0xffffffff80eec63c at ffs_lock+0x7c #3 0xffffffff810f1978 at VOP_LOCK1_APV+0x48 #4 0xffffffff80cb7bbf at _vn_lock+0x4f #5 0xffffffff80c952a1 at lookup+0xe1 #6 0xffffffff80c94c61 at namei+0x4f1 #7 0xffffffff80cafa9b at kern_symlinkat+0xcb #8 0xffffffff81074a01 at amd64_syscall+0x2f1 #9 0xffffffff8104a7d0 at fast_syscall_common+0x101 nlink=2, effnlink=2, size=205312, extsize 0 generation=62882065, uid=2007, gid=0, flags=0x0 ino 131150, on dev raid3/data vnode 0xfffff804b1f92000: type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VMP_LAZYLIST) v_object 0xfffff8042b73fc60 ref 0 pages 0 cleanbuf 0 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff8014febb6e0 (pid 68205, creat, tid 100285) #0 0xffffffff80b9bdf4 at lockmgr_slock_hard+0x354 #1 0xffffffff80b9ccb8 at __lockmgr_args+0x798 #2 0xffffffff80eec63c at ffs_lock+0x7c #3 0xffffffff810f1978 at VOP_LOCK1_APV+0x48 #4 0xffffffff80cb7bbf at _vn_lock+0x4f #5 0xffffffff80c952a1 at lookup+0xe1 #6 0xffffffff80c94c61 at namei+0x4f1 #7 0xffffffff80cb6f41 at vn_open_cred+0xf1 #8 0xffffffff80caeaf3 at kern_openat+0x1f3 #9 0xffffffff81074a01 at amd64_syscall+0x2f1 #10 0xffffffff8104a7d0 at fast_syscall_common+0x101 nlink=2, effnlink=2, size=11776, extsize 0 generation=476bb1e7, uid=2007, gid=0, flags=0x0 ino 131156, on dev raid3/data vnode 0xfffff8043f2a2000: type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VMP_LAZYLIST) v_object 0xfffff804fa415318 ref 0 pages 0 cleanbuf 0 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff8014fcd2000 (pid 68196, creat, tid 100384) #0 0xffffffff80b9bdf4 at lockmgr_slock_hard+0x354 #1 0xffffffff80b9ccb8 at __lockmgr_args+0x798 #2 0xffffffff80eec63c at ffs_lock+0x7c #3 0xffffffff810f1978 at VOP_LOCK1_APV+0x48 #4 0xffffffff80cb7bbf at _vn_lock+0x4f #5 0xffffffff80c952a1 at lookup+0xe1 #6 0xffffffff80c94c61 at namei+0x4f1 #7 0xffffffff80cb6f41 at vn_open_cred+0xf1 #8 0xffffffff80caeaf3 at kern_openat+0x1f3 #9 0xffffffff81074a01 at amd64_syscall+0x2f1 #10 0xffffffff8104a7d0 at fast_syscall_common+0x101 nlink=2, effnlink=2, size=3072, extsize 0 generation=64084df8, uid=2007, gid=0, flags=0x0 ino 131173, on dev raid3/data vnode 0xfffff8078a333a00: type VLNK usecount 0, writecount 0, refcount 1 flags (VV_NOSYNC|VI_DOINGINACT|VMP_LAZYLIST) lock type ufs: EXCL by thread 0xfffff801ea4a76e0 (pid 68112, symlink, tid 100465) #0 0xffffffff80b9c2ea at lockmgr_xlock_hard+0x40a #1 0xffffffff80b9cb4c at __lockmgr_args+0x62c #2 0xffffffff80eec63c at ffs_lock+0x7c #3 0xffffffff810f1978 at VOP_LOCK1_APV+0x48 #4 0xffffffff80cb7bbf at _vn_lock+0x4f #5 0xffffffff80ca2041 at vget_finish+0x81 #6 0xffffffff80c9325f at vfs_hash_get+0xbf #7 0xffffffff80ee7db9 at ffs_vgetf+0x59 #8 0xffffffff80ef5c88 at ufs_lookup_ino+0x9b8 #9 0xffffffff810eee2d at VOP_CACHEDLOOKUP_APV+0x5d #10 0xffffffff80c8b302 at vfs_cache_lookup+0xd2 #11 0xffffffff810eec9d at VOP_LOOKUP_APV+0x5d #12 0xffffffff80c957d1 at lookup+0x611 #13 0xffffffff80c94c61 at namei+0x4f1 #14 0xffffffff80caff09 at kern_funlinkat+0xb9 #15 0xffffffff80cafe48 at sys_unlink+0x28 #16 0xffffffff81074a01 at amd64_syscall+0x2f1 #17 0xffffffff8104a7d0 at fast_syscall_common+0x101 nlink=0, effnlink=0, size=0, extsize 0 generation=19038f92, uid=2007, gid=0, flags=0x0 ino 134528, on dev raid3/data vnode 0xfffff80044c33280: type VREG usecount 1, writecount 0, refcount 1 flags (VMP_LAZYLIST) v_object 0xfffff8063fb40000 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff8014fb4e000 (pid 68193, link, tid 100255) #0 0xffffffff80b9c2ea at lockmgr_xlock_hard+0x40a #1 0xffffffff80b9cb4c at __lockmgr_args+0x62c #2 0xffffffff80eec63c at ffs_lock+0x7c #3 0xffffffff810f1978 at VOP_LOCK1_APV+0x48 #4 0xffffffff80cb7bbf at _vn_lock+0x4f #5 0xffffffff80ca2041 at vget_finish+0x81 #6 0xffffffff80c9325f at vfs_hash_get+0xbf #7 0xffffffff80ee7db9 at ffs_vgetf+0x59 #8 0xffffffff80ef5c88 at ufs_lookup_ino+0x9b8 #9 0xffffffff810eee2d at VOP_CACHEDLOOKUP_APV+0x5d #10 0xffffffff80c8b302 at vfs_cache_lookup+0xd2 #11 0xffffffff810eec9d at VOP_LOOKUP_APV+0x5d #12 0xffffffff80c957d1 at lookup+0x611 #13 0xffffffff80c94c61 at namei+0x4f1 #14 0xffffffff80caff09 at kern_funlinkat+0xb9 #15 0xffffffff80cafe48 at sys_unlink+0x28 #16 0xffffffff81074a01 at amd64_syscall+0x2f1 #17 0xffffffff8104a7d0 at fast_syscall_common+0x101 nlink=3476, effnlink=3475, size=0, extsize 0 generation=392026e6, uid=2007, gid=0, flags=0x0 ino 173306, on dev raid3/data vnode 0xfffff802be48b780: type VREG usecount 1, writecount 0, refcount 1 flags (VMP_LAZYLIST) v_object 0xfffff805c16fd948 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff8014fb2c6e0 (pid 68180, link, tid 100240) #0 0xffffffff80b9c2ea at lockmgr_xlock_hard+0x40a #1 0xffffffff80b9cb4c at __lockmgr_args+0x62c #2 0xffffffff80eec63c at ffs_lock+0x7c #3 0xffffffff810f1978 at VOP_LOCK1_APV+0x48 #4 0xffffffff80cb7bbf at _vn_lock+0x4f #5 0xffffffff80ca2041 at vget_finish+0x81 #6 0xffffffff80c9325f at vfs_hash_get+0xbf #7 0xffffffff80ee7db9 at ffs_vgetf+0x59 #8 0xffffffff80ef5c88 at ufs_lookup_ino+0x9b8 #9 0xffffffff810eee2d at VOP_CACHEDLOOKUP_APV+0x5d #10 0xffffffff80c8b302 at vfs_cache_lookup+0xd2 #11 0xffffffff810eec9d at VOP_LOOKUP_APV+0x5d #12 0xffffffff80c957d1 at lookup+0x611 #13 0xffffffff80c94c61 at namei+0x4f1 #14 0xffffffff80caff09 at kern_funlinkat+0xb9 #15 0xffffffff80cafe48 at sys_unlink+0x28 #16 0xffffffff81074a01 at amd64_syscall+0x2f1 #17 0xffffffff8104a7d0 at fast_syscall_common+0x101 nlink=213, effnlink=213, size=0, extsize 0 generation=dd314d04, uid=2007, gid=0, flags=0x0 ino 203003, on dev raid3/data vnode 0xfffff805536f8000: type VREG usecount 2, writecount 0, refcount 1 flags (VMP_LAZYLIST) v_object 0xfffff804ed9ef528 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff805455686e0 (pid 68137, link, tid 100452) #0 0xffffffff80b9c2ea at lockmgr_xlock_hard+0x40a #1 0xffffffff80b9cb4c at __lockmgr_args+0x62c #2 0xffffffff80eec63c at ffs_lock+0x7c #3 0xffffffff810f1978 at VOP_LOCK1_APV+0x48 #4 0xffffffff80cb7bbf at _vn_lock+0x4f #5 0xffffffff80ca2041 at vget_finish+0x81 #6 0xffffffff80c9325f at vfs_hash_get+0xbf #7 0xffffffff80ee7db9 at ffs_vgetf+0x59 #8 0xffffffff80ef5c88 at ufs_lookup_ino+0x9b8 #9 0xffffffff810eee2d at VOP_CACHEDLOOKUP_APV+0x5d #10 0xffffffff80c8b302 at vfs_cache_lookup+0xd2 #11 0xffffffff810eec9d at VOP_LOOKUP_APV+0x5d #12 0xffffffff80c957d1 at lookup+0x611 #13 0xffffffff80c94c61 at namei+0x4f1 #14 0xffffffff80caff09 at kern_funlinkat+0xb9 #15 0xffffffff80cafe48 at sys_unlink+0x28 #16 0xffffffff81074a01 at amd64_syscall+0x2f1 #17 0xffffffff8104a7d0 at fast_syscall_common+0x101 nlink=8532, effnlink=8532, size=0, extsize 0 generation=2e683c18, uid=2007, gid=0, flags=0x0 ino 200400, on dev raid3/data vnode 0xfffff80446f30c80: type VREG usecount 1, writecount 0, refcount 1 flags () v_object 0xfffff80044c1d420 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff803bc7e7000 (pid 68206, link, tid 100522) #0 0xffffffff80b9c2ea at lockmgr_xlock_hard+0x40a #1 0xffffffff80b9cb4c at __lockmgr_args+0x62c #2 0xffffffff80eec63c at ffs_lock+0x7c #3 0xffffffff810f1978 at VOP_LOCK1_APV+0x48 #4 0xffffffff80cb7bbf at _vn_lock+0x4f #5 0xffffffff80ca2041 at vget_finish+0x81 #6 0xffffffff80c9325f at vfs_hash_get+0xbf #7 0xffffffff80ee7db9 at ffs_vgetf+0x59 #8 0xffffffff80ef5c88 at ufs_lookup_ino+0x9b8 #9 0xffffffff810eee2d at VOP_CACHEDLOOKUP_APV+0x5d #10 0xffffffff80c8b302 at vfs_cache_lookup+0xd2 #11 0xffffffff810eec9d at VOP_LOOKUP_APV+0x5d #12 0xffffffff80c957d1 at lookup+0x611 #13 0xffffffff80c94c61 at namei+0x4f1 #14 0xffffffff80caff09 at kern_funlinkat+0xb9 #15 0xffffffff80cafe48 at sys_unlink+0x28 #16 0xffffffff81074a01 at amd64_syscall+0x2f1 #17 0xffffffff8104a7d0 at fast_syscall_common+0x101 nlink=4084, effnlink=4083, size=0, extsize 0 generation=a294c115, uid=2007, gid=0, flags=0x0 ino 200013, on dev raid3/data vnode 0xfffff80784765000: type VREG usecount 2, writecount 0, refcount 1 flags (VMP_LAZYLIST) v_object 0xfffff804eaa12b58 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff80545568000 (pid 68185, link, tid 100451) #0 0xffffffff80b9c2ea at lockmgr_xlock_hard+0x40a #1 0xffffffff80b9cb4c at __lockmgr_args+0x62c #2 0xffffffff80eec63c at ffs_lock+0x7c #3 0xffffffff810f1978 at VOP_LOCK1_APV+0x48 #4 0xffffffff80cb7bbf at _vn_lock+0x4f #5 0xffffffff80ca2041 at vget_finish+0x81 #6 0xffffffff80c9325f at vfs_hash_get+0xbf #7 0xffffffff80ee7db9 at ffs_vgetf+0x59 #8 0xffffffff80ef5c88 at ufs_lookup_ino+0x9b8 #9 0xffffffff810eee2d at VOP_CACHEDLOOKUP_APV+0x5d #10 0xffffffff80c8b302 at vfs_cache_lookup+0xd2 #11 0xffffffff810eec9d at VOP_LOOKUP_APV+0x5d #12 0xffffffff80c957d1 at lookup+0x611 #13 0xffffffff80c94c61 at namei+0x4f1 #14 0xffffffff80caff09 at kern_funlinkat+0xb9 #15 0xffffffff80cafe48 at sys_unlink+0x28 #16 0xffffffff81074a01 at amd64_syscall+0x2f1 #17 0xffffffff8104a7d0 at fast_syscall_common+0x101 nlink=866, effnlink=866, size=0, extsize 0 generation=d3139c5a, uid=2007, gid=0, flags=0x0 ino 225523, on dev raid3/data vnode 0xfffff8028b7e7a00: type VREG usecount 2, writecount 0, refcount 1 flags (VMP_LAZYLIST) v_object 0xfffff80170f13b58 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff8014fb4e6e0 (pid 68143, link, tid 100244) #0 0xffffffff80b9c2ea at lockmgr_xlock_hard+0x40a #1 0xffffffff80b9cb4c at __lockmgr_args+0x62c #2 0xffffffff80eec63c at ffs_lock+0x7c #3 0xffffffff810f1978 at VOP_LOCK1_APV+0x48 #4 0xffffffff80cb7bbf at _vn_lock+0x4f #5 0xffffffff80ca2041 at vget_finish+0x81 #6 0xffffffff80c9325f at vfs_hash_get+0xbf #7 0xffffffff80ee7db9 at ffs_vgetf+0x59 #8 0xffffffff80ef5c88 at ufs_lookup_ino+0x9b8 #9 0xffffffff810eee2d at VOP_CACHEDLOOKUP_APV+0x5d #10 0xffffffff80c8b302 at vfs_cache_lookup+0xd2 #11 0xffffffff810eec9d at VOP_LOOKUP_APV+0x5d #12 0xffffffff80c957d1 at lookup+0x611 #13 0xffffffff80c94c61 at namei+0x4f1 #14 0xffffffff80caff09 at kern_funlinkat+0xb9 #15 0xffffffff80cafe48 at sys_unlink+0x28 #16 0xffffffff81074a01 at amd64_syscall+0x2f1 #17 0xffffffff8104a7d0 at fast_syscall_common+0x101 nlink=7047, effnlink=7047, size=0, extsize 0 generation=7fb7446, uid=2007, gid=0, flags=0x0 ino 131136, on dev raid3/data vnode 0xfffff805d284e000: type VREG usecount 1, writecount 0, refcount 1 flags (VMP_LAZYLIST) v_object 0xfffff807dddcce70 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff801a51f06e0 (pid 68131, link, tid 100317) #0 0xffffffff80b9c2ea at lockmgr_xlock_hard+0x40a #1 0xffffffff80b9cb4c at __lockmgr_args+0x62c #2 0xffffffff80eec63c at ffs_lock+0x7c #3 0xffffffff810f1978 at VOP_LOCK1_APV+0x48 #4 0xffffffff80cb7bbf at _vn_lock+0x4f #5 0xffffffff80caf7a8 at kern_linkat_vp+0x138 #6 0xffffffff80caf4a2 at sys_link+0x92 #7 0xffffffff81074a01 at amd64_syscall+0x2f1 #8 0xffffffff8104a7d0 at fast_syscall_common+0x101 nlink=339, effnlink=339, size=0, extsize 0 generation=628bc310, uid=2007, gid=0, flags=0x0 ino 192625, on dev raid3/data vnode 0xfffff8000850b280: type VLNK usecount 0, writecount 0, refcount 1 flags (VV_NOSYNC|VI_DOINGINACT|VMP_LAZYLIST) lock type ufs: EXCL by thread 0xfffff80390b8e000 (pid 68130, symlink, tid 100468) #0 0xffffffff80b9c2ea at lockmgr_xlock_hard+0x40a #1 0xffffffff80b9cb4c at __lockmgr_args+0x62c #2 0xffffffff80eec63c at ffs_lock+0x7c #3 0xffffffff810f1978 at VOP_LOCK1_APV+0x48 #4 0xffffffff80cb7bbf at _vn_lock+0x4f #5 0xffffffff80ca2041 at vget_finish+0x81 #6 0xffffffff80c9325f at vfs_hash_get+0xbf #7 0xffffffff80ee7db9 at ffs_vgetf+0x59 #8 0xffffffff80ef5c88 at ufs_lookup_ino+0x9b8 #9 0xffffffff810eee2d at VOP_CACHEDLOOKUP_APV+0x5d #10 0xffffffff80c8b302 at vfs_cache_lookup+0xd2 #11 0xffffffff810eec9d at VOP_LOOKUP_APV+0x5d #12 0xffffffff80c957d1 at lookup+0x611 #13 0xffffffff80c94c61 at namei+0x4f1 #14 0xffffffff80caff09 at kern_funlinkat+0xb9 #15 0xffffffff80cafe48 at sys_unlink+0x28 #16 0xffffffff81074a01 at amd64_syscall+0x2f1 #17 0xffffffff8104a7d0 at fast_syscall_common+0x101 nlink=0, effnlink=0, size=0, extsize 0 generation=7c115a0e, uid=2007, gid=0, flags=0x0 ino 27102, on dev raid3/data vnode 0xfffff806a6982500: type VLNK usecount 0, writecount 0, refcount 1 flags (VV_NOSYNC|VI_DOINGINACT|VMP_LAZYLIST) lock type ufs: EXCL by thread 0xfffff8001dec56e0 (pid 68155, symlink, tid 100161) #0 0xffffffff80b9c2ea at lockmgr_xlock_hard+0x40a #1 0xffffffff80b9cb4c at __lockmgr_args+0x62c #2 0xffffffff80eec63c at ffs_lock+0x7c #3 0xffffffff810f1978 at VOP_LOCK1_APV+0x48 #4 0xffffffff80cb7bbf at _vn_lock+0x4f #5 0xffffffff80ca2041 at vget_finish+0x81 #6 0xffffffff80c9325f at vfs_hash_get+0xbf #7 0xffffffff80ee7db9 at ffs_vgetf+0x59 #8 0xffffffff80ef5c88 at ufs_lookup_ino+0x9b8 #9 0xffffffff810eee2d at VOP_CACHEDLOOKUP_APV+0x5d #10 0xffffffff80c8b302 at vfs_cache_lookup+0xd2 #11 0xffffffff810eec9d at VOP_LOOKUP_APV+0x5d #12 0xffffffff80c957d1 at lookup+0x611 #13 0xffffffff80c94c61 at namei+0x4f1 #14 0xffffffff80caff09 at kern_funlinkat+0xb9 #15 0xffffffff80cafe48 at sys_unlink+0x28 #16 0xffffffff81074a01 at amd64_syscall+0x2f1 #17 0xffffffff8104a7d0 at fast_syscall_common+0x101 nlink=0, effnlink=0, size=0, extsize 0 generation=5961769b, uid=2007, gid=0, flags=0x0 ino 32708, on dev raid3/data vnode 0xfffff80623b03280: type VREG usecount 1, writecount 1, refcount 71 flags (VMP_LAZYLIST) v_object 0xfffff803f648a840 ref 0 pages 552 cleanbuf 65 dirtybuf 4 lock type ufs: EXCL by thread 0xfffff802fd8036e0 (pid 68150, rw, tid 100463) #0 0xffffffff80b9c2ea at lockmgr_xlock_hard+0x40a #1 0xffffffff80b9cb4c at __lockmgr_args+0x62c #2 0xffffffff80eec63c at ffs_lock+0x7c #3 0xffffffff810f1978 at VOP_LOCK1_APV+0x48 #4 0xffffffff80cb7bbf at _vn_lock+0x4f #5 0xffffffff80cbc23c at vn_write+0x1cc #6 0xffffffff80cbbca3 at vn_io_fault_doio+0x43 #7 0xffffffff80cb82fc at vn_io_fault1+0x16c #8 0xffffffff80cb5bd2 at vn_io_fault+0x182 #9 0xffffffff80c3a281 at dofilewrite+0x81 #10 0xffffffff80c39ec9 at kern_writev+0x49 #11 0xffffffff80c39e73 at sys_write+0x83 #12 0xffffffff81074a01 at amd64_syscall+0x2f1 #13 0xffffffff8104a7d0 at fast_syscall_common+0x101 nlink=1, effnlink=1, size=2228224, extsize 0 generation=ba5a961c, uid=2007, gid=0, flags=0x0 ino 42424, on dev raid3/data vnode 0xfffff80475450000: type VREG usecount 1, writecount 1, refcount 69 flags (VMP_LAZYLIST) v_object 0xfffff801eac30420 ref 0 pages 536 cleanbuf 65 dirtybuf 2 lock type ufs: EXCL by thread 0xfffff8023e8096e0 (pid 68208, rw, tid 100482) #0 0xffffffff80b9c2ea at lockmgr_xlock_hard+0x40a #1 0xffffffff80b9cb4c at __lockmgr_args+0x62c #2 0xffffffff80eec63c at ffs_lock+0x7c #3 0xffffffff810f1978 at VOP_LOCK1_APV+0x48 #4 0xffffffff80cb7bbf at _vn_lock+0x4f #5 0xffffffff80cbc23c at vn_write+0x1cc #6 0xffffffff80cbbca3 at vn_io_fault_doio+0x43 #7 0xffffffff80cb82fc at vn_io_fault1+0x16c #8 0xffffffff80cb5bd2 at vn_io_fault+0x182 #9 0xffffffff80c3a281 at dofilewrite+0x81 #10 0xffffffff80c39ec9 at kern_writev+0x49 #11 0xffffffff80c39e73 at sys_write+0x83 #12 0xffffffff81074a01 at amd64_syscall+0x2f1 #13 0xffffffff8104a7d0 at fast_syscall_common+0x101 nlink=1, effnlink=1, size=2162688, extsize 0 generation=a1ff7bf8, uid=2007, gid=0, flags=0x0 ino 43992, on dev raid3/data vnode 0xfffff807232a9780: type VREG usecount 1, writecount 1, refcount 63 flags (VMP_LAZYLIST) v_object 0xfffff80285053210 ref 0 pages 488 cleanbuf 57 dirtybuf 4 lock type ufs: EXCL by thread 0xfffff801a54ad000 (pid 68117, rw, tid 100380) #0 0xffffffff80b9c2ea at lockmgr_xlock_hard+0x40a #1 0xffffffff80b9cb4c at __lockmgr_args+0x62c #2 0xffffffff80eec63c at ffs_lock+0x7c #3 0xffffffff810f1978 at VOP_LOCK1_APV+0x48 #4 0xffffffff80cb7bbf at _vn_lock+0x4f #5 0xffffffff80cbc23c at vn_write+0x1cc #6 0xffffffff80cbbca3 at vn_io_fault_doio+0x43 #7 0xffffffff80cb82fc at vn_io_fault1+0x16c #8 0xffffffff80cb5bd2 at vn_io_fault+0x182 #9 0xffffffff80c3a281 at dofilewrite+0x81 #10 0xffffffff80c39ec9 at kern_writev+0x49 #11 0xffffffff80c39e73 at sys_write+0x83 #12 0xffffffff81074a01 at amd64_syscall+0x2f1 #13 0xffffffff8104a7d0 at fast_syscall_common+0x101 nlink=1, effnlink=1, size=1966080, extsize 0 generation=c6d16aab, uid=2007, gid=0, flags=0x0 ino 137731, on dev raid3/data vnode 0xfffff801a3e87c80: type VREG usecount 1, writecount 1, refcount 22 flags (VMP_LAZYLIST) v_object 0xfffff804daf81630 ref 0 pages 160 cleanbuf 16 dirtybuf 4 lock type ufs: EXCL by thread 0xfffff804fa4a9000 (pid 68138, rw, tid 100442) #0 0xffffffff80b9c2ea at lockmgr_xlock_hard+0x40a #1 0xffffffff80b9cb4c at __lockmgr_args+0x62c #2 0xffffffff80eec63c at ffs_lock+0x7c #3 0xffffffff810f1978 at VOP_LOCK1_APV+0x48 #4 0xffffffff80cb7bbf at _vn_lock+0x4f #5 0xffffffff80cbc23c at vn_write+0x1cc #6 0xffffffff80cbbca3 at vn_io_fault_doio+0x43 #7 0xffffffff80cb82fc at vn_io_fault1+0x16c #8 0xffffffff80cb5bd2 at vn_io_fault+0x182 #9 0xffffffff80c3a281 at dofilewrite+0x81 #10 0xffffffff80c39ec9 at kern_writev+0x49 #11 0xffffffff80c39e73 at sys_write+0x83 #12 0xffffffff81074a01 at amd64_syscall+0x2f1 #13 0xffffffff8104a7d0 at fast_syscall_common+0x101 nlink=1, effnlink=1, size=622592, extsize 0 generation=a2334848, uid=2007, gid=0, flags=0x0 ino 44669, on dev raid3/data vnode 0xfffff8003c87d780: type VREG usecount 1, writecount 1, refcount 68 flags (VMP_LAZYLIST) v_object 0xfffff80170ee5738 ref 0 pages 528 cleanbuf 63 dirtybuf 3 lock type ufs: EXCL by thread 0xfffff801a52b6000 (pid 68202, rw, tid 100326) #0 0xffffffff80b9c2ea at lockmgr_xlock_hard+0x40a #1 0xffffffff80b9cb4c at __lockmgr_args+0x62c #2 0xffffffff80eec63c at ffs_lock+0x7c #3 0xffffffff810f1978 at VOP_LOCK1_APV+0x48 #4 0xffffffff80cb7bbf at _vn_lock+0x4f #5 0xffffffff80cbc23c at vn_write+0x1cc #6 0xffffffff80cbbca3 at vn_io_fault_doio+0x43 #7 0xffffffff80cb82fc at vn_io_fault1+0x16c #8 0xffffffff80cb5bd2 at vn_io_fault+0x182 #9 0xffffffff80c3a281 at dofilewrite+0x81 #10 0xffffffff80c39ec9 at kern_writev+0x49 #11 0xffffffff80c39e73 at sys_write+0x83 #12 0xffffffff81074a01 at amd64_syscall+0x2f1 #13 0xffffffff8104a7d0 at fast_syscall_common+0x101 nlink=1, effnlink=1, size=2129920, extsize 0 generation=9ab7460, uid=2007, gid=0, flags=0x0 ino 44817, on dev raid3/data vnode 0xfffff801ef486a00: type VREG usecount 1, writecount 1, refcount 64 flags (VMP_LAZYLIST) v_object 0xfffff804e3a21630 ref 0 pages 496 cleanbuf 58 dirtybuf 4 lock type ufs: EXCL by thread 0xfffff8014ffd16e0 (pid 68121, rw, tid 100311) #0 0xffffffff80b9c2ea at lockmgr_xlock_hard+0x40a #1 0xffffffff80b9cb4c at __lockmgr_args+0x62c #2 0xffffffff80eec63c at ffs_lock+0x7c #3 0xffffffff810f1978 at VOP_LOCK1_APV+0x48 #4 0xffffffff80cb7bbf at _vn_lock+0x4f #5 0xffffffff80cbc23c at vn_write+0x1cc #6 0xffffffff80cbbca3 at vn_io_fault_doio+0x43 #7 0xffffffff80cb82fc at vn_io_fault1+0x16c #8 0xffffffff80cb5bd2 at vn_io_fault+0x182 #9 0xffffffff80c3a281 at dofilewrite+0x81 #10 0xffffffff80c39ec9 at kern_writev+0x49 #11 0xffffffff80c39e73 at sys_write+0x83 #12 0xffffffff81074a01 at amd64_syscall+0x2f1 #13 0xffffffff8104a7d0 at fast_syscall_common+0x101 nlink=1, effnlink=1, size=1998848, extsize 0 generation=cf758481, uid=2007, gid=0, flags=0x0 ino 44951, on dev raid3/data vnode 0xfffff807e1c74a00: type VREG usecount 1, writecount 1, refcount 57 flags (VMP_LAZYLIST) v_object 0xfffff805c19ba948 ref 0 pages 440 cleanbuf 52 dirtybuf 3 lock type ufs: EXCL by thread 0xfffff8043a5526e0 (pid 68133, rw, tid 100415) #0 0xffffffff80b9c2ea at lockmgr_xlock_hard+0x40a #1 0xffffffff80b9cb4c at __lockmgr_args+0x62c #2 0xffffffff80eec63c at ffs_lock+0x7c #3 0xffffffff810f1978 at VOP_LOCK1_APV+0x48 #4 0xffffffff80cb7bbf at _vn_lock+0x4f #5 0xffffffff80cbc23c at vn_write+0x1cc #6 0xffffffff80cbbca3 at vn_io_fault_doio+0x43 #7 0xffffffff80cb82fc at vn_io_fault1+0x16c #8 0xffffffff80cb5bd2 at vn_io_fault+0x182 #9 0xffffffff80c3a281 at dofilewrite+0x81 #10 0xffffffff80c39ec9 at kern_writev+0x49 #11 0xffffffff80c39e73 at sys_write+0x83 #12 0xffffffff81074a01 at amd64_syscall+0x2f1 #13 0xffffffff8104a7d0 at fast_syscall_common+0x101 nlink=1, effnlink=1, size=1769472, extsize 0 generation=b65725d0, uid=2007, gid=0, flags=0x0 ino 45152, on dev raid3/data vnode 0xfffff80596b40000: type VREG usecount 1, writecount 1, refcount 31 flags (VMP_LAZYLIST) v_object 0xfffff801a5d9fb58 ref 0 pages 232 cleanbuf 25 dirtybuf 4 lock type ufs: EXCL by thread 0xfffff8001d6f06e0 (pid 68184, rw, tid 100149) #0 0xffffffff80b9c2ea at lockmgr_xlock_hard+0x40a #1 0xffffffff80b9cb4c at __lockmgr_args+0x62c #2 0xffffffff80eec63c at ffs_lock+0x7c #3 0xffffffff810f1978 at VOP_LOCK1_APV+0x48 #4 0xffffffff80cb7bbf at _vn_lock+0x4f #5 0xffffffff80cbc23c at vn_write+0x1cc #6 0xffffffff80cbbca3 at vn_io_fault_doio+0x43 #7 0xffffffff80cb82fc at vn_io_fault1+0x16c #8 0xffffffff80cb5bd2 at vn_io_fault+0x182 #9 0xffffffff80c3a281 at dofilewrite+0x81 #10 0xffffffff80c39ec9 at kern_writev+0x49 #11 0xffffffff80c39e73 at sys_write+0x83 #12 0xffffffff81074a01 at amd64_syscall+0x2f1 #13 0xffffffff8104a7d0 at fast_syscall_common+0x101 nlink=1, effnlink=1, size=917504, extsize 0 generation=365843ff, uid=2007, gid=0, flags=0x0 ino 45549, on dev raid3/data vnode 0xfffff8018be0dc80: type VREG usecount 1, writecount 1, refcount 37 flags (VMP_LAZYLIST) v_object 0xfffff804fa311d68 ref 0 pages 280 cleanbuf 32 dirtybuf 3 lock type ufs: EXCL by thread 0xfffff8014febb000 (pid 68156, rw, tid 100286) #0 0xffffffff80b9c2ea at lockmgr_xlock_hard+0x40a #1 0xffffffff80b9cb4c at __lockmgr_args+0x62c #2 0xffffffff80eec63c at ffs_lock+0x7c #3 0xffffffff810f1978 at VOP_LOCK1_APV+0x48 #4 0xffffffff80cb7bbf at _vn_lock+0x4f #5 0xffffffff80cbc23c at vn_write+0x1cc #6 0xffffffff80cbbca3 at vn_io_fault_doio+0x43 #7 0xffffffff80cb82fc at vn_io_fault1+0x16c #8 0xffffffff80cb5bd2 at vn_io_fault+0x182 #9 0xffffffff80c3a281 at dofilewrite+0x81 #10 0xffffffff80c39ec9 at kern_writev+0x49 #11 0xffffffff80c39e73 at sys_write+0x83 #12 0xffffffff81074a01 at amd64_syscall+0x2f1 #13 0xffffffff8104a7d0 at fast_syscall_common+0x101 nlink=1, effnlink=1, size=1114112, extsize 0 generation=d24f5d74, uid=2007, gid=0, flags=0x0 ino 46963, on dev raid3/data vnode 0xfffff8018be1a500: type VREG usecount 1, writecount 1, refcount 40 flags (VMP_LAZYLIST) v_object 0xfffff801ea1b2318 ref 0 pages 304 cleanbuf 35 dirtybuf 3 lock type ufs: EXCL by thread 0xfffff8014f8606e0 (pid 68163, rw, tid 100371) #0 0xffffffff80b9c2ea at lockmgr_xlock_hard+0x40a #1 0xffffffff80b9cb4c at __lockmgr_args+0x62c #2 0xffffffff80eec63c at ffs_lock+0x7c #3 0xffffffff810f1978 at VOP_LOCK1_APV+0x48 #4 0xffffffff80cb7bbf at _vn_lock+0x4f #5 0xffffffff80cbc23c at vn_write+0x1cc #6 0xffffffff80cbbca3 at vn_io_fault_doio+0x43 #7 0xffffffff80cb82fc at vn_io_fault1+0x16c #8 0xffffffff80cb5bd2 at vn_io_fault+0x182 #9 0xffffffff80c3a281 at dofilewrite+0x81 #10 0xffffffff80c39ec9 at kern_writev+0x49 #11 0xffffffff80c39e73 at sys_write+0x83 #12 0xffffffff81074a01 at amd64_syscall+0x2f1 #13 0xffffffff8104a7d0 at fast_syscall_common+0x101 nlink=1, effnlink=1, size=1212416, extsize 0 generation=b7cc4359, uid=2007, gid=0, flags=0x0 ino 47044, on dev raid3/data vnode 0xfffff8054b32aa00: type VREG usecount 1, writecount 1, refcount 8 flags (VMP_LAZYLIST) v_object 0xfffff807a4bcbd68 ref 0 pages 46 cleanbuf 3 dirtybuf 3 lock type ufs: EXCL by thread 0xfffff8046afde6e0 (pid 68144, rw, tid 100419) #0 0xffffffff80b9c2ea at lockmgr_xlock_hard+0x40a #1 0xffffffff80b9cb4c at __lockmgr_args+0x62c #2 0xffffffff80eec63c at ffs_lock+0x7c #3 0xffffffff810f1978 at VOP_LOCK1_APV+0x48 #4 0xffffffff80cb7bbf at _vn_lock+0x4f #5 0xffffffff80cbc23c at vn_write+0x1cc #6 0xffffffff80cbbca3 at vn_io_fault_doio+0x43 #7 0xffffffff80cb82fc at vn_io_fault1+0x16c #8 0xffffffff80cb5bd2 at vn_io_fault+0x182 #9 0xffffffff80c3a281 at dofilewrite+0x81 #10 0xffffffff80c39ec9 at kern_writev+0x49 #11 0xffffffff80c39e73 at sys_write+0x83 #12 0xffffffff81074a01 at amd64_syscall+0x2f1 #13 0xffffffff8104a7d0 at fast_syscall_common+0x101 nlink=1, effnlink=1, size=188416, extsize 0 generation=83ff4c3a, uid=2007, gid=0, flags=0x0 ino 47187, on dev raid3/data vnode 0xfffff8025e592c80: type VNON usecount 1, writecount 0, refcount 1 flags () lock type ufs: EXCL by thread 0xfffff806f2967000 (pid 68189, symlink, tid 100487) #0 0xffffffff80b9c2ea at lockmgr_xlock_hard+0x40a #1 0xffffffff80b9cb4c at __lockmgr_args+0x62c #2 0xffffffff80ee7ec1 at ffs_vgetf+0x161 #3 0xffffffff80eba461 at ffs_valloc+0x591 #4 0xffffffff80eff33d at ufs_makeinode+0xad #5 0xffffffff80efed66 at ufs_symlink+0x36 #6 0xffffffff810f1100 at VOP_SYMLINK_APV+0x60 #7 0xffffffff80cafbea at kern_symlinkat+0x21a #8 0xffffffff81074a01 at amd64_syscall+0x2f1 #9 0xffffffff8104a7d0 at fast_syscall_common+0x101 nlink=0, effnlink=0, size=0KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0037a72f80 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0037a72f90 trap() at trap+0x73/frame 0xfffffe0037a730c0 calltrap() at calltrap+0x8/frame 0xfffffe0037a730c0 --- trap 0xc, rip = 0xffffffff80efefe8, rsp = 0xfffffe0037a73190, rbp = 0xfffffe0037a731a0 --- ufs_print() at ufs_print+0x38/frame 0xfffffe0037a731a0 vn_printf() at vn_printf+0x3d0/frame 0xfffffe0037a73340 lockedvnodes() at lockedvnodes+0x8b/frame 0xfffffe0037a73380 db_command() at db_command+0x25c/frame 0xfffffe0037a73450 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0037a734f0 db_command() at db_command+0x25c/frame 0xfffffe0037a735c0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0037a73660 db_command() at db_command+0x25c/frame 0xfffffe0037a73730 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe0037a73740 db_trap() at db_trap+0xe8/frame 0xfffffe0037a737d0 kdb_trap() at kdb_trap+0x157/frame 0xfffffe0037a73850 trap() at trap+0x7d4/frame 0xfffffe0037a73980 calltrap() at calltrap+0x8/frame 0xfffffe0037a73980 --- trap 0x3, rip = 0xffffffff80c13b37, rsp = 0xfffffe0037a73a50, rbp = 0xfffffe0037a73a60 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe0037a73a60 vpanic() at vpanic+0x1a1/frame 0xfffffe0037a73ac0 panic() at panic+0x43/frame 0xfffffe0037a73b20 g_io_deliver() at g_io_deliver+0x386/frame 0xfffffe0037a73b70 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0037a73ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe0037a73bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a73bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a73bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Script command 'show lockedvnods' returned error db:1:pho1> show mount 0xfffff8001d5b8000 /dev/gpt/work on / (ufs) 0xfffff8001d5b7000 devfs on /dev (devfs) 0xfffff8003fb26000 /dev/gpt/tmp on /tmp (ufs) 0xfffff8014f8b8000 /dev/raid3/data on /mnt (ufs) More info: show mount db:1:pho1> show bufqueues bqempty: 99893 Buf domain 0 freebufs 14806 lofreebufs 219 hifreebufs 329 bufspace 7790592 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 98 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 118 (3100672) dirtyq count 98 (1052672) wakeup 0 lim 25 CPU 16, 0, 16, 6, 19, 9, 10, 3, 3, 0, 17, 12, Locked buffers: 5 space 155648 Total buffers: 13725 space 7790592 Buf domain 1 freebufs 11824 lofreebufs 219 hifreebufs 329 bufspace 105668608 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 2016 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 704 (22302720) dirtyq count 2021 (64229376) wakeup 0 lim 25 CPU 1, 0, 17, 8, 10, 9, 9, 13, 6, 9, 10, 6, Locked buffers: 502 space 16445440 Total buffers: 17825 space 105668608 Buf domain 2 freebufs 14841 lofreebufs 219 hifreebufs 329 bufspace 6467584 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 151 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 48 (1253376) dirtyq count 151 (2166784) wakeup 0 lim 25 CPU 3, 0, 9, 13, 10, 13, 6, 15, 0, 10, 6, 8, Locked buffers: 10 space 327680 Total buffers: 17772 space 6467584 Buf domain 3 freebufs 14932 lofreebufs 219 hifreebufs 329 bufspace 3690496 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 111 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 88 (1994752) dirtyq count 111 (1687552) wakeup 0 lim 25 CPU 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, Locked buffers: 3 space 40960 Total buffers: 17239 space 3690496 Buf domain 4 freebufs 14983 lofreebufs 219 hifreebufs 329 bufspace 1839104 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 91 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 59 (1355776) dirtyq count 91 (483328) wakeup 0 lim 25 CPU 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, Locked buffers: 1 space 24576 Total buffers: 11253 space 1839104 Buf domain 5 freebufs 13761 lofreebufs 219 hifreebufs 329 bufspace 42110976 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 130 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 1158 (37138432) dirtyq count 130 (2220032) wakeup 0 lim 25 CPU 11, 9, 2, 4, 8, 12, 14, 8, 6, 1, 6, 3, Locked buffers: 7 space 200704 Total buffers: 15434 space 42110976 Buf domain 6 freebufs 14881 lofreebufs 219 hifreebufs 329 bufspace 4993024 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 133 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 61 (1110016) dirtyq count 133 (1982464) wakeup 0 lim 25 CPU 6, 3, 10, 0, 3, 3, 3, 10, 0, 0, 14, 6, Locked buffers: 3 space 98304 Total buffers: 12683 space 4993024 db:1:pho1> show page vm_cnt.v_free_count: 43773 vm_cnt.v_inactive_count: 73329 vm_cnt.v_active_count: 7422561 vm_cnt.v_laundry_count: 274159 vm_cnt.v_wire_count: 309319 vm_cnt.v_free_reserved: 10644 vm_cnt.v_free_min: 51264 vm_cnt.v_free_target: 173124 vm_cnt.v_inactive_target: 259686 db:1:pho1> show pageq pq_free 43773 dom 0 page_cnt 8124099 free 43773 pq_act 7422561 pq_inact 73329 pq_laund 274159 pq_unsw 0 db:0:pho> show freepages DOMAIN: 0 FREE LIST 0: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000000 | 000000 09 (002048K) | 000000 | 000000 08 (001024K) | 000000 | 000000 07 (000512K) | 000000 | 000000 06 (000256K) | 000000 | 000000 05 (000128K) | 000001 | 000000 04 (000064K) | 000004 | 000000 03 (000032K) | 000024 | 000000 02 (000016K) | 000053 | 000001 01 (000008K) | 000057 | 000000 00 (000004K) | 000097 | 000000 FREE LIST 1: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000000 | 000000 09 (002048K) | 000000 | 000000 08 (001024K) | 000000 | 000000 07 (000512K) | 000000 | 000000 06 (000256K) | 000000 | 000000 05 (000128K) | 000000 | 000000 04 (000064K) | 000000 | 000000 03 (000032K) | 000000 | 000000 02 (000016K) | 000000 | 000000 01 (000008K) | 000000 | 000000 00 (000004K) | 000000 | 000000 db:0:pho> show uma Zone Size Used Free Requests Sleeps Bucket Total Mem XFree gr3:64k 65536 2173 69 131274 0 1 146931712 0 VNODE 640 179052 132 23304515 0 14 114677760 0 512 512 196000 248 24727984 0 29 100478976 0 RADIX NODE 144 536529 10473 26379349 0 61 78768288 0 VM OBJECT 264 29584 184301 26636075 0 29 56465640 0 FFS2 dinode 256 178932 453 23304315 0 61 45922560 0 128 128 243990 941 80371202 0 125 31351168 0 FFS inode 160 178937 463 23304320 0 61 28704000 0 mbuf_cluster 2048 11624 4 28188 0 5 23814144 0 BUF TRIE 144 1131 104821 13149063 0 61 15257088 0 128 128 109379 609 21475541 0 125 14078464 0 256 256 41429 361 10579626 0 61 10698240 0 swblk 136 23328 42676 334470 0 61 8976544 0 S VFS Cache 108 72292 1184 14956551 0 125 7935408 0 gr3:16k 16384 329 107 255603 0 1 7143424 0 mbuf 256 15731 5442 1934050 0 253 5420288 0 UMA Slabs 0 112 33058 6 144175 0 125 3703168 0 DIRHASH 1024 2972 180 882959 0 13 3227648 0 socket 904 51 2985 5403 0 13 2744544 0 128 128 14335 328 929415 0 125 1876864 0 128 128 11561 808 337848 0 125 1583232 0 4096 4096 351 0 1662315 0 1 1437696 0 vmem btag 56 15331 5032 183029 0 253 1140328 0 4096 4096 246 9 469115 0 1 1044480 0 swpctrie 144 2539 4097 31370 0 61 955584 0 THREAD 1760 501 15 528 0 5 908160 0 256 256 2734 461 2200357 0 61 817920 0 16384 16384 49 0 20071 0 1 802816 0 MAP ENTRY 96 5084 3106 32300139 0 125 786240 0 8192 8192 93 0 117 0 1 761856 0 64 64 8651 2563 621693255 0 253 717696 0 VMSPACE 2536 181 92 461960 0 3 692328 0 64 64 9313 326 17759 0 253 616896 0 pbuf 984 0 619 0 0 0 609096 0 256 Bucket 2048 250 21 2286532 0 5 555008 0 PROC 1328 236 148 469105 0 9 509952 0 256 256 467 1453 13859283 0 61 491520 0 32768 32768 13 0 15 0 1 425984 0 64 64 3607 2693 550152 0 253 403200 0 32768 32768 12 0 34 0 1 393216 0 filedesc0 1104 219 132 469106 0 9 387504 0 256 256 850 575 4970322 0 61 364800 0 128 128 1365 1456 12888733 0 125 361088 0 128 Bucket 1024 195 125 1112326 0 13 327680 0 64 Bucket 512 291 309 1466444 0 29 307200 0 32 32 6748 1820 55894 0 253 274176 0 1024 1024 219 45 64251 0 13 270336 0 NAMEI 1024 75 185 187633078 0 13 266240 0 64 64 1601 2556 2920164 0 253 266048 0 65536 65536 4 0 2171 0 1 262144 0 32768 32768 8 0 312 0 1 262144 0 16 16 14035 1965 15505 0 253 256000 0 32 Bucket 256 168 776 1967488 0 61 241664 0 2048 2048 20 94 3439648 0 5 233472 0 g_bio 408 23 517 99348552 0 29 220320 0 2048 2048 98 8 122 0 5 217088 0 64 64 262 3077 3397357 0 253 213696 0 512 512 105 311 258185 0 29 212992 0 128 128 1077 566 1098 0 125 210304 0 256 256 37 743 22868539 0 61 199680 0 65536 65536 3 0 54 0 1 196608 0 4096 4096 48 0 78 0 1 196608 0 16 Bucket 128 113 1405 398533 0 125 194304 0 UMA Zones 2176 89 0 90 0 3 193664 0 256 256 445 305 43413 0 61 192000 0 Files 80 186 2164 21453874 0 125 188000 0 256 256 431 259 175364 0 61 176640 0 1024 1024 61 103 2231 0 13 167936 0 64 64 33 2298 120906 0 253 149184 0 6 Bucket 48 42 3066 176229 0 253 149184 0 ksiginfo 112 357 903 5967 0 125 141120 0 128 128 954 100 557332679 0 125 134912 0 8 Bucket 64 83 1995 1135915 0 253 132992 0 65536 65536 2 0 11 0 1 131072 0 65536 65536 1 1 77 0 1 131072 0 65536 65536 2 0 1037834 0 1 131072 0 TURNSTILE 136 517 428 517 0 61 128520 0 128 128 112 880 190056 0 125 126976 0 clpbuf 984 0 128 3369403 0 5 125952 0 selfd 64 97 1730 7751573 0 253 116928 0 32 32 598 3056 1276777 0 253 116928 0 16384 16384 7 0 22175 0 1 114688 0 rl_entry 40 357 2370 357 0 253 109080 0 4 Bucket 32 282 3120 479426 0 253 108864 0 8192 8192 13 0 536629 0 1 106496 0 8192 8192 13 0 1673 0 1 106496 0 512 512 151 49 174 0 29 102400 0 16384 16384 6 0 11 0 1 98304 0 ttyinq 160 330 245 540 0 61 92000 0 SLEEPQUEUE 88 517 475 517 0 125 87296 0 ttyoutq 256 173 157 282 0 61 84480 0 1024 1024 4 76 2033216 0 13 81920 0 fakepg 104 0 780 92 0 125 81120 0 32 32 109 2411 416979 0 253 80640 0 12 Bucket 96 58 782 251211 0 125 80640 0 pipe 760 9 96 199423 0 13 79800 0 512 512 62 82 62 0 29 73728 0 4096 4096 17 0 195 0 1 69632 0 32 32 6 2136 151554 0 253 68544 0 65536 65536 1 0 1 0 1 65536 0 32768 32768 2 0 2 0 1 65536 0 4096 4096 16 0 21 0 1 65536 0 512 512 8 120 325940 0 29 65536 0 512 512 38 90 5933 0 29 65536 0 64 64 41 967 296975787 0 253 64512 0 1024 1024 33 27 152503 0 13 61440 0 gr3:4k 4096 0 14 5762 0 1 57344 0 8192 8192 7 0 21 0 1 57344 0 16 16 327 3173 7525159 0 253 56000 0 4096 4096 1 12 1092575 0 1 53248 0 32 32 65 1573 75 0 253 52416 0 16384 16384 3 0 3 0 1 49152 0 32 32 123 1389 108456 0 253 48384 0 cpuset 104 27 438 27 0 125 48360 0 16 16 52 2948 2551971 0 253 48000 0 32 32 550 836 22989 0 253 44352 0 unpcb 256 19 146 4992 0 61 42240 0 8192 8192 5 0 9 0 1 40960 0 64 pcpu 8 3144 1976 3531 0 253 40960 0 swrbuf 984 0 41 90597 0 5 40344 0 64 64 35 595 23828 0 253 40320 0 mt_stats_zone 64 432 144 440 0 253 36864 0 32 32 45 1089 64 0 253 36288 0 16 16 63 2187 96 0 253 36000 0 16 16 255 1995 76960 0 253 36000 0 rtentry 208 12 159 15 0 61 35568 0 Mountpoints 2944 4 8 11 0 3 35328 0 UMA Kegs 384 78 8 79 0 29 33024 0 32768 32768 1 0 319 0 1 32768 0 32768 32768 1 0 252815 0 1 32768 0 8192 8192 4 0 4 0 1 32768 0 udp_inpcb 488 20 44 375 0 29 31232 0 256 256 39 81 42 0 61 30720 0 16 16 173 1577 2506774 0 253 28000 0 tcpcb 1008 9 15 14 0 13 24192 0 udpcb 32 20 736 375 0 253 24192 0 16 16 27 1473 28 0 253 24000 0 KMAP ENTRY 96 18 231 45 0 125 23904 0 swwbuf 984 4 20 195824 0 1 23616 0 tcp_inpcb 488 9 39 14 0 29 23424 0 mt_zone 24 432 403 440 0 253 20040 0 16 16 471 779 902171 0 253 20000 0 16384 16384 1 0 3385 0 1 16384 0 8192 8192 2 0 2 0 1 16384 0 2048 2048 4 4 5638 0 5 16384 0 1024 1024 7 9 7 0 13 16384 0 1024 1024 5 11 907 0 13 16384 0 512 512 4 28 1826964 0 29 16384 0 MAP 216 2 69 2 0 61 15336 0 2048 2048 3 3 168028 0 5 12288 0 2048 2048 4 2 4 0 5 12288 0 1024 1024 6 6 6 0 13 12288 0 512 512 5 19 70 0 29 12288 0 8192 8192 1 0 1 0 1 8192 0 2048 2048 2 2 45 0 5 8192 0 2048 2048 3 1 667 0 5 8192 0 1024 1024 2 6 262636 0 13 8192 0 L VFS Cache 328 19 5 55 0 29 7872 0 mbuf_packet 256 22 0 1901877 0 253 5632 0 epoch_record pcpu 256 4 12 4 0 61 4096 0 4096 4096 1 0 189837 0 1 4096 0 4096 4096 1 0 13 0 1 4096 0 2048 2048 1 1 3 0 5 4096 0 int pcpu 4 50 974 50 0 253 4096 0 VNODEPOLL 120 1 32 1 0 125 3960 0 procdesc 136 1 28 16 0 61 3944 0 ripcb 488 1 7 3 0 29 3904 0 UMA Slabs 1 176 10 11 10 0 61 3696 0 vmem 1856 0 1 0 0 5 1856 0 FFS1 dinode 128 0 0 0 0 125 0 0 IPsec SA lft_c 16 0 0 0 0 253 0 0 udplite_inpcb 488 0 0 0 0 29 0 0 sctp_asconf_ack 48 0 0 0 0 253 0 0 sctp_asconf 40 0 0 0 0 253 0 0 sctp_stream_msg_out 112 0 0 0 0 125 0 0 sctp_readq 152 0 0 0 0 61 0 0 sctp_chunk 152 0 0 0 0 61 0 0 sctp_raddr 736 0 0 0 0 13 0 0 sctp_laddr 48 0 0 4 0 253 0 0 sctp_asoc 2408 0 0 0 0 3 0 0 sctp_ep 1280 0 0 0 0 9 0 0 tcp_log_node 120 0 0 0 0 125 0 0 tcp_log_bucket 184 0 0 0 0 61 0 0 tcp_log 408 0 0 0 0 29 0 0 tcpreass 48 0 0 0 0 253 0 0 tfo_ccache_entries 80 0 0 0 0 125 0 0 tfo 4 0 0 0 0 253 0 0 sackhole 32 0 0 0 0 253 0 0 hostcache 96 0 0 0 0 125 0 0 syncache 168 0 0 1 0 61 0 0 tcptw 88 0 0 0 0 125 0 0 ipq 56 0 0 0 0 253 0 0 KNOTE 160 0 0 641 0 61 0 0 itimer 352 0 0 0 0 29 0 0 AIOLIO 280 0 0 0 0 29 0 0 AIOCB 752 0 0 0 0 13 0 0 AIOP 32 0 0 0 0 253 0 0 AIO 208 0 0 0 0 61 0 0 NCLNODE 744 0 0 0 0 13 0 0 LTS VFS Cache 368 0 0 0 0 29 0 0 STS VFS Cache 148 0 0 0 0 61 0 0 rentr 24 0 0 9 0 253 0 0 vtnet_tx_hdr 24 0 0 0 0 253 0 0 crypto_session 24 0 0 0 0 253 0 0 cryptodesc 120 0 0 0 0 125 0 0 cryptop 128 0 0 0 0 125 0 0 nvme_request 128 0 0 0 0 125 0 0 FPU_save_area 832 0 0 0 0 13 0 0 DMAR_MAP_ENTRY 120 0 0 0 0 125 0 0 mbuf_extpgs 256 0 0 0 0 61 0 0 mbuf_jumbo_16k 16384 0 0 0 0 1 0 0 mbuf_jumbo_9k 9216 0 0 0 0 1 0 0 mbuf_jumbo_page 4096 0 0 2 0 1 0 0 audit_record 1280 0 0 0 0 9 0 0 domainset 40 0 0 0 0 253 0 0 MAC labels 40 0 0 0 0 253 0 0 vnpbuf 984 0 0 0 0 13 0 0 mdpbuf 984 0 0 1184916 0 1 0 0 nfspbuf 984 0 0 0 0 5 0 0 umtx_shm 88 0 0 0 0 125 0 0 umtx pi 96 0 0 0 0 125 0 0 rangeset pctrie nodes 144 0 0 0 0 61 0 0 65536 65536 0 0 0 0 1 0 0 65536 65536 0 0 0 0 1 0 0 32768 32768 0 0 2145 0 1 0 0 32768 32768 0 0 0 0 1 0 0 16384 16384 0 0 0 0 1 0 0 16384 16384 0 0 0 0 1 0 0 16384 16384 0 0 0 0 1 0 0 UMA Hash 256 0 0 0 0 61 0 0 db:0:pho> show umacache Zone Size Used Free Requests Bucket debugnet_mbuf_packet 2048 0 0 0 0 debugnet_mbuf_cluster 2048 -6144 0 0 0 debugnet_mbuf 256 -10240 0 0 0 kstack_cache 16384 374 0 401 1 vm pgcache 4096 166263 51 16303019 7 vm pgcache 4096 1860973 136 177737004 41 buf free cache 984 5903 135 20470771 13 buffer arena-65 65536 0 0 0 1 buffer arena-61 61440 0 0 0 1 buffer arena-57 57344 0 0 0 1 buffer arena-53 53248 0 0 0 1 buffer arena-49 49152 0 0 0 1 buffer arena-45 45056 0 0 0 1 buffer arena-40 40960 0 0 0 1 buffer arena-36 36864 0 0 0 1 buffer arena-32 32768 3364 14 3236788 2 buffer arena-28 28672 0 0 0 1 buffer arena-24 24576 0 0 0 1 buffer arena-20 20480 0 0 0 1 buffer arena-16 16384 5 0 1878 1 buffer arena-12 12288 0 0 0 1 buffer arena-81 8192 0 0 0 1 buffer arena-40 4096 0 0 0 1 db:0:pho> acttrace Tracing command swap pid 68222 tid 100308 td 0xfffff801a51586e0 (CPU 10) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1dfdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1dfdf0 trap() at trap+0x61/frame 0xfffffe003e1dff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1dff20 --- trap 0x13, rip = 0x203687, rsp = 0x7fffffffe4e0, rbp = 0x7fffffffe500 --- Tracing command creat pid 68196 tid 100384 td 0xfffff8014fcd2000 (CPU 0) cpustop_handler() at cpustop_handler+0x2a/frame 0xffffffff81d86400 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xffffffff81d86420 trap() at trap+0x61/frame 0xffffffff81d86550 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81d86550 --- trap 0x13, rip = 0xffffffff80c15152, rsp = 0xfffffe00addd12f0, rbp = 0xfffffe00addd1300 --- lock_delay() at lock_delay+0x32/frame 0xfffffe00addd1300 __rw_wlock_hard() at __rw_wlock_hard+0x1b8/frame 0xfffffe00addd13d0 _rw_wlock_cookie() at _rw_wlock_cookie+0xbc/frame 0xfffffe00addd1410 workitem_alloc() at workitem_alloc+0xa1/frame 0xfffffe00addd1440 softdep_setup_inomapdep() at softdep_setup_inomapdep+0x138/frame 0xfffffe00addd14a0 ffs_nodealloccg() at ffs_nodealloccg+0x56c/frame 0xfffffe00addd1540 ffs_hashalloc() at ffs_hashalloc+0x10c/frame 0xfffffe00addd1590 ffs_valloc() at ffs_valloc+0x474/frame 0xfffffe00addd1630 ufs_makeinode() at ufs_makeinode+0xad/frame 0xfffffe00addd17c0 ufs_create() at ufs_create+0x34/frame 0xfffffe00addd17e0 VOP_CREATE_APV() at VOP_CREATE_APV+0x5d/frame 0xfffffe00addd1800 vn_open_cred() at vn_open_cred+0x36c/frame 0xfffffe00addd1950 kern_openat() at kern_openat+0x1f3/frame 0xfffffe00addd1ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00addd1bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00addd1bf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8004302ca, rsp = 0x7fffffffe458, rbp = 0x7fffffffe500 --- Tracing command rw pid 68192 tid 100342 td 0xfffff801a54ab000 (CPU 1) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e173dd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e173df0 trap() at trap+0x61/frame 0xfffffe003e173f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e173f20 --- trap 0x13, rip = 0xffffffff80f0fdf7, rsp = 0xfffffe00e7413760, rbp = 0xfffffe00e7413790 --- uma_dbg_free() at uma_dbg_free+0x97/frame 0xfffffe00e7413790 uma_zfree_arg() at uma_zfree_arg+0x95/frame 0xfffffe00e74137f0 free() at free+0x91/frame 0xfffffe00e7413820 vn_io_fault1() at vn_io_fault1+0x37f/frame 0xfffffe00e7413970 vn_io_fault() at vn_io_fault+0x182/frame 0xfffffe00e74139e0 dofileread() at dofileread+0x81/frame 0xfffffe00e7413a30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e7413a70 sys_read() at sys_read+0x83/frame 0xfffffe00e7413ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e7413bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e7413bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800434f0a, rsp = 0x7fffffffd448, rbp = 0x7fffffffe500 --- Tracing command swap pid 68187 tid 100473 td 0xfffff801ea4a7000 (CPU 5) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1a3dd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1a3df0 trap() at trap+0x61/frame 0xfffffe003e1a3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1a3f20 --- trap 0x13, rip = 0x203689, rsp = 0x7fffffffe4e0, rbp = 0x7fffffffe500 --- Tracing command fts pid 68181 tid 100239 td 0xfffff8014fb43000 (CPU 3) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e18bdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e18bdf0 trap() at trap+0x61/frame 0xfffffe003e18bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e18bf20 --- trap 0x13, rip = 0xffffffff80c34f6b, rsp = 0xfffffe00e57d9640, rbp = 0xfffffe00e57d96c0 --- witness_checkorder() at witness_checkorder+0x28b/frame 0xfffffe00e57d96c0 __mtx_lock_flags() at __mtx_lock_flags+0x94/frame 0xfffffe00e57d9710 vdropl() at vdropl+0x275/frame 0xfffffe00e57d9750 vputx() at vputx+0x1c9/frame 0xfffffe00e57d97b0 namei() at namei+0x66c/frame 0xfffffe00e57d98a0 kern_statat() at kern_statat+0x7f/frame 0xfffffe00e57d99c0 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00e57d9ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e57d9bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e57d9bf0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x80043017a, rsp = 0x7fffffffe1e8, rbp = 0x7fffffffe2a0 --- Tracing command swap pid 68165 tid 100421 td 0xfffff803e2f15000 (CPU 2) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e17fdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e17fdf0 trap() at trap+0x61/frame 0xfffffe003e17ff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e17ff20 --- trap 0x13, rip = 0x203689, rsp = 0x7fffffffe4e0, rbp = 0x7fffffffe500 --- Tracing command rw pid 68125 tid 100284 td 0xfffff8014feba000 (CPU 4) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e197dd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e197df0 trap() at trap+0x61/frame 0xfffffe003e197f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e197f20 --- trap 0x13, rip = 0xffffffff80eca66a, rsp = 0xfffffe00e62ed0d0, rbp = 0xfffffe00e62ed150 --- softdep_disk_io_initiation() at softdep_disk_io_initiation+0x43a/frame 0xfffffe00e62ed150 ffs_geom_strategy() at ffs_geom_strategy+0xc5/frame 0xfffffe00e62ed180 bufwrite() at bufwrite+0x24a/frame 0xfffffe00e62ed1d0 ffs_update() at ffs_update+0x2d2/frame 0xfffffe00e62ed230 softdep_request_cleanup() at softdep_request_cleanup+0xbc/frame 0xfffffe00e62ed2c0 ffs_realloccg() at ffs_realloccg+0x171/frame 0xfffffe00e62ed3d0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0x57f/frame 0xfffffe00e62ed590 ffs_write() at ffs_write+0x21b/frame 0xfffffe00e62ed630 VOP_WRITE_APV() at VOP_WRITE_APV+0xda/frame 0xfffffe00e62ed740 vn_write() at vn_write+0x27a/frame 0xfffffe00e62ed7c0 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00e62ed820 vn_io_fault1() at vn_io_fault1+0x16c/frame 0xfffffe00e62ed970 vn_io_fault() at vn_io_fault+0x182/frame 0xfffffe00e62ed9e0 dofilewrite() at dofilewrite+0x81/frame 0xfffffe00e62eda30 kern_writev() at kern_writev+0x49/frame 0xfffffe00e62eda70 sys_write() at sys_write+0x83/frame 0xfffffe00e62edac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e62edbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e62edbf0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800434eca, rsp = 0x7fffffffd448, rbp = 0x7fffffffe500 --- Tracing command rw pid 68117 tid 100380 td 0xfffff801a54ad000 (CPU 7) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1bbdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1bbdf0 trap() at trap+0x61/frame 0xfffffe003e1bbf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1bbf20 --- trap 0x13, rip = 0xffffffff80c15150, rsp = 0xfffffe00e567dee0, rbp = 0xfffffe00e567def0 --- lock_delay() at lock_delay+0x30/frame 0xfffffe00e567def0 _mtx_lock_spin_cookie() at _mtx_lock_spin_cookie+0xd1/frame 0xfffffe00e567df80 __mtx_lock_spin_flags() at __mtx_lock_spin_flags+0xda/frame 0xfffffe00e567dfc0 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x170/frame 0xfffffe00e567e080 __lockmgr_args() at __lockmgr_args+0x62c/frame 0xfffffe00e567e140 getblkx() at getblkx+0x15f/frame 0xfffffe00e567e220 breadn_flags() at breadn_flags+0x44/frame 0xfffffe00e567e290 ffs_getcg() at ffs_getcg+0xd7/frame 0xfffffe00e567e310 ffs_checkblk() at ffs_checkblk+0x6c/frame 0xfffffe00e567e350 ffs_reallocblks() at ffs_reallocblks+0x29d/frame 0xfffffe00e567e4a0 VOP_REALLOCBLKS_APV() at VOP_REALLOCBLKS_APV+0x60/frame 0xfffffe00e567e4c0 cluster_write() at cluster_write+0x598/frame 0xfffffe00e567e590 ffs_write() at ffs_write+0x445/frame 0xfffffe00e567e630 VOP_WRITE_APV() at VOP_WRITE_APV+0xda/frame 0xfffffe00e567e740 vn_write() at vn_write+0x27a/frame 0xfffffe00e567e7c0 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00e567e820 vn_io_fault1() at vn_io_fault1+0x16c/frame 0xfffffe00e567e970 vn_io_fault() at vn_io_fault+0x182/frame 0xfffffe00e567e9e0 dofilewrite() at dofilewrite+0x81/frame 0xfffffe00e567ea30 kern_writev() at kern_writev+0x49/frame 0xfffffe00e567ea70 sys_write() at sys_write+0x83/frame 0xfffffe00e567eac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e567ebf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e567ebf0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800434eca, rsp = 0x7fffffffd448, rbp = 0x7fffffffe500 --- Tracing command g_raid3 data pid 68072 tid 100449 td 0xfffff8001ddb5000 (CPU 11) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1ebdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1ebdf0 trap() at trap+0x61/frame 0xfffffe003e1ebf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1ebf20 --- trap 0x13, rip = 0xffffffff80f2b672, rsp = 0xfffffe00e577aa30, rbp = 0xfffffe00e577aa30 --- PHYS_TO_VM_PAGE() at PHYS_TO_VM_PAGE+0x12/frame 0xfffffe00e577aa30 item_ctor() at item_ctor+0xb8/frame 0xfffffe00e577aa90 uma_zalloc_arg() at uma_zalloc_arg+0x1a9/frame 0xfffffe00e577aad0 g_clone_bio() at g_clone_bio+0x1d/frame 0xfffffe00e577aaf0 g_raid3_worker() at g_raid3_worker+0x77f/frame 0xfffffe00e577abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e577abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e577abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100128 td 0xfffff8001d455000 (CPU 8) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1c7dd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1c7df0 trap() at trap+0x61/frame 0xfffffe003e1c7f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1c7f20 --- trap 0x13, rip = 0xffffffff80c35ce0, rsp = 0xfffffe0037bd0670, rbp = 0xfffffe0037bd06a0 --- witness_lock() at witness_lock+0x190/frame 0xfffffe0037bd06a0 _rw_wlock_cookie() at _rw_wlock_cookie+0xcf/frame 0xfffffe0037bd06e0 pmap_ts_referenced() at pmap_ts_referenced+0xc4/frame 0xfffffe0037bd0770 vm_pageout_worker() at vm_pageout_worker+0x10a3/frame 0xfffffe0037bd0b70 vm_pageout() at vm_pageout+0x193/frame 0xfffffe0037bd0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bd0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bd0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100063 td 0xfffff80003b1d000 (CPU 9) kdb_enter() at kdb_enter+0x37/frame 0xfffffe0037a73a60 vpanic() at vpanic+0x1a1/frame 0xfffffe0037a73ac0 panic() at panic+0x43/frame 0xfffffe0037a73b20 g_io_deliver() at g_io_deliver+0x386/frame 0xfffffe0037a73b70 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0037a73ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe0037a73bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a73bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a73bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100064 td 0xfffff80003b1e6e0 (CPU 6) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1afdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1afdf0 trap() at trap+0x61/frame 0xfffffe003e1aff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1aff20 --- trap 0x13, rip = 0xffffffff80b0cf89, rsp = 0xfffffe0037a78b40, rbp = 0xfffffe0037a78b70 --- g_io_check() at g_io_check+0x79/frame 0xfffffe0037a78b70 g_io_schedule_down() at g_io_schedule_down+0xf7/frame 0xfffffe0037a78ba0 g_down_procbody() at g_down_procbody+0x5c/frame 0xfffffe0037a78bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a78bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a78bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:pho> ps pid ppid pgrp uid state wmesg wchan cmd 69475 69404 2470 0 R sh 69404 2503 2470 0 S piperd 0xfffff8001dd615f0 sh 68242 68141 68080 2007 R+ swap 68239 68141 68080 2007 R+ swap 68238 68141 68080 2007 R+ swap 68237 68135 68080 2007 D+ getblk 0xfffffe003a9d6948 mkdir 68236 68135 68080 2007 D+ getblk 0xfffffe003bb7f4f8 mkdir 68235 68141 68080 2007 R+ swap 68234 68135 68080 2007 D+ getblk 0xfffffe003a9d6948 mkdir 68233 68141 68080 2007 R+ swap 68230 68135 68080 2007 R+ mkdir 68229 68141 68080 2007 R+ swap 68227 68135 68080 2007 R+ mkdir 68226 68141 68080 2007 R+ swap 68224 68135 68080 2007 D+ getblk 0xfffffe00386dc158 mkdir 68222 68141 68080 2007 R+ CPU 10 swap 68221 68104 68080 2007 D+ getblk 0xfffffe003bb7f4f8 symlink 68220 68135 68080 2007 D+ getblk 0xfffffe003a9d6948 mkdir 68218 68141 68080 2007 R+ swap 68217 68104 68080 2007 D+ getblk 0xfffffe003bb7f4f8 symlink 68216 68135 68080 2007 D+ ufs 0xfffff803ffc9a2e8 mkdir 68214 68141 68080 2007 R+ swap 68213 68118 68080 2007 R+ link 68212 68104 68080 2007 D+ getblk 0xfffffe003bb7f4f8 symlink 68211 68135 68080 2007 R+ mkdir 68209 68113 68080 2007 D+ ufs 0xfffff803ffc9a2e8 fts 68208 68107 68080 2007 D+ biowr 0xfffff804e133bc00 rw 68207 68141 68080 2007 R+ swap 68206 68118 68080 2007 R+ link 68205 68134 68080 2007 D+ getblk 0xfffffe00386dc158 creat 68204 68104 68080 2007 D+ getblk 0xfffffe003bb7f4f8 symlink 68203 68135 68080 2007 R+ mkdir 68202 68107 68080 2007 D+ biowr 0xfffff80262731000 rw 68201 68113 68080 2007 D+ ufs 0xfffff803ffc9a2e8 fts 68200 68118 68080 2007 R+ link 68199 68104 68080 2007 D+ getblk 0xfffffe003bb7f4f8 symlink 68198 68141 68080 2007 R+ swap 68196 68134 68080 2007 R+ CPU 0 creat 68195 68135 68080 2007 D+ ufs 0xfffff807556fa2e8 mkdir 68194 68113 68080 2007 D+ ufs 0xfffff803ffc9a2e8 fts 68193 68118 68080 2007 R+ link 68192 68107 68080 2007 R+ CPU 1 rw 68190 68134 68080 2007 D+ getblk 0xfffffe00386dc158 creat 68189 68104 68080 2007 R+ symlink 68188 68135 68080 2007 R+ mkdir 68187 68141 68080 2007 R+ CPU 5 swap 68186 68113 68080 2007 D+ ufs 0xfffff803ffc9a2e8 fts 68185 68118 68080 2007 R+ link 68184 68107 68080 2007 D+ getblk 0xfffffe00386dc158 rw 68183 68135 68080 2007 D+ getblk 0xfffffe003a9d6948 mkdir 68182 68141 68080 2007 R+ swap 68181 68113 68080 2007 R+ CPU 3 fts 68180 68118 68080 2007 R+ link 68179 68104 68080 2007 D+ getblk 0xfffffe003bb7f4f8 symlink 68177 68134 68080 2007 R+ creat 68176 68135 68080 2007 D+ biowr 0xfffffe003a9d68c8 mkdir 68175 68113 68080 2007 D+ ufs 0xfffff803ffc9a2e8 fts 68173 68107 68080 2007 R+ rw 68172 68104 68080 2007 D+ getblk 0xfffffe003a9d6948 symlink 68170 68118 68080 2007 R+ link 68169 68134 68080 2007 D+ getblk 0xfffffe003bb7f4f8 creat 68168 68135 68080 2007 R+ mkdir 68167 68145 68080 2007 D+ ufs 0xfffff803ffc9a2e8 rename 68166 68113 68080 2007 D+ ufs 0xfffff803ffc9a2e8 fts 68165 68141 68080 2007 R+ CPU 2 swap 68163 68107 68080 2007 D+ getblk 0xfffffe00386dc158 rw 68162 68104 68080 2007 R+ symlink 68161 68118 68080 2007 R+ link 68160 68135 68080 2007 R+ mkdir 68159 68134 68080 2007 D+ ufs 0xfffff804e1321a68 creat 68158 68140 68080 2007 D+ ufs 0xfffff803ffc9a2e8 mkfifo 68157 68145 68080 2007 D+ ufs 0xfffff803ffc9a2e8 rename 68156 68107 68080 2007 D+ getblk 0xfffffe00386dc158 rw 68155 68104 68080 2007 D+ biowr 0xfffffe003b374788 symlink 68154 68113 68080 2007 D+ ufs 0xfffff803ffc9a2e8 fts 68153 68134 68080 2007 D+ getblk 0xfffffe003bb7f4f8 creat 68152 68141 68080 2007 R+ swap 68151 68135 68080 2007 R+ mkdir 68150 68107 68080 2007 R+ rw 68149 68118 68080 2007 R+ link 68148 68104 68080 2007 D+ getblk 0xfffffe003bb7f4f8 symlink 68147 68113 68080 2007 D+ ufs 0xfffff803ffc9a2e8 fts 68146 68135 68080 2007 R+ mkdir 68145 68100 68080 2007 SW+ wait 0xfffff8014f140000 rename 68144 68107 68080 2007 R+ rw 68143 68118 68080 2007 R+ link 68142 68104 68080 2007 D+ getblk 0xfffffe003bb7f4f8 symlink 68141 68101 68080 2007 SW+ wait 0xfffff8014fa85a60 swap 68140 68103 68080 2007 S+ wait 0xfffff801a53dba60 mkfifo 68139 68113 68080 2007 D+ ufs 0xfffff803ffc9a2e8 fts 68138 68107 68080 2007 R+ rw 68137 68118 68080 2007 R+ link 68136 68104 68080 2007 D+ getblk 0xfffffe003bb7f4f8 symlink 68135 68099 68080 2007 SW+ wait 0xfffff8003f1cba60 mkdir 68134 68098 68080 2007 SW+ wait 0xfffff8001d2f6a60 creat 68133 68107 68080 2007 D+ getblk 0xfffffe00386dc158 rw 68132 68113 68080 2007 D+ ufs 0xfffff803ffc9a2e8 fts 68131 68118 68080 2007 R+ link 68130 68104 68080 2007 D+ biowr 0xfffffe003a00c6c8 symlink 68129 68107 68080 2007 R+ rw 68128 68113 68080 2007 D+ ufs 0xfffff803ffc9a2e8 fts 68127 68118 68080 2007 R+ link 68126 68104 68080 2007 D+ getblk 0xfffffe003bb7f4f8 symlink 68125 68107 68080 2007 RL+ CPU 4 rw 68124 68113 68080 2007 D+ ufs 0xfffff803ffc9a2e8 fts 68123 68118 68080 2007 R+ link 68122 68104 68080 2007 R+ symlink 68121 68107 68080 2007 R+ rw 68120 68113 68080 2007 D+ ufs 0xfffff803ffc9a2e8 fts 68119 68104 68080 2007 D+ getblk 0xfffffe003bb7f4f8 symlink 68118 68096 68080 2007 SW+ wait 0xfffff8001d9dfa60 link 68117 68107 68080 2007 R+ CPU 7 rw 68116 68104 68080 2007 D+ getblk 0xfffffe003a9d6948 symlink 68115 68105 68080 2007 D+ getblk 0xfffffe003a9d6948 openat 68114 68107 68080 2007 D+ getblk 0xfffffe003a9d6948 rw 68113 68095 68080 2007 SW+ wait 0xfffff8014fd2b530 fts 68112 68104 68080 2007 R+ symlink 68111 68105 68080 2007 D+ getblk 0xfffffe003a9d6948 openat 68110 68107 68080 2007 R+ rw 68109 68104 68080 2007 R+ symlink 68108 68105 68080 2007 D+ getblk 0xfffffe003a9d6948 openat 68107 68094 68080 2007 SW+ wait 0xfffff8001dd57a60 rw 68106 68102 68080 2007 R+ lockf2 68105 68093 68080 2007 SW+ wait 0xfffff8003f4b9000 openat 68104 68092 68080 2007 SW+ wait 0xfffff802a5a93530 symlink 68103 68090 68080 2007 S+ nanslp 0xffffffff81c816f9 mkfifo 68102 68091 68080 2007 SW+ wait 0xfffff8055987e000 lockf2 68101 68090 68080 2007 S+ nanslp 0xffffffff81c816fa swap 68100 68090 68080 2007 S+ nanslp 0xffffffff81c816f3 rename 68099 68090 68080 2007 S+ nanslp 0xffffffff81c816f2 mkdir 68098 68090 68080 2007 S+ nanslp 0xffffffff81c816f8 creat 68096 68090 68080 2007 S+ nanslp 0xffffffff81c816f7 link 68095 68090 68080 2007 S+ nanslp 0xffffffff81c816f1 fts 68094 68090 68080 2007 S+ nanslp 0xffffffff81c816f3 rw 68093 68090 68080 2007 S+ nanslp 0xffffffff81c816fa openat 68092 68090 68080 2007 S+ nanslp 0xffffffff81c816f9 symlink 68091 68090 68080 2007 S+ nanslp 0xffffffff81c816fa lockf2 68090 68089 68080 2007 SW+ wait 0xfffff8001d2ed000 run 68089 68088 68080 2007 SW+ wait 0xfffff803f4d26530 run 68088 68080 68080 2007 S+ nanslp 0xffffffff81c816fa run 68080 68079 68080 2007 SW+ wait 0xfffff8001dc1c000 sh 68079 68050 2359 0 SW+ wait 0xfffff8014fad7000 su 68072 0 0 0 RL CPU 11 [g_raid3 data] 68069 0 0 0 DL mdwait 0xfffff80665fea000 [md12] 68065 0 0 0 DL mdwait 0xfffff8053fe90000 [md11] 68061 0 0 0 DL mdwait 0xfffff805c39a3000 [md10] 68051 2359 2359 0 S+ piperd 0xfffff8035ade9000 tee 68050 68049 2359 0 SW+ wait 0xfffff8001da4d000 sh 68049 2359 2359 0 SW+ wait 0xfffff80448b19530 sh 2506 2470 2470 0 S piperd 0xfffff8001da095f0 sh 2504 2470 2470 0 S piperd 0xfffff8001da09be0 awk 2503 2470 2470 0 SW wait 0xfffff8003572fa60 sh 2470 1 2470 0 SWs wait 0xfffff8001da53000 sh 2359 2357 2359 0 SW+ wait 0xfffff8001dd8d530 sh 2357 2355 2357 0 SW+ wait 0xfffff8001d9e2a60 bash 2355 2354 2355 0 SW+ pause 0xfffff8001deea0a8 csh 2354 2349 2354 2006 SW+ wait 0xfffff8001deea530 su 2349 2348 2349 2006 SWs+ wait 0xfffff8001d9eda60 bash 2348 2345 2345 2006 S select 0xfffff80005015040 sshd 2345 2281 2345 0 Ss select 0xfffff80003b793c0 sshd 2341 2340 2341 0 S+ ttyin 0xfffff8000515a0b0 csh 2340 1 2340 0 SWs+ wait 0xfffff8001d3f6000 login 2339 1 2339 0 Ss+ ttyin 0xfffff8000515a4b0 getty 2338 1 2338 0 Ss+ ttyin 0xfffff8001d4280b0 getty 2337 1 2337 0 Ss+ ttyin 0xfffff8001d4284b0 getty 2336 1 2336 0 Ss+ ttyin 0xfffff8001d4288b0 getty 2335 1 2335 0 Ss+ ttyin 0xfffff8001d428cb0 getty 2334 1 2334 0 Ss+ ttyin 0xfffff8001d4270b0 getty 2333 1 2333 0 Ss+ ttyin 0xfffff8001d4274b0 getty 2332 1 2332 0 Ss+ ttyin 0xfffff8001d4278b0 getty 2331 1 2331 0 Ss+ ttyin 0xfffff8001d427cb0 getty 2285 1 2285 0 SWs nanslp 0xffffffff81c816f7 cron 2281 1 2281 0 Ss select 0xfffff8001d89b8c0 sshd 2253 1 2253 0 Ss select 0xfffff8001d8d0ec0 powerd 2250 1 2250 123 Ss (threaded) ntpd 100156 S select 0xfffff8001d5822c0 ntpd 100527 S usem 0xfffff8001d751a80 ntpd 2189 1 2189 0 Ss rpcsvc 0xfffff8001d5d6760 NLM: master 2186 1 2186 0 Ss select 0xfffff8001d8d0f40 rpc.statd 2140 1 2140 0 Ss nanslp 0xffffffff81c816fa watchdogd 2061 1 2061 0 Ss select 0xfffff8001d89b940 rpcbind 2051 1 2051 0 Ss select 0xfffff80005015240 syslogd 1980 1 1980 0 Ss select 0xfffff800351d00c0 devd 1975 1 1975 65 Ss select 0xfffff800050152c0 dhclient 1928 1 1928 0 Ss select 0xfffff8001dd74140 dhclient 1925 1 1925 0 Ss select 0xfffff80003b79540 dhclient 34 0 0 0 DL syncer 0xffffffff81d57b58 [syncer] 33 0 0 0 DL vlruwt 0xfffff8001d3f1000 [vnlru] 32 0 0 0 RL (threaded) [bufdaemon] 100130 D psleep 0xffffffff81d57058 [bufdaemon] 100131 D - 0xffffffff8180a980 [bufspacedaemon-0] 100134 D - 0xffffffff81812c40 [bufspacedaemon-1] 100135 D - 0xffffffff8181af00 [bufspacedaemon-2] 100136 D - 0xffffffff818231c0 [bufspacedaemon-3] 100138 D - 0xffffffff8182b480 [bufspacedaemon-4] 100140 D - 0xffffffff81833740 [bufspacedaemon-5] 100141 D - 0xffffffff8183ba00 [bufspacedaemon-6] 100153 D sdflush 0xfffff8001de83ce8 [/ worker] 100205 D sdflush 0xfffff8001d2e62e8 [/tmp worker] 100528 RunQ [/mnt worker] 31 0 0 0 DL psleep 0xffffffff81d72ac8 [vmdaemon] 30 0 0 0 RL (threaded) [pagedaemon] 100128 Run CPU 8 [dom0] 100132 D swbufa 0xffffffff81d6e404 [laundry: dom0] 100139 D umarcl 0xffffffff80f0bb20 [uma] 29 0 0 0 DL idle 0xfffff8001d50a530 [enc_daemon1] 28 0 0 0 DL idle 0xfffff8001d50aa60 [enc_daemon0] 27 0 0 0 DL - 0xffffffff81adbfb0 [rand_harvestq] 26 0 0 0 DL waiting 0xffffffff81de5020 [sctp_iterator] 25 0 0 0 DL - 0xffffffff81d56a5c [soaiod4] 24 0 0 0 DL - 0xffffffff81d56a5c [soaiod3] 23 0 0 0 DL - 0xffffffff81d56a5c [soaiod2] 22 0 0 0 DL - 0xffffffff81d56a5c [soaiod1] 21 0 0 0 DL (threaded) [usb] 100096 D - 0xfffffe00d2bfc440 [usbus0] 100097 D - 0xfffffe00d2bfc498 [usbus0] 100098 D - 0xfffffe00d2bfc4f0 [usbus0] 100099 D - 0xfffffe00d2bfc548 [usbus0] 100100 D - 0xfffffe00d2bfc5a0 [usbus0] 100102 D - 0xfffffe003e436cf0 [usbus1] 100103 D - 0xfffffe003e436d48 [usbus1] 100104 D - 0xfffffe003e436da0 [usbus1] 100105 D - 0xfffffe003e436df8 [usbus1] 100106 D - 0xfffffe003e436e50 [usbus1] 100107 D - 0xfffffe00d2f89cf0 [usbus2] 100108 D - 0xfffffe00d2f89d48 [usbus2] 100109 D - 0xfffffe00d2f89da0 [usbus2] 100110 D - 0xfffffe00d2f89df8 [usbus2] 100111 D - 0xfffffe00d2f89e50 [usbus2] 20 0 0 0 RL (threaded) [cam] 100091 D - 0xffffffff819b73c0 [doneq0] 100092 RunQ [doneq1] 100093 D - 0xffffffff819b74c0 [doneq2] 100125 D - 0xffffffff819b7288 [scanner] 19 0 0 0 DL crypto_ 0xfffff80003bd0450 [crypto returns 11] 18 0 0 0 DL crypto_ 0xfffff80003bd03f0 [crypto returns 10] 17 0 0 0 DL crypto_ 0xfffff80003bd0390 [crypto returns 9] 16 0 0 0 DL crypto_ 0xfffff80003bd0330 [crypto returns 8] 15 0 0 0 DL crypto_ 0xfffff80003bd02d0 [crypto returns 7] 9 0 0 0 DL crypto_ 0xfffff80003bd0270 [crypto returns 6] 8 0 0 0 DL crypto_ 0xfffff80003bd0210 [crypto returns 5] 7 0 0 0 DL crypto_ 0xfffff80003bd01b0 [crypto returns 4] 6 0 0 0 DL crypto_ 0xfffff80003bd0150 [crypto returns 3] 5 0 0 0 DL crypto_ 0xfffff80003bd00f0 [crypto returns 2] 4 0 0 0 DL crypto_ 0xfffff80003bd0090 [crypto returns 1] 3 0 0 0 DL crypto_ 0xfffff80003bd0030 [crypto returns 0] 2 0 0 0 DL crypto_ 0xffffffff81d6cb38 [crypto] 14 0 0 0 DL seqstat 0xfffff80003adf888 [sequencer 00] 13 0 0 0 RL (threaded) [geom] 100062 D - 0xffffffff81d9e088 [g_event] 100063 Run CPU 9 [g_up] 100064 Run CPU 6 [g_down] 12 0 0 0 WL (threaded) [intr] 100017 I [swi6: task queue] 100018 I [swi6: Giant taskq] 100020 I [swi5: fast taskq] 100047 I [swi4: clock (0)] 100048 I [swi4: clock (1)] 100049 I [swi4: clock (2)] 100050 I [swi4: clock (3)] 100051 I [swi4: clock (4)] 100052 I [swi4: clock (5)] 100053 I [swi4: clock (6)] 100054 I [swi4: clock (7)] 100055 I [swi4: clock (8)] 100056 I [swi4: clock (9)] 100057 I [swi4: clock (10)] 100058 I [swi4: clock (11)] 100059 I [swi1: netisr 0] 100060 I [swi3: vm] 100094 I [irq56: ahci0] 100095 I [irq19: xhci0] 100101 I [irq18: ehci0 ehci1] 100112 I [irq71: ahci1] 100113 I [swi0: uart uart] 100180 I [irq72: ioat0] 100181 I [irq73: ioat1] 100182 I [irq74: ioat2] 100183 I [irq75: ioat3] 100184 I [irq76: ioat4] 100185 I [irq77: ioat5] 100186 I [irq78: ioat6] 100187 I [irq79: ioat7] 11 0 0 0 RL (threaded) [idle] 100003 CanRun [idle: cpu0] 100004 CanRun [idle: cpu1] 100005 CanRun [idle: cpu2] 100006 CanRun [idle: cpu3] 100007 CanRun [idle: cpu4] 100008 CanRun [idle: cpu5] 100009 CanRun [idle: cpu6] 100010 CanRun [idle: cpu7] 100011 CanRun [idle: cpu8] 100012 CanRun [idle: cpu9] 100013 CanRun [idle: cpu10] 100014 CanRun [idle: cpu11] 1 0 1 0 SLs wait 0xfffff80003944530 [init] 10 0 0 0 DL audit_w 0xffffffff81de5cb0 [audit] 0 0 0 0 DLs (threaded) [kernel] 100000 D swapin 0xffffffff81d8c638 [swapper] 100015 D - 0xfffff8000399f000 [config_0] 100016 D - 0xfffff8000399ee00 [aiod_kick taskq] 100019 D - 0xfffff8000399eb00 [thread taskq] 100021 D - 0xfffff8000399e900 [kqueue_ctx taskq] 100022 D - 0xfffff8000399e800 [if_io_tqg_0] 100023 D - 0xfffff8000399e700 [if_io_tqg_1] 100024 D - 0xfffff8000399e600 [if_io_tqg_2] 100025 D - 0xfffff8000399e500 [if_io_tqg_3] 100026 D - 0xfffff8000399e400 [if_io_tqg_4] 100027 D - 0xfffff8000399e300 [if_io_tqg_5] 100028 D - 0xfffff8000399e200 [if_io_tqg_6] 100029 D - 0xfffff8000399e100 [if_io_tqg_7] 100030 D - 0xfffff8000399e000 [if_io_tqg_8] 100031 D - 0xfffff8000399de00 [if_io_tqg_9] 100032 D - 0xfffff8000399dd00 [if_io_tqg_10] 100033 D - 0xfffff8000399dc00 [if_io_tqg_11] 100034 D - 0xfffff8000399db00 [softirq_0] 100035 D - 0xfffff8000399da00 [softirq_1] 100036 D - 0xfffff8000399d900 [softirq_2] 100037 D - 0xfffff8000399d800 [softirq_3] 100038 D - 0xfffff8000399d700 [softirq_4] 100039 D - 0xfffff8000399d600 [softirq_5] 100040 D - 0xfffff8000399d500 [softirq_6] 100041 D - 0xfffff8000399d400 [softirq_7] 100042 D - 0xfffff8000399d300 [softirq_8] 100043 D - 0xfffff8000399d200 [softirq_9] 100044 D - 0xfffff8000399d100 [softirq_10] 100045 D - 0xfffff8000399d000 [softirq_11] 100046 D - 0xfffff80003abd100 [if_config_tqg_0] 100061 D - 0xfffff80003abd000 [firmware taskq] 100066 D - 0xfffff80003abee00 [crypto_0] 100067 D - 0xfffff80003abee00 [crypto_1] 100068 D - 0xfffff80003abee00 [crypto_2] 100069 D - 0xfffff80003abee00 [crypto_3] 100070 D - 0xfffff80003abee00 [crypto_4] 100071 D - 0xfffff80003abee00 [crypto_5] 100072 D - 0xfffff80003abee00 [crypto_6] 100073 D - 0xfffff80003abee00 [crypto_7] 100074 D - 0xfffff80003abee00 [crypto_8] 100075 D - 0xfffff80003abee00 [crypto_9] 100076 D - 0xfffff80003abee00 [crypto_10] 100077 D - 0xfffff80003abee00 [crypto_11] 100114 D - 0xfffff800051cb200 [mca taskq] 100121 D - 0xfffff8001d458300 [acpi_task_0] 100122 D - 0xfffff8001d458300 [acpi_task_1] 100123 D - 0xfffff8001d458300 [acpi_task_2] 100124 D - 0xfffff80003abed00 [CAM taskq] 68097 68090 68080 2007 Z+ lockf 68225 68140 68080 2007 Z+ mkfifo 68228 68140 68080 2007 Z+ mkfifo 68231 68140 68080 2007 Z+ mkfifo 68232 68140 68080 2007 Z+ mkfifo 68240 68141 68080 2007 Z+ swap 68241 68141 68080 2007 Z+ swap 68164 68140 68080 2007 Z+ mkfifo 68171 68140 68080 2007 Z+ mkfifo 68174 68141 68080 2007 Z+ swap 68178 68140 68080 2007 Z+ mkfifo 68191 68140 68080 2007 Z+ mkfifo 68197 68140 68080 2007 Z+ mkfifo 69477 69475 2470 0 Z sed 68210 68140 68080 2007 Z+ mkfifo 68215 68140 68080 2007 Z+ mkfifo 68219 68140 68080 2007 Z+ mkfifo 68223 68140 68080 2007 Z+ mkfifo db:0:pho> allt Tracing command sh pid 69475 tid 100231 td 0xfffff800350eb6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e57b66b0 mi_switch() at mi_switch+0x164/frame 0xfffffe00e57b66f0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e57b6730 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e57b6790 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e57b67a0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e57b6840 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00e57b68d0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e57b6ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e57b6bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e57b6bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8004094ca, rsp = 0x7fffffffdd08, rbp = 0x7fffffffddc0 --- Tracing command sh pid 69404 tid 100427 td 0xfffff8046af4d6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e75497f0 mi_switch() at mi_switch+0x164/frame 0xfffffe00e7549830 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e7549870 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e75498d0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e75498e0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e7549980 pipe_read() at pipe_read+0x428/frame 0xfffffe00e75499e0 dofileread() at dofileread+0x81/frame 0xfffffe00e7549a30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e7549a70 sys_read() at sys_read+0x83/frame 0xfffffe00e7549ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e7549bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e7549bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800478f0a, rsp = 0x7fffffffdf58, rbp = 0x7fffffffe0a0 --- Tracing command swap pid 68242 tid 100472 td 0xfffff804510f16e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e7625b50 mi_switch() at mi_switch+0x164/frame 0xfffffe00e7625b90 sched_preempt() at sched_preempt+0x86/frame 0xfffffe00e7625bc0 ipi_bitmap_handler() at ipi_bitmap_handler+0x64/frame 0xfffffe00e7625bf0 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0xb3/frame 0xfffffe00e7625bf0 --- interrupt, rip = 0x20368e, rsp = 0x7fffffffe4e0, rbp = 0x7fffffffe500 --- Tracing command swap pid 68239 tid 100224 td 0xfffff8003fdb3000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e5793b60 mi_switch() at mi_switch+0x164/frame 0xfffffe00e5793ba0 ast() at ast+0x299/frame 0xfffffe00e5793bf0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe500 Tracing command swap pid 68238 tid 100346 td 0xfffff801a54f7000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e7427b50 mi_switch() at mi_switch+0x164/frame 0xfffffe00e7427b90 sched_preempt() at sched_preempt+0x86/frame 0xfffffe00e7427bc0 ipi_bitmap_handler() at ipi_bitmap_handler+0x64/frame 0xfffffe00e7427bf0 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0xb3/frame 0xfffffe00e7427bf0 --- interrupt, rip = 0x203687, rsp = 0x7fffffffe4e0, rbp = 0x7fffffffe500 --- Tracing command mkdir pid 68237 tid 100518 td 0xfffff805c0bf46e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e775e1e0 mi_switch() at mi_switch+0x164/frame 0xfffffe00e775e220 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e775e260 sleeplk() at sleeplk+0x107/frame 0xfffffe00e775e2c0 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x225/frame 0xfffffe00e775e380 __lockmgr_args() at __lockmgr_args+0x62c/frame 0xfffffe00e775e440 getblkx() at getblkx+0x15f/frame 0xfffffe00e775e520 breadn_flags() at breadn_flags+0x44/frame 0xfffffe00e775e590 ffs_vgetf() at ffs_vgetf+0x340/frame 0xfffffe00e775e640 ffs_valloc() at ffs_valloc+0x591/frame 0xfffffe00e775e6e0 ufs_mkdir() at ufs_mkdir+0xcc/frame 0xfffffe00e775e880 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x60/frame 0xfffffe00e775e8a0 kern_mkdirat() at kern_mkdirat+0x1b3/frame 0xfffffe00e775eac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e775ebf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e775ebf0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x80043032a, rsp = 0x7fffffff2898, rbp = 0x7fffffff2cc0 --- Tracing command mkdir pid 68236 tid 100444 td 0xfffff804fa4aa000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e759e2a0 mi_switch() at mi_switch+0x164/frame 0xfffffe00e759e2e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e759e320 sleeplk() at sleeplk+0x107/frame 0xfffffe00e759e380 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x225/frame 0xfffffe00e759e440 __lockmgr_args() at __lockmgr_args+0x62c/frame 0xfffffe00e759e500 getblkx() at getblkx+0x15f/frame 0xfffffe00e759e5e0 breadn_flags() at breadn_flags+0x44/frame 0xfffffe00e759e650 ffs_update() at ffs_update+0x138/frame 0xfffffe00e759e6e0 ufs_mkdir() at ufs_mkdir+0x32f/frame 0xfffffe00e759e880 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x60/frame 0xfffffe00e759e8a0 kern_mkdirat() at kern_mkdirat+0x1b3/frame 0xfffffe00e759eac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e759ebf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e759ebf0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x80043032a, rsp = 0x7fffffffdca8, rbp = 0x7fffffffe0d0 --- Tracing command swap pid 68235 tid 100329 td 0xfffff801a5346000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e63ceb50 mi_switch() at mi_switch+0x164/frame 0xfffffe00e63ceb90 sched_preempt() at sched_preempt+0x86/frame 0xfffffe00e63cebc0 ipi_bitmap_handler() at ipi_bitmap_handler+0x64/frame 0xfffffe00e63cebf0 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0xb3/frame 0xfffffe00e63cebf0 --- interrupt, rip = 0x203687, rsp = 0x7fffffffe4e0, rbp = 0x7fffffffe500 --- Tracing command mkdir pid 68234 tid 100373 td 0xfffff80289153000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e62631e0 mi_switch() at mi_switch+0x164/frame 0xfffffe00e6263220 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e6263260 sleeplk() at sleeplk+0x107/frame 0xfffffe00e62632c0 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x225/frame 0xfffffe00e6263380 __lockmgr_args() at __lockmgr_args+0x62c/frame 0xfffffe00e6263440 getblkx() at getblkx+0x15f/frame 0xfffffe00e6263520 breadn_flags() at breadn_flags+0x44/frame 0xfffffe00e6263590 ffs_vgetf() at ffs_vgetf+0x340/frame 0xfffffe00e6263640 ffs_valloc() at ffs_valloc+0x591/frame 0xfffffe00e62636e0 ufs_mkdir() at ufs_mkdir+0xcc/frame 0xfffffe00e6263880 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x60/frame 0xfffffe00e62638a0 kern_mkdirat() at kern_mkdirat+0x1b3/frame 0xfffffe00e6263ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e6263bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e6263bf0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x80043032a, rsp = 0x7fffffff02e8, rbp = 0x7fffffff0710 --- Tracing command swap pid 68233 tid 100272 td 0xfffff8014fb456e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e62b1b60 mi_switch() at mi_switch+0x164/frame 0xfffffe00e62b1ba0 ast() at ast+0x299/frame 0xfffffe00e62b1bf0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe500 Tracing command mkdir pid 68230 tid 100462 td 0xfffff802d0f62000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e75f3120 mi_switch() at mi_switch+0x164/frame 0xfffffe00e75f3160 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e75f31a0 sleeplk() at sleeplk+0x107/frame 0xfffffe00e75f3200 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x225/frame 0xfffffe00e75f32c0 __lockmgr_args() at __lockmgr_args+0x62c/frame 0xfffffe00e75f3380 getblkx() at getblkx+0x15f/frame 0xfffffe00e75f3460 breadn_flags() at breadn_flags+0x44/frame 0xfffffe00e75f34d0 ffs_getcg() at ffs_getcg+0xd7/frame 0xfffffe00e75f3550 ffs_nodealloccg() at ffs_nodealloccg+0xa1/frame 0xfffffe00e75f35f0 ffs_hashalloc() at ffs_hashalloc+0x79/frame 0xfffffe00e75f3640 ffs_valloc() at ffs_valloc+0x474/frame 0xfffffe00e75f36e0 ufs_mkdir() at ufs_mkdir+0xcc/frame 0xfffffe00e75f3880 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x60/frame 0xfffffe00e75f38a0 kern_mkdirat() at kern_mkdirat+0x1b3/frame 0xfffffe00e75f3ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e75f3bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e75f3bf0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x80043032a, rsp = 0x7ffffffefeb8, rbp = 0x7fffffff02e0 --- Tracing command swap pid 68229 tid 100377 td 0xfffff802164e3000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e566fb50 mi_switch() at mi_switch+0x164/frame 0xfffffe00e566fb90 sched_preempt() at sched_preempt+0x86/frame 0xfffffe00e566fbc0 ipi_bitmap_handler() at ipi_bitmap_handler+0x64/frame 0xfffffe00e566fbf0 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0xb3/frame 0xfffffe00e566fbf0 --- interrupt, rip = 0x20368e, rsp = 0x7fffffffe4e0, rbp = 0x7fffffffe500 --- Tracing command mkdir pid 68227 tid 100328 td 0xfffff801a52b76e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e63c8fa0 mi_switch() at mi_switch+0x164/frame 0xfffffe00e63c8fe0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e63c9020 sleeplk() at sleeplk+0x107/frame 0xfffffe00e63c9080 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x225/frame 0xfffffe00e63c9140 __lockmgr_args() at __lockmgr_args+0x62c/frame 0xfffffe00e63c9200 getblkx() at getblkx+0x15f/frame 0xfffffe00e63c92e0 breadn_flags() at breadn_flags+0x44/frame 0xfffffe00e63c9350 ffs_getcg() at ffs_getcg+0xd7/frame 0xfffffe00e63c93d0 ffs_alloccg() at ffs_alloccg+0x94/frame 0xfffffe00e63c9460 ffs_hashalloc() at ffs_hashalloc+0x79/frame 0xfffffe00e63c94b0 ffs_alloc() at ffs_alloc+0x1ee/frame 0xfffffe00e63c9530 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xcd3/frame 0xfffffe00e63c96e0 ufs_mkdir() at ufs_mkdir+0x701/frame 0xfffffe00e63c9880 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x60/frame 0xfffffe00e63c98a0 kern_mkdirat() at kern_mkdirat+0x1b3/frame 0xfffffe00e63c9ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e63c9bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e63c9bf0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x80043032a, rsp = 0x7fffffffa208, rbp = 0x7fffffffa630 --- Tracing command swap pid 68226 tid 100370 td 0xfffff80842e63000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e6254b50 mi_switch() at mi_switch+0x164/frame 0xfffffe00e6254b90 sched_preempt() at sched_preempt+0x86/frame 0xfffffe00e6254bc0 ipi_bitmap_handler() at ipi_bitmap_handler+0x64/frame 0xfffffe00e6254bf0 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0xb3/frame 0xfffffe00e6254bf0 --- interrupt, rip = 0x203689, rsp = 0x7fffffffe4e0, rbp = 0x7fffffffe500 --- Tracing command mkdir pid 68224 tid 100300 td 0xfffff801a506f6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e633d120 mi_switch() at mi_switch+0x164/frame 0xfffffe00e633d160 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e633d1a0 sleeplk() at sleeplk+0x107/frame 0xfffffe00e633d200 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x225/frame 0xfffffe00e633d2c0 __lockmgr_args() at __lockmgr_args+0x62c/frame 0xfffffe00e633d380 getblkx() at getblkx+0x15f/frame 0xfffffe00e633d460 breadn_flags() at breadn_flags+0x44/frame 0xfffffe00e633d4d0 ffs_getcg() at ffs_getcg+0xd7/frame 0xfffffe00e633d550 ffs_nodealloccg() at ffs_nodealloccg+0xa1/frame 0xfffffe00e633d5f0 ffs_hashalloc() at ffs_hashalloc+0x79/frame 0xfffffe00e633d640 ffs_valloc() at ffs_valloc+0x474/frame 0xfffffe00e633d6e0 ufs_mkdir() at ufs_mkdir+0xcc/frame 0xfffffe00e633d880 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x60/frame 0xfffffe00e633d8a0 kern_mkdirat() at kern_mkdirat+0x1b3/frame 0xfffffe00e633dac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e633dbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e633dbf0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x80043032a, rsp = 0x7fffffff9148, rbp = 0x7fffffff9570 --- Tracing command swap pid 68222 tid 100308 td 0xfffff801a51586e0 (CPU 10) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1dfdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1dfdf0 trap() at trap+0x61/frame 0xfffffe003e1dff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1dff20 --- trap 0x13, rip = 0x203687, rsp = 0x7fffffffe4e0, rbp = 0x7fffffffe500 --- Tracing command symlink pid 68221 tid 100189 td 0xfffff800351126e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e56cc1c0 mi_switch() at mi_switch+0x164/frame 0xfffffe00e56cc200 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e56cc240 sleeplk() at sleeplk+0x107/frame 0xfffffe00e56cc2a0 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x225/frame 0xfffffe00e56cc360 __lockmgr_args() at __lockmgr_args+0x62c/frame 0xfffffe00e56cc420 getblkx() at getblkx+0x15f/frame 0xfffffe00e56cc500 breadn_flags() at breadn_flags+0x44/frame 0xfffffe00e56cc570 ffs_update() at ffs_update+0x138/frame 0xfffffe00e56cc600 ufs_direnter() at ufs_direnter+0x7e5/frame 0xfffffe00e56cc6c0 ufs_makeinode() at ufs_makeinode+0x60c/frame 0xfffffe00e56cc850 ufs_symlink() at ufs_symlink+0x36/frame 0xfffffe00e56cc880 VOP_SYMLINK_APV() at VOP_SYMLINK_APV+0x60/frame 0xfffffe00e56cc8a0 kern_symlinkat() at kern_symlinkat+0x21a/frame 0xfffffe00e56ccac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e56ccbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e56ccbf0 --- syscall (57, FreeBSD ELF64, sys_symlink), rip = 0x8002f675a, rsp = 0x7fffffffe458, rbp = 0x7fffffffe500 --- Tracing command mkdir pid 68220 tid 100389 td 0xfffff801850fa6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00addea2a0 mi_switch() at mi_switch+0x164/frame 0xfffffe00addea2e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addea320 sleeplk() at sleeplk+0x107/frame 0xfffffe00addea380 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x225/frame 0xfffffe00addea440 __lockmgr_args() at __lockmgr_args+0x62c/frame 0xfffffe00addea500 getblkx() at getblkx+0x15f/frame 0xfffffe00addea5e0 breadn_flags() at breadn_flags+0x44/frame 0xfffffe00addea650 ffs_update() at ffs_update+0x138/frame 0xfffffe00addea6e0 ufs_mkdir() at ufs_mkdir+0x810/frame 0xfffffe00addea880 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x60/frame 0xfffffe00addea8a0 kern_mkdirat() at kern_mkdirat+0x1b3/frame 0xfffffe00addeaac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00addeabf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00addeabf0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x80043032a, rsp = 0x7fffffff2cc8, rbp = 0x7fffffff30f0 --- Tracing command swap pid 68218 tid 100262 td 0xfffff8014f87d000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e624fb50 mi_switch() at mi_switch+0x164/frame 0xfffffe00e624fb90 sched_preempt() at sched_preempt+0x86/frame 0xfffffe00e624fbc0 ipi_bitmap_handler() at ipi_bitmap_handler+0x64/frame 0xfffffe00e624fbf0 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0xb3/frame 0xfffffe00e624fbf0 --- interrupt, rip = 0x203689, rsp = 0x7fffffffe4e0, rbp = 0x7fffffffe500 --- Tracing command symlink pid 68217 tid 100179 td 0xfffff8001d811000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e566a1c0 mi_switch() at mi_switch+0x164/frame 0xfffffe00e566a200 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e566a240 sleeplk() at sleeplk+0x107/frame 0xfffffe00e566a2a0 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x225/frame 0xfffffe00e566a360 __lockmgr_args() at __lockmgr_args+0x62c/frame 0xfffffe00e566a420 getblkx() at getblkx+0x15f/frame 0xfffffe00e566a500 breadn_flags() at breadn_flags+0x44/frame 0xfffffe00e566a570 ffs_update() at ffs_update+0x138/frame 0xfffffe00e566a600 ufs_direnter() at ufs_direnter+0x7e5/frame 0xfffffe00e566a6c0 ufs_makeinode() at ufs_makeinode+0x60c/frame 0xfffffe00e566a850 ufs_symlink() at ufs_symlink+0x36/frame 0xfffffe00e566a880 VOP_SYMLINK_APV() at VOP_SYMLINK_APV+0x60/frame 0xfffffe00e566a8a0 kern_symlinkat() at kern_symlinkat+0x21a/frame 0xfffffe00e566aac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e566abf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e566abf0 --- syscall (57, FreeBSD ELF64, sys_symlink), rip = 0x8002f675a, rsp = 0x7fffffffe458, rbp = 0x7fffffffe500 --- Tracing command mkdir pid 68216 tid 100322 td 0xfffff801a52df000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e63ab3f0 mi_switch() at mi_switch+0x164/frame 0xfffffe00e63ab430 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e63ab470 sleeplk() at sleeplk+0x107/frame 0xfffffe00e63ab4d0 lockmgr_slock_hard() at lockmgr_slock_hard+0x1d6/frame 0xfffffe00e63ab580 __lockmgr_args() at __lockmgr_args+0x798/frame 0xfffffe00e63ab640 ffs_lock() at ffs_lock+0x7c/frame 0xfffffe00e63ab690 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x48/frame 0xfffffe00e63ab6b0 _vn_lock() at _vn_lock+0x4f/frame 0xfffffe00e63ab710 lookup() at lookup+0xe1/frame 0xfffffe00e63ab7b0 namei() at namei+0x4f1/frame 0xfffffe00e63ab8a0 kern_mkdirat() at kern_mkdirat+0x92/frame 0xfffffe00e63abac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e63abbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e63abbf0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x80043032a, rsp = 0x7fffffffdca8, rbp = 0x7fffffffe0d0 --- Tracing command swap pid 68214 tid 100266 td 0xfffff8014fcc6000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e6293a90 mi_switch() at mi_switch+0x164/frame 0xfffffe00e6293ad0 sched_preempt() at sched_preempt+0x86/frame 0xfffffe00e6293b00 ipi_bitmap_handler() at ipi_bitmap_handler+0x64/frame 0xfffffe00e6293b30 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0xb3/frame 0xfffffe00e6293b30 --- interrupt, rip = 0xffffffff8104d3b4, rsp = 0xfffffe00e6293c00, rbp = 0x7fffffffe500 --- doreti_ast() at doreti_ast+0x1a/frame 0x7fffffffe500 Tracing command link pid 68213 tid 100367 td 0xfffff801bfec16e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e7490b60 mi_switch() at mi_switch+0x164/frame 0xfffffe00e7490ba0 ast() at ast+0x299/frame 0xfffffe00e7490bf0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe500 Tracing command symlink pid 68212 tid 100276 td 0xfffff8014fa2e000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e62c51c0 mi_switch() at mi_switch+0x164/frame 0xfffffe00e62c5200 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e62c5240 sleeplk() at sleeplk+0x107/frame 0xfffffe00e62c52a0 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x225/frame 0xfffffe00e62c5360 __lockmgr_args() at __lockmgr_args+0x62c/frame 0xfffffe00e62c5420 getblkx() at getblkx+0x15f/frame 0xfffffe00e62c5500 breadn_flags() at breadn_flags+0x44/frame 0xfffffe00e62c5570 ffs_update() at ffs_update+0x138/frame 0xfffffe00e62c5600 ufs_direnter() at ufs_direnter+0x7e5/frame 0xfffffe00e62c56c0 ufs_makeinode() at ufs_makeinode+0x60c/frame 0xfffffe00e62c5850 ufs_symlink() at ufs_symlink+0x36/frame 0xfffffe00e62c5880 VOP_SYMLINK_APV() at VOP_SYMLINK_APV+0x60/frame 0xfffffe00e62c58a0 kern_symlinkat() at kern_symlinkat+0x21a/frame 0xfffffe00e62c5ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e62c5bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e62c5bf0 --- syscall (57, FreeBSD ELF64, sys_symlink), rip = 0x8002f675a, rsp = 0x7fffffffe458, rbp = 0x7fffffffe500 --- Tracing command mkdir pid 68211 tid 100355 td 0xfffff80842e62000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e7453fa0 mi_switch() at mi_switch+0x164/frame 0xfffffe00e7453fe0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e7454020 sleeplk() at sleeplk+0x107/frame 0xfffffe00e7454080 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x225/frame 0xfffffe00e7454140 __lockmgr_args() at __lockmgr_args+0x62c/frame 0xfffffe00e7454200 getblkx() at getblkx+0x15f/frame 0xfffffe00e74542e0 breadn_flags() at breadn_flags+0x44/frame 0xfffffe00e7454350 ffs_getcg() at ffs_getcg+0xd7/frame 0xfffffe00e74543d0 ffs_alloccg() at ffs_alloccg+0x94/frame 0xfffffe00e7454460 ffs_hashalloc() at ffs_hashalloc+0x79/frame 0xfffffe00e74544b0 ffs_alloc() at ffs_alloc+0x1ee/frame 0xfffffe00e7454530 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xcd3/frame 0xfffffe00e74546e0 ufs_mkdir() at ufs_mkdir+0x701/frame 0xfffffe00e7454880 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x60/frame 0xfffffe00e74548a0 kern_mkdirat() at kern_mkdirat+0x1b3/frame 0xfffffe00e7454ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e7454bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e7454bf0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x80043032a, rsp = 0x7fffffff3d88, rbp = 0x7fffffff41b0 --- Tracing command fts pid 68209 tid 100420 td 0xfffff80488f3a000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e75263f0 mi_switch() at mi_switch+0x164/frame 0xfffffe00e7526430 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e7526470 sleeplk() at sleeplk+0x107/frame 0xfffffe00e75264d0 lockmgr_slock_hard() at lockmgr_slock_hard+0x1d6/frame 0xfffffe00e7526580 __lockmgr_args() at __lockmgr_args+0x798/frame 0xfffffe00e7526640 ffs_lock() at ffs_lock+0x7c/frame 0xfffffe00e7526690 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x48/frame 0xfffffe00e75266b0 _vn_lock() at _vn_lock+0x4f/frame 0xfffffe00e7526710 lookup() at lookup+0xe1/frame 0xfffffe00e75267b0 namei() at namei+0x4f1/frame 0xfffffe00e75268a0 kern_statat() at kern_statat+0x7f/frame 0xfffffe00e75269c0 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00e7526ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e7526bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e7526bf0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x80043017a, rsp = 0x7fffffffe1e8, rbp = 0x7fffffffe2a0 --- Tracing command rw pid 68208 tid 100482 td 0xfffff8023e8096e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e7657200 mi_switch() at mi_switch+0x164/frame 0xfffffe00e7657240 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e7657280 _sleep() at _sleep+0x2cd/frame 0xfffffe00e7657320 bufwait() at bufwait+0xc4/frame 0xfffffe00e7657360 softdep_request_cleanup() at softdep_request_cleanup+0x282/frame 0xfffffe00e76573f0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xb4b/frame 0xfffffe00e7657590 ffs_write() at ffs_write+0x21b/frame 0xfffffe00e7657630 VOP_WRITE_APV() at VOP_WRITE_APV+0xda/frame 0xfffffe00e7657740 vn_write() at vn_write+0x27a/frame 0xfffffe00e76577c0 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00e7657820 vn_io_fault1() at vn_io_fault1+0x16c/frame 0xfffffe00e7657970 vn_io_fault() at vn_io_fault+0x182/frame 0xfffffe00e76579e0 dofilewrite() at dofilewrite+0x81/frame 0xfffffe00e7657a30 kern_writev() at kern_writev+0x49/frame 0xfffffe00e7657a70 sys_write() at sys_write+0x83/frame 0xfffffe00e7657ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e7657bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e7657bf0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800434eca, rsp = 0x7fffffffd448, rbp = 0x7fffffffe500 --- Tracing command swap pid 68207 tid 100236 td 0xfffff8014f7c36e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e57cab50 mi_switch() at mi_switch+0x164/frame 0xfffffe00e57cab90 sched_preempt() at sched_preempt+0x86/frame 0xfffffe00e57cabc0 ipi_bitmap_handler() at ipi_bitmap_handler+0x64/frame 0xfffffe00e57cabf0 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0xb3/frame 0xfffffe00e57cabf0 --- interrupt, rip = 0x203687, rsp = 0x7fffffffe4e0, rbp = 0x7fffffffe500 --- Tracing command link pid 68206 tid 100522 td 0xfffff803bc7e7000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e7772620 mi_switch() at mi_switch+0x164/frame 0xfffffe00e7772660 __mtx_lock_sleep() at __mtx_lock_sleep+0x1f4/frame 0xfffffe00e7772710 __mtx_lock_flags() at __mtx_lock_flags+0xea/frame 0xfffffe00e7772760 vlazy() at vlazy+0x48/frame 0xfffffe00e7772790 ufs_dirremove() at ufs_dirremove+0x41/frame 0xfffffe00e77727e0 ufs_remove() at ufs_remove+0x75/frame 0xfffffe00e7772840 VOP_REMOVE_APV() at VOP_REMOVE_APV+0x80/frame 0xfffffe00e7772860 kern_funlinkat() at kern_funlinkat+0x2be/frame 0xfffffe00e7772aa0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe00e7772ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e7772bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e7772bf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80042c91a, rsp = 0x7fffffffe3c8, rbp = 0x7fffffffe500 --- Tracing command creat pid 68205 tid 100285 td 0xfffff8014febb6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e62f2070 mi_switch() at mi_switch+0x164/frame 0xfffffe00e62f20b0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e62f20f0 sleeplk() at sleeplk+0x107/frame 0xfffffe00e62f2150 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x225/frame 0xfffffe00e62f2210 __lockmgr_args() at __lockmgr_args+0x62c/frame 0xfffffe00e62f22d0 getblkx() at getblkx+0x15f/frame 0xfffffe00e62f23b0 breadn_flags() at breadn_flags+0x44/frame 0xfffffe00e62f2420 ffs_getcg() at ffs_getcg+0xd7/frame 0xfffffe00e62f24a0 ffs_nodealloccg() at ffs_nodealloccg+0xa1/frame 0xfffffe00e62f2540 ffs_hashalloc() at ffs_hashalloc+0x10c/frame 0xfffffe00e62f2590 ffs_valloc() at ffs_valloc+0x474/frame 0xfffffe00e62f2630 ufs_makeinode() at ufs_makeinode+0xad/frame 0xfffffe00e62f27c0 ufs_create() at ufs_create+0x34/frame 0xfffffe00e62f27e0 VOP_CREATE_APV() at VOP_CREATE_APV+0x5d/frame 0xfffffe00e62f2800 vn_open_cred() at vn_open_cred+0x36c/frame 0xfffffe00e62f2950 kern_openat() at kern_openat+0x1f3/frame 0xfffffe00e62f2ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e62f2bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e62f2bf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8004302ca, rsp = 0x7fffffffe458, rbp = 0x7fffffffe500 --- Tracing command symlink pid 68204 tid 100171 td 0xfffff8001d80f6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e56421c0 mi_switch() at mi_switch+0x164/frame 0xfffffe00e5642200 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e5642240 sleeplk() at sleeplk+0x107/frame 0xfffffe00e56422a0 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x225/frame 0xfffffe00e5642360 __lockmgr_args() at __lockmgr_args+0x62c/frame 0xfffffe00e5642420 getblkx() at getblkx+0x15f/frame 0xfffffe00e5642500 breadn_flags() at breadn_flags+0x44/frame 0xfffffe00e5642570 ffs_update() at ffs_update+0x138/frame 0xfffffe00e5642600 ufs_direnter() at ufs_direnter+0x7e5/frame 0xfffffe00e56426c0 ufs_makeinode() at ufs_makeinode+0x60c/frame 0xfffffe00e5642850 ufs_symlink() at ufs_symlink+0x36/frame 0xfffffe00e5642880 VOP_SYMLINK_APV() at VOP_SYMLINK_APV+0x60/frame 0xfffffe00e56428a0 kern_symlinkat() at kern_symlinkat+0x21a/frame 0xfffffe00e5642ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e5642bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5642bf0 --- syscall (57, FreeBSD ELF64, sys_symlink), rip = 0x8002f675a, rsp = 0x7fffffffe458, rbp = 0x7fffffffe500 --- Tracing command mkdir pid 68203 tid 100386 td 0xfffff80488ea06e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00adddafa0 mi_switch() at mi_switch+0x164/frame 0xfffffe00adddafe0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00adddb020 sleeplk() at sleeplk+0x107/frame 0xfffffe00adddb080 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x225/frame 0xfffffe00adddb140 __lockmgr_args() at __lockmgr_args+0x62c/frame 0xfffffe00adddb200 getblkx() at getblkx+0x15f/frame 0xfffffe00adddb2e0 breadn_flags() at breadn_flags+0x44/frame 0xfffffe00adddb350 ffs_getcg() at ffs_getcg+0xd7/frame 0xfffffe00adddb3d0 ffs_alloccg() at ffs_alloccg+0x94/frame 0xfffffe00adddb460 ffs_hashalloc() at ffs_hashalloc+0x79/frame 0xfffffe00adddb4b0 ffs_alloc() at ffs_alloc+0x1ee/frame 0xfffffe00adddb530 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xcd3/frame 0xfffffe00adddb6e0 ufs_mkdir() at ufs_mkdir+0x701/frame 0xfffffe00adddb880 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x60/frame 0xfffffe00adddb8a0 kern_mkdirat() at kern_mkdirat+0x1b3/frame 0xfffffe00adddbac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00adddbbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00adddbbf0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x80043032a, rsp = 0x7fffffffb2c8, rbp = 0x7fffffffb6f0 --- Tracing command rw pid 68202 tid 100326 td 0xfffff801a52b6000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e63bf200 mi_switch() at mi_switch+0x164/frame 0xfffffe00e63bf240 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e63bf280 _sleep() at _sleep+0x2cd/frame 0xfffffe00e63bf320 bufwait() at bufwait+0xc4/frame 0xfffffe00e63bf360 softdep_request_cleanup() at softdep_request_cleanup+0x282/frame 0xfffffe00e63bf3f0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xb4b/frame 0xfffffe00e63bf590 ffs_write() at ffs_write+0x21b/frame 0xfffffe00e63bf630 VOP_WRITE_APV() at VOP_WRITE_APV+0xda/frame 0xfffffe00e63bf740 vn_write() at vn_write+0x27a/frame 0xfffffe00e63bf7c0 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00e63bf820 vn_io_fault1() at vn_io_fault1+0x16c/frame 0xfffffe00e63bf970 vn_io_fault() at vn_io_fault+0x182/frame 0xfffffe00e63bf9e0 dofilewrite() at dofilewrite+0x81/frame 0xfffffe00e63bfa30 kern_writev() at kern_writev+0x49/frame 0xfffffe00e63bfa70 sys_write() at sys_write+0x83/frame 0xfffffe00e63bfac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e63bfbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e63bfbf0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800434eca, rsp = 0x7fffffffd448, rbp = 0x7fffffffe500 --- Tracing command fts pid 68201 tid 100477 td 0xfffff8040eb0f6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e763e3f0 mi_switch() at mi_switch+0x164/frame 0xfffffe00e763e430 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e763e470 sleeplk() at sleeplk+0x107/frame 0xfffffe00e763e4d0 lockmgr_slock_hard() at lockmgr_slock_hard+0x1d6/frame 0xfffffe00e763e580 __lockmgr_args() at __lockmgr_args+0x798/frame 0xfffffe00e763e640 ffs_lock() at ffs_lock+0x7c/frame 0xfffffe00e763e690 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x48/frame 0xfffffe00e763e6b0 _vn_lock() at _vn_lock+0x4f/frame 0xfffffe00e763e710 lookup() at lookup+0xe1/frame 0xfffffe00e763e7b0 namei() at namei+0x4f1/frame 0xfffffe00e763e8a0 kern_statat() at kern_statat+0x7f/frame 0xfffffe00e763e9c0 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00e763eac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e763ebf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e763ebf0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x80043017a, rsp = 0x7fffffffe1e8, rbp = 0x7fffffffe2a0 --- Tracing command link pid 68200 tid 100483 td 0xfffff8023e809000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e765cb60 mi_switch() at mi_switch+0x164/frame 0xfffffe00e765cba0 ast() at ast+0x299/frame 0xfffffe00e765cbf0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe500 Tracing command symlink pid 68199 tid 100408 td 0xfffff8046af4d000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e74ea1c0 mi_switch() at mi_switch+0x164/frame 0xfffffe00e74ea200 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e74ea240 sleeplk() at sleeplk+0x107/frame 0xfffffe00e74ea2a0 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x225/frame 0xfffffe00e74ea360 __lockmgr_args() at __lockmgr_args+0x62c/frame 0xfffffe00e74ea420 getblkx() at getblkx+0x15f/frame 0xfffffe00e74ea500 breadn_flags() at breadn_flags+0x44/frame 0xfffffe00e74ea570 ffs_update() at ffs_update+0x138/frame 0xfffffe00e74ea600 ufs_direnter() at ufs_direnter+0x7e5/frame 0xfffffe00e74ea6c0 ufs_makeinode() at ufs_makeinode+0x60c/frame 0xfffffe00e74ea850 ufs_symlink() at ufs_symlink+0x36/frame 0xfffffe00e74ea880 VOP_SYMLINK_APV() at VOP_SYMLINK_APV+0x60/frame 0xfffffe00e74ea8a0 kern_symlinkat() at kern_symlinkat+0x21a/frame 0xfffffe00e74eaac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e74eabf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e74eabf0 --- syscall (57, FreeBSD ELF64, sys_symlink), rip = 0x8002f675a, rsp = 0x7fffffffe458, rbp = 0x7fffffffe500 --- Tracing command swap pid 68198 tid 100513 td 0xfffff8032170b000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e76a6b60 mi_switch() at mi_switch+0x164/frame 0xfffffe00e76a6ba0 ast() at ast+0x299/frame 0xfffffe00e76a6bf0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe500 Tracing command creat pid 68196 tid 100384 td 0xfffff8014fcd2000 (CPU 0) cpustop_handler() at cpustop_handler+0x2a/frame 0xffffffff81d86400 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xffffffff81d86420 trap() at trap+0x61/frame 0xffffffff81d86550 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81d86550 --- trap 0x13, rip = 0xffffffff80c15152, rsp = 0xfffffe00addd12f0, rbp = 0xfffffe00addd1300 --- lock_delay() at lock_delay+0x32/frame 0xfffffe00addd1300 __rw_wlock_hard() at __rw_wlock_hard+0x1b8/frame 0xfffffe00addd13d0 _rw_wlock_cookie() at _rw_wlock_cookie+0xbc/frame 0xfffffe00addd1410 workitem_alloc() at workitem_alloc+0xa1/frame 0xfffffe00addd1440 softdep_setup_inomapdep() at softdep_setup_inomapdep+0x138/frame 0xfffffe00addd14a0 ffs_nodealloccg() at ffs_nodealloccg+0x56c/frame 0xfffffe00addd1540 ffs_hashalloc() at ffs_hashalloc+0x10c/frame 0xfffffe00addd1590 ffs_valloc() at ffs_valloc+0x474/frame 0xfffffe00addd1630 ufs_makeinode() at ufs_makeinode+0xad/frame 0xfffffe00addd17c0 ufs_create() at ufs_create+0x34/frame 0xfffffe00addd17e0 VOP_CREATE_APV() at VOP_CREATE_APV+0x5d/frame 0xfffffe00addd1800 vn_open_cred() at vn_open_cred+0x36c/frame 0xfffffe00addd1950 kern_openat() at kern_openat+0x1f3/frame 0xfffffe00addd1ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00addd1bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00addd1bf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8004302ca, rsp = 0x7fffffffe458, rbp = 0x7fffffffe500 --- Tracing command mkdir pid 68195 tid 100277 td 0xfffff8014fa356e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e62ca200 mi_switch() at mi_switch+0x164/frame 0xfffffe00e62ca240 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e62ca280 sleeplk() at sleeplk+0x107/frame 0xfffffe00e62ca2e0 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x225/frame 0xfffffe00e62ca3a0 __lockmgr_args() at __lockmgr_args+0x62c/frame 0xfffffe00e62ca460 ffs_lock() at ffs_lock+0x7c/frame 0xfffffe00e62ca4b0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x48/frame 0xfffffe00e62ca4d0 _vn_lock() at _vn_lock+0x4f/frame 0xfffffe00e62ca530 vget_finish() at vget_finish+0x81/frame 0xfffffe00e62ca560 vfs_hash_get() at vfs_hash_get+0xbf/frame 0xfffffe00e62ca5b0 ffs_vgetf() at ffs_vgetf+0x59/frame 0xfffffe00e62ca640 ffs_valloc() at ffs_valloc+0x591/frame 0xfffffe00e62ca6e0 ufs_mkdir() at ufs_mkdir+0xcc/frame 0xfffffe00e62ca880 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x60/frame 0xfffffe00e62ca8a0 kern_mkdirat() at kern_mkdirat+0x1b3/frame 0xfffffe00e62caac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e62cabf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e62cabf0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x80043032a, rsp = 0x7fffffff8d18, rbp = 0x7fffffff9140 --- Tracing command fts pid 68194 tid 100382 td 0xfffff801a54ac000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e56883f0 mi_switch() at mi_switch+0x164/frame 0xfffffe00e5688430 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e5688470 sleeplk() at sleeplk+0x107/frame 0xfffffe00e56884d0 lockmgr_slock_hard() at lockmgr_slock_hard+0x1d6/frame 0xfffffe00e5688580 __lockmgr_args() at __lockmgr_args+0x798/frame 0xfffffe00e5688640 ffs_lock() at ffs_lock+0x7c/frame 0xfffffe00e5688690 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x48/frame 0xfffffe00e56886b0 _vn_lock() at _vn_lock+0x4f/frame 0xfffffe00e5688710 lookup() at lookup+0xe1/frame 0xfffffe00e56887b0 namei() at namei+0x4f1/frame 0xfffffe00e56888a0 kern_statat() at kern_statat+0x7f/frame 0xfffffe00e56889c0 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00e5688ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e5688bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5688bf0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x80043017a, rsp = 0x7fffffffe1e8, rbp = 0x7fffffffe2a0 --- Tracing command link pid 68193 tid 100255 td 0xfffff8014fb4e000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e622c520 mi_switch() at mi_switch+0x164/frame 0xfffffe00e622c560 __rw_wlock_hard() at __rw_wlock_hard+0x4b4/frame 0xfffffe00e622c630 _rw_wlock_cookie() at _rw_wlock_cookie+0xbc/frame 0xfffffe00e622c670 workitem_alloc() at workitem_alloc+0xa1/frame 0xfffffe00e622c6a0 newdirrem() at newdirrem+0x169/frame 0xfffffe00e622c750 softdep_setup_remove() at softdep_setup_remove+0x3c/frame 0xfffffe00e622c790 ufs_dirremove() at ufs_dirremove+0x1f9/frame 0xfffffe00e622c7e0 ufs_remove() at ufs_remove+0x75/frame 0xfffffe00e622c840 VOP_REMOVE_APV() at VOP_REMOVE_APV+0x80/frame 0xfffffe00e622c860 kern_funlinkat() at kern_funlinkat+0x2be/frame 0xfffffe00e622caa0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe00e622cac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e622cbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e622cbf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80042c91a, rsp = 0x7fffffffe3c8, rbp = 0x7fffffffe500 --- Tracing command rw pid 68192 tid 100342 td 0xfffff801a54ab000 (CPU 1) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e173dd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e173df0 trap() at trap+0x61/frame 0xfffffe003e173f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e173f20 --- trap 0x13, rip = 0xffffffff80f0fdf7, rsp = 0xfffffe00e7413760, rbp = 0xfffffe00e7413790 --- uma_dbg_free() at uma_dbg_free+0x97/frame 0xfffffe00e7413790 uma_zfree_arg() at uma_zfree_arg+0x95/frame 0xfffffe00e74137f0 free() at free+0x91/frame 0xfffffe00e7413820 vn_io_fault1() at vn_io_fault1+0x37f/frame 0xfffffe00e7413970 vn_io_fault() at vn_io_fault+0x182/frame 0xfffffe00e74139e0 dofileread() at dofileread+0x81/frame 0xfffffe00e7413a30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e7413a70 sys_read() at sys_read+0x83/frame 0xfffffe00e7413ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e7413bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e7413bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800434f0a, rsp = 0x7fffffffd448, rbp = 0x7fffffffe500 --- Tracing command creat pid 68190 tid 100246 td 0xfffff8014fa2e6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e57fc070 mi_switch() at mi_switch+0x164/frame 0xfffffe00e57fc0b0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e57fc0f0 sleeplk() at sleeplk+0x107/frame 0xfffffe00e57fc150 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x225/frame 0xfffffe00e57fc210 __lockmgr_args() at __lockmgr_args+0x62c/frame 0xfffffe00e57fc2d0 getblkx() at getblkx+0x15f/frame 0xfffffe00e57fc3b0 breadn_flags() at breadn_flags+0x44/frame 0xfffffe00e57fc420 ffs_getcg() at ffs_getcg+0xd7/frame 0xfffffe00e57fc4a0 ffs_nodealloccg() at ffs_nodealloccg+0xa1/frame 0xfffffe00e57fc540 ffs_hashalloc() at ffs_hashalloc+0x10c/frame 0xfffffe00e57fc590 ffs_valloc() at ffs_valloc+0x474/frame 0xfffffe00e57fc630 ufs_makeinode() at ufs_makeinode+0xad/frame 0xfffffe00e57fc7c0 ufs_create() at ufs_create+0x34/frame 0xfffffe00e57fc7e0 VOP_CREATE_APV() at VOP_CREATE_APV+0x5d/frame 0xfffffe00e57fc800 vn_open_cred() at vn_open_cred+0x36c/frame 0xfffffe00e57fc950 kern_openat() at kern_openat+0x1f3/frame 0xfffffe00e57fcac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e57fcbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e57fcbf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8004302ca, rsp = 0x7fffffffe458, rbp = 0x7fffffffe500 --- Tracing command symlink pid 68189 tid 100487 td 0xfffff806f2967000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e76701c0 mi_switch() at mi_switch+0x164/frame 0xfffffe00e7670200 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e7670240 sleeplk() at sleeplk+0x107/frame 0xfffffe00e76702a0 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x225/frame 0xfffffe00e7670360 __lockmgr_args() at __lockmgr_args+0x62c/frame 0xfffffe00e7670420 getblkx() at getblkx+0x15f/frame 0xfffffe00e7670500 breadn_flags() at breadn_flags+0x44/frame 0xfffffe00e7670570 ffs_vgetf() at ffs_vgetf+0x340/frame 0xfffffe00e7670620 ffs_valloc() at ffs_valloc+0x591/frame 0xfffffe00e76706c0 ufs_makeinode() at ufs_makeinode+0xad/frame 0xfffffe00e7670850 ufs_symlink() at ufs_symlink+0x36/frame 0xfffffe00e7670880 VOP_SYMLINK_APV() at VOP_SYMLINK_APV+0x60/frame 0xfffffe00e76708a0 kern_symlinkat() at kern_symlinkat+0x21a/frame 0xfffffe00e7670ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e7670bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e7670bf0 --- syscall (57, FreeBSD ELF64, sys_symlink), rip = 0x8002f675a, rsp = 0x7fffffffe458, rbp = 0x7fffffffe500 --- Tracing command mkdir pid 68188 tid 100508 td 0xfffff801850f9000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e76c4430 mi_switch() at mi_switch+0x164/frame 0xfffffe00e76c4470 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e76c44b0 sleeplk() at sleeplk+0x107/frame 0xfffffe00e76c4510 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x225/frame 0xfffffe00e76c45d0 __lockmgr_args() at __lockmgr_args+0x62c/frame 0xfffffe00e76c4690 getblkx() at getblkx+0x15f/frame 0xfffffe00e76c4770 breadn_flags() at breadn_flags+0x44/frame 0xfffffe00e76c47e0 ffs_update() at ffs_update+0x138/frame 0xfffffe00e76c4870 ufs_inactive() at ufs_inactive+0x2d7/frame 0xfffffe00e76c48b0 VOP_INACTIVE_APV() at VOP_INACTIVE_APV+0x60/frame 0xfffffe00e76c48d0 vinactivef() at vinactivef+0xf4/frame 0xfffffe00e76c4920 vputx() at vputx+0x300/frame 0xfffffe00e76c4980 kern_chdir() at kern_chdir+0x12d/frame 0xfffffe00e76c4ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e76c4bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e76c4bf0 --- syscall (12, FreeBSD ELF64, sys_chdir), rip = 0x8002f699a, rsp = 0x7fffffff56a8, rbp = 0x7fffffff5ad0 --- Tracing command swap pid 68187 tid 100473 td 0xfffff801ea4a7000 (CPU 5) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1a3dd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1a3df0 trap() at trap+0x61/frame 0xfffffe003e1a3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1a3f20 --- trap 0x13, rip = 0x203689, rsp = 0x7fffffffe4e0, rbp = 0x7fffffffe500 --- Tracing command fts pid 68186 tid 100288 td 0xfffff8003fd9a6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e63013f0 mi_switch() at mi_switch+0x164/frame 0xfffffe00e6301430 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e6301470 sleeplk() at sleeplk+0x107/frame 0xfffffe00e63014d0 lockmgr_slock_hard() at lockmgr_slock_hard+0x1d6/frame 0xfffffe00e6301580 __lockmgr_args() at __lockmgr_args+0x798/frame 0xfffffe00e6301640 ffs_lock() at ffs_lock+0x7c/frame 0xfffffe00e6301690 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x48/frame 0xfffffe00e63016b0 _vn_lock() at _vn_lock+0x4f/frame 0xfffffe00e6301710 lookup() at lookup+0xe1/frame 0xfffffe00e63017b0 namei() at namei+0x4f1/frame 0xfffffe00e63018a0 kern_statat() at kern_statat+0x7f/frame 0xfffffe00e63019c0 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00e6301ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e6301bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e6301bf0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x80043017a, rsp = 0x7fffffffe1e8, rbp = 0x7fffffffe2a0 --- Tracing command link pid 68185 tid 100451 td 0xfffff80545568000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e75bc290 mi_switch() at mi_switch+0x164/frame 0xfffffe00e75bc2d0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e75bc310 sleeplk() at sleeplk+0x107/frame 0xfffffe00e75bc370 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x225/frame 0xfffffe00e75bc430 __lockmgr_args() at __lockmgr_args+0x62c/frame 0xfffffe00e75bc4f0 getblkx() at getblkx+0x15f/frame 0xfffffe00e75bc5d0 breadn_flags() at breadn_flags+0x44/frame 0xfffffe00e75bc640 ffs_update() at ffs_update+0x138/frame 0xfffffe00e75bc6d0 handle_workitem_remove() at handle_workitem_remove+0x489/frame 0xfffffe00e75bc750 softdep_setup_remove() at softdep_setup_remove+0x203/frame 0xfffffe00e75bc790 ufs_dirremove() at ufs_dirremove+0x1f9/frame 0xfffffe00e75bc7e0 ufs_remove() at ufs_remove+0x75/frame 0xfffffe00e75bc840 VOP_REMOVE_APV() at VOP_REMOVE_APV+0x80/frame 0xfffffe00e75bc860 kern_funlinkat() at kern_funlinkat+0x2be/frame 0xfffffe00e75bcaa0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe00e75bcac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e75bcbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e75bcbf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80042c91a, rsp = 0x7fffffffe3c8, rbp = 0x7fffffffe500 --- Tracing command rw pid 68184 tid 100149 td 0xfffff8001d6f06e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e37c4ee0 mi_switch() at mi_switch+0x164/frame 0xfffffe00e37c4f20 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e37c4f60 sleeplk() at sleeplk+0x107/frame 0xfffffe00e37c4fc0 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x225/frame 0xfffffe00e37c5080 __lockmgr_args() at __lockmgr_args+0x62c/frame 0xfffffe00e37c5140 getblkx() at getblkx+0x15f/frame 0xfffffe00e37c5220 breadn_flags() at breadn_flags+0x44/frame 0xfffffe00e37c5290 ffs_getcg() at ffs_getcg+0xd7/frame 0xfffffe00e37c5310 ffs_checkblk() at ffs_checkblk+0x6c/frame 0xfffffe00e37c5350 ffs_reallocblks() at ffs_reallocblks+0xc0f/frame 0xfffffe00e37c54a0 VOP_REALLOCBLKS_APV() at VOP_REALLOCBLKS_APV+0x60/frame 0xfffffe00e37c54c0 cluster_write() at cluster_write+0x598/frame 0xfffffe00e37c5590 ffs_write() at ffs_write+0x445/frame 0xfffffe00e37c5630 VOP_WRITE_APV() at VOP_WRITE_APV+0xda/frame 0xfffffe00e37c5740 vn_write() at vn_write+0x27a/frame 0xfffffe00e37c57c0 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00e37c5820 vn_io_fault1() at vn_io_fault1+0x16c/frame 0xfffffe00e37c5970 vn_io_fault() at vn_io_fault+0x182/frame 0xfffffe00e37c59e0 dofilewrite() at dofilewrite+0x81/frame 0xfffffe00e37c5a30 kern_writev() at kern_writev+0x49/frame 0xfffffe00e37c5a70 sys_write() at sys_write+0x83/frame 0xfffffe00e37c5ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e37c5bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e37c5bf0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800434eca, rsp = 0x7fffffffd448, rbp = 0x7fffffffe500 --- Tracing command mkdir pid 68183 tid 100385 td 0xfffff80842e636e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00addd62a0 mi_switch() at mi_switch+0x164/frame 0xfffffe00addd62e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addd6320 sleeplk() at sleeplk+0x107/frame 0xfffffe00addd6380 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x225/frame 0xfffffe00addd6440 __lockmgr_args() at __lockmgr_args+0x62c/frame 0xfffffe00addd6500 getblkx() at getblkx+0x15f/frame 0xfffffe00addd65e0 breadn_flags() at breadn_flags+0x44/frame 0xfffffe00addd6650 ffs_update() at ffs_update+0x138/frame 0xfffffe00addd66e0 ufs_mkdir() at ufs_mkdir+0x810/frame 0xfffffe00addd6880 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x60/frame 0xfffffe00addd68a0 kern_mkdirat() at kern_mkdirat+0x1b3/frame 0xfffffe00addd6ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00addd6bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00addd6bf0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x80043032a, rsp = 0x7fffffff13a8, rbp = 0x7fffffff17d0 --- Tracing command swap pid 68182 tid 100167 td 0xfffff800050f76e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e5622b60 mi_switch() at mi_switch+0x164/frame 0xfffffe00e5622ba0 ast() at ast+0x299/frame 0xfffffe00e5622bf0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe500 Tracing command fts pid 68181 tid 100239 td 0xfffff8014fb43000 (CPU 3) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e18bdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e18bdf0 trap() at trap+0x61/frame 0xfffffe003e18bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e18bf20 --- trap 0x13, rip = 0xffffffff80c34f6b, rsp = 0xfffffe00e57d9640, rbp = 0xfffffe00e57d96c0 --- witness_checkorder() at witness_checkorder+0x28b/frame 0xfffffe00e57d96c0 __mtx_lock_flags() at __mtx_lock_flags+0x94/frame 0xfffffe00e57d9710 vdropl() at vdropl+0x275/frame 0xfffffe00e57d9750 vputx() at vputx+0x1c9/frame 0xfffffe00e57d97b0 namei() at namei+0x66c/frame 0xfffffe00e57d98a0 kern_statat() at kern_statat+0x7f/frame 0xfffffe00e57d99c0 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00e57d9ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e57d9bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e57d9bf0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x80043017a, rsp = 0x7fffffffe1e8, rbp = 0x7fffffffe2a0 --- Tracing command link pid 68180 tid 100240 td 0xfffff8014fb2c6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e57de610 mi_switch() at mi_switch+0x164/frame 0xfffffe00e57de650 __rw_wlock_hard() at __rw_wlock_hard+0x4b4/frame 0xfffffe00e57de720 _rw_wlock_cookie() at _rw_wlock_cookie+0xbc/frame 0xfffffe00e57de760 softdep_slowdown() at softdep_slowdown+0x52/frame 0xfffffe00e57de790 ufs_dirremove() at ufs_dirremove+0x201/frame 0xfffffe00e57de7e0 ufs_remove() at ufs_remove+0x75/frame 0xfffffe00e57de840 VOP_REMOVE_APV() at VOP_REMOVE_APV+0x80/frame 0xfffffe00e57de860 kern_funlinkat() at kern_funlinkat+0x2be/frame 0xfffffe00e57deaa0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe00e57deac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e57debf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e57debf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80042c91a, rsp = 0x7fffffffe3c8, rbp = 0x7fffffffe500 --- Tracing command symlink pid 68179 tid 100316 td 0xfffff801a5159000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e638d1c0 mi_switch() at mi_switch+0x164/frame 0xfffffe00e638d200 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e638d240 sleeplk() at sleeplk+0x107/frame 0xfffffe00e638d2a0 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x225/frame 0xfffffe00e638d360 __lockmgr_args() at __lockmgr_args+0x62c/frame 0xfffffe00e638d420 getblkx() at getblkx+0x15f/frame 0xfffffe00e638d500 breadn_flags() at breadn_flags+0x44/frame 0xfffffe00e638d570 ffs_update() at ffs_update+0x138/frame 0xfffffe00e638d600 ufs_direnter() at ufs_direnter+0x7e5/frame 0xfffffe00e638d6c0 ufs_makeinode() at ufs_makeinode+0x60c/frame 0xfffffe00e638d850 ufs_symlink() at ufs_symlink+0x36/frame 0xfffffe00e638d880 VOP_SYMLINK_APV() at VOP_SYMLINK_APV+0x60/frame 0xfffffe00e638d8a0 kern_symlinkat() at kern_symlinkat+0x21a/frame 0xfffffe00e638dac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e638dbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e638dbf0 --- syscall (57, FreeBSD ELF64, sys_symlink), rip = 0x8002f675a, rsp = 0x7fffffffe458, rbp = 0x7fffffffe500 --- Tracing command creat pid 68177 tid 100325 td 0xfffff801a51ee6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e63ba1f0 mi_switch() at mi_switch+0x164/frame 0xfffffe00e63ba230 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e63ba270 sleeplk() at sleeplk+0x107/frame 0xfffffe00e63ba2d0 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x225/frame 0xfffffe00e63ba390 __lockmgr_args() at __lockmgr_args+0x62c/frame 0xfffffe00e63ba450 getblkx() at getblkx+0x15f/frame 0xfffffe00e63ba530 breadn_flags() at breadn_flags+0x44/frame 0xfffffe00e63ba5a0 ffs_update() at ffs_update+0x138/frame 0xfffffe00e63ba630 ufs_makeinode() at ufs_makeinode+0x34f/frame 0xfffffe00e63ba7c0 ufs_create() at ufs_create+0x34/frame 0xfffffe00e63ba7e0 VOP_CREATE_APV() at VOP_CREATE_APV+0x5d/frame 0xfffffe00e63ba800 vn_open_cred() at vn_open_cred+0x36c/frame 0xfffffe00e63ba950 kern_openat() at kern_openat+0x1f3/frame 0xfffffe00e63baac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e63babf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e63babf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8004302ca, rsp = 0x7fffffffe458, rbp = 0x7fffffffe500 --- Tracing command mkdir pid 68176 tid 100404 td 0xfffff8014fcd1000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e74d6210 mi_switch() at mi_switch+0x164/frame 0xfffffe00e74d6250 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e74d6290 _sleep() at _sleep+0x2cd/frame 0xfffffe00e74d6330 bufwait() at bufwait+0xc4/frame 0xfffffe00e74d6370 bufwrite() at bufwrite+0x258/frame 0xfffffe00e74d63c0 ffs_update() at ffs_update+0x2d2/frame 0xfffffe00e74d6420 softdep_request_cleanup() at softdep_request_cleanup+0xbc/frame 0xfffffe00e74d64b0 ffs_alloc() at ffs_alloc+0x25b/frame 0xfffffe00e74d6530 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xcd3/frame 0xfffffe00e74d66e0 ufs_mkdir() at ufs_mkdir+0x701/frame 0xfffffe00e74d6880 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x60/frame 0xfffffe00e74d68a0 kern_mkdirat() at kern_mkdirat+0x1b3/frame 0xfffffe00e74d6ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e74d6bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e74d6bf0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x80043032a, rsp = 0x7ffffffef658, rbp = 0x7ffffffefa80 --- Tracing command fts pid 68175 tid 100458 td 0xfffff8040eb0f000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e75df3f0 mi_switch() at mi_switch+0x164/frame 0xfffffe00e75df430 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e75df470 sleeplk() at sleeplk+0x107/frame 0xfffffe00e75df4d0 lockmgr_slock_hard() at lockmgr_slock_hard+0x1d6/frame 0xfffffe00e75df580 __lockmgr_args() at __lockmgr_args+0x798/frame 0xfffffe00e75df640 ffs_lock() at ffs_lock+0x7c/frame 0xfffffe00e75df690 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x48/frame 0xfffffe00e75df6b0 _vn_lock() at _vn_lock+0x4f/frame 0xfffffe00e75df710 lookup() at lookup+0xe1/frame 0xfffffe00e75df7b0 namei() at namei+0x4f1/frame 0xfffffe00e75df8a0 kern_statat() at kern_statat+0x7f/frame 0xfffffe00e75df9c0 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00e75dfac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e75dfbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e75dfbf0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x80043017a, rsp = 0x7fffffffe1e8, rbp = 0x7fffffffe2a0 --- Tracing command rw pid 68173 tid 100283 td 0xfffff8014fd556e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e62e7db0 mi_switch() at mi_switch+0x164/frame 0xfffffe00e62e7df0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e62e7e30 sleeplk() at sleeplk+0x107/frame 0xfffffe00e62e7e90 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x225/frame 0xfffffe00e62e7f50 __lockmgr_args() at __lockmgr_args+0x62c/frame 0xfffffe00e62e8010 getblkx() at getblkx+0x15f/frame 0xfffffe00e62e80f0 breadn_flags() at breadn_flags+0x44/frame 0xfffffe00e62e8160 ffs_getcg() at ffs_getcg+0xd7/frame 0xfffffe00e62e81e0 ffs_alloccg() at ffs_alloccg+0x94/frame 0xfffffe00e62e8270 ffs_hashalloc() at ffs_hashalloc+0x79/frame 0xfffffe00e62e82c0 ffs_realloccg() at ffs_realloccg+0x580/frame 0xfffffe00e62e83d0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0x57f/frame 0xfffffe00e62e8590 ffs_write() at ffs_write+0x21b/frame 0xfffffe00e62e8630 VOP_WRITE_APV() at VOP_WRITE_APV+0xda/frame 0xfffffe00e62e8740 vn_write() at vn_write+0x27a/frame 0xfffffe00e62e87c0 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00e62e8820 vn_io_fault1() at vn_io_fault1+0x16c/frame 0xfffffe00e62e8970 vn_io_fault() at vn_io_fault+0x182/frame 0xfffffe00e62e89e0 dofilewrite() at dofilewrite+0x81/frame 0xfffffe00e62e8a30 kern_writev() at kern_writev+0x49/frame 0xfffffe00e62e8a70 sys_write() at sys_write+0x83/frame 0xfffffe00e62e8ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e62e8bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e62e8bf0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800434eca, rsp = 0x7fffffffd448, rbp = 0x7fffffffe500 --- Tracing command symlink pid 68172 tid 100517 td 0xfffff80285002000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e76ba280 mi_switch() at mi_switch+0x164/frame 0xfffffe00e76ba2c0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e76ba300 sleeplk() at sleeplk+0x107/frame 0xfffffe00e76ba360 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x225/frame 0xfffffe00e76ba420 __lockmgr_args() at __lockmgr_args+0x62c/frame 0xfffffe00e76ba4e0 getblkx() at getblkx+0x15f/frame 0xfffffe00e76ba5c0 breadn_flags() at breadn_flags+0x44/frame 0xfffffe00e76ba630 ffs_update() at ffs_update+0x138/frame 0xfffffe00e76ba6c0 ufs_makeinode() at ufs_makeinode+0x34f/frame 0xfffffe00e76ba850 ufs_symlink() at ufs_symlink+0x36/frame 0xfffffe00e76ba880 VOP_SYMLINK_APV() at VOP_SYMLINK_APV+0x60/frame 0xfffffe00e76ba8a0 kern_symlinkat() at kern_symlinkat+0x21a/frame 0xfffffe00e76baac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e76babf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e76babf0 --- syscall (57, FreeBSD ELF64, sys_symlink), rip = 0x8002f675a, rsp = 0x7fffffffe458, rbp = 0x7fffffffe500 --- Tracing command link pid 68170 tid 100453 td 0xfffff8060bf99000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e75c6b60 mi_switch() at mi_switch+0x164/frame 0xfffffe00e75c6ba0 ast() at ast+0x299/frame 0xfffffe00e75c6bf0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe500 Tracing command creat pid 68169 tid 100474 td 0xfffff805b3f1c6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e762f130 mi_switch() at mi_switch+0x164/frame 0xfffffe00e762f170 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e762f1b0 sleeplk() at sleeplk+0x107/frame 0xfffffe00e762f210 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x225/frame 0xfffffe00e762f2d0 __lockmgr_args() at __lockmgr_args+0x62c/frame 0xfffffe00e762f390 getblkx() at getblkx+0x15f/frame 0xfffffe00e762f470 breadn_flags() at breadn_flags+0x44/frame 0xfffffe00e762f4e0 ffs_update() at ffs_update+0x138/frame 0xfffffe00e762f570 ufs_direnter() at ufs_direnter+0x7e5/frame 0xfffffe00e762f630 ufs_makeinode() at ufs_makeinode+0x60c/frame 0xfffffe00e762f7c0 ufs_create() at ufs_create+0x34/frame 0xfffffe00e762f7e0 VOP_CREATE_APV() at VOP_CREATE_APV+0x5d/frame 0xfffffe00e762f800 vn_open_cred() at vn_open_cred+0x36c/frame 0xfffffe00e762f950 kern_openat() at kern_openat+0x1f3/frame 0xfffffe00e762fac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e762fbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e762fbf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8004302ca, rsp = 0x7fffffffe458, rbp = 0x7fffffffe500 --- Tracing command mkdir pid 68168 tid 100289 td 0xfffff8003fd9a000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e6306180 mi_switch() at mi_switch+0x164/frame 0xfffffe00e63061c0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e6306200 sleeplk() at sleeplk+0x107/frame 0xfffffe00e6306260 lockmgr_slock_hard() at lockmgr_slock_hard+0x1d6/frame 0xfffffe00e6306310 __lockmgr_args() at __lockmgr_args+0x798/frame 0xfffffe00e63063d0 ffs_lock() at ffs_lock+0x7c/frame 0xfffffe00e6306420 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x48/frame 0xfffffe00e6306440 _vn_lock() at _vn_lock+0x4f/frame 0xfffffe00e63064a0 vget_finish() at vget_finish+0x81/frame 0xfffffe00e63064d0 vfs_hash_get() at vfs_hash_get+0xbf/frame 0xfffffe00e6306520 ffs_vgetf() at ffs_vgetf+0x59/frame 0xfffffe00e63065b0 vn_vget_ino_gen() at vn_vget_ino_gen+0x110/frame 0xfffffe00e6306620 vn_vget_ino() at vn_vget_ino+0x21/frame 0xfffffe00e6306640 ufs_lookup_ino() at ufs_lookup_ino+0x4be/frame 0xfffffe00e6306750 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0x5d/frame 0xfffffe00e6306770 vfs_cache_lookup() at vfs_cache_lookup+0xd2/frame 0xfffffe00e63067d0 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x5d/frame 0xfffffe00e63067f0 lookup() at lookup+0x611/frame 0xfffffe00e6306890 namei() at namei+0x4f1/frame 0xfffffe00e6306980 kern_chdir() at kern_chdir+0x4d/frame 0xfffffe00e6306ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e6306bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e6306bf0 --- syscall (12, FreeBSD ELF64, sys_chdir), rip = 0x8002f699a, rsp = 0x7fffffffdc98, rbp = 0x7fffffffe0d0 --- Tracing command rename pid 68167 tid 100409 td 0xfffff80479a146e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e74ef2f0 mi_switch() at mi_switch+0x164/frame 0xfffffe00e74ef330 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e74ef370 sleeplk() at sleeplk+0x107/frame 0xfffffe00e74ef3d0 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x225/frame 0xfffffe00e74ef490 lockmgr_upgrade() at lockmgr_upgrade+0x151/frame 0xfffffe00e74ef4e0 __lockmgr_args() at __lockmgr_args+0x6c4/frame 0xfffffe00e74ef5a0 ffs_lock() at ffs_lock+0x7c/frame 0xfffffe00e74ef5f0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x48/frame 0xfffffe00e74ef610 _vn_lock() at _vn_lock+0x4f/frame 0xfffffe00e74ef670 lookup() at lookup+0x51c/frame 0xfffffe00e74ef710 namei() at namei+0x4f1/frame 0xfffffe00e74ef800 vn_open_cred() at vn_open_cred+0xf1/frame 0xfffffe00e74ef950 kern_openat() at kern_openat+0x1f3/frame 0xfffffe00e74efac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e74efbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e74efbf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8004302ca, rsp = 0x7fffffffe2d8, rbp = 0x7fffffffe3c0 --- Tracing command fts pid 68166 tid 100281 td 0xfffff8014fe616e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e62de3f0 mi_switch() at mi_switch+0x164/frame 0xfffffe00e62de430 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e62de470 sleeplk() at sleeplk+0x107/frame 0xfffffe00e62de4d0 lockmgr_slock_hard() at lockmgr_slock_hard+0x1d6/frame 0xfffffe00e62de580 __lockmgr_args() at __lockmgr_args+0x798/frame 0xfffffe00e62de640 ffs_lock() at ffs_lock+0x7c/frame 0xfffffe00e62de690 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x48/frame 0xfffffe00e62de6b0 _vn_lock() at _vn_lock+0x4f/frame 0xfffffe00e62de710 lookup() at lookup+0xe1/frame 0xfffffe00e62de7b0 namei() at namei+0x4f1/frame 0xfffffe00e62de8a0 kern_statat() at kern_statat+0x7f/frame 0xfffffe00e62de9c0 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00e62deac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e62debf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e62debf0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x80043017a, rsp = 0x7fffffffe1e8, rbp = 0x7fffffffe2a0 --- Tracing command swap pid 68165 tid 100421 td 0xfffff803e2f15000 (CPU 2) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e17fdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e17fdf0 trap() at trap+0x61/frame 0xfffffe003e17ff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e17ff20 --- trap 0x13, rip = 0x203689, rsp = 0x7fffffffe4e0, rbp = 0x7fffffffe500 --- Tracing command rw pid 68163 tid 100371 td 0xfffff8014f8606e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e6258ee0 mi_switch() at mi_switch+0x164/frame 0xfffffe00e6258f20 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e6258f60 sleeplk() at sleeplk+0x107/frame 0xfffffe00e6258fc0 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x225/frame 0xfffffe00e6259080 __lockmgr_args() at __lockmgr_args+0x62c/frame 0xfffffe00e6259140 getblkx() at getblkx+0x15f/frame 0xfffffe00e6259220 breadn_flags() at breadn_flags+0x44/frame 0xfffffe00e6259290 ffs_getcg() at ffs_getcg+0xd7/frame 0xfffffe00e6259310 ffs_checkblk() at ffs_checkblk+0x6c/frame 0xfffffe00e6259350 ffs_reallocblks() at ffs_reallocblks+0xc0f/frame 0xfffffe00e62594a0 VOP_REALLOCBLKS_APV() at VOP_REALLOCBLKS_APV+0x60/frame 0xfffffe00e62594c0 cluster_write() at cluster_write+0x598/frame 0xfffffe00e6259590 ffs_write() at ffs_write+0x445/frame 0xfffffe00e6259630 VOP_WRITE_APV() at VOP_WRITE_APV+0xda/frame 0xfffffe00e6259740 vn_write() at vn_write+0x27a/frame 0xfffffe00e62597c0 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00e6259820 vn_io_fault1() at vn_io_fault1+0x16c/frame 0xfffffe00e6259970 vn_io_fault() at vn_io_fault+0x182/frame 0xfffffe00e62599e0 dofilewrite() at dofilewrite+0x81/frame 0xfffffe00e6259a30 kern_writev() at kern_writev+0x49/frame 0xfffffe00e6259a70 sys_write() at sys_write+0x83/frame 0xfffffe00e6259ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e6259bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e6259bf0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800434eca, rsp = 0x7fffffffd448, rbp = 0x7fffffffe500 --- Tracing command symlink pid 68162 tid 100520 td 0xfffff801be39d6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e7768280 mi_switch() at mi_switch+0x164/frame 0xfffffe00e77682c0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e7768300 sleeplk() at sleeplk+0x107/frame 0xfffffe00e7768360 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x225/frame 0xfffffe00e7768420 __lockmgr_args() at __lockmgr_args+0x62c/frame 0xfffffe00e77684e0 getblkx() at getblkx+0x15f/frame 0xfffffe00e77685c0 breadn_flags() at breadn_flags+0x44/frame 0xfffffe00e7768630 ffs_update() at ffs_update+0x138/frame 0xfffffe00e77686c0 ufs_makeinode() at ufs_makeinode+0x34f/frame 0xfffffe00e7768850 ufs_symlink() at ufs_symlink+0x36/frame 0xfffffe00e7768880 VOP_SYMLINK_APV() at VOP_SYMLINK_APV+0x60/frame 0xfffffe00e77688a0 kern_symlinkat() at kern_symlinkat+0x21a/frame 0xfffffe00e7768ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e7768bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e7768bf0 --- syscall (57, FreeBSD ELF64, sys_symlink), rip = 0x8002f675a, rsp = 0x7fffffffe458, rbp = 0x7fffffffe500 --- Tracing command link pid 68161 tid 100376 td 0xfffff802164e36e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e6272b60 mi_switch() at mi_switch+0x164/frame 0xfffffe00e6272ba0 ast() at ast+0x299/frame 0xfffffe00e6272bf0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe500 Tracing command mkdir pid 68160 tid 100304 td 0xfffff801a50ee6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e6351120 mi_switch() at mi_switch+0x164/frame 0xfffffe00e6351160 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e63511a0 sleeplk() at sleeplk+0x107/frame 0xfffffe00e6351200 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x225/frame 0xfffffe00e63512c0 __lockmgr_args() at __lockmgr_args+0x62c/frame 0xfffffe00e6351380 getblkx() at getblkx+0x15f/frame 0xfffffe00e6351460 breadn_flags() at breadn_flags+0x44/frame 0xfffffe00e63514d0 ffs_getcg() at ffs_getcg+0xd7/frame 0xfffffe00e6351550 ffs_nodealloccg() at ffs_nodealloccg+0xa1/frame 0xfffffe00e63515f0 ffs_hashalloc() at ffs_hashalloc+0x79/frame 0xfffffe00e6351640 ffs_valloc() at ffs_valloc+0x474/frame 0xfffffe00e63516e0 ufs_mkdir() at ufs_mkdir+0xcc/frame 0xfffffe00e6351880 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x60/frame 0xfffffe00e63518a0 kern_mkdirat() at kern_mkdirat+0x1b3/frame 0xfffffe00e6351ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e6351bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e6351bf0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x80043032a, rsp = 0x7fffffff30f8, rbp = 0x7fffffff3520 --- Tracing command creat pid 68159 tid 100405 td 0xfffff80436f82000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e74db150 mi_switch() at mi_switch+0x164/frame 0xfffffe00e74db190 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e74db1d0 sleeplk() at sleeplk+0x107/frame 0xfffffe00e74db230 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x225/frame 0xfffffe00e74db2f0 __lockmgr_args() at __lockmgr_args+0x62c/frame 0xfffffe00e74db3b0 ffs_lock() at ffs_lock+0x7c/frame 0xfffffe00e74db400 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x48/frame 0xfffffe00e74db420 _vn_lock() at _vn_lock+0x4f/frame 0xfffffe00e74db480 vget_finish() at vget_finish+0x81/frame 0xfffffe00e74db4b0 vfs_hash_get() at vfs_hash_get+0xbf/frame 0xfffffe00e74db500 ffs_vgetf() at ffs_vgetf+0x59/frame 0xfffffe00e74db590 ffs_valloc() at ffs_valloc+0x591/frame 0xfffffe00e74db630 ufs_makeinode() at ufs_makeinode+0xad/frame 0xfffffe00e74db7c0 ufs_create() at ufs_create+0x34/frame 0xfffffe00e74db7e0 VOP_CREATE_APV() at VOP_CREATE_APV+0x5d/frame 0xfffffe00e74db800 vn_open_cred() at vn_open_cred+0x36c/frame 0xfffffe00e74db950 kern_openat() at kern_openat+0x1f3/frame 0xfffffe00e74dbac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e74dbbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e74dbbf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8004302ca, rsp = 0x7fffffffe458, rbp = 0x7fffffffe500 --- Tracing command mkfifo pid 68158 tid 100144 td 0xfffff8000501a000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e37ac350 mi_switch() at mi_switch+0x164/frame 0xfffffe00e37ac390 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e37ac3d0 sleeplk() at sleeplk+0x107/frame 0xfffffe00e37ac430 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x225/frame 0xfffffe00e37ac4f0 lockmgr_upgrade() at lockmgr_upgrade+0x151/frame 0xfffffe00e37ac540 __lockmgr_args() at __lockmgr_args+0x6c4/frame 0xfffffe00e37ac600 ffs_lock() at ffs_lock+0x7c/frame 0xfffffe00e37ac650 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x48/frame 0xfffffe00e37ac670 _vn_lock() at _vn_lock+0x4f/frame 0xfffffe00e37ac6d0 lookup() at lookup+0x51c/frame 0xfffffe00e37ac770 namei() at namei+0x4f1/frame 0xfffffe00e37ac860 kern_funlinkat() at kern_funlinkat+0xb9/frame 0xfffffe00e37acaa0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe00e37acac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e37acbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e37acbf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80042c91a, rsp = 0x7fffffffe4b8, rbp = 0x7fffffffe500 --- Tracing command rename pid 68157 tid 100481 td 0xfffff80465bca000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e7652330 mi_switch() at mi_switch+0x164/frame 0xfffffe00e7652370 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e76523b0 sleeplk() at sleeplk+0x107/frame 0xfffffe00e7652410 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x225/frame 0xfffffe00e76524d0 lockmgr_upgrade() at lockmgr_upgrade+0x151/frame 0xfffffe00e7652520 __lockmgr_args() at __lockmgr_args+0x6c4/frame 0xfffffe00e76525e0 ffs_lock() at ffs_lock+0x7c/frame 0xfffffe00e7652630 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x48/frame 0xfffffe00e7652650 _vn_lock() at _vn_lock+0x4f/frame 0xfffffe00e76526b0 lookup() at lookup+0x51c/frame 0xfffffe00e7652750 namei() at namei+0x4f1/frame 0xfffffe00e7652840 kern_renameat() at kern_renameat+0x9a/frame 0xfffffe00e7652ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e7652bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e7652bf0 --- syscall (128, FreeBSD ELF64, sys_rename), rip = 0x8002f661a, rsp = 0x7fffffffe3c8, rbp = 0x7fffffffe500 --- Tracing command rw pid 68156 tid 100286 td 0xfffff8014febb000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e62f6ee0 mi_switch() at mi_switch+0x164/frame 0xfffffe00e62f6f20 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e62f6f60 sleeplk() at sleeplk+0x107/frame 0xfffffe00e62f6fc0 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x225/frame 0xfffffe00e62f7080 __lockmgr_args() at __lockmgr_args+0x62c/frame 0xfffffe00e62f7140 getblkx() at getblkx+0x15f/frame 0xfffffe00e62f7220 breadn_flags() at breadn_flags+0x44/frame 0xfffffe00e62f7290 ffs_getcg() at ffs_getcg+0xd7/frame 0xfffffe00e62f7310 ffs_checkblk() at ffs_checkblk+0x6c/frame 0xfffffe00e62f7350 ffs_reallocblks() at ffs_reallocblks+0x1202/frame 0xfffffe00e62f74a0 VOP_REALLOCBLKS_APV() at VOP_REALLOCBLKS_APV+0x60/frame 0xfffffe00e62f74c0 cluster_write() at cluster_write+0x598/frame 0xfffffe00e62f7590 ffs_write() at ffs_write+0x445/frame 0xfffffe00e62f7630 VOP_WRITE_APV() at VOP_WRITE_APV+0xda/frame 0xfffffe00e62f7740 vn_write() at vn_write+0x27a/frame 0xfffffe00e62f77c0 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00e62f7820 vn_io_fault1() at vn_io_fault1+0x16c/frame 0xfffffe00e62f7970 vn_io_fault() at vn_io_fault+0x182/frame 0xfffffe00e62f79e0 dofilewrite() at dofilewrite+0x81/frame 0xfffffe00e62f7a30 kern_writev() at kern_writev+0x49/frame 0xfffffe00e62f7a70 sys_write() at sys_write+0x83/frame 0xfffffe00e62f7ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e62f7bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e62f7bf0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800434eca, rsp = 0x7fffffffd448, rbp = 0x7fffffffe500 --- Tracing command symlink pid 68155 tid 100161 td 0xfffff8001dec56e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e5604360 mi_switch() at mi_switch+0x164/frame 0xfffffe00e56043a0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e56043e0 _sleep() at _sleep+0x2cd/frame 0xfffffe00e5604480 bufwait() at bufwait+0xc4/frame 0xfffffe00e56044c0 bufwrite() at bufwrite+0x258/frame 0xfffffe00e5604510 ffs_update() at ffs_update+0x2d2/frame 0xfffffe00e5604570 ffs_truncate() at ffs_truncate+0x726/frame 0xfffffe00e5604750 ufs_inactive() at ufs_inactive+0x1cf/frame 0xfffffe00e5604790 VOP_INACTIVE_APV() at VOP_INACTIVE_APV+0x60/frame 0xfffffe00e56047b0 vinactivef() at vinactivef+0xf4/frame 0xfffffe00e5604800 vputx() at vputx+0x300/frame 0xfffffe00e5604860 kern_funlinkat() at kern_funlinkat+0x314/frame 0xfffffe00e5604aa0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe00e5604ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e5604bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5604bf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80042c91a, rsp = 0x7fffffffe458, rbp = 0x7fffffffe500 --- Tracing command fts pid 68154 tid 100301 td 0xfffff801a506f000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e63423f0 mi_switch() at mi_switch+0x164/frame 0xfffffe00e6342430 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e6342470 sleeplk() at sleeplk+0x107/frame 0xfffffe00e63424d0 lockmgr_slock_hard() at lockmgr_slock_hard+0x1d6/frame 0xfffffe00e6342580 __lockmgr_args() at __lockmgr_args+0x798/frame 0xfffffe00e6342640 ffs_lock() at ffs_lock+0x7c/frame 0xfffffe00e6342690 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x48/frame 0xfffffe00e63426b0 _vn_lock() at _vn_lock+0x4f/frame 0xfffffe00e6342710 lookup() at lookup+0xe1/frame 0xfffffe00e63427b0 namei() at namei+0x4f1/frame 0xfffffe00e63428a0 kern_statat() at kern_statat+0x7f/frame 0xfffffe00e63429c0 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00e6342ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e6342bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e6342bf0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x80043017a, rsp = 0x7fffffffe1e8, rbp = 0x7fffffffe2a0 --- Tracing command creat pid 68153 tid 100417 td 0xfffff80434b806e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e7517130 mi_switch() at mi_switch+0x164/frame 0xfffffe00e7517170 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e75171b0 sleeplk() at sleeplk+0x107/frame 0xfffffe00e7517210 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x225/frame 0xfffffe00e75172d0 __lockmgr_args() at __lockmgr_args+0x62c/frame 0xfffffe00e7517390 getblkx() at getblkx+0x15f/frame 0xfffffe00e7517470 breadn_flags() at breadn_flags+0x44/frame 0xfffffe00e75174e0 ffs_update() at ffs_update+0x138/frame 0xfffffe00e7517570 ufs_direnter() at ufs_direnter+0x7e5/frame 0xfffffe00e7517630 ufs_makeinode() at ufs_makeinode+0x60c/frame 0xfffffe00e75177c0 ufs_create() at ufs_create+0x34/frame 0xfffffe00e75177e0 VOP_CREATE_APV() at VOP_CREATE_APV+0x5d/frame 0xfffffe00e7517800 vn_open_cred() at vn_open_cred+0x36c/frame 0xfffffe00e7517950 kern_openat() at kern_openat+0x1f3/frame 0xfffffe00e7517ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e7517bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e7517bf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8004302ca, rsp = 0x7fffffffe458, rbp = 0x7fffffffe500 --- Tracing command swap pid 68152 tid 100521 td 0xfffff803bc7e76e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e776d690 mi_switch() at mi_switch+0x164/frame 0xfffffe00e776d6d0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e776d710 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e776d750 _sleep() at _sleep+0x26c/frame 0xfffffe00e776d7f0 swap_pager_getpages() at swap_pager_getpages+0x549/frame 0xfffffe00e776d880 vm_pager_get_pages() at vm_pager_get_pages+0x4f/frame 0xfffffe00e776d8d0 vm_fault() at vm_fault+0x7a8/frame 0xfffffe00e776da00 vm_fault_trap() at vm_fault_trap+0x6e/frame 0xfffffe00e776da40 trap_pfault() at trap_pfault+0x1f3/frame 0xfffffe00e776dac0 trap() at trap+0x470/frame 0xfffffe00e776dbf0 calltrap() at calltrap+0x8/frame 0xfffffe00e776dbf0 --- trap 0xc, rip = 0x203689, rsp = 0x7fffffffe4e0, rbp = 0x7fffffffe500 --- Tracing command mkdir pid 68151 tid 100351 td 0xfffff801a54f8000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e7440180 mi_switch() at mi_switch+0x164/frame 0xfffffe00e74401c0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e7440200 sleeplk() at sleeplk+0x107/frame 0xfffffe00e7440260 lockmgr_slock_hard() at lockmgr_slock_hard+0x1d6/frame 0xfffffe00e7440310 __lockmgr_args() at __lockmgr_args+0x798/frame 0xfffffe00e74403d0 ffs_lock() at ffs_lock+0x7c/frame 0xfffffe00e7440420 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x48/frame 0xfffffe00e7440440 _vn_lock() at _vn_lock+0x4f/frame 0xfffffe00e74404a0 vget_finish() at vget_finish+0x81/frame 0xfffffe00e74404d0 vfs_hash_get() at vfs_hash_get+0xbf/frame 0xfffffe00e7440520 ffs_vgetf() at ffs_vgetf+0x59/frame 0xfffffe00e74405b0 vn_vget_ino_gen() at vn_vget_ino_gen+0x110/frame 0xfffffe00e7440620 vn_vget_ino() at vn_vget_ino+0x21/frame 0xfffffe00e7440640 ufs_lookup_ino() at ufs_lookup_ino+0x4be/frame 0xfffffe00e7440750 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0x5d/frame 0xfffffe00e7440770 vfs_cache_lookup() at vfs_cache_lookup+0xd2/frame 0xfffffe00e74407d0 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x5d/frame 0xfffffe00e74407f0 lookup() at lookup+0x611/frame 0xfffffe00e7440890 namei() at namei+0x4f1/frame 0xfffffe00e7440980 kern_chdir() at kern_chdir+0x4d/frame 0xfffffe00e7440ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e7440bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e7440bf0 --- syscall (12, FreeBSD ELF64, sys_chdir), rip = 0x8002f699a, rsp = 0x7fffffffdc98, rbp = 0x7fffffffe0d0 --- Tracing command rw pid 68150 tid 100463 td 0xfffff802fd8036e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e75f7ee0 mi_switch() at mi_switch+0x164/frame 0xfffffe00e75f7f20 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e75f7f60 sleeplk() at sleeplk+0x107/frame 0xfffffe00e75f7fc0 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x225/frame 0xfffffe00e75f8080 __lockmgr_args() at __lockmgr_args+0x62c/frame 0xfffffe00e75f8140 getblkx() at getblkx+0x15f/frame 0xfffffe00e75f8220 breadn_flags() at breadn_flags+0x44/frame 0xfffffe00e75f8290 ffs_getcg() at ffs_getcg+0xd7/frame 0xfffffe00e75f8310 ffs_checkblk() at ffs_checkblk+0x6c/frame 0xfffffe00e75f8350 ffs_reallocblks() at ffs_reallocblks+0xc0f/frame 0xfffffe00e75f84a0 VOP_REALLOCBLKS_APV() at VOP_REALLOCBLKS_APV+0x60/frame 0xfffffe00e75f84c0 cluster_write() at cluster_write+0x598/frame 0xfffffe00e75f8590 ffs_write() at ffs_write+0x445/frame 0xfffffe00e75f8630 VOP_WRITE_APV() at VOP_WRITE_APV+0xda/frame 0xfffffe00e75f8740 vn_write() at vn_write+0x27a/frame 0xfffffe00e75f87c0 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00e75f8820 vn_io_fault1() at vn_io_fault1+0x16c/frame 0xfffffe00e75f8970 vn_io_fault() at vn_io_fault+0x182/frame 0xfffffe00e75f89e0 dofilewrite() at dofilewrite+0x81/frame 0xfffffe00e75f8a30 kern_writev() at kern_writev+0x49/frame 0xfffffe00e75f8a70 sys_write() at sys_write+0x83/frame 0xfffffe00e75f8ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e75f8bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e75f8bf0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800434eca, rsp = 0x7fffffffd448, rbp = 0x7fffffffe500 --- Tracing command link pid 68149 tid 100220 td 0xfffff8001dd786e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e577fb60 mi_switch() at mi_switch+0x164/frame 0xfffffe00e577fba0 ast() at ast+0x299/frame 0xfffffe00e577fbf0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe500 Tracing command symlink pid 68148 tid 100470 td 0xfffff8043bd40000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e761b1c0 mi_switch() at mi_switch+0x164/frame 0xfffffe00e761b200 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e761b240 sleeplk() at sleeplk+0x107/frame 0xfffffe00e761b2a0 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x225/frame 0xfffffe00e761b360 __lockmgr_args() at __lockmgr_args+0x62c/frame 0xfffffe00e761b420 getblkx() at getblkx+0x15f/frame 0xfffffe00e761b500 breadn_flags() at breadn_flags+0x44/frame 0xfffffe00e761b570 ffs_update() at ffs_update+0x138/frame 0xfffffe00e761b600 ufs_direnter() at ufs_direnter+0x7e5/frame 0xfffffe00e761b6c0 ufs_makeinode() at ufs_makeinode+0x60c/frame 0xfffffe00e761b850 ufs_symlink() at ufs_symlink+0x36/frame 0xfffffe00e761b880 VOP_SYMLINK_APV() at VOP_SYMLINK_APV+0x60/frame 0xfffffe00e761b8a0 kern_symlinkat() at kern_symlinkat+0x21a/frame 0xfffffe00e761bac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e761bbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e761bbf0 --- syscall (57, FreeBSD ELF64, sys_symlink), rip = 0x8002f675a, rsp = 0x7fffffffe458, rbp = 0x7fffffffe500 --- Tracing command fts pid 68147 tid 100372 td 0xfffff801a54ad6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e625e3f0 mi_switch() at mi_switch+0x164/frame 0xfffffe00e625e430 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e625e470 sleeplk() at sleeplk+0x107/frame 0xfffffe00e625e4d0 lockmgr_slock_hard() at lockmgr_slock_hard+0x1d6/frame 0xfffffe00e625e580 __lockmgr_args() at __lockmgr_args+0x798/frame 0xfffffe00e625e640 ffs_lock() at ffs_lock+0x7c/frame 0xfffffe00e625e690 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x48/frame 0xfffffe00e625e6b0 _vn_lock() at _vn_lock+0x4f/frame 0xfffffe00e625e710 lookup() at lookup+0xe1/frame 0xfffffe00e625e7b0 namei() at namei+0x4f1/frame 0xfffffe00e625e8a0 kern_statat() at kern_statat+0x7f/frame 0xfffffe00e625e9c0 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00e625eac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e625ebf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e625ebf0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x80043017a, rsp = 0x7fffffffe1e8, rbp = 0x7fffffffe2a0 --- Tracing command mkdir pid 68146 tid 100476 td 0xfffff8048f965000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e7639120 mi_switch() at mi_switch+0x164/frame 0xfffffe00e7639160 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e76391a0 sleeplk() at sleeplk+0x107/frame 0xfffffe00e7639200 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x225/frame 0xfffffe00e76392c0 __lockmgr_args() at __lockmgr_args+0x62c/frame 0xfffffe00e7639380 getblkx() at getblkx+0x15f/frame 0xfffffe00e7639460 breadn_flags() at breadn_flags+0x44/frame 0xfffffe00e76394d0 ffs_getcg() at ffs_getcg+0xd7/frame 0xfffffe00e7639550 ffs_nodealloccg() at ffs_nodealloccg+0xa1/frame 0xfffffe00e76395f0 ffs_hashalloc() at ffs_hashalloc+0x79/frame 0xfffffe00e7639640 ffs_valloc() at ffs_valloc+0x474/frame 0xfffffe00e76396e0 ufs_mkdir() at ufs_mkdir+0xcc/frame 0xfffffe00e7639880 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x60/frame 0xfffffe00e76398a0 kern_mkdirat() at kern_mkdirat+0x1b3/frame 0xfffffe00e7639ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e7639bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e7639bf0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x80043032a, rsp = 0x7fffffff41b8, rbp = 0x7fffffff45e0 --- Tracing command rename pid 68145 tid 100238 td 0xfffff8014f89f6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e57d46b0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0037a730c0 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0037a730d0 trap() at trap+0x73/frame 0xfffffe0037a73200 calltrap() at calltrap+0x8/frame 0xfffffe0037a73200 --- trap 0xc, rip = 0xffffffff810471a0, rsp = 0xfffffe0037a732d0, rbp = 0xfffffe0037a73360 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe0037a73360 db_get_value() at db_get_value+0x32/frame 0xfffffe0037a733a0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0037a73430 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0037a73450 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0037a734f0 db_command() at db_command+0x25c/frame 0xfffffe0037a735c0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0037a73660 db_command() at db_command+0x25c/frame 0xfffffe0037a73730 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe0037a73740 db_trap() at db_trap+0xe8/frame 0xfffffe0037a737d0 kdb_trap() at kdb_trap+0x157/frame 0xfffffe0037a73850 trap() at trap+0x7d4/frame 0xfffffe0037a73980 calltrap() at calltrap+0x8/frame 0xfffffe0037a73980 --- trap 0x3, rip = 0xffffffff80c13b37, rsp = 0xfffffe0037a73a50, rbp = 0xfffffe0037a73a60 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe0037a73a60 vpanic() at vpanic+0x1a1/frame 0xfffffe0037a73ac0 panic() at panic+0x43/frame 0xfffffe0037a73b20 g_io_deliver() at g_io_deliver+0x386/frame 0xfffffe0037a73b70 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0037a73ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe0037a73bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a73bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a73bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00e57d46b8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0037a73350 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0037a73360 db_get_value() at db_get_value+0x4c/frame 0xfffffe0037a733a0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0037a73430 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0037a73450 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0037a734f0 db_command() at db_command+0x25c/frame 0xfffffe0037a735c0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0037a73660 db_command() at db_command+0x25c/frame 0xfffffe0037a73730 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe0037a73740 db_trap() at db_trap+0xe8/frame 0xfffffe0037a737d0 kdb_trap() at kdb_trap+0x157/frame 0xfffffe0037a73850 trap() at trap+0x7d4/frame 0xfffffe0037a73980 calltrap() at calltrap+0x8/frame 0xfffffe0037a73980 --- trap 0x3, rip = 0xffffffff80c13b37, rsp = 0xfffffe0037a73a50, rbp = 0xfffffe0037a73a60 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe0037a73a60 vpanic() at vpanic+0x1a1/frame 0xfffffe0037a73ac0 panic() at panic+0x43/frame 0xfffffe0037a73b20 g_io_deliver() at g_io_deliver+0x386/frame 0xfffffe0037a73b70 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0037a73ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe0037a73bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a73bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a73bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command rw pid 68144 tid 100419 td 0xfffff8046afde6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e7520e90 mi_switch() at mi_switch+0x164/frame 0xfffffe00e7520ed0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e7520f10 sleeplk() at sleeplk+0x107/frame 0xfffffe00e7520f70 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x225/frame 0xfffffe00e7521030 __lockmgr_args() at __lockmgr_args+0x62c/frame 0xfffffe00e75210f0 getblkx() at getblkx+0x15f/frame 0xfffffe00e75211d0 breadn_flags() at breadn_flags+0x44/frame 0xfffffe00e7521240 ffs_getcg() at ffs_getcg+0xd7/frame 0xfffffe00e75212c0 ffs_realloccg() at ffs_realloccg+0x389/frame 0xfffffe00e75213d0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0x57f/frame 0xfffffe00e7521590 ffs_write() at ffs_write+0x21b/frame 0xfffffe00e7521630 VOP_WRITE_APV() at VOP_WRITE_APV+0xda/frame 0xfffffe00e7521740 vn_write() at vn_write+0x27a/frame 0xfffffe00e75217c0 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00e7521820 vn_io_fault1() at vn_io_fault1+0x16c/frame 0xfffffe00e7521970 vn_io_fault() at vn_io_fault+0x182/frame 0xfffffe00e75219e0 dofilewrite() at dofilewrite+0x81/frame 0xfffffe00e7521a30 kern_writev() at kern_writev+0x49/frame 0xfffffe00e7521a70 sys_write() at sys_write+0x83/frame 0xfffffe00e7521ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e7521bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e7521bf0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800434eca, rsp = 0x7fffffffd448, rbp = 0x7fffffffe500 --- Tracing command link pid 68143 tid 100244 td 0xfffff8014fb4e6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e57f24d0 mi_switch() at mi_switch+0x164/frame 0xfffffe00e57f2510 __rw_wlock_hard() at __rw_wlock_hard+0x4b4/frame 0xfffffe00e57f25e0 _rw_wlock_cookie() at _rw_wlock_cookie+0xbc/frame 0xfffffe00e57f2620 softdep_update_inodeblock() at softdep_update_inodeblock+0xbc/frame 0xfffffe00e57f2670 ffs_update() at ffs_update+0x1f6/frame 0xfffffe00e57f26d0 handle_workitem_remove() at handle_workitem_remove+0x489/frame 0xfffffe00e57f2750 softdep_setup_remove() at softdep_setup_remove+0x203/frame 0xfffffe00e57f2790 ufs_dirremove() at ufs_dirremove+0x1f9/frame 0xfffffe00e57f27e0 ufs_remove() at ufs_remove+0x75/frame 0xfffffe00e57f2840 VOP_REMOVE_APV() at VOP_REMOVE_APV+0x80/frame 0xfffffe00e57f2860 kern_funlinkat() at kern_funlinkat+0x2be/frame 0xfffffe00e57f2aa0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe00e57f2ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e57f2bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e57f2bf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80042c91a, rsp = 0x7fffffffe3c8, rbp = 0x7fffffffe500 --- Tracing command symlink pid 68142 tid 100152 td 0xfffff8001dce6000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e37d41c0 mi_switch() at mi_switch+0x164/frame 0xfffffe00e37d4200 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e37d4240 sleeplk() at sleeplk+0x107/frame 0xfffffe00e37d42a0 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x225/frame 0xfffffe00e37d4360 __lockmgr_args() at __lockmgr_args+0x62c/frame 0xfffffe00e37d4420 getblkx() at getblkx+0x15f/frame 0xfffffe00e37d4500 breadn_flags() at breadn_flags+0x44/frame 0xfffffe00e37d4570 ffs_update() at ffs_update+0x138/frame 0xfffffe00e37d4600 ufs_direnter() at ufs_direnter+0x7e5/frame 0xfffffe00e37d46c0 ufs_makeinode() at ufs_makeinode+0x60c/frame 0xfffffe00e37d4850 ufs_symlink() at ufs_symlink+0x36/frame 0xfffffe00e37d4880 VOP_SYMLINK_APV() at VOP_SYMLINK_APV+0x60/frame 0xfffffe00e37d48a0 kern_symlinkat() at kern_symlinkat+0x21a/frame 0xfffffe00e37d4ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e37d4bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e37d4bf0 --- syscall (57, FreeBSD ELF64, sys_symlink), rip = 0x8002f675a, rsp = 0x7fffffffe458, rbp = 0x7fffffffe500 --- Tracing command swap pid 68141 tid 100247 td 0xfffff8014f811000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e62046b0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0037a730c0 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0037a730d0 trap() at trap+0x73/frame 0xfffffe0037a73200 calltrap() at calltrap+0x8/frame 0xfffffe0037a73200 --- trap 0xc, rip = 0xffffffff810471a0, rsp = 0xfffffe0037a732d0, rbp = 0xfffffe0037a73360 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe0037a73360 db_get_value() at db_get_value+0x32/frame 0xfffffe0037a733a0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0037a73430 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0037a73450 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0037a734f0 db_command() at db_command+0x25c/frame 0xfffffe0037a735c0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0037a73660 db_command() at db_command+0x25c/frame 0xfffffe0037a73730 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe0037a73740 db_trap() at db_trap+0xe8/frame 0xfffffe0037a737d0 kdb_trap() at kdb_trap+0x157/frame 0xfffffe0037a73850 trap() at trap+0x7d4/frame 0xfffffe0037a73980 calltrap() at calltrap+0x8/frame 0xfffffe0037a73980 --- trap 0x3, rip = 0xffffffff80c13b37, rsp = 0xfffffe0037a73a50, rbp = 0xfffffe0037a73a60 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe0037a73a60 vpanic() at vpanic+0x1a1/frame 0xfffffe0037a73ac0 panic() at panic+0x43/frame 0xfffffe0037a73b20 g_io_deliver() at g_io_deliver+0x386/frame 0xfffffe0037a73b70 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0037a73ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe0037a73bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a73bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a73bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00e62046b8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0037a73350 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0037a73360 db_get_value() at db_get_value+0x4c/frame 0xfffffe0037a733a0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0037a73430 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0037a73450 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0037a734f0 db_command() at db_command+0x25c/frame 0xfffffe0037a735c0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0037a73660 db_command() at db_command+0x25c/frame 0xfffffe0037a73730 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe0037a73740 db_trap() at db_trap+0xe8/frame 0xfffffe0037a737d0 kdb_trap() at kdb_trap+0x157/frame 0xfffffe0037a73850 trap() at trap+0x7d4/frame 0xfffffe0037a73980 calltrap() at calltrap+0x8/frame 0xfffffe0037a73980 --- trap 0x3, rip = 0xffffffff80c13b37, rsp = 0xfffffe0037a73a50, rbp = 0xfffffe0037a73a60 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe0037a73a60 vpanic() at vpanic+0x1a1/frame 0xfffffe0037a73ac0 panic() at panic+0x43/frame 0xfffffe0037a73b20 g_io_deliver() at g_io_deliver+0x386/frame 0xfffffe0037a73b70 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0037a73ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe0037a73bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a73bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a73bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command mkfifo pid 68140 tid 100344 td 0xfffff801a53cd6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e741d6b0 mi_switch() at mi_switch+0x164/frame 0xfffffe00e741d6f0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e741d730 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e741d790 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e741d7a0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e741d840 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00e741d8d0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e741dac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e741dbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e741dbf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003c54ca, rsp = 0x7fffffffe528, rbp = 0x7fffffffe560 --- Tracing command fts pid 68139 tid 100440 td 0xfffff8036e85e000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e758a3f0 mi_switch() at mi_switch+0x164/frame 0xfffffe00e758a430 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e758a470 sleeplk() at sleeplk+0x107/frame 0xfffffe00e758a4d0 lockmgr_slock_hard() at lockmgr_slock_hard+0x1d6/frame 0xfffffe00e758a580 __lockmgr_args() at __lockmgr_args+0x798/frame 0xfffffe00e758a640 ffs_lock() at ffs_lock+0x7c/frame 0xfffffe00e758a690 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x48/frame 0xfffffe00e758a6b0 _vn_lock() at _vn_lock+0x4f/frame 0xfffffe00e758a710 lookup() at lookup+0xe1/frame 0xfffffe00e758a7b0 namei() at namei+0x4f1/frame 0xfffffe00e758a8a0 kern_statat() at kern_statat+0x7f/frame 0xfffffe00e758a9c0 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00e758aac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e758abf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e758abf0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x80043017a, rsp = 0x7fffffffe1e8, rbp = 0x7fffffffe2a0 --- Tracing command rw pid 68138 tid 100442 td 0xfffff804fa4a9000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e7593e50 mi_switch() at mi_switch+0x164/frame 0xfffffe00e7593e90 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e7593ed0 sleeplk() at sleeplk+0x107/frame 0xfffffe00e7593f30 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x225/frame 0xfffffe00e7593ff0 __lockmgr_args() at __lockmgr_args+0x62c/frame 0xfffffe00e75940b0 getblkx() at getblkx+0x15f/frame 0xfffffe00e7594190 breadn_flags() at breadn_flags+0x44/frame 0xfffffe00e7594200 ffs_getcg() at ffs_getcg+0xd7/frame 0xfffffe00e7594280 ffs_alloccg() at ffs_alloccg+0x94/frame 0xfffffe00e7594310 ffs_hashalloc() at ffs_hashalloc+0x79/frame 0xfffffe00e7594360 ffs_alloc() at ffs_alloc+0x1ee/frame 0xfffffe00e75943e0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xada/frame 0xfffffe00e7594590 ffs_write() at ffs_write+0x21b/frame 0xfffffe00e7594630 VOP_WRITE_APV() at VOP_WRITE_APV+0xda/frame 0xfffffe00e7594740 vn_write() at vn_write+0x27a/frame 0xfffffe00e75947c0 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00e7594820 vn_io_fault1() at vn_io_fault1+0x16c/frame 0xfffffe00e7594970 vn_io_fault() at vn_io_fault+0x182/frame 0xfffffe00e75949e0 dofilewrite() at dofilewrite+0x81/frame 0xfffffe00e7594a30 kern_writev() at kern_writev+0x49/frame 0xfffffe00e7594a70 sys_write() at sys_write+0x83/frame 0xfffffe00e7594ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e7594bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e7594bf0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800434eca, rsp = 0x7fffffffd448, rbp = 0x7fffffffe500 --- Tracing command link pid 68137 tid 100452 td 0xfffff805455686e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e75c1450 mi_switch() at mi_switch+0x164/frame 0xfffffe00e75c1490 sched_preempt() at sched_preempt+0x86/frame 0xfffffe00e75c14c0 ipi_bitmap_handler() at ipi_bitmap_handler+0x64/frame 0xfffffe00e75c14f0 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0xb3/frame 0xfffffe00e75c14f0 --- interrupt, rip = 0xffffffff80f2ada8, rsp = 0xfffffe00e75c15c0, rbp = 0xfffffe00e75c1600 --- vm_page_busy_acquire() at vm_page_busy_acquire+0x68/frame 0xfffffe00e75c1600 bdwrite() at bdwrite+0x162/frame 0xfffffe00e75c1670 ffs_update() at ffs_update+0x31b/frame 0xfffffe00e75c16d0 handle_workitem_remove() at handle_workitem_remove+0x489/frame 0xfffffe00e75c1750 softdep_setup_remove() at softdep_setup_remove+0x203/frame 0xfffffe00e75c1790 ufs_dirremove() at ufs_dirremove+0x1f9/frame 0xfffffe00e75c17e0 ufs_remove() at ufs_remove+0x75/frame 0xfffffe00e75c1840 VOP_REMOVE_APV() at VOP_REMOVE_APV+0x80/frame 0xfffffe00e75c1860 kern_funlinkat() at kern_funlinkat+0x2be/frame 0xfffffe00e75c1aa0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe00e75c1ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e75c1bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e75c1bf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80042c91a, rsp = 0x7fffffffe3c8, rbp = 0x7fffffffe500 --- Tracing command symlink pid 68136 tid 100395 td 0xfffff8033fb00000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e74a91c0 mi_switch() at mi_switch+0x164/frame 0xfffffe00e74a9200 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e74a9240 sleeplk() at sleeplk+0x107/frame 0xfffffe00e74a92a0 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x225/frame 0xfffffe00e74a9360 __lockmgr_args() at __lockmgr_args+0x62c/frame 0xfffffe00e74a9420 getblkx() at getblkx+0x15f/frame 0xfffffe00e74a9500 breadn_flags() at breadn_flags+0x44/frame 0xfffffe00e74a9570 ffs_update() at ffs_update+0x138/frame 0xfffffe00e74a9600 ufs_direnter() at ufs_direnter+0x7e5/frame 0xfffffe00e74a96c0 ufs_makeinode() at ufs_makeinode+0x60c/frame 0xfffffe00e74a9850 ufs_symlink() at ufs_symlink+0x36/frame 0xfffffe00e74a9880 VOP_SYMLINK_APV() at VOP_SYMLINK_APV+0x60/frame 0xfffffe00e74a98a0 kern_symlinkat() at kern_symlinkat+0x21a/frame 0xfffffe00e74a9ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e74a9bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e74a9bf0 --- syscall (57, FreeBSD ELF64, sys_symlink), rip = 0x8002f675a, rsp = 0x7fffffffe458, rbp = 0x7fffffffe500 --- Tracing command mkdir pid 68135 tid 100249 td 0xfffff8003f4586e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e620e6b0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0037a730c0 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0037a730d0 trap() at trap+0x73/frame 0xfffffe0037a73200 calltrap() at calltrap+0x8/frame 0xfffffe0037a73200 --- trap 0xc, rip = 0xffffffff810471a0, rsp = 0xfffffe0037a732d0, rbp = 0xfffffe0037a73360 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe0037a73360 db_get_value() at db_get_value+0x32/frame 0xfffffe0037a733a0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0037a73430 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0037a73450 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0037a734f0 db_command() at db_command+0x25c/frame 0xfffffe0037a735c0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0037a73660 db_command() at db_command+0x25c/frame 0xfffffe0037a73730 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe0037a73740 db_trap() at db_trap+0xe8/frame 0xfffffe0037a737d0 kdb_trap() at kdb_trap+0x157/frame 0xfffffe0037a73850 trap() at trap+0x7d4/frame 0xfffffe0037a73980 calltrap() at calltrap+0x8/frame 0xfffffe0037a73980 --- trap 0x3, rip = 0xffffffff80c13b37, rsp = 0xfffffe0037a73a50, rbp = 0xfffffe0037a73a60 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe0037a73a60 vpanic() at vpanic+0x1a1/frame 0xfffffe0037a73ac0 panic() at panic+0x43/frame 0xfffffe0037a73b20 g_io_deliver() at g_io_deliver+0x386/frame 0xfffffe0037a73b70 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0037a73ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe0037a73bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a73bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a73bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00e620e6b8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0037a73350 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0037a73360 db_get_value() at db_get_value+0x4c/frame 0xfffffe0037a733a0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0037a73430 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0037a73450 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0037a734f0 db_command() at db_command+0x25c/frame 0xfffffe0037a735c0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0037a73660 db_command() at db_command+0x25c/frame 0xfffffe0037a73730 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe0037a73740 db_trap() at db_trap+0xe8/frame 0xfffffe0037a737d0 kdb_trap() at kdb_trap+0x157/frame 0xfffffe0037a73850 trap() at trap+0x7d4/frame 0xfffffe0037a73980 calltrap() at calltrap+0x8/frame 0xfffffe0037a73980 --- trap 0x3, rip = 0xffffffff80c13b37, rsp = 0xfffffe0037a73a50, rbp = 0xfffffe0037a73a60 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe0037a73a60 vpanic() at vpanic+0x1a1/frame 0xfffffe0037a73ac0 panic() at panic+0x43/frame 0xfffffe0037a73b20 g_io_deliver() at g_io_deliver+0x386/frame 0xfffffe0037a73b70 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0037a73ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe0037a73bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a73bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a73bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command creat pid 68134 tid 100159 td 0xfffff8001dec6000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e37f76b0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0037a730c0 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0037a730d0 trap() at trap+0x73/frame 0xfffffe0037a73200 calltrap() at calltrap+0x8/frame 0xfffffe0037a73200 --- trap 0xc, rip = 0xffffffff810471a0, rsp = 0xfffffe0037a732d0, rbp = 0xfffffe0037a73360 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe0037a73360 db_get_value() at db_get_value+0x32/frame 0xfffffe0037a733a0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0037a73430 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0037a73450 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0037a734f0 db_command() at db_command+0x25c/frame 0xfffffe0037a735c0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0037a73660 db_command() at db_command+0x25c/frame 0xfffffe0037a73730 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe0037a73740 db_trap() at db_trap+0xe8/frame 0xfffffe0037a737d0 kdb_trap() at kdb_trap+0x157/frame 0xfffffe0037a73850 trap() at trap+0x7d4/frame 0xfffffe0037a73980 calltrap() at calltrap+0x8/frame 0xfffffe0037a73980 --- trap 0x3, rip = 0xffffffff80c13b37, rsp = 0xfffffe0037a73a50, rbp = 0xfffffe0037a73a60 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe0037a73a60 vpanic() at vpanic+0x1a1/frame 0xfffffe0037a73ac0 panic() at panic+0x43/frame 0xfffffe0037a73b20 g_io_deliver() at g_io_deliver+0x386/frame 0xfffffe0037a73b70 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0037a73ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe0037a73bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a73bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a73bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00e37f76b8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0037a73350 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0037a73360 db_get_value() at db_get_value+0x4c/frame 0xfffffe0037a733a0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0037a73430 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0037a73450 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0037a734f0 db_command() at db_command+0x25c/frame 0xfffffe0037a735c0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0037a73660 db_command() at db_command+0x25c/frame 0xfffffe0037a73730 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe0037a73740 db_trap() at db_trap+0xe8/frame 0xfffffe0037a737d0 kdb_trap() at kdb_trap+0x157/frame 0xfffffe0037a73850 trap() at trap+0x7d4/frame 0xfffffe0037a73980 calltrap() at calltrap+0x8/frame 0xfffffe0037a73980 --- trap 0x3, rip = 0xffffffff80c13b37, rsp = 0xfffffe0037a73a50, rbp = 0xfffffe0037a73a60 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe0037a73a60 vpanic() at vpanic+0x1a1/frame 0xfffffe0037a73ac0 panic() at panic+0x43/frame 0xfffffe0037a73b20 g_io_deliver() at g_io_deliver+0x386/frame 0xfffffe0037a73b70 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0037a73ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe0037a73bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a73bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a73bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command rw pid 68133 tid 100415 td 0xfffff8043a5526e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e750cee0 mi_switch() at mi_switch+0x164/frame 0xfffffe00e750cf20 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e750cf60 sleeplk() at sleeplk+0x107/frame 0xfffffe00e750cfc0 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x225/frame 0xfffffe00e750d080 __lockmgr_args() at __lockmgr_args+0x62c/frame 0xfffffe00e750d140 getblkx() at getblkx+0x15f/frame 0xfffffe00e750d220 breadn_flags() at breadn_flags+0x44/frame 0xfffffe00e750d290 ffs_getcg() at ffs_getcg+0xd7/frame 0xfffffe00e750d310 ffs_checkblk() at ffs_checkblk+0x6c/frame 0xfffffe00e750d350 ffs_reallocblks() at ffs_reallocblks+0x262/frame 0xfffffe00e750d4a0 VOP_REALLOCBLKS_APV() at VOP_REALLOCBLKS_APV+0x60/frame 0xfffffe00e750d4c0 cluster_write() at cluster_write+0x598/frame 0xfffffe00e750d590 ffs_write() at ffs_write+0x445/frame 0xfffffe00e750d630 VOP_WRITE_APV() at VOP_WRITE_APV+0xda/frame 0xfffffe00e750d740 vn_write() at vn_write+0x27a/frame 0xfffffe00e750d7c0 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00e750d820 vn_io_fault1() at vn_io_fault1+0x16c/frame 0xfffffe00e750d970 vn_io_fault() at vn_io_fault+0x182/frame 0xfffffe00e750d9e0 dofilewrite() at dofilewrite+0x81/frame 0xfffffe00e750da30 kern_writev() at kern_writev+0x49/frame 0xfffffe00e750da70 sys_write() at sys_write+0x83/frame 0xfffffe00e750dac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e750dbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e750dbf0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800434eca, rsp = 0x7fffffffd448, rbp = 0x7fffffffe500 --- Tracing command fts pid 68132 tid 100447 td 0xfffff8043d0b66e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e75ad3f0 mi_switch() at mi_switch+0x164/frame 0xfffffe00e75ad430 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e75ad470 sleeplk() at sleeplk+0x107/frame 0xfffffe00e75ad4d0 lockmgr_slock_hard() at lockmgr_slock_hard+0x1d6/frame 0xfffffe00e75ad580 __lockmgr_args() at __lockmgr_args+0x798/frame 0xfffffe00e75ad640 ffs_lock() at ffs_lock+0x7c/frame 0xfffffe00e75ad690 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x48/frame 0xfffffe00e75ad6b0 _vn_lock() at _vn_lock+0x4f/frame 0xfffffe00e75ad710 lookup() at lookup+0xe1/frame 0xfffffe00e75ad7b0 namei() at namei+0x4f1/frame 0xfffffe00e75ad8a0 kern_statat() at kern_statat+0x7f/frame 0xfffffe00e75ad9c0 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00e75adac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e75adbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e75adbf0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x80043017a, rsp = 0x7fffffffe1e8, rbp = 0x7fffffffe2a0 --- Tracing command link pid 68131 tid 100317 td 0xfffff801a51f06e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e63923f0 mi_switch() at mi_switch+0x164/frame 0xfffffe00e6392430 __rw_wlock_hard() at __rw_wlock_hard+0x4b4/frame 0xfffffe00e6392500 _rw_wlock_cookie() at _rw_wlock_cookie+0xbc/frame 0xfffffe00e6392540 bqrelse() at bqrelse+0x8c/frame 0xfffffe00e6392570 bdwrite() at bdwrite+0x215/frame 0xfffffe00e63925e0 ffs_update() at ffs_update+0x31b/frame 0xfffffe00e6392640 ufs_link() at ufs_link+0x14d/frame 0xfffffe00e6392790 VOP_LINK_APV() at VOP_LINK_APV+0x80/frame 0xfffffe00e63927b0 kern_linkat_vp() at kern_linkat_vp+0x2e6/frame 0xfffffe00e63929a0 sys_link() at sys_link+0x92/frame 0xfffffe00e6392ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e6392bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e6392bf0 --- syscall (9, FreeBSD ELF64, sys_link), rip = 0x8002f69ba, rsp = 0x7fffffffe3c8, rbp = 0x7fffffffe500 --- Tracing command symlink pid 68130 tid 100468 td 0xfffff80390b8e000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e7611360 mi_switch() at mi_switch+0x164/frame 0xfffffe00e76113a0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e76113e0 _sleep() at _sleep+0x2cd/frame 0xfffffe00e7611480 bufwait() at bufwait+0xc4/frame 0xfffffe00e76114c0 bufwrite() at bufwrite+0x258/frame 0xfffffe00e7611510 ffs_update() at ffs_update+0x2d2/frame 0xfffffe00e7611570 ffs_truncate() at ffs_truncate+0x726/frame 0xfffffe00e7611750 ufs_inactive() at ufs_inactive+0x1cf/frame 0xfffffe00e7611790 VOP_INACTIVE_APV() at VOP_INACTIVE_APV+0x60/frame 0xfffffe00e76117b0 vinactivef() at vinactivef+0xf4/frame 0xfffffe00e7611800 vputx() at vputx+0x300/frame 0xfffffe00e7611860 kern_funlinkat() at kern_funlinkat+0x314/frame 0xfffffe00e7611aa0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe00e7611ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e7611bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e7611bf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80042c91a, rsp = 0x7fffffffe458, rbp = 0x7fffffffe500 --- Tracing command rw pid 68129 tid 100175 td 0xfffff8001d9db6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e5655e50 mi_switch() at mi_switch+0x164/frame 0xfffffe00e5655e90 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e5655ed0 sleeplk() at sleeplk+0x107/frame 0xfffffe00e5655f30 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x225/frame 0xfffffe00e5655ff0 __lockmgr_args() at __lockmgr_args+0x62c/frame 0xfffffe00e56560b0 getblkx() at getblkx+0x15f/frame 0xfffffe00e5656190 breadn_flags() at breadn_flags+0x44/frame 0xfffffe00e5656200 ffs_getcg() at ffs_getcg+0xd7/frame 0xfffffe00e5656280 ffs_alloccg() at ffs_alloccg+0x94/frame 0xfffffe00e5656310 ffs_hashalloc() at ffs_hashalloc+0x79/frame 0xfffffe00e5656360 ffs_alloc() at ffs_alloc+0x1ee/frame 0xfffffe00e56563e0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xcd3/frame 0xfffffe00e5656590 ffs_write() at ffs_write+0x21b/frame 0xfffffe00e5656630 VOP_WRITE_APV() at VOP_WRITE_APV+0xda/frame 0xfffffe00e5656740 vn_write() at vn_write+0x27a/frame 0xfffffe00e56567c0 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00e5656820 vn_io_fault1() at vn_io_fault1+0x16c/frame 0xfffffe00e5656970 vn_io_fault() at vn_io_fault+0x182/frame 0xfffffe00e56569e0 dofilewrite() at dofilewrite+0x81/frame 0xfffffe00e5656a30 kern_writev() at kern_writev+0x49/frame 0xfffffe00e5656a70 sys_write() at sys_write+0x83/frame 0xfffffe00e5656ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e5656bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5656bf0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800434eca, rsp = 0x7fffffffd448, rbp = 0x7fffffffe500 --- Tracing command fts pid 68128 tid 100314 td 0xfffff801a51ef6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e63833f0 mi_switch() at mi_switch+0x164/frame 0xfffffe00e6383430 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e6383470 sleeplk() at sleeplk+0x107/frame 0xfffffe00e63834d0 lockmgr_slock_hard() at lockmgr_slock_hard+0x1d6/frame 0xfffffe00e6383580 __lockmgr_args() at __lockmgr_args+0x798/frame 0xfffffe00e6383640 ffs_lock() at ffs_lock+0x7c/frame 0xfffffe00e6383690 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x48/frame 0xfffffe00e63836b0 _vn_lock() at _vn_lock+0x4f/frame 0xfffffe00e6383710 lookup() at lookup+0xe1/frame 0xfffffe00e63837b0 namei() at namei+0x4f1/frame 0xfffffe00e63838a0 kern_statat() at kern_statat+0x7f/frame 0xfffffe00e63839c0 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00e6383ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e6383bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e6383bf0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x80043017a, rsp = 0x7fffffffe1e8, rbp = 0x7fffffffe2a0 --- Tracing command link pid 68127 tid 100362 td 0xfffff80273fcc6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e7477b60 mi_switch() at mi_switch+0x164/frame 0xfffffe00e7477ba0 ast() at ast+0x299/frame 0xfffffe00e7477bf0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe500 Tracing command symlink pid 68126 tid 100418 td 0xfffff80434b80000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e751c1c0 mi_switch() at mi_switch+0x164/frame 0xfffffe00e751c200 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e751c240 sleeplk() at sleeplk+0x107/frame 0xfffffe00e751c2a0 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x225/frame 0xfffffe00e751c360 __lockmgr_args() at __lockmgr_args+0x62c/frame 0xfffffe00e751c420 getblkx() at getblkx+0x15f/frame 0xfffffe00e751c500 breadn_flags() at breadn_flags+0x44/frame 0xfffffe00e751c570 ffs_update() at ffs_update+0x138/frame 0xfffffe00e751c600 ufs_direnter() at ufs_direnter+0x7e5/frame 0xfffffe00e751c6c0 ufs_makeinode() at ufs_makeinode+0x60c/frame 0xfffffe00e751c850 ufs_symlink() at ufs_symlink+0x36/frame 0xfffffe00e751c880 VOP_SYMLINK_APV() at VOP_SYMLINK_APV+0x60/frame 0xfffffe00e751c8a0 kern_symlinkat() at kern_symlinkat+0x21a/frame 0xfffffe00e751cac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e751cbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e751cbf0 --- syscall (57, FreeBSD ELF64, sys_symlink), rip = 0x8002f675a, rsp = 0x7fffffffe458, rbp = 0x7fffffffe500 --- Tracing command rw pid 68125 tid 100284 td 0xfffff8014feba000 (CPU 4) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e197dd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e197df0 trap() at trap+0x61/frame 0xfffffe003e197f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e197f20 --- trap 0x13, rip = 0xffffffff80eca66a, rsp = 0xfffffe00e62ed0d0, rbp = 0xfffffe00e62ed150 --- softdep_disk_io_initiation() at softdep_disk_io_initiation+0x43a/frame 0xfffffe00e62ed150 ffs_geom_strategy() at ffs_geom_strategy+0xc5/frame 0xfffffe00e62ed180 bufwrite() at bufwrite+0x24a/frame 0xfffffe00e62ed1d0 ffs_update() at ffs_update+0x2d2/frame 0xfffffe00e62ed230 softdep_request_cleanup() at softdep_request_cleanup+0xbc/frame 0xfffffe00e62ed2c0 ffs_realloccg() at ffs_realloccg+0x171/frame 0xfffffe00e62ed3d0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0x57f/frame 0xfffffe00e62ed590 ffs_write() at ffs_write+0x21b/frame 0xfffffe00e62ed630 VOP_WRITE_APV() at VOP_WRITE_APV+0xda/frame 0xfffffe00e62ed740 vn_write() at vn_write+0x27a/frame 0xfffffe00e62ed7c0 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00e62ed820 vn_io_fault1() at vn_io_fault1+0x16c/frame 0xfffffe00e62ed970 vn_io_fault() at vn_io_fault+0x182/frame 0xfffffe00e62ed9e0 dofilewrite() at dofilewrite+0x81/frame 0xfffffe00e62eda30 kern_writev() at kern_writev+0x49/frame 0xfffffe00e62eda70 sys_write() at sys_write+0x83/frame 0xfffffe00e62edac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e62edbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e62edbf0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800434eca, rsp = 0x7fffffffd448, rbp = 0x7fffffffe500 --- Tracing command fts pid 68124 tid 100514 td 0xfffff8003f500000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e76ab3f0 mi_switch() at mi_switch+0x164/frame 0xfffffe00e76ab430 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e76ab470 sleeplk() at sleeplk+0x107/frame 0xfffffe00e76ab4d0 lockmgr_slock_hard() at lockmgr_slock_hard+0x1d6/frame 0xfffffe00e76ab580 __lockmgr_args() at __lockmgr_args+0x798/frame 0xfffffe00e76ab640 ffs_lock() at ffs_lock+0x7c/frame 0xfffffe00e76ab690 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x48/frame 0xfffffe00e76ab6b0 _vn_lock() at _vn_lock+0x4f/frame 0xfffffe00e76ab710 lookup() at lookup+0xe1/frame 0xfffffe00e76ab7b0 namei() at namei+0x4f1/frame 0xfffffe00e76ab8a0 kern_statat() at kern_statat+0x7f/frame 0xfffffe00e76ab9c0 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00e76abac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e76abbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e76abbf0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x80043017a, rsp = 0x7fffffffe1e8, rbp = 0x7fffffffe2a0 --- Tracing command link pid 68123 tid 100310 td 0xfffff801a51596e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e636fb60 mi_switch() at mi_switch+0x164/frame 0xfffffe00e636fba0 ast() at ast+0x299/frame 0xfffffe00e636fbf0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe500 Tracing command symlink pid 68122 tid 100319 td 0xfffff801a51ca000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e639cb60 mi_switch() at mi_switch+0x164/frame 0xfffffe00e639cba0 ast() at ast+0x299/frame 0xfffffe00e639cbf0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe500 Tracing command rw pid 68121 tid 100311 td 0xfffff8014ffd16e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e6373ee0 mi_switch() at mi_switch+0x164/frame 0xfffffe00e6373f20 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e6373f60 sleeplk() at sleeplk+0x107/frame 0xfffffe00e6373fc0 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x225/frame 0xfffffe00e6374080 __lockmgr_args() at __lockmgr_args+0x62c/frame 0xfffffe00e6374140 getblkx() at getblkx+0x15f/frame 0xfffffe00e6374220 breadn_flags() at breadn_flags+0x44/frame 0xfffffe00e6374290 ffs_getcg() at ffs_getcg+0xd7/frame 0xfffffe00e6374310 ffs_checkblk() at ffs_checkblk+0x6c/frame 0xfffffe00e6374350 ffs_reallocblks() at ffs_reallocblks+0x29d/frame 0xfffffe00e63744a0 VOP_REALLOCBLKS_APV() at VOP_REALLOCBLKS_APV+0x60/frame 0xfffffe00e63744c0 cluster_write() at cluster_write+0x598/frame 0xfffffe00e6374590 ffs_write() at ffs_write+0x445/frame 0xfffffe00e6374630 VOP_WRITE_APV() at VOP_WRITE_APV+0xda/frame 0xfffffe00e6374740 vn_write() at vn_write+0x27a/frame 0xfffffe00e63747c0 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00e6374820 vn_io_fault1() at vn_io_fault1+0x16c/frame 0xfffffe00e6374970 vn_io_fault() at vn_io_fault+0x182/frame 0xfffffe00e63749e0 dofilewrite() at dofilewrite+0x81/frame 0xfffffe00e6374a30 kern_writev() at kern_writev+0x49/frame 0xfffffe00e6374a70 sys_write() at sys_write+0x83/frame 0xfffffe00e6374ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e6374bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e6374bf0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800434eca, rsp = 0x7fffffffd448, rbp = 0x7fffffffe500 --- Tracing command fts pid 68120 tid 100388 td 0xfffff8036ec36000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00adde53f0 mi_switch() at mi_switch+0x164/frame 0xfffffe00adde5430 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00adde5470 sleeplk() at sleeplk+0x107/frame 0xfffffe00adde54d0 lockmgr_slock_hard() at lockmgr_slock_hard+0x1d6/frame 0xfffffe00adde5580 __lockmgr_args() at __lockmgr_args+0x798/frame 0xfffffe00adde5640 ffs_lock() at ffs_lock+0x7c/frame 0xfffffe00adde5690 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x48/frame 0xfffffe00adde56b0 _vn_lock() at _vn_lock+0x4f/frame 0xfffffe00adde5710 lookup() at lookup+0xe1/frame 0xfffffe00adde57b0 namei() at namei+0x4f1/frame 0xfffffe00adde58a0 kern_statat() at kern_statat+0x7f/frame 0xfffffe00adde59c0 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00adde5ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00adde5bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00adde5bf0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x80043017a, rsp = 0x7fffffffe1e8, rbp = 0x7fffffffe2a0 --- Tracing command symlink pid 68119 tid 100350 td 0xfffff8014f8a16e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e743b1c0 mi_switch() at mi_switch+0x164/frame 0xfffffe00e743b200 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e743b240 sleeplk() at sleeplk+0x107/frame 0xfffffe00e743b2a0 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x225/frame 0xfffffe00e743b360 __lockmgr_args() at __lockmgr_args+0x62c/frame 0xfffffe00e743b420 getblkx() at getblkx+0x15f/frame 0xfffffe00e743b500 breadn_flags() at breadn_flags+0x44/frame 0xfffffe00e743b570 ffs_update() at ffs_update+0x138/frame 0xfffffe00e743b600 ufs_direnter() at ufs_direnter+0x7e5/frame 0xfffffe00e743b6c0 ufs_makeinode() at ufs_makeinode+0x60c/frame 0xfffffe00e743b850 ufs_symlink() at ufs_symlink+0x36/frame 0xfffffe00e743b880 VOP_SYMLINK_APV() at VOP_SYMLINK_APV+0x60/frame 0xfffffe00e743b8a0 kern_symlinkat() at kern_symlinkat+0x21a/frame 0xfffffe00e743bac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e743bbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e743bbf0 --- syscall (57, FreeBSD ELF64, sys_symlink), rip = 0x8002f675a, rsp = 0x7fffffffe458, rbp = 0x7fffffffe500 --- Tracing command link pid 68118 tid 100146 td 0xfffff8001dd78000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e37b66b0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0037a730c0 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0037a730d0 trap() at trap+0x73/frame 0xfffffe0037a73200 calltrap() at calltrap+0x8/frame 0xfffffe0037a73200 --- trap 0xc, rip = 0xffffffff810471a0, rsp = 0xfffffe0037a732d0, rbp = 0xfffffe0037a73360 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe0037a73360 db_get_value() at db_get_value+0x32/frame 0xfffffe0037a733a0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0037a73430 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0037a73450 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0037a734f0 db_command() at db_command+0x25c/frame 0xfffffe0037a735c0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0037a73660 db_command() at db_command+0x25c/frame 0xfffffe0037a73730 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe0037a73740 db_trap() at db_trap+0xe8/frame 0xfffffe0037a737d0 kdb_trap() at kdb_trap+0x157/frame 0xfffffe0037a73850 trap() at trap+0x7d4/frame 0xfffffe0037a73980 calltrap() at calltrap+0x8/frame 0xfffffe0037a73980 --- trap 0x3, rip = 0xffffffff80c13b37, rsp = 0xfffffe0037a73a50, rbp = 0xfffffe0037a73a60 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe0037a73a60 vpanic() at vpanic+0x1a1/frame 0xfffffe0037a73ac0 panic() at panic+0x43/frame 0xfffffe0037a73b20 g_io_deliver() at g_io_deliver+0x386/frame 0xfffffe0037a73b70 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0037a73ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe0037a73bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a73bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a73bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00e37b66b8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0037a73350 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0037a73360 db_get_value() at db_get_value+0x4c/frame 0xfffffe0037a733a0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0037a73430 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0037a73450 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0037a734f0 db_command() at db_command+0x25c/frame 0xfffffe0037a735c0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0037a73660 db_command() at db_command+0x25c/frame 0xfffffe0037a73730 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe0037a73740 db_trap() at db_trap+0xe8/frame 0xfffffe0037a737d0 kdb_trap() at kdb_trap+0x157/frame 0xfffffe0037a73850 trap() at trap+0x7d4/frame 0xfffffe0037a73980 calltrap() at calltrap+0x8/frame 0xfffffe0037a73980 --- trap 0x3, rip = 0xffffffff80c13b37, rsp = 0xfffffe0037a73a50, rbp = 0xfffffe0037a73a60 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe0037a73a60 vpanic() at vpanic+0x1a1/frame 0xfffffe0037a73ac0 panic() at panic+0x43/frame 0xfffffe0037a73b20 g_io_deliver() at g_io_deliver+0x386/frame 0xfffffe0037a73b70 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0037a73ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe0037a73bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a73bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a73bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command rw pid 68117 tid 100380 td 0xfffff801a54ad000 (CPU 7) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1bbdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1bbdf0 trap() at trap+0x61/frame 0xfffffe003e1bbf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1bbf20 --- trap 0x13, rip = 0xffffffff80c15150, rsp = 0xfffffe00e567dee0, rbp = 0xfffffe00e567def0 --- lock_delay() at lock_delay+0x30/frame 0xfffffe00e567def0 _mtx_lock_spin_cookie() at _mtx_lock_spin_cookie+0xd1/frame 0xfffffe00e567df80 __mtx_lock_spin_flags() at __mtx_lock_spin_flags+0xda/frame 0xfffffe00e567dfc0 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x170/frame 0xfffffe00e567e080 __lockmgr_args() at __lockmgr_args+0x62c/frame 0xfffffe00e567e140 getblkx() at getblkx+0x15f/frame 0xfffffe00e567e220 breadn_flags() at breadn_flags+0x44/frame 0xfffffe00e567e290 ffs_getcg() at ffs_getcg+0xd7/frame 0xfffffe00e567e310 ffs_checkblk() at ffs_checkblk+0x6c/frame 0xfffffe00e567e350 ffs_reallocblks() at ffs_reallocblks+0x29d/frame 0xfffffe00e567e4a0 VOP_REALLOCBLKS_APV() at VOP_REALLOCBLKS_APV+0x60/frame 0xfffffe00e567e4c0 cluster_write() at cluster_write+0x598/frame 0xfffffe00e567e590 ffs_write() at ffs_write+0x445/frame 0xfffffe00e567e630 VOP_WRITE_APV() at VOP_WRITE_APV+0xda/frame 0xfffffe00e567e740 vn_write() at vn_write+0x27a/frame 0xfffffe00e567e7c0 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00e567e820 vn_io_fault1() at vn_io_fault1+0x16c/frame 0xfffffe00e567e970 vn_io_fault() at vn_io_fault+0x182/frame 0xfffffe00e567e9e0 dofilewrite() at dofilewrite+0x81/frame 0xfffffe00e567ea30 kern_writev() at kern_writev+0x49/frame 0xfffffe00e567ea70 sys_write() at sys_write+0x83/frame 0xfffffe00e567eac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e567ebf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e567ebf0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800434eca, rsp = 0x7fffffffd448, rbp = 0x7fffffffe500 --- Tracing command symlink pid 68116 tid 100464 td 0xfffff8043bd406e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e75fd1c0 mi_switch() at mi_switch+0x164/frame 0xfffffe00e75fd200 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e75fd240 sleeplk() at sleeplk+0x107/frame 0xfffffe00e75fd2a0 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x225/frame 0xfffffe00e75fd360 __lockmgr_args() at __lockmgr_args+0x62c/frame 0xfffffe00e75fd420 getblkx() at getblkx+0x15f/frame 0xfffffe00e75fd500 breadn_flags() at breadn_flags+0x44/frame 0xfffffe00e75fd570 ffs_vgetf() at ffs_vgetf+0x340/frame 0xfffffe00e75fd620 ffs_valloc() at ffs_valloc+0x591/frame 0xfffffe00e75fd6c0 ufs_makeinode() at ufs_makeinode+0xad/frame 0xfffffe00e75fd850 ufs_symlink() at ufs_symlink+0x36/frame 0xfffffe00e75fd880 VOP_SYMLINK_APV() at VOP_SYMLINK_APV+0x60/frame 0xfffffe00e75fd8a0 kern_symlinkat() at kern_symlinkat+0x21a/frame 0xfffffe00e75fdac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e75fdbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e75fdbf0 --- syscall (57, FreeBSD ELF64, sys_symlink), rip = 0x8002f675a, rsp = 0x7fffffffe458, rbp = 0x7fffffffe500 --- Tracing command openat pid 68115 tid 100378 td 0xfffff8036eda56e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e5674290 mi_switch() at mi_switch+0x164/frame 0xfffffe00e56742d0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e5674310 sleeplk() at sleeplk+0x107/frame 0xfffffe00e5674370 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x225/frame 0xfffffe00e5674430 __lockmgr_args() at __lockmgr_args+0x62c/frame 0xfffffe00e56744f0 getblkx() at getblkx+0x15f/frame 0xfffffe00e56745d0 breadn_flags() at breadn_flags+0x44/frame 0xfffffe00e5674640 ffs_update() at ffs_update+0x138/frame 0xfffffe00e56746d0 handle_workitem_remove() at handle_workitem_remove+0x489/frame 0xfffffe00e5674750 softdep_setup_remove() at softdep_setup_remove+0x203/frame 0xfffffe00e5674790 ufs_dirremove() at ufs_dirremove+0x1f9/frame 0xfffffe00e56747e0 ufs_remove() at ufs_remove+0x75/frame 0xfffffe00e5674840 VOP_REMOVE_APV() at VOP_REMOVE_APV+0x80/frame 0xfffffe00e5674860 kern_funlinkat() at kern_funlinkat+0x2be/frame 0xfffffe00e5674aa0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe00e5674ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e5674bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5674bf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80042c91a, rsp = 0x7fffffffe3c8, rbp = 0x7fffffffe500 --- Tracing command rw pid 68114 tid 100200 td 0xfffff8003f1916e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e570f130 mi_switch() at mi_switch+0x164/frame 0xfffffe00e570f170 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e570f1b0 sleeplk() at sleeplk+0x107/frame 0xfffffe00e570f210 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x225/frame 0xfffffe00e570f2d0 __lockmgr_args() at __lockmgr_args+0x62c/frame 0xfffffe00e570f390 getblkx() at getblkx+0x15f/frame 0xfffffe00e570f470 breadn_flags() at breadn_flags+0x44/frame 0xfffffe00e570f4e0 ffs_vgetf() at ffs_vgetf+0x340/frame 0xfffffe00e570f590 ffs_valloc() at ffs_valloc+0x591/frame 0xfffffe00e570f630 ufs_makeinode() at ufs_makeinode+0xad/frame 0xfffffe00e570f7c0 ufs_create() at ufs_create+0x34/frame 0xfffffe00e570f7e0 VOP_CREATE_APV() at VOP_CREATE_APV+0x5d/frame 0xfffffe00e570f800 vn_open_cred() at vn_open_cred+0x36c/frame 0xfffffe00e570f950 kern_openat() at kern_openat+0x1f3/frame 0xfffffe00e570fac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e570fbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e570fbf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8004302ca, rsp = 0x7fffffffd448, rbp = 0x7fffffffe500 --- Tracing command fts pid 68113 tid 100273 td 0xfffff8014fd56000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e62b66b0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0037a730c0 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0037a730d0 trap() at trap+0x73/frame 0xfffffe0037a73200 calltrap() at calltrap+0x8/frame 0xfffffe0037a73200 --- trap 0xc, rip = 0xffffffff810471a0, rsp = 0xfffffe0037a732d0, rbp = 0xfffffe0037a73360 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe0037a73360 db_get_value() at db_get_value+0x32/frame 0xfffffe0037a733a0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0037a73430 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0037a73450 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0037a734f0 db_command() at db_command+0x25c/frame 0xfffffe0037a735c0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0037a73660 db_command() at db_command+0x25c/frame 0xfffffe0037a73730 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe0037a73740 db_trap() at db_trap+0xe8/frame 0xfffffe0037a737d0 kdb_trap() at kdb_trap+0x157/frame 0xfffffe0037a73850 trap() at trap+0x7d4/frame 0xfffffe0037a73980 calltrap() at calltrap+0x8/frame 0xfffffe0037a73980 --- trap 0x3, rip = 0xffffffff80c13b37, rsp = 0xfffffe0037a73a50, rbp = 0xfffffe0037a73a60 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe0037a73a60 vpanic() at vpanic+0x1a1/frame 0xfffffe0037a73ac0 panic() at panic+0x43/frame 0xfffffe0037a73b20 g_io_deliver() at g_io_deliver+0x386/frame 0xfffffe0037a73b70 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0037a73ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe0037a73bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a73bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a73bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00e62b66b8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0037a73350 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0037a73360 db_get_value() at db_get_value+0x4c/frame 0xfffffe0037a733a0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0037a73430 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0037a73450 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0037a734f0 db_command() at db_command+0x25c/frame 0xfffffe0037a735c0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0037a73660 db_command() at db_command+0x25c/frame 0xfffffe0037a73730 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe0037a73740 db_trap() at db_trap+0xe8/frame 0xfffffe0037a737d0 kdb_trap() at kdb_trap+0x157/frame 0xfffffe0037a73850 trap() at trap+0x7d4/frame 0xfffffe0037a73980 calltrap() at calltrap+0x8/frame 0xfffffe0037a73980 --- trap 0x3, rip = 0xffffffff80c13b37, rsp = 0xfffffe0037a73a50, rbp = 0xfffffe0037a73a60 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe0037a73a60 vpanic() at vpanic+0x1a1/frame 0xfffffe0037a73ac0 panic() at panic+0x43/frame 0xfffffe0037a73b20 g_io_deliver() at g_io_deliver+0x386/frame 0xfffffe0037a73b70 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0037a73ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe0037a73bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a73bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a73bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command symlink pid 68112 tid 100465 td 0xfffff801ea4a76e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e7602360 mi_switch() at mi_switch+0x164/frame 0xfffffe00e76023a0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e76023e0 _sleep() at _sleep+0x2cd/frame 0xfffffe00e7602480 bufwait() at bufwait+0xc4/frame 0xfffffe00e76024c0 bufwrite() at bufwrite+0x258/frame 0xfffffe00e7602510 ffs_update() at ffs_update+0x2d2/frame 0xfffffe00e7602570 ffs_truncate() at ffs_truncate+0x726/frame 0xfffffe00e7602750 ufs_inactive() at ufs_inactive+0x1cf/frame 0xfffffe00e7602790 VOP_INACTIVE_APV() at VOP_INACTIVE_APV+0x60/frame 0xfffffe00e76027b0 vinactivef() at vinactivef+0xf4/frame 0xfffffe00e7602800 vputx() at vputx+0x300/frame 0xfffffe00e7602860 kern_funlinkat() at kern_funlinkat+0x314/frame 0xfffffe00e7602aa0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe00e7602ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e7602bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e7602bf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80042c91a, rsp = 0x7fffffffe458, rbp = 0x7fffffffe500 --- Tracing command openat pid 68111 tid 100446 td 0xfffff804fa3e6000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e75a8310 mi_switch() at mi_switch+0x164/frame 0xfffffe00e75a8350 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e75a8390 sleeplk() at sleeplk+0x107/frame 0xfffffe00e75a83f0 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x225/frame 0xfffffe00e75a84b0 __lockmgr_args() at __lockmgr_args+0x62c/frame 0xfffffe00e75a8570 getblkx() at getblkx+0x15f/frame 0xfffffe00e75a8650 breadn_flags() at breadn_flags+0x44/frame 0xfffffe00e75a86c0 ffs_update() at ffs_update+0x138/frame 0xfffffe00e75a8750 ufs_inactive() at ufs_inactive+0x2d7/frame 0xfffffe00e75a8790 VOP_INACTIVE_APV() at VOP_INACTIVE_APV+0x60/frame 0xfffffe00e75a87b0 vinactivef() at vinactivef+0xf4/frame 0xfffffe00e75a8800 vputx() at vputx+0x300/frame 0xfffffe00e75a8860 kern_funlinkat() at kern_funlinkat+0x314/frame 0xfffffe00e75a8aa0 sys_unlinkat() at sys_unlinkat+0x43/frame 0xfffffe00e75a8ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e75a8bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e75a8bf0 --- syscall (503, FreeBSD ELF64, sys_unlinkat), rip = 0x8002f511a, rsp = 0x7fffffffe3c8, rbp = 0x7fffffffe500 --- Tracing command rw pid 68110 tid 100450 td 0xfffff80488f28000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e75b6d50 mi_switch() at mi_switch+0x164/frame 0xfffffe00e75b6d90 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e75b6dd0 sleeplk() at sleeplk+0x107/frame 0xfffffe00e75b6e30 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x225/frame 0xfffffe00e75b6ef0 __lockmgr_args() at __lockmgr_args+0x62c/frame 0xfffffe00e75b6fb0 getblkx() at getblkx+0x15f/frame 0xfffffe00e75b7090 breadn_flags() at breadn_flags+0x44/frame 0xfffffe00e75b7100 ffs_getcg() at ffs_getcg+0xd7/frame 0xfffffe00e75b7180 ffs_blkfree_cg() at ffs_blkfree_cg+0xf7/frame 0xfffffe00e75b7220 ffs_blkfree() at ffs_blkfree+0xa5/frame 0xfffffe00e75b7280 handle_workitem_freefrag() at handle_workitem_freefrag+0xbe/frame 0xfffffe00e75b72d0 softdep_setup_allocindir_page() at softdep_setup_allocindir_page+0x132/frame 0xfffffe00e75b7340 ffs_reallocblks() at ffs_reallocblks+0xb90/frame 0xfffffe00e75b74a0 VOP_REALLOCBLKS_APV() at VOP_REALLOCBLKS_APV+0x60/frame 0xfffffe00e75b74c0 cluster_write() at cluster_write+0x598/frame 0xfffffe00e75b7590 ffs_write() at ffs_write+0x445/frame 0xfffffe00e75b7630 VOP_WRITE_APV() at VOP_WRITE_APV+0xda/frame 0xfffffe00e75b7740 vn_write() at vn_write+0x27a/frame 0xfffffe00e75b77c0 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00e75b7820 vn_io_fault1() at vn_io_fault1+0x16c/frame 0xfffffe00e75b7970 vn_io_fault() at vn_io_fault+0x182/frame 0xfffffe00e75b79e0 dofilewrite() at dofilewrite+0x81/frame 0xfffffe00e75b7a30 kern_writev() at kern_writev+0x49/frame 0xfffffe00e75b7a70 sys_write() at sys_write+0x83/frame 0xfffffe00e75b7ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e75b7bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e75b7bf0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800434eca, rsp = 0x7fffffffd448, rbp = 0x7fffffffe500 --- Tracing command symlink pid 68109 tid 100290 td 0xfffff8014f9db6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e630b100 mi_switch() at mi_switch+0x164/frame 0xfffffe00e630b140 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e630b180 sleeplk() at sleeplk+0x107/frame 0xfffffe00e630b1e0 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x225/frame 0xfffffe00e630b2a0 __lockmgr_args() at __lockmgr_args+0x62c/frame 0xfffffe00e630b360 getblkx() at getblkx+0x15f/frame 0xfffffe00e630b440 breadn_flags() at breadn_flags+0x44/frame 0xfffffe00e630b4b0 ffs_getcg() at ffs_getcg+0xd7/frame 0xfffffe00e630b530 ffs_nodealloccg() at ffs_nodealloccg+0xa1/frame 0xfffffe00e630b5d0 ffs_hashalloc() at ffs_hashalloc+0x10c/frame 0xfffffe00e630b620 ffs_valloc() at ffs_valloc+0x474/frame 0xfffffe00e630b6c0 ufs_makeinode() at ufs_makeinode+0xad/frame 0xfffffe00e630b850 ufs_symlink() at ufs_symlink+0x36/frame 0xfffffe00e630b880 VOP_SYMLINK_APV() at VOP_SYMLINK_APV+0x60/frame 0xfffffe00e630b8a0 kern_symlinkat() at kern_symlinkat+0x21a/frame 0xfffffe00e630bac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e630bbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e630bbf0 --- syscall (57, FreeBSD ELF64, sys_symlink), rip = 0x8002f675a, rsp = 0x7fffffffe458, rbp = 0x7fffffffe500 --- Tracing command openat pid 68108 tid 100254 td 0xfffff800356e96e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e6227310 mi_switch() at mi_switch+0x164/frame 0xfffffe00e6227350 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e6227390 sleeplk() at sleeplk+0x107/frame 0xfffffe00e62273f0 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x225/frame 0xfffffe00e62274b0 __lockmgr_args() at __lockmgr_args+0x62c/frame 0xfffffe00e6227570 getblkx() at getblkx+0x15f/frame 0xfffffe00e6227650 breadn_flags() at breadn_flags+0x44/frame 0xfffffe00e62276c0 ffs_update() at ffs_update+0x138/frame 0xfffffe00e6227750 ufs_inactive() at ufs_inactive+0x2d7/frame 0xfffffe00e6227790 VOP_INACTIVE_APV() at VOP_INACTIVE_APV+0x60/frame 0xfffffe00e62277b0 vinactivef() at vinactivef+0xf4/frame 0xfffffe00e6227800 vputx() at vputx+0x300/frame 0xfffffe00e6227860 kern_funlinkat() at kern_funlinkat+0x314/frame 0xfffffe00e6227aa0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe00e6227ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e6227bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e6227bf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80042c91a, rsp = 0x7fffffffe3c8, rbp = 0x7fffffffe500 --- Tracing command rw pid 68107 tid 100211 td 0xfffff8003fb116e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e57526b0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0037a730c0 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0037a730d0 trap() at trap+0x73/frame 0xfffffe0037a73200 calltrap() at calltrap+0x8/frame 0xfffffe0037a73200 --- trap 0xc, rip = 0xffffffff810471a0, rsp = 0xfffffe0037a732d0, rbp = 0xfffffe0037a73360 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe0037a73360 db_get_value() at db_get_value+0x32/frame 0xfffffe0037a733a0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0037a73430 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0037a73450 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0037a734f0 db_command() at db_command+0x25c/frame 0xfffffe0037a735c0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0037a73660 db_command() at db_command+0x25c/frame 0xfffffe0037a73730 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe0037a73740 db_trap() at db_trap+0xe8/frame 0xfffffe0037a737d0 kdb_trap() at kdb_trap+0x157/frame 0xfffffe0037a73850 trap() at trap+0x7d4/frame 0xfffffe0037a73980 calltrap() at calltrap+0x8/frame 0xfffffe0037a73980 --- trap 0x3, rip = 0xffffffff80c13b37, rsp = 0xfffffe0037a73a50, rbp = 0xfffffe0037a73a60 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe0037a73a60 vpanic() at vpanic+0x1a1/frame 0xfffffe0037a73ac0 panic() at panic+0x43/frame 0xfffffe0037a73b20 g_io_deliver() at g_io_deliver+0x386/frame 0xfffffe0037a73b70 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0037a73ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe0037a73bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a73bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a73bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00e57526b8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0037a73350 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0037a73360 db_get_value() at db_get_value+0x4c/frame 0xfffffe0037a733a0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0037a73430 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0037a73450 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0037a734f0 db_command() at db_command+0x25c/frame 0xfffffe0037a735c0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0037a73660 db_command() at db_command+0x25c/frame 0xfffffe0037a73730 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe0037a73740 db_trap() at db_trap+0xe8/frame 0xfffffe0037a737d0 kdb_trap() at kdb_trap+0x157/frame 0xfffffe0037a73850 trap() at trap+0x7d4/frame 0xfffffe0037a73980 calltrap() at calltrap+0x8/frame 0xfffffe0037a73980 --- trap 0x3, rip = 0xffffffff80c13b37, rsp = 0xfffffe0037a73a50, rbp = 0xfffffe0037a73a60 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe0037a73a60 vpanic() at vpanic+0x1a1/frame 0xfffffe0037a73ac0 panic() at panic+0x43/frame 0xfffffe0037a73b20 g_io_deliver() at g_io_deliver+0x386/frame 0xfffffe0037a73b70 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0037a73ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe0037a73bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a73bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a73bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command lockf2 pid 68106 tid 100456 td 0xfffff801c0b006e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e75d5640 mi_switch() at mi_switch+0x164/frame 0xfffffe00e75d5680 sched_preempt() at sched_preempt+0x86/frame 0xfffffe00e75d56b0 ipi_bitmap_handler() at ipi_bitmap_handler+0x64/frame 0xfffffe00e75d56e0 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0xb3/frame 0xfffffe00e75d56e0 --- interrupt, rip = 0xffffffff80b9ecf0, rsp = 0xfffffe00e75d57b0, rbp = 0xfffffe00e75d5850 --- lf_advlockasync() at lf_advlockasync+0xc50/frame 0xfffffe00e75d5850 lf_advlock() at lf_advlock+0x45/frame 0xfffffe00e75d58a0 vop_stdadvlock() at vop_stdadvlock+0xbc/frame 0xfffffe00e75d59a0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x60/frame 0xfffffe00e75d59c0 kern_fcntl() at kern_fcntl+0xb24/frame 0xfffffe00e75d5a50 kern_fcntl_freebsd() at kern_fcntl_freebsd+0xa5/frame 0xfffffe00e75d5ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e75d5bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e75d5bf0 --- syscall (92, FreeBSD ELF64, sys_fcntl), rip = 0x800425e8a, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4d0 --- Tracing command openat pid 68105 tid 100391 td 0xfffff8003506b6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e74956b0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0037a730c0 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0037a730d0 trap() at trap+0x73/frame 0xfffffe0037a73200 calltrap() at calltrap+0x8/frame 0xfffffe0037a73200 --- trap 0xc, rip = 0xffffffff810471a0, rsp = 0xfffffe0037a732d0, rbp = 0xfffffe0037a73360 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe0037a73360 db_get_value() at db_get_value+0x32/frame 0xfffffe0037a733a0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0037a73430 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0037a73450 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0037a734f0 db_command() at db_command+0x25c/frame 0xfffffe0037a735c0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0037a73660 db_command() at db_command+0x25c/frame 0xfffffe0037a73730 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe0037a73740 db_trap() at db_trap+0xe8/frame 0xfffffe0037a737d0 kdb_trap() at kdb_trap+0x157/frame 0xfffffe0037a73850 trap() at trap+0x7d4/frame 0xfffffe0037a73980 calltrap() at calltrap+0x8/frame 0xfffffe0037a73980 --- trap 0x3, rip = 0xffffffff80c13b37, rsp = 0xfffffe0037a73a50, rbp = 0xfffffe0037a73a60 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe0037a73a60 vpanic() at vpanic+0x1a1/frame 0xfffffe0037a73ac0 panic() at panic+0x43/frame 0xfffffe0037a73b20 g_io_deliver() at g_io_deliver+0x386/frame 0xfffffe0037a73b70 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0037a73ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe0037a73bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a73bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a73bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00e74956b8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0037a73350 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0037a73360 db_get_value() at db_get_value+0x4c/frame 0xfffffe0037a733a0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0037a73430 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0037a73450 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0037a734f0 db_command() at db_command+0x25c/frame 0xfffffe0037a735c0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0037a73660 db_command() at db_command+0x25c/frame 0xfffffe0037a73730 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe0037a73740 db_trap() at db_trap+0xe8/frame 0xfffffe0037a737d0 kdb_trap() at kdb_trap+0x157/frame 0xfffffe0037a73850 trap() at trap+0x7d4/frame 0xfffffe0037a73980 calltrap() at calltrap+0x8/frame 0xfffffe0037a73980 --- trap 0x3, rip = 0xffffffff80c13b37, rsp = 0xfffffe0037a73a50, rbp = 0xfffffe0037a73a60 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe0037a73a60 vpanic() at vpanic+0x1a1/frame 0xfffffe0037a73ac0 panic() at panic+0x43/frame 0xfffffe0037a73b20 g_io_deliver() at g_io_deliver+0x386/frame 0xfffffe0037a73b70 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0037a73ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe0037a73bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a73bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a73bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command symlink pid 68104 tid 100509 td 0xfffff80273fcd000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e76c96b0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0037a730c0 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0037a730d0 trap() at trap+0x73/frame 0xfffffe0037a73200 calltrap() at calltrap+0x8/frame 0xfffffe0037a73200 --- trap 0xc, rip = 0xffffffff810471a0, rsp = 0xfffffe0037a732d0, rbp = 0xfffffe0037a73360 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe0037a73360 db_get_value() at db_get_value+0x32/frame 0xfffffe0037a733a0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0037a73430 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0037a73450 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0037a734f0 db_command() at db_command+0x25c/frame 0xfffffe0037a735c0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0037a73660 db_command() at db_command+0x25c/frame 0xfffffe0037a73730 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe0037a73740 db_trap() at db_trap+0xe8/frame 0xfffffe0037a737d0 kdb_trap() at kdb_trap+0x157/frame 0xfffffe0037a73850 trap() at trap+0x7d4/frame 0xfffffe0037a73980 calltrap() at calltrap+0x8/frame 0xfffffe0037a73980 --- trap 0x3, rip = 0xffffffff80c13b37, rsp = 0xfffffe0037a73a50, rbp = 0xfffffe0037a73a60 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe0037a73a60 vpanic() at vpanic+0x1a1/frame 0xfffffe0037a73ac0 panic() at panic+0x43/frame 0xfffffe0037a73b20 g_io_deliver() at g_io_deliver+0x386/frame 0xfffffe0037a73b70 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0037a73ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe0037a73bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a73bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a73bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00e76c96b8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0037a73350 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0037a73360 db_get_value() at db_get_value+0x4c/frame 0xfffffe0037a733a0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0037a73430 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0037a73450 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0037a734f0 db_command() at db_command+0x25c/frame 0xfffffe0037a735c0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0037a73660 db_command() at db_command+0x25c/frame 0xfffffe0037a73730 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe0037a73740 db_trap() at db_trap+0xe8/frame 0xfffffe0037a737d0 kdb_trap() at kdb_trap+0x157/frame 0xfffffe0037a73850 trap() at trap+0x7d4/frame 0xfffffe0037a73980 calltrap() at calltrap+0x8/frame 0xfffffe0037a73980 --- trap 0x3, rip = 0xffffffff80c13b37, rsp = 0xfffffe0037a73a50, rbp = 0xfffffe0037a73a60 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe0037a73a60 vpanic() at vpanic+0x1a1/frame 0xfffffe0037a73ac0 panic() at panic+0x43/frame 0xfffffe0037a73b20 g_io_deliver() at g_io_deliver+0x386/frame 0xfffffe0037a73b70 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0037a73ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe0037a73bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a73bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a73bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command mkfifo pid 68103 tid 100143 td 0xfffff8001d2ff000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e37a7830 mi_switch() at mi_switch+0x164/frame 0xfffffe00e37a7870 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e37a78b0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e37a7910 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e37a7950 _sleep() at _sleep+0x258/frame 0xfffffe00e37a79f0 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe00e37a7a80 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00e37a7ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e37a7bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e37a7bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003c562a, rsp = 0x7fffffffe518, rbp = 0x7fffffffe560 --- Tracing command lockf2 pid 68102 tid 100515 td 0xfffff804fa4a96e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e76b06b0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0037a730c0 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0037a730d0 trap() at trap+0x73/frame 0xfffffe0037a73200 calltrap() at calltrap+0x8/frame 0xfffffe0037a73200 --- trap 0xc, rip = 0xffffffff810471a0, rsp = 0xfffffe0037a732d0, rbp = 0xfffffe0037a73360 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe0037a73360 db_get_value() at db_get_value+0x32/frame 0xfffffe0037a733a0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0037a73430 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0037a73450 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0037a734f0 db_command() at db_command+0x25c/frame 0xfffffe0037a735c0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0037a73660 db_command() at db_command+0x25c/frame 0xfffffe0037a73730 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe0037a73740 db_trap() at db_trap+0xe8/frame 0xfffffe0037a737d0 kdb_trap() at kdb_trap+0x157/frame 0xfffffe0037a73850 trap() at trap+0x7d4/frame 0xfffffe0037a73980 calltrap() at calltrap+0x8/frame 0xfffffe0037a73980 --- trap 0x3, rip = 0xffffffff80c13b37, rsp = 0xfffffe0037a73a50, rbp = 0xfffffe0037a73a60 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe0037a73a60 vpanic() at vpanic+0x1a1/frame 0xfffffe0037a73ac0 panic() at panic+0x43/frame 0xfffffe0037a73b20 g_io_deliver() at g_io_deliver+0x386/frame 0xfffffe0037a73b70 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0037a73ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe0037a73bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a73bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a73bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00e76b06b8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0037a73350 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0037a73360 db_get_value() at db_get_value+0x4c/frame 0xfffffe0037a733a0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0037a73430 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0037a73450 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0037a734f0 db_command() at db_command+0x25c/frame 0xfffffe0037a735c0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0037a73660 db_command() at db_command+0x25c/frame 0xfffffe0037a73730 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe0037a73740 db_trap() at db_trap+0xe8/frame 0xfffffe0037a737d0 kdb_trap() at kdb_trap+0x157/frame 0xfffffe0037a73850 trap() at trap+0x7d4/frame 0xfffffe0037a73980 calltrap() at calltrap+0x8/frame 0xfffffe0037a73980 --- trap 0x3, rip = 0xffffffff80c13b37, rsp = 0xfffffe0037a73a50, rbp = 0xfffffe0037a73a60 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe0037a73a60 vpanic() at vpanic+0x1a1/frame 0xfffffe0037a73ac0 panic() at panic+0x43/frame 0xfffffe0037a73b20 g_io_deliver() at g_io_deliver+0x386/frame 0xfffffe0037a73b70 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0037a73ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe0037a73bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a73bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a73bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command swap pid 68101 tid 100302 td 0xfffff8014febc000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e6347830 mi_switch() at mi_switch+0x164/frame 0xfffffe00e6347870 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e63478b0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e6347910 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e6347950 _sleep() at _sleep+0x258/frame 0xfffffe00e63479f0 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe00e6347a80 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00e6347ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e6347bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e6347bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003c562a, rsp = 0x7fffffffe518, rbp = 0x7fffffffe560 --- Tracing command rename pid 68100 tid 100299 td 0xfffff801a506e000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e6338830 mi_switch() at mi_switch+0x164/frame 0xfffffe00e6338870 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e63388b0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e6338910 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e6338950 _sleep() at _sleep+0x258/frame 0xfffffe00e63389f0 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe00e6338a80 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00e6338ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e6338bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e6338bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003c562a, rsp = 0x7fffffffe518, rbp = 0x7fffffffe560 --- Tracing command mkdir pid 68099 tid 100430 td 0xfffff8042dca26e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e7558830 mi_switch() at mi_switch+0x164/frame 0xfffffe00e7558870 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e75588b0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e7558910 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e7558950 _sleep() at _sleep+0x258/frame 0xfffffe00e75589f0 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe00e7558a80 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00e7558ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e7558bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e7558bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003c562a, rsp = 0x7fffffffe518, rbp = 0x7fffffffe560 --- Tracing command creat pid 68098 tid 100242 td 0xfffff8014fb44000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e57e8830 mi_switch() at mi_switch+0x164/frame 0xfffffe00e57e8870 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e57e88b0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e57e8910 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e57e8950 _sleep() at _sleep+0x258/frame 0xfffffe00e57e89f0 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe00e57e8a80 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00e57e8ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e57e8bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e57e8bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003c562a, rsp = 0x7fffffffe518, rbp = 0x7fffffffe560 --- Tracing command link pid 68096 tid 100151 td 0xfffff8001ddb26e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e37cf830 mi_switch() at mi_switch+0x164/frame 0xfffffe00e37cf870 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e37cf8b0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e37cf910 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e37cf950 _sleep() at _sleep+0x258/frame 0xfffffe00e37cf9f0 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe00e37cfa80 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00e37cfac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e37cfbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e37cfbf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003c562a, rsp = 0x7fffffffe518, rbp = 0x7fffffffe560 --- Tracing command fts pid 68095 tid 100466 td 0xfffff80390b8d000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e7607830 mi_switch() at mi_switch+0x164/frame 0xfffffe00e7607870 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e76078b0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e7607910 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e7607950 _sleep() at _sleep+0x258/frame 0xfffffe00e76079f0 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe00e7607a80 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00e7607ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e7607bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e7607bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003c362a, rsp = 0x7fffffffe518, rbp = 0x7fffffffe560 --- Tracing command rw pid 68094 tid 100439 td 0xfffff8036e85e6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e7585830 mi_switch() at mi_switch+0x164/frame 0xfffffe00e7585870 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e75858b0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e7585910 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e7585950 _sleep() at _sleep+0x258/frame 0xfffffe00e75859f0 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe00e7585a80 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00e7585ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e7585bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e7585bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003c562a, rsp = 0x7fffffffe518, rbp = 0x7fffffffe560 --- Tracing command openat pid 68093 tid 100271 td 0xfffff8014fd566e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e62ac830 mi_switch() at mi_switch+0x164/frame 0xfffffe00e62ac870 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e62ac8b0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e62ac910 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e62ac950 _sleep() at _sleep+0x258/frame 0xfffffe00e62ac9f0 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe00e62aca80 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00e62acac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e62acbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e62acbf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003c562a, rsp = 0x7fffffffe518, rbp = 0x7fffffffe560 --- Tracing command symlink pid 68092 tid 100512 td 0xfffff8001d9e6000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e76a1830 mi_switch() at mi_switch+0x164/frame 0xfffffe00e76a1870 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e76a18b0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e76a1910 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e76a1950 _sleep() at _sleep+0x258/frame 0xfffffe00e76a19f0 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe00e76a1a80 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00e76a1ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e76a1bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e76a1bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003c562a, rsp = 0x7fffffffe518, rbp = 0x7fffffffe560 --- Tracing command lockf2 pid 68091 tid 100313 td 0xfffff801a51ee000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e637e830 mi_switch() at mi_switch+0x164/frame 0xfffffe00e637e870 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e637e8b0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e637e910 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e637e950 _sleep() at _sleep+0x258/frame 0xfffffe00e637e9f0 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe00e637ea80 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00e637eac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e637ebf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e637ebf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003c562a, rsp = 0x7fffffffe518, rbp = 0x7fffffffe560 --- Tracing command run pid 68090 tid 100154 td 0xfffff8001dec66e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e37de6b0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0037a730c0 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0037a730d0 trap() at trap+0x73/frame 0xfffffe0037a73200 calltrap() at calltrap+0x8/frame 0xfffffe0037a73200 --- trap 0xc, rip = 0xffffffff810471a0, rsp = 0xfffffe0037a732d0, rbp = 0xfffffe0037a73360 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe0037a73360 db_get_value() at db_get_value+0x32/frame 0xfffffe0037a733a0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0037a73430 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0037a73450 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0037a734f0 db_command() at db_command+0x25c/frame 0xfffffe0037a735c0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0037a73660 db_command() at db_command+0x25c/frame 0xfffffe0037a73730 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe0037a73740 db_trap() at db_trap+0xe8/frame 0xfffffe0037a737d0 kdb_trap() at kdb_trap+0x157/frame 0xfffffe0037a73850 trap() at trap+0x7d4/frame 0xfffffe0037a73980 calltrap() at calltrap+0x8/frame 0xfffffe0037a73980 --- trap 0x3, rip = 0xffffffff80c13b37, rsp = 0xfffffe0037a73a50, rbp = 0xfffffe0037a73a60 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe0037a73a60 vpanic() at vpanic+0x1a1/frame 0xfffffe0037a73ac0 panic() at panic+0x43/frame 0xfffffe0037a73b20 g_io_deliver() at g_io_deliver+0x386/frame 0xfffffe0037a73b70 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0037a73ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe0037a73bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a73bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a73bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00e37de6b8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0037a73350 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0037a73360 db_get_value() at db_get_value+0x4c/frame 0xfffffe0037a733a0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0037a73430 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0037a73450 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0037a734f0 db_command() at db_command+0x25c/frame 0xfffffe0037a735c0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0037a73660 db_command() at db_command+0x25c/frame 0xfffffe0037a73730 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe0037a73740 db_trap() at db_trap+0xe8/frame 0xfffffe0037a737d0 kdb_trap() at kdb_trap+0x157/frame 0xfffffe0037a73850 trap() at trap+0x7d4/frame 0xfffffe0037a73980 calltrap() at calltrap+0x8/frame 0xfffffe0037a73980 --- trap 0x3, rip = 0xffffffff80c13b37, rsp = 0xfffffe0037a73a50, rbp = 0xfffffe0037a73a60 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe0037a73a60 vpanic() at vpanic+0x1a1/frame 0xfffffe0037a73ac0 panic() at panic+0x43/frame 0xfffffe0037a73b20 g_io_deliver() at g_io_deliver+0x386/frame 0xfffffe0037a73b70 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0037a73ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe0037a73bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a73bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a73bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command run pid 68089 tid 100437 td 0xfffff803e2f6d6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e757b6b0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0037a730c0 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0037a730d0 trap() at trap+0x73/frame 0xfffffe0037a73200 calltrap() at calltrap+0x8/frame 0xfffffe0037a73200 --- trap 0xc, rip = 0xffffffff810471a0, rsp = 0xfffffe0037a732d0, rbp = 0xfffffe0037a73360 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe0037a73360 db_get_value() at db_get_value+0x32/frame 0xfffffe0037a733a0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0037a73430 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0037a73450 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0037a734f0 db_command() at db_command+0x25c/frame 0xfffffe0037a735c0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0037a73660 db_command() at db_command+0x25c/frame 0xfffffe0037a73730 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe0037a73740 db_trap() at db_trap+0xe8/frame 0xfffffe0037a737d0 kdb_trap() at kdb_trap+0x157/frame 0xfffffe0037a73850 trap() at trap+0x7d4/frame 0xfffffe0037a73980 calltrap() at calltrap+0x8/frame 0xfffffe0037a73980 --- trap 0x3, rip = 0xffffffff80c13b37, rsp = 0xfffffe0037a73a50, rbp = 0xfffffe0037a73a60 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe0037a73a60 vpanic() at vpanic+0x1a1/frame 0xfffffe0037a73ac0 panic() at panic+0x43/frame 0xfffffe0037a73b20 g_io_deliver() at g_io_deliver+0x386/frame 0xfffffe0037a73b70 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0037a73ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe0037a73bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a73bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a73bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00e757b6b8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0037a73350 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0037a73360 db_get_value() at db_get_value+0x4c/frame 0xfffffe0037a733a0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0037a73430 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0037a73450 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0037a734f0 db_command() at db_command+0x25c/frame 0xfffffe0037a735c0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0037a73660 db_command() at db_command+0x25c/frame 0xfffffe0037a73730 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe0037a73740 db_trap() at db_trap+0xe8/frame 0xfffffe0037a737d0 kdb_trap() at kdb_trap+0x157/frame 0xfffffe0037a73850 trap() at trap+0x7d4/frame 0xfffffe0037a73980 calltrap() at calltrap+0x8/frame 0xfffffe0037a73980 --- trap 0x3, rip = 0xffffffff80c13b37, rsp = 0xfffffe0037a73a50, rbp = 0xfffffe0037a73a60 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe0037a73a60 vpanic() at vpanic+0x1a1/frame 0xfffffe0037a73ac0 panic() at panic+0x43/frame 0xfffffe0037a73b20 g_io_deliver() at g_io_deliver+0x386/frame 0xfffffe0037a73b70 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0037a73ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe0037a73bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a73bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a73bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command run pid 68088 tid 100426 td 0xfffff8046afde000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e7544830 mi_switch() at mi_switch+0x164/frame 0xfffffe00e7544870 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e75448b0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e7544910 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e7544950 _sleep() at _sleep+0x258/frame 0xfffffe00e75449f0 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe00e7544a80 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00e7544ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e7544bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e7544bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003c362a, rsp = 0x7fffffffe3a8, rbp = 0x7fffffffe3f0 --- Tracing command sh pid 68080 tid 100278 td 0xfffff8014fa35000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e62cf6b0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0037a730c0 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0037a730d0 trap() at trap+0x73/frame 0xfffffe0037a73200 calltrap() at calltrap+0x8/frame 0xfffffe0037a73200 --- trap 0xc, rip = 0xffffffff810471a0, rsp = 0xfffffe0037a732d0, rbp = 0xfffffe0037a73360 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe0037a73360 db_get_value() at db_get_value+0x32/frame 0xfffffe0037a733a0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0037a73430 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0037a73450 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0037a734f0 db_command() at db_command+0x25c/frame 0xfffffe0037a735c0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0037a73660 db_command() at db_command+0x25c/frame 0xfffffe0037a73730 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe0037a73740 db_trap() at db_trap+0xe8/frame 0xfffffe0037a737d0 kdb_trap() at kdb_trap+0x157/frame 0xfffffe0037a73850 trap() at trap+0x7d4/frame 0xfffffe0037a73980 calltrap() at calltrap+0x8/frame 0xfffffe0037a73980 --- trap 0x3, rip = 0xffffffff80c13b37, rsp = 0xfffffe0037a73a50, rbp = 0xfffffe0037a73a60 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe0037a73a60 vpanic() at vpanic+0x1a1/frame 0xfffffe0037a73ac0 panic() at panic+0x43/frame 0xfffffe0037a73b20 g_io_deliver() at g_io_deliver+0x386/frame 0xfffffe0037a73b70 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0037a73ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe0037a73bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a73bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a73bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00e62cf6b8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0037a73350 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0037a73360 db_get_value() at db_get_value+0x4c/frame 0xfffffe0037a733a0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0037a73430 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0037a73450 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0037a734f0 db_command() at db_command+0x25c/frame 0xfffffe0037a735c0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0037a73660 db_command() at db_command+0x25c/frame 0xfffffe0037a73730 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe0037a73740 db_trap() at db_trap+0xe8/frame 0xfffffe0037a737d0 kdb_trap() at kdb_trap+0x157/frame 0xfffffe0037a73850 trap() at trap+0x7d4/frame 0xfffffe0037a73980 calltrap() at calltrap+0x8/frame 0xfffffe0037a73980 --- trap 0x3, rip = 0xffffffff80c13b37, rsp = 0xfffffe0037a73a50, rbp = 0xfffffe0037a73a60 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe0037a73a60 vpanic() at vpanic+0x1a1/frame 0xfffffe0037a73ac0 panic() at panic+0x43/frame 0xfffffe0037a73b20 g_io_deliver() at g_io_deliver+0x386/frame 0xfffffe0037a73b70 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0037a73ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe0037a73bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a73bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a73bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command su pid 68079 tid 100471 td 0xfffff8048f9656e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e76206b0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0037a730c0 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0037a730d0 trap() at trap+0x73/frame 0xfffffe0037a73200 calltrap() at calltrap+0x8/frame 0xfffffe0037a73200 --- trap 0xc, rip = 0xffffffff810471a0, rsp = 0xfffffe0037a732d0, rbp = 0xfffffe0037a73360 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe0037a73360 db_get_value() at db_get_value+0x32/frame 0xfffffe0037a733a0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0037a73430 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0037a73450 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0037a734f0 db_command() at db_command+0x25c/frame 0xfffffe0037a735c0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0037a73660 db_command() at db_command+0x25c/frame 0xfffffe0037a73730 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe0037a73740 db_trap() at db_trap+0xe8/frame 0xfffffe0037a737d0 kdb_trap() at kdb_trap+0x157/frame 0xfffffe0037a73850 trap() at trap+0x7d4/frame 0xfffffe0037a73980 calltrap() at calltrap+0x8/frame 0xfffffe0037a73980 --- trap 0x3, rip = 0xffffffff80c13b37, rsp = 0xfffffe0037a73a50, rbp = 0xfffffe0037a73a60 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe0037a73a60 vpanic() at vpanic+0x1a1/frame 0xfffffe0037a73ac0 panic() at panic+0x43/frame 0xfffffe0037a73b20 g_io_deliver() at g_io_deliver+0x386/frame 0xfffffe0037a73b70 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0037a73ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe0037a73bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a73bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a73bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00e76206b8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0037a73350 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0037a73360 db_get_value() at db_get_value+0x4c/frame 0xfffffe0037a733a0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0037a73430 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0037a73450 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0037a734f0 db_command() at db_command+0x25c/frame 0xfffffe0037a735c0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0037a73660 db_command() at db_command+0x25c/frame 0xfffffe0037a73730 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe0037a73740 db_trap() at db_trap+0xe8/frame 0xfffffe0037a737d0 kdb_trap() at kdb_trap+0x157/frame 0xfffffe0037a73850 trap() at trap+0x7d4/frame 0xfffffe0037a73980 calltrap() at calltrap+0x8/frame 0xfffffe0037a73980 --- trap 0x3, rip = 0xffffffff80c13b37, rsp = 0xfffffe0037a73a50, rbp = 0xfffffe0037a73a60 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe0037a73a60 vpanic() at vpanic+0x1a1/frame 0xfffffe0037a73ac0 panic() at panic+0x43/frame 0xfffffe0037a73b20 g_io_deliver() at g_io_deliver+0x386/frame 0xfffffe0037a73b70 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0037a73ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe0037a73bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a73bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a73bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command g_raid3 data pid 68072 tid 100449 td 0xfffff8001ddb5000 (CPU 11) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1ebdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1ebdf0 trap() at trap+0x61/frame 0xfffffe003e1ebf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1ebf20 --- trap 0x13, rip = 0xffffffff80f2b672, rsp = 0xfffffe00e577aa30, rbp = 0xfffffe00e577aa30 --- PHYS_TO_VM_PAGE() at PHYS_TO_VM_PAGE+0x12/frame 0xfffffe00e577aa30 item_ctor() at item_ctor+0xb8/frame 0xfffffe00e577aa90 uma_zalloc_arg() at uma_zalloc_arg+0x1a9/frame 0xfffffe00e577aad0 g_clone_bio() at g_clone_bio+0x1d/frame 0xfffffe00e577aaf0 g_raid3_worker() at g_raid3_worker+0x77f/frame 0xfffffe00e577abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e577abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e577abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command md12 pid 68069 tid 100323 td 0xfffff801a51cb000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e63b0a30 mi_switch() at mi_switch+0x164/frame 0xfffffe00e63b0a70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e63b0ab0 _sleep() at _sleep+0x2cd/frame 0xfffffe00e63b0b50 md_kthread() at md_kthread+0xd5/frame 0xfffffe00e63b0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e63b0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e63b0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command md11 pid 68065 tid 100265 td 0xfffff8014fcc66e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e628ea30 mi_switch() at mi_switch+0x164/frame 0xfffffe00e628ea70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e628eab0 _sleep() at _sleep+0x2cd/frame 0xfffffe00e628eb50 md_kthread() at md_kthread+0xd5/frame 0xfffffe00e628ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e628ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e628ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command md10 pid 68061 tid 100403 td 0xfffff8014feba6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e74d1a30 mi_switch() at mi_switch+0x164/frame 0xfffffe00e74d1a70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e74d1ab0 _sleep() at _sleep+0x2cd/frame 0xfffffe00e74d1b50 md_kthread() at md_kthread+0xd5/frame 0xfffffe00e74d1bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e74d1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e74d1bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command tee pid 68051 tid 100340 td 0xfffff801a5397000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e74097f0 mi_switch() at mi_switch+0x164/frame 0xfffffe00e7409830 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e7409870 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e74098d0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e74098e0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e7409980 pipe_read() at pipe_read+0x428/frame 0xfffffe00e74099e0 dofileread() at dofileread+0x81/frame 0xfffffe00e7409a30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e7409a70 sys_read() at sys_read+0x83/frame 0xfffffe00e7409ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e7409bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e7409bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800419f0a, rsp = 0x7fffffffe6b8, rbp = 0x7fffffffe700 --- Tracing command sh pid 68050 tid 100188 td 0xfffff800377ed6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e56c76b0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0037a730c0 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0037a730d0 trap() at trap+0x73/frame 0xfffffe0037a73200 calltrap() at calltrap+0x8/frame 0xfffffe0037a73200 --- trap 0xc, rip = 0xffffffff810471a0, rsp = 0xfffffe0037a732d0, rbp = 0xfffffe0037a73360 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe0037a73360 db_get_value() at db_get_value+0x32/frame 0xfffffe0037a733a0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0037a73430 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0037a73450 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0037a734f0 db_command() at db_command+0x25c/frame 0xfffffe0037a735c0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0037a73660 db_command() at db_command+0x25c/frame 0xfffffe0037a73730 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe0037a73740 db_trap() at db_trap+0xe8/frame 0xfffffe0037a737d0 kdb_trap() at kdb_trap+0x157/frame 0xfffffe0037a73850 trap() at trap+0x7d4/frame 0xfffffe0037a73980 calltrap() at calltrap+0x8/frame 0xfffffe0037a73980 --- trap 0x3, rip = 0xffffffff80c13b37, rsp = 0xfffffe0037a73a50, rbp = 0xfffffe0037a73a60 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe0037a73a60 vpanic() at vpanic+0x1a1/frame 0xfffffe0037a73ac0 panic() at panic+0x43/frame 0xfffffe0037a73b20 g_io_deliver() at g_io_deliver+0x386/frame 0xfffffe0037a73b70 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0037a73ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe0037a73bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a73bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a73bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00e56c76b8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0037a73350 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0037a73360 db_get_value() at db_get_value+0x4c/frame 0xfffffe0037a733a0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0037a73430 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0037a73450 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0037a734f0 db_command() at db_command+0x25c/frame 0xfffffe0037a735c0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0037a73660 db_command() at db_command+0x25c/frame 0xfffffe0037a73730 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe0037a73740 db_trap() at db_trap+0xe8/frame 0xfffffe0037a737d0 kdb_trap() at kdb_trap+0x157/frame 0xfffffe0037a73850 trap() at trap+0x7d4/frame 0xfffffe0037a73980 calltrap() at calltrap+0x8/frame 0xfffffe0037a73980 --- trap 0x3, rip = 0xffffffff80c13b37, rsp = 0xfffffe0037a73a50, rbp = 0xfffffe0037a73a60 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe0037a73a60 vpanic() at vpanic+0x1a1/frame 0xfffffe0037a73ac0 panic() at panic+0x43/frame 0xfffffe0037a73b20 g_io_deliver() at g_io_deliver+0x386/frame 0xfffffe0037a73b70 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0037a73ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe0037a73bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a73bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a73bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sh pid 68049 tid 100422 td 0xfffff8046af856e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e75306b0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0037a730c0 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0037a730d0 trap() at trap+0x73/frame 0xfffffe0037a73200 calltrap() at calltrap+0x8/frame 0xfffffe0037a73200 --- trap 0xc, rip = 0xffffffff810471a0, rsp = 0xfffffe0037a732d0, rbp = 0xfffffe0037a73360 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe0037a73360 db_get_value() at db_get_value+0x32/frame 0xfffffe0037a733a0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0037a73430 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0037a73450 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0037a734f0 db_command() at db_command+0x25c/frame 0xfffffe0037a735c0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0037a73660 db_command() at db_command+0x25c/frame 0xfffffe0037a73730 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe0037a73740 db_trap() at db_trap+0xe8/frame 0xfffffe0037a737d0 kdb_trap() at kdb_trap+0x157/frame 0xfffffe0037a73850 trap() at trap+0x7d4/frame 0xfffffe0037a73980 calltrap() at calltrap+0x8/frame 0xfffffe0037a73980 --- trap 0x3, rip = 0xffffffff80c13b37, rsp = 0xfffffe0037a73a50, rbp = 0xfffffe0037a73a60 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe0037a73a60 vpanic() at vpanic+0x1a1/frame 0xfffffe0037a73ac0 panic() at panic+0x43/frame 0xfffffe0037a73b20 g_io_deliver() at g_io_deliver+0x386/frame 0xfffffe0037a73b70 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0037a73ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe0037a73bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a73bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a73bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00e75306b8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0037a73350 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0037a73360 db_get_value() at db_get_value+0x4c/frame 0xfffffe0037a733a0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0037a73430 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0037a73450 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0037a734f0 db_command() at db_command+0x25c/frame 0xfffffe0037a735c0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0037a73660 db_command() at db_command+0x25c/frame 0xfffffe0037a73730 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe0037a73740 db_trap() at db_trap+0xe8/frame 0xfffffe0037a737d0 kdb_trap() at kdb_trap+0x157/frame 0xfffffe0037a73850 trap() at trap+0x7d4/frame 0xfffffe0037a73980 calltrap() at calltrap+0x8/frame 0xfffffe0037a73980 --- trap 0x3, rip = 0xffffffff80c13b37, rsp = 0xfffffe0037a73a50, rbp = 0xfffffe0037a73a60 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe0037a73a60 vpanic() at vpanic+0x1a1/frame 0xfffffe0037a73ac0 panic() at panic+0x43/frame 0xfffffe0037a73b20 g_io_deliver() at g_io_deliver+0x386/frame 0xfffffe0037a73b70 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0037a73ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe0037a73bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a73bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a73bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sh pid 2506 tid 100234 td 0xfffff8003f846000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e57c07f0 mi_switch() at mi_switch+0x164/frame 0xfffffe00e57c0830 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e57c0870 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e57c08d0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e57c08e0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e57c0980 pipe_read() at pipe_read+0x428/frame 0xfffffe00e57c09e0 dofileread() at dofileread+0x81/frame 0xfffffe00e57c0a30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e57c0a70 sys_read() at sys_read+0x83/frame 0xfffffe00e57c0ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e57c0bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e57c0bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800478f0a, rsp = 0x7fffffffe228, rbp = 0x7fffffffe330 --- Tracing command awk pid 2504 tid 100209 td 0xfffff8003f85d000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e57487f0 mi_switch() at mi_switch+0x164/frame 0xfffffe00e5748830 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e5748870 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e57488d0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e57488e0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e5748980 pipe_read() at pipe_read+0x428/frame 0xfffffe00e57489e0 dofileread() at dofileread+0x81/frame 0xfffffe00e5748a30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e5748a70 sys_read() at sys_read+0x83/frame 0xfffffe00e5748ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e5748bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5748bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80047df0a, rsp = 0x7fffffffe328, rbp = 0x7fffffffe340 --- Tracing command sh pid 2503 tid 100223 td 0xfffff8003f8466e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e578e6b0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0037a730c0 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0037a730d0 trap() at trap+0x73/frame 0xfffffe0037a73200 calltrap() at calltrap+0x8/frame 0xfffffe0037a73200 --- trap 0xc, rip = 0xffffffff810471a0, rsp = 0xfffffe0037a732d0, rbp = 0xfffffe0037a73360 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe0037a73360 db_get_value() at db_get_value+0x32/frame 0xfffffe0037a733a0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0037a73430 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0037a73450 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0037a734f0 db_command() at db_command+0x25c/frame 0xfffffe0037a735c0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0037a73660 db_command() at db_command+0x25c/frame 0xfffffe0037a73730 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe0037a73740 db_trap() at db_trap+0xe8/frame 0xfffffe0037a737d0 kdb_trap() at kdb_trap+0x157/frame 0xfffffe0037a73850 trap() at trap+0x7d4/frame 0xfffffe0037a73980 calltrap() at calltrap+0x8/frame 0xfffffe0037a73980 --- trap 0x3, rip = 0xffffffff80c13b37, rsp = 0xfffffe0037a73a50, rbp = 0xfffffe0037a73a60 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe0037a73a60 vpanic() at vpanic+0x1a1/frame 0xfffffe0037a73ac0 panic() at panic+0x43/frame 0xfffffe0037a73b20 g_io_deliver() at g_io_deliver+0x386/frame 0xfffffe0037a73b70 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0037a73ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe0037a73bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a73bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a73bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00e578e6b8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0037a73350 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0037a73360 db_get_value() at db_get_value+0x4c/frame 0xfffffe0037a733a0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0037a73430 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0037a73450 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0037a734f0 db_command() at db_command+0x25c/frame 0xfffffe0037a735c0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0037a73660 db_command() at db_command+0x25c/frame 0xfffffe0037a73730 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe0037a73740 db_trap() at db_trap+0xe8/frame 0xfffffe0037a737d0 kdb_trap() at kdb_trap+0x157/frame 0xfffffe0037a73850 trap() at trap+0x7d4/frame 0xfffffe0037a73980 calltrap() at calltrap+0x8/frame 0xfffffe0037a73980 --- trap 0x3, rip = 0xffffffff80c13b37, rsp = 0xfffffe0037a73a50, rbp = 0xfffffe0037a73a60 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe0037a73a60 vpanic() at vpanic+0x1a1/frame 0xfffffe0037a73ac0 panic() at panic+0x43/frame 0xfffffe0037a73b20 g_io_deliver() at g_io_deliver+0x386/frame 0xfffffe0037a73b70 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0037a73ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe0037a73bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a73bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a73bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sh pid 2470 tid 100203 td 0xfffff800377ee000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e571e6b0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0037a730c0 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0037a730d0 trap() at trap+0x73/frame 0xfffffe0037a73200 calltrap() at calltrap+0x8/frame 0xfffffe0037a73200 --- trap 0xc, rip = 0xffffffff810471a0, rsp = 0xfffffe0037a732d0, rbp = 0xfffffe0037a73360 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe0037a73360 db_get_value() at db_get_value+0x32/frame 0xfffffe0037a733a0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0037a73430 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0037a73450 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0037a734f0 db_command() at db_command+0x25c/frame 0xfffffe0037a735c0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0037a73660 db_command() at db_command+0x25c/frame 0xfffffe0037a73730 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe0037a73740 db_trap() at db_trap+0xe8/frame 0xfffffe0037a737d0 kdb_trap() at kdb_trap+0x157/frame 0xfffffe0037a73850 trap() at trap+0x7d4/frame 0xfffffe0037a73980 calltrap() at calltrap+0x8/frame 0xfffffe0037a73980 --- trap 0x3, rip = 0xffffffff80c13b37, rsp = 0xfffffe0037a73a50, rbp = 0xfffffe0037a73a60 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe0037a73a60 vpanic() at vpanic+0x1a1/frame 0xfffffe0037a73ac0 panic() at panic+0x43/frame 0xfffffe0037a73b20 g_io_deliver() at g_io_deliver+0x386/frame 0xfffffe0037a73b70 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0037a73ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe0037a73bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a73bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a73bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00e571e6b8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0037a73350 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0037a73360 db_get_value() at db_get_value+0x4c/frame 0xfffffe0037a733a0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0037a73430 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0037a73450 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0037a734f0 db_command() at db_command+0x25c/frame 0xfffffe0037a735c0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0037a73660 db_command() at db_command+0x25c/frame 0xfffffe0037a73730 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe0037a73740 db_trap() at db_trap+0xe8/frame 0xfffffe0037a737d0 kdb_trap() at kdb_trap+0x157/frame 0xfffffe0037a73850 trap() at trap+0x7d4/frame 0xfffffe0037a73980 calltrap() at calltrap+0x8/frame 0xfffffe0037a73980 --- trap 0x3, rip = 0xffffffff80c13b37, rsp = 0xfffffe0037a73a50, rbp = 0xfffffe0037a73a60 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe0037a73a60 vpanic() at vpanic+0x1a1/frame 0xfffffe0037a73ac0 panic() at panic+0x43/frame 0xfffffe0037a73b20 g_io_deliver() at g_io_deliver+0x386/frame 0xfffffe0037a73b70 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0037a73ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe0037a73bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a73bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a73bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sh pid 2359 tid 100221 td 0xfffff8003f028000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e57846b0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0037a730c0 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0037a730d0 trap() at trap+0x73/frame 0xfffffe0037a73200 calltrap() at calltrap+0x8/frame 0xfffffe0037a73200 --- trap 0xc, rip = 0xffffffff810471a0, rsp = 0xfffffe0037a732d0, rbp = 0xfffffe0037a73360 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe0037a73360 db_get_value() at db_get_value+0x32/frame 0xfffffe0037a733a0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0037a73430 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0037a73450 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0037a734f0 db_command() at db_command+0x25c/frame 0xfffffe0037a735c0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0037a73660 db_command() at db_command+0x25c/frame 0xfffffe0037a73730 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe0037a73740 db_trap() at db_trap+0xe8/frame 0xfffffe0037a737d0 kdb_trap() at kdb_trap+0x157/frame 0xfffffe0037a73850 trap() at trap+0x7d4/frame 0xfffffe0037a73980 calltrap() at calltrap+0x8/frame 0xfffffe0037a73980 --- trap 0x3, rip = 0xffffffff80c13b37, rsp = 0xfffffe0037a73a50, rbp = 0xfffffe0037a73a60 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe0037a73a60 vpanic() at vpanic+0x1a1/frame 0xfffffe0037a73ac0 panic() at panic+0x43/frame 0xfffffe0037a73b20 g_io_deliver() at g_io_deliver+0x386/frame 0xfffffe0037a73b70 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0037a73ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe0037a73bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a73bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a73bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00e57846b8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0037a73350 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0037a73360 db_get_value() at db_get_value+0x4c/frame 0xfffffe0037a733a0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0037a73430 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0037a73450 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0037a734f0 db_command() at db_command+0x25c/frame 0xfffffe0037a735c0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0037a73660 db_command() at db_command+0x25c/frame 0xfffffe0037a73730 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe0037a73740 db_trap() at db_trap+0xe8/frame 0xfffffe0037a737d0 kdb_trap() at kdb_trap+0x157/frame 0xfffffe0037a73850 trap() at trap+0x7d4/frame 0xfffffe0037a73980 calltrap() at calltrap+0x8/frame 0xfffffe0037a73980 --- trap 0x3, rip = 0xffffffff80c13b37, rsp = 0xfffffe0037a73a50, rbp = 0xfffffe0037a73a60 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe0037a73a60 vpanic() at vpanic+0x1a1/frame 0xfffffe0037a73ac0 panic() at panic+0x43/frame 0xfffffe0037a73b20 g_io_deliver() at g_io_deliver+0x386/frame 0xfffffe0037a73b70 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0037a73ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe0037a73bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a73bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a73bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bash pid 2357 tid 100177 td 0xfffff8001d9db000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e56606b0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0037a730c0 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0037a730d0 trap() at trap+0x73/frame 0xfffffe0037a73200 calltrap() at calltrap+0x8/frame 0xfffffe0037a73200 --- trap 0xc, rip = 0xffffffff810471a0, rsp = 0xfffffe0037a732d0, rbp = 0xfffffe0037a73360 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe0037a73360 db_get_value() at db_get_value+0x32/frame 0xfffffe0037a733a0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0037a73430 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0037a73450 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0037a734f0 db_command() at db_command+0x25c/frame 0xfffffe0037a735c0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0037a73660 db_command() at db_command+0x25c/frame 0xfffffe0037a73730 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe0037a73740 db_trap() at db_trap+0xe8/frame 0xfffffe0037a737d0 kdb_trap() at kdb_trap+0x157/frame 0xfffffe0037a73850 trap() at trap+0x7d4/frame 0xfffffe0037a73980 calltrap() at calltrap+0x8/frame 0xfffffe0037a73980 --- trap 0x3, rip = 0xffffffff80c13b37, rsp = 0xfffffe0037a73a50, rbp = 0xfffffe0037a73a60 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe0037a73a60 vpanic() at vpanic+0x1a1/frame 0xfffffe0037a73ac0 panic() at panic+0x43/frame 0xfffffe0037a73b20 g_io_deliver() at g_io_deliver+0x386/frame 0xfffffe0037a73b70 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0037a73ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe0037a73bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a73bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a73bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00e56606b8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0037a73350 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0037a73360 db_get_value() at db_get_value+0x4c/frame 0xfffffe0037a733a0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0037a73430 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0037a73450 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0037a734f0 db_command() at db_command+0x25c/frame 0xfffffe0037a735c0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0037a73660 db_command() at db_command+0x25c/frame 0xfffffe0037a73730 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe0037a73740 db_trap() at db_trap+0xe8/frame 0xfffffe0037a737d0 kdb_trap() at kdb_trap+0x157/frame 0xfffffe0037a73850 trap() at trap+0x7d4/frame 0xfffffe0037a73980 calltrap() at calltrap+0x8/frame 0xfffffe0037a73980 --- trap 0x3, rip = 0xffffffff80c13b37, rsp = 0xfffffe0037a73a50, rbp = 0xfffffe0037a73a60 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe0037a73a60 vpanic() at vpanic+0x1a1/frame 0xfffffe0037a73ac0 panic() at panic+0x43/frame 0xfffffe0037a73b20 g_io_deliver() at g_io_deliver+0x386/frame 0xfffffe0037a73b70 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0037a73ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe0037a73bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a73bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a73bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command csh pid 2355 tid 100190 td 0xfffff8001dcf86e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e56d18a0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0037a730c0 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0037a730d0 trap() at trap+0x73/frame 0xfffffe0037a73200 calltrap() at calltrap+0x8/frame 0xfffffe0037a73200 --- trap 0xc, rip = 0xffffffff810471a0, rsp = 0xfffffe0037a732d0, rbp = 0xfffffe0037a73360 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe0037a73360 db_get_value() at db_get_value+0x32/frame 0xfffffe0037a733a0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0037a73430 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0037a73450 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0037a734f0 db_command() at db_command+0x25c/frame 0xfffffe0037a735c0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0037a73660 db_command() at db_command+0x25c/frame 0xfffffe0037a73730 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe0037a73740 db_trap() at db_trap+0xe8/frame 0xfffffe0037a737d0 kdb_trap() at kdb_trap+0x157/frame 0xfffffe0037a73850 trap() at trap+0x7d4/frame 0xfffffe0037a73980 calltrap() at calltrap+0x8/frame 0xfffffe0037a73980 --- trap 0x3, rip = 0xffffffff80c13b37, rsp = 0xfffffe0037a73a50, rbp = 0xfffffe0037a73a60 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe0037a73a60 vpanic() at vpanic+0x1a1/frame 0xfffffe0037a73ac0 panic() at panic+0x43/frame 0xfffffe0037a73b20 g_io_deliver() at g_io_deliver+0x386/frame 0xfffffe0037a73b70 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0037a73ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe0037a73bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a73bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a73bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00e56d18a8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0037a73350 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0037a73360 db_get_value() at db_get_value+0x4c/frame 0xfffffe0037a733a0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0037a73430 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0037a73450 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0037a734f0 db_command() at db_command+0x25c/frame 0xfffffe0037a735c0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0037a73660 db_command() at db_command+0x25c/frame 0xfffffe0037a73730 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe0037a73740 db_trap() at db_trap+0xe8/frame 0xfffffe0037a737d0 kdb_trap() at kdb_trap+0x157/frame 0xfffffe0037a73850 trap() at trap+0x7d4/frame 0xfffffe0037a73980 calltrap() at calltrap+0x8/frame 0xfffffe0037a73980 --- trap 0x3, rip = 0xffffffff80c13b37, rsp = 0xfffffe0037a73a50, rbp = 0xfffffe0037a73a60 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe0037a73a60 vpanic() at vpanic+0x1a1/frame 0xfffffe0037a73ac0 panic() at panic+0x43/frame 0xfffffe0037a73b20 g_io_deliver() at g_io_deliver+0x386/frame 0xfffffe0037a73b70 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0037a73ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe0037a73bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a73bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a73bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command su pid 2354 tid 100173 td 0xfffff800351a5000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e564c6b0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0037a730c0 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0037a730d0 trap() at trap+0x73/frame 0xfffffe0037a73200 calltrap() at calltrap+0x8/frame 0xfffffe0037a73200 --- trap 0xc, rip = 0xffffffff810471a0, rsp = 0xfffffe0037a732d0, rbp = 0xfffffe0037a73360 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe0037a73360 db_get_value() at db_get_value+0x32/frame 0xfffffe0037a733a0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0037a73430 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0037a73450 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0037a734f0 db_command() at db_command+0x25c/frame 0xfffffe0037a735c0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0037a73660 db_command() at db_command+0x25c/frame 0xfffffe0037a73730 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe0037a73740 db_trap() at db_trap+0xe8/frame 0xfffffe0037a737d0 kdb_trap() at kdb_trap+0x157/frame 0xfffffe0037a73850 trap() at trap+0x7d4/frame 0xfffffe0037a73980 calltrap() at calltrap+0x8/frame 0xfffffe0037a73980 --- trap 0x3, rip = 0xffffffff80c13b37, rsp = 0xfffffe0037a73a50, rbp = 0xfffffe0037a73a60 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe0037a73a60 vpanic() at vpanic+0x1a1/frame 0xfffffe0037a73ac0 panic() at panic+0x43/frame 0xfffffe0037a73b20 g_io_deliver() at g_io_deliver+0x386/frame 0xfffffe0037a73b70 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0037a73ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe0037a73bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a73bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a73bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00e564c6b8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0037a73350 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0037a73360 db_get_value() at db_get_value+0x4c/frame 0xfffffe0037a733a0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0037a73430 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0037a73450 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0037a734f0 db_command() at db_command+0x25c/frame 0xfffffe0037a735c0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0037a73660 db_command() at db_command+0x25c/frame 0xfffffe0037a73730 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe0037a73740 db_trap() at db_trap+0xe8/frame 0xfffffe0037a737d0 kdb_trap() at kdb_trap+0x157/frame 0xfffffe0037a73850 trap() at trap+0x7d4/frame 0xfffffe0037a73980 calltrap() at calltrap+0x8/frame 0xfffffe0037a73980 --- trap 0x3, rip = 0xffffffff80c13b37, rsp = 0xfffffe0037a73a50, rbp = 0xfffffe0037a73a60 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe0037a73a60 vpanic() at vpanic+0x1a1/frame 0xfffffe0037a73ac0 panic() at panic+0x43/frame 0xfffffe0037a73b20 g_io_deliver() at g_io_deliver+0x386/frame 0xfffffe0037a73b70 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0037a73ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe0037a73bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a73bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a73bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bash pid 2349 tid 100195 td 0xfffff80035112000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e56ea6b0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0037a730c0 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0037a730d0 trap() at trap+0x73/frame 0xfffffe0037a73200 calltrap() at calltrap+0x8/frame 0xfffffe0037a73200 --- trap 0xc, rip = 0xffffffff810471a0, rsp = 0xfffffe0037a732d0, rbp = 0xfffffe0037a73360 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe0037a73360 db_get_value() at db_get_value+0x32/frame 0xfffffe0037a733a0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0037a73430 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0037a73450 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0037a734f0 db_command() at db_command+0x25c/frame 0xfffffe0037a735c0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0037a73660 db_command() at db_command+0x25c/frame 0xfffffe0037a73730 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe0037a73740 db_trap() at db_trap+0xe8/frame 0xfffffe0037a737d0 kdb_trap() at kdb_trap+0x157/frame 0xfffffe0037a73850 trap() at trap+0x7d4/frame 0xfffffe0037a73980 calltrap() at calltrap+0x8/frame 0xfffffe0037a73980 --- trap 0x3, rip = 0xffffffff80c13b37, rsp = 0xfffffe0037a73a50, rbp = 0xfffffe0037a73a60 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe0037a73a60 vpanic() at vpanic+0x1a1/frame 0xfffffe0037a73ac0 panic() at panic+0x43/frame 0xfffffe0037a73b20 g_io_deliver() at g_io_deliver+0x386/frame 0xfffffe0037a73b70 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0037a73ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe0037a73bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a73bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a73bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00e56ea6b8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0037a73350 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0037a73360 db_get_value() at db_get_value+0x4c/frame 0xfffffe0037a733a0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0037a73430 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0037a73450 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0037a734f0 db_command() at db_command+0x25c/frame 0xfffffe0037a735c0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0037a73660 db_command() at db_command+0x25c/frame 0xfffffe0037a73730 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe0037a73740 db_trap() at db_trap+0xe8/frame 0xfffffe0037a737d0 kdb_trap() at kdb_trap+0x157/frame 0xfffffe0037a73850 trap() at trap+0x7d4/frame 0xfffffe0037a73980 calltrap() at calltrap+0x8/frame 0xfffffe0037a73980 --- trap 0x3, rip = 0xffffffff80c13b37, rsp = 0xfffffe0037a73a50, rbp = 0xfffffe0037a73a60 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe0037a73a60 vpanic() at vpanic+0x1a1/frame 0xfffffe0037a73ac0 panic() at panic+0x43/frame 0xfffffe0037a73b20 g_io_deliver() at g_io_deliver+0x386/frame 0xfffffe0037a73b70 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0037a73ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe0037a73bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a73bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a73bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sshd pid 2348 tid 100213 td 0xfffff8003f5006e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e575c710 mi_switch() at mi_switch+0x164/frame 0xfffffe00e575c750 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e575c790 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e575c7f0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e575c800 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e575c860 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e575c8a0 kern_select() at kern_select+0x962/frame 0xfffffe00e575ca80 sys_select() at sys_select+0x56/frame 0xfffffe00e575cac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e575cbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e575cbf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8008f7eea, rsp = 0x7fffffffa578, rbp = 0x7fffffffa5b0 --- Tracing command sshd pid 2345 tid 100170 td 0xfffff8001d6f0000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e563d790 mi_switch() at mi_switch+0x164/frame 0xfffffe00e563d7d0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e563d810 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e563d870 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e563d880 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e563d8e0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e563d920 kern_poll() at kern_poll+0x48b/frame 0xfffffe00e563daa0 sys_poll() at sys_poll+0x50/frame 0xfffffe00e563dac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e563dbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e563dbf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x80089acea, rsp = 0x7fffffffe5d8, rbp = 0x7fffffffe610 --- Tracing command csh pid 2341 tid 100204 td 0xfffff8003f0286e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e5723770 mi_switch() at mi_switch+0x164/frame 0xfffffe00e57237b0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e57237f0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e5723850 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e5723860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e57238c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e57238f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e5723950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e5723980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e57239e0 dofileread() at dofileread+0x81/frame 0xfffffe00e5723a30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e5723a70 sys_read() at sys_read+0x83/frame 0xfffffe00e5723ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e5723bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5723bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004fdf0a, rsp = 0x7fffffffe1e8, rbp = 0x7fffffffe210 --- Tracing command login pid 2340 tid 100157 td 0xfffff8001d8116e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e37ed6b0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0037a730c0 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0037a730d0 trap() at trap+0x73/frame 0xfffffe0037a73200 calltrap() at calltrap+0x8/frame 0xfffffe0037a73200 --- trap 0xc, rip = 0xffffffff810471a0, rsp = 0xfffffe0037a732d0, rbp = 0xfffffe0037a73360 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe0037a73360 db_get_value() at db_get_value+0x32/frame 0xfffffe0037a733a0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0037a73430 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0037a73450 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0037a734f0 db_command() at db_command+0x25c/frame 0xfffffe0037a735c0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0037a73660 db_command() at db_command+0x25c/frame 0xfffffe0037a73730 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe0037a73740 db_trap() at db_trap+0xe8/frame 0xfffffe0037a737d0 kdb_trap() at kdb_trap+0x157/frame 0xfffffe0037a73850 trap() at trap+0x7d4/frame 0xfffffe0037a73980 calltrap() at calltrap+0x8/frame 0xfffffe0037a73980 --- trap 0x3, rip = 0xffffffff80c13b37, rsp = 0xfffffe0037a73a50, rbp = 0xfffffe0037a73a60 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe0037a73a60 vpanic() at vpanic+0x1a1/frame 0xfffffe0037a73ac0 panic() at panic+0x43/frame 0xfffffe0037a73b20 g_io_deliver() at g_io_deliver+0x386/frame 0xfffffe0037a73b70 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0037a73ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe0037a73bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a73bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a73bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00e37ed6b8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0037a73350 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0037a73360 db_get_value() at db_get_value+0x4c/frame 0xfffffe0037a733a0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0037a73430 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0037a73450 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0037a734f0 db_command() at db_command+0x25c/frame 0xfffffe0037a735c0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0037a73660 db_command() at db_command+0x25c/frame 0xfffffe0037a73730 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe0037a73740 db_trap() at db_trap+0xe8/frame 0xfffffe0037a737d0 kdb_trap() at kdb_trap+0x157/frame 0xfffffe0037a73850 trap() at trap+0x7d4/frame 0xfffffe0037a73980 calltrap() at calltrap+0x8/frame 0xfffffe0037a73980 --- trap 0x3, rip = 0xffffffff80c13b37, rsp = 0xfffffe0037a73a50, rbp = 0xfffffe0037a73a60 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe0037a73a60 vpanic() at vpanic+0x1a1/frame 0xfffffe0037a73ac0 panic() at panic+0x43/frame 0xfffffe0037a73b20 g_io_deliver() at g_io_deliver+0x386/frame 0xfffffe0037a73b70 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0037a73ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe0037a73bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a73bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a73bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command getty pid 2339 tid 100145 td 0xfffff80005102000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e37b1770 mi_switch() at mi_switch+0x164/frame 0xfffffe00e37b17b0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e37b17f0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e37b1850 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e37b1860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e37b18c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e37b18f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e37b1950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e37b1980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e37b19e0 dofileread() at dofileread+0x81/frame 0xfffffe00e37b1a30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e37b1a70 sys_read() at sys_read+0x83/frame 0xfffffe00e37b1ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e37b1bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e37b1bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800435f0a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2338 tid 100218 td 0xfffff8003fdb36e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e5775770 mi_switch() at mi_switch+0x164/frame 0xfffffe00e57757b0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e57757f0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e5775850 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e5775860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e57758c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e57758f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e5775950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e5775980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e57759e0 dofileread() at dofileread+0x81/frame 0xfffffe00e5775a30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e5775a70 sys_read() at sys_read+0x83/frame 0xfffffe00e5775ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e5775bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5775bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800435f0a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2337 tid 100217 td 0xfffff8003f492000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e5770770 mi_switch() at mi_switch+0x164/frame 0xfffffe00e57707b0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e57707f0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e5770850 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e5770860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e57708c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e57708f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e5770950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e5770980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e57709e0 dofileread() at dofileread+0x81/frame 0xfffffe00e5770a30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e5770a70 sys_read() at sys_read+0x83/frame 0xfffffe00e5770ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e5770bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5770bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800435f0a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2336 tid 100216 td 0xfffff8003f4926e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e576b770 mi_switch() at mi_switch+0x164/frame 0xfffffe00e576b7b0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e576b7f0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e576b850 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e576b860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e576b8c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e576b8f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e576b950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e576b980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e576b9e0 dofileread() at dofileread+0x81/frame 0xfffffe00e576ba30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e576ba70 sys_read() at sys_read+0x83/frame 0xfffffe00e576bac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e576bbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e576bbf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800435f0a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2335 tid 100215 td 0xfffff8003fb78000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e5766770 mi_switch() at mi_switch+0x164/frame 0xfffffe00e57667b0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e57667f0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e5766850 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e5766860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e57668c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e57668f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e5766950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e5766980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e57669e0 dofileread() at dofileread+0x81/frame 0xfffffe00e5766a30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e5766a70 sys_read() at sys_read+0x83/frame 0xfffffe00e5766ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e5766bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5766bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800435f0a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2334 tid 100214 td 0xfffff8001df79000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e5761770 mi_switch() at mi_switch+0x164/frame 0xfffffe00e57617b0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e57617f0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e5761850 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e5761860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e57618c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e57618f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e5761950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e5761980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e57619e0 dofileread() at dofileread+0x81/frame 0xfffffe00e5761a30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e5761a70 sys_read() at sys_read+0x83/frame 0xfffffe00e5761ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e5761bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5761bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800435f0a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2333 tid 100163 td 0xfffff800350f3000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e560e770 mi_switch() at mi_switch+0x164/frame 0xfffffe00e560e7b0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e560e7f0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e560e850 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e560e860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e560e8c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e560e8f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e560e950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e560e980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e560e9e0 dofileread() at dofileread+0x81/frame 0xfffffe00e560ea30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e560ea70 sys_read() at sys_read+0x83/frame 0xfffffe00e560eac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e560ebf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e560ebf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800435f0a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2332 tid 100208 td 0xfffff8001df796e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e5743770 mi_switch() at mi_switch+0x164/frame 0xfffffe00e57437b0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e57437f0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e5743850 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e5743860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e57438c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e57438f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e5743950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e5743980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e57439e0 dofileread() at dofileread+0x81/frame 0xfffffe00e5743a30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e5743a70 sys_read() at sys_read+0x83/frame 0xfffffe00e5743ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e5743bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5743bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800435f0a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2331 tid 100142 td 0xfffff8001d73b6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e37a2770 mi_switch() at mi_switch+0x164/frame 0xfffffe00e37a27b0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e37a27f0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e37a2850 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e37a2860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e37a28c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e37a28f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e37a2950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e37a2980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e37a29e0 dofileread() at dofileread+0x81/frame 0xfffffe00e37a2a30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e37a2a70 sys_read() at sys_read+0x83/frame 0xfffffe00e37a2ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e37a2bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e37a2bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800435f0a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command cron pid 2285 tid 100165 td 0xfffff8001dd79000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e5618830 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0037a730c0 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0037a730d0 trap() at trap+0x73/frame 0xfffffe0037a73200 calltrap() at calltrap+0x8/frame 0xfffffe0037a73200 --- trap 0xc, rip = 0xffffffff810471a0, rsp = 0xfffffe0037a732d0, rbp = 0xfffffe0037a73360 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe0037a73360 db_get_value() at db_get_value+0x32/frame 0xfffffe0037a733a0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0037a73430 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0037a73450 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0037a734f0 db_command() at db_command+0x25c/frame 0xfffffe0037a735c0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0037a73660 db_command() at db_command+0x25c/frame 0xfffffe0037a73730 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe0037a73740 db_trap() at db_trap+0xe8/frame 0xfffffe0037a737d0 kdb_trap() at kdb_trap+0x157/frame 0xfffffe0037a73850 trap() at trap+0x7d4/frame 0xfffffe0037a73980 calltrap() at calltrap+0x8/frame 0xfffffe0037a73980 --- trap 0x3, rip = 0xffffffff80c13b37, rsp = 0xfffffe0037a73a50, rbp = 0xfffffe0037a73a60 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe0037a73a60 vpanic() at vpanic+0x1a1/frame 0xfffffe0037a73ac0 panic() at panic+0x43/frame 0xfffffe0037a73b20 g_io_deliver() at g_io_deliver+0x386/frame 0xfffffe0037a73b70 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0037a73ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe0037a73bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a73bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a73bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00e5618838 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0037a73350 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0037a73360 db_get_value() at db_get_value+0x4c/frame 0xfffffe0037a733a0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0037a73430 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0037a73450 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0037a734f0 db_command() at db_command+0x25c/frame 0xfffffe0037a735c0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0037a73660 db_command() at db_command+0x25c/frame 0xfffffe0037a73730 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe0037a73740 db_trap() at db_trap+0xe8/frame 0xfffffe0037a737d0 kdb_trap() at kdb_trap+0x157/frame 0xfffffe0037a73850 trap() at trap+0x7d4/frame 0xfffffe0037a73980 calltrap() at calltrap+0x8/frame 0xfffffe0037a73980 --- trap 0x3, rip = 0xffffffff80c13b37, rsp = 0xfffffe0037a73a50, rbp = 0xfffffe0037a73a60 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe0037a73a60 vpanic() at vpanic+0x1a1/frame 0xfffffe0037a73ac0 panic() at panic+0x43/frame 0xfffffe0037a73b20 g_io_deliver() at g_io_deliver+0x386/frame 0xfffffe0037a73b70 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0037a73ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe0037a73bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a73bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a73bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sshd pid 2281 tid 100162 td 0xfffff8001ddb2000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e5609710 mi_switch() at mi_switch+0x164/frame 0xfffffe00e5609750 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e5609790 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e56097f0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e5609800 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e5609860 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e56098a0 kern_select() at kern_select+0x962/frame 0xfffffe00e5609a80 sys_select() at sys_select+0x56/frame 0xfffffe00e5609ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e5609bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5609bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8008f7eea, rsp = 0x7fffffffe668, rbp = 0x7fffffffe6a0 --- Tracing command powerd pid 2253 tid 100207 td 0xfffff8003f85d6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e573e6d0 mi_switch() at mi_switch+0x164/frame 0xfffffe00e573e710 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e573e750 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e573e7b0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e573e7f0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00e573e860 seltdwait() at seltdwait+0x6b/frame 0xfffffe00e573e8a0 kern_select() at kern_select+0x962/frame 0xfffffe00e573ea80 sys_select() at sys_select+0x56/frame 0xfffffe00e573eac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e573ebf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e573ebf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800432eea, rsp = 0x7fffffffeb78, rbp = 0x7fffffffecc0 --- Tracing command ntpd pid 2250 tid 100156 td 0xfffff8001d810000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e37e8710 mi_switch() at mi_switch+0x164/frame 0xfffffe00e37e8750 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e37e8790 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e37e87f0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e37e8800 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e37e8860 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e37e88a0 kern_select() at kern_select+0x962/frame 0xfffffe00e37e8a80 sys_select() at sys_select+0x56/frame 0xfffffe00e37e8ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e37e8bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e37e8bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80082aeea, rsp = 0x7fffffffdef8, rbp = 0x7fffffffdf30 --- Tracing command ntpd pid 2250 tid 100527 td 0xfffff8003506b000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e76817f0 mi_switch() at mi_switch+0x164/frame 0xfffffe00e7681830 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e7681870 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e76818d0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e76818e0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e7681980 umtxq_sleep() at umtxq_sleep+0x19e/frame 0xfffffe00e76819e0 do_sem2_wait() at do_sem2_wait+0x38f/frame 0xfffffe00e7681a70 __umtx_op_sem2_wait() at __umtx_op_sem2_wait+0x76/frame 0xfffffe00e7681ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e7681bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e7681bf0 --- syscall (454, FreeBSD ELF64, sys__umtx_op), rip = 0x80071f22a, rsp = 0x7fffdffbced8, rbp = 0x7fffdffbcf50 --- Tracing command rpc.lockd pid 2189 tid 100197 td 0xfffff800377c56e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e5700610 mi_switch() at mi_switch+0x164/frame 0xfffffe00e5700650 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e5700690 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e57006f0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e5700730 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00e57007a0 svc_run_internal() at svc_run_internal+0xabe/frame 0xfffffe00e57008e0 svc_run() at svc_run+0x253/frame 0xfffffe00e5700940 sys_nlm_syscall() at sys_nlm_syscall+0x745/frame 0xfffffe00e5700ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e5700bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5700bf0 --- syscall (154, FreeBSD ELF64, sys_nlm_syscall), rip = 0x8002f557a, rsp = 0x7fffffffebf8, rbp = 0x7fffffffecc0 --- Tracing command rpc.statd pid 2186 tid 100194 td 0xfffff8003502c000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e56e56d0 mi_switch() at mi_switch+0x164/frame 0xfffffe00e56e5710 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e56e5750 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e56e57b0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e56e57f0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00e56e5860 seltdwait() at seltdwait+0x6b/frame 0xfffffe00e56e58a0 kern_select() at kern_select+0x962/frame 0xfffffe00e56e5a80 sys_select() at sys_select+0x56/frame 0xfffffe00e56e5ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e56e5bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e56e5bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800429eea, rsp = 0x7fffffffeaa8, rbp = 0x7fffffffebf0 --- Tracing command watchdogd pid 2140 tid 100201 td 0xfffff800376dc000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e5714830 mi_switch() at mi_switch+0x164/frame 0xfffffe00e5714870 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e57148b0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e5714910 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e5714950 _sleep() at _sleep+0x258/frame 0xfffffe00e57149f0 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe00e5714a80 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00e5714ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e5714bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5714bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003c362a, rsp = 0x7fffffffea98, rbp = 0x7fffffffeae0 --- Tracing command rpcbind pid 2061 tid 100164 td 0xfffff8001ddb56e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e5613750 mi_switch() at mi_switch+0x164/frame 0xfffffe00e5613790 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e56137d0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e5613830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e5613870 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00e56138e0 seltdwait() at seltdwait+0x6b/frame 0xfffffe00e5613920 kern_poll() at kern_poll+0x48b/frame 0xfffffe00e5613aa0 sys_poll() at sys_poll+0x50/frame 0xfffffe00e5613ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e5613bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5613bf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003d0cea, rsp = 0x7fffffffca38, rbp = 0x7fffffffec50 --- Tracing command syslogd pid 2051 tid 100192 td 0xfffff800377ed000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e56db710 mi_switch() at mi_switch+0x164/frame 0xfffffe00e56db750 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e56db790 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e56db7f0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e56db800 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e56db860 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e56db8a0 kern_select() at kern_select+0x962/frame 0xfffffe00e56dba80 sys_select() at sys_select+0x56/frame 0xfffffe00e56dbac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e56dbbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e56dbbf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80043aeea, rsp = 0x7fffffffe748, rbp = 0x7fffffffecc0 --- Tracing command devd pid 1980 tid 100172 td 0xfffff800351a56e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e56476d0 mi_switch() at mi_switch+0x164/frame 0xfffffe00e5647710 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e5647750 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e56477b0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e56477f0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00e5647860 seltdwait() at seltdwait+0x6b/frame 0xfffffe00e56478a0 kern_select() at kern_select+0x962/frame 0xfffffe00e5647a80 sys_select() at sys_select+0x56/frame 0xfffffe00e5647ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e5647bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5647bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x2f7f7a, rsp = 0x7fffffffcb48, rbp = 0x7fffffffece0 --- Tracing command dhclient pid 1975 tid 100199 td 0xfffff8001dce66e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e570a750 mi_switch() at mi_switch+0x164/frame 0xfffffe00e570a790 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e570a7d0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e570a830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e570a870 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00e570a8e0 seltdwait() at seltdwait+0x6b/frame 0xfffffe00e570a920 kern_poll() at kern_poll+0x48b/frame 0xfffffe00e570aaa0 sys_poll() at sys_poll+0x50/frame 0xfffffe00e570aac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e570abf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e570abf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003f3cea, rsp = 0x7fffffffec28, rbp = 0x7fffffffec60 --- Tracing command dhclient pid 1928 tid 100196 td 0xfffff8001dec5000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e56ef790 mi_switch() at mi_switch+0x164/frame 0xfffffe00e56ef7d0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e56ef810 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e56ef870 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e56ef880 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e56ef8e0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e56ef920 kern_poll() at kern_poll+0x48b/frame 0xfffffe00e56efaa0 sys_poll() at sys_poll+0x50/frame 0xfffffe00e56efac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e56efbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e56efbf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003f3cea, rsp = 0x7fffffffec38, rbp = 0x7fffffffec60 --- Tracing command dhclient pid 1925 tid 100193 td 0xfffff800356e9000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e56e0710 mi_switch() at mi_switch+0x164/frame 0xfffffe00e56e0750 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e56e0790 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e56e07f0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e56e0800 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e56e0860 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e56e08a0 kern_select() at kern_select+0x962/frame 0xfffffe00e56e0a80 sys_select() at sys_select+0x56/frame 0xfffffe00e56e0ac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00e56e0bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e56e0bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800450eea, rsp = 0x7fffffffe9e8, rbp = 0x7fffffffeaa0 --- Tracing command syncer pid 34 tid 100137 td 0xfffff8001d8106e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e37899f0 mi_switch() at mi_switch+0x164/frame 0xfffffe00e3789a30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e3789a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e3789ab0 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x184/frame 0xfffffe00e3789b20 sched_sync() at sched_sync+0x69d/frame 0xfffffe00e3789bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e3789bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e3789bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vnlru pid 33 tid 100133 td 0xfffff8001d80f000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037bf59b0 mi_switch() at mi_switch+0x164/frame 0xfffffe0037bf59f0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bf5a30 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037bf5a70 _sleep() at _sleep+0x26c/frame 0xfffffe0037bf5b10 vnlru_proc() at vnlru_proc+0xafd/frame 0xfffffe0037bf5bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bf5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bf5bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100130 td 0xfffff8001d456000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037bdaa00 mi_switch() at mi_switch+0x164/frame 0xfffffe0037bdaa40 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bdaa80 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037bdaac0 _sleep() at _sleep+0x26c/frame 0xfffffe0037bdab60 buf_daemon() at buf_daemon+0x112/frame 0xfffffe0037bdabb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bdabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bdabf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100131 td 0xfffff8001d6c6000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037beb9f0 mi_switch() at mi_switch+0x164/frame 0xfffffe0037beba30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037beba70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037bebab0 _sleep() at _sleep+0x26c/frame 0xfffffe0037bebb50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe0037bebbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bebbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bebbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100134 td 0xfffff8001d6c76e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037bfa9f0 mi_switch() at mi_switch+0x164/frame 0xfffffe0037bfaa30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bfaa70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037bfaab0 _sleep() at _sleep+0x26c/frame 0xfffffe0037bfab50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe0037bfabb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bfabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bfabf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100135 td 0xfffff8001d6c7000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037bff9f0 mi_switch() at mi_switch+0x164/frame 0xfffffe0037bffa30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bffa70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037bffab0 _sleep() at _sleep+0x26c/frame 0xfffffe0037bffb50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe0037bffbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bffbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bffbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100136 td 0xfffff8001d5536e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e37849f0 mi_switch() at mi_switch+0x164/frame 0xfffffe00e3784a30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e3784a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e3784ab0 _sleep() at _sleep+0x26c/frame 0xfffffe00e3784b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00e3784bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e3784bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e3784bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100138 td 0xfffff8001d553000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e378e9f0 mi_switch() at mi_switch+0x164/frame 0xfffffe00e378ea30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e378ea70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e378eab0 _sleep() at _sleep+0x26c/frame 0xfffffe00e378eb50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00e378ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e378ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e378ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100140 td 0xfffff8001d6ef6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e37989f0 mi_switch() at mi_switch+0x164/frame 0xfffffe00e3798a30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e3798a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e3798ab0 _sleep() at _sleep+0x26c/frame 0xfffffe00e3798b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00e3798bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e3798bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e3798bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100141 td 0xfffff8001d6ef000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e379d9f0 mi_switch() at mi_switch+0x164/frame 0xfffffe00e379da30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e379da70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e379dab0 _sleep() at _sleep+0x26c/frame 0xfffffe00e379db50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00e379dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e379dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e379dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100153 td 0xfffff8001dd796e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e37d9a20 mi_switch() at mi_switch+0x164/frame 0xfffffe00e37d9a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e37d9aa0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e37d9ae0 _sleep() at _sleep+0x26c/frame 0xfffffe00e37d9b80 softdep_flush() at softdep_flush+0x175/frame 0xfffffe00e37d9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e37d9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e37d9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100205 td 0xfffff800357796e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e5734a20 mi_switch() at mi_switch+0x164/frame 0xfffffe00e5734a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e5734aa0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e5734ae0 _sleep() at _sleep+0x26c/frame 0xfffffe00e5734b80 softdep_flush() at softdep_flush+0x175/frame 0xfffffe00e5734bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e5734bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e5734bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100528 td 0xfffff80430308000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e76bf5c0 mi_switch() at mi_switch+0x164/frame 0xfffffe00e76bf600 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e76bf640 sleeplk() at sleeplk+0x107/frame 0xfffffe00e76bf6a0 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x225/frame 0xfffffe00e76bf760 __lockmgr_args() at __lockmgr_args+0x62c/frame 0xfffffe00e76bf820 getblkx() at getblkx+0x15f/frame 0xfffffe00e76bf900 breadn_flags() at breadn_flags+0x44/frame 0xfffffe00e76bf970 ffs_getcg() at ffs_getcg+0xd7/frame 0xfffffe00e76bf9f0 ffs_freefile() at ffs_freefile+0x8e/frame 0xfffffe00e76bfa80 handle_workitem_freefile() at handle_workitem_freefile+0x138/frame 0xfffffe00e76bfac0 process_worklist_item() at process_worklist_item+0x2aa/frame 0xfffffe00e76bfb40 softdep_process_worklist() at softdep_process_worklist+0xc7/frame 0xfffffe00e76bfb80 softdep_flush() at softdep_flush+0xff/frame 0xfffffe00e76bfbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e76bfbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e76bfbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vmdaemon pid 31 tid 100129 td 0xfffff8001d4566e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037bd5a20 mi_switch() at mi_switch+0x164/frame 0xfffffe0037bd5a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bd5aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037bd5b40 vm_daemon() at vm_daemon+0x82/frame 0xfffffe0037bd5bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bd5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bd5bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100128 td 0xfffff8001d455000 (CPU 8) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1c7dd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1c7df0 trap() at trap+0x61/frame 0xfffffe003e1c7f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1c7f20 --- trap 0x13, rip = 0xffffffff80c35ce0, rsp = 0xfffffe0037bd0670, rbp = 0xfffffe0037bd06a0 --- witness_lock() at witness_lock+0x190/frame 0xfffffe0037bd06a0 _rw_wlock_cookie() at _rw_wlock_cookie+0xcf/frame 0xfffffe0037bd06e0 pmap_ts_referenced() at pmap_ts_referenced+0xc4/frame 0xfffffe0037bd0770 vm_pageout_worker() at vm_pageout_worker+0x10a3/frame 0xfffffe0037bd0b70 vm_pageout() at vm_pageout+0x193/frame 0xfffffe0037bd0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bd0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bd0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100132 td 0xfffff8001d75d6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037bf0470 mi_switch() at mi_switch+0x164/frame 0xfffffe0037bf04b0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bf04f0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037bf0590 swap_pager_putpages() at swap_pager_putpages+0x1f6/frame 0xfffffe0037bf0630 vm_pageout_flush() at vm_pageout_flush+0xf5/frame 0xfffffe0037bf06c0 vm_pageout_cluster() at vm_pageout_cluster+0x352/frame 0xfffffe0037bf0930 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x815/frame 0xfffffe0037bf0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bf0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bf0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100139 td 0xfffff8001d75d000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e3793a20 mi_switch() at mi_switch+0x164/frame 0xfffffe00e3793a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e3793aa0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e3793ae0 _sleep() at _sleep+0x26c/frame 0xfffffe00e3793b80 uma_reclaim_worker() at uma_reclaim_worker+0xb8/frame 0xfffffe00e3793bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e3793bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e3793bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon1 pid 29 tid 100127 td 0xfffff8001d525000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037bcba10 mi_switch() at mi_switch+0x164/frame 0xfffffe0037bcba50 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bcba90 _sleep() at _sleep+0x2cd/frame 0xfffffe0037bcbb30 enc_daemon() at enc_daemon+0xf6/frame 0xfffffe0037bcbbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bcbbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bcbbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon0 pid 28 tid 100126 td 0xfffff8001d5256e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037bc6a10 mi_switch() at mi_switch+0x164/frame 0xfffffe0037bc6a50 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bc6a90 _sleep() at _sleep+0x2cd/frame 0xfffffe0037bc6b30 enc_daemon() at enc_daemon+0xf6/frame 0xfffffe0037bc6bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bc6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bc6bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command rand_harvestq pid 27 tid 100120 td 0xfffff8001d40b000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037ba89d0 mi_switch() at mi_switch+0x164/frame 0xfffffe0037ba8a10 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ba8a50 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037ba8a90 _sleep() at _sleep+0x26c/frame 0xfffffe0037ba8b30 random_kthread() at random_kthread+0x67/frame 0xfffffe0037ba8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ba8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ba8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sctp_iterator pid 26 tid 100119 td 0xfffff8001d40b6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037ba3a70 mi_switch() at mi_switch+0x164/frame 0xfffffe0037ba3ab0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ba3af0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ba3b90 sctp_iterator_thread() at sctp_iterator_thread+0x59/frame 0xfffffe0037ba3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ba3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ba3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod4 pid 25 tid 100118 td 0xfffff8001d2ff6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b92a10 mi_switch() at mi_switch+0x164/frame 0xfffffe0037b92a50 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b92a90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037b92ad0 _sleep() at _sleep+0x26c/frame 0xfffffe0037b92b70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe0037b92bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b92bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b92bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod3 pid 24 tid 100117 td 0xfffff8001d307000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b8da10 mi_switch() at mi_switch+0x164/frame 0xfffffe0037b8da50 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b8da90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037b8dad0 _sleep() at _sleep+0x26c/frame 0xfffffe0037b8db70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe0037b8dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b8dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b8dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod2 pid 23 tid 100116 td 0xfffff8001d3076e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b88a10 mi_switch() at mi_switch+0x164/frame 0xfffffe0037b88a50 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b88a90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037b88ad0 _sleep() at _sleep+0x26c/frame 0xfffffe0037b88b70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe0037b88bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b88bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b88bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod1 pid 22 tid 100115 td 0xfffff8001d306000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b83a10 mi_switch() at mi_switch+0x164/frame 0xfffffe0037b83a50 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b83a90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037b83ad0 _sleep() at _sleep+0x26c/frame 0xfffffe0037b83b70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe0037b83bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b83bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b83bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100096 td 0xfffff800050026e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b24a90 mi_switch() at mi_switch+0x164/frame 0xfffffe0037b24ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b24b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b24b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b24bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b24bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b24bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100097 td 0xfffff80005002000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b29a90 mi_switch() at mi_switch+0x164/frame 0xfffffe0037b29ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b29b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b29b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b29bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b29bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b29bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100098 td 0xfffff800041ef6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b2ea90 mi_switch() at mi_switch+0x164/frame 0xfffffe0037b2ead0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b2eb10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b2eb70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b2ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b2ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b2ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100099 td 0xfffff800041ef000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b33a90 mi_switch() at mi_switch+0x164/frame 0xfffffe0037b33ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b33b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b33b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b33bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b33bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b33bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100100 td 0xfffff80003d496e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b38a90 mi_switch() at mi_switch+0x164/frame 0xfffffe0037b38ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b38b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b38b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b38bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b38bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b38bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100102 td 0xfffff800041f96e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b42a90 mi_switch() at mi_switch+0x164/frame 0xfffffe0037b42ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b42b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b42b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b42bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b42bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b42bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100103 td 0xfffff800041f9000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b47a90 mi_switch() at mi_switch+0x164/frame 0xfffffe0037b47ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b47b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b47b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b47bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b47bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b47bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100104 td 0xfffff800041fa6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b4ca90 mi_switch() at mi_switch+0x164/frame 0xfffffe0037b4cad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b4cb10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b4cb70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b4cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b4cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b4cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100105 td 0xfffff800041fa000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b51a90 mi_switch() at mi_switch+0x164/frame 0xfffffe0037b51ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b51b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b51b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b51bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b51bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b51bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100106 td 0xfffff8000501a6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b56a90 mi_switch() at mi_switch+0x164/frame 0xfffffe0037b56ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b56b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b56b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b56bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b56bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b56bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100107 td 0xfffff800050f7000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b5ba90 mi_switch() at mi_switch+0x164/frame 0xfffffe0037b5bad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b5bb10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b5bb70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b5bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b5bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b5bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100108 td 0xfffff800050f86e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b60a90 mi_switch() at mi_switch+0x164/frame 0xfffffe0037b60ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b60b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b60b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b60bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b60bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b60bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100109 td 0xfffff800050f8000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b65a90 mi_switch() at mi_switch+0x164/frame 0xfffffe0037b65ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b65b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b65b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b65bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b65bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b65bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100110 td 0xfffff800050f06e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b6aa90 mi_switch() at mi_switch+0x164/frame 0xfffffe0037b6aad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b6ab10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b6ab70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b6abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b6abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b6abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100111 td 0xfffff800050f0000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b6fa90 mi_switch() at mi_switch+0x164/frame 0xfffffe0037b6fad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b6fb10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b6fb70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b6fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b6fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b6fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100091 td 0xfffff80003d49000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b0ba40 mi_switch() at mi_switch+0x164/frame 0xfffffe0037b0ba80 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b0bac0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b0bb60 xpt_done_td() at xpt_done_td+0x8b/frame 0xfffffe0037b0bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b0bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b0bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100092 td 0xfffff80003d4a6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b10a40 mi_switch() at mi_switch+0x164/frame 0xfffffe0037b10a80 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b10ac0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b10b60 xpt_done_td() at xpt_done_td+0x8b/frame 0xfffffe0037b10bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b10bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b10bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100093 td 0xfffff80003d4a000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b15a40 mi_switch() at mi_switch+0x164/frame 0xfffffe0037b15a80 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b15ac0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b15b60 xpt_done_td() at xpt_done_td+0x8b/frame 0xfffffe0037b15bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b15bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b15bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100125 td 0xfffff8001d4556e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037bc1a30 mi_switch() at mi_switch+0x164/frame 0xfffffe0037bc1a70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bc1ab0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037bc1b50 xpt_scanner_thread() at xpt_scanner_thread+0x92/frame 0xfffffe0037bc1bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bc1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bc1bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 11 pid 19 tid 100090 td 0xfffff80003bdf6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b06a20 mi_switch() at mi_switch+0x164/frame 0xfffffe0037b06a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b06aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b06b40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe0037b06bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b06bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b06bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 10 pid 18 tid 100089 td 0xfffff80003be7000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b01a20 mi_switch() at mi_switch+0x164/frame 0xfffffe0037b01a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b01aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b01b40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe0037b01bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b01bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b01bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 9 pid 17 tid 100088 td 0xfffff80003be76e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037afca20 mi_switch() at mi_switch+0x164/frame 0xfffffe0037afca60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037afcaa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037afcb40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe0037afcbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037afcbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037afcbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 8 pid 16 tid 100087 td 0xfffff80003be6000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037af7a20 mi_switch() at mi_switch+0x164/frame 0xfffffe0037af7a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037af7aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037af7b40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe0037af7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037af7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037af7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 7 pid 15 tid 100086 td 0xfffff80003be66e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037af2a20 mi_switch() at mi_switch+0x164/frame 0xfffffe0037af2a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037af2aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037af2b40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe0037af2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037af2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037af2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 6 pid 9 tid 100085 td 0xfffff80003bcd000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037aeda20 mi_switch() at mi_switch+0x164/frame 0xfffffe0037aeda60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037aedaa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037aedb40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe0037aedbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037aedbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037aedbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 5 pid 8 tid 100084 td 0xfffff80003bcd6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037ae8a20 mi_switch() at mi_switch+0x164/frame 0xfffffe0037ae8a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ae8aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ae8b40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe0037ae8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ae8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ae8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 4 pid 7 tid 100083 td 0xfffff80003be0000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037ae3a20 mi_switch() at mi_switch+0x164/frame 0xfffffe0037ae3a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ae3aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ae3b40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe0037ae3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ae3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ae3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 3 pid 6 tid 100082 td 0xfffff80003be06e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037adea20 mi_switch() at mi_switch+0x164/frame 0xfffffe0037adea60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037adeaa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037adeb40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe0037adebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037adebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037adebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 2 pid 5 tid 100081 td 0xfffff80003bdf000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037ad9a20 mi_switch() at mi_switch+0x164/frame 0xfffffe0037ad9a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ad9aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ad9b40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe0037ad9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ad9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ad9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 1 pid 4 tid 100080 td 0xfffff80003bc46e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037ad4a20 mi_switch() at mi_switch+0x164/frame 0xfffffe0037ad4a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ad4aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ad4b40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe0037ad4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ad4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ad4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 0 pid 3 tid 100079 td 0xfffff80003bd5000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037acfa20 mi_switch() at mi_switch+0x164/frame 0xfffffe0037acfa60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037acfaa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037acfb40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe0037acfbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037acfbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037acfbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 2 tid 100078 td 0xfffff80003bd56e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037acaa50 mi_switch() at mi_switch+0x164/frame 0xfffffe0037acaa90 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037acaad0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037acab70 crypto_proc() at crypto_proc+0x2bf/frame 0xfffffe0037acabb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037acabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037acabf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sequencer 00 pid 14 tid 100065 td 0xfffff80003b1e000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037a89a50 mi_switch() at mi_switch+0x164/frame 0xfffffe0037a89a90 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037a89ad0 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037a89b30 seq_eventthread() at seq_eventthread+0x8c/frame 0xfffffe0037a89bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a89bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a89bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100062 td 0xfffff80003b1d6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037a6ea50 mi_switch() at mi_switch+0x164/frame 0xfffffe0037a6ea90 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037a6ead0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037a6eb70 g_run_events() at g_run_events+0x64/frame 0xfffffe0037a6ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a6ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a6ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100063 td 0xfffff80003b1d000 (CPU 9) kdb_enter() at kdb_enter+0x37/frame 0xfffffe0037a73a60 vpanic() at vpanic+0x1a1/frame 0xfffffe0037a73ac0 panic() at panic+0x43/frame 0xfffffe0037a73b20 g_io_deliver() at g_io_deliver+0x386/frame 0xfffffe0037a73b70 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0037a73ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe0037a73bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a73bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a73bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100064 td 0xfffff80003b1e6e0 (CPU 6) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1afdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1afdf0 trap() at trap+0x61/frame 0xfffffe003e1aff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1aff20 --- trap 0x13, rip = 0xffffffff80b0cf89, rsp = 0xfffffe0037a78b40, rbp = 0xfffffe0037a78b70 --- g_io_check() at g_io_check+0x79/frame 0xfffffe0037a78b70 g_io_schedule_down() at g_io_schedule_down+0xf7/frame 0xfffffe0037a78ba0 g_down_procbody() at g_down_procbody+0x5c/frame 0xfffffe0037a78bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a78bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a78bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100017 td 0xfffff800039a6000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00addb8ae0 mi_switch() at mi_switch+0x164/frame 0xfffffe00addb8b20 ithread_loop() at ithread_loop+0xa9/frame 0xfffffe00addb8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addb8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addb8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100018 td 0xfffff800039a56e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00addbdae0 mi_switch() at mi_switch+0x164/frame 0xfffffe00addbdb20 ithread_loop() at ithread_loop+0xa9/frame 0xfffffe00addbdbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addbdbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addbdbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100020 td 0xfffff8000395d6e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100047 td 0xfffff80003abf000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377feae0 mi_switch() at mi_switch+0x164/frame 0xfffffe00377feb20 ithread_loop() at ithread_loop+0xa9/frame 0xfffffe00377febb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377febf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377febf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100048 td 0xfffff80003ab76e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100049 td 0xfffff80003ab7000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100050 td 0xfffff80003ab06e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100051 td 0xfffff80003ae6000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100052 td 0xfffff80003ad36e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100053 td 0xfffff80003ad3000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100054 td 0xfffff80003ad46e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100055 td 0xfffff80003ad4000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100056 td 0xfffff80003ae46e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100057 td 0xfffff80003ae4000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100058 td 0xfffff80003ae56e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100059 td 0xfffff80003ae5000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037a3bae0 mi_switch() at mi_switch+0x164/frame 0xfffffe0037a3bb20 ithread_loop() at ithread_loop+0xa9/frame 0xfffffe0037a3bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a3bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a3bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100060 td 0xfffff80003ae66e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100094 td 0xfffff80003d4b6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b1aae0 mi_switch() at mi_switch+0x164/frame 0xfffffe0037b1ab20 ithread_loop() at ithread_loop+0xa9/frame 0xfffffe0037b1abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b1abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b1abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100095 td 0xfffff80003d4b000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b1fae0 mi_switch() at mi_switch+0x164/frame 0xfffffe0037b1fb20 ithread_loop() at ithread_loop+0xa9/frame 0xfffffe0037b1fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b1fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b1fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100101 td 0xfffff80005016000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b3dae0 mi_switch() at mi_switch+0x164/frame 0xfffffe0037b3db20 ithread_loop() at ithread_loop+0xa9/frame 0xfffffe0037b3dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b3dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b3dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100112 td 0xfffff800051016e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100113 td 0xfffff80005101000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b79ae0 mi_switch() at mi_switch+0x164/frame 0xfffffe0037b79b20 ithread_loop() at ithread_loop+0xa9/frame 0xfffffe0037b79bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b79bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b79bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100180 td 0xfffff800358b46e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100181 td 0xfffff800358b4000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100182 td 0xfffff800356d46e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100183 td 0xfffff800356d4000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100184 td 0xfffff800357556e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100185 td 0xfffff80035779000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100186 td 0xfffff800357266e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100187 td 0xfffff80035726000 fork_trampoline() at fork_trampoline Tracing command idle pid 11 tid 100003 td 0xfffff8000394b000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00add72a90 mi_switch() at mi_switch+0x164/frame 0xfffffe00add72ad0 sched_idletd() at sched_idletd+0x437/frame 0xfffffe00add72bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add72bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add72bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffff800039456e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00add77910 mi_switch() at mi_switch+0x164/frame 0xfffffe00add77950 sched_preempt() at sched_preempt+0x86/frame 0xfffffe00add77980 ipi_bitmap_handler() at ipi_bitmap_handler+0x64/frame 0xfffffe00add779b0 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0xb3/frame 0xfffffe00add779b0 --- interrupt, rip = 0xffffffff81053d8a, rsp = 0xfffffe00add77a80, rbp = 0xfffffe00add77a90 --- spinlock_exit() at spinlock_exit+0x3a/frame 0xfffffe00add77a90 mi_switch() at mi_switch+0x187/frame 0xfffffe00add77ad0 sched_idletd() at sched_idletd+0x437/frame 0xfffffe00add77bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add77bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add77bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffff80003945000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00add7ca90 mi_switch() at mi_switch+0x164/frame 0xfffffe00add7cad0 sched_idletd() at sched_idletd+0x9e/frame 0xfffffe00add7cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add7cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add7cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffff8000395a6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00add81a90 mi_switch() at mi_switch+0x164/frame 0xfffffe00add81ad0 sched_idletd() at sched_idletd+0x9e/frame 0xfffffe00add81bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add81bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add81bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffff8000395a000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00add86910 mi_switch() at mi_switch+0x164/frame 0xfffffe00add86950 sched_preempt() at sched_preempt+0x86/frame 0xfffffe00add86980 ipi_bitmap_handler() at ipi_bitmap_handler+0x64/frame 0xfffffe00add869b0 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0xb3/frame 0xfffffe00add869b0 --- interrupt, rip = 0xffffffff81053d8a, rsp = 0xfffffe00add86a80, rbp = 0xfffffe00add86a90 --- spinlock_exit() at spinlock_exit+0x3a/frame 0xfffffe00add86a90 mi_switch() at mi_switch+0x187/frame 0xfffffe00add86ad0 sched_idletd() at sched_idletd+0x9e/frame 0xfffffe00add86bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add86bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add86bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffff800039596e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00add8ba90 mi_switch() at mi_switch+0x164/frame 0xfffffe00add8bad0 sched_idletd() at sched_idletd+0x9e/frame 0xfffffe00add8bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add8bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add8bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffff80003959000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00add90a90 mi_switch() at mi_switch+0x164/frame 0xfffffe00add90ad0 sched_idletd() at sched_idletd+0x9e/frame 0xfffffe00add90bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add90bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add90bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffff8000394c6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00add95a90 mi_switch() at mi_switch+0x164/frame 0xfffffe00add95ad0 sched_idletd() at sched_idletd+0x437/frame 0xfffffe00add95bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add95bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add95bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffff8000395d000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00add9aa90 mi_switch() at mi_switch+0x164/frame 0xfffffe00add9aad0 sched_idletd() at sched_idletd+0x437/frame 0xfffffe00add9abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add9abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add9abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffff8000395c6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00add9fa90 mi_switch() at mi_switch+0x164/frame 0xfffffe00add9fad0 sched_idletd() at sched_idletd+0x9e/frame 0xfffffe00add9fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add9fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add9fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffff8000395c000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00adda4a90 mi_switch() at mi_switch+0x164/frame 0xfffffe00adda4ad0 sched_idletd() at sched_idletd+0x437/frame 0xfffffe00adda4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adda4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adda4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffff8000395b6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00adda9a90 mi_switch() at mi_switch+0x164/frame 0xfffffe00adda9ad0 sched_idletd() at sched_idletd+0x437/frame 0xfffffe00adda9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adda9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adda9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command init pid 1 tid 100002 td 0xfffff8000394b6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00add6d6b0 mi_switch() at mi_switch+0x164/frame 0xfffffe00add6d6f0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00add6d730 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00add6d790 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00add6d7a0 _sleep() at _sleep+0x2c3/frame 0xfffffe00add6d840 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00add6d8d0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00add6dac0 amd64_syscall() at amd64_syscall+0x2f1/frame 0xfffffe00add6dbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00add6dbf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x2b2dca, rsp = 0x7fffffffe778, rbp = 0x7fffffffe7e0 --- Tracing command audit pid 10 tid 100001 td 0xfffff8000394c000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00add68a70 mi_switch() at mi_switch+0x164/frame 0xfffffe00add68ab0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00add68af0 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe00add68b50 audit_worker() at audit_worker+0x9f/frame 0xfffffe00add68bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add68bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add68bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xffffffff81d9e180 sched_switch() at sched_switch+0x5ba/frame 0xffffffff82300bf0 mi_switch() at mi_switch+0x164/frame 0xffffffff82300c30 sleepq_switch() at sleepq_switch+0x11a/frame 0xffffffff82300c70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xffffffff82300cb0 _sleep() at _sleep+0x26c/frame 0xffffffff82300d50 swapper() at swapper+0x75/frame 0xffffffff82300da0 mi_startup() at mi_startup+0x2ed/frame 0xffffffff82300df0 btext() at btext+0x2c Tracing command kernel pid 0 tid 100015 td 0xfffff8000395b000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00addaea90 mi_switch() at mi_switch+0x164/frame 0xfffffe00addaead0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addaeb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addaeb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00addaebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addaebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addaebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100016 td 0xfffff800039a66e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00addb3a60 mi_switch() at mi_switch+0x164/frame 0xfffffe00addb3aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addb3ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00addb3b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00addb3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addb3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addb3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100019 td 0xfffff800039a5000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00addc2a60 mi_switch() at mi_switch+0x164/frame 0xfffffe00addc2aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addc2ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00addc2b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00addc2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addc2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addc2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xfffff800039aa000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00addcca60 mi_switch() at mi_switch+0x164/frame 0xfffffe00addccaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addccae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00addccb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00addccbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addccbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addccbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xfffff800039a96e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037781a90 mi_switch() at mi_switch+0x164/frame 0xfffffe0037781ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037781b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0037781b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe0037781bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037781bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037781bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xfffff800039a9000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037786a90 mi_switch() at mi_switch+0x164/frame 0xfffffe0037786ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037786b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0037786b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe0037786bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037786bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037786bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xfffff800039a86e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe003778ba90 mi_switch() at mi_switch+0x164/frame 0xfffffe003778bad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe003778bb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe003778bb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe003778bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003778bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003778bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xfffff800039a8000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037790a90 mi_switch() at mi_switch+0x164/frame 0xfffffe0037790ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037790b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0037790b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe0037790bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037790bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037790bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100026 td 0xfffff800039e16e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037795a90 mi_switch() at mi_switch+0x164/frame 0xfffffe0037795ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037795b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0037795b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe0037795bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037795bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037795bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100027 td 0xfffff800039e1000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe003779aa90 mi_switch() at mi_switch+0x164/frame 0xfffffe003779aad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe003779ab10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe003779ab80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe003779abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003779abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003779abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100028 td 0xfffff800039e06e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe003779fa90 mi_switch() at mi_switch+0x164/frame 0xfffffe003779fad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe003779fb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe003779fb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe003779fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003779fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003779fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100029 td 0xfffff800039e0000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377a4a90 mi_switch() at mi_switch+0x164/frame 0xfffffe00377a4ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377a4b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377a4b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377a4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377a4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377a4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100030 td 0xfffff800039aa6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377a9a90 mi_switch() at mi_switch+0x164/frame 0xfffffe00377a9ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377a9b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377a9b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377a9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377a9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377a9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100031 td 0xfffff800039e6000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377aea90 mi_switch() at mi_switch+0x164/frame 0xfffffe00377aead0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377aeb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377aeb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377aebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377aebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377aebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100032 td 0xfffff800039e56e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377b3a90 mi_switch() at mi_switch+0x164/frame 0xfffffe00377b3ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377b3b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377b3b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377b3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377b3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377b3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100033 td 0xfffff800039e5000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377b8a90 mi_switch() at mi_switch+0x164/frame 0xfffffe00377b8ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377b8b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377b8b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377b8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377b8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377b8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100034 td 0xfffff800039e46e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377bda90 mi_switch() at mi_switch+0x164/frame 0xfffffe00377bdad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377bdb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377bdb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377bdbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377bdbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377bdbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100035 td 0xfffff800039e4000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377c2a90 mi_switch() at mi_switch+0x164/frame 0xfffffe00377c2ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377c2b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377c2b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377c2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377c2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377c2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100036 td 0xfffff80003ab36e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377c7a90 mi_switch() at mi_switch+0x164/frame 0xfffffe00377c7ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377c7b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377c7b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377c7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377c7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377c7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100037 td 0xfffff80003ab3000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377cca90 mi_switch() at mi_switch+0x164/frame 0xfffffe00377ccad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377ccb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377ccb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377ccbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377ccbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377ccbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100038 td 0xfffff80003ab46e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377d1a90 mi_switch() at mi_switch+0x164/frame 0xfffffe00377d1ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377d1b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377d1b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377d1bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377d1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377d1bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100039 td 0xfffff80003ab4000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377d6a90 mi_switch() at mi_switch+0x164/frame 0xfffffe00377d6ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377d6b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377d6b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377d6bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377d6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377d6bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100040 td 0xfffff800039e66e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377dba90 mi_switch() at mi_switch+0x164/frame 0xfffffe00377dbad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377dbb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377dbb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377dbbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377dbbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377dbbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100041 td 0xfffff80003ab0000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377e0a90 mi_switch() at mi_switch+0x164/frame 0xfffffe00377e0ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377e0b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377e0b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377e0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377e0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377e0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100042 td 0xfffff80003ab16e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377e5a90 mi_switch() at mi_switch+0x164/frame 0xfffffe00377e5ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377e5b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377e5b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377e5bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377e5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377e5bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100043 td 0xfffff80003ab1000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377eaa90 mi_switch() at mi_switch+0x164/frame 0xfffffe00377eaad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377eab10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377eab80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377eabb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377eabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377eabf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100044 td 0xfffff80003ab26e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377efa90 mi_switch() at mi_switch+0x164/frame 0xfffffe00377efad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377efb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377efb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377efbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377efbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377efbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100045 td 0xfffff80003ab2000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377f4a90 mi_switch() at mi_switch+0x164/frame 0xfffffe00377f4ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377f4b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377f4b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377f4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377f4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377f4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100046 td 0xfffff80003abf6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377f9a90 mi_switch() at mi_switch+0x164/frame 0xfffffe00377f9ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377f9b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377f9b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377f9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377f9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377f9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100061 td 0xfffff80003b1c000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037a69a60 mi_switch() at mi_switch+0x164/frame 0xfffffe0037a69aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037a69ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037a69b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0037a69bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a69bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a69bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100066 td 0xfffff80003bc76e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037a8ea60 mi_switch() at mi_switch+0x164/frame 0xfffffe0037a8eaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037a8eae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037a8eb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0037a8ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a8ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a8ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100067 td 0xfffff80003bc7000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037a93a60 mi_switch() at mi_switch+0x164/frame 0xfffffe0037a93aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037a93ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037a93b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0037a93bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a93bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a93bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100068 td 0xfffff80003bc86e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037a98a60 mi_switch() at mi_switch+0x164/frame 0xfffffe0037a98aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037a98ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037a98b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0037a98bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a98bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a98bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100069 td 0xfffff80003bc8000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037a9da60 mi_switch() at mi_switch+0x164/frame 0xfffffe0037a9daa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037a9dae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037a9db80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0037a9dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a9dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a9dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100070 td 0xfffff80003b1c6e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037aa2a60 mi_switch() at mi_switch+0x164/frame 0xfffffe0037aa2aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037aa2ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037aa2b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0037aa2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037aa2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037aa2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100071 td 0xfffff80003bc4000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037aa7a60 mi_switch() at mi_switch+0x164/frame 0xfffffe0037aa7aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037aa7ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037aa7b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0037aa7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037aa7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037aa7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100072 td 0xfffff80003bc56e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037aaca60 mi_switch() at mi_switch+0x164/frame 0xfffffe0037aacaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037aacae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037aacb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0037aacbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037aacbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037aacbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100073 td 0xfffff80003bc5000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037ab1a60 mi_switch() at mi_switch+0x164/frame 0xfffffe0037ab1aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ab1ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ab1b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0037ab1bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ab1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ab1bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100074 td 0xfffff80003bc66e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037ab6a60 mi_switch() at mi_switch+0x164/frame 0xfffffe0037ab6aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ab6ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ab6b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0037ab6bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ab6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ab6bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100075 td 0xfffff80003bc6000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037abba60 mi_switch() at mi_switch+0x164/frame 0xfffffe0037abbaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037abbae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037abbb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0037abbbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037abbbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037abbbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100076 td 0xfffff80003bd46e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037ac0a60 mi_switch() at mi_switch+0x164/frame 0xfffffe0037ac0aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ac0ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ac0b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0037ac0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ac0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ac0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100077 td 0xfffff80003bd4000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037ac5a60 mi_switch() at mi_switch+0x164/frame 0xfffffe0037ac5aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ac5ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ac5b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0037ac5bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ac5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ac5bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100114 td 0xfffff800051026e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b7ea90 mi_switch() at mi_switch+0x164/frame 0xfffffe0037b7ead0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b7eb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0037b7eb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe0037b7ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b7ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b7ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100121 td 0xfffff8001d4036e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037bada90 mi_switch() at mi_switch+0x164/frame 0xfffffe0037badad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037badb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0037badb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe0037badbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037badbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037badbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100122 td 0xfffff8001d403000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037bb2a90 mi_switch() at mi_switch+0x164/frame 0xfffffe0037bb2ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bb2b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0037bb2b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe0037bb2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bb2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bb2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100123 td 0xfffff8001d3066e0 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037bb7a90 mi_switch() at mi_switch+0x164/frame 0xfffffe0037bb7ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bb7b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0037bb7b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe0037bb7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bb7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bb7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100124 td 0xfffff8001d468000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037bbca60 mi_switch() at mi_switch+0x164/frame 0xfffffe0037bbcaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bbcae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037bbcb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0037bbcbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bbcbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bbcbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:pho> show allchains chain 1: thread 100427 (pid 69404, sh) sleeping on 0xfffff8001dd615f0 "piperd" chain 2: thread 100518 (pid 68237, mkdir) blocked on lockmgr bufwaitEXCL thread 100404 (pid 68176, mkdir) sleeping on 0xfffffe003a9d68c8 "biowr" chain 3: thread 100444 (pid 68236, mkdir) blocked on lockmgr bufwaitEXCL thread 100244 (pid 68143, link) is on a run queue chain 4: thread 100373 (pid 68234, mkdir) blocked on lockmgr bufwaitEXCL thread 100404 (pid 68176, mkdir) sleeping on 0xfffffe003a9d68c8 "biowr" chain 5: thread 100300 (pid 68224, mkdir) blocked on lockmgr bufwaitEXCL thread 100384 (pid 68196, creat) running on CPU 0 chain 6: thread 100189 (pid 68221, symlink) blocked on lockmgr bufwaitEXCL thread 100244 (pid 68143, link) is on a run queue chain 7: thread 100389 (pid 68220, mkdir) blocked on lockmgr bufwaitEXCL thread 100404 (pid 68176, mkdir) sleeping on 0xfffffe003a9d68c8 "biowr" chain 8: thread 100179 (pid 68217, symlink) blocked on lockmgr bufwaitEXCL thread 100244 (pid 68143, link) is on a run queue chain 9: thread 100322 (pid 68216, mkdir) blocked on lockmgr ufsEXCL thread 100444 (pid 68236, mkdir) blocked on lockmgr bufwaitEXCL thread 100244 (pid 68143, link) is on a run queue chain 10: thread 100276 (pid 68212, symlink) blocked on lockmgr bufwaitEXCL thread 100244 (pid 68143, link) is on a run queue chain 11: thread 100420 (pid 68209, fts) blocked on lockmgr ufsEXCL thread 100444 (pid 68236, mkdir) blocked on lockmgr bufwaitEXCL thread 100244 (pid 68143, link) is on a run queue chain 12: thread 100482 (pid 68208, rw) sleeping on 0xfffff804e133bc00 "biowr" chain 13: thread 100285 (pid 68205, creat) blocked on lockmgr bufwaitEXCL thread 100384 (pid 68196, creat) running on CPU 0 chain 14: thread 100171 (pid 68204, symlink) blocked on lockmgr bufwaitEXCL thread 100244 (pid 68143, link) is on a run queue chain 15: thread 100326 (pid 68202, rw) sleeping on 0xfffff80262731000 "biowr" chain 16: thread 100477 (pid 68201, fts) blocked on lockmgr ufsEXCL thread 100444 (pid 68236, mkdir) blocked on lockmgr bufwaitEXCL thread 100244 (pid 68143, link) is on a run queue chain 17: thread 100408 (pid 68199, symlink) blocked on lockmgr bufwaitEXCL thread 100244 (pid 68143, link) is on a run queue chain 18: thread 100277 (pid 68195, mkdir) blocked on lockmgr ufsEXCL thread 100254 (pid 68108, openat) blocked on lockmgr bufwaitEXCL thread 100404 (pid 68176, mkdir) sleeping on 0xfffffe003a9d68c8 "biowr" chain 19: thread 100382 (pid 68194, fts) blocked on lockmgr ufsEXCL thread 100444 (pid 68236, mkdir) blocked on lockmgr bufwaitEXCL thread 100244 (pid 68143, link) is on a run queue chain 20: thread 100246 (pid 68190, creat) blocked on lockmgr bufwaitEXCL thread 100384 (pid 68196, creat) running on CPU 0 chain 21: thread 100288 (pid 68186, fts) blocked on lockmgr ufsEXCL thread 100444 (pid 68236, mkdir) blocked on lockmgr bufwaitEXCL thread 100244 (pid 68143, link) is on a run queue chain 22: thread 100149 (pid 68184, rw) blocked on lockmgr bufwaitEXCL thread 100384 (pid 68196, creat) running on CPU 0 chain 23: thread 100385 (pid 68183, mkdir) blocked on lockmgr bufwaitEXCL thread 100404 (pid 68176, mkdir) sleeping on 0xfffffe003a9d68c8 "biowr" chain 24: thread 100316 (pid 68179, symlink) blocked on lockmgr bufwaitEXCL thread 100244 (pid 68143, link) is on a run queue chain 25: thread 100404 (pid 68176, mkdir) sleeping on 0xfffffe003a9d68c8 "biowr" chain 26: thread 100458 (pid 68175, fts) blocked on lockmgr ufsEXCL thread 100444 (pid 68236, mkdir) blocked on lockmgr bufwaitEXCL thread 100244 (pid 68143, link) is on a run queue chain 27: thread 100517 (pid 68172, symlink) blocked on lockmgr bufwaitEXCL thread 100404 (pid 68176, mkdir) sleeping on 0xfffffe003a9d68c8 "biowr" chain 28: thread 100474 (pid 68169, creat) blocked on lockmgr bufwaitEXCL thread 100244 (pid 68143, link) is on a run queue chain 29: thread 100409 (pid 68167, rename) blocked on lockmgr ufsEXCL thread 100444 (pid 68236, mkdir) blocked on lockmgr bufwaitEXCL thread 100244 (pid 68143, link) is on a run queue chain 30: thread 100281 (pid 68166, fts) blocked on lockmgr ufsEXCL thread 100444 (pid 68236, mkdir) blocked on lockmgr bufwaitEXCL thread 100244 (pid 68143, link) is on a run queue chain 31: thread 100371 (pid 68163, rw) blocked on lockmgr bufwaitEXCL thread 100384 (pid 68196, creat) running on CPU 0 chain 32: thread 100405 (pid 68159, creat) blocked on lockmgr ufsEXCL thread 100446 (pid 68111, openat) blocked on lockmgr bufwaitEXCL thread 100404 (pid 68176, mkdir) sleeping on 0xfffffe003a9d68c8 "biowr" chain 33: thread 100144 (pid 68158, mkfifo) blocked on lockmgr ufsEXCL thread 100444 (pid 68236, mkdir) blocked on lockmgr bufwaitEXCL thread 100244 (pid 68143, link) is on a run queue chain 34: thread 100481 (pid 68157, rename) blocked on lockmgr ufsEXCL thread 100444 (pid 68236, mkdir) blocked on lockmgr bufwaitEXCL thread 100244 (pid 68143, link) is on a run queue chain 35: thread 100286 (pid 68156, rw) blocked on lockmgr bufwaitEXCL thread 100384 (pid 68196, creat) running on CPU 0 chain 36: thread 100161 (pid 68155, symlink) sleeping on 0xfffffe003b374788 "biowr" chain 37: thread 100301 (pid 68154, fts) blocked on lockmgr ufsEXCL thread 100444 (pid 68236, mkdir) blocked on lockmgr bufwaitEXCL thread 100244 (pid 68143, link) is on a run queue chain 38: thread 100417 (pid 68153, creat) blocked on lockmgr bufwaitEXCL thread 100244 (pid 68143, link) is on a run queue chain 39: thread 100470 (pid 68148, symlink) blocked on lockmgr bufwaitEXCL thread 100244 (pid 68143, link) is on a run queue chain 40: thread 100372 (pid 68147, fts) blocked on lockmgr ufsEXCL thread 100444 (pid 68236, mkdir) blocked on lockmgr bufwaitEXCL thread 100244 (pid 68143, link) is on a run queue chain 41: thread 100238 (pid 68145, rename) sleeping on 0xfffff8014f140000 "wait" chain 42: thread 100152 (pid 68142, symlink) blocked on lockmgr bufwaitEXCL thread 100244 (pid 68143, link) is on a run queue chain 43: thread 100247 (pid 68141, swap) sleeping on 0xfffff8014fa85a60 "wait" chain 44: thread 100344 (pid 68140, mkfifo) sleeping on 0xfffff801a53dba60 "wait" chain 45: thread 100440 (pid 68139, fts) blocked on lockmgr ufsEXCL thread 100444 (pid 68236, mkdir) blocked on lockmgr bufwaitEXCL thread 100244 (pid 68143, link) is on a run queue chain 46: thread 100395 (pid 68136, symlink) blocked on lockmgr bufwaitEXCL thread 100244 (pid 68143, link) is on a run queue chain 47: thread 100249 (pid 68135, mkdir) sleeping on 0xfffff8003f1cba60 "wait" chain 48: thread 100159 (pid 68134, creat) sleeping on 0xfffff8001d2f6a60 "wait" chain 49: thread 100415 (pid 68133, rw) blocked on lockmgr bufwaitEXCL thread 100384 (pid 68196, creat) running on CPU 0 chain 50: thread 100447 (pid 68132, fts) blocked on lockmgr ufsEXCL thread 100444 (pid 68236, mkdir) blocked on lockmgr bufwaitEXCL thread 100244 (pid 68143, link) is on a run queue chain 51: thread 100468 (pid 68130, symlink) sleeping on 0xfffffe003a00c6c8 "biowr" chain 52: thread 100314 (pid 68128, fts) blocked on lockmgr ufsEXCL thread 100444 (pid 68236, mkdir) blocked on lockmgr bufwaitEXCL thread 100244 (pid 68143, link) is on a run queue chain 53: thread 100418 (pid 68126, symlink) blocked on lockmgr bufwaitEXCL thread 100244 (pid 68143, link) is on a run queue chain 54: thread 100514 (pid 68124, fts) blocked on lockmgr ufsEXCL thread 100444 (pid 68236, mkdir) blocked on lockmgr bufwaitEXCL thread 100244 (pid 68143, link) is on a run queue chain 55: thread 100388 (pid 68120, fts) blocked on lockmgr ufsEXCL thread 100444 (pid 68236, mkdir) blocked on lockmgr bufwaitEXCL thread 100244 (pid 68143, link) is on a run queue chain 56: thread 100350 (pid 68119, symlink) blocked on lockmgr bufwaitEXCL thread 100244 (pid 68143, link) is on a run queue chain 57: thread 100146 (pid 68118, link) sleeping on 0xfffff8001d9dfa60 "wait" chain 58: thread 100464 (pid 68116, symlink) blocked on lockmgr bufwaitEXCL thread 100404 (pid 68176, mkdir) sleeping on 0xfffffe003a9d68c8 "biowr" chain 59: thread 100378 (pid 68115, openat) blocked on lockmgr bufwaitEXCL thread 100404 (pid 68176, mkdir) sleeping on 0xfffffe003a9d68c8 "biowr" chain 60: thread 100200 (pid 68114, rw) blocked on lockmgr bufwaitEXCL thread 100404 (pid 68176, mkdir) sleeping on 0xfffffe003a9d68c8 "biowr" chain 61: thread 100273 (pid 68113, fts) sleeping on 0xfffff8014fd2b530 "wait" chain 62: thread 100446 (pid 68111, openat) blocked on lockmgr bufwaitEXCL thread 100404 (pid 68176, mkdir) sleeping on 0xfffffe003a9d68c8 "biowr" chain 63: thread 100254 (pid 68108, openat) blocked on lockmgr bufwaitEXCL thread 100404 (pid 68176, mkdir) sleeping on 0xfffffe003a9d68c8 "biowr" chain 64: thread 100211 (pid 68107, rw) sleeping on 0xfffff8001dd57a60 "wait" chain 65: thread 100391 (pid 68105, openat) sleeping on 0xfffff8003f4b9000 "wait" chain 66: thread 100509 (pid 68104, symlink) sleeping on 0xfffff802a5a93530 "wait" chain 67: thread 100143 (pid 68103, mkfifo) sleeping on 0xffffffff81c816f9 "nanslp" chain 68: thread 100515 (pid 68102, lockf2) sleeping on 0xfffff8055987e000 "wait" chain 69: thread 100302 (pid 68101, swap) sleeping on 0xffffffff81c816fa "nanslp" chain 70: thread 100299 (pid 68100, rename) sleeping on 0xffffffff81c816f3 "nanslp" chain 71: thread 100430 (pid 68099, mkdir) sleeping on 0xffffffff81c816f2 "nanslp" chain 72: thread 100242 (pid 68098, creat) sleeping on 0xffffffff81c816f8 "nanslp" chain 73: thread 100151 (pid 68096, link) sleeping on 0xffffffff81c816f7 "nanslp" chain 74: thread 100466 (pid 68095, fts) sleeping on 0xffffffff81c816f1 "nanslp" chain 75: thread 100439 (pid 68094, rw) sleeping on 0xffffffff81c816f3 "nanslp" chain 76: thread 100271 (pid 68093, openat) sleeping on 0xffffffff81c816fa "nanslp" chain 77: thread 100512 (pid 68092, symlink) sleeping on 0xffffffff81c816f9 "nanslp" chain 78: thread 100313 (pid 68091, lockf2) sleeping on 0xffffffff81c816fa "nanslp" chain 79: thread 100154 (pid 68090, run) sleeping on 0xfffff8001d2ed000 "wait" chain 80: thread 100437 (pid 68089, run) sleeping on 0xfffff803f4d26530 "wait" chain 81: thread 100426 (pid 68088, run) sleeping on 0xffffffff81c816fa "nanslp" chain 82: thread 100278 (pid 68080, sh) sleeping on 0xfffff8001dc1c000 "wait" chain 83: thread 100471 (pid 68079, su) sleeping on 0xfffff8014fad7000 "wait" chain 84: thread 100323 (pid 68069, md12) sleeping on 0xfffff80665fea000 "mdwait" chain 85: thread 100265 (pid 68065, md11) sleeping on 0xfffff8053fe90000 "mdwait" chain 86: thread 100403 (pid 68061, md10) sleeping on 0xfffff805c39a3000 "mdwait" chain 87: thread 100340 (pid 68051, tee) sleeping on 0xfffff8035ade9000 "piperd" chain 88: thread 100188 (pid 68050, sh) sleeping on 0xfffff8001da4d000 "wait" chain 89: thread 100422 (pid 68049, sh) sleeping on 0xfffff80448b19530 "wait" chain 90: thread 100234 (pid 2506, sh) sleeping on 0xfffff8001da095f0 "piperd" chain 91: thread 100209 (pid 2504, awk) sleeping on 0xfffff8001da09be0 "piperd" chain 92: thread 100223 (pid 2503, sh) sleeping on 0xfffff8003572fa60 "wait" chain 93: thread 100203 (pid 2470, sh) sleeping on 0xfffff8001da53000 "wait" chain 94: thread 100221 (pid 2359, sh) sleeping on 0xfffff8001dd8d530 "wait" chain 95: thread 100177 (pid 2357, bash) sleeping on 0xfffff8001d9e2a60 "wait" chain 96: thread 100190 (pid 2355, csh) sleeping on 0xfffff8001deea0a8 "pause" chain 97: thread 100173 (pid 2354, su) sleeping on 0xfffff8001deea530 "wait" chain 98: thread 100195 (pid 2349, bash) sleeping on 0xfffff8001d9eda60 "wait" chain 99: thread 100213 (pid 2348, sshd) sleeping on 0xfffff80005015040 "select" chain 100: thread 100170 (pid 2345, sshd) sleeping on 0xfffff80003b793c0 "select" chain 101: thread 100204 (pid 2341, csh) sleeping on 0xfffff8000515a0b0 "ttyin" chain 102: thread 100157 (pid 2340, login) sleeping on 0xfffff8001d3f6000 "wait" chain 103: thread 100145 (pid 2339, getty) sleeping on 0xfffff8000515a4b0 "ttyin" chain 104: thread 100218 (pid 2338, getty) sleeping on 0xfffff8001d4280b0 "ttyin" chain 105: thread 100217 (pid 2337, getty) sleeping on 0xfffff8001d4284b0 "ttyin" chain 106: thread 100216 (pid 2336, getty) sleeping on 0xfffff8001d4288b0 "ttyin" chain 107: thread 100215 (pid 2335, getty) sleeping on 0xfffff8001d428cb0 "ttyin" chain 108: thread 100214 (pid 2334, getty) sleeping on 0xfffff8001d4270b0 "ttyin" chain 109: thread 100163 (pid 2333, getty) sleeping on 0xfffff8001d4274b0 "ttyin" chain 110: thread 100208 (pid 2332, getty) sleeping on 0xfffff8001d4278b0 "ttyin" chain 111: thread 100142 (pid 2331, getty) sleeping on 0xfffff8001d427cb0 "ttyin" chain 112: thread 100165 (pid 2285, cron) sleeping on 0xffffffff81c816f7 "nanslp" chain 113: thread 100162 (pid 2281, sshd) sleeping on 0xfffff8001d89b8c0 "select" chain 114: thread 100207 (pid 2253, powerd) sleeping on 0xfffff8001d8d0ec0 "select" chain 115: thread 100156 (pid 2250, ntpd) sleeping on 0xfffff8001d5822c0 "select" chain 116: thread 100527 (pid 2250, ntpd) sleeping on 0xfffff8001d751a80 "usem" chain 117: thread 100197 (pid 2189, NLM: master) sleeping on 0xfffff8001d5d6760 "rpcsvc" chain 118: thread 100194 (pid 2186, rpc.statd) sleeping on 0xfffff8001d8d0f40 "select" chain 119: thread 100201 (pid 2140, watchdogd) sleeping on 0xffffffff81c816fa "nanslp" chain 120: thread 100164 (pid 2061, rpcbind) sleeping on 0xfffff8001d89b940 "select" chain 121: thread 100192 (pid 2051, syslogd) sleeping on 0xfffff80005015240 "select" chain 122: thread 100172 (pid 1980, devd) sleeping on 0xfffff800351d00c0 "select" chain 123: thread 100199 (pid 1975, dhclient) sleeping on 0xfffff800050152c0 "select" chain 124: thread 100196 (pid 1928, dhclient) sleeping on 0xfffff8001dd74140 "select" chain 125: thread 100193 (pid 1925, dhclient) sleeping on 0xfffff80003b79540 "select" chain 126: thread 100137 (pid 34, syncer) sleeping on 0xffffffff81d57b58 "syncer" chain 127: thread 100133 (pid 33, vnlru) sleeping on 0xfffff8001d3f1000 "vlruwt" chain 128: thread 100130 (pid 32, bufdaemon) sleeping on 0xffffffff81d57058 "psleep" chain 129: thread 100131 (pid 32, bufspacedaemon-0) sleeping on 0xffffffff8180a980 "-" chain 130: thread 100134 (pid 32, bufspacedaemon-1) sleeping on 0xffffffff81812c40 "-" chain 131: thread 100135 (pid 32, bufspacedaemon-2) sleeping on 0xffffffff8181af00 "-" chain 132: thread 100136 (pid 32, bufspacedaemon-3) sleeping on 0xffffffff818231c0 "-" chain 133: thread 100138 (pid 32, bufspacedaemon-4) sleeping on 0xffffffff8182b480 "-" chain 134: thread 100140 (pid 32, bufspacedaemon-5) sleeping on 0xffffffff81833740 "-" chain 135: thread 100141 (pid 32, bufspacedaemon-6) sleeping on 0xffffffff8183ba00 "-" chain 136: thread 100153 (pid 32, / worker) sleeping on 0xfffff8001de83ce8 "sdflush" chain 137: thread 100205 (pid 32, /tmp worker) sleeping on 0xfffff8001d2e62e8 "sdflush" chain 138: thread 100129 (pid 31, vmdaemon) sleeping on 0xffffffff81d72ac8 "psleep" chain 139: thread 100132 (pid 30, laundry: dom0) sleeping on 0xffffffff81d6e404 "swbufa" chain 140: thread 100139 (pid 30, uma) sleeping on 0xffffffff80f0bb20 "umarcl" chain 141: thread 100127 (pid 29, enc_daemon1) sleeping on 0xfffff8001d50a530 "idle" chain 142: thread 100126 (pid 28, enc_daemon0) sleeping on 0xfffff8001d50aa60 "idle" chain 143: thread 100120 (pid 27, rand_harvestq) sleeping on 0xffffffff81adbfb0 "-" chain 144: thread 100119 (pid 26, sctp_iterator) sleeping on 0xffffffff81de5020 "waiting_for_work" chain 145: thread 100118 (pid 25, soaiod4) sleeping on 0xffffffff81d56a5c "-" chain 146: thread 100117 (pid 24, soaiod3) sleeping on 0xffffffff81d56a5c "-" chain 147: thread 100116 (pid 23, soaiod2) sleeping on 0xffffffff81d56a5c "-" chain 148: thread 100115 (pid 22, soaiod1) sleeping on 0xffffffff81d56a5c "-" chain 149: thread 100096 (pid 21, usbus0) sleeping on 0xfffffe00d2bfc440 "-" chain 150: thread 100097 (pid 21, usbus0) sleeping on 0xfffffe00d2bfc498 "-" chain 151: thread 100098 (pid 21, usbus0) sleeping on 0xfffffe00d2bfc4f0 "-" chain 152: thread 100099 (pid 21, usbus0) sleeping on 0xfffffe00d2bfc548 "-" chain 153: thread 100100 (pid 21, usbus0) sleeping on 0xfffffe00d2bfc5a0 "-" chain 154: thread 100102 (pid 21, usbus1) sleeping on 0xfffffe003e436cf0 "-" chain 155: thread 100103 (pid 21, usbus1) sleeping on 0xfffffe003e436d48 "-" chain 156: thread 100104 (pid 21, usbus1) sleeping on 0xfffffe003e436da0 "-" chain 157: thread 100105 (pid 21, usbus1) sleeping on 0xfffffe003e436df8 "-" chain 158: thread 100106 (pid 21, usbus1) sleeping on 0xfffffe003e436e50 "-" chain 159: thread 100107 (pid 21, usbus2) sleeping on 0xfffffe00d2f89cf0 "-" chain 160: thread 100108 (pid 21, usbus2) sleeping on 0xfffffe00d2f89d48 "-" chain 161: thread 100109 (pid 21, usbus2) sleeping on 0xfffffe00d2f89da0 "-" chain 162: thread 100110 (pid 21, usbus2) sleeping on 0xfffffe00d2f89df8 "-" chain 163: thread 100111 (pid 21, usbus2) sleeping on 0xfffffe00d2f89e50 "-" chain 164: thread 100091 (pid 20, doneq0) sleeping on 0xffffffff819b73c0 "-" chain 165: thread 100093 (pid 20, doneq2) sleeping on 0xffffffff819b74c0 "-" chain 166: thread 100125 (pid 20, scanner) sleeping on 0xffffffff819b7288 "-" chain 167: thread 100090 (pid 19, crypto returns 11) sleeping on 0xfffff80003bd0450 "crypto_ret_wait" chain 168: thread 100089 (pid 18, crypto returns 10) sleeping on 0xfffff80003bd03f0 "crypto_ret_wait" chain 169: thread 100088 (pid 17, crypto returns 9) sleeping on 0xfffff80003bd0390 "crypto_ret_wait" chain 170: thread 100087 (pid 16, crypto returns 8) sleeping on 0xfffff80003bd0330 "crypto_ret_wait" chain 171: thread 100086 (pid 15, crypto returns 7) sleeping on 0xfffff80003bd02d0 "crypto_ret_wait" chain 172: thread 100085 (pid 9, crypto returns 6) sleeping on 0xfffff80003bd0270 "crypto_ret_wait" chain 173: thread 100084 (pid 8, crypto returns 5) sleeping on 0xfffff80003bd0210 "crypto_ret_wait" chain 174: thread 100083 (pid 7, crypto returns 4) sleeping on 0xfffff80003bd01b0 "crypto_ret_wait" chain 175: thread 100082 (pid 6, crypto returns 3) sleeping on 0xfffff80003bd0150 "crypto_ret_wait" chain 176: thread 100081 (pid 5, crypto returns 2) sleeping on 0xfffff80003bd00f0 "crypto_ret_wait" chain 177: thread 100080 (pid 4, crypto returns 1) sleeping on 0xfffff80003bd0090 "crypto_ret_wait" chain 178: thread 100079 (pid 3, crypto returns 0) sleeping on 0xfffff80003bd0030 "crypto_ret_wait" chain 179: thread 100078 (pid 2, crypto) sleeping on 0xffffffff81d6cb38 "crypto_wait" chain 180: thread 100065 (pid 14, sequencer 00) sleeping on 0xfffff80003adf888 "seqstate" chain 181: thread 100062 (pid 13, g_event) sleeping on 0xffffffff81d9e088 "-" chain 182: thread 100002 (pid 1, init) sleeping on 0xfffff80003944530 "wait" chain 183: thread 100001 (pid 10, audit) sleeping on 0xffffffff81de5cb0 "audit_worker_cv" chain 184: thread 100000 (pid 0, swapper) sleeping on 0xffffffff81d8c638 "swapin" chain 185: thread 100015 (pid 0, config_0) sleeping on 0xfffff8000399f000 "-" chain 186: thread 100016 (pid 0, aiod_kick taskq) sleeping on 0xfffff8000399ee00 "-" chain 187: thread 100019 (pid 0, thread taskq) sleeping on 0xfffff8000399eb00 "-" chain 188: thread 100021 (pid 0, kqueue_ctx taskq) sleeping on 0xfffff8000399e900 "-" chain 189: thread 100022 (pid 0, if_io_tqg_0) sleeping on 0xfffff8000399e800 "-" chain 190: thread 100023 (pid 0, if_io_tqg_1) sleeping on 0xfffff8000399e700 "-" chain 191: thread 100024 (pid 0, if_io_tqg_2) sleeping on 0xfffff8000399e600 "-" chain 192: thread 100025 (pid 0, if_io_tqg_3) sleeping on 0xfffff8000399e500 "-" chain 193: thread 100026 (pid 0, if_io_tqg_4) sleeping on 0xfffff8000399e400 "-" chain 194: thread 100027 (pid 0, if_io_tqg_5) sleeping on 0xfffff8000399e300 "-" chain 195: thread 100028 (pid 0, if_io_tqg_6) sleeping on 0xfffff8000399e200 "-" chain 196: thread 100029 (pid 0, if_io_tqg_7) sleeping on 0xfffff8000399e100 "-" chain 197: thread 100030 (pid 0, if_io_tqg_8) sleeping on 0xfffff8000399e000 "-" chain 198: thread 100031 (pid 0, if_io_tqg_9) sleeping on 0xfffff8000399de00 "-" chain 199: thread 100032 (pid 0, if_io_tqg_10) sleeping on 0xfffff8000399dd00 "-" chain 200: thread 100033 (pid 0, if_io_tqg_11) sleeping on 0xfffff8000399dc00 "-" chain 201: thread 100034 (pid 0, softirq_0) sleeping on 0xfffff8000399db00 "-" chain 202: thread 100035 (pid 0, softirq_1) sleeping on 0xfffff8000399da00 "-" chain 203: thread 100036 (pid 0, softirq_2) sleeping on 0xfffff8000399d900 "-" chain 204: thread 100037 (pid 0, softirq_3) sleeping on 0xfffff8000399d800 "-" chain 205: thread 100038 (pid 0, softirq_4) sleeping on 0xfffff8000399d700 "-" chain 206: thread 100039 (pid 0, softirq_5) sleeping on 0xfffff8000399d600 "-" chain 207: thread 100040 (pid 0, softirq_6) sleeping on 0xfffff8000399d500 "-" chain 208: thread 100041 (pid 0, softirq_7) sleeping on 0xfffff8000399d400 "-" chain 209: thread 100042 (pid 0, softirq_8) sleeping on 0xfffff8000399d300 "-" chain 210: thread 100043 (pid 0, softirq_9) sleeping on 0xfffff8000399d200 "-" chain 211: thread 100044 (pid 0, softirq_10) sleeping on 0xfffff8000399d100 "-" chain 212: thread 100045 (pid 0, softirq_11) sleeping on 0xfffff8000399d000 "-" chain 213: thread 100046 (pid 0, if_config_tqg_0) sleeping on 0xfffff80003abd100 "-" chain 214: thread 100061 (pid 0, firmware taskq) sleeping on 0xfffff80003abd000 "-" chain 215: thread 100066 (pid 0, crypto_0) sleeping on 0xfffff80003abee00 "-" chain 216: thread 100067 (pid 0, crypto_1) sleeping on 0xfffff80003abee00 "-" chain 217: thread 100068 (pid 0, crypto_2) sleeping on 0xfffff80003abee00 "-" chain 218: thread 100069 (pid 0, crypto_3) sleeping on 0xfffff80003abee00 "-" chain 219: thread 100070 (pid 0, crypto_4) sleeping on 0xfffff80003abee00 "-" chain 220: thread 100071 (pid 0, crypto_5) sleeping on 0xfffff80003abee00 "-" chain 221: thread 100072 (pid 0, crypto_6) sleeping on 0xfffff80003abee00 "-" chain 222: thread 100073 (pid 0, crypto_7) sleeping on 0xfffff80003abee00 "-" chain 223: thread 100074 (pid 0, crypto_8) sleeping on 0xfffff80003abee00 "-" chain 224: thread 100075 (pid 0, crypto_9) sleeping on 0xfffff80003abee00 "-" chain 225: thread 100076 (pid 0, crypto_10) sleeping on 0xfffff80003abee00 "-" chain 226: thread 100077 (pid 0, crypto_11) sleeping on 0xfffff80003abee00 "-" chain 227: thread 100114 (pid 0, mca taskq) sleeping on 0xfffff800051cb200 "-" chain 228: thread 100121 (pid 0, acpi_task_0) sleeping on 0xfffff8001d458300 "-" chain 229: thread 100122 (pid 0, acpi_task_1) sleeping on 0xfffff8001d458300 "-" chain 230: thread 100123 (pid 0, acpi_task_2) sleeping on 0xfffff8001d458300 "-" chain 231: thread 100124 (pid 0, CAM taskq) sleeping on 0xfffff80003abed00 "-" db:0:pho> chain 1: thread 100427 (pid 69404, sh) sleeping on 0xfffff8001dd615f0 "piperd" chain 2: thread 100518 (pid 68237, mkdir) blocked on lockmgr bufwaitEXCL thread 100404 (pid 68176, mkdir) sleeping on 0xfffffe003a9d68c8 "biowr" chain 3: thread 100444 (pid 68236, mkdir) blocked on lockmgr bufwaitEXCL thread 100244 (pid 68143, link) is on a run queue chain 4: thread 100373 (pid 68234, mkdir) blocked on lockmgr bufwaitEXCL thread 100404 (pid 68176, mkdir) sleeping on 0xfffffe003a9d68c8 "biowr" chain 5: thread 100300 (pid 68224, mkdir) blocked on lockmgr bufwaitEXCL thread 100384 (pid 68196, creat) running on CPU 0 chain 6: thread 100189 (pid 68221, symlink) blocked on lockmgr bufwaitEXCL thread 100244 (pid 68143, link) is on a run queue chain 7: thread 100389 (pid 68220, mkdir) blocked on lockmgr bufwaitEXCL thread 100404 (pid 68176, mkdir) sleeping on 0xfffffe003a9d68c8 "biowr" chain 8: thread 100179 (pid 68217, symlink) blocked on lockmgr bufwaitEXCL thread 100244 (pid 68143, link) is on a run queue chain 9: thread 100322 (pid 68216, mkdir) blocked on lockmgr ufsEXCL thread 100444 (pid 68236, mkdir) blocked on lockmgr bufwaitEXCL thread 100244 (pid 68143, link) is on a run queue chain 10: thread 100276 (pid 68212, symlink) blocked on lockmgr bufwaitEXCL thread 100244 (pid 68143, link) is on a run queue chain 11: thread 100420 (pid 68209, fts) blocked on lockmgr ufsEXCL thread 100444 (pid 68236, mkdir) blocked on lockmgr bufwaitEXCL thread 100244 (pid 68143, link) is on a run queue chain 12: thread 100482 (pid 68208, rw) sleeping on 0xfffff804e133bc00 "biowr" chain 13: thread 100285 (pid 68205, creat) blocked on lockmgr bufwaitEXCL thread 100384 (pid 68196, creat) running on CPU 0 chain 14: thread 100171 (pid 68204, symlink) blocked on lockmgr bufwaitEXCL thread 100244 (pid 68143, link) is on a run queue chain 15: thread 100326 (pid 68202, rw) sleeping on 0xfffff80262731000 "biowr" chain 16: thread 100477 (pid 68201, fts) blocked on lockmgr ufsEXCL thread 100444 (pid 68236, mkdir) blocked on lockmgr bufwaitEXCL thread 100244 (pid 68143, link) is on a run queue chain 17: thread 100408 (pid 68199, symlink) blocked on lockmgr bufwaitEXCL thread 100244 (pid 68143, link) is on a run queue chain 18: thread 100277 (pid 68195, mkdir) blocked on lockmgr ufsEXCL thread 100254 (pid 68108, openat) blocked on lockmgr bufwaitEXCL thread 100404 (pid 68176, mkdir) sleeping on 0xfffffe003a9d68c8 "biowr" chain 19: thread 100382 (pid 68194, fts) blocked on lockmgr ufsEXCL thread 100444 (pid 68236, mkdir) blocked on lockmgr bufwaitEXCL thread 100244 (pid 68143, link) is on a run queue chain 20: thread 100246 (pid 68190, creat) blocked on lockmgr bufwaitEXCL thread 100384 (pid 68196, creat) running on CPU 0 chain 21: thread 100288 (pid 68186, fts) blocked on lockmgr ufsEXCL thread 100444 (pid 68236, mkdir) blocked on lockmgr bufwaitEXCL thread 100244 (pid 68143, link) is on a run queue chain 22: thread 100149 (pid 68184, rw) blocked on lockmgr bufwaitEXCL thread 100384 (pid 68196, creat) running on CPU 0 chain 23: thread 100385 (pid 68183, mkdir) blocked on lockmgr bufwaitEXCL thread 100404 (pid 68176, mkdir) sleeping on 0xfffffe003a9d68c8 "biowr" chain 24: thread 100316 (pid 68179, symlink) blocked on lockmgr bufwaitEXCL thread 100244 (pid 68143, link) is on a run queue chain 25: thread 100404 (pid 68176, mkdir) sleeping on 0xfffffe003a9d68c8 "biowr" chain 26: thread 100458 (pid 68175, fts) blocked on lockmgr ufsEXCL thread 100444 (pid 68236, mkdir) blocked on lockmgr bufwaitEXCL thread 100244 (pid 68143, link) is on a run queue chain 27: thread 100517 (pid 68172, symlink) blocked on lockmgr bufwaitEXCL thread 100404 (pid 68176, mkdir) sleeping on 0xfffffe003a9d68c8 "biowr" chain 28: thread 100474 (pid 68169, creat) blocked on lockmgr bufwaitEXCL thread 100244 (pid 68143, link) is on a run queue chain 29: thread 100409 (pid 68167, rename) blocked on lockmgr ufsEXCL thread 100444 (pid 68236, mkdir) blocked on lockmgr bufwaitEXCL thread 100244 (pid 68143, link) is on a run queue chain 30: thread 100281 (pid 68166, fts) blocked on lockmgr ufsEXCL thread 100444 (pid 68236, mkdir) blocked on lockmgr bufwaitEXCL thread 100244 (pid 68143, link) is on a run queue chain 31: thread 100371 (pid 68163, rw) blocked on lockmgr bufwaitEXCL thread 100384 (pid 68196, creat) running on CPU 0 chain 32: thread 100405 (pid 68159, creat) blocked on lockmgr ufsEXCL thread 100446 (pid 68111, openat) blocked on lockmgr bufwaitEXCL thread 100404 (pid 68176, mkdir) sleeping on 0xfffffe003a9d68c8 "biowr" chain 33: thread 100144 (pid 68158, mkfifo) blocked on lockmgr ufsEXCL thread 100444 (pid 68236, mkdir) blocked on lockmgr bufwaitEXCL thread 100244 (pid 68143, link) is on a run queue chain 34: thread 100481 (pid 68157, rename) blocked on lockmgr ufsEXCL thread 100444 (pid 68236, mkdir) blocked on lockmgr bufwaitEXCL thread 100244 (pid 68143, link) is on a run queue chain 35: thread 100286 (pid 68156, rw) blocked on lockmgr bufwaitEXCL thread 100384 (pid 68196, creat) running on CPU 0 chain 36: thread 100161 (pid 68155, symlink) sleeping on 0xfffffe003b374788 "biowr" chain 37: thread 100301 (pid 68154, fts) blocked on lockmgr ufsEXCL thread 100444 (pid 68236, mkdir) blocked on lockmgr bufwaitEXCL thread 100244 (pid 68143, link) is on a run queue chain 38: thread 100417 (pid 68153, creat) blocked on lockmgr bufwaitEXCL thread 100244 (pid 68143, link) is on a run queue chain 39: thread 100470 (pid 68148, symlink) blocked on lockmgr bufwaitEXCL thread 100244 (pid 68143, link) is on a run queue chain 40: thread 100372 (pid 68147, fts) blocked on lockmgr ufsEXCL thread 100444 (pid 68236, mkdir) blocked on lockmgr bufwaitEXCL thread 100244 (pid 68143, link) is on a run queue chain 41: thread 100238 (pid 68145, rename) sleeping on 0xfffff8014f140000 "wait" chain 42: thread 100152 (pid 68142, symlink) blocked on lockmgr bufwaitEXCL thread 100244 (pid 68143, link) is on a run queue chain 43: thread 100247 (pid 68141, swap) sleeping on 0xfffff8014fa85a60 "wait" chain 44: thread 100344 (pid 68140, mkfifo) sleeping on 0xfffff801a53dba60 "wait" chain 45: thread 100440 (pid 68139, fts) blocked on lockmgr ufsEXCL thread 100444 (pid 68236, mkdir) blocked on lockmgr bufwaitEXCL thread 100244 (pid 68143, link) is on a run queue chain 46: thread 100395 (pid 68136, symlink) blocked on lockmgr bufwaitEXCL thread 100244 (pid 68143, link) is on a run queue chain 47: thread 100249 (pid 68135, mkdir) sleeping on 0xfffff8003f1cba60 "wait" chain 48: thread 100159 (pid 68134, creat) sleeping on 0xfffff8001d2f6a60 "wait" chain 49: thread 100415 (pid 68133, rw) blocked on lockmgr bufwaitEXCL thread 100384 (pid 68196, creat) running on CPU 0 chain 50: thread 100447 (pid 68132, fts) blocked on lockmgr ufsEXCL thread 100444 (pid 68236, mkdir) blocked on lockmgr bufwaitEXCL thread 100244 (pid 68143, link) is on a run queue chain 51: thread 100468 (pid 68130, symlink) sleeping on 0xfffffe003a00c6c8 "biowr" chain 52: thread 100314 (pid 68128, fts) blocked on lockmgr ufsEXCL thread 100444 (pid 68236, mkdir) blocked on lockmgr bufwaitEXCL thread 100244 (pid 68143, link) is on a run queue chain 53: thread 100418 (pid 68126, symlink) blocked on lockmgr bufwaitEXCL thread 100244 (pid 68143, link) is on a run queue chain 54: thread 100514 (pid 68124, fts) blocked on lockmgr ufsEXCL thread 100444 (pid 68236, mkdir) blocked on lockmgr bufwaitEXCL thread 100244 (pid 68143, link) is on a run queue chain 55: thread 100388 (pid 68120, fts) blocked on lockmgr ufsEXCL thread 100444 (pid 68236, mkdir) blocked on lockmgr bufwaitEXCL thread 100244 (pid 68143, link) is on a run queue chain 56: thread 100350 (pid 68119, symlink) blocked on lockmgr bufwaitEXCL thread 100244 (pid 68143, link) is on a run queue chain 57: thread 100146 (pid 68118, link) sleeping on 0xfffff8001d9dfa60 "wait" chain 58: thread 100464 (pid 68116, symlink) blocked on lockmgr bufwaitEXCL thread 100404 (pid 68176, mkdir) sleeping on 0xfffffe003a9d68c8 "biowr" chain 59: thread 100378 (pid 68115, openat) blocked on lockmgr bufwaitEXCL thread 100404 (pid 68176, mkdir) sleeping on 0xfffffe003a9d68c8 "biowr" chain 60: thread 100200 (pid 68114, rw) blocked on lockmgr bufwaitEXCL thread 100404 (pid 68176, mkdir) sleeping on 0xfffffe003a9d68c8 "biowr" chain 61: thread 100273 (pid 68113, fts) sleeping on 0xfffff8014fd2b530 "wait" chain 62: thread 100446 (pid 68111, openat) blocked on lockmgr bufwaitEXCL thread 100404 (pid 68176, mkdir) sleeping on 0xfffffe003a9d68c8 "biowr" chain 63: thread 100254 (pid 68108, openat) blocked on lockmgr bufwaitEXCL thread 100404 (pid 68176, mkdir) sleeping on 0xfffffe003a9d68c8 "biowr" chain 64: thread 100211 (pid 68107, rw) sleeping on 0xfffff8001dd57a60 "wait" chain 65: thread 100391 (pid 68105, openat) sleeping on 0xfffff8003f4b9000 "wait" chain 66: thread 100509 (pid 68104, symlink) sleeping on 0xfffff802a5a93530 "wait" chain 67: thread 100143 (pid 68103, mkfifo) sleeping on 0xffffffff81c816f9 "nanslp" chain 68: thread 100515 (pid 68102, lockf2) sleeping on 0xfffff8055987e000 "wait" chain 69: thread 100302 (pid 68101, swap) sleeping on 0xffffffff81c816fa "nanslp" chain 70: thread 100299 (pid 68100, rename) sleeping on 0xffffffff81c816f3 "nanslp" chain 71: thread 100430 (pid 68099, mkdir) sleeping on 0xffffffff81c816f2 "nanslp" chain 72: thread 100242 (pid 68098, creat) sleeping on 0xffffffff81c816f8 "nanslp" chain 73: thread 100151 (pid 68096, link) sleeping on 0xffffffff81c816f7 "nanslp" chain 74: thread 100466 (pid 68095, fts) sleeping on 0xffffffff81c816f1 "nanslp" chain 75: thread 100439 (pid 68094, rw) sleeping on 0xffffffff81c816f3 "nanslp" chain 76: thread 100271 (pid 68093, openat) sleeping on 0xffffffff81c816fa "nanslp" chain 77: thread 100512 (pid 68092, symlink) sleeping on 0xffffffff81c816f9 "nanslp" chain 78: thread 100313 (pid 68091, lockf2) sleeping on 0xffffffff81c816fa "nanslp" chain 79: thread 100154 (pid 68090, run) sleeping on 0xfffff8001d2ed000 "wait" chain 80: thread 100437 (pid 68089, run) sleeping on 0xfffff803f4d26530 "wait" chain 81: thread 100426 (pid 68088, run) sleeping on 0xffffffff81c816fa "nanslp" chain 82: thread 100278 (pid 68080, sh) sleeping on 0xfffff8001dc1c000 "wait" chain 83: thread 100471 (pid 68079, su) sleeping on 0xfffff8014fad7000 "wait" chain 84: thread 100323 (pid 68069, md12) sleeping on 0xfffff80665fea000 "mdwait" chain 85: thread 100265 (pid 68065, md11) sleeping on 0xfffff8053fe90000 "mdwait" chain 86: thread 100403 (pid 68061, md10) sleeping on 0xfffff805c39a3000 "mdwait" chain 87: thread 100340 (pid 68051, tee) sleeping on 0xfffff8035ade9000 "piperd" chain 88: thread 100188 (pid 68050, sh) sleeping on 0xfffff8001da4d000 "wait" chain 89: thread 100422 (pid 68049, sh) sleeping on 0xfffff80448b19530 "wait" chain 90: thread 100234 (pid 2506, sh) sleeping on 0xfffff8001da095f0 "piperd" chain 91: thread 100209 (pid 2504, awk) sleeping on 0xfffff8001da09be0 "piperd" chain 92: thread 100223 (pid 2503, sh) sleeping on 0xfffff8003572fa60 "wait" chain 93: thread 100203 (pid 2470, sh) sleeping on 0xfffff8001da53000 "wait" chain 94: thread 100221 (pid 2359, sh) sleeping on 0xfffff8001dd8d530 "wait" chain 95: thread 100177 (pid 2357, bash) sleeping on 0xfffff8001d9e2a60 "wait" chain 96: thread 100190 (pid 2355, csh) sleeping on 0xfffff8001deea0a8 "pause" chain 97: thread 100173 (pid 2354, su) sleeping on 0xfffff8001deea530 "wait" chain 98: thread 100195 (pid 2349, bash) sleeping on 0xfffff8001d9eda60 "wait" chain 99: thread 100213 (pid 2348, sshd) sleeping on 0xfffff80005015040 "select" chain 100: thread 100170 (pid 2345, sshd) sleeping on 0xfffff80003b793c0 "select" chain 101: thread 100204 (pid 2341, csh) sleeping on 0xfffff8000515a0b0 "ttyin" chain 102: thread 100157 (pid 2340, login) sleeping on 0xfffff8001d3f6000 "wait" chain 103: thread 100145 (pid 2339, getty) sleeping on 0xfffff8000515a4b0 "ttyin" chain 104: thread 100218 (pid 2338, getty) sleeping on 0xfffff8001d4280b0 "ttyin" chain 105: thread 100217 (pid 2337, getty) sleeping on 0xfffff8001d4284b0 "ttyin" chain 106: thread 100216 (pid 2336, getty) sleeping on 0xfffff8001d4288b0 "ttyin" chain 107: thread 100215 (pid 2335, getty) sleeping on 0xfffff8001d428cb0 "ttyin" chain 108: thread 100214 (pid 2334, getty) sleeping on 0xfffff8001d4270b0 "ttyin" chain 109: thread 100163 (pid 2333, getty) sleeping on 0xfffff8001d4274b0 "ttyin" chain 110: thread 100208 (pid 2332, getty) sleeping on 0xfffff8001d4278b0 "ttyin" chain 111: thread 100142 (pid 2331, getty) sleeping on 0xfffff8001d427cb0 "ttyin" chain 112: thread 100165 (pid 2285, cron) sleeping on 0xffffffff81c816f7 "nanslp" chain 113: thread 100162 (pid 2281, sshd) sleeping on 0xfffff8001d89b8c0 "select" chain 114: thread 100207 (pid 2253, powerd) sleeping on 0xfffff8001d8d0ec0 "select" chain 115: thread 100156 (pid 2250, ntpd) sleeping on 0xfffff8001d5822c0 "select" chain 116: thread 100527 (pid 2250, ntpd) sleeping on 0xfffff8001d751a80 "usem" chain 117: thread 100197 (pid 2189, NLM: master) sleeping on 0xfffff8001d5d6760 "rpcsvc" chain 118: thread 100194 (pid 2186, rpc.statd) sleeping on 0xfffff8001d8d0f40 "select" chain 119: thread 100201 (pid 2140, watchdogd) sleeping on 0xffffffff81c816fa "nanslp" chain 120: thread 100164 (pid 2061, rpcbind) sleeping on 0xfffff8001d89b940 "select" chain 121: thread 100192 (pid 2051, syslogd) sleeping on 0xfffff80005015240 "select" chain 122: thread 100172 (pid 1980, devd) sleeping on 0xfffff800351d00c0 "select" chain 123: thread 100199 (pid 1975, dhclient) sleeping on 0xfffff800050152c0 "select" chain 124: thread 100196 (pid 1928, dhclient) sleeping on 0xfffff8001dd74140 "select" chain 125: thread 100193 (pid 1925, dhclient) sleeping on 0xfffff80003b79540 "select" chain 126: thread 100137 (pid 34, syncer) sleeping on 0xffffffff81d57b58 "syncer" chain 127: thread 100133 (pid 33, vnlru) sleeping on 0xfffff8001d3f1000 "vlruwt" chain 128: thread 100130 (pid 32, bufdaemon) sleeping on 0xffffffff81d57058 "psleep" chain 129: thread 100131 (pid 32, bufspacedaemon-0) sleeping on 0xffffffff8180a980 "-" chain 130: thread 100134 (pid 32, bufspacedaemon-1) sleeping on 0xffffffff81812c40 "-" chain 131: thread 100135 (pid 32, bufspacedaemon-2) sleeping on 0xffffffff8181af00 "-" chain 132: thread 100136 (pid 32, bufspacedaemon-3) sleeping on 0xffffffff818231c0 "-" chain 133: thread 100138 (pid 32, bufspacedaemon-4) sleeping on 0xffffffff8182b480 "-" chain 134: thread 100140 (pid 32, bufspacedaemon-5) sleeping on 0xffffffff81833740 "-" chain 135: thread 100141 (pid 32, bufspacedaemon-6) sleeping on 0xffffffff8183ba00 "-" chain 136: thread 100153 (pid 32, / worker) sleeping on 0xfffff8001de83ce8 "sdflush" chain 137: thread 100205 (pid 32, /tmp worker) sleeping on 0xfffff8001d2e62e8 "sdflush" chain 138: thread 100129 (pid 31, vmdaemon) sleeping on 0xffffffff81d72ac8 "psleep" chain 139: thread 100132 (pid 30, laundry: dom0) sleeping on 0xffffffff81d6e404 "swbufa" chain 140: thread 100139 (pid 30, uma) sleeping on 0xffffffff80f0bb20 "umarcl" chain 141: thread 100127 (pid 29, enc_daemon1) sleeping on 0xfffff8001d50a530 "idle" chain 142: thread 100126 (pid 28, enc_daemon0) sleeping on 0xfffff8001d50aa60 "idle" chain 143: thread 100120 (pid 27, rand_harvestq) sleeping on 0xffffffff81adbfb0 "-" chain 144: thread 100119 (pid 26, sctp_iterator) sleeping on 0xffffffff81de5020 "waiting_for_work" chain 145: thread 100118 (pid 25, soaiod4) sleeping on 0xffffffff81d56a5c "-" chain 146: thread 100117 (pid 24, soaiod3) sleeping on 0xffffffff81d56a5c "-" chain 147: thread 100116 (pid 23, soaiod2) sleeping on 0xffffffff81d56a5c "-" chain 148: thread 100115 (pid 22, soaiod1) sleeping on 0xffffffff81d56a5c "-" chain 149: thread 100096 (pid 21, usbus0) sleeping on 0xfffffe00d2bfc440 "-" chain 150: thread 100097 (pid 21, usbus0) sleeping on 0xfffffe00d2bfc498 "-" chain 151: thread 100098 (pid 21, usbus0) sleeping on 0xfffffe00d2bfc4f0 "-" chain 152: thread 100099 (pid 21, usbus0) sleeping on 0xfffffe00d2bfc548 "-" chain 153: thread 100100 (pid 21, usbus0) sleeping on 0xfffffe00d2bfc5a0 "-" chain 154: thread 100102 (pid 21, usbus1) sleeping on 0xfffffe003e436cf0 "-" chain 155: thread 100103 (pid 21, usbus1) sleeping on 0xfffffe003e436d48 "-" chain 156: thread 100104 (pid 21, usbus1) sleeping on 0xfffffe003e436da0 "-" chain 157: thread 100105 (pid 21, usbus1) sleeping on 0xfffffe003e436df8 "-" chain 158: thread 100106 (pid 21, usbus1) sleeping on 0xfffffe003e436e50 "-" chain 159: thread 100107 (pid 21, usbus2) sleeping on 0xfffffe00d2f89cf0 "-" chain 160: thread 100108 (pid 21, usbus2) sleeping on 0xfffffe00d2f89d48 "-" chain 161: thread 100109 (pid 21, usbus2) sleeping on 0xfffffe00d2f89da0 "-" chain 162: thread 100110 (pid 21, usbus2) sleeping on 0xfffffe00d2f89df8 "-" chain 163: thread 100111 (pid 21, usbus2) sleeping on 0xfffffe00d2f89e50 "-" chain 164: thread 100091 (pid 20, doneq0) sleeping on 0xffffffff819b73c0 "-" chain 165: thread 100093 (pid 20, doneq2) sleeping on 0xffffffff819b74c0 "-" chain 166: thread 100125 (pid 20, scanner) sleeping on 0xffffffff819b7288 "-" chain 167: thread 100090 (pid 19, crypto returns 11) sleeping on 0xfffff80003bd0450 "crypto_ret_wait" chain 168: thread 100089 (pid 18, crypto returns 10) sleeping on 0xfffff80003bd03f0 "crypto_ret_wait" chain 169: thread 100088 (pid 17, crypto returns 9) sleeping on 0xfffff80003bd0390 "crypto_ret_wait" chain 170: thread 100087 (pid 16, crypto returns 8) sleeping on 0xfffff80003bd0330 "crypto_ret_wait" chain 171: thread 100086 (pid 15, crypto returns 7) sleeping on 0xfffff80003bd02d0 "crypto_ret_wait" chain 172: thread 100085 (pid 9, crypto returns 6) sleeping on 0xfffff80003bd0270 "crypto_ret_wait" chain 173: thread 100084 (pid 8, crypto returns 5) sleeping on 0xfffff80003bd0210 "crypto_ret_wait" chain 174: thread 100083 (pid 7, crypto returns 4) sleeping on 0xfffff80003bd01b0 "crypto_ret_wait" chain 175: thread 100082 (pid 6, crypto returns 3) sleeping on 0xfffff80003bd0150 "crypto_ret_wait" chain 176: thread 100081 (pid 5, crypto returns 2) sleeping on 0xfffff80003bd00f0 "crypto_ret_wait" chain 177: thread 100080 (pid 4, crypto returns 1) sleeping on 0xfffff80003bd0090 "crypto_ret_wait" chain 178: thread 100079 (pid 3, crypto returns 0) sleeping on 0xfffff80003bd0030 "crypto_ret_wait" chain 179: thread 100078 (pid 2, crypto) sleeping on 0xffffffff81d6cb38 "crypto_wait" chain 180: thread 100065 (pid 14, sequencer 00) sleeping on 0xfffff80003adf888 "seqstate" chain 181: thread 100062 (pid 13, g_event) sleeping on 0xffffffff81d9e088 "-" chain 182: thread 100002 (pid 1, init) sleeping on 0xfffff80003944530 "wait" chain 183: thread 100001 (pid 10, audit) sleeping on 0xffffffff81de5cb0 "audit_worker_cv" chain 184: thread 100000 (pid 0, swapper) sleeping on 0xffffffff81d8c638 "swapin" chain 185: thread 100015 (pid 0, config_0) sleeping on 0xfffff8000399f000 "-" chain 186: thread 100016 (pid 0, aiod_kick taskq) sleeping on 0xfffff8000399ee00 "-" chain 187: thread 100019 (pid 0, thread taskq) sleeping on 0xfffff8000399eb00 "-" chain 188: thread 100021 (pid 0, kqueue_ctx taskq) sleeping on 0xfffff8000399e900 "-" chain 189: thread 100022 (pid 0, if_io_tqg_0) sleeping on 0xfffff8000399e800 "-" chain 190: thread 100023 (pid 0, if_io_tqg_1) sleeping on 0xfffff8000399e700 "-" chain 191: thread 100024 (pid 0, if_io_tqg_2) sleeping on 0xfffff8000399e600 "-" chain 192: thread 100025 (pid 0, if_io_tqg_3) sleeping on 0xfffff8000399e500 "-" chain 193: thread 100026 (pid 0, if_io_tqg_4) sleeping on 0xfffff8000399e400 "-" chain 194: thread 100027 (pid 0, if_io_tqg_5) sleeping on 0xfffff8000399e300 "-" chain 195: thread 100028 (pid 0, if_io_tqg_6) sleeping on 0xfffff8000399e200 "-" chain 196: thread 100029 (pid 0, if_io_tqg_7) sleeping on 0xfffff8000399e100 "-" chain 197: thread 100030 (pid 0, if_io_tqg_8) sleeping on 0xfffff8000399e000 "-" chain 198: thread 100031 (pid 0, if_io_tqg_9) sleeping on 0xfffff8000399de00 "-" chain 199: thread 100032 (pid 0, if_io_tqg_10) sleeping on 0xfffff8000399dd00 "-" chain 200: thread 100033 (pid 0, if_io_tqg_11) sleeping on 0xfffff8000399dc00 "-" chain 201: thread 100034 (pid 0, softirq_0) sleeping on 0xfffff8000399db00 "-" chain 202: thread 100035 (pid 0, softirq_1) sleeping on 0xfffff8000399da00 "-" chain 203: thread 100036 (pid 0, softirq_2) sleeping on 0xfffff8000399d900 "-" chain 204: thread 100037 (pid 0, softirq_3) sleeping on 0xfffff8000399d800 "-" chain 205: thread 100038 (pid 0, softirq_4) sleeping on 0xfffff8000399d700 "-" chain 206: thread 100039 (pid 0, softirq_5) sleeping on 0xfffff8000399d600 "-" chain 207: thread 100040 (pid 0, softirq_6) sleeping on 0xfffff8000399d500 "-" chain 208: thread 100041 (pid 0, softirq_7) sleeping on 0xfffff8000399d400 "-" chain 209: thread 100042 (pid 0, softirq_8) sleeping on 0xfffff8000399d300 "-" chain 210: thread 100043 (pid 0, softirq_9) sleeping on 0xfffff8000399d200 "-" chain 211: thread 100044 (pid 0, softirq_10) sleeping on 0xfffff8000399d100 "-" chain 212: thread 100045 (pid 0, softirq_11) sleeping on 0xfffff8000399d000 "-" chain 213: thread 100046 (pid 0, if_config_tqg_0) sleeping on 0xfffff80003abd100 "-" chain 214: thread 100061 (pid 0, firmware taskq) sleeping on 0xfffff80003abd000 "-" chain 215: thread 100066 (pid 0, crypto_0) sleeping on 0xfffff80003abee00 "-" chain 216: thread 100067 (pid 0, crypto_1) sleeping on 0xfffff80003abee00 "-" chain 217: thread 100068 (pid 0, crypto_2) sleeping on 0xfffff80003abee00 "-" chain 218: thread 100069 (pid 0, crypto_3) sleeping on 0xfffff80003abee00 "-" chain 219: thread 100070 (pid 0, crypto_4) sleeping on 0xfffff80003abee00 "-" chain 220: thread 100071 (pid 0, crypto_5) sleeping on 0xfffff80003abee00 "-" chain 221: thread 100072 (pid 0, crypto_6) sleeping on 0xfffff80003abee00 "-" chain 222: thread 100073 (pid 0, crypto_7) sleeping on 0xfffff80003abee00 "-" chain 223: thread 100074 (pid 0, crypto_8) sleeping on 0xfffff80003abee00 "-" chain 224: thread 100075 (pid 0, crypto_9) sleeping on 0xfffff80003abee00 "-" chain 225: thread 100076 (pid 0, crypto_10) sleeping on 0xfffff80003abee00 "-" chain 226: thread 100077 (pid 0, crypto_11) sleeping on 0xfffff80003abee00 "-" chain 227: thread 100114 (pid 0, mca taskq) sleeping on 0xfffff800051cb200 "-" chain 228: thread 100121 (pid 0, acpi_task_0) sleeping on 0xfffff8001d458300 "-" chain 229: thread 100122 (pid 0, acpi_task_1) sleeping on 0xfffff8001d458300 "-" chain 230: thread 100123 (pid 0, acpi_task_2) sleeping on 0xfffff8001d458300 "-" chain 231: thread 100124 (pid 0, CAM taskq) sleeping on 0xfffff80003abed00 "-" db> (kgdb) bt #0 __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:55 #1 doadump (textdump=0x0) at ../../../kern/kern_shutdown.c:393 #2 0xffffffff8049bbba in db_dump (dummy=, dummy2=, dummy3=, dummy4=) at ../../../ddb/db_command.c:575 #3 0xffffffff8049b97c in db_command (last_cmdp=, cmd_table=, dopager=0x0) at ../../../ddb/db_command.c:482 #4 0xffffffff804a0948 in db_script_exec (scriptname=, warnifnotfound=) at ../../../ddb/db_script.c:304 #5 0xffffffff8049b97c in db_command (last_cmdp=, cmd_table=, dopager=0x0) at ../../../ddb/db_command.c:482 #6 0xffffffff804a0948 in db_script_exec (scriptname=, warnifnotfound=) at ../../../ddb/db_script.c:304 #7 0xffffffff8049b97c in db_command (last_cmdp=, cmd_table=, dopager=0x1) at ../../../ddb/db_command.c:482 #8 0xffffffff8049b6ed in db_command_loop () at ../../../ddb/db_command.c:535 #9 0xffffffff8049e918 in db_trap (type=, code=) at ../../../ddb/db_main.c:252 #10 0xffffffff80c143e7 in kdb_trap (type=0x3, code=0x0, tf=) at ../../../kern/subr_kdb.c:691 #11 0xffffffff81073a14 in trap (frame=0xfffffe0037a73990) at ../../../amd64/amd64/trap.c:585 #12 #13 kdb_enter (why=0xffffffff812013a4 "panic", msg=) at ../../../kern/subr_kdb.c:478 #14 0xffffffff80bc9e11 in vpanic (fmt=, ap=) at ../../../kern/kern_shutdown.c:899 #15 0xffffffff80bc9ba3 in panic (fmt=0xffffffff81c7af98 "uX\034\201\377\377\377\377") at ../../../kern/kern_shutdown.c:836 #16 0xffffffff80b0d5b6 in g_io_deliver (bp=0xfffff80215db2e58, error=0x2d) at ../../../geom/geom_io.c:641 #17 0xffffffff80b0d8d5 in g_io_schedule_up (tp=) at ../../../geom/geom_io.c:872 #18 0xffffffff80b0e03c in g_up_procbody (arg=) at ../../../geom/geom_kern.c:99 #19 0xffffffff80b86e50 in fork_exit (callout=0xffffffff80b0dfe0 , arg=0x0, frame=0xfffffe0037a73c00) at ../../../kern/kern_fork.c:1058 #20 (kgdb) f 16 #16 0xffffffff80b0d5b6 in g_io_deliver (bp=0xfffff80215db2e58, error=0x2d) at ../../../geom/geom_io.c:641 641 KASSERT(bp->bio_completed <= bp->bio_length, (kgdb) l 636 KASSERT(bp->bio_cflags == bp->_bio_cflags, 637 ("bio_cflags used by the provider %s", pp->name)); 638 } 639 #endif 640 KASSERT(bp->bio_completed >= 0, ("bio_completed can't be less than 0")); 641 KASSERT(bp->bio_completed <= bp->bio_length, 642 ("bio_completed can't be greater than bio_length")); 643 644 g_trace(G_T_BIO, 645 "g_io_deliver(%p) from %p(%s) to %p(%s) cmd %d error %d off %jd len %jd", (kgdb) info loc pp = 0xfffff8071219f100 cp = 0xfffff80729f84480 direct = now = mtxp = first = (kgdb) p *bp $1 = {bio_cmd = 0xa, bio_flags = 0x8000, bio_cflags = 0x0, bio_pflags = 0x0, bio_dev = 0x0, bio_disk = 0x0, bio_offset = 0x0, bio_bcount = 0x0, bio_data = 0x0, bio_ma = 0x0, bio_ma_offset = 0x0, bio_ma_n = 0x0, bio_error = 0x2d, bio_resid = 0x0, bio_done = 0xffffffff80b14e40 , bio_driver1 = 0x0, bio_driver2 = 0x0, bio_caller1 = 0x0, bio_caller2 = 0xfffff80262731000, bio_queue = {tqe_next = 0xfffff80161110990, tqe_prev = 0xffffffff81c7a6e8 }, bio_attribute = 0x0, bio_zone = {zone_cmd = 0x0, zone_params = {disk_params = {zone_mode = 0x0, flags = 0x0, optimal_seq_zones = 0x0, optimal_nonseq_zones = 0x0, max_seq_zones = 0x0}, rwp = {id = 0x0, flags = 0x0}, report = {starting_id = 0x0, rep_options = 0x0, header = {same = 0x0, maximum_lba = 0x0, reserved = '\000' }, entries_allocated = 0x0, entries_filled = 0x0, entries_available = 0x0, entries = 0x0}}}, bio_from = 0xfffff80729f84480, bio_to = 0xfffff8071219f100, bio_length = 0xa620000, bio_completed = 0x1f260000, bio_children = 0x3, bio_inbed = 0x3, bio_parent = 0x0, bio_t0 = {sec = 0xbd4, frac = 0x7e900620c357029e}, bio_task = 0x0, bio_task_arg = 0x0, bio_spare1 = 0x0, bio_spare2 = 0x0, _bio_caller1 = 0x0, _bio_caller2 = 0xfffff80262731000, _bio_cflags = 0x0, bio_track_bp = 0xfffff80262731000, bio_pblkno = 0x0} (kgdb) Index: src/sys/geom/raid3/g_raid3.c =================================================================== --- src/sys/geom/raid3/g_raid3.c (revision 357112) +++ src/sys/geom/raid3/g_raid3.c (working copy) @@ -1255,6 +1255,8 @@ finish: pbp->bio_pflags &= ~G_RAID3_BIO_PFLAG_MASK; while ((cbp = G_RAID3_HEAD_BIO(pbp)) != NULL) g_raid3_destroy_bio(sc, cbp); + if (pbp->bio_cmd == BIO_SPEEDUP) + pbp->bio_completed = pbp->bio_length; g_io_deliver(pbp, pbp->bio_error); } Index: src/sys/geom/stripe/g_stripe.c =================================================================== --- src/sys/geom/stripe/g_stripe.c (revision 357112) +++ src/sys/geom/stripe/g_stripe.c (working copy) @@ -298,6 +298,8 @@ g_stripe_done(struct bio *bp) mtx_unlock(&sc->sc_lock); if (pbp->bio_driver1 != NULL) uma_zfree(g_stripe_zone, pbp->bio_driver1); + if (bp->bio_cmd == BIO_SPEEDUP) + pbp->bio_completed = pbp->bio_length; g_io_deliver(pbp, pbp->bio_error); } else mtx_unlock(&sc->sc_lock); -- Test scenario: misc/graid3.sh