panic: interlock (sleep mutex) vnode interlock not locked @ ufs/ffs/ffs_snapshot.c:2465, vmcore.493 KDB: debugger backends: ddb KDB: current backend: ddb ---<>--- Copyright (c) 1992-2022 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 14.0-CURRENT #0 ufs-n252595-8fdb6047e6a-dirty: Sun Jan 23 20:23:13 CET 2022 pho@mercat1.netperf.freebsd.org:/var/tmp/deviant3/sys/amd64/compile/PHO amd64 FreeBSD clang version 13.0.0 (git@github.com:llvm/llvm-project.git llvmorg-13.0.0-0-gd7b669b3a303) WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. VT(vga): resolution 640x480 CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.11-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics real memory = 34359738368 (32768 MB) avail memory = 33176580096 (31639 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 12 CPUs FreeBSD/SMP: 1 package(s) x 6 core(s) x 2 hardware threads random: registering fast source Intel Secure Key RNG random: fast provider: "Intel Secure Key RNG" random: unblocking device. ioapic0 irqs 0-23 ioapic1 irqs 24-47 Launching APs: 1 5 9 3 10 2 7 11 4 6 8 random: entropy device external interface kbd1 at kbdmux0 vtvga0: smbios0: at iomem 0xf0560-0xf057e smbios0: Version: 2.8, BCD Revision: 2.7 aesni0: acpi0: acpi0: Power Button (fixed) cpu0: on acpi0 atrtc0: port 0x70-0x71,0x74-0x77 irq 8 on acpi0 atrtc0: registered as a time-of-day clock, resolution 1.000000s Event timer "RTC" frequency 32768 Hz quality 0 attimer0: port 0x40-0x43,0x50-0x53 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Event timer "HPET" frequency 14318180 Hz quality 350 Event timer "HPET1" frequency 14318180 Hz quality 340 Event timer "HPET2" frequency 14318180 Hz quality 340 Event timer "HPET3" frequency 14318180 Hz quality 340 Event timer "HPET4" frequency 14318180 Hz quality 340 Event timer "HPET5" frequency 14318180 Hz quality 340 Event timer "HPET6" frequency 14318180 Hz quality 340 Event timer "HPET7" frequency 14318180 Hz quality 340 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 pcib0: on acpi0 pci0: on pcib0 pci0: at device 11.1 (no driver attached) pci0: at device 11.2 (no driver attached) pci0: at device 16.1 (no driver attached) pci0: at device 16.6 (no driver attached) pci0: at device 18.1 (no driver attached) acpi_syscontainer0: on acpi0 acpi_syscontainer1: on acpi0 acpi_syscontainer2: on acpi0 acpi_syscontainer3: on acpi0 apei0: on acpi0 pcib1: port 0xcf8-0xcff on acpi0 pci1: on pcib1 pcib2: irq 26 at device 1.0 on pci1 pci2: on pcib2 pcib3: irq 32 at device 2.0 on pci1 pci3: on pcib3 pci3: at device 0.0 (no driver attached) pci3: at device 0.1 (no driver attached) pcib4: irq 40 at device 3.0 on pci1 pci4: on pcib4 pci1: at device 17.0 (no driver attached) ahci0: port 0xf110-0xf117,0xf100-0xf103,0xf0f0-0xf0f7,0xf0e0-0xf0e3,0xf020-0xf03f mem 0xfb438000-0xfb4387ff irq 16 at device 17.4 on pci1 ahci0: AHCI v1.30 with 4 6Gbps ports, Port Multiplier not supported ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahcich2: at channel 2 on ahci0 ahcich3: at channel 3 on ahci0 ahciem0: on ahci0 xhci0: mem 0xfb400000-0xfb40ffff irq 19 at device 20.0 on pci1 xhci0: 32 bytes context size, 64-bit DMA usbus0 on xhci0 usbus0: 5.0Gbps Super Speed USB v3.0 pci1: at device 22.0 (no driver attached) pci1: at device 22.1 (no driver attached) ehci0: mem 0xfb434000-0xfb4343ff irq 18 at device 26.0 on pci1 usbus1: EHCI version 1.0 usbus1 on ehci0 usbus1: 480Mbps High Speed USB v2.0 pcib5: irq 16 at device 28.0 on pci1 pci5: on pcib5 pcib6: irq 18 at device 28.2 on pci1 pci6: on pcib6 pcib7: at device 0.0 on pci6 pci7: on pcib7 vgapci0: port 0xe000-0xe07f mem 0xfa000000-0xfaffffff,0xfb000000-0xfb01ffff irq 18 at device 0.0 on pci7 vgapci0: Boot video device pcib8: irq 16 at device 28.4 on pci1 pci8: on pcib8 igb0: port 0xd020-0xd03f mem 0xfb320000-0xfb33ffff,0xfb344000-0xfb347fff irq 16 at device 0.0 on pci8 igb0: EEPROM V1.63-0 eTrack 0x800009fa igb0: Using 1024 TX descriptors and 1024 RX descriptors igb0: queue equality override not set, capping rx_queues at 6 and tx_queues at 6 igb0: Using 6 ugen0.3: at usbus0 ukbd0 on uhub3 ukbd0: on usbus0 kbd2 at ukbd0 ** /dev/gpt/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 452 files, 23860 used, 1241547 free (91 frags, 155182 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** Updating CPU Microcode... CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.00-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab Structured Extended Features3=0x9c000400 XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics Done. ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat/pkg /usr/local/lib/compat /usr/local/lib/compat/pkg /usr/local/lib/e2fsprogs /usr/local/lib/gcc10 /usr/local/lib/gcc8 /usr/local/lib/gcc9 /usr/local/lib/perl5/5.32/mach/CORE 32-bit compatibility ldconfig path: /usr/lib32 /usr/local/lib32/compat Setting hostname: mercat1.netperf.freebsd.org. Setting up harvesting: PURE_RDRAND,[UMA],[FS_ATIME],SWI,INTERRUPT,NET_NG,[NET_ETHER],NET_TUN,MOUSE,KEYBOARD,ATTACH,CACHED Feeding entropy: . Autoloading module: acpi_wmi.ko Autoloading module: ichsmb.ko Autoloading module: ioat.ko acpi_wmi0: on acpi0 acpi_wmi0: cannot find EC device ioat0: mem 0xfb42c000-0xfb42ffff irq 31 at device 4.0 on pci1 ioat0: Capabilities: 2f7 ioat1: mem 0xfb428000-0xfb42bfff irq 39 at device 4.1 on pci1 ioat1: Capabilities: 2f7 ioat2: mem 0xfb424000-0xfb427fff irq 31 at device 4.2 on pci1 ioat2: Capabilities: f7 ioat3: mem 0xfb420000-0xfb423fff irq 39 at device 4.3 on pci1 ioat3: Capabilities: f7 ioat4: mem 0xfb41c000-0xfb41ffff irq 31 at device 4.4 on pci1 ioat4: Capabilities: f7 ioat5: mem 0xfb418000-0xfb41bfff irq 39 at device 4.5 on pci1 ioat5: Capabilities: f7 ioat6: mem 0xfb414000-0xfb417fff irq 31 at device 4.6 on pci1 ioat6: Capabilities: f7 ioat7: mem 0xfb410000-0xfb413fff irq 39 at device 4.7 on pci1 ioat7: Capabilities: f7 ichsmb0: port 0x580-0x59f mem 0xfb431000-0xfb4310ff irq 18 at device 31.3 on pci1 smbus0: on ichsmb0 lo0: link state changed to UP Starting Network: lo0 igb0 igb1 mce0 mce1. lo0: flags=8049 metric 0 mtu 16384 options=680003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x3 inet 127.0.0.1 netmask 0xff0000FORMNUD,AUTO_LINKLOCAL> igb0: flags=8863 metric 0 mtu 1500 options=4e507bb ether 0c:c4:7a:a8:cd:da inet6 fe80::ec4:7aff:fea8:cdda%igb0 prefixlen 64 scopeid 0x1 media: Ethernet autoselect status: no carrier nd6 options=21 igb1: flags=8822 metric 0 mtu 1500 options=4e507bb ether 0c:c4:7a:a8:cd:db media: Ethernet autoselect status: no carrier nd6 options=29 mce0: flags=8822 metric 0 mtu 1500 options=7eed07bb ether 7c:fe:90:30:ee:38 media: Ethernet autoselect status: no carrier nd6 options=29 mce1: flags=8822 metric 0 mtu 1500 options=7eed07bb ether 7c:fe:90:30:ee:39 media: Ethernet autoselect status: no carrier nd6 options=29 Starting devd. igb0: link state changed to UP Autoloading module: acpi_wmi.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Starting Network: igb1. igb1: flags=8822 metric 0 mtu 1500 options=4e507bb ether 0c:c4:7a:a8:cd:db media: Ethernet autoselect status: no carrier nd6 options=29 Autoloading module: ichsmb.ko Starting Network: mce0. mce0: flags=8822 metric 0 mtu 1500 options=7eed07bb ether 7c:fe:90:30:ee:38 media: Ethernet autoselect status: no carrier nd6 options=29 Starting Network: mce1. mce1: flags=8822 metric 0 mtu 1500 options=7eed07bb ether 7c:fe:90:30:ee:39 media: Ethernet autoselect status: no carrier nd6 options=29 Autoloading module: uhid.ko Autoloading module: ums.ko Autoloading module: usbhid.ko ums0 on uhub3 ums0: on usbus0 ums0: 3 buttons and [Z] coordinates ID=0 Starting dhclient. DHCPREQUEST on igb0 to 255.255.255.255 port 67 DHCPACK from 192if_delmulti_locked: detaching ifnet instance 0xfffff8000495f800 .168.5.1 bound to 192.168.5.171 -- renewal in 300 seconds. add host 127.0.0.1: gateway lo0 fib 0: route already in table add host ::1: gateway lo0 fib 0: route already in table add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Creating and/or trimming log files. Recovering vi editor sessions:. Updating motd:. Clearing /tmp (X related). Starting syslogd. Starting watchdogd. No core dumps found. Setting date via ntp. 23 Jan 20:31:47 ntpdate[2599]: step time server 192.168.5.1 offset +0.412125 sec Starting rpcbind. NFS access cache time=60 Starting statd. Starting lockd. Starting powerd. Security policy loaded: MAC/ntpd (mac_ntpd) Starting ntpd. Mounting late filesystems:. Starting inetd. Configuring vt: blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting cron. sysctl: unknown oid 'debug.fail_point.pmap_allocpte_page_alloc' at line 12 Sun Jan 23 20:31 FreeBSD/amd64 (mercat1.netperf.freebsd.org) (ttyu1) login: Jan 23 20:41:57 mercat1 su[2804]: pho to root on /dev/pts/0 20220123 20:42:21 all (1/1): snap11.sh lock order reversal: 1st 0xfffffe010e5dc680 pbufwait (pbufwait, lockmgr) @ vm/vm_pager.c:470 2nd 0xfffff80003f12430 snaplk (snaplk, lockmgr) @ dev/md/md.c:977 lock order pbufwait -> snaplk attempted at: #0 0xffffffff80c76c0d at witness_checkorder+0xbdd #1 0xffffffff80bd3eac at lockmgr_lock_flags+0x16c #2 0xffffffff80f3fe0d at ffs_lock+0x9d #3 0xffffffff811a375c at VOP_LOCK1_APV+0x3c #4 0xffffffff80d0e9b4 at _vn_lock+0x54 #5 0xffffffff807025c9 at mdstart_vnode+0x499 #6 0xffffffff8070008c at md_kthread+0x20c #7 0xffffffff80bbd150 at fork_exit+0x80 #8 0xffffffff810a8a8e at fork_trampoline+0xe lock order reversal: 1st 0xfffffe00381db790 bufwait (bufwait, lockmgr) @ ufs/ffs/ffs_vnops.c:318 2nd 0xfffff80003f12430 snaplk (snaplk, lockmgr) @ ufs/ffs/ffs_snapshot.c:2465 lock order snaplk -> bufwait established at: #0 0xffffffff80c7634e at witness_checkorder+0x31e #1 0xffffffff80bd45cc at lockmgr_xlock_hard+0x6c #2 0xffffffff80bd4ed9 at __lockmgr_args+0x1f9 #3 0xffffffff80cf4a90 at bnoreuselist+0xc0 #4 0xffffffff80ce106e at vop_stdadvise+0x14e #5 0xffffffff811a6149 at VOP_ADVISE_APV+0x59 #6 0xffffffff80702694 at mdstart_vnode+0x564 #7 0xffffffff8070008c at md_kthread+0x20c #8 0xffffffff80bbd150 at fork_exit+0x80 #9 0xffffffff810a8a8e at fork_trampoline+0xe lock order bufwait -> snaplk attempted at: #0 0xffffffff80c76c0d at witness_checkorder+0xbdd #1 0xffffffff80bd45cc at lockmgr_xlock_hard+0x6c #2 0xffffffff80bd4ed9 at __lockmgr_args+0x1f9 #3 0xffffffff80f1a927 at ffs_copyonwrite+0x1d7 #4 0xffffffff80f3ec0f at ffs_geom_strategy+0xcf #5 0xffffffff80f53db3 at ufs_strategy+0x83 #6 0xffffffff811a3bd1 at VOP_STRATEGY_APV+0x61 #7 0xffffffff80cc742e at bufstrategy+0x3e #8 0xffffffff80cc72cc at bufwrite+0x24c #9 0xffffffff80f41291 at ffs_syncvnode+0x3c1 #10 0xffffffff80f3fcae at ffs_fsync+0x1e #11 0xffffffff811a234c at VOP_FSYNC_APV+0x3c #12 0xffffffff80f51a14 at ufs_remove+0x114 #13 0xffffffff811a24f5 at VOP_REMOVE_APV+0x85 #14 0xffffffff80d0645a at kern_funlinkat+0x35a #15 0xffffffff80d060f8 at sys_unlink+0x28 #16 0xffffffff810d7455 at amd64_syscall+0x145 #17 0xffffffff810a832b at fast_syscall_common+0xf8 lock order reversal: 1st 0xfffff80003f12430 snaplk (snaplk, lockmgr) @ ufs/ufs/ufs_vnops.c:1037 2nd 0xfffffe014407f330 ufs (ufs, lockmgr) @ ufs/ffs/ffs_snapshot.c:1786 lock order ufs -> snaplk established at: #0 0xffffffff80c7634e at witness_checkorder+0x31e #1 0xffffffff80bd3dbc at lockmgr_lock_flags+0x7c #2 0xffffffff80f3fe0d at ffs_lock+0x9d #3 0xffffffff811a375c at VOP_LOCK1_APV+0x3c #4 0xffffffff80d0e9b4 at _vn_lock+0x54 #5 0xffffffff80cf618a at vget_finish+0x7a #6 0xffffffff80ce424d at vfs_hash_get+0xcd #7 0xffffffff80f3b388 at ffs_vgetf+0x58 #8 0xffffffff80f4a107 at ufs_lookup_ino+0xbe7 #9 0xffffffff811a014a at VOP_CACHEDLOOKUP_APV+0x5a #10 0xffffffff80cd5916 at vfs_cache_lookup+0xa6 #11 0xffffffff8119ff8a at VOP_LOOKUP_APV+0x5a #12 0xffffffff80ce6d51 at lookup+0x4c1 #13 0xffffffff80ce5be8 at namei+0x3f8 #14 0xffffffff80d0e110 at vn_open_cred+0x4b0 #15 0xffffffff80d04ad6 at kern_openat+0x286 #16 0xffffffff810d7455 at amd64_syscall+0x145 #17 0xffffffff810a832b at fast_syscall_common+0xf8 lock order snaplk -> ufs attempted at: #0 0xffffffff80c76c0d at witness_checkorder+0xbdd #1 0xffffffff80bd45cc at lockmgr_xlock_hard+0x6c #2 0xffffffff80bd4ed9 at __lockmgr_args+0x1f9 #3 0xffffffff80f18f26 at ffs_snapremove+0x486 #4 0xffffffff80f130f5 at ffs_truncate+0x255 #5 0xffffffff80f4924a at ufs_inactive+0x1aa #6 0xffffffff811a32e9 at VOP_INACTIVE_APV+0x59 #7 0xffffffff80cf73fa at vinactivef+0xda #8 0xffffffff80cf6a4a at vput_final+0x2aa #9 0xffffffff80d06375 at kern_funlinkat+0x275 #10 0xffffffff80d060f8 at sys_unlink+0x28 #11 0xffffffff810d7455 at amd64_syscall+0x145 #12 0xffffffff810a832b at fast_syscall_common+0xf8 panic: interlock (sleep mutex) vnode interlock not locked @ ufs/ffs/ffs_snapshot.c:2465 cpuid = 2 time = 1642966980 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe014174b370 vpanic() at vpanic+0x17f/frame 0xfffffe014174b3c0 panic() at panic+0x43/frame 0xfffffe014174b420 witness_checkorder() at witness_checkorder+0xd1c/frame 0xfffffe014174b5e0 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x6c/frame 0xfffffe014174b680 __lockmgr_args() at __lockmgr_args+0x1f9/frame 0xfffffe014174b720 ffs_copyonwrite() at ffs_copyonwrite+0x1d7/frame 0xfffffe014174b7f0 ffs_geom_strategy() at ffs_geom_strategy+0xcf/frame 0xfffffe014174b820 ufs_strategy() at ufs_strategy+0x83/frame 0xfffffe014174b850 VOP_STRATEGY_APV() at VOP_STRATEGY_APV+0x61/frame 0xfffffe014174b870 bufstrategy() at bufstrategy+0x3e/frame 0xfffffe014174b8a0 bufwrite() at bufwrite+0x24c/frame 0xfffffe014174b8f0 ffs_truncate() at ffs_truncate+0x6b9/frame 0xfffffe014174bac0 ffs_vput_pair() at ffs_v74bb50 vn_open_cred() at vn_open_cred+0x382/frame 0xfffffe014174bcb0 kern_openat() at kern_openat+0x286/frame 0xfffffe014174be00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe014174bf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014174bf30 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x31f8fffc963a, rsp = 0x31f8fdb669d8, rbp = 0x31f8fdb66a90 --- KDB: enter: panic [ thread pid 4437 tid 100215 ] Stopped at kdb_enter+0x37: movq $0,0x12854ee(%rip) db> run pho db:0:pho> set $lines 20000 db:0:pho> run pho1 db:1:pho1> dump Dumping 1689 out of 32626 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% Dump complete db:1:pho1> bt Tracing pid 4437 tid 100215 td 0xfffffe010e606e40 kdb_enter() at kdb_enter+0x37/frame 0xfffffe014174b370 vpanic() at vpanic+0x1b0/frame 0xfffffe014174b3c0 panic() at panic+0x43/frame 0xfffffe014174b420 witness_checkorder() at witness_checkorder+0xd1c/frame 0xfffffe014174b5e0 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x6c/frame 0xfffffe014174b680 __lockmgr_args() at __lockmgr_args+0x1f9/frame 0xfffffe014174b720 ffs_copyonwrite() at ffs_copyonwrite+0x1d7/frame 0xfffffe014174b7f0 ffs_geom_strategy() at ffs_geom_strategy+0xcf/frame 0xfffffe014174b820 ufs_strategy() at ufs_strategy+0x83/frame 0xfffffe014174b850 VOP_STRATEGY_APV() at VOP_STRATEGY_APV+0x61/frame 0xfffffe014174b870 bufstrategy() at bufstrategy+0x3e/frame 0xfffffe014174b8a0 bufwrite() at bufwrite+0x24c/frame 0xfffffe014174b8f0 ffs_truncate() at ffs_truncate+0x6b9/frame 0xfffffe014174bac0 ffs_vput_pair() at ffs_vput_pair+0x1b3/frame 0xfffffe014174bb50 vn_open_cred() at vn_open_cred+0x382/frame 0xfffffe014174bcb0 kern_openat() at kern_openat+0x286/frame 0xfffffe014174be00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe014174bf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014174bf30 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x31f8fffc963a, rsp = 0x31f8fdb669d8, rbp = 0x31f8fdb66a90 --- db:1:pho1> show allpcpu Current CPU: 2 cpuid = 0 dynamic pcpu = 0x7c4600 curthread = 0xfffffe0142892560: pid 4434 tid 100341 critnest 0 "rw" curpcb = 0xfffffe0142892a70 fpcurthread = 0xfffffe0142892560: pid 4434 "rw" idlethread = 0xfffffe00e4c603a0: tid 100003 "idle: cpu0" self = 0xffffffff82410000 curpmap = 0xfffffe0144035518 tssp = 0xffffffff82410384 rsp0 = 0xfffffe01439d7000 kcr3 = 0x80000004778230aa ucr3 = 0x800000048224b8aa scr3 = 0x4e0c2be67 gs32p = 0xffffffff82410404 ldt = 0xffffffff82410444 tss = 0xffffffff82410434 curvnet = 0 spin locks held: cpuid = 1 dynamic pcpu = 0xfffffe00bb287600 curthread = 0xfffffe010e606720: pid 4438 tid 100342 critnest 0 "creat" curpcb = 0xfffffe010e606c30 fpcurthread = 0xfffffe010e606720: pid 4438 "creat" idlethread = 0xfffffe00e4c5fc80: tid 100004 "idle: cpu1" self = 0xffffffff82411000 curpmap = 0xfffffe014ebf4b20 tssp = 0xffffffff82411384 rsp0 = 0xfffffe01439e1000 kcr3 = 0x8000000482037006 ucr3 = 0x8000000482034806 scr3 = 0x482bf3b74 gs32p = 0xffffffff82411404 ldt = 0xffffffff82411444 tss = 0xffffffff82411434 curvnet = 0 spin locks held: cpuid = 2 dynamic pcpu = 0xfffffe00bb294600 curthread = 0xfffffe010e606e40: pid 4437 tid 100215 critnest 1 "creat" curpcb = 0xfffffe010e607350 fpcurthread = 0xfffffe010e606e40: pid 4437 "creat" idlethread = 0xfffffe00e4c5f560: tid 100005 "idle: cpu2" self = 0xffffffff82412000 curpmap = 0xfffffe010e7be518 tssp = 0xffffffff82412384 rsp0 = 0xfffffe014174c000 kcr3 = 0x800000048208e04d ucr3 = 0x80000004823ba84d scr3 = 0x482bf3fa9 gs32p = 0xffffffff82412404 ldt = 0xffffffff82412444 tss = 0xffffffff82412434 curvnet = 0 spin locks held: cpuid = 3 dynamic pcpu = 0xfffffe00bb2a1600 curthread = 0xfffffe01445a8560: pid 4433 tid 100335 critnest 0 "rw" curpcb = 0xfffffe01445a8a70 fpcurthread = 0xfffffe01445a8560: pid 4433 "rw" idlethread = 0xfffffe00e4c5ee40: tid 100006 "idle: cpu3" self = 0xffffffff82413000 curpmap = 0xfffffe014ebe4b20 tssp = 0xffffffff82413384 rsp0 = 0xfffffe0143976000 kcr3 = 0x800000047783a0cd ucr3 = 0x800000048236d8cd scr3 = 0x4e079ee94 gs32p = 0xffffffff82413404 ldt = 0xffffffff82413444 tss = 0xffffffff82413434 curvnet = 0 spin locks held: cpuid = 4 dynamic pcpu = 0xfffffe00bb2ae600 curthread = 0xfffffe0143515740: pid 4431 tid 100325 critnest 0 "rw" curpcb = 0xfffffe0143515c50 fpcurthread = 0xfffffe0143515740: pid 4431 "rw" idlethread = 0xfffffe00e4c5e720: tid 100007 "idle: cpu4" self = 0xffffffff82414000 curpmap = 0xfffffe014352d128 tssp = 0xffffffff82414384 rsp0 = 0xfffffe014399e000 kcr3 = 0x80000004821e800a ucr3 = 0x800000048227680a scr3 = 0x482bf3808 gs32p = 0xffffffff82414404 ldt = 0xffffffff82414444 tss = 0xffffffff82414434 curvnet = 0 spin locks held: cpuid = 5 dynamic pcpu = 0xfffffe00bb2bb600 curthread = 0xfffffe01445aa1e0: pid 11537 tid 100359 critnest 0 "rm" curpcb = 0xfffffe01445aa6f0 fpcurthread = 0xfffffe01445aa1e0: pid 11537 "rm" idlethread = 0xfffffe00e4c5e000: tid 100008 "idle: cpu5" self = 0xffffffff82415000 curpmap = 0xfffffe014eb37b20 tssp = 0xffffffff82415384 rsp0 = 0xfffffe014397b000 kcr3 = 0x80000004e076e58f ucr3 = 0x8000000482c0cd8f scr3 = 0x482bf3d8a gs32p = 0xffffffff82415404 ldt = 0xffffffff82415444 tss = 0xffffffff82415434 curvnet = 0 spin locks held: cpuid = 6 dynamic pcpu = 0xfffffe00bb2c8600 curthread = 0xfffffe0142892c80: pid 4432 tid 100336 critnest 0 "rw" curpcb = 0xfffffe0142893190 fpcurthread = 0xfffffe0142892c80: pid 4432 "rw" idlethread = 0xfffffe00e4c66c80: tid 100009 "idle: cpu6" self = 0xffffffff82416000 curpmap = 0xfffffe014ebe3518 tssp = 0xffffffff82416384 rsp0 = 0xfffffe014398a000 kcr3 = 0x800000047722a1a7 ucr3 = 0x800000048209f9a7 scr3 = 0x482bf3db0 gs32p = 0xffffffff82416404 ldt = 0xffffffff82416444 tss = 0xffffffff82416434 curvnet = 0 spin locks held: cpuid = 7 dynamic pcpu = 0xfffffe00bb2d5600 curthread = 0xfffffe010e606000: pid 4439 tid 100343 critnest 0 "creat" curpcb = 0xfffffe010e606510 fpcurthread = 0xfffffe010e606000: pid 4439 "creat" idlethread = 0xfffffe00e4c66560: tid 100010 "idle: cpu7" self = 0xffffffff82417000 curpmap = 0xfffffe014289b518 tssp = 0xffffffff82417384 rsp0 = 0xfffffe01439dc000 kcr3 = 0x80000004822e8249 ucr3 = 0x80000004822e6a49 scr3 = 0x482c0cd74 gs32p = 0xffffffff82417404 ldt = 0xffffffff82417444 tss = 0xffffffff82417434 curvnet = 0 spin locks held: cpuid = 8 dynamic pcpu = 0xfffffe00bb2e2600 curthread = 0xfffffe01445a7e40: pid 4429 tid 100327 critnest 0 "rw" curpcb = 0xfffffe01445a8350 fpcurthread = 0xfffffe01445a7e40: pid 4429 "rw" idlethread = 0xfffffe00e4c65e40: tid 100011 "idle: cpu8" self = 0xffffffff82418000 curpmap = 0xfffffe014ebe2b20 tssp = 0xffffffff82418384 rsp0 = 0xfffffe0143971000 kcr3 = 0x80000004822d8140 ucr3 = 0x8000000477bab940 scr3 = 0x47795ff57 gs32p = 0xffffffff82418404 ldt = 0xffffffff82418444 tss = 0xffffffff82418434 curvnet = 0 spin locks held: cpuid = 9 dynamic pcpu = 0xfffffe00bb2ef600 curthread = 0xfffffe010e7e3e40: pid 4436 tid 100216 critnest 0 "creat" curpcb = 0xfffffe010e7e4350 fpcurthread = 0xfffffe010e7e3e40: pid 4436 "creat" idlethread = 0xfffffe00e4c65720: tid 100012 "idle: cpu9" self = 0xffffffff82419000 curpmap = 0xfffffe014eb3a518 tssp = 0xffffffff82419384 rsp0 = 0xfffffe0141783000 kcr3 = 0x80000004776bc049 ucr3 = 0x8000000477760849 scr3 = 0x482bf3ab6 gs32p = 0xffffffff82419404 ldt = 0xffffffff82419444 tss = 0xffffffff82419434 curvnet = 0 spin locks held: cpuid = 10 dynamic pcpu = 0xfffffe00bb2fc600 curthread = 0xfffffe010e5e8740: pid 4440 tid 100344 critnest 0 "creat" curpcb = 0xfffffe010e5e8c50 fpcurthread = 0xfffffe010e5e8740: pid 4440 "creat" idlethread = 0xfffffe00e4c65000: tid 100013 "idle: cpu10" self = 0xffffffff8241a000 curpmap = 0xfffffe014ebe4128 tssp = 0xffffffff8241a384 rsp0 = 0xfffffe01439eb000 kcr3 = 0x80000004779c6007 ucr3 = 0x8000000482366807 scr3 = 0x47795f802 gs32p = 0xffffffff8241a404 ldt = 0xffffffff8241a444 tss = 0xffffffff8241a434 curvnet = 0 spin locks held: cpuid = 11 dynamic pcpu = 0xfffffe00bb309600 curthread = 0xfffffe01445a9ac0: pid 4430 tid 100326 critnest 0 "rw" curpcb = 0xfffffe01445a9fd0 fpcurthread = 0xfffffe01445a9ac0: pid 4430 "rw" idlethread = 0xfffffe00e4c62740: tid 100014 "idle: cpu11" self = 0xffffffff8241b000 curpmap = 0xfffffe01437fc518 tssp = 0xffffffff8241b384 rsp0 = 0xfffffe01438fe000 kcr3 = 0x80000004823d71b0 ucr3 = 0x80000004823d29b0 scr3 = 0x4e050afe8 gs32p = 0xffffffff8241b404 ldt = 0xffffffff8241b444 tss = 0xffffffff8241b434 curvnet = 0 spin locks held: db:1:pho1> show alllocks Process 4440 (creat) thread 0xfffffe010e5e8740 (100344) exclusive lockmgr ufs (ufs) r = 0 (0xfffffe0150b2a2c8) locked @ kern/vfs_subr.c:2993 Process 4439 (creat) thread 0xfffffe010e606000 (100343) exclusive lockmgr ufs (ufs) r = 0 (0xfffffe014d8cd778) locked @ kern/vfs_lookup.c:900 Process 4438 (creat) thread 0xfffffe010e606720 (100342) exclusive lockmgr ufs (ufs) r = 0 (0xfffffe014faa1778) locked @ ufs/ffs/ffs_vfsops.c:1895 Process 4437 (creat) thread 0xfffffe010e606e40 (100215) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0039388590) locked @ kern/vfs_bio.c:1721 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe00381f7d60) locked @ kern/vfs_bio.c:3985 exclusive lockmgr ufs (ufs) r = 0 (0xfffffe014f9b7c28) locked @ kern/vfs_lookup.c:900 Process 4436 (creat) thread 0xfffffe010e7e3e40 (100216) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe00381f1d50) locked @ kern/vfs_bio.c:3985 exclusive lockmgr ufs (ufs) r = 0 (0xfffffe0150039520) locked @ ufs/ffs/ffs_vfsops.c:1895 exclusive lockmgr ufs (ufs) r = 0 (0xfffffe014f8987e0) locked @ kern/vfs_lookup.c:900 Process 4434 (rw) thread 0xfffffe0142892560 (100341) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0037c8aa80) locked @ kern/vfs_cluster.c:934 exclusive lockmgr pbufwait (pbufwait) r = 0 (0xfffffe010e5d5080) locked @ vm/vm_pager.c:470 exclusive lockmgr ufs (ufs) r = 0 (0xfffffe014fd8f2c8) locked @ kern/vfs_vnops.c:1164 Process 4432 (rw) thread 0xfffffe0142892c80 (100336) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe00381bf1c0) locked @ kern/vfs_bio.c:3985 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0039347c10) locked @ kern/vfs_bio.c:3985 exclusive lockmgr ufs (ufs) r = 0 (0xfffffe0150885a38) locked @ kern/vfs_vnops.c:1164 Process 4431 (rw) thread 0xfffffe0143515740 (100325) exclusive sleep mutex vnode interlock (vnode interlock) r = 0 (0xfffffe0150ce73f0) locked @ kern/kern_rangelock.c:239 Process 4429 (rw) thread 0xfffffe01445a7e40 (100327) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0037b6c550) locked @ kern/vfs_bio.c:1721 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0038f53940) locked @ kern/vfs_bio.c:3985 exclusive lockmgr ufs (ufs) r = 0 (0xfffffe014fb62c90) locked @ kern/vfs_vnops.c:1164 db:1:pho1> show lockedvnods Locked vnodes vnode 0xfffffe014f898770: type VDIR usecount 2, writecount 0, refcount 3 seqc users 1 mountedhere 0 hold count flags () flags (VMP_LAZYLIST) v_object 0xfffff80477b86420 ref 0 pages 1 cleanbuf 0 dirtybuf 1 lock type ufs: EXCL by thread 0xfffffe010e7e3e40 (pid 4436, creat, tid 100216) #0 0xffffffff80bd3f0f at lockmgr_lock_flags+0x1cf #1 0xffffffff80f3fe0d at ffs_lock+0x9d #2 0xffffffff811a375c at VOP_LOCK1_APV+0x3c #3 0xffffffff80d0e9b4 at _vn_lock+0x54 #4 0xffffffff80ce6955 at lookup+0xc5 #5 0xffffffff80ce5be8 at namei+0x3f8 #6 0xffffffff80d0dd8c at vn_open_cred+0x12c #7 0xffffffff80d04ad6 at kern_openat+0x286 #8 0xffffffff810d7455 at amd64_syscall+0x145 #9 0xffffffff810a832b at fast_syscall_common+0xf8 nlink=2, effnlink=2, size=512, extsize 0 generation=7ae6d8f8, uid=0, gid=0, flags=0x0 ino 131077, on dev md10a vnode 0xfffffe014d8cd708: type VDIR usecount 2, writecount 0, refcount 2 seqc users 1 mountedhere 0 hold count flags () flags (VMP_LAZYLIST) v_object 0xfffff803e477f210 ref 0 pages 0 cleanbuf 0 dirtybuf 1 lock type ufs: EXCL by thread 0xfffffe010e606000 (pid 4439, creat, tid 100343) #0 0xffffffff80bd3f0f at lockmgr_lock_flags+0x1cf #1 0xffffffff80f3fe0d at ffs_lock+0x9d #2 0xffffffff811a375c at VOP_LOCK1_APV+0x3c #3 0xffffffff80d0e9b4 at _vn_lock+0x54 #4 0xffffffff80ce6955 at lookup+0xc5 #5 0xffffffff80ce5be8 at namei+0x3f8 #6 0xffffffff80d0dd8c at vn_open_cred+0x12c #7 0xffffffff80d04ad6 at kern_openat+0x286 #8 0xffffffff810d7455 at amd64_syscall+0x145 #9 0xffffffff810a832b at fast_syscall_common+0xf8 nlink=2, effnlink=2, size=2560, extsize 0 generation=f0ea7d23, uid=0, gid=0, flags=0x0 ino 131079, on dev md10a vnode 0xfffffe014f9b7bb8: type VDIR usecount 2, writecount 0, refcount 2 seqc users 0 mountedhere 0 hold count flags () flags (VMP_LAZYLIST) v_object 0xfffff804779cd948 ref 0 pages 0 cleanbuf 1 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe010e606e40 (pid 4437, creat, tid 100215) #0 0xffffffff80bd3f0f at lockmgr_lock_flags+0x1cf #1 0xffffffff80f3fe0d at ffs_lock+0x9d #2 0xffffffff811a375c at VOP_LOCK1_APV+0x3c #3 0xffffffff80d0e9b4 at _vn_lock+0x54 #4 0xffffffff80ce6955 at lookup+0xc5 #5 0xffffffff80ce5be8 at namei+0x3f8 #6 0xffffffff80d0dd8c at vn_open_cred+0x12c #7 0xffffffff80d04ad6 at kern_openat+0x286 #8 0xffffffff810d7455 at amd64_syscall+0x145 #9 0xffffffff810a832b at fast_syscall_common+0xf8 nlink=2, effnlink=2, size=24576, extsize 0 generation=aecb8af2, uid=0, gid=0, flags=0x0 ino 131157, on dev md10a vnode 0xfffffe014fb62c20: type VREG usecount 1, writecount 1, refcount 5058 seqc users 1 hold count flags () flags (VIRF_PGREAD|VMP_LAZYLIST) v_object 0xfffff80482aca738 ref 0 pages 40448 cleanbuf 5043 dirtybuf 13 lock type ufs: EXCL by thread 0xfffffe01445a7e40 (pid 4429, rw, tid 100327) #0 0xffffffff80bd3f0f at lockmgr_lock_flags+0x1cf #1 0xffffffff80f3fe0d at ffs_lock+0x9d #2 0xffffffff811a375c at VOP_LOCK1_APV+0x3c #3 0xffffffff80d0e9b4 at _vn_lock+0x54 #4 0xffffffff80d13928 at vn_write+0x1e8 #5 0xffffffff80d13343 at vn_io_fault_doio+0x43 #6 0xffffffff80d0f363 at vn_io_fault1+0x163 #7 0xffffffff80d0ccda at vn_io_fault+0x1aa #8 0xffffffff80c7c341 at dofilewrite+0x81 #9 0xffffffff80c7be70 at sys_write+0xc0 #10 0xffffffff810d7455 at amd64_syscall+0x145 #11 0xffffffff810a832b at fast_syscall_common+0xf8 nlink=1, effnlink=1, size=165543936, extsize 0 generation=6ccc0388, uid=0, gid=0, flags=0x0 ino 131084, on dev md10a vnode 0xfffffe01508859c8: type VREG usecount 1, writecount 1, refcount 3205 seqc users 1 hold count flags () flags (VIRF_PGREAD|VMP_LAZYLIST) v_object 0xfffff804e00b7a50 ref 0 pages 34128 cleanbuf 3190 dirtybuf 13 lock type ufs: EXCL by thread 0xfffffe0142892c80 (pid 4432, rw, tid 100336) #0 0xffffffff80bd3f0f at lockmgr_lock_flags+0x1cf #1 0xffffffff80f3fe0d at ffs_lock+0x9d #2 0xffffffff811a375c at VOP_LOCK1_APV+0x3c #3 0xffffffff80d0e9b4 at _vn_lock+0x54 #4 0xffffffff80d13928 at vn_write+0x1e8 #5 0xffffffff80d13343 at vn_io_fault_doio+0x43 #6 0xffffffff80d0f363 at vn_io_fault1+0x163 #7 0xffffffff80d0ccda at vn_io_fault+0x1aa #8 0xffffffff80c7c341 at dofilewrite+0x81 #9 0xffffffff80c7be70 at sys_write+0xc0 #10 0xffffffff810d7455 at amd64_syscall+0x145 #11 0xffffffff810a832b at fast_syscall_common+0xf8 nlink=1, effnlink=1, size=139689984, extsize 0 generation=1da04942, uid=0, gid=0, flags=0x0 ino 133728, on dev md10a vnode 0xfffffe014fd8f258: type VREG usecount 1, writecount 1, refcount 4210 seqc users 0 hold count flags () flags (VIRF_PGREAD|VMP_LAZYLIST) v_object 0xfffff80477157e70 ref 0 pages 33664 cleanbuf 4186 dirtybuf 22 lock type ufs: EXCL by thread 0xfffffe0142892560 (pid 4434, rw, tid 100341) #0 0xffffffff80bd3f0f at lockmgr_lock_flags+0x1cf #1 0xffffffff80f3fe0d at ffs_lock+0x9d #2 0xffffffff811a375c at VOP_LOCK1_APV+0x3c #3 0xffffffff80d0e9b4 at _vn_lock+0x54 #4 0xffffffff80d13928 at vn_write+0x1e8 #5 0xffffffff80d13343 at vn_io_fault_doio+0x43 #6 0xffffffff80d0f363 at vn_io_fault1+0x163 #7 0xffffffff80d0ccda at vn_io_fault+0x1aa #8 0xffffffff80c7c341 at dofilewrite+0x81 #9 0xffffffff80c7be70 at sys_write+0xc0 #10 0xffffffff810d7455 at amd64_syscall+0x145 #11 0xffffffff810a832b at fast_syscall_common+0xf8 nlink=1, effnlink=1, size=137789440, extsize 0 generation=a6aca999, uid=0, gid=0, flags=0x0 ino 131086, on dev md10a vnode 0xfffffe0150b2a258: type VREG usecount 0, writecount 0, refcount 1 seqc users 1 hold count flags () flags (VIRF_DOOMED|VIRF_PGREAD|VV_NOSYNC|VI_DOINGINACT) lock type ufs: EXCL by thread 0xfffffe010e5e8740 (pid 4440, creat, tid 100344) #0 0xffffffff80bd3f0f at lockmgr_lock_flags+0x1cf #1 0xffffffff80f3fe0d at ffs_lock+0x9d #2 0xffffffff811a375c at VOP_LOCK1_APV+0x3c #3 0xffffffff80d0e9b4 at _vn_lock+0x54 #4 0xffffffff80cf618a at vget_finish+0x7a #5 0xffffffff80ce424d at vfs_hash_get+0xcd #6 0xffffffff80f3b388 at ffs_vgetf+0x58 #7 0xffffffff80f4a28d at ufs_lookup_ino+0xd6d #8 0xffffffff811a014a at VOP_CACHEDLOOKUP_APV+0x5a #9 0xffffffff80cd5916 at vfs_cache_lookup+0xa6 #10 0xffffffff8119ff8a at VOP_LOOKUP_APV+0x5a #11 0xffffffff80ce6d51 at lookup+0x4c1 #12 0xffffffff80ce5be8 at namei+0x3f8 #13 0xffffffff80d06275 at kern_funlinkat+0x175 #14 0xffffffff80d060f8 at sys_unlink+0x28 #15 0xffffffff810d7455 at amd64_syscall+0x145 #16 0xffffffff810a832b at fast_syscall_common+0xf8 vnode 0xfffffe014faa1708: type VREG usecount 1, writecount 0, refcount 1 seqc users 0 hold count flags () flags (VMP_LAZYLIST) v_object 0xfffff804825dc210 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe010e606720 (pid 4438, creat, tid 100342) #0 0xffffffff80bd4a0c at lockmgr_xlock_hard+0x4ac #1 0xffffffff80bd4ed9 at __lockmgr_args+0x1f9 #2 0xffffffff80f3b49d at ffs_vgetf+0x16d #3 0xffffffff80f0b9cf at ffs_valloc+0x57f #4 0xffffffff80f54149 at ufs_makeinode+0xd9 #5 0xffffffff80f50744 at ufs_create+0x34 #6 0xffffffff811a0312 at VOP_CREATE_APV+0x62 #7 0xffffffff80d0df29 at vn_open_cred+0x2c9 #8 0xffffffff80d04ad6 at kern_openat+0x286 #9 0xffffffff810d7455 at amd64_syscall+0x145 #10 0xffffffff810a832b at fast_syscall_common+0xf8 nlink=1, effnlink=1, size=0, extsize 0 generation=9896a2e7, uid=0, gid=0, flags=0x0 ino 134197, on dev md10a vnode 0xfffffe01500394b0: type VREG usecount 1, writecount 0, refcount 1 seqc users 1 hold count flags () flags (VMP_LAZYLIST) lock type ufs: EXCL by thread 0xfffffe010e7e3e40 (pid 4436, creat, tid 100216) #0 0xffffffff80bd4a0c at lockmgr_xlock_hard+0x4ac #1 0xffffffff80bd4ed9 at __lockmgr_args+0x1f9 #2 0xffffffff80f3b49d at ffs_vgetf+0x16d #3 0xffffffff80f0b9cf at ffs_valloc+0x57f #4 0xffffffff80f54149 at ufs_makeinode+0xd9 #5 0xffffffff80f50744 at ufs_create+0x34 #6 0xffffffff811a0312 at VOP_CREATE_APV+0x62 #7 0xffffffff80d0df29 at vn_open_cred+0x2c9 #8 0xffffffff80d04ad6 at kern_openat+0x286 #9 0xffffffff810d7455 at amd64_syscall+0x145 #10 0xffffffff810a832b at fast_syscall_common+0xf8 nlink=1, effnlink=1, size=0, extsize 0 generation=d44f0f1d, uid=0, gid=0, flags=0x0 ino 134198, on dev md10a db:1:pho1> show mount 0xfffffe010e382700 /dev/gpt/work on / (ufs) 0xfffffe010e383280 devfs on /dev (devfs) 0xfffffe014356d280 /dev/gpt/tmp on /tmp (ufs) 0xfffffe014ec0c280 /dev/md10a on /mnt (ufs) More info: show mount db:1:pho1> show bufqueues bqempty: 71740 Buf domain 0 freebufs 9289 lofreebufs 219 hifreebufs 329 bufspace 191356928 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 40 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 5732 (187707392) dirtyq count 40 (1298432) wakeup 0 lim 25 CPU 5, 1, 3, 13, 0, 0, 11, 2, 7, 0, 1, 18, Locked buffers: 14 space 446464 Total buffers: 5874 space 191356928 Buf domain 1 freebufs 15130 lofreebufs 219 hifreebufs 329 bufspace 12288 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 0 (0) dirtyq count 0 (0) wakeup 0 lim 25 CPU 0, 2, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, Locked buffers: 0 space 0 Total buffers: 1108 space 12288 Buf domain 2 freebufs 9430 lofreebufs 219 hifreebufs 329 bufspace 149925888 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 24 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 5536 (144510976) dirtyq count 37 (1155072) wakeup 0 lim 25 CPU 0, 18, 15, 6, 14, 16, 2, 11, 7, 18, 11, 12, Locked buffers: 14 space 458752 Total buffers: 5703 space 149925888 Buf domain 3 freebufs 7881 lofreebufs 219 hifreebufs 329 bufspace 237518848 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 33 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 7071 (231645184) dirtyq count 33 (1052672) wakeup 0 lim 25 CPU 18, 2, 21, 11, 15, 12, 19, 10, 9, 4, 7, 20, Locked buffers: 1 space 32768 Total buffers: 7353 space 237518848 Buf domain 4 freebufs 15131 lofreebufs 219 hifreebufs 329 bufspace 8192 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 1 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 0 (0) dirtyq count 1 (4096) wakeup 0 lim 25 CPU 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, Locked buffers: 0 space 0 Total buffers: 152 space 8192 Buf domain 5 freebufs 10075 lofreebufs 219 hifreebufs 329 bufspace 165703680 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 14 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 4898 (160468992) dirtyq count 14 (450560) wakeup 0 lim 25 CPU 22, 15, 7, 2, 7, 9, 16, 20, 23, 9, 1, 14, Locked buffers: 2 space 65536 Total buffers: 5218 space 165703680 Buf domain 6 freebufs 9375 lofreebufs 219 hifreebufs 329 bufspace 188612608 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 5 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 5618 (184025088) dirtyq count 5 (163840) wakeup 0 lim 25 CPU 18, 12, 1, 4, 13, 2, 23, 19, 15, 6, 15, 7, Locked buffers: 0 space 0 Total buffers: 8783 space 188612608 db:1:pho1> show lockedbufs buf at 0xfffffe00378d7400 b_flags = 0x20000000, b_xflags=0x2 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe014e838d98), b_data = 0xfffffe004bde8000 , b_blkno = 2181376, b_lblkno = 2181376, b_vp = 0xfffffe014e838c20, b_dep = 0 b_kvabase = 0xfffffe004bde8000, b_kvasize = 32768 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80477237318, 0x42920, 0x4d6c09000),(0xfffff80477237318, 0x42921, 0x4d6c0a000),(0xfffff80477237318, 0x42922, 0x4d6c0b000),(0xfffff80477237318, 0x42923, 0x4d6c0c000),(0xfffff80477237318, 0x42924, 0x4d6c0d000),(0xfffff80477237318, 0x42925, 0x4d6c0e000),(0xfffff80477237318, 0x42926, 0x4d6c0f000),(0xfffff80477237318, 0x42927, 0x4d6c10000) lock type bufwait: EXCL by KERNPROC #0 0xffffffff80bd60b0 at _lockmgr_disown+0xd0 #1 0xffffffff80f35361 at indirdep_lookup+0xa1 #2 0xffffffff80f25170 at setup_allocindir_phase2+0x80 #3 0xffffffff80f24efc at softdep_setup_allocindir_page+0xfc #4 0xffffffff80f1274e at ffs_balloc_ufs2+0x1c1e #5 0xffffffff80f3f7f2 at ffs_write+0x262 #6 0xffffffff811a1b3f at VOP_WRITE_APV+0xcf #7 0xffffffff80d13a3c at vn_write+0x2fc #8 0xffffffff80d13343 at vn_io_fault_doio+0x43 #9 0xffffffff80d0f363 at vn_io_fault1+0x163 #10 0xffffffff80d0ccda at vn_io_fault+0x1aa #11 0xffffffff80c7c341 at dofilewrite+0x81 #12 0xffffffff80c7be70 at sys_write+0xc0 #13 0xffffffff810d7455 at amd64_syscall+0x145 #14 0xffffffff810a832b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 402 1: getblkx 2: brelse 3: bufdone 4: bufdone 5: biodone 6: g_io_deliver 7: biodone 8: g_io_deliver 9: g_io_check 10: g_io_request 11: g_part_start 12: g_io_check 13: g_io_request 14: g_vfs_strategy 15: bufwrite 16: brelse 17: brelse 18: bqrelse 19: bufdone 20: cluster_wbuild 21: brelse 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: bqrelse 27: bdwrite 28: getblkx 29: bqrelse 30: bdwrite 31: getblkx 32: bqrelse buf at 0xfffffe0037a41240 b_flags = 0xa0021024, b_xflags=0x2 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe014fd8f3d0), b_data = 0xfffffe00e472c000 , b_blkno = 380864, b_lblkno = 4184, b_vp = 0xfffffe014fd8f258, b_dep = 0xfffff8048279d600 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80477157e70, 0x82c0, 0x501074000),(0xfffff80477157e70, 0x82c1, 0x501075000),(0xfffff80477157e70, 0x82c2, 0x501076000),(0xfffff80477157e70, 0x82c3, 0x501077000),(0xfffff80477157e70, 0x82c4, 0x501078000),(0xfffff80477157e70, 0x82c5, 0x501079000),(0xfffff80477157e70, 0x82c6, 0x50107a000),(0xfffff80477157e70, 0x82c7, 0x50107b000) lock type bufwait: EXCL by KERNPROC #0 0xffffffff80bd60b0 at _lockmgr_disown+0xd0 #1 0xffffffff80cdf944 at cluster_wbuild+0x5b4 #2 0xffffffff80cdedcc at cluster_write+0x12c #3 0xffffffff80f3f9b2 at ffs_write+0x422 #4 0xffffffff811a1b3f at VOP_WRITE_APV+0xcf #5 0xffffffff80d13a3c at vn_write+0x2fc #6 0xffffffff80d13343 at vn_io_fault_doio+0x43 #7 0xffffffff80d0f363 at vn_io_fault1+0x163 #8 0xffffffff80d0ccda at vn_io_fault+0x1aa #9 0xffffffff80c7c341 at dofilewrite+0x81 #10 0xffffffff80c7be70 at sys_write+0xc0 #11 0xffffffff810d7455 at amd64_syscall+0x145 #12 0xffffffff810a832b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 1089 1: cluster_wbuild 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: brelse 27: bqrelse 28: bufdone 29: cluster_wbuild 30: bqrelse 31: bdwrite 32: getblkx buf at 0xfffffe0037b6c4d0 b_flags = 0x20000000, b_xflags=0x2 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe014fb62d98), b_data = 0xfffffe00e472c000 , b_blkno = 386240, b_lblkno = 5052, b_vp = 0xfffffe014fb62c20, b_dep = 0 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80482aca738, 0x9de0, 0x5334c6000),(0xfffff80482aca738, 0x9de1, 0x5334c5000),(0xfffff80482aca738, 0x9de2, 0x5334c4000),(0xfffff80482aca738, 0x9de3, 0x5334c3000),(0xfffff80482aca738, 0x9de4, 0x5334c2000),(0xfffff80482aca738, 0x9de5, 0x5334c1000),(0xfffff80482aca738, 0x9de6, 0x5334c0000),(0xfffff80482aca738, 0x9de7, 0x5040bf000) lock type bufwait: EXCL by thread 0xfffffe01445a7e40 (pid 4429, rw, tid 100327) #0 0xffffffff80bd4a0c at lockmgr_xlock_hard+0x4ac #1 0xffffffff80bd4ed9 at __lockmgr_args+0x1f9 #2 0xffffffff80ccc274 at getnewbuf+0x344 #3 0xffffffff80cc9563 at getblkx+0x683 #4 0xffffffff80f12ad4 at ffs_balloc_getblk+0x54 #5 0xffffffff80f12620 at ffs_balloc_ufs2+0x1af0 #6 0xffffffff80f3f7f2 at ffs_write+0x262 #7 0xffffffff811a1b3f at VOP_WRITE_APV+0xcf #8 0xffffffff80d13a3c at vn_write+0x2fc #9 0xffffffff80d13343 at vn_io_fault_doio+0x43 #10 0xffffffff80d0f363 at vn_io_fault1+0x163 #11 0xffffffff80d0ccda at vn_io_fault+0x1aa #12 0xffffffff80c7c341 at dofilewrite+0x81 #13 0xffffffff80c7be70 at sys_write+0xc0 #14 0xffffffff810d7455 at amd64_syscall+0x145 #15 0xffffffff810a832b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 646 1: getblkx 2: brelse 3: bqrelse 4: bufdone 5: cluster_wbuild 6: brelse 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: bqrelse 27: bdwrite 28: getblkx 29: bqrelse 30: bdwrite 31: getblkx 32: brelse buf at 0xfffffe0037c10e40 b_flags = 0xa0021024, b_xflags=0x2 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe014fd8f3d0), b_data = 0xfffffe00e472c000 , b_blkno = 380544, b_lblkno = 4179, b_vp = 0xfffffe014fd8f258, b_dep = 0xfffff80477f14300 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80477157e70, 0x8298, 0x4c551a000),(0xfffff80477157e70, 0x8299, 0x4c5519000),(0xfffff80477157e70, 0x829a, 0x4c5518000),(0xfffff80477157e70, 0x829b, 0x4c5517000),(0xfffff80477157e70, 0x829c, 0x4c5516000),(0xfffff80477157e70, 0x829d, 0x4c5515000),(0xfffff80477157e70, 0x829e, 0x4c5514000),(0xfffff80477157e70, 0x829f, 0x4c5513000) lock type bufwait: EXCL by KERNPROC #0 0xffffffff80bd60b0 at _lockmgr_disown+0xd0 #1 0xffffffff80cdf944 at cluster_wbuild+0x5b4 #2 0xffffffff80cdedcc at cluster_write+0x12c #3 0xffffffff80f3f9b2 at ffs_write+0x422 #4 0xffffffff811a1b3f at VOP_WRITE_APV+0xcf #5 0xffffffff80d13a3c at vn_write+0x2fc #6 0xffffffff80d13343 at vn_io_fault_doio+0x43 #7 0xffffffff80d0f363 at vn_io_fault1+0x163 #8 0xffffffff80d0ccda at vn_io_fault+0x1aa #9 0xffffffff80c7c341 at dofilewrite+0x81 #10 0xffffffff80c7be70 at sys_write+0xc0 #11 0xffffffff810d7455 at amd64_syscall+0x145 #12 0xffffffff810a832b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 335 1: cluster_wbuild 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: bqrelse 27: bdwrite 28: getblkx 29: bqrelse 30: bdwrite 31: getblkx 32: bqrelse buf at 0xfffffe0037c6d050 b_flags = 0x20000000, b_xflags=0x2 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe014e838d98), b_data = 0xfffffe004da90000 , b_blkno = 2130880, b_lblkno = 2130880, b_vp = 0xfffffe014e838c20, b_dep = 0 b_kvabase = 0xfffffe004da90000, b_kvasize = 32768 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80477237318, 0x41078, 0x4d920e000),(0xfffff80477237318, 0x41079, 0x4d920d000),(0xfffff80477237318, 0x4107a, 0x4d920c000),(0xfffff80477237318, 0x4107b, 0x4d920b000),(0xfffff80477237318, 0x4107c, 0x4d920a000),(0xfffff80477237318, 0x4107d, 0x4d9209000),(0xfffff80477237318, 0x4107e, 0x4d9208000),(0xfffff80477237318, 0x4107f, 0x4d9207000) lock type bufwait: EXCL by KERNPROC #0 0xffffffff80bd60b0 at _lockmgr_disown+0xd0 #1 0xffffffff80f35361 at indirdep_lookup+0xa1 #2 0xffffffff80f25170 at setup_allocindir_phase2+0x80 #3 0xffffffff80f24efc at softdep_setup_allocindir_page+0xfc #4 0xffffffff80f1274e at ffs_balloc_ufs2+0x1c1e #5 0xffffffff80f3f7f2 at ffs_write+0x262 #6 0xffffffff811a1b3f at VOP_WRITE_APV+0xcf #7 0xffffffff80d13a3c at vn_write+0x2fc #8 0xffffffff80d13343 at vn_io_fault_doio+0x43 #9 0xffffffff80d0f363 at vn_io_fault1+0x163 #10 0xffffffff80d0ccda at vn_io_fault+0x1aa #11 0xffffffff80c7c341 at dofilewrite+0x81 #12 0xffffffff80c7be70 at sys_write+0xc0 #13 0xffffffff810d7455 at amd64_syscall+0x145 #14 0xffffffff810a832b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 87 1: getblkx 2: brelse 3: bqrelse 4: bufdone 5: cluster_wbuild 6: bqrelse 7: bdwrite 8: getblkx 9: bqrelse 10: bdwrite 11: getblkx 12: bqrelse 13: bdwrite 14: getblkx 15: bqrelse 16: bdwrite 17: getblkx 18: bqrelse 19: bdwrite 20: getblkx 21: bqrelse 22: bdwrite 23: getblkx 24: bqrelse 25: bdwrite 26: getblkx 27: bqrelse 28: bdwrite 29: getblkx 30: brelse 31: bqrelse 32: bufdone buf at 0xfffffe0037c8aa00 b_flags = 0xa0021024, b_xflags=0x1 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe014fd8f3d0), b_data = 0xfffffe00e472c000 , b_blkno = 380992, b_lblkno = 4186, b_vp = 0xfffffe014fd8f258, b_dep = 0xfffff80482b4db00 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80477157e70, 0x82d0, 0x529640000),(0xfffff80477157e70, 0x82d1, 0x4f018e000),(0xfffff80477157e70, 0x82d2, 0x52964f000),(0xfffff80477157e70, 0x82d3, 0x529650000),(0xfffff80477157e70, 0x82d4, 0x529651000),(0xfffff80477157e70, 0x82d5, 0x529652000),(0xfffff80477157e70, 0x82d6, 0x529653000),(0xfffff80477157e70, 0x82d7, 0x529654000) lock type bufwait: EXCL by thread 0xfffffe0142892560 (pid 4434, rw, tid 100341) #0 0xffffffff80bd4a0c at lockmgr_xlock_hard+0x4ac #1 0xffffffff80bd4ed9 at __lockmgr_args+0x1f9 #2 0xffffffff80cdf726 at cluster_wbuild+0x396 #3 0xffffffff80cdedcc at cluster_write+0x12c #4 0xffffffff80f3f9b2 at ffs_write+0x422 #5 0xffffffff811a1b3f at VOP_WRITE_APV+0xcf #6 0xffffffff80d13a3c at vn_write+0x2fc #7 0xffffffff80d13343 at vn_io_fault_doio+0x43 #8 0xffffffff80d0f363 at vn_io_fault1+0x163 #9 0xffffffff80d0ccda at vn_io_fault+0x1aa #10 0xffffffff80c7c341 at dofilewrite+0x81 #11 0xffffffff80c7be70 at sys_write+0xc0 #12 0xffffffff810d7455 at amd64_syscall+0x145 #13 0xffffffff810a832b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 300 1: bqrelse 2: bdwrite 3: getblkx 4: bqrelse 5: bdwrite 6: getblkx 7: bqrelse 8: bdwrite 9: getblkx 10: bqrelse 11: bdwrite 12: getblkx 13: bqrelse 14: bdwrite 15: getblkx 16: bqrelse 17: bdwrite 18: getblkx 19: bqrelse 20: bdwrite 21: getblkx 22: bqrelse 23: bdwrite 24: getblkx 25: brelse 26: bqrelse 27: bufdone 28: cluster_wbuild 29: brelse 30: getblkx 31: bqrelse 32: bdwrite buf at 0xfffffe0037cc2860 b_flags = 0xa0021024, b_xflags=0x2 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe014fd8f3d0), b_data = 0xfffffe00e472c000 , b_blkno = 380416, b_lblkno = 4177, b_vp = 0xfffffe014fd8f258, b_dep = 0xfffff80004078d00 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80477157e70, 0x8288, 0x4c552a000),(0xfffff80477157e70, 0x8289, 0x4c5529000),(0xfffff80477157e70, 0x828a, 0x4c5528000),(0xfffff80477157e70, 0x828b, 0x4c5527000),(0xfffff80477157e70, 0x828c, 0x4c5526000),(0xfffff80477157e70, 0x828d, 0x4c5525000),(0xfffff80477157e70, 0x828e, 0x4c5524000),(0xfffff80477157e70, 0x828f, 0x4c5523000) lock type bufwait: EXCL by KERNPROC #0 0xffffffff80bd60b0 at _lockmgr_disown+0xd0 #1 0xffffffff80cdf944 at cluster_wbuild+0x5b4 #2 0xffffffff80cdedcc at cluster_write+0x12c #3 0xffffffff80f3f9b2 at ffs_write+0x422 #4 0xffffffff811a1b3f at VOP_WRITE_APV+0xcf #5 0xffffffff80d13a3c at vn_write+0x2fc #6 0xffffffff80d13343 at vn_io_fault_doio+0x43 #7 0xffffffff80d0f363 at vn_io_fault1+0x163 #8 0xffffffff80d0ccda at vn_io_fault+0x1aa #9 0xffffffff80c7c341 at dofilewrite+0x81 #10 0xffffffff80c7be70 at sys_write+0xc0 #11 0xffffffff810d7455 at amd64_syscall+0x145 #12 0xffffffff810a832b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 729 1: cluster_wbuild 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: bqrelse 27: bdwrite 28: getblkx 29: bqrelse 30: bdwrite 31: getblkx 32: bqrelse buf at 0xfffffe0037ce72b0 b_flags = 0xa0021024, b_xflags=0x2 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe014fd8f3d0), b_data = 0xfffffe00e472c000 , b_blkno = 380800, b_lblkno = 4183, b_vp = 0xfffffe014fd8f258, b_dep = 0xfffff80482962600 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80477157e70, 0x82b8, 0x50106a000),(0xfffff80477157e70, 0x82b9, 0x50106b000),(0xfffff80477157e70, 0x82ba, 0x50106c000),(0xfffff80477157e70, 0x82bb, 0x50106d000),(0xfffff80477157e70, 0x82bc, 0x50106e000),(0xfffff80477157e70, 0x82bd, 0x50106f000),(0xfffff80477157e70, 0x82be, 0x501071000),(0xfffff80477157e70, 0x82bf, 0x501073000) lock type bufwait: EXCL by KERNPROC #0 0xffffffff80bd60b0 at _lockmgr_disown+0xd0 #1 0xffffffff80cdf944 at cluster_wbuild+0x5b4 #2 0xffffffff80cdedcc at cluster_write+0x12c #3 0xffffffff80f3f9b2 at ffs_write+0x422 #4 0xffffffff811a1b3f at VOP_WRITE_APV+0xcf #5 0xffffffff80d13a3c at vn_write+0x2fc #6 0xffffffff80d13343 at vn_io_fault_doio+0x43 #7 0xffffffff80d0f363 at vn_io_fault1+0x163 #8 0xffffffff80d0ccda at vn_io_fault+0x1aa #9 0xffffffff80c7c341 at dofilewrite+0x81 #10 0xffffffff80c7be70 at sys_write+0xc0 #11 0xffffffff810d7455 at amd64_syscall+0x145 #12 0xffffffff810a832b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 762 1: cluster_wbuild 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: brelse 27: bqrelse 28: bufdone 29: cluster_wbuild 30: bqrelse 31: bdwrite 32: getblkx buf at 0xfffffe0038134930 b_flags = 0xa0021024, b_xflags=0x2 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe014fd8f3d0), b_data = 0xfffffe00e472c000 , b_blkno = 380608, b_lblkno = 4180, b_vp = 0xfffffe014fd8f258, b_dep = 0xfffff8048227fd00 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80477157e70, 0x82a0, 0x51ab70000),(0xfffff80477157e70, 0x82a1, 0x51ab6f000),(0xfffff80477157e70, 0x82a2, 0x51ab6e000),(0xfffff80477157e70, 0x82a3, 0x51ab6d000),(0xfffff80477157e70, 0x82a4, 0x51ab6c000),(0xfffff80477157e70, 0x82a5, 0x51ab6b000),(0xfffff80477157e70, 0x82a6, 0x51ab6a000),(0xfffff80477157e70, 0x82a7, 0x51ab69000) lock type bufwait: EXCL by KERNPROC #0 0xffffffff80bd60b0 at _lockmgr_disown+0xd0 #1 0xffffffff80cdf944 at cluster_wbuild+0x5b4 #2 0xffffffff80cdedcc at cluster_write+0x12c #3 0xffffffff80f3f9b2 at ffs_write+0x422 #4 0xffffffff811a1b3f at VOP_WRITE_APV+0xcf #5 0xffffffff80d13a3c at vn_write+0x2fc #6 0xffffffff80d13343 at vn_io_fault_doio+0x43 #7 0xffffffff80d0f363 at vn_io_fault1+0x163 #8 0xffffffff80d0ccda at vn_io_fault+0x1aa #9 0xffffffff80c7c341 at dofilewrite+0x81 #10 0xffffffff80c7be70 at sys_write+0xc0 #11 0xffffffff810d7455 at amd64_syscall+0x145 #12 0xffffffff810a832b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 143 1: cluster_wbuild 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: bqrelse 27: bdwrite 28: getblkx 29: bqrelse 30: bdwrite 31: getblkx 32: brelse buf at 0xfffffe00381bf140 b_flags = 0xa00010a0, b_xflags=0x20011 b_vflags=0x1 b_ioflags0x0 b_error = 0, b_bufsize = 28672, b_bcount = 28672, b_resid = 0 b_bufobj = (0xfffffe014e838d98), b_data = 0xfffffe004f9e8000 , b_blkno = 256, b_lblkno = 256, b_vp = 0xfffffe014e838c20, b_dep = 0xfffff80003bf8300 b_kvabase = 0xfffffe004f9e8000, b_kvasize = 32768 b_npages = 7, pages(OBJ, IDX, PA): (0xfffff80477237318, 0x20, 0x47f700000),(0xfffff80477237318, 0x21, 0x47da1f000),(0xfffff80477237318, 0x22, 0x47a117000),(0xfffff80477237318, 0x23, 0x4781ce000),(0xfffff80477237318, 0x24, 0x4806b9000),(0xfffff80477237318, 0x25, 0x47b9d1000),(0xfffff80477237318, 0x26, 0x45e22b000) lock type bufwait: EXCL by thread 0xfffffe0142892c80 (pid 4432, rw, tid 100336) #0 0xffffffff80bd4a0c at lockmgr_xlock_hard+0x4ac #1 0xffffffff80bd4ed9 at __lockmgr_args+0x1f9 #2 0xffffffff80cc8fff at getblkx+0x11f #3 0xffffffff80cc8ce4 at breadn_flags+0x44 #4 0xffffffff80f0daa8 at ffs_getcg+0xd8 #5 0xffffffff80f08e61 at ffs_alloccg+0x91 #6 0xffffffff80f08ce9 at ffs_hashalloc+0x79 #7 0xffffffff80f08a05 at ffs_alloc+0x1f5 #8 0xffffffff80f116a4 at ffs_balloc_ufs2+0xb74 #9 0xffffffff80f3f7f2 at ffs_write+0x262 #10 0xffffffff811a1b3f at VOP_WRITE_APV+0xcf #11 0xffffffff80d13a3c at vn_write+0x2fc #12 0xffffffff80d13343 at vn_io_fault_doio+0x43 #13 0xffffffff80d0f363 at vn_io_fault1+0x163 #14 0xffffffff80d0ccda at vn_io_fault+0x1aa #15 0xffffffff80c7c341 at dofilewrite+0x81 #16 0xffffffff80c7be70 at sys_write+0xc0 #17 0xffffffff810d7455 at amd64_syscall+0x145 b_io_tracking: b_io_tcnt = 1936713 1: bdwrite 2: getblkx 3: bqrelse 4: bdwrite 5: getblkx 6: bqrelse 7: bdwrite 8: getblkx 9: bqrelse 10: bdwrite 11: getblkx 12: bqrelse 13: bdwrite 14: getblkx 15: bqrelse 16: bdwrite 17: getblkx 18: bqrelse 19: bdwrite 20: getblkx 21: bqrelse 22: bdwrite 23: getblkx 24: bqrelse 25: bdwrite 26: getblkx 27: bqrelse 28: bdwrite 29: getblkx 30: bqrelse 31: bdwrite 32: getblkx buf at 0xfffffe00381f1cd0 b_flags = 0xa00210a0, b_xflags=0x1 b_vflags=0x1 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe014e838d98), b_data = 0xfffffe004fcf8000 , b_blkno = 2099008, b_lblkno = 2099008, b_vp = 0xfffffe014e838c20, b_dep = 0xfffff80477188000 b_kvabase = 0xfffffe004fcf8000, b_kvasize = 32768 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80477237318, 0x400e8, 0x46737d000),(0xfffff80477237318, 0x400e9, 0x45e076000),(0xfffff80477237318, 0x400ea, 0x4789ee000),(0xfffff80477237318, 0x400eb, 0x47cfd4000),(0xfffff80477237318, 0x400ec, 0x4806bb000),(0xfffff80477237318, 0x400ed, 0x4569db000),(0xfffff80477237318, 0x400ee, 0x4673ea000),(0xfffff80477237318, 0x400ef, 0x480692000) lock type bufwait: EXCL by thread 0xfffffe010e7e3e40 (pid 4436, creat, tid 100216) #0 0xffffffff80bd4a0c at lockmgr_xlock_hard+0x4ac #1 0xffffffff80bd4ed9 at __lockmgr_args+0x1f9 #2 0xffffffff80cc8fff at getblkx+0x11f #3 0xffffffff80cc8ce4 at breadn_flags+0x44 #4 0xffffffff80f3a65a at ffs_breadz+0x5a #5 0xffffffff80f12c5d at ffs_update+0x14d #6 0xffffffff80f54417 at ufs_makeinode+0x3a7 #7 0xffffffff80f50744 at ufs_create+0x34 #8 0xffffffff811a0312 at VOP_CREATE_APV+0x62 #9 0xffffffff80d0df29 at vn_open_cred+0x2c9 #10 0xffffffff80d04ad6 at kern_openat+0x286 #11 0xffffffff810d7455 at amd64_syscall+0x145 #12 0xffffffff810a832b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 307390 1: getblkx 2: bqrelse 3: getblkx 4: bqrelse 5: bdwrite 6: getblkx 7: bqrelse 8: getblkx 9: bqrelse 10: bdwrite 11: getblkx 12: bqrelse 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: getblkx 19: bqrelse 20: bdwrite 21: getblkx 22: bqrelse 23: getblkx 24: bqrelse 25: bdwrite 26: getblkx 27: bqrelse 28: getblkx 29: bqrelse 30: bdwrite 31: getblkx 32: bqrelse buf at 0xfffffe00381f7ce0 b_flags = 0x80000020, b_xflags=0x2 b_vflags=0x1 b_ioflags0x0 b_error = 0, b_bufsize = 24576, b_bcount = 24576, b_resid = 0 b_bufobj = (0xfffffe014f9b7d30), b_data = 0xfffffe004fa58000 , b_blkno = 2130624, b_lblkno = 0, b_vp = 0xfffffe014f9b7bb8, b_dep = 0 b_kvabase = 0xfffffe004fa58000, b_kvasize = 32768 b_npages = 6, pages(OBJ, IDX, PA): (0, 0xdeadc0dedeadc0de, 0x48215c000),(0, 0xdeadc0dedeadc0de, 0x4e0acd000),(0, 0xdeadc0dedeadc0de, 0x4e09b5000),(0, 0xdeadc0dedeadc0de, 0x4820a2000),(0, 0xdeadc0dedeadc0de, 0x4e050a000),(0, 0xdeadc0dedeadc0de, 0x4e06f6000) lock type bufwait: EXCL by thread 0xfffffe010e606e40 (pid 4437, creat, tid 100215) #0 0xffffffff80bd4a0c at lockmgr_xlock_hard+0x4ac #1 0xffffffff80bd4ed9 at __lockmgr_args+0x1f9 #2 0xffffffff80cc8fff at getblkx+0x11f #3 0xffffffff80cc8ce4 at breadn_flags+0x44 #4 0xffffffff80f12a3f at ffs_balloc_bread+0x5f #5 0xffffffff80f1191e at ffs_balloc_ufs2+0xdee #6 0xffffffff80f1353f at ffs_truncate+0x69f #7 0xffffffff80f403d3 at ffs_vput_pair+0x1b3 #8 0xffffffff80d0dfe2 at vn_open_cred+0x382 #9 0xffffffff80d04ad6 at kern_openat+0x286 #10 0xffffffff810d7455 at amd64_syscall+0x145 #11 0xffffffff810a832b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 1973070 1: bufwrite 2: getblkx 3: brelse 4: bufdone 5: biodone 6: g_io_deliver 7: biodone 8: g_io_deliver 9: g_io_check 10: g_io_request 11: g_part_start 12: g_io_check 13: g_io_request 14: g_vfs_strategy 15: bufwrite 16: bqrelse 17: bdwrite 18: getblkx 19: brelse 20: getblkx 21: bqrelse 22: bdwrite 23: getblkx 24: brelse 25: getblkx 26: bqrelse 27: bdwrite 28: getblkx 29: brelse 30: getblkx 31: bqrelse 32: bdwrite buf at 0xfffffe003823dfd0 b_flags = 0x20000000, b_xflags=0x2 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe014e838d98), b_data = 0xfffffe004e0b8000 , b_blkno = 2131392, b_lblkno = 2131392, b_vp = 0xfffffe014e838c20, b_dep = 0 b_kvabase = 0xfffffe004e0b8000, b_kvasize = 32768 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80477237318, 0x410b8, 0x527354000),(0xfffff80477237318, 0x410b9, 0x527353000),(0xfffff80477237318, 0x410ba, 0x527352000),(0xfffff80477237318, 0x410bb, 0x527351000),(0xfffff80477237318, 0x410bc, 0x527350000),(0xfffff80477237318, 0x410bd, 0x52734f000),(0xfffff80477237318, 0x410be, 0x52734e000),(0xfffff80477237318, 0x410bf, 0x52734d000) lock type bufwait: EXCL by KERNPROC #0 0xffffffff80bd60b0 at _lockmgr_disown+0xd0 #1 0xffffffff80f35361 at indirdep_lookup+0xa1 #2 0xffffffff80f25170 at setup_allocindir_phase2+0x80 #3 0xffffffff80f24efc at softdep_setup_allocindir_page+0xfc #4 0xffffffff80f1274e at ffs_balloc_ufs2+0x1c1e #5 0xffffffff80f3f7f2 at ffs_write+0x262 #6 0xffffffff811a1b3f at VOP_WRITE_APV+0xcf #7 0xffffffff80d13a3c at vn_write+0x2fc #8 0xffffffff80d13343 at vn_io_fault_doio+0x43 #9 0xffffffff80d0f363 at vn_io_fault1+0x163 #10 0xffffffff80d0ccda at vn_io_fault+0x1aa #11 0xffffffff80c7c341 at dofilewrite+0x81 #12 0xffffffff80c7be70 at sys_write+0xc0 #13 0xffffffff810d7455 at amd64_syscall+0x145 #14 0xffffffff810a832b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 724 1: getblkx 2: brelse 3: bqrelse 4: bufdone 5: cluster_wbuild 6: brelse 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: bqrelse 27: bdwrite 28: getblkx 29: bqrelse 30: bdwrite 31: getblkx 32: brelse buf at 0xfffffe0038289c30 b_flags = 0x20000000, b_xflags=0x2 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe014e838d98), b_data = 0xfffffe004d5b0000 , b_blkno = 2212928, b_lblkno = 2212928, b_vp = 0xfffffe014e838c20, b_dep = 0 b_kvabase = 0xfffffe004d5b0000, b_kvasize = 32768 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80477237318, 0x43888, 0x4d7cdc000),(0xfffff80477237318, 0x43889, 0x535700000),(0xfffff80477237318, 0x4388a, 0x52208f000),(0xfffff80477237318, 0x4388b, 0x49a846000),(0xfffff80477237318, 0x4388c, 0x51bea3000),(0xfffff80477237318, 0x4388d, 0x4d49e0000),(0xfffff80477237318, 0x4388e, 0x52154f000),(0xfffff80477237318, 0x4388f, 0x4b4194000) lock type bufwait: EXCL by KERNPROC #0 0xffffffff80bd60b0 at _lockmgr_disown+0xd0 #1 0xffffffff80f35361 at indirdep_lookup+0xa1 #2 0xffffffff80f25170 at setup_allocindir_phase2+0x80 #3 0xffffffff80f24efc at softdep_setup_allocindir_page+0xfc #4 0xffffffff80f0ad2c at ffs_reallocblks+0xc5c #5 0xffffffff811a4669 at VOP_REALLOCBLKS_APV+0x59 #6 0xffffffff80cdf266 at cluster_write+0x5c6 #7 0xffffffff80f3f9b2 at ffs_write+0x422 #8 0xffffffff811a1b3f at VOP_WRITE_APV+0xcf #9 0xffffffff80d13a3c at vn_write+0x2fc #10 0xffffffff80d13343 at vn_io_fault_doio+0x43 #11 0xffffffff80d0f363 at vn_io_fault1+0x163 #12 0xffffffff80d0ccda at vn_io_fault+0x1aa #13 0xffffffff80c7c341 at dofilewrite+0x81 #14 0xffffffff80c7be70 at sys_write+0xc0 #15 0xffffffff810d7455 at amd64_syscall+0x145 #16 0xffffffff810a832b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 855 1: getblkx 2: brelse 3: bqrelse 4: bufdone 5: cluster_wbuild 6: brelse 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: bqrelse 27: bdwrite 28: getblkx 29: bqrelse 30: bdwrite 31: getblkx 32: bqrelse buf at 0xfffffe00385ab630 b_flags = 0xa0021024, b_xflags=0x2 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe014fd8f3d0), b_data = 0xfffffe00e472c000 , b_blkno = 380288, b_lblkno = 4175, b_vp = 0xfffffe014fd8f258, b_dep = 0xfffff804e0232a00 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80477157e70, 0x8278, 0x4c553a000),(0xfffff80477157e70, 0x8279, 0x4c5539000),(0xfffff80477157e70, 0x827a, 0x4c5538000),(0xfffff80477157e70, 0x827b, 0x4c5537000),(0xfffff80477157e70, 0x827c, 0x4c5536000),(0xfffff80477157e70, 0x827d, 0x4c5535000),(0xfffff80477157e70, 0x827e, 0x4c5534000),(0xfffff80477157e70, 0x827f, 0x4c5533000) lock type bufwait: EXCL by KERNPROC #0 0xffffffff80bd60b0 at _lockmgr_disown+0xd0 #1 0xffffffff80cdf944 at cluster_wbuild+0x5b4 #2 0xffffffff80cdedcc at cluster_write+0x12c #3 0xffffffff80f3f9b2 at ffs_write+0x422 #4 0xffffffff811a1b3f at VOP_WRITE_APV+0xcf #5 0xffffffff80d13a3c at vn_write+0x2fc #6 0xffffffff80d13343 at vn_io_fault_doio+0x43 #7 0xffffffff80d0f363 at vn_io_fault1+0x163 #8 0xffffffff80d0ccda at vn_io_fault+0x1aa #9 0xffffffff80c7c341 at dofilewrite+0x81 #10 0xffffffff80c7be70 at sys_write+0xc0 #11 0xffffffff810d7455 at amd64_syscall+0x145 #12 0xffffffff810a832b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 823 1: cluster_wbuild 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: bqrelse 27: bdwrite 28: getblkx 29: bqrelse 30: bdwrite 31: getblkx 32: bqrelse buf at 0xfffffe00388d8310 b_flags = 0x20000000, b_xflags=0x2 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe014e838d98), b_data = 0xfffffe003d730000 , b_blkno = 2130496, b_lblkno = 2130496, b_vp = 0xfffffe014e838c20, b_dep = 0 b_kvabase = 0xfffffe003d730000, b_kvasize = 32768 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80477237318, 0x41048, 0x4b96e7000),(0xfffff80477237318, 0x41049, 0x4b96e6000),(0xfffff80477237318, 0x4104a, 0x4ba5c8000),(0xfffff80477237318, 0x4104b, 0x4ba5c7000),(0xfffff80477237318, 0x4104c, 0x4ba5c6000),(0xfffff80477237318, 0x4104d, 0x4ba5c5000),(0xfffff80477237318, 0x4104e, 0x4ba5c4000),(0xfffff80477237318, 0x4104f, 0x4ba5c3000) lock type bufwait: EXCL by KERNPROC #0 0xffffffff80bd60b0 at _lockmgr_disown+0xd0 #1 0xffffffff80f35361 at indirdep_lookup+0xa1 #2 0xffffffff80f25170 at setup_allocindir_phase2+0x80 #3 0xffffffff80f24efc at softdep_setup_allocindir_page+0xfc #4 0xffffffff80f1274e at ffs_balloc_ufs2+0x1c1e #5 0xffffffff80f3f7f2 at ffs_write+0x262 #6 0xffffffff811a1b3f at VOP_WRITE_APV+0xcf #7 0xffffffff80d13a3c at vn_write+0x2fc #8 0xffffffff80d13343 at vn_io_fault_doio+0x43 #9 0xffffffff80d0f363 at vn_io_fault1+0x163 #10 0xffffffff80d0ccda at vn_io_fault+0x1aa #11 0xffffffff80c7c341 at dofilewrite+0x81 #12 0xffffffff80c7be70 at sys_write+0xc0 #13 0xffffffff810d7455 at amd64_syscall+0x145 #14 0xffffffff810a832b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 1059 1: getblkx 2: brelse 3: bqrelse 4: bufdone 5: cluster_wbuild 6: brelse 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: bqrelse 27: bdwrite 28: getblkx 29: bqrelse 30: bdwrite 31: getblkx 32: bqrelse buf at 0xfffffe0038abdae0 b_flags = 0xa0021024, b_xflags=0x2 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe014fd8f3d0), b_data = 0xfffffe00e472c000 , b_blkno = 380352, b_lblkno = 4176, b_vp = 0xfffffe014fd8f258, b_dep = 0xfffff80482805800 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80477157e70, 0x8280, 0x4c5532000),(0xfffff80477157e70, 0x8281, 0x4c5531000),(0xfffff80477157e70, 0x8282, 0x4c5530000),(0xfffff80477157e70, 0x8283, 0x4c552f000),(0xfffff80477157e70, 0x8284, 0x4c552e000),(0xfffff80477157e70, 0x8285, 0x4c552d000),(0xfffff80477157e70, 0x8286, 0x4c552c000),(0xfffff80477157e70, 0x8287, 0x4c552b000) lock type bufwait: EXCL by KERNPROC #0 0xffffffff80bd60b0 at _lockmgr_disown+0xd0 #1 0xffffffff80cdf944 at cluster_wbuild+0x5b4 #2 0xffffffff80cdedcc at cluster_write+0x12c #3 0xffffffff80f3f9b2 at ffs_write+0x422 #4 0xffffffff811a1b3f at VOP_WRITE_APV+0xcf #5 0xffffffff80d13a3c at vn_write+0x2fc #6 0xffffffff80d13343 at vn_io_fault_doio+0x43 #7 0xffffffff80d0f363 at vn_io_fault1+0x163 #8 0xffffffff80d0ccda at vn_io_fault+0x1aa #9 0xffffffff80c7c341 at dofilewrite+0x81 #10 0xffffffff80c7be70 at sys_write+0xc0 #11 0xffffffff810d7455 at amd64_syscall+0x145 #12 0xffffffff810a832b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 1042 1: cluster_wbuild 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: bqrelse 27: bdwrite 28: getblkx 29: bqrelse 30: bdwrite 31: getblkx 32: bqrelse buf at 0xfffffe0038b210e0 b_flags = 0x20000000, b_xflags=0x2 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe014e838d98), b_data = 0xfffffe004df08000 , b_blkno = 2131200, b_lblkno = 2131200, b_vp = 0xfffffe014e838c20, b_dep = 0 b_kvabase = 0xfffffe004df08000, b_kvasize = 32768 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80477237318, 0x410a0, 0x4c12dc000),(0xfffff80477237318, 0x410a1, 0x4a09d7000),(0xfffff80477237318, 0x410a2, 0x4a09d6000),(0xfffff80477237318, 0x410a3, 0x4aadbd000),(0xfffff80477237318, 0x410a4, 0x4aadbc000),(0xfffff80477237318, 0x410a5, 0x4a622f000),(0xfffff80477237318, 0x410a6, 0x4a622e000),(0xfffff80477237318, 0x410a7, 0x4a3185000) lock type bufwait: EXCL by KERNPROC #0 0xffffffff80bd60b0 at _lockmgr_disown+0xd0 #1 0xffffffff80f35361 at indirdep_lookup+0xa1 #2 0xffffffff80f25170 at setup_allocindir_phase2+0x80 #3 0xffffffff80f25470 at softdep_setup_allocindir_meta+0xb0 #4 0xffffffff80f11502 at ffs_balloc_ufs2+0x9d2 #5 0xffffffff80f3f7f2 at ffs_write+0x262 #6 0xffffffff811a1b3f at VOP_WRITE_APV+0xcf #7 0xffffffff80d13a3c at vn_write+0x2fc #8 0xffffffff80d13343 at vn_io_fault_doio+0x43 #9 0xffffffff80d0f363 at vn_io_fault1+0x163 #10 0xffffffff80d0ccda at vn_io_fault+0x1aa #11 0xffffffff80c7c341 at dofilewrite+0x81 #12 0xffffffff80c7be70 at sys_write+0xc0 #13 0xffffffff810d7455 at amd64_syscall+0x145 #14 0xffffffff810a832b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 670 1: getblkx 2: brelse 3: bqrelse 4: bufdone 5: cluster_wbuild 6: bqrelse 7: bdwrite 8: getblkx 9: bqrelse 10: bdwrite 11: getblkx 12: bqrelse 13: bdwrite 14: getblkx 15: bqrelse 16: bdwrite 17: getblkx 18: bqrelse 19: bdwrite 20: getblkx 21: bqrelse 22: bdwrite 23: getblkx 24: bqrelse 25: bdwrite 26: getblkx 27: bqrelse 28: bdwrite 29: getblkx 30: brelse 31: bqrelse 32: bufdone buf at 0xfffffe0038bd1a70 b_flags = 0xa0021024, b_xflags=0x2 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe014fd8f3d0), b_data = 0xfffffe00e472c000 , b_blkno = 380928, b_lblkno = 4185, b_vp = 0xfffffe014fd8f258, b_dep = 0xfffff80482725800 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80477157e70, 0x82c8, 0x50107d000),(0xfffff80477157e70, 0x82c9, 0x50107f000),(0xfffff80477157e70, 0x82ca, 0x529641000),(0xfffff80477157e70, 0x82cb, 0x529644000),(0xfffff80477157e70, 0x82cc, 0x501070000),(0xfffff80477157e70, 0x82cd, 0x50107c000),(0xfffff80477157e70, 0x82ce, 0x501064000),(0xfffff80477157e70, 0x82cf, 0x50107e000) lock type bufwait: EXCL by KERNPROC #0 0xffffffff80bd60b0 at _lockmgr_disown+0xd0 #1 0xffffffff80cdf944 at cluster_wbuild+0x5b4 #2 0xffffffff80cdedcc at cluster_write+0x12c #3 0xffffffff80f3f9b2 at ffs_write+0x422 #4 0xffffffff811a1b3f at VOP_WRITE_APV+0xcf #5 0xffffffff80d13a3c at vn_write+0x2fc #6 0xffffffff80d13343 at vn_io_fault_doio+0x43 #7 0xffffffff80d0f363 at vn_io_fault1+0x163 #8 0xffffffff80d0ccda at vn_io_fault+0x1aa #9 0xffffffff80c7c341 at dofilewrite+0x81 #10 0xffffffff80c7be70 at sys_write+0xc0 #11 0xffffffff810d7455 at amd64_syscall+0x145 #12 0xffffffff810a832b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 780 1: cluster_wbuild 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: brelse 27: bqrelse 28: bufdone 29: cluster_wbuild 30: brelse 31: getblkx 32: bqrelse buf at 0xfffffe0038c3d4f0 b_flags = 0xa0021024, b_xflags=0x2 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe014fd8f3d0), b_data = 0xfffffe00e472c000 , b_blkno = 380736, b_lblkno = 4182, b_vp = 0xfffffe014fd8f258, b_dep = 0xfffff80482af1d00 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80477157e70, 0x82b0, 0x4c5502000),(0xfffff80477157e70, 0x82b1, 0x4c5501000),(0xfffff80477157e70, 0x82b2, 0x4c5500000),(0xfffff80477157e70, 0x82b3, 0x5040ba000),(0xfffff80477157e70, 0x82b4, 0x5040b9000),(0xfffff80477157e70, 0x82b5, 0x5040b8000),(0xfffff80477157e70, 0x82b6, 0x5040b7000),(0xfffff80477157e70, 0x82b7, 0x5040b6000) lock type bufwait: EXCL by KERNPROC #0 0xffffffff80bd60b0 at _lockmgr_disown+0xd0 #1 0xffffffff80cdf944 at cluster_wbuild+0x5b4 #2 0xffffffff80cdedcc at cluster_write+0x12c #3 0xffffffff80f3f9b2 at ffs_write+0x422 #4 0xffffffff811a1b3f at VOP_WRITE_APV+0xcf #5 0xffffffff80d13a3c at vn_write+0x2fc #6 0xffffffff80d13343 at vn_io_fault_doio+0x43 #7 0xffffffff80d0f363 at vn_io_fault1+0x163 #8 0xffffffff80d0ccda at vn_io_fault+0x1aa #9 0xffffffff80c7c341 at dofilewrite+0x81 #10 0xffffffff80c7be70 at sys_write+0xc0 #11 0xffffffff810d7455 at amd64_syscall+0x145 #12 0xffffffff810a832b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 403 1: cluster_wbuild 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: bqrelse 27: bdwrite 28: getblkx 29: brelse 30: bqrelse 31: bufdone 32: cluster_wbuild buf at 0xfffffe0038e57970 b_flags = 0x20000000, b_xflags=0x2 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe014e838d98), b_data = 0xfffffe004dd48000 , b_blkno = 2131264, b_lblkno = 2131264, b_vp = 0xfffffe014e838c20, b_dep = 0 b_kvabase = 0xfffffe004dd48000, b_kvasize = 32768 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80477237318, 0x410a8, 0x50f516000),(0xfffff80477237318, 0x410a9, 0x50f515000),(0xfffff80477237318, 0x410aa, 0x50f514000),(0xfffff80477237318, 0x410ab, 0x50f513000),(0xfffff80477237318, 0x410ac, 0x50f512000),(0xfffff80477237318, 0x410ad, 0x50f511000),(0xfffff80477237318, 0x410ae, 0x50f510000),(0xfffff80477237318, 0x410af, 0x50f50f000) lock type bufwait: EXCL by KERNPROC #0 0xffffffff80bd60b0 at _lockmgr_disown+0xd0 #1 0xffffffff80f35361 at indirdep_lookup+0xa1 #2 0xffffffff80f25170 at setup_allocindir_phase2+0x80 #3 0xffffffff80f24efc at softdep_setup_allocindir_page+0xfc #4 0xffffffff80f1274e at ffs_balloc_ufs2+0x1c1e #5 0xffffffff80f3f7f2 at ffs_write+0x262 #6 0xffffffff811a1b3f at VOP_WRITE_APV+0xcf #7 0xffffffff80d13a3c at vn_write+0x2fc #8 0xffffffff80d13343 at vn_io_fault_doio+0x43 #9 0xffffffff80d0f363 at vn_io_fault1+0x163 #10 0xffffffff80d0ccda at vn_io_fault+0x1aa #11 0xffffffff80c7c341 at dofilewrite+0x81 #12 0xffffffff80c7be70 at sys_write+0xc0 #13 0xffffffff810d7455 at amd64_syscall+0x145 #14 0xffffffff810a832b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 387 1: getblkx 2: brelse 3: bqrelse 4: bufdone 5: cluster_wbuild 6: bqrelse 7: bdwrite 8: getblkx 9: bqrelse 10: bdwrite 11: getblkx 12: bqrelse 13: bdwrite 14: getblkx 15: bqrelse 16: bdwrite 17: getblkx 18: bqrelse 19: bdwrite 20: getblkx 21: bqrelse 22: bdwrite 23: getblkx 24: bqrelse 25: bdwrite 26: getblkx 27: bqrelse 28: bdwrite 29: getblkx 30: brelse 31: bqrelse 32: bufdone buf at 0xfffffe0038e5b510 b_flags = 0x20000000, b_xflags=0x2 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe014e838d98), b_data = 0xfffffe004d468000 , b_blkno = 2131136, b_lblkno = 2131136, b_vp = 0xfffffe014e838c20, b_dep = 0 b_kvabase = 0xfffffe004d468000, b_kvasize = 32768 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80477237318, 0x41098, 0x4d4826000),(0xfffff80477237318, 0x41099, 0x4bd36b000),(0xfffff80477237318, 0x4109a, 0x4bd36a000),(0xfffff80477237318, 0x4109b, 0x4b6273000),(0xfffff80477237318, 0x4109c, 0x4b6272000),(0xfffff80477237318, 0x4109d, 0x4b110b000),(0xfffff80477237318, 0x4109e, 0x4b110a000),(0xfffff80477237318, 0x4109f, 0x4c9c8d000) lock type bufwait: EXCL by KERNPROC #0 0xffffffff80bd60b0 at _lockmgr_disown+0xd0 #1 0xffffffff80f35361 at indirdep_lookup+0xa1 #2 0xffffffff80f25170 at setup_allocindir_phase2+0x80 #3 0xffffffff80f24efc at softdep_setup_allocindir_page+0xfc #4 0xffffffff80f1274e at ffs_balloc_ufs2+0x1c1e #5 0xffffffff80f3f7f2 at ffs_write+0x262 #6 0xffffffff811a1b3f at VOP_WRITE_APV+0xcf #7 0xffffffff80d13a3c at vn_write+0x2fc #8 0xffffffff80d13343 at vn_io_fault_doio+0x43 #9 0xffffffff80d0f363 at vn_io_fault1+0x163 #10 0xffffffff80d0ccda at vn_io_fault+0x1aa #11 0xffffffff80c7c341 at dofilewrite+0x81 #12 0xffffffff80c7be70 at sys_write+0xc0 #13 0xffffffff810d7455 at amd64_syscall+0x145 #14 0xffffffff810a832b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 390 1: getblkx 2: brelse 3: bqrelse 4: bufdone 5: cluster_wbuild 6: brelse 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: bqrelse 27: bdwrite 28: getblkx 29: bqrelse 30: bdwrite 31: getblkx 32: brelse buf at 0xfffffe0038f538c0 b_flags = 0xa00210a0, b_xflags=0x1 b_vflags=0x1 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe014fb62d98), b_data = 0xfffffe004c5e8000 , b_blkno = 2131136, b_lblkno = -4108, b_vp = 0xfffffe014fb62c20, b_dep = 0xfffff8000492ad00 b_kvabase = 0xfffffe004c5e8000, b_kvasize = 32768 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80482aca738, 0xfffffffff7fa0, 0x4c9c5d000),(0xfffff80482aca738, 0xfffffffff7fa1, 0x4c9c5c000),(0xfffff80482aca738, 0xfffffffff7fa2, 0x4c9c5b000),(0xfffff80482aca738, 0xfffffffff7fa3, 0x4c9c5a000),(0xfffff80482aca738, 0xfffffffff7fa4, 0x4c9c59000),(0xfffff80482aca738, 0xfffffffff7fa5, 0x4c9c58000),(0xfffff80482aca738, 0xfffffffff7fa6, 0x4c9c57000),(0xfffff80482aca738, 0xfffffffff7fa7, 0x4c9c56000) lock type bufwait: EXCL by thread 0xfffffe01445a7e40 (pid 4429, rw, tid 100327) #0 0xffffffff80bd4a0c at lockmgr_xlock_hard+0x4ac #1 0xffffffff80bd4ed9 at __lockmgr_args+0x1f9 #2 0xffffffff80cc8fff at getblkx+0x11f #3 0xffffffff80cc8ce4 at breadn_flags+0x44 #4 0xffffffff80f1121b at ffs_balloc_ufs2+0x6eb #5 0xffffffff80f3f7f2 at ffs_write+0x262 #6 0xffffffff811a1b3f at VOP_WRITE_APV+0xcf #7 0xffffffff80d13a3c at vn_write+0x2fc #8 0xffffffff80d13343 at vn_io_fault_doio+0x43 #9 0xffffffff80d0f363 at vn_io_fault1+0x163 #10 0xffffffff80d0ccda at vn_io_fault+0x1aa #11 0xffffffff80c7c341 at dofilewrite+0x81 #12 0xffffffff80c7be70 at sys_write+0xc0 #13 0xffffffff810d7455 at amd64_syscall+0x145 #14 0xffffffff810a832b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 16939 1: getblkx 2: brelse 3: getblkx 4: brelse 5: getblkx 6: brelse 7: getblkx 8: brelse 9: getblkx 10: brelse 11: getblkx 12: brelse 13: getblkx 14: brelse 15: getblkx 16: bqrelse 17: bdwrite 18: getblkx 19: brelse 20: getblkx 21: brelse 22: getblkx 23: brelse 24: getblkx 25: brelse 26: getblkx 27: brelse 28: getblkx 29: brelse 30: getblkx 31: brelse 32: getblkx buf at 0xfffffe0038f5b000 b_flags = 0xa0021024, b_xflags=0x2 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe014fd8f3d0), b_data = 0xfffffe00e472c000 , b_blkno = 380480, b_lblkno = 4178, b_vp = 0xfffffe014fd8f258, b_dep = 0xfffff80470e25500 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80477157e70, 0x8290, 0x4c5522000),(0xfffff80477157e70, 0x8291, 0x4c5521000),(0xfffff80477157e70, 0x8292, 0x4c5520000),(0xfffff80477157e70, 0x8293, 0x4c551f000),(0xfffff80477157e70, 0x8294, 0x4c551e000),(0xfffff80477157e70, 0x8295, 0x4c551d000),(0xfffff80477157e70, 0x8296, 0x4c551c000),(0xfffff80477157e70, 0x8297, 0x4c551b000) lock type bufwait: EXCL by KERNPROC #0 0xffffffff80bd60b0 at _lockmgr_disown+0xd0 #1 0xffffffff80cdf944 at cluster_wbuild+0x5b4 #2 0xffffffff80cdedcc at cluster_write+0x12c #3 0xffffffff80f3f9b2 at ffs_write+0x422 #4 0xffffffff811a1b3f at VOP_WRITE_APV+0xcf #5 0xffffffff80d13a3c at vn_write+0x2fc #6 0xffffffff80d13343 at vn_io_fault_doio+0x43 #7 0xffffffff80d0f363 at vn_io_fault1+0x163 #8 0xffffffff80d0ccda at vn_io_fault+0x1aa #9 0xffffffff80c7c341 at dofilewrite+0x81 #10 0xffffffff80c7be70 at sys_write+0xc0 #11 0xffffffff810d7455 at amd64_syscall+0x145 #12 0xffffffff810a832b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 437 1: cluster_wbuild 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: bqrelse 27: bdwrite 28: getblkx 29: bqrelse 30: bdwrite 31: getblkx 32: bqrelse buf at 0xfffffe0039002e70 b_flags = 0x20000000, b_xflags=0x2 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe014e838d98), b_data = 0xfffffe004bda8000 , b_blkno = 2131328, b_lblkno = 2131328, b_vp = 0xfffffe014e838c20, b_dep = 0 b_kvabase = 0xfffffe004bda8000, b_kvasize = 32768 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80477237318, 0x410b0, 0x527364000),(0xfffff80477237318, 0x410b1, 0x527363000),(0xfffff80477237318, 0x410b2, 0x527362000),(0xfffff80477237318, 0x410b3, 0x527361000),(0xfffff80477237318, 0x410b4, 0x527360000),(0xfffff80477237318, 0x410b5, 0x52735f000),(0xfffff80477237318, 0x410b6, 0x52735e000),(0xfffff80477237318, 0x410b7, 0x52735d000) lock type bufwait: EXCL by KERNPROC #0 0xffffffff80bd60b0 at _lockmgr_disown+0xd0 #1 0xffffffff80f35361 at indirdep_lookup+0xa1 #2 0xffffffff80f25170 at setup_allocindir_phase2+0x80 #3 0xffffffff80f25470 at softdep_setup_allocindir_meta+0xb0 #4 0xffffffff80f11502 at ffs_balloc_ufs2+0x9d2 #5 0xffffffff80f3f7f2 at ffs_write+0x262 #6 0xffffffff811a1b3f at VOP_WRITE_APV+0xcf #7 0xffffffff80d13a3c at vn_write+0x2fc #8 0xffffffff80d13343 at vn_io_fault_doio+0x43 #9 0xffffffff80d0f363 at vn_io_fault1+0x163 #10 0xffffffff80d0ccda at vn_io_fault+0x1aa #11 0xffffffff80c7c341 at dofilewrite+0x81 #12 0xffffffff80c7be70 at sys_write+0xc0 #13 0xffffffff810d7455 at amd64_syscall+0x145 #14 0xffffffff810a832b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 444 1: getblkx 2: brelse 3: bqrelse 4: bufdone 5: cluster_wbuild 6: brelse 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: bqrelse 27: bdwrite 28: getblkx 29: bqrelse 30: bdwrite 31: getblkx 32: brelse buf at 0xfffffe0039216f90 b_flags = 0x20000000, b_xflags=0x2 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe014e838d98), b_data = 0xfffffe004bfd8000 , b_blkno = 2131008, b_lblkno = 2131008, b_vp = 0xfffffe014e838c20, b_dep = 0 b_kvabase = 0xfffffe004bfd8000, b_kvasize = 32768 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80477237318, 0x41088, 0x4fdcf9000),(0xfffff80477237318, 0x41089, 0x4fdcf8000),(0xfffff80477237318, 0x4108a, 0x4fdcf7000),(0xfffff80477237318, 0x4108b, 0x4fdcf6000),(0xfffff80477237318, 0x4108c, 0x4fdcf5000),(0xfffff80477237318, 0x4108d, 0x4fdcf4000),(0xfffff80477237318, 0x4108e, 0x4fdcf3000),(0xfffff80477237318, 0x4108f, 0x4fdcf2000) lock type bufwait: EXCL by KERNPROC #0 0xffffffff80bd60b0 at _lockmgr_disown+0xd0 #1 0xffffffff80f35361 at indirdep_lookup+0xa1 #2 0xffffffff80f25170 at setup_allocindir_phase2+0x80 #3 0xffffffff80f24efc at softdep_setup_allocindir_page+0xfc #4 0xffffffff80f1274e at ffs_balloc_ufs2+0x1c1e #5 0xffffffff80f3f7f2 at ffs_write+0x262 #6 0xffffffff811a1b3f at VOP_WRITE_APV+0xcf #7 0xffffffff80d13a3c at vn_write+0x2fc #8 0xffffffff80d13343 at vn_io_fault_doio+0x43 #9 0xffffffff80d0f363 at vn_io_fault1+0x163 #10 0xffffffff80d0ccda at vn_io_fault+0x1aa #11 0xffffffff80c7c341 at dofilewrite+0x81 #12 0xffffffff80c7be70 at sys_write+0xc0 #13 0xffffffff810d7455 at amd64_syscall+0x145 #14 0xffffffff810a832b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 499 1: getblkx 2: brelse 3: bqrelse 4: bufdone 5: cluster_wbuild 6: bqrelse 7: bdwrite 8: getblkx 9: bqrelse 10: bdwrite 11: getblkx 12: bqrelse 13: bdwrite 14: getblkx 15: bqrelse 16: bdwrite 17: getblkx 18: bqrelse 19: bdwrite 20: getblkx 21: bqrelse 22: bdwrite 23: getblkx 24: bqrelse 25: bdwrite 26: getblkx 27: bqrelse 28: bdwrite 29: getblkx 30: bqrelse 31: bdwrite 32: getblkx buf at 0xfffffe0039239c10 b_flags = 0xa0021024, b_xflags=0x2 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe014fd8f3d0), b_data = 0xfffffe00e472c000 , b_blkno = 380224, b_lblkno = 4174, b_vp = 0xfffffe014fd8f258, b_dep = 0xfffff80004390e00 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80477157e70, 0x8270, 0x4d70c2000),(0xfffff80477157e70, 0x8271, 0x4d70c1000),(0xfffff80477157e70, 0x8272, 0x4d70c0000),(0xfffff80477157e70, 0x8273, 0x4c553f000),(0xfffff80477157e70, 0x8274, 0x4c553e000),(0xfffff80477157e70, 0x8275, 0x4c553d000),(0xfffff80477157e70, 0x8276, 0x4c553c000),(0xfffff80477157e70, 0x8277, 0x4c553b000) lock type bufwait: EXCL by KERNPROC #0 0xffffffff80bd60b0 at _lockmgr_disown+0xd0 #1 0xffffffff80cdf944 at cluster_wbuild+0x5b4 #2 0xffffffff80cdedcc at cluster_write+0x12c #3 0xffffffff80f3f9b2 at ffs_write+0x422 #4 0xffffffff811a1b3f at VOP_WRITE_APV+0xcf #5 0xffffffff80d13a3c at vn_write+0x2fc #6 0xffffffff80d13343 at vn_io_fault_doio+0x43 #7 0xffffffff80d0f363 at vn_io_fault1+0x163 #8 0xffffffff80d0ccda at vn_io_fault+0x1aa #9 0xffffffff80c7c341 at dofilewrite+0x81 #10 0xffffffff80c7be70 at sys_write+0xc0 #11 0xffffffff810d7455 at amd64_syscall+0x145 #12 0xffffffff810a832b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 443 1: cluster_wbuild 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: bqrelse 27: bdwrite 28: getblkx 29: bqrelse 30: bdwrite 31: getblkx 32: bqrelse buf at 0xfffffe0039347b90 b_flags = 0xa00210a0, b_xflags=0x1 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe0150885b40), b_data = 0xfffffe004cbc0000 , b_blkno = 2131264, b_lblkno = -4108, b_vp = 0xfffffe01508859c8, b_dep = 0xfffff80477dc4300 b_kvabase = 0xfffffe004cbc0000, b_kvasize = 32768 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff804e00b7a50, 0xfffffffff7fa0, 0x4fff31000),(0xfffff804e00b7a50, 0xfffffffff7fa1, 0x4fff30000),(0xfffff804e00b7a50, 0xfffffffff7fa2, 0x4fff2f000),(0xfffff804e00b7a50, 0xfffffffff7fa3, 0x4fff2e000),(0xfffff804e00b7a50, 0xfffffffff7fa4, 0x4fff2d000),(0xfffff804e00b7a50, 0xfffffffff7fa5, 0x4fff2c000),(0xfffff804e00b7a50, 0xfffffffff7fa6, 0x4fff2b000),(0xfffff804e00b7a50, 0xfffffffff7fa7, 0x4fff2a000) lock type bufwait: EXCL by thread 0xfffffe0142892c80 (pid 4432, rw, tid 100336) #0 0xffffffff80bd4a0c at lockmgr_xlock_hard+0x4ac #1 0xffffffff80bd4ed9 at __lockmgr_args+0x1f9 #2 0xffffffff80cc8fff at getblkx+0x11f #3 0xffffffff80cc8ce4 at breadn_flags+0x44 #4 0xffffffff80f1121b at ffs_balloc_ufs2+0x6eb #5 0xffffffff80f3f7f2 at ffs_write+0x262 #6 0xffffffff811a1b3f at VOP_WRITE_APV+0xcf #7 0xffffffff80d13a3c at vn_write+0x2fc #8 0xffffffff80d13343 at vn_io_fault_doio+0x43 #9 0xffffffff80d0f363 at vn_io_fault1+0x163 #10 0xffffffff80d0ccda at vn_io_fault+0x1aa #11 0xffffffff80c7c341 at dofilewrite+0x81 #12 0xffffffff80c7be70 at sys_write+0xc0 #13 0xffffffff810d7455 at amd64_syscall+0x145 #14 0xffffffff810a832b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 2983 1: getblkx 2: brelse 3: getblkx 4: brelse 5: getblkx 6: brelse 7: getblkx 8: brelse 9: getblkx 10: brelse 11: getblkx 12: brelse 13: getblkx 14: brelse 15: getblkx 16: bqrelse 17: bdwrite 18: getblkx 19: brelse 20: getblkx 21: brelse 22: getblkx 23: brelse 24: getblkx 25: brelse 26: getblkx 27: brelse 28: getblkx 29: brelse 30: getblkx 31: brelse 32: getblkx buf at 0xfffffe003934ad40 b_flags = 0xa0021024, b_xflags=0x2 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe014fd8f3d0), b_data = 0xfffffe00e472c000 , b_blkno = 380160, b_lblkno = 4173, b_vp = 0xfffffe014fd8f258, b_dep = 0xfffff804e035e900 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80477157e70, 0x8268, 0x4d70ca000),(0xfffff80477157e70, 0x8269, 0x4d70c9000),(0xfffff80477157e70, 0x826a, 0x4d70c8000),(0xfffff80477157e70, 0x826b, 0x4d70c7000),(0xfffff80477157e70, 0x826c, 0x4d70c6000),(0xfffff80477157e70, 0x826d, 0x4d70c5000),(0xfffff80477157e70, 0x826e, 0x4d70c4000),(0xfffff80477157e70, 0x826f, 0x4d70c3000) lock type bufwait: EXCL by KERNPROC #0 0xffffffff80bd60b0 at _lockmgr_disown+0xd0 #1 0xffffffff80cdf944 at cluster_wbuild+0x5b4 #2 0xffffffff80cdedcc at cluster_write+0x12c #3 0xffffffff80f3f9b2 at ffs_write+0x422 #4 0xffffffff811a1b3f at VOP_WRITE_APV+0xcf #5 0xffffffff80d13a3c at vn_write+0x2fc #6 0xffffffff80d13343 at vn_io_fault_doio+0x43 #7 0xffffffff80d0f363 at vn_io_fault1+0x163 #8 0xffffffff80d0ccda at vn_io_fault+0x1aa #9 0xffffffff80c7c341 at dofilewrite+0x81 #10 0xffffffff80c7be70 at sys_write+0xc0 #11 0xffffffff810d7455 at amd64_syscall+0x145 #12 0xffffffff810a832b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 566 1: cluster_wbuild 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: bqrelse 27: bdwrite 28: getblkx 29: bqrelse 30: bdwrite 31: getblkx 32: bqrelse buf at 0xfffffe0039388510 b_flags = 0x20000220, b_xflags=0x2 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe01507971e0), b_data = 0xfffffe004fb48000 , b_blkno = -1, b_lblkno = -32780, b_vp = 0xfffffe0150797068, b_dep = 0 b_kvabase = 0xfffffe004fb48000, b_kvasize = 32768 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80482548210, 0xffffffffbffa0, 0x4ff2d4000),(0xfffff80482548210, 0xffffffffbffa1, 0x4ff2d3000),(0xfffff80482548210, 0xffffffffbffa2, 0x4ff2d2000),(0xfffff80482548210, 0xffffffffbffa3, 0x4ff2d1000),(0xfffff80482548210, 0xffffffffbffa4, 0x4ff2d0000),(0xfffff80482548210, 0xffffffffbffa5, 0x4ff2cf000),(0xfffff80482548210, 0xffffffffbffa6, 0x4ff2ce000),(0xfffff80482548210, 0xffffffffbffa7, 0x4ff2cd000) lock type bufwait: EXCL by thread 0xfffffe010e606e40 (pid 4437, creat, tid 100215) #0 0xffffffff80bd4a0c at lockmgr_xlock_hard+0x4ac #1 0xffffffff80bd4ed9 at __lockmgr_args+0x1f9 #2 0xffffffff80ccc274 at getnewbuf+0x344 #3 0xffffffff80cc9563 at getblkx+0x683 #4 0xffffffff80cc8ce4 at breadn_flags+0x44 #5 0xffffffff80f1121b at ffs_balloc_ufs2+0x6eb #6 0xffffffff80f1aa1c at ffs_copyonwrite+0x2cc #7 0xffffffff80f3ec0f at ffs_geom_strategy+0xcf #8 0xffffffff80f53db3 at ufs_strategy+0x83 #9 0xffffffff811a3bd1 at VOP_STRATEGY_APV+0x61 #10 0xffffffff80cc742e at bufstrategy+0x3e #11 0xffffffff80cc72cc at bufwrite+0x24c #12 0xffffffff80f13559 at ffs_truncate+0x6b9 #13 0xffffffff80f403d3 at ffs_vput_pair+0x1b3 #14 0xffffffff80d0dfe2 at vn_open_cred+0x382 #15 0xffffffff80d04ad6 at kern_openat+0x286 #16 0xffffffff810d7455 at amd64_syscall+0x145 #17 0xffffffff810a832b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 373 1: bufdone 2: getblkx 3: brelse 4: bqrelse 5: bufdone 6: cluster_wbuild 7: brelse 8: getblkx 9: bqrelse 10: bdwrite 11: getblkx 12: bqrelse 13: bdwrite 14: getblkx 15: bqrelse 16: bdwrite 17: getblkx 18: bqrelse 19: bdwrite 20: getblkx 21: bqrelse 22: bdwrite 23: getblkx 24: bqrelse 25: bdwrite 26: getblkx 27: bqrelse 28: bdwrite 29: getblkx 30: bqrelse 31: bdwrite 32: getblkx buf at 0xfffffe00393c2490 b_flags = 0xa0021024, b_xflags=0x2 b_vflags=0x0 b_ioflags0x0 b_error = 0, b_bufsize = 32768, b_bcount = 32768, b_resid = 0 b_bufobj = (0xfffffe014fd8f3d0), b_data = 0xfffffe00e472c000 , b_blkno = 380672, b_lblkno = 4181, b_vp = 0xfffffe014fd8f258, b_dep = 0xfffff80477a66d00 b_kvabase = 0xfffffe00e472c000, b_kvasize = 0 b_npages = 8, pages(OBJ, IDX, PA): (0xfffff80477157e70, 0x82a8, 0x4c550a000),(0xfffff80477157e70, 0x82a9, 0x4c5509000),(0xfffff80477157e70, 0x82aa, 0x4c5508000),(0xfffff80477157e70, 0x82ab, 0x4c5507000),(0xfffff80477157e70, 0x82ac, 0x4c5506000),(0xfffff80477157e70, 0x82ad, 0x4c5505000),(0xfffff80477157e70, 0x82ae, 0x4c5504000),(0xfffff80477157e70, 0x82af, 0x4c5503000) lock type bufwait: EXCL by KERNPROC #0 0xffffffff80bd60b0 at _lockmgr_disown+0xd0 #1 0xffffffff80cdf944 at cluster_wbuild+0x5b4 #2 0xffffffff80cdedcc at cluster_write+0x12c #3 0xffffffff80f3f9b2 at ffs_write+0x422 #4 0xffffffff811a1b3f at VOP_WRITE_APV+0xcf #5 0xffffffff80d13a3c at vn_write+0x2fc #6 0xffffffff80d13343 at vn_io_fault_doio+0x43 #7 0xffffffff80d0f363 at vn_io_fault1+0x163 #8 0xffffffff80d0ccda at vn_io_fault+0x1aa #9 0xffffffff80c7c341 at dofilewrite+0x81 #10 0xffffffff80c7be70 at sys_write+0xc0 #11 0xffffffff810d7455 at amd64_syscall+0x145 #12 0xffffffff810a832b at fast_syscall_common+0xf8 b_io_tracking: b_io_tcnt = 626 1: cluster_wbuild 2: bqrelse 3: bdwrite 4: getblkx 5: bqrelse 6: bdwrite 7: getblkx 8: bqrelse 9: bdwrite 10: getblkx 11: bqrelse 12: bdwrite 13: getblkx 14: bqrelse 15: bdwrite 16: getblkx 17: bqrelse 18: bdwrite 19: getblkx 20: bqrelse 21: bdwrite 22: getblkx 23: bqrelse 24: bdwrite 25: getblkx 26: bqrelse 27: bdwrite 28: getblkx 29: bqrelse 30: bdwrite 31: getblkx 32: brelse db:1:pho1> show page vm_cnt.v_free_count: 7296734 vm_cnt.v_inactive_count: 50688 vm_cnt.v_active_count: 349014 vm_cnt.v_laundry_count: 0 vm_cnt.v_wire_count: 423093 vm_cnt.v_free_reserved: 10644 vm_cnt.v_free_min: 51265 vm_cnt.v_free_target: 173128 vm_cnt.v_inactive_target: 259692 db:1:pho1> show pageq pq_free 7296734 dom 0 page_cnt 8124374 free 7296734 pq_act 349014 pq_inact 50688 pq_laund 0 pq_unsw 0 db:0:pho> show freepages DOMAIN: 0 FREE LIST 0: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 001744 | 000000 11 (008192K) | 000001 | 000000 10 (004096K) | 000002 | 000000 09 (002048K) | 000004 | 000001 08 (001024K) | 000001 | 000001 07 (000512K) | 000046 | 000000 06 (000256K) | 000197 | 000001 05 (000128K) | 000000 | 000001 04 (000064K) | 000001 | 000001 03 (000032K) | 000001 | 000001 02 (000016K) | 000001 | 000000 01 (000008K) | 000000 | 000001 00 (000004K) | 000000 | 000000 FREE LIST 1: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000000 | 000000 09 (002048K) | 000000 | 000000 08 (001024K) | 000001 | 000000 07 (000512K) | 000000 | 000000 06 (000256K) | 000001 | 000000 05 (000128K) | 000001 | 000000 04 (000064K) | 000002 | 000000 03 (000032K) | 000001 | 000000 02 (000016K) | 000000 | 000000 01 (000008K) | 000000 | 000000 00 (000004K) | 000000 | 000000 db:0:pho> show uma Zone Size Used Free Requests Sleeps Bucket Total Mem XFree malloc-4096 4096 34133 3 34266 0 2 139821056 0 FFS inode 1160 101005 6256 1193812 0 28 124422760 0 VNODE 600 101134 6272 1194691 0 31 64443600 0 mbuf_cluster 2048 13931 1055 13949 0 254 30691328 0 FFS2 dinode 256 101004 6576 1193794 0 63 27540480 0 BUF TRIE 144 2011 103941 311124 0 62 15257088 0 S VFS Cache 104 99904 1301 100536 0 126 10525320 0 RADIX NODE 144 50654 2179 694475 0 62 7607952 0 VM OBJECT 264 13502 6268 1301442 0 32 5219280 0 UMA Slabs 0 112 45759 27 45759 0 126 5128032 0 mbuf 256 15555 3250 42588 0 254 4814080 0 malloc-384 384 4857 4403 1798914 0 33 3555840 0 malloc-128 128 26300 1321 40048 0 126 3535488 0 mbuf_jumbo_page 4096 0 762 6 0 254 3121152 0 socket 960 56 2992 5819 0 254 2926080 0 vmem btag 56 45223 1493 45223 0 254 2616096 0 pbuf 2776 0 761 0 0 0 2112536 0 malloc-256 256 3594 4221 1156358 0 62 2000640 0 malloc-128 128 14320 1180 1136900 0 126 1984000 0 malloc-4096 4096 420 36 115238 0 2 1867776 0 malloc-128 128 13480 904 21968 0 126 1841152 0 256 Bucket 2048 725 127 42822 0 8 1744896 0 tcpcb 1096 12 1514 17 0 254 1672496 0 malloc-256 256 2178 3492 1094996 0 63 1451520 0 malloc-32768 32768 12 29 804 0 1 1343488 0 malloc-128 128 2812 5899 1705552 0 126 1115008 0 malloc-32768 32768 9 23 3696 0 1 1048576 0 DIRHASH 1024 787 221 28142 0 16 1032192 0 malloc-128 128 1241 6106 1096658 0 127 940416 0 malloc-65536 65536 1 12 466 0 1 851968 0 malloc-32768 32768 2 24 6343 0 1 851968 0 malloc-16384 16384 2 50 8497 0 1 851968 0 THREAD 1808 401 50 422 0 8 815408 0 64 Bucket 512 785 799 68187 0 30 811008 0 malloc-64 64 9296 2926 17763 0 254 782208 0 malloc-64 64 9210 2760 24908 0 254 766080 0 128 Bucket 1024 437 302 21578 0 16 756736 0 unpcb 256 19 2786 5586 0 254 718080 0 malloc-8192 8192 86 0 86 0 1 704512 0 DEVCTL 1024 0 676 3957 0 0 692224 0 32 Bucket 256 654 1896 108251 0 62 652800 0 mbuf_packet 256 8 2532 1963 0 254 650240 0 malloc-65536 65536 3 6 3940 0 1 589824 0 malloc-32768 32768 12 4 20 0 1 524288 0 UMA Zones 2048 232 3 232 0 8 481280 0 MAP ENTRY 96 2557 2357 629538 0 126 471744 0 malloc-65536 65536 2 5 7 0 1 458752 0 FPU_save_area 832 403 128 1160 0 16 441792 0 g_bio 408 0 1070 591280 0 31 436560 0 malloc-256 256 510 1170 263496 0 62 430080 0 malloc-32768 32768 1 12 375 0 1 425984 0 malloc-64 64 4279 2336 4309 0 254 423360 0 malloc-1024 1024 223 177 5301 0 16 409600 0 lkpicurr 168 9 2391 9 0 62 403200 0 lkpimm 168 3 2325 3 0 62 391104 0 malloc-8192 8192 14 32 1578 0 1 376832 0 VMSPACE 2552 63 81 11147 0 4 367488 0 malloc-256 256 510 855 28046 0 62 349440 0 malloc-2048 2048 118 50 138 0 8 344064 0 malloc-32 32 8285 1921 9436 0 254 326592 0 malloc-256 256 475 770 32693 0 62 318720 0 L VFS Cache 320 807 153 807 0 30 307200 0 malloc-16 16 16111 2389 17124 0 254 296000 0 malloc-16384 16384 12 6 4835 0 1 294912 0 malloc-128 128 961 1333 33151 0 126 293632 0 16 Bucket 144 228 1732 20040 0 62 282240 0 malloc-512 512 236 308 5709 0 30 278528 0 PROC 1352 82 119 11537 0 8 271752 0 malloc-256 256 61 944 22277 0 62 257280 0 NAMEI 1024 4 236 2447801 0 16 245760 0 filedesc0 1072 82 142 11538 0 8 240128 0 malloc-256 256 32 898 1135979 0 62 238080 0 pipe 744 7 298 4366 0 16 226920 0 ksiginfo 112 190 1826 993 0 126 225792 0 malloc-64 64 539 2800 20060849 0 254 213696 0 malloc-2048 2048 1 103 773 0 8 212992 0 malloc-1024 1024 2 206 3065 0 16 212992 0 ttyoutq 256 181 629 290 0 62 207360 0 malloc-64 64 6 3081 395 0 254 197568 0 malloc-64 64 167 2920 40173 0 254 197568 0 malloc-64 64 62 3025 113 0 254 197568 0 2 Bucket 32 3300 2874 61194 0 254 197568 0 malloc-65536 65536 3 0 3 0 1 196608 0 malloc-16384 16384 7 5 12 0 1 196608 0 malloc-8192 8192 23 1 24 0 1 196608 0 malloc-2048 2048 2 94 5684 0 8 196608 0 malloc-128 128 35 1484 4631 0 126 194432 0 malloc-128 128 118 1401 936 0 126 194432 0 malloc-256 256 130 620 1429 0 62 192000 0 malloc-8192 8192 17 6 3067 0 1 188416 0 malloc-512 512 0 360 9586 0 30 184320 0 malloc-512 512 12 348 759 0 30 184320 0 malloc-1024 1024 23 153 42 0 16 180224 0 malloc-1024 1024 21 155 280 0 16 180224 0 udp_inpcb 424 22 374 202 0 30 167904 0 Files 80 153 1897 1191936 0 126 164000 0 malloc-2048 2048 6 74 194 0 8 163840 0 malloc-384 384 227 193 10323 0 30 161280 0 4 Bucket 48 676 2684 3804 0 254 161280 0 malloc-512 512 3 301 399 0 30 155648 0 ttyinq 160 345 605 555 0 62 152000 0 malloc-384 384 155 235 157 0 30 149760 0 malloc-1024 1024 2 142 17087 0 16 147456 0 malloc-1024 1024 32 112 4421 0 16 147456 0 cpuset 104 27 1368 27 0 126 145080 0 8 Bucket 80 182 1518 1877255 0 126 136000 0 PGRP 88 34 1484 66 0 126 133584 0 ada_ccb 272 0 490 21200 0 30 133280 0 malloc-64 64 23 2056 48 0 254 133056 0 malloc-65536 65536 2 0 2 0 1 131072 0 malloc-65536 65536 2 0 2 0 1 131072 0 malloc-16384 16384 2 6 14 0 1 131072 0 malloc-4096 4096 1 31 753 0 2 131072 0 malloc-2048 2048 2 62 310 0 8 131072 0 rl_entry 40 180 2951 180 0 254 125240 0 SLEEPQUEUE 88 452 956 452 0 126 123904 0 malloc-32 32 564 3090 25220 0 254 116928 0 malloc-384 384 3 297 1017 0 30 115200 0 malloc-384 384 53 247 53 0 30 115200 0 TURNSTILE 136 452 367 452 0 62 111384 0 routing nhops 256 9 426 15 0 62 111360 0 malloc-32 32 519 2883 5161 0 254 108864 0 malloc-4096 4096 4 22 767 0 2 106496 0 udpcb 32 22 3128 202 0 254 100800 0 PWD 32 34 3116 1057 0 254 100800 0 malloc-32 32 5 3145 1915 0 254 100800 0 malloc-32 32 269 2881 6725 0 254 100800 0 clpbuf 2776 1 35 23111 0 2 99936 0 malloc-4096 4096 1 23 1522 0 2 98304 0 malloc-1024 1024 25 71 44 0 16 98304 0 malloc-512 512 5 179 1259 0 30 94208 0 ertt_txseginfo 40 0 2323 128 0 254 92920 0 kenv 258 18 342 21842 0 30 92880 0 malloc-32 32 367 2531 23935 0 254 92736 0 malloc-4096 4096 16 6 21 0 2 90112 0 syncache 168 0 528 2 0 254 88704 0 malloc-32 32 67 2579 76 0 254 84672 0 malloc-16384 16384 5 0 5 0 1 81920 0 malloc-2048 2048 5 35 1511 0 8 81920 0 pcpu-64 64 453 827 453 0 254 81920 0 malloc-384 384 11 199 21 0 30 80640 0 UMA Kegs 384 202 1 202 0 30 77952 0 rtentry 176 12 425 15 0 62 76912 0 tcp_inpcb 424 12 168 17 0 30 76320 0 malloc-8192 8192 7 2 9 0 1 73728 0 udp_inpcb ports 32 10 2132 18 0 254 68544 0 malloc-32 32 65 2077 110 0 254 68544 0 malloc-32768 32768 2 0 2 0 1 65536 0 malloc-4096 4096 14 2 25 0 2 65536 0 malloc-2048 2048 6 26 6 0 8 65536 0 malloc-1024 1024 9 55 13 0 16 65536 0 ertt 72 12 772 17 0 126 56448 0 malloc-16 16 426 3074 58781 0 254 56000 0 malloc-16 16 468 3032 1094195 0 254 56000 0 malloc-16 16 20 3230 2693 0 254 52000 0 malloc-16 16 503 2747 28541 0 254 52000 0 Mountpoints 2944 4 12 5 0 4 47104 0 pcpu-8 8 3526 2106 3533 0 254 45056 0 tcp_inpcb ports 32 6 1380 6 0 254 44352 0 mdpbuf 2776 0 15 23976 0 1 41640 0 malloc-8192 8192 4 1 5 0 1 40960 0 malloc-8192 8192 4 0 4 0 1 32768 0 malloc-512 512 1 63 2 0 30 32768 0 malloc-512 512 0 64 2 0 30 32768 0 malloc-16 16 25 1975 25 0 254 32000 0 malloc-16 16 255 1745 255 0 254 32000 0 malloc-16 16 58 1692 72 0 254 28000 0 ripcb 424 1 62 3 0 30 26712 0 SMR CPU 32 7 760 7 0 254 24544 0 malloc-384 384 3 57 16 0 30 23040 0 SMR SHARED 24 7 760 7 0 254 18408 0 epoch_record pcpu 256 4 60 4 0 62 16384 0 malloc-4096 4096 1 3 13 0 2 16384 0 malloc-2048 2048 1 7 1 0 8 16384 0 malloc-512 512 1 31 1 0 30 16384 0 pcpu-16 16 16 1008 16 0 254 16384 0 fakepg 104 0 156 4 0 126 16224 0 vmem 1856 1 7 1 0 8 14848 0 vtnet_tx_hdr 24 0 167 0 0 254 4008 0 UMA Slabs 1 176 10 12 10 0 62 3872 0 KMAP ENTRY 96 33 6 33 0 0 3744 0 FFS1 dinode 128 0 0 0 0 126 0 0 swblk 136 0 0 0 0 62 0 0 swpctrie 144 0 0 0 0 62 0 0 da_ccb 544 0 0 0 0 16 0 0 tfo_ccache_entries 80 0 0 0 0 126 0 0 tfo 4 0 0 0 0 254 0 0 sackhole 32 0 0 0 0 254 0 0 hostcache 64 0 0 0 0 254 0 0 tcptw 72 0 0 0 0 254 0 0 ipq 56 0 0 0 0 254 0 0 tcp_log_node 120 0 0 0 0 126 0 0 tcp_log_bucket 176 0 0 0 0 62 0 0 tcp_log 416 0 0 0 0 254 0 0 tcpreass 48 0 0 0 0 254 0 0 ripcb ports 32 0 0 0 0 254 0 0 udplite_inpcb ports 32 0 0 0 0 254 0 0 udplite_inpcb 424 0 0 0 0 30 0 0 IPsec SA lft_c 16 0 0 0 0 254 0 0 KNOTE 160 0 0 0 0 62 0 0 itimer 352 0 0 0 0 30 0 0 AIOLIO 272 0 0 0 0 30 0 0 AIOCB 552 0 0 0 0 16 0 0 AIOP 32 0 0 0 0 254 0 0 AIO 208 0 0 0 0 62 0 0 TMPFS node 224 0 0 0 0 62 0 0 NCLNODE 760 0 0 0 0 16 0 0 LTS VFS Cache 360 0 0 0 0 30 0 0 STS VFS Cache 144 0 0 0 0 62 0 0 cryptop 280 0 0 0 0 30 0 0 linux_dma_object 32 0 0 0 0 254 0 0 linux_dma_pctrie 144 0 0 0 0 62 0 0 IOMMU_MAP_ENTRY 120 0 0 0 0 126 0 0 mbuf_jumbo_16k 16384 0 0 0 0 254 0 0 mbuf_jumbo_9k 9216 0 0 0 0 254 0 0 audit_record 1280 0 0 0 0 8 0 0 domainset 40 0 0 0 0 254 0 0 MAC labels 40 0 0 0 0 254 0 0 vnpbuf 2776 0 0 0 0 10 0 0 nfspbuf 2776 0 0 0 0 2 0 0 swwbuf 2776 0 0 0 0 1 0 0 swrbuf 2776 0 0 0 0 2 0 0 umtx_shm 88 0 0 0 0 126 0 0 umtx pi 96 0 0 0 0 126 0 0 rangeset pctrie nodes 144 0 0 0 0 62 0 0 malloc-65536 65536 0 0 0 0 1 0 0 malloc-65536 65536 0 0 0 0 1 0 0 malloc-32768 32768 0 0 0 0 1 0 0 malloc-32768 32768 0 0 0 0 1 0 0 malloc-16384 16384 0 0 0 0 1 0 0 malloc-16384 16384 0 0 0 0 1 0 0 malloc-16384 16384 0 0 0 0 1 0 0 malloc-8192 8192 0 0 0 0 1 0 0 malloc-384 384 0 0 0 0 30 0 0 pcpu-32 32 0 0 0 0 254 0 0 pcpu-4 4 0 0 0 0 254 0 0 UMA Hash 256 0 0 0 0 62 0 0 db:0:pho> show umacache Zone Size Used Free Requests Bucket debugnet_mbuf_packet 2048 0 0 0 0 debugnet_mbuf_cluster 2048 -6144 0 0 0 debugnet_mbuf 256 -10240 0 0 0 vm pgcache 4096 76356 2711 632043 169 vm pgcache 4096 283406 1951 5511620 169 buf free cache 848 29620 4571 628950 21 buffer arena-65 65536 0 0 0 1 buffer arena-61 61440 0 0 0 1 buffer arena-57 57344 0 0 0 1 buffer arena-53 53248 0 0 0 1 buffer arena-49 49152 0 0 0 1 buffer arena-45 45056 0 0 0 1 buffer arena-40 40960 0 0 0 1 buffer arena-36 36864 0 0 0 1 buffer arena-32 32768 1353 8338 76702 3 buffer arena-28 28672 0 0 0 1 buffer arena-24 24576 0 0 0 1 buffer arena-20 20480 0 0 0 1 buffer arena-16 16384 5 3 14 1 buffer arena-12 12288 0 0 0 1 buffer arena-81 8192 0 0 0 1 buffer arena-40 4096 0 0 0 2 kstack_cache 16384 401 7 422 2 db:0:pho> acttrace Tracing command rm pid 11537 tid 100359 td 0xfffffe01445aa1e0 (CPU 5) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce54e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce54e10 trap() at trap+0x56/frame 0xfffffe003ce54f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce54f20 --- trap 0x13, rip = 0x2b4ebcb04da2, rsp = 0x167139049460, rbp = 0x1671390498e0 --- Tracing command rw pid 4429 tid 100327 td 0xfffffe01445a7e40 (CPU 8) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce7be00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce7be10 trap() at trap+0x56/frame 0xfffffe003ce7bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce7bf20 --- trap 0x13, rip = 0xffffffff80c773d7, rsp = 0xfffffe01439705d0, rbp = 0xfffffe0143970600 --- witness_lock() at witness_lock+0x97/frame 0xfffffe0143970600 _rw_wlock_cookie() at _rw_wlock_cookie+0xca/frame 0xfffffe0143970640 newallocindir() at newallocindir+0x72/frame 0xfffffe0143970690 softdep_setup_allocindir_page() at softdep_setup_allocindir_page+0x7e/frame 0xfffffe0143970700 ffs_balloc_ufs2() at ffs_balloc_ufs2+0x1c1e/frame 0xfffffe01439708d0 ffs_write() at ffs_write+0x262/frame 0xfffffe0143970980 VOP_WRITE_APV() at VOP_WRITE_APV+0xcf/frame 0xfffffe0143970a90 vn_write() at vn_write+0x2fc/frame 0xfffffe0143970b20 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe0143970b80 vn_io_fault1() at vn_io_fault1+0x163/frame 0xfffffe0143970cc0 vn_io_fault() at vn_io_fault+0x1aa/frame 0xfffffe0143970d40 dofilewrite() at dofilewrite+0x81/frame 0xfffffe0143970d90 sys_write() at sys_write+0xc0/frame 0xfffffe0143970e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0143970f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0143970f30 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x31ed4ad1991a, rsp = 0x31ed49098cf8, rbp = 0x31ed49099db0 --- Tracing command rw pid 4430 tid 100326 td 0xfffffe01445a9ac0 (CPU 11) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003cea2e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003cea2e10 trap() at trap+0x56/frame 0xfffffe003cea2f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003cea2f20 --- trap 0x13, rip = 0xffffffff810d33b6, rsp = 0xfffffe01438fd930, rbp = 0xfffffe01438fd930 --- copyout_nosmap_erms() at copyout_nosmap_erms+0x156/frame 0xfffffe01438fd930 uiomove_fromphys() at uiomove_fromphys+0x1a1/frame 0xfffffe01438fd9a0 vn_read_from_obj() at vn_read_from_obj+0x168/frame 0xfffffe01438fda80 VOP_READ_PGCACHE_APV() at VOP_READ_PGCACHE_APV+0x34/frame 0xfffffe01438fdaa0 vn_read() at vn_read+0x94/frame 0xfffffe01438fdb20 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe01438fdb80 vn_io_fault1() at vn_io_fault1+0x163/frame 0xfffffe01438fdcc0 vn_io_fault() at vn_io_fault+0x1aa/frame 0xfffffe01438fdd40 dofileread() at dofileread+0x81/frame 0xfffffe01438fdd90 sys_read() at sys_read+0xc0/frame 0xfffffe01438fde00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe01438fdf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01438fdf30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x31ed4ad196fa, rsp = 0x31ed49098cf8, rbp = 0x31ed49099db0 --- Tracing command rw pid 4431 tid 100325 td 0xfffffe0143515740 (CPU 4) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce47e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce47e10 trap() at trap+0x56/frame 0xfffffe003ce47f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce47f20 --- trap 0x13, rip = 0xffffffff80c7795a, rsp = 0xfffffe014399dc10, rbp = 0xfffffe014399dc40 --- witness_unlock() at witness_unlock+0x9a/frame 0xfffffe014399dc40 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe014399dc70 rangelock_enqueue() at rangelock_enqueue+0x13d/frame 0xfffffe014399dcc0 vn_io_fault() at vn_io_fault+0x17a/frame 0xfffffe014399dd40 dofileread() at dofileread+0x81/frame 0xfffffe014399dd90 sys_read() at sys_read+0xc0/frame 0xfffffe014399de00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe014399df30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014399df30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x31ed4ad196fa, rsp = 0x31ed49098cf8, rbp = 0x31ed49099db0 --- Tracing command rw pid 4432 tid 100336 td 0xfffffe0142892c80 (CPU 6) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce61e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce61e10 trap() at trap+0x56/frame 0xfffffe003ce61f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce61f20 --- trap 0x13, rip = 0xffffffff80ccac91, rsp = 0xfffffe0143989520, rbp = 0xfffffe0143989540 --- bqrelse() at bqrelse+0x41/frame 0xfffffe0143989540 bdwrite() at bdwrite+0x215/frame 0xfffffe01439895b0 ffs_alloccg() at ffs_alloccg+0x15a/frame 0xfffffe0143989630 ffs_hashalloc() at ffs_hashalloc+0x79/frame 0xfffffe0143989680 ffs_alloc() at ffs_alloc+0x1f5/frame 0xfffffe0143989700 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xb74/frame 0xfffffe01439898d0 ffs_write() at ffs_write+0x262/frame 0xfffffe0143989980 VOP_WRITE_APV() at VOP_WRITE_APV+0xcf/frame 0xfffffe0143989a90 vn_write() at vn_write+0x2fc/frame 0xfffffe0143989b20 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe0143989b80 vn_io_fault1() at vn_io_fault1+0x163/frame 0xfffffe0143989cc0 vn_io_fault() at vn_io_fault+0x1aa/frame 0xfffffe0143989d40 dofilewrite() at dofilewrite+0x81/frame 0xfffffe0143989d90 sys_write() at sys_write+0xc0/frame 0xfffffe0143989e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0143989f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0143989f30 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x31ed4ad1991a, rsp = 0x31ed49098cf8, rbp = 0x31ed49099db0 --- Tracing command rw pid 4433 tid 100335 td 0xfffffe01445a8560 (CPU 3) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce3ae00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce3ae10 trap() at trap+0x56/frame 0xfffffe003ce3af20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce3af20 --- trap 0x13, rip = 0xffffffff810d33b8, rsp = 0xfffffe0143975930, rbp = 0xfffffe0143975930 --- copyout_nosmap_erms() at copyout_nosmap_erms+0x158/frame 0xfffffe0143975930 uiomove_fromphys() at uiomove_fromphys+0x1a1/frame 0xfffffe01439759a0 vn_read_from_obj() at vn_read_from_obj+0x168/frame 0xfffffe0143975a80 VOP_READ_PGCACHE_APV() at VOP_READ_PGCACHE_APV+0x34/frame 0xfffffe0143975aa0 vn_read() at vn_read+0x94/frame 0xfffffe0143975b20 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe0143975b80 vn_io_fault1() at vn_io_fault1+0x163/frame 0xfffffe0143975cc0 vn_io_fault() at vn_io_fault+0x1aa/frame 0xfffffe0143975d40 dofileread() at dofileread+0x81/frame 0xfffffe0143975d90 sys_read() at sys_read+0xc0/frame 0xfffffe0143975e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0143975f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0143975f30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x31ed4ad196fa, rsp = 0x31ed49098cf8, rbp = 0x31ed49099db0 --- Tracing command rw pid 4434 tid 100341 td 0xfffffe0142892560 (CPU 0) cpustop_handler() at cpustop_handler+0x28/frame 0xffffffff81fea310 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xffffffff81fea320 trap() at trap+0x56/frame 0xffffffff81fea430 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81fea430 --- trap 0x13, rip = 0xffffffff80c76100, rsp = 0xfffffe01439d6520, rbp = 0xfffffe01439d66d0 --- witness_checkorder() at witness_checkorder+0xd0/frame 0xfffffe01439d66d0 _rw_wlock_cookie() at _rw_wlock_cookie+0x67/frame 0xfffffe01439d6710 reassignbuf() at reassignbuf+0x3a/frame 0xfffffe01439d6740 bundirty() at bundirty+0x32/frame 0xfffffe01439d6760 cluster_wbuild() at cluster_wbuild+0x58c/frame 0xfffffe01439d6800 cluster_write() at cluster_write+0x12c/frame 0xfffffe01439d68d0 ffs_write() at ffs_write+0x422/frame 0xfffffe01439d6980 VOP_WRITE_APV() at VOP_WRITE_APV+0xcf/frame 0xfffffe01439d6a90 vn_write() at vn_write+0x2fc/frame 0xfffffe01439d6b20 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe01439d6b80 vn_io_fault1() at vn_io_fault1+0x163/frame 0xfffffe01439d6cc0 vn_io_fault() at vn_io_fault+0x1aa/frame 0xfffffe01439d6d40 dofilewrite() at dofilewrite+0x81/frame 0xfffffe01439d6d90 sys_write() at sys_write+0xc0/frame 0xfffffe01439d6e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe01439d6f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01439d6f30 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x31ed4ad1991a, rsp = 0x31ed49098cf8, rbp = 0x31ed49099db0 --- Tracing command creat pid 4436 tid 100216 td 0xfffffe010e7e3e40 (CPU 9) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce88e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce88e10 trap() at trap+0x56/frame 0xfffffe003ce88f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce88f20 --- trap 0x13, rip = 0xffffffff80c54222, rsp = 0xfffffe0141782820, rbp = 0xfffffe0141782830 --- lock_delay() at lock_delay+0x22/frame 0xfffffe0141782830 __rw_wlock_hard() at __rw_wlock_hard+0x188/frame 0xfffffe01417828d0 _rw_wlock_cookie() at _rw_wlock_cookie+0xb7/frame 0xfffffe0141782910 softdep_update_inodeblock() at softdep_update_inodeblock+0xdd/frame 0xfffffe0141782970 ffs_update() at ffs_update+0x1a3/frame 0xfffffe01417829b0 ufs_makeinode() at ufs_makeinode+0x3a7/frame 0xfffffe0141782b10 ufs_create() at ufs_create+0x34/frame 0xfffffe0141782b30 VOP_CREATE_APV() at VOP_CREATE_APV+0x62/frame 0xfffffe0141782b50 vn_open_cred() at vn_open_cred+0x2c9/frame 0xfffffe0141782cb0 kern_openat() at kern_openat+0x286/frame 0xfffffe0141782e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0141782f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141782f30 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x31f8fffc963a, rsp = 0x31f8fdb669d8, rbp = 0x31f8fdb66a90 --- Tracing command creat pid 4437 tid 100215 td 0xfffffe010e606e40 (CPU 2) kdb_enter() at kdb_enter+0x37/frame 0xfffffe014174b370 vpanic() at vpanic+0x1b0/frame 0xfffffe014174b3c0 panic() at panic+0x43/frame 0xfffffe014174b420 witness_checkorder() at witness_checkorder+0xd1c/frame 0xfffffe014174b5e0 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x6c/frame 0xfffffe014174b680 __lockmgr_args() at __lockmgr_args+0x1f9/frame 0xfffffe014174b720 ffs_copyonwrite() at ffs_copyonwrite+0x1d7/frame 0xfffffe014174b7f0 ffs_geom_strategy() at ffs_geom_strategy+0xcf/frame 0xfffffe014174b820 ufs_strategy() at ufs_strategy+0x83/frame 0xfffffe014174b850 VOP_STRATEGY_APV() at VOP_STRATEGY_APV+0x61/frame 0xfffffe014174b870 bufstrategy() at bufstrategy+0x3e/frame 0xfffffe014174b8a0 bufwrite() at bufwrite+0x24c/frame 0xfffffe014174b8f0 ffs_truncate() at ffs_truncate+0x6b9/frame 0xfffffe014174bac0 ffs_vput_pair() at ffs_vput_pair+0x1b3/frame 0xfffffe014174bb50 vn_open_cred() at vn_open_cred+0x382/frame 0xfffffe014174bcb0 kern_openat() at kern_openat+0x286/frame 0xfffffe014174be00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe014174bf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014174bf30 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x31f8fffc963a, rsp = 0x31f8fdb669d8, rbp = 0x31f8fdb66a90 --- Tracing command creat pid 4438 tid 100342 td 0xfffffe010e606720 (CPU 1) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce20e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce20e10 trap() at trap+0x56/frame 0xfffffe003ce20f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce20f20 --- trap 0x13, rip = 0xffffffff80c762d1, rsp = 0xfffffe01439e0850, rbp = 0xfffffe01439e0a00 --- witness_checkorder() at witness_checkorder+0x2a1/frame 0xfffffe01439e0a00 __mtx_lock_flags() at __mtx_lock_flags+0x94/frame 0xfffffe01439e0a50 vn_irflag_set_cond() at vn_irflag_set_cond+0x2d/frame 0xfffffe01439e0a80 ufs_open() at ufs_open+0x66/frame 0xfffffe01439e0ab0 VOP_OPEN_APV() at VOP_OPEN_APV+0x56/frame 0xfffffe01439e0ad0 vn_open_vnode() at vn_open_vnode+0x1c9/frame 0xfffffe01439e0b50 vn_open_cred() at vn_open_cred+0x548/frame 0xfffffe01439e0cb0 kern_openat() at kern_openat+0x286/frame 0xfffffe01439e0e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe01439e0f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01439e0f30 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x31f8fffc963a, rsp = 0x31f8fdb669d8, rbp = 0x31f8fdb66a90 --- Tracing command creat pid 4439 tid 100343 td 0xfffffe010e606000 (CPU 7) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce6ee00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce6ee10 trap() at trap+0x56/frame 0xfffffe003ce6ef20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce6ef20 --- trap 0x13, rip = 0xffffffff80f600e2, rsp = 0xfffffe01439db840, rbp = 0xfffffe01439db880 --- item_ctor() at item_ctor+0x1e2/frame 0xfffffe01439db880 ffs_vgetf() at ffs_vgetf+0xe8/frame 0xfffffe01439db900 ffs_valloc() at ffs_valloc+0x57f/frame 0xfffffe01439db9b0 ufs_makeinode() at ufs_makeinode+0xd9/frame 0xfffffe01439dbb10 ufs_create() at ufs_create+0x34/frame 0xfffffe01439dbb30 VOP_CREATE_APV() at VOP_CREATE_APV+0x62/frame 0xfffffe01439dbb50 vn_open_cred() at vn_open_cred+0x2c9/frame 0xfffffe01439dbcb0 kern_openat() at kern_openat+0x286/frame 0xfffffe01439dbe00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe01439dbf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01439dbf30 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x31f8fffc963a, rsp = 0x31f8fdb669d8, rbp = 0x31f8fdb66a90 --- Tracing command creat pid 4440 tid 100344 td 0xfffffe010e5e8740 (CPU 10) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce95e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce95e10 trap() at trap+0x56/frame 0xfffffe003ce95f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce95f20 --- trap 0x13, rip = 0xffffffff80cf636a, rsp = 0xfffffe01439ea9e0, rbp = 0xfffffe01439ea9f0 --- assert_vi_unlocked() at assert_vi_unlocked+0x1a/frame 0xfffffe01439ea9f0 VOP_ADVLOCKPURGE_APV() at VOP_ADVLOCKPURGE_APV+0x6c/frame 0xfffffe01439eaa10 vgonel() at vgonel+0x462/frame 0xfffffe01439eaa70 vrecycle() at vrecycle+0x5c/frame 0xfffffe01439eaaa0 ufs_inactive() at ufs_inactive+0x27c/frame 0xfffffe01439eaae0 VOP_INACTIVE_APV() at VOP_INACTIVE_APV+0x59/frame 0xfffffe01439eab00 vinactivef() at vinactivef+0xda/frame 0xfffffe01439eab40 vput_final() at vput_final+0x2aa/frame 0xfffffe01439eaba0 kern_funlinkat() at kern_funlinkat+0x275/frame 0xfffffe01439eade0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe01439eae00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe01439eaf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01439eaf30 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x31f8fffc653a, rsp = 0x31f8fdb669d8, rbp = 0x31f8fdb66a90 --- db:0:pho> ps pid ppid pgrp uid state wmesg wchan cmd 11537 4388 3080 0 R+ CPU 5 rm 11018 3225 3165 0 S nanslp 0xffffffff81eab82b sleep 4440 4435 3080 0 R+ CPU 10 creat 4439 4435 3080 0 R+ CPU 7 creat 4438 4435 3080 0 R+ CPU 1 creat 4437 4435 3080 0 R+ CPU 2 creat 4436 4435 3080 0 R+ CPU 9 creat 4435 4425 3080 0 S+ wait 0xfffff803e42d8a90 creat 4434 4428 3080 0 R+ CPU 0 rw 4433 4428 3080 0 R+ CPU 3 rw 4432 4428 3080 0 R+ CPU 6 rw 4431 4428 3080 0 R+ CPU 4 rw 4430 4428 3080 0 R+ CPU 11 rw 4429 4428 3080 0 R+ CPU 8 rw 4428 4427 3080 0 S+ wait 0xfffff803e42d8000 rw 4427 4423 3080 0 S+ nanslp 0xffffffff81eab82a rw 4425 4423 3080 0 S+ nanslp 0xffffffff81eab828 creat 4423 4422 3080 0 S+ wait 0xfffff8028de47000 run 4422 4420 3080 0 S+ wait 0xfffff803e487e000 run 4420 4408 3080 0 S+ nanslp 0xffffffff81eab825 run 4408 4388 3080 0 S+ wait 0xfffff80032533a90 sh 4398 0 0 0 DL mdwait 0xfffff8028dc8c000 [md10] 4389 3080 3080 0 S+ piperd 0xfffff8048235bba0 tee 4388 4387 3080 0 S+ wait 0xfffff8004a337000 sh 4387 3080 3080 0 S+ wait 0xfffff800328d2a90 sh 4380 4379 4380 2006 Ss+ select 0xfffff8004ae9c340 bash 4379 3647 3647 2006 S select 0xfffff80003da09c0 sshd 3647 2713 3647 0 Ss select 0xfffff80003e4a3c0 sshd 3228 3165 3165 0 S piperd 0xfffff8004af232e8 sh 3226 3165 3165 0 S piperd 0xfffff80032bb62e8 awk 3225 3165 3165 0 S wait 0xfffff80032704548 sh 3165 1 3165 0 Ss wait 0xfffff800274a8000 sh 3080 2806 3080 0 S+ wait 0xfffff80032704000 sh 2806 2804 2806 0 S+ wait 0xfffff80003dbea90 bash 2804 2803 2804 0 S+ pause 0xfffff80032b745f8 csh 2803 2798 2803 2006 S+ wait 0xfffff803e4011a90 su 2798 2797 2798 2006 Ss+ wait 0xfffff8003284ea90 bash 2797 2794 2794 2006 S select 0xfffff80003c94540 sshd 2794 2713 2794 0 Ss select 0xfffff80003b936c0 sshd 2740 1 2740 0 Ss+ ttyin 0xfffff8000c1858b0 getty 2739 1 2739 0 Ss+ ttyin 0xfffff8000c185cb0 getty 2738 1 2738 0 Ss+ ttyin 0xfffff800273cf8b0 getty 2737 1 2737 0 Ss+ ttyin 0xfffff800273cfcb0 getty 2736 1 2736 0 Ss+ ttyin 0xfffff800273ce0b0 getty 2735 1 2735 0 Ss+ ttyin 0xfffff800273ce4b0 getty 2734 1 2734 0 Ss+ ttyin 0xfffff800273ce8b0 getty 2733 1 2733 0 Ss+ ttyin 0xfffff800273cecb0 getty 2732 1 2732 0 Ss+ ttyin 0xfffff800273cd0b0 getty 2731 1 2731 0 Ss+ ttyin 0xfffff800273cd4b0 getty 2717 1 2717 0 Ss nanslp 0xffffffff81eab821 cron 2713 1 2713 0 Ss select 0xfffff80004196e40 sshd 2694 1 2694 0 Ss select 0xfffff80004087240 inetd 2668 1 2668 123 Ss select 0xfffff80003da0ac0 ntpd 2642 1 2642 0 Ss select 0xfffff8002dc29140 powerd 2637 1 2637 0 Ss rpcsvc 0xfffff8000c167c60 NLM: master 2634 1 2634 0 Ss select 0xfffff800321c4140 rpc.statd 2609 1 2609 0 Ss select 0xfffff8002dc291c0 rpcbind 2587 1 2587 0 Ss nanslp 0xffffffff81eab825 watchdogd 2579 1 2579 0 Ss select 0xfffff8002dc29440 syslogd 2390 1 2390 0 Ss select 0xfffff80003ffe140 devd 2385 1 2385 65 Ss select 0xfffff8002dc294c0 dhclient 2326 1 2326 0 Ss select 0xfffff8000c10fdc0 dhclient 2323 1 2323 0 Ss select 0xfffff80003da0a40 dhclient 18 0 0 0 DL syncer 0xffffffff81f9c630 [syncer] 17 0 0 0 DL vlruwt 0xfffff80027509a90 [vnlru] 16 0 0 0 DL (threaded) [bufdaemon] 100197 D psleep 0xffffffff81f9b660 [bufdaemon] 100198 D - 0xffffffff81a0af40 [bufspacedaemon-0] 100199 D - 0xffffffff81a13200 [bufspacedaemon-1] 100200 D - 0xffffffff81a1b4c0 [bufspacedaemon-2] 100201 D - 0xffffffff81a23780 [bufspacedaemon-3] 100202 D - 0xffffffff81a2ba40 [bufspacedaemon-4] 100203 D - 0xffffffff81a33d00 [bufspacedaemon-5] 100204 D - 0xffffffff81a3bfc0 [bufspacedaemon-6] 100217 D sdflush 0xfffff800273d54e8 [/ worker] 100225 D sdflush 0xfffff800042568e8 [/tmp worker] 100338 D sdflush 0xfffff80003beace8 [/mnt worker] 9 0 0 0 DL psleep 0xffffffff81fc1390 [vmdaemon] 8 0 0 0 DL (threaded) [pagedaemon] 100195 D psleep 0xffffffff81fb57f8 [dom0] 100205 D launds 0xffffffff81fb5804 [laundry: dom0] 100206 D umarcl 0xffffffff80f61d80 [uma] 7 0 0 0 DL idle 0xfffff80003c25a90 [enc_daemon1] 6 0 0 0 DL idle 0xfffff80003c24000 [enc_daemon0] 5 0 0 0 DL - 0xffffffff81cdf1d8 [rand_harvestq] 15 0 0 0 DL (threaded) [usb] 100128 D - 0xfffffe010a192440 [usbus0] 100129 D - 0xfffffe010a192498 [usbus0] 100130 D - 0xfffffe010a1924f0 [usbus0] 100131 D - 0xfffffe010a192548 [usbus0] 100132 D - 0xfffffe010a1925a0 [usbus0] 100134 D - 0xfffffe00e4d66cf0 [usbus1] 100135 D - 0xfffffe00e4d66d48 [usbus1] 100136 D - 0xfffffe00e4d66da0 [usbus1] 100137 D - 0xfffffe00e4d66df8 [usbus1] 100138 D - 0xfffffe00e4d66e50 [usbus1] 100139 D - 0xfffffe010a554cf0 [usbus2] 100140 D - 0xfffffe010a554d48 [usbus2] 100141 D - 0xfffffe010a554da0 [usbus2] 100142 D - 0xfffffe010a554df8 [usbus2] 100143 D - 0xfffffe010a554e50 [usbus2] 4 0 0 0 DL (threaded) [cam] 100121 D - 0xffffffff81bc8fc0 [doneq0] 100122 D - 0xffffffff81bc9040 [doneq1] 100123 D - 0xffffffff81bc90c0 [doneq2] 100124 D - 0xffffffff81bc8f40 [async] 100152 D - 0xffffffff81bc8e10 [scanner] 14 0 0 0 DL seqstat 0xfffff80004408888 [sequencer 00] 3 0 0 0 DL (threaded) [crypto] 100107 D crypto_ 0xffffffff81fb2d20 [crypto] 100108 D crypto_ 0xfffff80004326c30 [crypto returns 0] 100109 D crypto_ 0xfffff80004326c80 [crypto returns 1] 100110 D crypto_ 0xfffff80004326cd0 [crypto returns 2] 100111 D crypto_ 0xfffff80004326d20 [crypto returns 3] 100112 D crypto_ 0xfffff80004326d70 [crypto returns 4] 100113 D crypto_ 0xfffff80004326dc0 [crypto returns 5] 100114 D crypto_ 0xfffff80004326e10 [crypto returns 6] 100115 D crypto_ 0xfffff80004326e60 [crypto returns 7] 100116 D crypto_ 0xfffff80004326eb0 [crypto returns 8] 100117 D crypto_ 0xfffff80004326f00 [crypto returns 9] 100118 D crypto_ 0xfffff80004326f50 [crypto returns 10] 100119 D crypto_ 0xfffff80004326fa0 [crypto returns 11] 13 0 0 0 DL (threaded) [geom] 100092 D - 0xffffffff81e8af90 [g_event] 100093 D - 0xffffffff81e8af98 [g_up] 100094 D - 0xffffffff81e8afa0 [g_down] 2 0 0 0 WL (threaded) [clock] 100078 I [clock (0)] 100079 I [clock (1)] 100080 I [clock (2)] 100081 I [clock (3)] 100082 I [clock (4)] 100083 I [clock (5)] 100084 I [clock (6)] 100085 I [clock (7)] 100086 I [clock (8)] 100087 I [clock (9)] 100088 I [clock (10)] 100089 I [clock (11)] 12 0 0 0 WL (threaded) [intr] 100043 I [swi5: fast taskq] 100048 I [swi6: task queue] 100049 I [swi6: Giant taskq] 100077 I [swi1: netisr 0] 100090 I [swi3: busdma] 100125 I [swi4: apei] 100126 I [irq56: ahci0] 100127 I [irq19: xhci0] 100133 I [irq18: ehci0 ehci1+] 100144 I [irq71: ahci1] 100145 I [swi0: uart uart] 100159 I [irq73: mlx5_core0] 100160 I [irq74: mlx5_core0] 100161 I [irq72: mlx5_core0] 100162 I [irq75: mlx5_core0] 100163 I [irq76: mlx5_core0] 100164 I [irq77: mlx5_core0] 100165 I [irq78: mlx5_core0] 100166 I [irq79: mlx5_core0] 100167 I [irq80: mlx5_core0] 100168 I [irq81: mlx5_core0] 100169 I [irq82: mlx5_core0] 100170 I [irq83: mlx5_core0] 100171 I [irq84: mlx5_core0] 100172 I [irq85: mlx5_core0] 100173 I [irq86: mlx5_core0] 100179 I [irq88: mlx5_core1] 100180 I [irq89: mlx5_core1] 100181 I [irq87: mlx5_core1] 100182 I [irq90: mlx5_core1] 100183 I [irq91: mlx5_core1] 100184 I [irq92: mlx5_core1] 100185 I [irq93: mlx5_core1] 100186 I [irq94: mlx5_core1] 100187 I [irq95: mlx5_core1] 100188 I [irq96: mlx5_core1] 100189 I [irq97: mlx5_core1] 100190 I [irq98: mlx5_core1] 100191 I [irq99: mlx5_core1] 100192 I [irq100: mlx5_core1] 100193 I [irq101: mlx5_core1] 100251 I [irq102: ioat0] 100252 I [irq103: ioat1] 100253 I [irq104: ioat2] 100254 I [irq105: ioat3] 100255 I [irq106: ioat4] 100256 I [irq107: ioat5] 100257 I [irq108: ioat6] 100258 I [irq109: ioat7] 11 0 0 0 RL (threaded) [idle] 100003 CanRun [idle: cpu0] 100004 CanRun [idle: cpu1] 100005 CanRun [idle: cpu2] 100006 CanRun [idle: cpu3] 100007 CanRun [idle: cpu4] 100008 CanRun [idle: cpu5] 100009 CanRun [idle: cpu6] 100010 CanRun [idle: cpu7] 100011 CanRun [idle: cpu8] 100012 CanRun [idle: cpu9] 100013 CanRun [idle: cpu10] 100014 CanRun [idle: cpu11] 1 0 1 0 SLs wait 0xfffff80003c23000 [init] 10 0 0 0 DL audit_w 0xffffffff81fb3230 [audit] 0 0 0 0 DLs (threaded) [kernel] 100000 D swapin 0xffffffff81e8b530 [swapper] 100015 D - 0xfffff80003a0d000 [softirq_0] 100016 D - 0xfffff80003a0cd00 [softirq_1] 100017 D - 0xfffff80003a0cb00 [softirq_2] 100018 D - 0xfffff80003a0c900 [softirq_3] 100019 D - 0xfffff80003a0c700 [softirq_4] 100020 D - 0xfffff80003a0c500 [softirq_5] 100021 D - 0xfffff80003a0c300 [softirq_6] 100022 D - 0xfffff80003a0c100 [softirq_7] 100023 D - 0xfffff80003a0be00 [softirq_8] 100024 D - 0xfffff80003a0bc00 [softirq_9] 100025 D - 0xfffff80003a0ba00 [softirq_10] 100026 D - 0xfffff80003a0b800 [softirq_11] 100027 D - 0xfffff80003a0b600 [if_io_tqg_0] 100028 D - 0xfffff80003a0b400 [if_io_tqg_1] 100029 D - 0xfffff80003a0b200 [if_io_tqg_2] 100030 D - 0xfffff80003a0b000 [if_io_tqg_3] 100031 D - 0xfffff80003a0ad00 [if_io_tqg_4] 100032 D - 0xfffff80003a0ab00 [if_io_tqg_5] 100033 D - 0xfffff80003a0a900 [if_io_tqg_6] 100034 D - 0xfffff80003a0a700 [if_io_tqg_7] 100035 D - 0xfffff80003a0a500 [if_io_tqg_8] 100036 D - 0xfffff80003a0a300 [if_io_tqg_9] 100037 D - 0xfffff80003a0a100 [if_io_tqg_10] 100038 D - 0xfffff80003bd4300 [if_io_tqg_11] 100039 D - 0xfffff80003bd4100 [if_config_tqg_0] 100040 D - 0xfffff80003bd5e00 [inm_free taskq] 100041 D - 0xfffff80003bd5c00 [deferred_unmount ta] 100042 D - 0xfffff80003bd5a00 [thread taskq] 100044 D - 0xfffff80003bd5600 [pci_hp taskq] 100045 D - 0xfffff80003bd5400 [linuxkpi_irq_wq] 100046 D - 0xfffff80003bd5200 [kqueue_ctx taskq] 100047 D - 0xfffff80003bd5000 [in6m_free taskq] 100050 D - 0xfffff80003bd6900 [aiod_kick taskq] 100051 D - 0xfffff80003bd6700 [linuxkpi_short_wq_0] 100052 D - 0xfffff80003bd6700 [linuxkpi_short_wq_1] 100053 D - 0xfffff80003bd6700 [linuxkpi_short_wq_2] 100054 D - 0xfffff80003bd6700 [linuxkpi_short_wq_3] 100055 D - 0xfffff80003bd6700 [linuxkpi_short_wq_4] 100056 D - 0xfffff80003bd6700 [linuxkpi_short_wq_5] 100057 D - 0xfffff80003bd6700 [linuxkpi_short_wq_6] 100058 D - 0xfffff80003bd6700 [linuxkpi_short_wq_7] 100059 D - 0xfffff80003bd6700 [linuxkpi_short_wq_8] 100060 D - 0xfffff80003bd6700 [linuxkpi_short_wq_9] 100061 D - 0xfffff80003bd6700 [linuxkpi_short_wq_1] 100062 D - 0xfffff80003bd6700 [linuxkpi_short_wq_1] 100063 D - 0xfffff80003bd6700 [linuxkpi_short_wq_1] 100064 D - 0xfffff80003bd7800 [linuxkpi_long_wq_0] 100065 D - 0xfffff80003bd7800 [linuxkpi_long_wq_1] 100066 D - 0xfffff80003bd7800 [linuxkpi_long_wq_2] 100067 D - 0xfffff80003bd7800 [linuxkpi_long_wq_3] 100068 D - 0xfffff80003bd7800 [linuxkpi_long_wq_4] 100069 D - 0xfffff80003bd7800 [linuxkpi_long_wq_5] 100070 D - 0xfffff80003bd7800 [linuxkpi_long_wq_6] 100071 D - 0xfffff80003bd7800 [linuxkpi_long_wq_7] 100072 D - 0xfffff80003bd7800 [linuxkpi_long_wq_8] 100073 D - 0xfffff80003bd7800 [linuxkpi_long_wq_9] 100074 D - 0xfffff80003bd7800 [linuxkpi_long_wq_10] 100075 D - 0xfffff80003bd7800 [linuxkpi_long_wq_11] 100076 D - 0xfffff80003bd7800 [linuxkpi_long_wq_12] 100091 D - 0xfffff80003eed600 [firmware taskq] 100095 D - 0xfffff80003eed100 [crypto_0] 100096 D - 0xfffff80003eed100 [crypto_1] 100097 D - 0xfffff80003eed100 [crypto_2] 100098 D - 0xfffff80003eed100 [crypto_3] 100099 D - 0xfffff80003eed100 [crypto_4] 100100 D - 0xfffff80003eed100 [crypto_5] 100101 D - 0xfffff80003eed100 [crypto_6] 100102 D - 0xfffff80003eed100 [crypto_7] 100103 D - 0xfffff80003eed100 [crypto_8] 100104 D - 0xfffff80003eed100 [crypto_9] 100105 D - 0xfffff80003eed100 [crypto_10] 100106 D - 0xfffff80003eed100 [crypto_11] 100147 D - 0xfffff800274b2d00 [acpi_task_0] 100148 D - 0xfffff800274b2d00 [acpi_task_1] 100149 D - 0xfffff800274b2d00 [acpi_task_2] 100150 D - 0xfffff80003a0e100 [mca taskq] 100151 D - 0xfffff80003eef400 [CAM taskq] 100155 D - 0xfffff800274b2600 [mlx5_core0-rec] 100156 D - 0xfffff800274b2400 [mlx5_core0-wdg] 100157 D - 0xfffff800274b2200 [mlx5_core0-cmd] 100158 D - 0xfffff800274b2000 [mlx5_page_allocator] 100174 D - 0xfffff800274b4d00 [mlx5_esw_wq] 100175 D - 0xfffff800274b4b00 [mlx5_core1-rec] 100176 D - 0xfffff800274b4900 [mlx5_core1-wdg] 100177 D - 0xfffff800274b4700 [mlx5_core1-cmd] 100178 D - 0xfffff800274b4500 [mlx5_page_allocator] 100194 D - 0xfffff80027548500 [mlx5_esw_wq] 4426 4423 3080 0 Z+ mkdir db:0:pho> allt Tracing command kernel pid 0 tid 100000 td 0xffffffff81e8ba80 sched_switch() at sched_switch+0x559/frame 0xffffffff8235ee00 mi_switch() at mi_switch+0x157/frame 0xffffffff8235ee20 sleepq_switch() at sleepq_switch+0x107/frame 0xffffffff8235ee60 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xffffffff8235eea0 _sleep() at _sleep+0x2ce/frame 0xffffffff8235ef40 swapper() at swapper+0x75/frame 0xffffffff8235efa0 mi_startup() at mi_startup+0x2f3/frame 0xffffffff8235eff0 btext() at btext+0x22 Tracing command kernel pid 0 tid 100015 td 0xfffffe00e4c62020 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4858de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4858e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4858e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4858ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4858ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4858f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4858f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100016 td 0xfffffe00e4c61900 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4853de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4853e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4853e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4853ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4853ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4853f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4853f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100017 td 0xfffffe00e4ce6720 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4862de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4862e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4862e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4862ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4862ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4862f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4862f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100018 td 0xfffffe00e4ce6000 sched_switch() at sched_switch+0x559/frame 0xfffffe00e485dde0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e485de00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e485de40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e485dec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e485def0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e485df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e485df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100019 td 0xfffffe00e4c69740 sched_switch() at sched_switch+0x559/frame 0xfffffe00e486cde0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e486ce00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e486ce40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e486cec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e486cef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e486cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e486cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xfffffe00e4c69020 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4867de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4867e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4867e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4867ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4867ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4867f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4867f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xfffffe00e4c68900 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4876de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4876e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4876e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4876ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4876ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4876f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4876f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xfffffe00e4c681e0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4871de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4871e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4871e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4871ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4871ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4871f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4871f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xfffffe00e4c67ac0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4880de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4880e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4880e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4880ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4880ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4880f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4880f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xfffffe00e4c673a0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e487bde0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e487be00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e487be40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e487bec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e487bef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e487bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e487bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xfffffe00e4cea020 sched_switch() at sched_switch+0x559/frame 0xfffffe00e488ade0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e488ae00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e488ae40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e488aec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e488aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e488af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e488af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100026 td 0xfffffe00e4ce9900 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4885de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4885e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4885e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4885ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4885ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4885f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4885f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100027 td 0xfffffe00e4ce91e0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4894de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4894e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4894e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4894ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4894ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4894f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4894f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100028 td 0xfffffe00e4ce8ac0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e488fde0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e488fe00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e488fe40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e488fec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e488fef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e488ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e488ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100029 td 0xfffffe00e4ce83a0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e489ede0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e489ee00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e489ee40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e489eec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e489eef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e489ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e489ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100030 td 0xfffffe00e4ce7c80 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4899de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4899e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4899e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4899ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4899ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4899f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4899f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100031 td 0xfffffe00e4ce7560 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48a8de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48a8e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48a8e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e48a8ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48a8ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48a8f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48a8f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100032 td 0xfffffe00e4ce6e40 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48a3de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48a3e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48a3e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e48a3ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48a3ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48a3f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48a3f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100033 td 0xfffffe00e4cf3ac0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48b2de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48b2e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48b2e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e48b2ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48b2ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48b2f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48b2f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100034 td 0xfffffe00e4cf33a0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48adde0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48ade00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48ade40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e48adec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48adef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48adf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48adf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100035 td 0xfffffe00e4cf2c80 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48bcde0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48bce00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48bce40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e48bcec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48bcef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48bcf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48bcf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100036 td 0xfffffe00e4cf2560 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48b7de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48b7e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48b7e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e48b7ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48b7ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48b7f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48b7f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100037 td 0xfffffe00e4cf1e40 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48c6de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48c6e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48c6e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e48c6ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48c6ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48c6f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48c6f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100038 td 0xfffffe00e4cf1720 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48c1de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48c1e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48c1e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e48c1ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48c1ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48c1f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48c1f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100039 td 0xfffffe00e4cf1000 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48d0de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48d0e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48d0e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e48d0ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48d0ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48d0f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48d0f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100040 td 0xfffffe00e4cea740 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48cbdc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48cbde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48cbe20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e48cbec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48cbef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48cbf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48cbf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100041 td 0xfffffe00e4cf9560 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48dadc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48dade0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48dae20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e48daec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48daef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48daf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48daf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100042 td 0xfffffe00e4cf8e40 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48d5dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48d5de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48d5e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e48d5ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48d5ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48d5f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48d5f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100044 td 0xfffffe00e4cf8000 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48dfdc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48dfde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48dfe20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e48dfec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48dfef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48dff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48dff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100045 td 0xfffffe00e4cf5740 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48eede0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48eee00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48eee40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e48eeec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe00e48eeef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48eef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48eef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100046 td 0xfffffe00e4cf5020 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48e9dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48e9de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48e9e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e48e9ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48e9ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48e9f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48e9f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100047 td 0xfffffe00e4cf4900 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48f8dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48f8de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48f8e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e48f8ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48f8ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48f8f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48f8f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100050 td 0xfffffe00e4cfc740 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48fddc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48fdde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48fde20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e48fdec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48fdef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48fdf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48fdf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100051 td 0xfffffe00e4cfc020 sched_switch() at sched_switch+0x559/frame 0xfffffe00e490cdc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e490cde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e490ce20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e490cec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e490cef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e490cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e490cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100052 td 0xfffffe00e4cfb900 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4907dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4907de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4907e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4907ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4907ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4907f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4907f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100053 td 0xfffffe00e4cfb1e0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4916dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4916de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4916e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4916ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4916ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4916f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4916f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100054 td 0xfffffe00e4cfaac0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4911dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4911de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4911e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4911ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4911ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4911f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4911f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100055 td 0xfffffe00e4cfa3a0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4920dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4920de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4920e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4920ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4920ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4920f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4920f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100056 td 0xfffffe00e4cf9c80 sched_switch() at sched_switch+0x559/frame 0xfffffe00e491bdc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e491bde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e491be20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e491bec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e491bef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e491bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e491bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100057 td 0xfffffe00e4d04900 sched_switch() at sched_switch+0x559/frame 0xfffffe00e492adc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e492ade0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e492ae20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e492aec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e492aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e492af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e492af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100058 td 0xfffffe00e4d041e0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4925dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4925de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4925e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4925ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4925ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4925f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4925f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100059 td 0xfffffe00e4d03ac0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4934dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4934de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4934e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4934ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4934ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4934f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4934f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100060 td 0xfffffe00e4d033a0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e492fdc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e492fde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e492fe20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e492fec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e492fef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e492ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e492ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100061 td 0xfffffe00e4d02c80 sched_switch() at sched_switch+0x559/frame 0xfffffe00e493edc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e493ede0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e493ee20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e493eec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e493eef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e493ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e493ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100062 td 0xfffffe00e4d02560 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4939dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4939de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4939e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4939ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4939ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4939f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4939f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100063 td 0xfffffe00e4d01e40 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4948dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4948de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4948e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4948ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4948ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4948f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4948f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100064 td 0xfffffe00e4d01720 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4943dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4943de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4943e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4943ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4943ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4943f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4943f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100065 td 0xfffffe00e4d0a3a0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4952dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4952de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4952e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4952ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4952ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4952f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4952f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100066 td 0xfffffe00e4d09c80 sched_switch() at sched_switch+0x559/frame 0xfffffe00e494ddc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e494dde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e494de20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e494dec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e494def0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e494df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e494df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100067 td 0xfffffe00e4d09560 sched_switch() at sched_switch+0x559/frame 0xfffffe00e495cdc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e495cde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e495ce20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e495cec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e495cef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e495cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e495cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100068 td 0xfffffe00e4d08e40 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4957dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4957de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4957e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4957ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4957ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4957f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4957f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100069 td 0xfffffe00e4d08720 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4966dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4966de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4966e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4966ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4966ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4966f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4966f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100070 td 0xfffffe00e4d08000 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4961dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4961de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4961e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4961ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4961ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4961f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4961f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100071 td 0xfffffe00e4d05740 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4970dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4970de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4970e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4970ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4970ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4970f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4970f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100072 td 0xfffffe00e4d05020 sched_switch() at sched_switch+0x559/frame 0xfffffe00e496bdc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e496bde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e496be20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e496bec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e496bef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e496bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e496bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100073 td 0xfffffe00e4d0de40 sched_switch() at sched_switch+0x559/frame 0xfffffe00e497adc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e497ade0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e497ae20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e497aec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e497aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e497af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e497af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100074 td 0xfffffe00e4d0d720 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4975dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4975de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4975e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4975ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4975ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4975f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4975f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100075 td 0xfffffe00e4d0d000 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4984dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4984de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4984e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4984ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4984ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4984f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4984f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100076 td 0xfffffe00e4d0c740 sched_switch() at sched_switch+0x559/frame 0xfffffe00e497fdc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e497fde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e497fe20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e497fec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e497fef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e497ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e497ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100091 td 0xfffffe00e4d17720 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e34dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e34de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e34e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e34ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e34ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e34f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e34f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100095 td 0xfffffe00e4d2ce40 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e48dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e48de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e48e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e48ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e48ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e48f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e48f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100096 td 0xfffffe00e4d2c720 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e43dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e43de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e43e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e43ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e43ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e43f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e43f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100097 td 0xfffffe00e4d2c000 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e52dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e52de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e52e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e52ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e52ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e52f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e52f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100098 td 0xfffffe00e4d1b740 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e4ddc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e4dde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e4de20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e4dec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e4def0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e4df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e4df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100099 td 0xfffffe00e4d1b020 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e5cdc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e5cde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e5ce20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e5cec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e5cef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e5cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e5cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100100 td 0xfffffe00e4d1a900 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e57dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e57de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e57e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e57ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e57ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e57f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e57f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100101 td 0xfffffe00e4d36720 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e66dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e66de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e66e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e66ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e66ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e66f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e66f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100102 td 0xfffffe00e4d36000 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e61dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e61de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e61e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e61ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e61ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e61f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e61f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100103 td 0xfffffe00e4d30740 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e70dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e70de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e70e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e70ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e70ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e70f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e70f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100104 td 0xfffffe00e4d30020 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e6bdc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e6bde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e6be20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e6bec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e6bef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e6bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e6bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100105 td 0xfffffe00e4d2f900 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e7adc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e7ade0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e7ae20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e7aec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e7aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e7af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e7af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100106 td 0xfffffe00e4d2f1e0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e75dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e75de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e75e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e75ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e75ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e75f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e75f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100147 td 0xfffffe010dc01c80 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4ffcde0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4ffce00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ffce40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4ffcec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe00e4ffcef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ffcf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ffcf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100148 td 0xfffffe010dc01560 sched_switch() at sched_switch+0x559/frame 0xfffffe010da3ede0 mi_switch() at mi_switch+0x157/frame 0xfffffe010da3ee00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da3ee40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe010da3eec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe010da3eef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da3ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da3ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100149 td 0xfffffe010dc00e40 sched_switch() at sched_switch+0x559/frame 0xfffffe010da39de0 mi_switch() at mi_switch+0x157/frame 0xfffffe010da39e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da39e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe010da39ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe010da39ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da39f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da39f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100150 td 0xfffffe010dc00720 sched_switch() at sched_switch+0x559/frame 0xfffffe010da48de0 mi_switch() at mi_switch+0x157/frame 0xfffffe010da48e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da48e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe010da48ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe010da48ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da48f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da48f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100151 td 0xfffffe010dc00000 sched_switch() at sched_switch+0x559/frame 0xfffffe010da43dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe010da43de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da43e20 _sleep() at _sleep+0x2e7/frame 0xfffffe010da43ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010da43ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da43f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da43f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100155 td 0xfffffe010a31d020 sched_switch() at sched_switch+0x559/frame 0xfffffe010da4ddc0 mi_switch() at mi_switch+0x157/frame 0xfffffe010da4dde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da4de20 _sleep() at _sleep+0x2e7/frame 0xfffffe010da4dec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010da4def0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da4df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da4df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100156 td 0xfffffe010ded6e40 sched_switch() at sched_switch+0x559/frame 0xfffffe010da66dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe010da66de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da66e20 _sleep() at _sleep+0x2e7/frame 0xfffffe010da66ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010da66ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da66f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da66f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100157 td 0xfffffe010ded6720 sched_switch() at sched_switch+0x559/frame 0xfffffe010da61dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe010da61de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da61e20 _sleep() at _sleep+0x2e7/frame 0xfffffe010da61ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010da61ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da61f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da61f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100158 td 0xfffffe010ded6000 sched_switch() at sched_switch+0x559/frame 0xfffffe010da70dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe010da70de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da70e20 _sleep() at _sleep+0x2e7/frame 0xfffffe010da70ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010da70ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da70f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da70f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100174 td 0xfffffe010dfcd3a0 sched_switch() at sched_switch+0x559/frame 0xfffffe010dac0dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe010dac0de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010dac0e20 _sleep() at _sleep+0x2e7/frame 0xfffffe010dac0ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010dac0ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010dac0f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010dac0f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100175 td 0xfffffe010dfccc80 sched_switch() at sched_switch+0x559/frame 0xfffffe010dabbdc0 mi_switch() at mi_switch+0x157/frame 0xfffffe010dabbde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010dabbe20 _sleep() at _sleep+0x2e7/frame 0xfffffe010dabbec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010dabbef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010dabbf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010dabbf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100176 td 0xfffffe010dfcc560 sched_switch() at sched_switch+0x559/frame 0xfffffe010dacadc0 mi_switch() at mi_switch+0x157/frame 0xfffffe010dacade0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010dacae20 _sleep() at _sleep+0x2e7/frame 0xfffffe010dacaec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010dacaef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010dacaf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010dacaf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100177 td 0xfffffe010dfcbe40 sched_switch() at sched_switch+0x559/frame 0xfffffe010dac5dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe010dac5de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010dac5e20 _sleep() at _sleep+0x2e7/frame 0xfffffe010dac5ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010dac5ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010dac5f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010dac5f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100178 td 0xfffffe010dfcb720 sched_switch() at sched_switch+0x559/frame 0xfffffe010dad4dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe010dad4de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010dad4e20 _sleep() at _sleep+0x2e7/frame 0xfffffe010dad4ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010dad4ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010dad4f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010dad4f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100194 td 0xfffffe010e1c1900 sched_switch() at sched_switch+0x559/frame 0xfffffe010db24dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe010db24de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db24e20 _sleep() at _sleep+0x2e7/frame 0xfffffe010db24ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010db24ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db24f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db24f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command init pid 1 tid 100002 td 0xfffffe00e4c60ac0 sched_switch() at sched_switch+0x559/frame 0xfffffe00377e1a10 mi_switch() at mi_switch+0x157/frame 0xfffffe00377e1a30 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00377e1a70 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe00377e1ac0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00377e1ad0 _sleep() at _sleep+0x2dd/frame 0xfffffe00377e1b70 kern_wait6() at kern_wait6+0x474/frame 0xfffffe00377e1c00 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe00377e1e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe00377e1f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00377e1f30 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x28e8da, rsp = 0x820574598, rbp = 0x820574600 --- Tracing command clock pid 2 tid 100078 td 0xfffffe00e4d11020 sched_switch() at sched_switch+0x559/frame 0xfffffe00e49b9ea0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e49b9ec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe00e49b9ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49b9f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49b9f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command clock pid 2 tid 100079 td 0xfffffe00e4d10900 sched_switch() at sched_switch+0x559/frame 0xfffffe00e49c8ea0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e49c8ec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe00e49c8ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49c8f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49c8f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command clock pid 2 tid 100080 td 0xfffffe00e4d101e0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e49c3ea0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e49c3ec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe00e49c3ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49c3f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49c3f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command clock pid 2 tid 100081 td 0xfffffe00e4d0fac0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e49d2ea0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e49d2ec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe00e49d2ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49d2f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49d2f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command clock pid 2 tid 100082 td 0xfffffe00e4d0f3a0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e49cdea0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e49cdec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe00e49cdef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49cdf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49cdf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command clock pid 2 tid 100083 td 0xfffffe00e4d0ec80 sched_switch() at sched_switch+0x559/frame 0xfffffe00e49dcea0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e49dcec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe00e49dcef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49dcf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49dcf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command clock pid 2 tid 100084 td 0xfffffe00e4d0e560 fork_trampoline() at fork_trampoline Tracing command clock pid 2 tid 100085 td 0xfffffe00e4d1a1e0 fork_trampoline() at fork_trampoline Tracing command clock pid 2 tid 100086 td 0xfffffe00e4d19ac0 fork_trampoline() at fork_trampoline Tracing command clock pid 2 tid 100087 td 0xfffffe00e4d193a0 fork_trampoline() at fork_trampoline Tracing command clock pid 2 tid 100088 td 0xfffffe00e4d18c80 fork_trampoline() at fork_trampoline Tracing command clock pid 2 tid 100089 td 0xfffffe00e4d18560 fork_trampoline() at fork_trampoline Tracing command crypto pid 3 tid 100107 td 0xfffffe00e4d2eac0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e84db0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e84dd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e84e10 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e84eb0 crypto_dispatch_thread() at crypto_dispatch_thread+0xbf/frame 0xfffffe00e4e84ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e84f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e84f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100108 td 0xfffffe00e4d2e3a0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e7fdb0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e7fdd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e7fe10 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e7feb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4e7fef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e7ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e7ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100109 td 0xfffffe00e4d3a020 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e8edb0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e8edd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e8ee10 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e8eeb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4e8eef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e8ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e8ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100110 td 0xfffffe00e4d39900 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e89db0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e89dd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e89e10 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e89eb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4e89ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e89f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e89f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100111 td 0xfffffe00e4d391e0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e98db0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e98dd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e98e10 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e98eb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4e98ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e98f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e98f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100112 td 0xfffffe00e4d38ac0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e93db0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e93dd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e93e10 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e93eb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4e93ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e93f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e93f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100113 td 0xfffffe00e4d383a0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4ea2db0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4ea2dd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ea2e10 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4ea2eb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4ea2ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ea2f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ea2f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100114 td 0xfffffe00e4d37c80 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e9ddb0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e9ddd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e9de10 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e9deb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4e9def0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e9df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e9df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100115 td 0xfffffe00e4d37560 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4eacdb0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4eacdd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4eace10 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4eaceb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4eacef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4eacf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4eacf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100116 td 0xfffffe00e4d36e40 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4ea7db0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4ea7dd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ea7e10 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4ea7eb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4ea7ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ea7f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ea7f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100117 td 0xfffffe00e4d3dac0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4eb6db0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4eb6dd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4eb6e10 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4eb6eb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4eb6ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4eb6f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4eb6f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100118 td 0xfffffe00e4d3d3a0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4eb1db0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4eb1dd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4eb1e10 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4eb1eb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4eb1ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4eb1f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4eb1f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100119 td 0xfffffe00e4d3cc80 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4ec0db0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4ec0dd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ec0e10 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4ec0eb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4ec0ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ec0f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ec0f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 4 tid 100121 td 0xfffffe00e4d3be40 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4ecada0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4ecadc0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ecae00 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4ecaea0 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe00e4ecaef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ecaf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ecaf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 4 tid 100122 td 0xfffffe00e4d3b720 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4ec5da0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4ec5dc0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ec5e00 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4ec5ea0 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe00e4ec5ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ec5f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ec5f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 4 tid 100123 td 0xfffffe00e4d3b000 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4ed4da0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4ed4dc0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ed4e00 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4ed4ea0 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe00e4ed4ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ed4f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ed4f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 4 tid 100124 td 0xfffffe00e4d3a740 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4ecfda0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4ecfdc0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ecfe00 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4ecfea0 xpt_async_td() at xpt_async_td+0x74/frame 0xfffffe00e4ecfef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ecff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ecff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 4 tid 100152 td 0xfffffe010a31d740 sched_switch() at sched_switch+0x559/frame 0xfffffe010da52dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe010da52de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da52e20 _sleep() at _sleep+0x2e7/frame 0xfffffe010da52ec0 xpt_scanner_thread() at xpt_scanner_thread+0x154/frame 0xfffffe010da52ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da52f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da52f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command rand_harvestq pid 5 tid 100146 td 0xfffffe010dc023a0 sched_switch() at sched_switch+0x559/frame 0xfffffe010da34d20 mi_switch() at mi_switch+0x157/frame 0xfffffe010da34d40 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da34d80 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010da34dc0 _sleep() at _sleep+0x2ce/frame 0xfffffe010da34e60 random_kthread() at random_kthread+0xa7/frame 0xfffffe010da34ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da34f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da34f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon0 pid 6 tid 100153 td 0xfffffe00e4d0c020 sched_switch() at sched_switch+0x559/frame 0xfffffe010da5cd80 mi_switch() at mi_switch+0x157/frame 0xfffffe010da5cda0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da5cde0 _sleep() at _sleep+0x2e7/frame 0xfffffe010da5ce80 enc_daemon() at enc_daemon+0xeb/frame 0xfffffe010da5cef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da5cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da5cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon1 pid 7 tid 100154 td 0xfffffe00e4d0b900 sched_switch() at sched_switch+0x559/frame 0xfffffe010da57d80 mi_switch() at mi_switch+0x157/frame 0xfffffe010da57da0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da57de0 _sleep() at _sleep+0x2e7/frame 0xfffffe010da57e80 enc_daemon() at enc_daemon+0xeb/frame 0xfffffe010da57ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da57f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da57f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 8 tid 100195 td 0xfffffe010e1c11e0 sched_switch() at sched_switch+0x559/frame 0xfffffe010db1fab0 mi_switch() at mi_switch+0x157/frame 0xfffffe010db1fad0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db1fb10 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db1fb50 _sleep() at _sleep+0x2ce/frame 0xfffffe010db1fbf0 vm_pageout_worker() at vm_pageout_worker+0x28c/frame 0xfffffe010db1feb0 vm_pageout() at vm_pageout+0x1d7/frame 0xfffffe010db1fef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db1ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db1ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 8 tid 100205 td 0xfffffe00e4d7a3a0 sched_switch() at sched_switch+0x559/frame 0xfffffe010db5db70 mi_switch() at mi_switch+0x157/frame 0xfffffe010db5db90 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db5dbd0 _sleep() at _sleep+0x2e7/frame 0xfffffe010db5dc70 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0xb83/frame 0xfffffe010db5def0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db5df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db5df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 8 tid 100206 td 0xfffffe00e4d79c80 sched_switch() at sched_switch+0x559/frame 0xfffffe010db58d80 mi_switch() at mi_switch+0x157/frame 0xfffffe010db58da0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db58de0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db58e20 _sleep() at _sleep+0x2ce/frame 0xfffffe010db58ec0 uma_reclaim_worker() at uma_reclaim_worker+0xc8/frame 0xfffffe010db58ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db58f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db58f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vmdaemon pid 9 tid 100196 td 0xfffffe010e1c0ac0 sched_switch() at sched_switch+0x559/frame 0xfffffe010db2ed80 mi_switch() at mi_switch+0x157/frame 0xfffffe010db2eda0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db2ede0 _sleep() at _sleep+0x2e7/frame 0xfffffe010db2ee80 vm_daemon() at vm_daemon+0x92/frame 0xfffffe010db2eef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db2ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db2ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command audit pid 10 tid 100001 td 0xfffffe00e4c611e0 sched_switch() at sched_switch+0x559/frame 0xfffffe00377e6dd0 mi_switch() at mi_switch+0x157/frame 0xfffffe00377e6df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00377e6e30 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00377e6e90 audit_worker() at audit_worker+0x9f/frame 0xfffffe00377e6ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377e6f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377e6f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100003 td 0xfffffe00e4c603a0 sched_switch() at sched_switch+0x559/frame 0xfffffe00377f0e30 mi_switch() at mi_switch+0x157/frame 0xfffffe00377f0e50 sched_idletd() at sched_idletd+0xa1/frame 0xfffffe00377f0ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377f0f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377f0f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffffe00e4c5fc80 sched_switch() at sched_switch+0x559/frame 0xfffffe00377ebe30 mi_switch() at mi_switch+0x157/frame 0xfffffe00377ebe50 sched_idletd() at sched_idletd+0xa1/frame 0xfffffe00377ebef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377ebf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377ebf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffffe00e4c5f560 sched_switch() at sched_switch+0x559/frame 0xfffffe00377fae30 mi_switch() at mi_switch+0x157/frame 0xfffffe00377fae50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00377faef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377faf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377faf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffffe00e4c5ee40 sched_switch() at sched_switch+0x559/frame 0xfffffe00377f5e30 mi_switch() at mi_switch+0x157/frame 0xfffffe00377f5e50 sched_idletd() at sched_idletd+0xa1/frame 0xfffffe00377f5ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377f5f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377f5f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffffe00e4c5e720 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4830e30 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4830e50 sched_idletd() at sched_idletd+0xa1/frame 0xfffffe00e4830ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4830f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4830f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffffe00e4c5e000 sched_switch() at sched_switch+0x559/frame 0xfffffe00377ffe30 mi_switch() at mi_switch+0x157/frame 0xfffffe00377ffe50 sched_idletd() at sched_idletd+0xa1/frame 0xfffffe00377ffef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377fff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377fff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffffe00e4c66c80 sched_switch() at sched_switch+0x559/frame 0xfffffe00e483ae30 mi_switch() at mi_switch+0x157/frame 0xfffffe00e483ae50 sched_idletd() at sched_idletd+0xa1/frame 0xfffffe00e483aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e483af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e483af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffffe00e4c66560 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4835e30 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4835e50 sched_idletd() at sched_idletd+0xa1/frame 0xfffffe00e4835ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4835f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4835f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffffe00e4c65e40 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4844e30 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4844e50 sched_idletd() at sched_idletd+0xa1/frame 0xfffffe00e4844ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4844f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4844f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffffe00e4c65720 sched_switch() at sched_switch+0x559/frame 0xfffffe00e483fe30 mi_switch() at mi_switch+0x157/frame 0xfffffe00e483fe50 sched_idletd() at sched_idletd+0xa1/frame 0xfffffe00e483fef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e483ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e483ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffffe00e4c65000 sched_switch() at sched_switch+0x559/frame 0xfffffe00e484ee30 mi_switch() at mi_switch+0x157/frame 0xfffffe00e484ee50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00e484eef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e484ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e484ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffffe00e4c62740 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4849e30 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4849e50 sched_idletd() at sched_idletd+0xa1/frame 0xfffffe00e4849ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4849f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4849f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100043 td 0xfffffe00e4cf8720 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100048 td 0xfffffe00e4cf41e0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48f3e40 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48f3e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e48f3ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48f3f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48f3f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100049 td 0xfffffe00e4d01000 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4902e40 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4902e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4902ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4902f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4902f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100077 td 0xfffffe00e4d11740 sched_switch() at sched_switch+0x559/frame 0xfffffe00e49bee40 mi_switch() at mi_switch+0x157/frame 0xfffffe00e49bee60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e49beef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49bef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49bef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100090 td 0xfffffe00e4d17e40 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100125 td 0xfffffe00e4d79560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100126 td 0xfffffe00e4d78e40 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4ed9e40 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4ed9e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4ed9ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ed9f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ed9f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100127 td 0xfffffe00e4d78720 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4ee8e40 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4ee8e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4ee8ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ee8f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ee8f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100133 td 0xfffffe010a319000 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4f06e40 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f06e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4f06ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f06f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f06f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100144 td 0xfffffe010a31a560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100145 td 0xfffffe010a319e40 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4f5ae40 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f5ae60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4f5aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f5af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f5af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100159 td 0xfffffe010dc04740 sched_switch() at sched_switch+0x559/frame 0xfffffe010da6be40 mi_switch() at mi_switch+0x157/frame 0xfffffe010da6be60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe010da6bef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da6bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da6bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100160 td 0xfffffe010dc04020 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100161 td 0xfffffe010dc03900 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100162 td 0xfffffe010dc031e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100163 td 0xfffffe010dc02ac0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100164 td 0xfffffe010deda740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100165 td 0xfffffe010deda020 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100166 td 0xfffffe010ded9900 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100167 td 0xfffffe010ded91e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100168 td 0xfffffe010ded8ac0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100169 td 0xfffffe010ded83a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100170 td 0xfffffe010ded7c80 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100171 td 0xfffffe010ded7560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100172 td 0xfffffe010dfce1e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100173 td 0xfffffe010dfcdac0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100179 td 0xfffffe010dfcb000 sched_switch() at sched_switch+0x559/frame 0xfffffe010dacfe40 mi_switch() at mi_switch+0x157/frame 0xfffffe010dacfe60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe010dacfef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010dacff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010dacff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100180 td 0xfffffe00e4d0b1e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100181 td 0xfffffe00e4d0aac0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100182 td 0xfffffe010e1bfc80 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100183 td 0xfffffe010e1bf560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100184 td 0xfffffe010e1bee40 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100185 td 0xfffffe010e1be720 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100186 td 0xfffffe010e1be000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100187 td 0xfffffe010dfcf740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100188 td 0xfffffe010dfcf020 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100189 td 0xfffffe010dfce900 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100190 td 0xfffffe010e223720 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100191 td 0xfffffe010e223000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100192 td 0xfffffe010e1c2740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100193 td 0xfffffe010e1c2020 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100251 td 0xfffffe01435f8ac0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100252 td 0xfffffe01435f83a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100253 td 0xfffffe01437f3560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100254 td 0xfffffe01437f2e40 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100255 td 0xfffffe01437f2720 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100256 td 0xfffffe01437f2000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100257 td 0xfffffe014366d740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100258 td 0xfffffe014366d020 fork_trampoline() at fork_trampoline Tracing command geom pid 13 tid 100092 td 0xfffffe00e4d17000 sched_switch() at sched_switch+0x559/frame 0xfffffe00e49ffdc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e49ffde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e49ffe20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e49ffec0 g_run_events() at g_run_events+0x444/frame 0xfffffe00e49ffef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49fff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49fff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100093 td 0xfffffe00e4d2dc80 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e3edb0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e3edd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e3ee10 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e3eeb0 g_io_schedule_up() at g_io_schedule_up+0x3c/frame 0xfffffe00e4e3eee0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe00e4e3eef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e3ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e3ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100094 td 0xfffffe00e4d2d560 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e39db0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e39dd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e39e10 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e39eb0 g_io_schedule_down() at g_io_schedule_down+0x4c/frame 0xfffffe00e4e39ee0 g_down_procbody() at g_down_procbody+0x5c/frame 0xfffffe00e4e39ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e39f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e39f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sequencer 00 pid 14 tid 100120 td 0xfffffe00e4d3c560 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4ebbdb0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4ebbdd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ebbe10 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4ebbe70 seq_eventthread() at seq_eventthread+0x8c/frame 0xfffffe00e4ebbef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ebbf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ebbf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100128 td 0xfffffe00e4d78000 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4ee3e00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4ee3e20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ee3e60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4ee3ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4ee3ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ee3f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ee3f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100129 td 0xfffffe00e4d3f740 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4ef2e00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4ef2e20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ef2e60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4ef2ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4ef2ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ef2f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ef2f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100130 td 0xfffffe00e4d3f020 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4eede00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4eede20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4eede60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4eedec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4eedef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4eedf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4eedf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100131 td 0xfffffe00e4d3e900 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4efce00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4efce20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4efce60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4efcec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4efcef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4efcf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4efcf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100132 td 0xfffffe00e4d3e1e0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4ef7e00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4ef7e20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ef7e60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4ef7ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4ef7ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ef7f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ef7f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100134 td 0xfffffe00e4d7c740 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4f01e00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f01e20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f01e60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4f01ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f01ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f01f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f01f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100135 td 0xfffffe00e4d7c020 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4f10e00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f10e20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f10e60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4f10ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f10ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f10f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f10f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100136 td 0xfffffe00e4d7b900 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4f0be00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f0be20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f0be60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4f0bec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f0bef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f0bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f0bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100137 td 0xfffffe00e4d7b1e0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4f1ae00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f1ae20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f1ae60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4f1aec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f1aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f1af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f1af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100138 td 0xfffffe00e4d7aac0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4f15e00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f15e20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f15e60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4f15ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f15ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f15f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f15f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100139 td 0xfffffe010a31c900 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4f3ce00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f3ce20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f3ce60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4f3cec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f3cef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f3cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f3cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100140 td 0xfffffe010a31c1e0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4f37e00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f37e20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f37e60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4f37ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f37ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f37f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f37f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100141 td 0xfffffe010a31bac0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4f46e00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f46e20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f46e60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4f46ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f46ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f46f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f46f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100142 td 0xfffffe010a31b3a0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4f41e00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f41e20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f41e60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4f41ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f41ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f41f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f41f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100143 td 0xfffffe010a31ac80 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4f50e00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f50e20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f50e60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4f50ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f50ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f50f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f50f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 16 tid 100197 td 0xfffffe010e1c03a0 sched_switch() at sched_switch+0x559/frame 0xfffffe010db29d60 mi_switch() at mi_switch+0x157/frame 0xfffffe010db29d80 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db29dc0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db29e00 _sleep() at _sleep+0x2ce/frame 0xfffffe010db29ea0 buf_daemon() at buf_daemon+0x121/frame 0xfffffe010db29ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db29f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db29f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 16 tid 100198 td 0xfffffe010a319720 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4f55d40 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f55d60 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f55da0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e4f55de0 _sleep() at _sleep+0x2ce/frame 0xfffffe00e4f55e80 bufspace_daemon() at bufspace_daemon+0x312/frame 0xfffffe00e4f55ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f55f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f55f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 16 tid 100199 td 0xfffffe010e227020 sched_switch() at sched_switch+0x559/frame 0xfffffe010db38d40 mi_switch() at mi_switch+0x157/frame 0xfffffe010db38d60 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db38da0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db38de0 _sleep() at _sleep+0x2ce/frame 0xfffffe010db38e80 bufspace_daemon() at bufspace_daemon+0x312/frame 0xfffffe010db38ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db38f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db38f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 16 tid 100200 td 0xfffffe010e226900 sched_switch() at sched_switch+0x559/frame 0xfffffe010db33d40 mi_switch() at mi_switch+0x157/frame 0xfffffe010db33d60 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db33da0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db33de0 _sleep() at _sleep+0x2ce/frame 0xfffffe010db33e80 bufspace_daemon() at bufspace_daemon+0x312/frame 0xfffffe010db33ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db33f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db33f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 16 tid 100201 td 0xfffffe010e2261e0 sched_switch() at sched_switch+0x559/frame 0xfffffe010db49d40 mi_switch() at mi_switch+0x157/frame 0xfffffe010db49d60 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db49da0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db49de0 _sleep() at _sleep+0x2ce/frame 0xfffffe010db49e80 bufspace_daemon() at bufspace_daemon+0x312/frame 0xfffffe010db49ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db49f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db49f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 16 tid 100202 td 0xfffffe010e225ac0 sched_switch() at sched_switch+0x559/frame 0xfffffe010ef0bd40 mi_switch() at mi_switch+0x157/frame 0xfffffe010ef0bd60 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010ef0bda0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010ef0bde0 _sleep() at _sleep+0x2ce/frame 0xfffffe010ef0be80 bufspace_daemon() at bufspace_daemon+0x312/frame 0xfffffe010ef0bef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010ef0bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010ef0bf30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command bufdaemon pid 16 tid 100203 td 0xfffffe010e2253a0 sched_switch() at sched_switch+0x559/frame 0xfffffe010db53d40 mi_switch() at mi_switch+0x157/frame 0xfffffe010db53d60 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db53da0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db53de0 _sleep() at _sleep+0x2ce/frame 0xfffffe010db53e80 bufspace_daemon() at bufspace_daemon+0x312/frame 0xfffffe010db53ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db53f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db53f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 16 tid 100204 td 0xfffffe010e224c80 sched_switch() at sched_switch+0x559/frame 0xfffffe010db4ed40 mi_switch() at mi_switch+0x157/frame 0xfffffe010db4ed60 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db4eda0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db4ede0 _sleep() at _sleep+0x2ce/frame 0xfffffe010db4ee80 bufspace_daemon() at bufspace_daemon+0x312/frame 0xfffffe010db4eef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db4ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db4ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 16 tid 100217 td 0xfffffe010e7e7740 sched_switch() at sched_switch+0x559/frame 0xfffffe014178cd70 mi_switch() at mi_switch+0x157/frame 0xfffffe014178cd90 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe014178cdd0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe014178ce10 _sleep() at _sleep+0x2ce/frame 0xfffffe014178ceb0 softdep_flush() at softdep_flush+0x188/frame 0xfffffe014178cef0 fork_exit() at fork_exit+0x80/frame 0xfffffe014178cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe014178cf30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command bufdaemon pid 16 tid 100225 td 0xfffffe01435f7c80 sched_switch() at sched_switch+0x559/frame 0xfffffe01417ccd70 mi_switch() at mi_switch+0x157/frame 0xfffffe01417ccd90 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01417ccdd0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe01417cce10 _sleep() at _sleep+0x2ce/frame 0xfffffe01417cceb0 softdep_flush() at softdep_flush+0x188/frame 0xfffffe01417ccef0 fork_exit() at fork_exit+0x80/frame 0xfffffe01417ccf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01417ccf30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command bufdaemon pid 16 tid 100338 td 0xfffffe01445ab020 sched_switch() at sched_switch+0x559/frame 0xfffffe014398ed70 mi_switch() at mi_switch+0x157/frame 0xfffffe014398ed90 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe014398edd0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe014398ee10 _sleep() at _sleep+0x2ce/frame 0xfffffe014398eeb0 softdep_flush() at softdep_flush+0x188/frame 0xfffffe014398eef0 fork_exit() at fork_exit+0x80/frame 0xfffffe014398ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe014398ef30 --- trap 0xc, rip = 0x824c5731a, rsp = 0x8389aef48, rbp = 0x8389aef60 --- Tracing command vnlru pid 17 tid 100207 td 0xfffffe010e5e6ac0 sched_switch() at sched_switch+0x559/frame 0xfffffe014173ad10 mi_switch() at mi_switch+0x157/frame 0xfffffe014173ad30 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe014173ad70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe014173adb0 _sleep() at _sleep+0x2ce/frame 0xfffffe014173ae50 vnlru_proc() at vnlru_proc+0x9fc/frame 0xfffffe014173aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe014173af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe014173af30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command syncer pid 18 tid 100208 td 0xfffffe010e5e63a0 sched_switch() at sched_switch+0x559/frame 0xfffffe0141735d40 mi_switch() at mi_switch+0x157/frame 0xfffffe0141735d60 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0141735da0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0141735de0 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x19a/frame 0xfffffe0141735e60 sched_sync() at sched_sync+0x63d/frame 0xfffffe0141735ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe0141735f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0141735f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command dhclient pid 2323 tid 100213 td 0xfffffe010e60a740 sched_switch() at sched_switch+0x559/frame 0xfffffe0141755ab0 mi_switch() at mi_switch+0x157/frame 0xfffffe0141755ad0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0141755b10 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0141755b60 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0141755b70 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe0141755bd0 kern_select() at kern_select+0xa95/frame 0xfffffe0141755dc0 sys_select() at sys_select+0x56/frame 0xfffffe0141755e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0141755f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141755f30 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x279747f2977a, rsp = 0x27974444af18, rbp = 0x27974444afd0 --- Tracing command dhclient pid 2326 tid 100235 td 0xfffffe0143511000 sched_switch() at sched_switch+0x559/frame 0xfffffe010db6cae0 mi_switch() at mi_switch+0x157/frame 0xfffffe010db6cb00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db6cb40 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe010db6cb90 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe010db6cba0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe010db6cc00 kern_poll_kfds() at kern_poll_kfds+0x4bc/frame 0xfffffe010db6cc90 kern_poll() at kern_poll+0x9f/frame 0xfffffe010db6cde0 sys_poll() at sys_poll+0x50/frame 0xfffffe010db6ce00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe010db6cf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010db6cf30 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x279747f2967a, rsp = 0x27974444b158, rbp = 0x27974444b190 --- Tracing command dhclient pid 2385 tid 100272 td 0xfffffe010e5e4720 sched_switch() at sched_switch+0x559/frame 0xfffffe01438ada90 mi_switch() at mi_switch+0x157/frame 0xfffffe01438adab0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01438adaf0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01438adb40 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe01438adb80 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x19a/frame 0xfffffe01438adc00 kern_poll_kfds() at kern_poll_kfds+0x485/frame 0xfffffe01438adc90 kern_poll() at kern_poll+0x9f/frame 0xfffffe01438adde0 sys_poll() at sys_poll+0x50/frame 0xfffffe01438ade00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe01438adf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01438adf30 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x279747f2967a, rsp = 0x27974444b158, rbp = 0x27974444b190 --- Tracing command devd pid 2390 tid 100218 td 0xfffffe010e7cbc80 sched_switch() at sched_switch+0x559/frame 0xfffffe0141769a60 mi_switch() at mi_switch+0x157/frame 0xfffffe0141769a80 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0141769ac0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0141769b10 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe0141769b50 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x19a/frame 0xfffffe0141769bd0 kern_select() at kern_select+0xa6f/frame 0xfffffe0141769dc0 sys_select() at sys_select+0x56/frame 0xfffffe0141769e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0141769f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141769f30 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x28b20a, rsp = 0x8204dc788, rbp = 0x8204de920 --- Tracing command syslogd pid 2579 tid 100269 td 0xfffffe010e7e61e0 sched_switch() at sched_switch+0x559/frame 0xfffffe0141791ab0 mi_switch() at mi_switch+0x157/frame 0xfffffe0141791ad0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0141791b10 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0141791b60 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0141791b70 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe0141791bd0 kern_select() at kern_select+0xa95/frame 0xfffffe0141791dc0 sys_select() at sys_select+0x56/frame 0xfffffe0141791e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0141791f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141791f30 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0xac926b9777a, rsp = 0xac92478a948, rbp = 0xac92478aed0 --- Tracing command watchdogd pid 2587 tid 100270 td 0xfffffe010e223e40 sched_switch() at sched_switch+0x559/frame 0xfffffe0143879bb0 mi_switch() at mi_switch+0x157/frame 0xfffffe0143879bd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0143879c10 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0143879c60 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe0143879ca0 _sleep() at _sleep+0x2bf/frame 0xfffffe0143879d40 kern_clock_nanosleep() at kern_clock_nanosleep+0x1d1/frame 0xfffffe0143879dc0 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe0143879e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0143879f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0143879f30 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x2ed03bc625fa, rsp = 0x2ed0398eb798, rbp = 0x2ed0398eb7e0 --- Tracing command rpcbind pid 2609 tid 100249 td 0xfffffe014366bac0 sched_switch() at sched_switch+0x559/frame 0xfffffe010dbd5a90 mi_switch() at mi_switch+0x157/frame 0xfffffe010dbd5ab0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010dbd5af0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe010dbd5b40 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe010dbd5b80 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x19a/frame 0xfffffe010dbd5c00 kern_poll_kfds() at kern_poll_kfds+0x485/frame 0xfffffe010dbd5c90 kern_poll() at kern_poll+0x9f/frame 0xfffffe010dbd5de0 sys_poll() at sys_poll+0x50/frame 0xfffffe010dbd5e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe010dbd5f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010dbd5f30 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x36924e89467a, rsp = 0x36924b8f4ef8, rbp = 0x36924b8f7120 --- Tracing command rpc.statd pid 2634 tid 100276 td 0xfffffe010e61de40 sched_switch() at sched_switch+0x559/frame 0xfffffe01438d0a60 mi_switch() at mi_switch+0x157/frame 0xfffffe01438d0a80 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01438d0ac0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01438d0b10 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe01438d0b50 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x19a/frame 0xfffffe01438d0bd0 kern_select() at kern_select+0xa6f/frame 0xfffffe01438d0dc0 sys_select() at sys_select+0x56/frame 0xfffffe01438d0e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe01438d0f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01438d0f30 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x2fd8cd52777a, rsp = 0x2fd8cbb7ab98, rbp = 0x2fd8cbb7ace0 --- Tracing command rpc.lockd pid 2637 tid 100281 td 0xfffffe01440af900 sched_switch() at sched_switch+0x559/frame 0xfffffe01438ee990 mi_switch() at mi_switch+0x157/frame 0xfffffe01438ee9b0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01438ee9f0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01438eea40 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe01438eea80 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x19a/frame 0xfffffe01438eeb00 svc_run_internal() at svc_run_internal+0xada/frame 0xfffffe01438eec30 svc_run() at svc_run+0x230/frame 0xfffffe01438eec90 sys_nlm_syscall() at sys_nlm_syscall+0x6fa/frame 0xfffffe01438eee00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe01438eef30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01438eef30 --- syscall (154, FreeBSD ELF64, sys_nlm_syscall), rip = 0x1e95e6c5deba, rsp = 0x1e95e3005578, rbp = 0x1e95e3005640 --- Tracing command powerd pid 2642 tid 100278 td 0xfffffe014366a560 sched_switch() at sched_switch+0x559/frame 0xfffffe0143899a60 mi_switch() at mi_switch+0x157/frame 0xfffffe0143899a80 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0143899ac0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0143899b10 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe0143899b50 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x19a/frame 0xfffffe0143899bd0 kern_select() at kern_select+0xa6f/frame 0xfffffe0143899dc0 sys_select() at sys_select+0x56/frame 0xfffffe0143899e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0143899f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0143899f30 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x19c320a3777a, rsp = 0x19c31df2f3c8, rbp = 0x19c31df2f500 --- Tracing command ntpd pid 2668 tid 100246 td 0xfffffe01435f91e0 sched_switch() at sched_switch+0x559/frame 0xfffffe010dbb2ab0 mi_switch() at mi_switch+0x157/frame 0xfffffe010dbb2ad0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010dbb2b10 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe010dbb2b60 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe010dbb2b70 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe010dbb2bd0 kern_select() at kern_select+0xa95/frame 0xfffffe010dbb2dc0 sys_select() at sys_select+0x56/frame 0xfffffe010dbb2e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe010dbb2f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010dbb2f30 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x1498a3b1f77a, rsp = 0x1498a0a4f938, rbp = 0x1498a0a4f970 --- Tracing command inetd pid 2694 tid 100280 td 0xfffffe010e7e4c80 sched_switch() at sched_switch+0x559/frame 0xfffffe01438e4ab0 mi_switch() at mi_switch+0x157/frame 0xfffffe01438e4ad0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01438e4b10 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01438e4b60 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01438e4b70 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe01438e4bd0 kern_select() at kern_select+0xa95/frame 0xfffffe01438e4dc0 sys_select() at sys_select+0x56/frame 0xfffffe01438e4e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe01438e4f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01438e4f30 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x325038977a, rsp = 0x324cc83e48, rbp = 0x324cc84ce0 --- Tracing command sshd pid 2713 tid 100228 td 0xfffffe010e7e3000 sched_switch() at sched_switch+0x559/frame 0xfffffe010db67a70 mi_switch() at mi_switch+0x157/frame 0xfffffe010db67a90 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db67ad0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe010db67b20 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe010db67b30 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe010db67b90 kern_select() at kern_select+0xa95/frame 0xfffffe010db67d80 sys_pselect() at sys_pselect+0x127/frame 0xfffffe010db67e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe010db67f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010db67f30 --- syscall (522, FreeBSD ELF64, sys_pselect), rip = 0x215c5feab6ba, rsp = 0x215c59d4bd88, rbp = 0x215c59d4bdd0 --- Tracing command cron pid 2717 tid 100244 td 0xfffffe010e7cd900 sched_switch() at sched_switch+0x559/frame 0xfffffe010db8abb0 mi_switch() at mi_switch+0x157/frame 0xfffffe010db8abd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db8ac10 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe010db8ac60 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe010db8aca0 _sleep() at _sleep+0x2bf/frame 0xfffffe010db8ad40 kern_clock_nanosleep() at kern_clock_nanosleep+0x1d1/frame 0xfffffe010db8adc0 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe010db8ae00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe010db8af30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010db8af30 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x316ef8f2f5fa, rsp = 0x316ef6a44ed8, rbp = 0x316ef6a450c0 --- Tracing command getty pid 2731 tid 100209 td 0xfffffe010e607560 sched_switch() at sched_switch+0x559/frame 0xfffffe0141750af0 mi_switch() at mi_switch+0x157/frame 0xfffffe0141750b10 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0141750b50 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0141750ba0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0141750bb0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe0141750c10 tty_wait() at tty_wait+0x42/frame 0xfffffe0141750c40 ttydisc_read() at ttydisc_read+0x21e/frame 0xfffffe0141750cb0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe0141750ce0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe0141750d40 dofileread() at dofileread+0x81/frame 0xfffffe0141750d90 sys_read() at sys_read+0xc0/frame 0xfffffe0141750e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0141750f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141750f30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x3dc6def9f6fa, rsp = 0x3dc6dc3e2f28, rbp = 0x3dc6dc3e2f70 --- Tracing command getty pid 2732 tid 100268 td 0xfffffe010e5e4e40 sched_switch() at sched_switch+0x559/frame 0xfffffe01438b2af0 mi_switch() at mi_switch+0x157/frame 0xfffffe01438b2b10 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01438b2b50 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01438b2ba0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01438b2bb0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe01438b2c10 tty_wait() at tty_wait+0x42/frame 0xfffffe01438b2c40 ttydisc_read() at ttydisc_read+0x21e/frame 0xfffffe01438b2cb0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe01438b2ce0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe01438b2d40 dofileread() at dofileread+0x81/frame 0xfffffe01438b2d90 sys_read() at sys_read+0xc0/frame 0xfffffe01438b2e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe01438b2f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01438b2f30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x1259ebced6fa, rsp = 0x1259ea973f68, rbp = 0x1259ea973fb0 --- Tracing command getty pid 2733 tid 100267 td 0xfffffe01440ac000 sched_switch() at sched_switch+0x559/frame 0xfffffe01438a8af0 mi_switch() at mi_switch+0x157/frame 0xfffffe01438a8b10 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01438a8b50 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01438a8ba0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01438a8bb0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe01438a8c10 tty_wait() at tty_wait+0x42/frame 0xfffffe01438a8c40 ttydisc_read() at ttydisc_read+0x21e/frame 0xfffffe01438a8cb0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe01438a8ce0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe01438a8d40 dofileread() at dofileread+0x81/frame 0xfffffe01438a8d90 sys_read() at sys_read+0xc0/frame 0xfffffe01438a8e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe01438a8f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01438a8f30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x35bde11036fa, rsp = 0x35bde0bbc378, rbp = 0x35bde0bbc3c0 --- Tracing command getty pid 2734 tid 100248 td 0xfffffe0142894900 sched_switch() at sched_switch+0x559/frame 0xfffffe010dbbcaf0 mi_switch() at mi_switch+0x157/frame 0xfffffe010dbbcb10 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010dbbcb50 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe010dbbcba0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe010dbbcbb0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe010dbbcc10 tty_wait() at tty_wait+0x42/frame 0xfffffe010dbbcc40 ttydisc_read() at ttydisc_read+0x21e/frame 0xfffffe010dbbccb0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe010dbbcce0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe010dbbcd40 dofileread() at dofileread+0x81/frame 0xfffffe010dbbcd90 sys_read() at sys_read+0xc0/frame 0xfffffe010dbbce00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe010dbbcf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010dbbcf30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x17e533e616fa, rsp = 0x17e532db58e8, rbp = 0x17e532db5930 --- Tracing command getty pid 2735 tid 100212 td 0xfffffe010e7cc3a0 sched_switch() at sched_switch+0x559/frame 0xfffffe014176eaf0 mi_switch() at mi_switch+0x157/frame 0xfffffe014176eb10 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe014176eb50 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014176eba0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe014176ebb0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe014176ec10 tty_wait() at tty_wait+0x42/frame 0xfffffe014176ec40 ttydisc_read() at ttydisc_read+0x21e/frame 0xfffffe014176ecb0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe014176ece0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe014176ed40 dofileread() at dofileread+0x81/frame 0xfffffe014176ed90 sys_read() at sys_read+0xc0/frame 0xfffffe014176ee00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe014176ef30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014176ef30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x12ebe09aa6fa, rsp = 0x12ebde08ac98, rbp = 0x12ebde08ace0 --- Tracing command getty pid 2736 tid 100271 td 0xfffffe010e7e5ac0 sched_switch() at sched_switch+0x559/frame 0xfffffe01438bcaf0 mi_switch() at mi_switch+0x157/frame 0xfffffe01438bcb10 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01438bcb50 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01438bcba0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01438bcbb0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe01438bcc10 tty_wait() at tty_wait+0x42/frame 0xfffffe01438bcc40 ttydisc_read() at ttydisc_read+0x21e/frame 0xfffffe01438bccb0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe01438bcce0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe01438bcd40 dofileread() at dofileread+0x81/frame 0xfffffe01438bcd90 sys_read() at sys_read+0xc0/frame 0xfffffe01438bce00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe01438bcf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01438bcf30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x33df26a0f6fa, rsp = 0x33df2537e088, rbp = 0x33df2537e0d0 --- Tracing command getty pid 2737 tid 100226 td 0xfffffe010e7e3720 sched_switch() at sched_switch+0x559/frame 0xfffffe014177daf0 mi_switch() at mi_switch+0x157/frame 0xfffffe014177db10 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe014177db50 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014177dba0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe014177dbb0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe014177dc10 tty_wait() at tty_wait+0x42/frame 0xfffffe014177dc40 ttydisc_read() at ttydisc_read+0x21e/frame 0xfffffe014177dcb0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe014177dce0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe014177dd40 dofileread() at dofileread+0x81/frame 0xfffffe014177dd90 sys_read() at sys_read+0xc0/frame 0xfffffe014177de00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe014177df30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014177df30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x34f8adfb46fa, rsp = 0x34f8ab8a1ff8, rbp = 0x34f8ab8a2040 --- Tracing command getty pid 2738 tid 100239 td 0xfffffe01435f6720 sched_switch() at sched_switch+0x559/frame 0xfffffe010db94af0 mi_switch() at mi_switch+0x157/frame 0xfffffe010db94b10 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db94b50 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe010db94ba0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe010db94bb0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe010db94c10 tty_wait() at tty_wait+0x42/frame 0xfffffe010db94c40 ttydisc_read() at ttydisc_read+0x21e/frame 0xfffffe010db94cb0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe010db94ce0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe010db94d40 dofileread() at dofileread+0x81/frame 0xfffffe010db94d90 sys_read() at sys_read+0xc0/frame 0xfffffe010db94e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe010db94f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010db94f30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x1ce38b0646fa, rsp = 0x1ce388dfbff8, rbp = 0x1ce388dfc040 --- Tracing command getty pid 2739 tid 100237 td 0xfffffe01435fa740 sched_switch() at sched_switch+0x559/frame 0xfffffe010dba3af0 mi_switch() at mi_switch+0x157/frame 0xfffffe010dba3b10 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010dba3b50 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe010dba3ba0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe010dba3bb0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe010dba3c10 tty_wait() at tty_wait+0x42/frame 0xfffffe010dba3c40 ttydisc_read() at ttydisc_read+0x21e/frame 0xfffffe010dba3cb0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe010dba3ce0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe010dba3d40 dofileread() at dofileread+0x81/frame 0xfffffe010dba3d90 sys_read() at sys_read+0xc0/frame 0xfffffe010dba3e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe010dba3f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010dba3f30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x3523fdf0b6fa, rsp = 0x3523faf57bd8, rbp = 0x3523faf57c20 --- Tracing command getty pid 2740 tid 100211 td 0xfffffe010e620900 sched_switch() at sched_switch+0x559/frame 0xfffffe0141764af0 mi_switch() at mi_switch+0x157/frame 0xfffffe0141764b10 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0141764b50 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0141764ba0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0141764bb0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe0141764c10 tty_wait() at tty_wait+0x42/frame 0xfffffe0141764c40 ttydisc_read() at ttydisc_read+0x21e/frame 0xfffffe0141764cb0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe0141764ce0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe0141764d40 dofileread() at dofileread+0x81/frame 0xfffffe0141764d90 sys_read() at sys_read+0xc0/frame 0xfffffe0141764e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0141764f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141764f30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x29293d4256fa, rsp = 0x29293ac69858, rbp = 0x29293ac698a0 --- Tracing command sshd pid 2794 tid 100241 td 0xfffffe01435f6000 sched_switch() at sched_switch+0x559/frame 0xfffffe010dbadae0 mi_switch() at mi_switch+0x157/frame 0xfffffe010dbadb00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010dbadb40 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe010dbadb90 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe010dbadba0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe010dbadc00 kern_poll_kfds() at kern_poll_kfds+0x4bc/frame 0xfffffe010dbadc90 kern_poll() at kern_poll+0x9f/frame 0xfffffe010dbadde0 sys_poll() at sys_poll+0x50/frame 0xfffffe010dbade00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe010dbadf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010dbadf30 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x35c25437767a, rsp = 0x35c24fdb7268, rbp = 0x35c24fdb72a0 --- Tracing command sshd pid 2797 tid 100210 td 0xfffffe010e61d000 sched_switch() at sched_switch+0x559/frame 0xfffffe014175aa70 mi_switch() at mi_switch+0x157/frame 0xfffffe014175aa90 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe014175aad0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014175ab20 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe014175ab30 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe014175ab90 kern_select() at kern_select+0xa95/frame 0xfffffe014175ad80 sys_pselect() at sys_pselect+0x127/frame 0xfffffe014175ae00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe014175af30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014175af30 --- syscall (522, FreeBSD ELF64, sys_pselect), rip = 0x35c2543776ba, rsp = 0x35c24fdb31e8, rbp = 0x35c24fdb3230 --- Tracing command bash pid 2798 tid 100260 td 0xfffffe010e224560 sched_switch() at sched_switch+0x559/frame 0xfffffe014387ea10 mi_switch() at mi_switch+0x157/frame 0xfffffe014387ea30 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe014387ea70 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014387eac0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe014387ead0 _sleep() at _sleep+0x2dd/frame 0xfffffe014387eb70 kern_wait6() at kern_wait6+0x474/frame 0xfffffe014387ec00 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe014387ee00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe014387ef30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014387ef30 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x823d898da, rsp = 0x82103fda8, rbp = 0x82103fe00 --- Tracing command su pid 2803 tid 100285 td 0xfffffe014446f3a0 sched_switch() at sched_switch+0x559/frame 0xfffffe0143902a10 mi_switch() at mi_switch+0x157/frame 0xfffffe0143902a30 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0143902a70 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0143902ac0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0143902ad0 _sleep() at _sleep+0x2dd/frame 0xfffffe0143902b70 kern_wait6() at kern_wait6+0x474/frame 0xfffffe0143902c00 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0143902e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0143902f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0143902f30 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x1b9230d358da, rsp = 0x1b922d25b4e8, rbp = 0x1b922d25ba30 --- Tracing command csh pid 2804 tid 100266 td 0xfffffe014366ac80 sched_switch() at sched_switch+0x559/frame 0xfffffe014389eba0 mi_switch() at mi_switch+0x157/frame 0xfffffe014389ebc0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe014389ec00 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014389ec50 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe014389ec60 _sleep() at _sleep+0x2dd/frame 0xfffffe014389ed00 kern_sigsuspend() at kern_sigsuspend+0x1ec/frame 0xfffffe014389edd0 sys_sigsuspend() at sys_sigsuspend+0x31/frame 0xfffffe014389ee00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe014389ef30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014389ef30 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x394d056fe83a, rsp = 0x394d03c77ef8, rbp = 0x394d03c77f80 --- Tracing command bash pid 2806 tid 100274 td 0xfffffe010e61ec80 sched_switch() at sched_switch+0x559/frame 0xfffffe01438c6a10 mi_switch() at mi_switch+0x157/frame 0xfffffe01438c6a30 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01438c6a70 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01438c6ac0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01438c6ad0 _sleep() at _sleep+0x2dd/frame 0xfffffe01438c6b70 kern_wait6() at kern_wait6+0x474/frame 0xfffffe01438c6c00 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe01438c6e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe01438c6f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01438c6f30 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x823f708da, rsp = 0x820d9f098, rbp = 0x820d9f0f0 --- Tracing command sleep pid 11018 tid 100419 td 0xfffffe01437f3c80 sched_switch() at sched_switch+0x559/frame 0xfffffe015053abb0 mi_switch() at mi_switch+0x157/frame 0xfffffe015053abd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe015053ac10 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe015053ac60 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe015053aca0 _sleep() at _sleep+0x2bf/frame 0xfffffe015053ad40 kern_clock_nanosleep() at kern_clock_nanosleep+0x1d1/frame 0xfffffe015053adc0 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe015053ae00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe015053af30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe015053af30 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x1dfdea16d5fa, rsp = 0x1dfde97c9d58, rbp = 0x1dfde97c9db0 --- Tracing command sh pid 3080 tid 100290 td 0xfffffe010e7ca000 sched_switch() at sched_switch+0x559/frame 0xfffffe0143911a10 mi_switch() at mi_switch+0x157/frame 0xfffffe0143911a30 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0143911a70 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0143911ac0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0143911ad0 _sleep() at _sleep+0x2dd/frame 0xfffffe0143911b70 kern_wait6() at kern_wait6+0x474/frame 0xfffffe0143911c00 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0143911e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0143911f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0143911f30 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x7a41d0788da, rsp = 0x7a41b2f92f8, rbp = 0x7a41b2f93b0 --- Tracing command sh pid 3165 tid 100286 td 0xfffffe010e7e4560 sched_switch() at sched_switch+0x559/frame 0xfffffe01438dfa10 mi_switch() at mi_switch+0x157/frame 0xfffffe01438dfa30 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01438dfa70 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01438dfac0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01438dfad0 _sleep() at _sleep+0x2dd/frame 0xfffffe01438dfb70 kern_wait6() at kern_wait6+0x474/frame 0xfffffe01438dfc00 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe01438dfe00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe01438dff30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01438dff30 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x32b212f288da, rsp = 0x32b210f6af88, rbp = 0x32b210f6b040 --- Tracing command sh pid 3225 tid 100289 td 0xfffffe010e7ca720 sched_switch() at sched_switch+0x559/frame 0xfffffe0143916a10 mi_switch() at mi_switch+0x157/frame 0xfffffe0143916a30 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0143916a70 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0143916ac0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0143916ad0 _sleep() at _sleep+0x2dd/frame 0xfffffe0143916b70 kern_wait6() at kern_wait6+0x474/frame 0xfffffe0143916c00 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0143916e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0143916f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0143916f30 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x32b212f288da, rsp = 0x32b210f6acb8, rbp = 0x32b210f6ad70 --- Tracing command awk pid 3226 tid 100219 td 0xfffffe010e7e7020 sched_switch() at sched_switch+0x559/frame 0xfffffe0141787b80 mi_switch() at mi_switch+0x157/frame 0xfffffe0141787ba0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0141787be0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0141787c30 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0141787c40 _sleep() at _sleep+0x2dd/frame 0xfffffe0141787ce0 pipe_read() at pipe_read+0x4b6/frame 0xfffffe0141787d40 dofileread() at dofileread+0x81/frame 0xfffffe0141787d90 sys_read() at sys_read+0xc0/frame 0xfffffe0141787e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0141787f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141787f30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x5a73e66b6fa, rsp = 0x5a73ca611a8, rbp = 0x5a73ca611c0 --- Tracing command sh pid 3228 tid 100279 td 0xfffffe010e7e53a0 sched_switch() at sched_switch+0x559/frame 0xfffffe01438b7b80 mi_switch() at mi_switch+0x157/frame 0xfffffe01438b7ba0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01438b7be0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01438b7c30 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01438b7c40 _sleep() at _sleep+0x2dd/frame 0xfffffe01438b7ce0 pipe_read() at pipe_read+0x4b6/frame 0xfffffe01438b7d40 dofileread() at dofileread+0x81/frame 0xfffffe01438b7d90 sys_read() at sys_read+0xc0/frame 0xfffffe01438b7e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe01438b7f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01438b7f30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x32b212f286fa, rsp = 0x32b210f6a888, rbp = 0x32b210f6adb0 --- Tracing command rm pid 11537 tid 100359 td 0xfffffe01445aa1e0 (CPU 5) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce54e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce54e10 trap() at trap+0x56/frame 0xfffffe003ce54f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce54f20 --- trap 0x13, rip = 0x2b4ebcb04da2, rsp = 0x167139049460, rbp = 0x1671390498e0 --- Tracing command sshd pid 3647 tid 100227 td 0xfffffe010e5e5560 sched_switch() at sched_switch+0x559/frame 0xfffffe01417b1ae0 mi_switch() at mi_switch+0x157/frame 0xfffffe01417b1b00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01417b1b40 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01417b1b90 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01417b1ba0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe01417b1c00 kern_poll_kfds() at kern_poll_kfds+0x4bc/frame 0xfffffe01417b1c90 kern_poll() at kern_poll+0x9f/frame 0xfffffe01417b1de0 sys_poll() at sys_poll+0x50/frame 0xfffffe01417b1e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe01417b1f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01417b1f30 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x1aac8455267a, rsp = 0x1aac7bc34b58, rbp = 0x1aac7bc34b90 --- Tracing command sshd pid 4379 tid 100291 td 0xfffffe01437f6740 sched_switch() at sched_switch+0x559/frame 0xfffffe01438a3a70 mi_switch() at mi_switch+0x157/frame 0xfffffe01438a3a90 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01438a3ad0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01438a3b20 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01438a3b30 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe01438a3b90 kern_select() at kern_select+0xa95/frame 0xfffffe01438a3d80 sys_pselect() at sys_pselect+0x127/frame 0xfffffe01438a3e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe01438a3f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01438a3f30 --- syscall (522, FreeBSD ELF64, sys_pselect), rip = 0x1aac845526ba, rsp = 0x1aac7bc30ad8, rbp = 0x1aac7bc30b20 --- Tracing command bash pid 4380 tid 100234 td 0xfffffe010e7ce020 sched_switch() at sched_switch+0x559/frame 0xfffffe010db8fa70 mi_switch() at mi_switch+0x157/frame 0xfffffe010db8fa90 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db8fad0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe010db8fb20 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe010db8fb30 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe010db8fb90 kern_select() at kern_select+0xa95/frame 0xfffffe010db8fd80 sys_pselect() at sys_pselect+0x127/frame 0xfffffe010db8fe00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe010db8ff30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010db8ff30 --- syscall (522, FreeBSD ELF64, sys_pselect), rip = 0x823ea26ba, rsp = 0x820747df8, rbp = 0x820747ec0 --- Tracing command sh pid 4387 tid 100300 td 0xfffffe01440adc80 sched_switch() at sched_switch+0x559/frame 0xfffffe0143952a10 mi_switch() at mi_switch+0x157/frame 0xfffffe0143952a30 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0143952a70 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0143952ac0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0143952ad0 _sleep() at _sleep+0x2dd/frame 0xfffffe0143952b70 kern_wait6() at kern_wait6+0x474/frame 0xfffffe0143952c00 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0143952e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0143952f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0143952f30 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x7a41d0788da, rsp = 0x7a41b2f8f98, rbp = 0x7a41b2f9050 --- Tracing command sh pid 4388 tid 100299 td 0xfffffe01440ae3a0 sched_switch() at sched_switch+0x559/frame 0xfffffe0143943a10 mi_switch() at mi_switch+0x157/frame 0xfffffe0143943a30 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0143943a70 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0143943ac0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0143943ad0 _sleep() at _sleep+0x2dd/frame 0xfffffe0143943b70 kern_wait6() at kern_wait6+0x474/frame 0xfffffe0143943c00 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0143943e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0143943f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0143943f30 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x83be2a648da, rsp = 0x83bdfc396b8, rbp = 0x83bdfc39770 --- Tracing command tee pid 4389 tid 100296 td 0xfffffe010e621020 sched_switch() at sched_switch+0x559/frame 0xfffffe0143925b80 mi_switch() at mi_switch+0x157/frame 0xfffffe0143925ba0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0143925be0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0143925c30 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0143925c40 _sleep() at _sleep+0x2dd/frame 0xfffffe0143925ce0 pipe_read() at pipe_read+0x4b6/frame 0xfffffe0143925d40 dofileread() at dofileread+0x81/frame 0xfffffe0143925d90 sys_read() at sys_read+0xc0/frame 0xfffffe0143925e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0143925f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0143925f30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x96dabe476fa, rsp = 0x96daa53a9f8, rbp = 0x96daa53aa50 --- Tracing command md10 pid 4398 tid 100293 td 0xfffffe010e621740 sched_switch() at sched_switch+0x559/frame 0xfffffe014392ada0 mi_switch() at mi_switch+0x157/frame 0xfffffe014392adc0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe014392ae00 _sleep() at _sleep+0x2e7/frame 0xfffffe014392aea0 md_kthread() at md_kthread+0xd5/frame 0xfffffe014392aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe014392af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe014392af30 --- trap 0xc, rip = 0x36838e8cd31a, rsp = 0x36838d968f88, rbp = 0x36838d968fa0 --- Tracing command sh pid 4408 tid 100231 td 0xfffffe010e7ce740 sched_switch() at sched_switch+0x559/frame 0xfffffe010db62a10 mi_switch() at mi_switch+0x157/frame 0xfffffe010db62a30 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db62a70 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe010db62ac0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe010db62ad0 _sleep() at _sleep+0x2dd/frame 0xfffffe010db62b70 kern_wait6() at kern_wait6+0x474/frame 0xfffffe010db62c00 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe010db62e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe010db62f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010db62f30 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x3c2ebb2d28da, rsp = 0x3c2eb94e6278, rbp = 0x3c2eb94e6330 --- Tracing command run pid 4420 tid 100265 td 0xfffffe010e7ccac0 sched_switch() at sched_switch+0x559/frame 0xfffffe010dbc6bb0 mi_switch() at mi_switch+0x157/frame 0xfffffe010dbc6bd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010dbc6c10 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe010dbc6c60 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe010dbc6ca0 _sleep() at _sleep+0x2bf/frame 0xfffffe010dbc6d40 kern_clock_nanosleep() at kern_clock_nanosleep+0x1d1/frame 0xfffffe010dbc6dc0 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe010dbc6e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe010dbc6f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010dbc6f30 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x2a9f4089a5fa, rsp = 0x2a9f3f9aa678, rbp = 0x2a9f3f9aa6c0 --- Tracing command run pid 4422 tid 100287 td 0xfffffe0144472e40 sched_switch() at sched_switch+0x559/frame 0xfffffe014390ca10 mi_switch() at mi_switch+0x157/frame 0xfffffe014390ca30 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe014390ca70 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014390cac0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe014390cad0 _sleep() at _sleep+0x2dd/frame 0xfffffe014390cb70 kern_wait6() at kern_wait6+0x474/frame 0xfffffe014390cc00 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe014390ce00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe014390cf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014390cf30 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x2a9f4089a8da, rsp = 0x2a9f3f9aa6c8, rbp = 0x2a9f3f9aa7f0 --- Tracing command run pid 4423 tid 100295 td 0xfffffe0144471740 sched_switch() at sched_switch+0x559/frame 0xfffffe014392fa10 mi_switch() at mi_switch+0x157/frame 0xfffffe014392fa30 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe014392fa70 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014392fac0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe014392fad0 _sleep() at _sleep+0x2dd/frame 0xfffffe014392fb70 kern_wait6() at kern_wait6+0x474/frame 0xfffffe014392fc00 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe014392fe00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe014392ff30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014392ff30 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x2a9f4089a8da, rsp = 0x2a9f3f9aa188, rbp = 0x2a9f3f9aa6c0 --- Tracing command creat pid 4425 tid 100323 td 0xfffffe01445ab740 sched_switch() at sched_switch+0x559/frame 0xfffffe01439b1bb0 mi_switch() at mi_switch+0x157/frame 0xfffffe01439b1bd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01439b1c10 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01439b1c60 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe01439b1ca0 _sleep() at _sleep+0x2bf/frame 0xfffffe01439b1d40 kern_clock_nanosleep() at kern_clock_nanosleep+0x1d1/frame 0xfffffe01439b1dc0 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe01439b1e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe01439b1f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01439b1f30 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x31f8fffc95fa, rsp = 0x31f8fdb66a48, rbp = 0x31f8fdb66a90 --- Tracing command mkdir pid 4426 tid 100339 td 0xfffffe01445aa900 thread_exit() at thread_exit+0x1f7/frame 0xfffffe014388fd80 exit1() at exit1+0xe1e/frame 0xfffffe014388fdf0 sys_exit() at sys_exit+0xd/frame 0xfffffe014388fe00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe014388ff30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014388ff30 --- syscall (1, FreeBSD ELF64, sys_exit), rip = 0x380b8402f31a, rsp = 0x380b828eb7d8, rbp = 0x380b828eb7f0 --- Tracing command rw pid 4427 tid 100340 td 0xfffffe014ebd3020 sched_switch() at sched_switch+0x559/frame 0xfffffe01439ccbb0 mi_switch() at mi_switch+0x157/frame 0xfffffe01439ccbd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01439ccc10 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01439ccc60 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe01439ccca0 _sleep() at _sleep+0x2bf/frame 0xfffffe01439ccd40 kern_clock_nanosleep() at kern_clock_nanosleep+0x1d1/frame 0xfffffe01439ccdc0 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe01439cce00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe01439ccf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01439ccf30 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x31ed4ad195fa, rsp = 0x31ed49099d68, rbp = 0x31ed49099db0 --- Tracing command rw pid 4428 tid 100333 td 0xfffffe0144474ac0 sched_switch() at sched_switch+0x559/frame 0xfffffe01439b6a10 mi_switch() at mi_switch+0x157/frame 0xfffffe01439b6a30 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01439b6a70 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01439b6ac0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01439b6ad0 _sleep() at _sleep+0x2dd/frame 0xfffffe01439b6b70 kern_wait6() at kern_wait6+0x474/frame 0xfffffe01439b6c00 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe01439b6e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe01439b6f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01439b6f30 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x31ed4ad198da, rsp = 0x31ed49099db8, rbp = 0x31ed49099ee0 --- Tracing command rw pid 4429 tid 100327 td 0xfffffe01445a7e40 (CPU 8) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce7be00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce7be10 trap() at trap+0x56/frame 0xfffffe003ce7bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce7bf20 --- trap 0x13, rip = 0xffffffff80c773d7, rsp = 0xfffffe01439705d0, rbp = 0xfffffe0143970600 --- witness_lock() at witness_lock+0x97/frame 0xfffffe0143970600 _rw_wlock_cookie() at _rw_wlock_cookie+0xca/frame 0xfffffe0143970640 newallocindir() at newallocindir+0x72/frame 0xfffffe0143970690 softdep_setup_allocindir_page() at softdep_setup_allocindir_page+0x7e/frame 0xfffffe0143970700 ffs_balloc_ufs2() at ffs_balloc_ufs2+0x1c1e/frame 0xfffffe01439708d0 ffs_write() at ffs_write+0x262/frame 0xfffffe0143970980 VOP_WRITE_APV() at VOP_WRITE_APV+0xcf/frame 0xfffffe0143970a90 vn_write() at vn_write+0x2fc/frame 0xfffffe0143970b20 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe0143970b80 vn_io_fault1() at vn_io_fault1+0x163/frame 0xfffffe0143970cc0 vn_io_fault() at vn_io_fault+0x1aa/frame 0xfffffe0143970d40 dofilewrite() at dofilewrite+0x81/frame 0xfffffe0143970d90 sys_write() at sys_write+0xc0/frame 0xfffffe0143970e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0143970f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0143970f30 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x31ed4ad1991a, rsp = 0x31ed49098cf8, rbp = 0x31ed49099db0 --- Tracing command rw pid 4430 tid 100326 td 0xfffffe01445a9ac0 (CPU 11) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003cea2e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003cea2e10 trap() at trap+0x56/frame 0xfffffe003cea2f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003cea2f20 --- trap 0x13, rip = 0xffffffff810d33b6, rsp = 0xfffffe01438fd930, rbp = 0xfffffe01438fd930 --- copyout_nosmap_erms() at copyout_nosmap_erms+0x156/frame 0xfffffe01438fd930 uiomove_fromphys() at uiomove_fromphys+0x1a1/frame 0xfffffe01438fd9a0 vn_read_from_obj() at vn_read_from_obj+0x168/frame 0xfffffe01438fda80 VOP_READ_PGCACHE_APV() at VOP_READ_PGCACHE_APV+0x34/frame 0xfffffe01438fdaa0 vn_read() at vn_read+0x94/frame 0xfffffe01438fdb20 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe01438fdb80 vn_io_fault1() at vn_io_fault1+0x163/frame 0xfffffe01438fdcc0 vn_io_fault() at vn_io_fault+0x1aa/frame 0xfffffe01438fdd40 dofileread() at dofileread+0x81/frame 0xfffffe01438fdd90 sys_read() at sys_read+0xc0/frame 0xfffffe01438fde00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe01438fdf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01438fdf30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x31ed4ad196fa, rsp = 0x31ed49098cf8, rbp = 0x31ed49099db0 --- Tracing command rw pid 4431 tid 100325 td 0xfffffe0143515740 (CPU 4) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce47e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce47e10 trap() at trap+0x56/frame 0xfffffe003ce47f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce47f20 --- trap 0x13, rip = 0xffffffff80c7795a, rsp = 0xfffffe014399dc10, rbp = 0xfffffe014399dc40 --- witness_unlock() at witness_unlock+0x9a/frame 0xfffffe014399dc40 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe014399dc70 rangelock_enqueue() at rangelock_enqueue+0x13d/frame 0xfffffe014399dcc0 vn_io_fault() at vn_io_fault+0x17a/frame 0xfffffe014399dd40 dofileread() at dofileread+0x81/frame 0xfffffe014399dd90 sys_read() at sys_read+0xc0/frame 0xfffffe014399de00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe014399df30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014399df30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x31ed4ad196fa, rsp = 0x31ed49098cf8, rbp = 0x31ed49099db0 --- Tracing command rw pid 4432 tid 100336 td 0xfffffe0142892c80 (CPU 6) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce61e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce61e10 trap() at trap+0x56/frame 0xfffffe003ce61f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce61f20 --- trap 0x13, rip = 0xffffffff80ccac91, rsp = 0xfffffe0143989520, rbp = 0xfffffe0143989540 --- bqrelse() at bqrelse+0x41/frame 0xfffffe0143989540 bdwrite() at bdwrite+0x215/frame 0xfffffe01439895b0 ffs_alloccg() at ffs_alloccg+0x15a/frame 0xfffffe0143989630 ffs_hashalloc() at ffs_hashalloc+0x79/frame 0xfffffe0143989680 ffs_alloc() at ffs_alloc+0x1f5/frame 0xfffffe0143989700 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xb74/frame 0xfffffe01439898d0 ffs_write() at ffs_write+0x262/frame 0xfffffe0143989980 VOP_WRITE_APV() at VOP_WRITE_APV+0xcf/frame 0xfffffe0143989a90 vn_write() at vn_write+0x2fc/frame 0xfffffe0143989b20 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe0143989b80 vn_io_fault1() at vn_io_fault1+0x163/frame 0xfffffe0143989cc0 vn_io_fault() at vn_io_fault+0x1aa/frame 0xfffffe0143989d40 dofilewrite() at dofilewrite+0x81/frame 0xfffffe0143989d90 sys_write() at sys_write+0xc0/frame 0xfffffe0143989e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0143989f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0143989f30 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x31ed4ad1991a, rsp = 0x31ed49098cf8, rbp = 0x31ed49099db0 --- Tracing command rw pid 4433 tid 100335 td 0xfffffe01445a8560 (CPU 3) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce3ae00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce3ae10 trap() at trap+0x56/frame 0xfffffe003ce3af20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce3af20 --- trap 0x13, rip = 0xffffffff810d33b8, rsp = 0xfffffe0143975930, rbp = 0xfffffe0143975930 --- copyout_nosmap_erms() at copyout_nosmap_erms+0x158/frame 0xfffffe0143975930 uiomove_fromphys() at uiomove_fromphys+0x1a1/frame 0xfffffe01439759a0 vn_read_from_obj() at vn_read_from_obj+0x168/frame 0xfffffe0143975a80 VOP_READ_PGCACHE_APV() at VOP_READ_PGCACHE_APV+0x34/frame 0xfffffe0143975aa0 vn_read() at vn_read+0x94/frame 0xfffffe0143975b20 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe0143975b80 vn_io_fault1() at vn_io_fault1+0x163/frame 0xfffffe0143975cc0 vn_io_fault() at vn_io_fault+0x1aa/frame 0xfffffe0143975d40 dofileread() at dofileread+0x81/frame 0xfffffe0143975d90 sys_read() at sys_read+0xc0/frame 0xfffffe0143975e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0143975f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0143975f30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x31ed4ad196fa, rsp = 0x31ed49098cf8, rbp = 0x31ed49099db0 --- Tracing command rw pid 4434 tid 100341 td 0xfffffe0142892560 (CPU 0) cpustop_handler() at cpustop_handler+0x28/frame 0xffffffff81fea310 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xffffffff81fea320 trap() at trap+0x56/frame 0xffffffff81fea430 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81fea430 --- trap 0x13, rip = 0xffffffff80c76100, rsp = 0xfffffe01439d6520, rbp = 0xfffffe01439d66d0 --- witness_checkorder() at witness_checkorder+0xd0/frame 0xfffffe01439d66d0 _rw_wlock_cookie() at _rw_wlock_cookie+0x67/frame 0xfffffe01439d6710 reassignbuf() at reassignbuf+0x3a/frame 0xfffffe01439d6740 bundirty() at bundirty+0x32/frame 0xfffffe01439d6760 cluster_wbuild() at cluster_wbuild+0x58c/frame 0xfffffe01439d6800 cluster_write() at cluster_write+0x12c/frame 0xfffffe01439d68d0 ffs_write() at ffs_write+0x422/frame 0xfffffe01439d6980 VOP_WRITE_APV() at VOP_WRITE_APV+0xcf/frame 0xfffffe01439d6a90 vn_write() at vn_write+0x2fc/frame 0xfffffe01439d6b20 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe01439d6b80 vn_io_fault1() at vn_io_fault1+0x163/frame 0xfffffe01439d6cc0 vn_io_fault() at vn_io_fault+0x1aa/frame 0xfffffe01439d6d40 dofilewrite() at dofilewrite+0x81/frame 0xfffffe01439d6d90 sys_write() at sys_write+0xc0/frame 0xfffffe01439d6e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe01439d6f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01439d6f30 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x31ed4ad1991a, rsp = 0x31ed49098cf8, rbp = 0x31ed49099db0 --- Tracing command creat pid 4435 tid 100331 td 0xfffffe0144475900 sched_switch() at sched_switch+0x559/frame 0xfffffe0143961a10 mi_switch() at mi_switch+0x157/frame 0xfffffe0143961a30 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0143961a70 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0143961ac0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0143961ad0 _sleep() at _sleep+0x2dd/frame 0xfffffe0143961b70 kern_wait6() at kern_wait6+0x474/frame 0xfffffe0143961c00 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0143961e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0143961f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0143961f30 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x31f8fffc98da, rsp = 0x31f8fdb66a98, rbp = 0x31f8fdb66bc0 --- Tracing command creat pid 4436 tid 100216 td 0xfffffe010e7e3e40 (CPU 9) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce88e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce88e10 trap() at trap+0x56/frame 0xfffffe003ce88f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce88f20 --- trap 0x13, rip = 0xffffffff80c54222, rsp = 0xfffffe0141782820, rbp = 0xfffffe0141782830 --- lock_delay() at lock_delay+0x22/frame 0xfffffe0141782830 __rw_wlock_hard() at __rw_wlock_hard+0x188/frame 0xfffffe01417828d0 _rw_wlock_cookie() at _rw_wlock_cookie+0xb7/frame 0xfffffe0141782910 softdep_update_inodeblock() at softdep_update_inodeblock+0xdd/frame 0xfffffe0141782970 ffs_update() at ffs_update+0x1a3/frame 0xfffffe01417829b0 ufs_makeinode() at ufs_makeinode+0x3a7/frame 0xfffffe0141782b10 ufs_create() at ufs_create+0x34/frame 0xfffffe0141782b30 VOP_CREATE_APV() at VOP_CREATE_APV+0x62/frame 0xfffffe0141782b50 vn_open_cred() at vn_open_cred+0x2c9/frame 0xfffffe0141782cb0 kern_openat() at kern_openat+0x286/frame 0xfffffe0141782e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0141782f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141782f30 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x31f8fffc963a, rsp = 0x31f8fdb669d8, rbp = 0x31f8fdb66a90 --- Tracing command creat pid 4437 tid 100215 td 0xfffffe010e606e40 (CPU 2) kdb_enter() at kdb_enter+0x37/frame 0xfffffe014174b370 vpanic() at vpanic+0x1b0/frame 0xfffffe014174b3c0 panic() at panic+0x43/frame 0xfffffe014174b420 witness_checkorder() at witness_checkorder+0xd1c/frame 0xfffffe014174b5e0 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x6c/frame 0xfffffe014174b680 __lockmgr_args() at __lockmgr_args+0x1f9/frame 0xfffffe014174b720 ffs_copyonwrite() at ffs_copyonwrite+0x1d7/frame 0xfffffe014174b7f0 ffs_geom_strategy() at ffs_geom_strategy+0xcf/frame 0xfffffe014174b820 ufs_strategy() at ufs_strategy+0x83/frame 0xfffffe014174b850 VOP_STRATEGY_APV() at VOP_STRATEGY_APV+0x61/frame 0xfffffe014174b870 bufstrategy() at bufstrategy+0x3e/frame 0xfffffe014174b8a0 bufwrite() at bufwrite+0x24c/frame 0xfffffe014174b8f0 ffs_truncate() at ffs_truncate+0x6b9/frame 0xfffffe014174bac0 ffs_vput_pair() at ffs_vput_pair+0x1b3/frame 0xfffffe014174bb50 vn_open_cred() at vn_open_cred+0x382/frame 0xfffffe014174bcb0 kern_openat() at kern_openat+0x286/frame 0xfffffe014174be00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe014174bf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014174bf30 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x31f8fffc963a, rsp = 0x31f8fdb669d8, rbp = 0x31f8fdb66a90 --- Tracing command creat pid 4438 tid 100342 td 0xfffffe010e606720 (CPU 1) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce20e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce20e10 trap() at trap+0x56/frame 0xfffffe003ce20f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce20f20 --- trap 0x13, rip = 0xffffffff80c762d1, rsp = 0xfffffe01439e0850, rbp = 0xfffffe01439e0a00 --- witness_checkorder() at witness_checkorder+0x2a1/frame 0xfffffe01439e0a00 __mtx_lock_flags() at __mtx_lock_flags+0x94/frame 0xfffffe01439e0a50 vn_irflag_set_cond() at vn_irflag_set_cond+0x2d/frame 0xfffffe01439e0a80 ufs_open() at ufs_open+0x66/frame 0xfffffe01439e0ab0 VOP_OPEN_APV() at VOP_OPEN_APV+0x56/frame 0xfffffe01439e0ad0 vn_open_vnode() at vn_open_vnode+0x1c9/frame 0xfffffe01439e0b50 vn_open_cred() at vn_open_cred+0x548/frame 0xfffffe01439e0cb0 kern_openat() at kern_openat+0x286/frame 0xfffffe01439e0e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe01439e0f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01439e0f30 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x31f8fffc963a, rsp = 0x31f8fdb669d8, rbp = 0x31f8fdb66a90 --- Tracing command creat pid 4439 tid 100343 td 0xfffffe010e606000 (CPU 7) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce6ee00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce6ee10 trap() at trap+0x56/frame 0xfffffe003ce6ef20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce6ef20 --- trap 0x13, rip = 0xffffffff80f600e2, rsp = 0xfffffe01439db840, rbp = 0xfffffe01439db880 --- item_ctor() at item_ctor+0x1e2/frame 0xfffffe01439db880 ffs_vgetf() at ffs_vgetf+0xe8/frame 0xfffffe01439db900 ffs_valloc() at ffs_valloc+0x57f/frame 0xfffffe01439db9b0 ufs_makeinode() at ufs_makeinode+0xd9/frame 0xfffffe01439dbb10 ufs_create() at ufs_create+0x34/frame 0xfffffe01439dbb30 VOP_CREATE_APV() at VOP_CREATE_APV+0x62/frame 0xfffffe01439dbb50 vn_open_cred() at vn_open_cred+0x2c9/frame 0xfffffe01439dbcb0 kern_openat() at kern_openat+0x286/frame 0xfffffe01439dbe00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe01439dbf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01439dbf30 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x31f8fffc963a, rsp = 0x31f8fdb669d8, rbp = 0x31f8fdb66a90 --- Tracing command creat pid 4440 tid 100344 td 0xfffffe010e5e8740 (CPU 10) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce95e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce95e10 trap() at trap+0x56/frame 0xfffffe003ce95f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce95f20 --- trap 0x13, rip = 0xffffffff80cf636a, rsp = 0xfffffe01439ea9e0, rbp = 0xfffffe01439ea9f0 --- assert_vi_unlocked() at assert_vi_unlocked+0x1a/frame 0xfffffe01439ea9f0 VOP_ADVLOCKPURGE_APV() at VOP_ADVLOCKPURGE_APV+0x6c/frame 0xfffffe01439eaa10 vgonel() at vgonel+0x462/frame 0xfffffe01439eaa70 vrecycle() at vrecycle+0x5c/frame 0xfffffe01439eaaa0 ufs_inactive() at ufs_inactive+0x27c/frame 0xfffffe01439eaae0 VOP_INACTIVE_APV() at VOP_INACTIVE_APV+0x59/frame 0xfffffe01439eab00 vinactivef() at vinactivef+0xda/frame 0xfffffe01439eab40 vput_final() at vput_final+0x2aa/frame 0xfffffe01439eaba0 kern_funlinkat() at kern_funlinkat+0x275/frame 0xfffffe01439eade0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe01439eae00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe01439eaf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01439eaf30 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x31f8fffc653a, rsp = 0x31f8fdb669d8, rbp = 0x31f8fdb66a90 --- db> reset cpu_reset: Restarting BSP cpu_reset_proxy: Stopped CPU 2 (kgdb) bt #0 __curthread () at /var/tmp/deviant3/sys/amd64/include/pcpu_aux.h:55 #1 doadump (textdump=textdump@entry=0x0) at ../../../kern/kern_shutdown.c:399 #2 0xffffffff804c659a in db_dump (dummy=, dummy2=, dummy3=, dummy4=) at ../../../ddb/db_command.c:575 #3 0xffffffff804c6452 in db_command (last_cmdp=, cmd_table=, dopager=dopager@entry=0x0) at ../../../ddb/db_command.c:482 #4 0xffffffff804c64e6 in db_command_script (command=command@entry=0xffffffff81bd3cc0 "dump") at ../../../ddb/db_command.c:553 #5 0xffffffff804cb818 in db_script_exec (scriptname=0xffffffff81bd3630 "dump", warnifnotfound=) at ../../../ddb/db_script.c:304 #6 0xffffffff804c6452 in db_command (last_cmdp=, cmd_table=, dopager=dopager@entry=0x0) at ../../../ddb/db_command.c:482 #7 0xffffffff804c64e6 in db_command_script (command=command@entry=0xffffffff81bd3c52 "run pho1") at ../../../ddb/db_command.c:553 #8 0xffffffff804cb818 in db_script_exec (scriptname=0xffffffff81bd3630 "dump", warnifnotfound=) at ../../../ddb/db_script.c:304 #9 0xffffffff804c6452 in db_command (last_cmdp=, cmd_table=, dopager=dopager@entry=0x1) at ../../../ddb/db_command.c:482 #10 0xffffffff804c60ad in db_command_loop () at ../../../ddb/db_command.c:535 #11 0xffffffff804c96e6 in db_trap (type=, code=) at ../../../ddb/db_main.c:270 #12 0xffffffff80c5349b in kdb_trap (type=type@entry=0x3, code=code@entry=0x0, tf=tf@entry=0xfffffe014174b2a0) at ../../../kern/subr_kdb.c:733 #13 0xffffffff810d667a in trap (frame=0xfffffe014174b2a0) at ../../../amd64/amd64/trap.c:609 #14 #15 kdb_enter (why=0xffffffff812d60cb "panic", msg=) at ../../../kern/subr_kdb.c:506 #16 0xffffffff80c05a30 in vpanic (fmt=0xffffffff811e07b1 "interlock (%s) %s not locked @ %s:%d", ap=ap@entry=0xfffffe014174b400) at ../../../kern/kern_shutdown.c:908 #17 0xffffffff80c057c3 in panic (fmt=0xffffffff81e8cf60 "\026#)\201\377\377\377\377") at ../../../kern/kern_shutdown.c:844 #18 0xffffffff80c76d4c in witness_checkorder (lock=, flags=, file=, line=0x9a1, interlock=) at ../../../kern/subr_witness.c:1202 #19 0xffffffff80bd45cc in lockmgr_xlock_hard (lk=lk@entry=0xfffff80003f12430, flags=flags@entry=0x80900, ilk=0xfffffe014e838d50, file=0xffffffff81325f36 "../../../ufs/ffs/ffs_snapshot.c", line=0x9a1, lwa=lwa@entry=0xfffffe014174b6a8) at ../../../kern/kern_lock.c:798 #20 0xffffffff80bd4ed9 in __lockmgr_args (lk=0xfffff80003f12430, flags=0x80900, ilk=0xffffffff81cfa800 , wmesg=, pri=, timo=, file=0xffffffff81325f36 "../../../ufs/ffs/ffs_snapshot.c", line=0x9a1) at ../../../kern/kern_lock.c:1379 #21 0xffffffff80f1a927 in _lockmgr_args (lk=0xffffffff81e8cf60 , flags=0x80900, ilk=0xfffffe014e838d50, wmesg=0x0, prio=0x0, timo=0x0, line=0x9a1, file=) at ../../../sys/lockmgr.h:107 #22 ffs_copyonwrite (devvp=, devvp@entry=0xfffffe014e838c20, bp=bp@entry=0xfffffe00381f7ce0) at ../../../ufs/ffs/ffs_snapshot.c:2464 #23 0xffffffff80f3ec0f in ffs_geom_strategy (bo=0xfffffe014e838d98, bp=0xfffffe00381f7ce0) at ../../../ufs/ffs/ffs_vfsops.c:2530 #24 0xffffffff80f53db3 in ufs_strategy (ap=) at ../../../ufs/ufs/ufs_vnops.c:2524 #25 0xffffffff811a3bd1 in VOP_STRATEGY_APV (vop=0xffffffff81b66780 , a=a@entry=0xfffffe014174b880) at vnode_if.c:2425 #26 0xffffffff80cc742e in VOP_STRATEGY (vp=0xffffffff8127ab88, bp=0xfffffe00381f7ce0) at ./vnode_if.h:1222 #27 bufstrategy (bo=, bp=0xfffffe00381f7ce0) at ../../../kern/vfs_bio.c:5111 #28 0xffffffff80cc72cc in bstrategy (bp=0xfffffe00381f7ce0) at ../../../sys/buf.h:440 #29 bufwrite (bp=0xfffffe00381f7ce0) at ../../../kern/vfs_bio.c:2349 #30 0xffffffff80f13559 in ffs_truncate (vp=vp@entry=0xfffffe014f9b7bb8, length=, flags=0x10880, cred=0xfffff80003cb2000) at ../../../ufs/ffs/ffs_inode.c:465 #31 0xffffffff80f403d3 in ffs_vput_pair (ap=0xfffffe014174bc18) at ../../../ufs/ffs/ffs_vnops.c:2046 #32 0xffffffff80d0dfe2 in VOP_VPUT_PAIR (dvp=0x1, dvp@entry=0x0, vpp=0x12, unlock_vp=0x0) at ./vnode_if.h:2421 #33 vn_open_cred (ndp=ndp@entry=0xfffffe014174bcc0, flagp=flagp@entry=0xfffffe014174bdd4, cmode=cmode@entry=0x1b0, vn_open_flags=vn_open_flags@entry=0x0, cred=0xfffff80003cb2000, fp=0xfffff800040279b0) at ../../../kern/vfs_vnops.c:294 #34 0xffffffff80d0dc5f in vn_open (ndp=0xffffffff81e8cf60 , ndp@entry=0xfffffe014174bcc0, flagp=0x80, flagp@entry=0xfffffe014174bdd4, cmode=0x8127ab88, cmode@entry=0x1b0, fp=0x1d0) at ../../../kern/vfs_vnops.c:195 #35 0xffffffff80d04ad6 in kern_openat (td=0xfffffe010e606e40, fd=0xffffff9c, path=0x31f8fdb669e0 , pathseg=UIO_USERSPACE, flags=0x602, mode=) at ../../../kern/vfs_syscalls.c:1170 #36 0xffffffff810d7455 in syscallenter (td=0xfffffe010e606e40) at ../../../amd64/amd64/../../kern/subr_syscall.c:189 #37 amd64_syscall (td=0xfffffe010e606e40, traced=0x0) at ../../../amd64/amd64/trap.c:1191 #38 #39 0x000031f8fffc963a in ?? () Backtrace stopped: Cannot access memory at address 0x31f8fdb669d8 (kgdb) f 19 #19 0xffffffff80bd45cc in lockmgr_xlock_hard (lk=lk@entry=0xfffff80003f12430, flags=flags@entry=0x80900, ilk=0xfffffe014e838d50, file=0xffffffff81325f36 "../../../ufs/ffs/ffs_snapshot.c", line=0x9a1, lwa=lwa@entry=0xfffffe014174b6a8) at ../../../kern/kern_lock.c:798 798 WITNESS_CHECKORDER(&lk->lock_object, LOP_NEWORDER | (kgdb) p *lk $1 = {lock_object = {lo_name = 0xffffffff8124bd0f "snaplk", lo_flags = 0x67b0008, lo_data = 0x0, lo_witness = 0xfffff8087fd84d80}, lk_lock = 0x1, lk_exslpfail = 0x0, lk_pri = 0x60, lk_timo = 0x33, lk_stack = {depth = 0xc, pcs = {0xffffffff80bd551b, 0xffffffff80f19a83, 0xffffffff80f1900a, 0xffffffff80f130f5, 0xffffffff80f4924a, 0xffffffff811a32e9, 0xffffffff80cf73fa, 0xffffffff80cf6a4a, 0xffffffff80d06375, 0xffffffff80d060f8, 0xffffffff810d7455, 0xffffffff810a832b, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0}}} (kgdb) f 30 #30 0xffffffff80f13559 in ffs_truncate (vp=vp@entry=0xfffffe014f9b7bb8, length=, flags=0x10880, cred=0xfffff80003cb2000) at ../../../ufs/ffs/ffs_inode.c:465 465 ffs_inode_bwrite(vp, bp, flags); (kgdb) l 460 lbn = lblkno(fs, length); 461 flags |= BA_CLRBUF; 462 error = UFS_BALLOC(vp, length - 1, 1, cred, flags, &bp); 463 if (error) 464 return (error); 465 ffs_inode_bwrite(vp, bp, flags); 466 467 /* 468 * When we are doing soft updates and the UFS_BALLOC 469 * above fills in a direct block hole with a full sized (kgdb) info loc lastiblock = {0xfffffe01501d5960, 0xfffffe014174bc18, 0xfffffe01501d59d0} indir_lbn = {0xfffffe014174b9b0, 0xffffffff813262b5, 0xfffffe014f9b7bb8} oldblks = {0xfffffe004fa5800c, 0xffffffff80ccaa65, 0x0, 0x8, 0xffffffff81264296, 0x1afe, 0xfe10d21a12ca4aef, 0xfffffe014f8bd488, 0xffffffff813262b5, 0xfffffe014f8bd630, 0x7fe, 0xfffffe014174b9f0, 0xfffffe014174b9d0, 0xffffffff80c5a789, 0x0} newblks = {0xfffffe014174b9d0, 0xffffffff80cf4210, 0xffffffff81b8b938, 0xfffffe014f9b7bb8, 0xfffffe014f8bd488, 0x7fe, 0xfffffe014174baa0, 0xffffffff80f4c37b, 0x302e373334343070, 0xffffffff811bef35, 0x2e2e2f2e2e207461, 0x2f7366752f2e2e2f, 0x5f7366662f736666, 0x40632e73706f6e76, 0xfffffe0036343032} blocksreleased = 0x0 ip = ump = 0xfffff80477b12e00 bo = 0xfffffe014f9b7d30 fs = error = 0x0 waitforupdate = 0x1 allerror = 0x0 needextclean = softdeptrunc = journaltrunc = 0x0 extblocks = osize = 0x6000 bp = 0x80 lbn = 0x0 i = blkno = indiroff = offset = size = level = lastblock = nblocks = bn = count = key = (kgdb) p *vp $2 = {v_type = VDIR, v_irflag = 0x0, v_seqc = 0xb6cce, v_nchash = 0x9ef258f1, v_hash = 0x20055, v_op = 0xffffffff81b66780 , v_data = 0xfffffe014f8bd488, v_mount = 0xfffffe014ec0c280, v_nmntvnodes = {tqe_next = 0xfffffe01509f0708, tqe_prev = 0xfffffe014fa16540}, { v_mountedhere = 0x0, v_unpcb = 0x0, v_rdev = 0x0, v_fifoinfo = 0x0}, v_hashlist = {le_next = 0x0, le_prev = 0xfffffe010c9b48c0}, v_cache_src = { lh_first = 0x0}, v_cache_dst = {tqh_first = 0xfffff804776c7c30, tqh_last = 0xfffff804776c7c40}, v_cache_dd = 0xfffff804776c7c30, v_lock = { lock_object = {lo_name = 0xffffffff811d336f "ufs", lo_flags = 0x6fb0000, lo_data = 0x0, lo_witness = 0xfffff8087fd84080}, lk_lock = 0xfffffe010e606e40, lk_exslpfail = 0x0, lk_pri = 0x60, lk_timo = 0x33, lk_stack = {depth = 0xa, pcs = {0xffffffff80bd3f0f, 0xffffffff80f3fe0d, 0xffffffff811a375c, 0xffffffff80d0e9b4, 0xffffffff80ce6955, 0xffffffff80ce5be8, 0xffffffff80d0dd8c, 0xffffffff80d04ad6, 0xffffffff810d7455, 0xffffffff810a832b, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0}}}, v_interlock = {lock_object = { lo_name = 0xffffffff81324006 "vnode interlock", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xfffff8087fd75500}, mtx_lock = 0x0}, v_vnlock = 0xfffffe014f9b7c28, v_vnodelist = {tqe_next = 0xfffffe014fa16518, tqe_prev = 0xfffffe014f8c08c8}, v_lazylist = { tqe_next = 0xfffffe01509f0708, tqe_prev = 0xfffffe014fa16680}, v_bufobj = {bo_lock = {lock_object = { lo_name = 0xffffffff812dbf67 "bufobj interlock", lo_flags = 0x5230000, lo_data = 0x0, lo_witness = 0xfffff8087fd80800}, rw_lock = 0x1}, bo_ops = 0xffffffff81b25f80 , bo_object = 0xfffff804779cd948, bo_synclist = {le_next = 0xffffffffffffffff, le_prev = 0xffffffffffffffff}, bo_private = 0xfffffe014f9b7bb8, bo_clean = {bv_hd = {tqh_first = 0xfffffe00381f7ce0, tqh_last = 0xfffffe00381f7d40}, bv_root = {pt_root = 0xfffffe00381f7e41}, bv_cnt = 0x1}, bo_dirty = {bv_hd = {tqh_first = 0x0, tqh_last = 0xfffffe014f9b7d98}, bv_root = {pt_root = 0x0}, bv_cnt = 0x0}, bo_numoutput = 0x1, bo_flag = 0x0, bo_domain = 0x0, bo_bsize = 0x8000}, v_pollinfo = 0x0, v_label = 0x0, v_lockf = 0x0, v_rl = {rl_waiters = {tqh_first = 0x0, tqh_last = 0xfffffe014f9b7de0}, rl_currdep = 0x0}, v_holdcnt = 0x2, v_usecount = 0x2, v_iflag = 0x0, v_vflag = 0x0, v_mflag = 0x1, v_dbatchcpu = 0xffff, v_writecount = 0x0, v_seqc_users = 0x0} (kgdb) p *bp Cannot access memory at address 0x80 (kgdb) -- Test scenario: misc/snap11.sh