Fatal trap 12: page fault while in kernel mode, vmcore.374 KDB: debugger backends: ddb KDB: current backend: ddb ---<>--- Copyright (c) 1992-2021 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 14.0-CURRENT #2 main-n248133-616a676a0535-dirty: Wed Jul 21 21:39:09 CEST 2021 pho@mercat1.netperf.freebsd.org:/usr/src/sys/amd64/compile/PHO amd64 FreeBSD clang version 12.0.1 (git@github.com:llvm/llvm-project.git llvmorg-12.0.1-rc2-0-ge7dac564cd0e) WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. VT(vga): resolution 640x480 CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.08-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics real memory = 34359738368 (32768 MB) avail memory = 33174138880 (31637 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 12 CPUs FreeBSD/SMP: 1 package(s) x 6 core(s) x 2 hardware threads random: registering fast source Intel Secure Key RNG random: fast provider: "Intel Secure Key RNG" random: unblocking device. ioapic0 irqs 0-23 ioapic1 irqs 24-47 Launching APs: 1 2 4 8 5 9 6 3 7 10 11 Timecounter "TSC-low" frequency 1750037622 Hz quality 1000 random: entropy device external interface kbd1 at kbdmux0 mlx5en: Mellanox Ethernet driver 3.6.0 (December 2020) vtvga0: smbios0: at iomem 0xf0560-0xf057e smbios0: Version: 2.8, BCD Revision: 2.7 aesni0: acpi0: acpi0: Power Button (fixed) cpu0: on acpi0 atrtc0: port 0x70-0x71,0x74-0x77 irq 8 on acpi0 atrtc0: registered as a time-of-day clock, resolution 1.000000s Event timer "RTC" frequency 32768 Hz quality 0 attimer0: port 0x40-0x43,0x50-0x53 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Event timer "HPET" frequency 14318180 Hz quality 350 Event timer "HPET1" frequency 14318180 Hz quality 340 Event timer "HPET2" frequency 14318180 Hz quality 340 Event timer "HPET3" frequency 14318180 Hz quality 340 Event timer "HPET4" frequency 14318180 Hz quality 340 Event timer "HPET5" frequency 14318180 Hz quality 340 Event timer "HPET6" frequency 14318180 Hz quality 340 Event timer "HPET7" frequency 14318180 Hz quality 340 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 pcib0: on acpi0 pci0: on pcib0 pci0: at device 11.1 (no driver attached) pci0: at device 11.2 (no driver attached) pci0: at device 16.1 (no driver attached) pci0: at device 16.6 (no driver attached) pci0: at device 18.1 (no driver attached) acpi_syscontainer0: on acpi0 acpi_syscontainer1: on acpi0 acpi_syscontainer2: on acpi0 acpi_syscontainer3: on acpi0 apei0: on acpi0 pcib1: port 0xcf8-0xcff on acpi0 pci1: on pcib1 pcib2: irq 26 at device 1.0 on pci1 pci2: on pcib2 pcib3: irq 32 at device 2.0 on pci1 pci3: on pcib3 pci3: at device 0.0 (no driver attached) pci3: at device 0.1 (no driver attached) pcib4: irq 40 at device 3.0 on pci1 pci4: on pcib4 pci1: at device 17.0 (no driver attached) ahci0: port 0xf110-0xf117,0xf100-0xf103,0xf0f0-0xf0f7,0xf0e0-0xf0e3,0xf020-0xf03f mem 0xfb438000-0xfb4387ff irq 16 at device 17.4 on pci1 ahci0: AHCI v1.30 with 4 6Gbps ports, Port Multiplier not supported ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahcich2: at channel 2 on ahci0 ahcich3: at channel 3 on ahci0 ahciem0: on ahci0 xhci0: mem 0xfb400000-0xfb40ffff irq 19 at device 20.0 on pci1 xhci0: 32 bytes context size, 64-bit DMA usbus0 on xhci0 usbus0: 5.0Gbps Super Speed USB v3.0 pci1: at device 22.0 (no driver attached) pci1: at device 22.1 (no driver attached) ehci0: mem 0xfb434000-0xfb4343ff irq 18 at device 26.0 on pci1 usbus1: EHCI version 1.0 usbus1 on ehci0 usbus1: 480Mbps High Speed USB v2.0 pcib5: irq 16 at device 28.0 on pci1 pci5: on pcib5 pcib6: irq 18 at device 28.2 on pci1 pci6: on pcib6 pcib7: at device 0.0 on pci6 pci7: on pcib7 vgapci0: port 0xe000-0xe07f mem 0xfa000000-0xfaffffff,0xfb000000-0xfb01ffff irq 18 at device 0.0 on pci7 vgapci0: Boot video device pcib8: irq 16 at device 28.4 on pci1 pci8: on pcib8 igb0: port 0xd020-0xd03f mem 0xfb320000-0xfb33ffff,0xfb344000-0xfb347fff irq 16 at device 0.0 on pci8 igb0: Using 1024 TX descriptors and 1024 RX descriptors igb0: queue equality override not set, capping rx_queues at 6 and tx_queues at 6 igb0: Using 6 RX queues 6 TX queues igb0: Using MSI-X interrupts with 7 vectors igb0: Ethernet address: 0c:c4:7a:a8:cd:da igb0: netmap queues/slots: TX 6/1024, RX 6/1024 igb1: port 0xd000-0xd01f mem 0xfb300000-0xfb31ffff,0xfb340000-0xfb343fff irq 17 at device 0.1 on pci8 igb1: Using 1024 TX descriptors and 1024 RX descriptors igb1: queue equality override not set, capping rx_queues at 6 and tx_queues at 6 igb1: Using 6 RX queues 6 TX queues igb1: Using MSI-X interrupts with 7 vectors igb1: Ethernet address: 0c:c4:7a:a8:cd:db igb1: netmap queues/slots: TX 6/1024, RX 6/1024 ehci1: mem 0xfb433000-0xfb4333ff irq 18 at device 29.0 on pci1 usbus2: EHCI version 1.0 usbus2 on ehci1 usbus2: 480Mbps High Speed USB v2.0 isab0: at device 31.0 on pci1 isa0: on isab0 ahci1: port 0xf070-0xf077,0xf060-0xf063,0xf050-0xf057,0xf040-0xf043,0xf000-0xf01f mem 0xfb432000-0xfb4327ff irq 16 at device 31.2 on pci1 ahci1: AHCI v1.30 with 6 6Gbps ports, Port Multiplier not supported ahcich4: at channel 0 on ahci1 ahcich5: at channel 1 on ahci1 ahcich6: at channel 2 on ahci1 ahcich7: at channel 3 on ahci1 ahcich8: at channel 4 on ahci1 ahcich9: at channel 5 on ahci1 ahciem1: on ahci1 acpi_button0: on acpi0 uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0 uart1: console (115200,n,8,1) orm0: at iomem 0xc0000-0xc7fff,0xcb000-0xcbfff pnpid ORM0000 on isa0 est0: on cpu0 NULL mp in getnewvnode(9), tag crossmp Timecounters tick every 1.000 msec Expensive timeout(9) function: 0xffffffff80510d60(0xfffffe0109f7a000) 0.004846698 s ses0 at ahciem0 bus 0 scbus4 target 0 lun 0 ses0: SEMB S-E-S 2.00 device ses0: SEMB SES Device ses1 at ahciem1 bus 0 scbus11 target 0 lun 0 ses1: SEMB S-E-S 2.00 device ses1: SEMB SES Device ses0: pass0 in 'Slot 01', SATA Slot: scbus1 target 0 ada0 at ahcich1 bus 0 scbus1 target 0 lun 0 ada0: ACS-2 ATA SATA 3.x device ada0: Serial Number WD-WCC3F3KDDP98 ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes) ada0: Command Queueing enabled ada0: 953869MB (1953525168 512 byte sectors) ada0: quirks=0x1<4K> Expensive timeout(9) function: 0xffffffff80a754c0(0xffffffff81aea0c8) 0.007387565 s mlx5_core0: mem 0xf8000000-0xf9ffffff irq 32 at device 0.0 on pci3 ugen2.1: at usbus2 ugen1.1: at usbus1 ugen0.1: <0x8086 XHCI root HUB> at usbus0 uhub0 on usbus2 uhub0: on usbus2 uhub1 on usbus0 uhub1: <0x8086 XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0 uhub2 on usbus1 uhub2: on usbus1 mlx5_core0: WARN: mlx5_vsc_set_space:124:(pid 0): Space 0x7 is not supported. mlx5_core0: WARN: mlx5_fwdump_prep:99:(pid 0): VSC scan space is not supported mlx5_core0: INFO: init_one:1613:(pid 0): cannot find SR-IOV PCIe cap mlx5_core: INFO: (mlx5_core0): E-Switch: Total vports 1, l2 table size(65536), per vport: max uc(1024) max mc(16384) mlx5_core0: Failed to initialize SR-IOV support, error 2 mlx5_core1: mem 0xf6000000-0xf7ffffff irq 32 at device 0.1 on pci3 ING: DIAGNOSTIC option enabled, expect reduced performance. WARNING: / was not properly dismounted Dual Console: Serial Primary, Video Secondary ugen0.3: at usbus0 ukbd0 on uhub3 ukbd0: on usbus0 kbd2 at ukbd0 fscklock order reversal: 1st 0xfffff80003c9c958 ufs (ufs, lockmgr) @ kern/vfs_mount.c:2052 2nd 0xfffff80009b47070 devfs (devfs, lockmgr) @ kern/vfs_subr.c:3254 lock order devfs -> ufs established at: #0 0xffffffff80c92149 at witness_checkorder+0x459 #1 0xffffffff80bf2178 at lockmgr_lock_flags+0x178 #2 0xffffffff80f4e30d at ffs_lock+0x9d #3 0xffffffff811b413c at VOP_LOCK1_APV+0x3c #4 0xffffffff80d283d4 at _vn_lock+0x54 #5 0xffffffff80d05c6b at vfs_domount+0xf5b #6 0xffffffff80d03810 at vfs_donmount+0x880 #7 0xffffffff80d08c17 at kernel_mount+0x57 #8 0xffffffff80d0b7e1 at parse_mount+0x4b1 #9 0xffffffff80d09ec3 at vfs_mountroot+0x7b3 #10 0xffffffff80bae96f at start_init+0x1f #11 0xffffffff80bdbba0 at fork_exit+0x80 #12 0xffffffff810bb4fe at fork_trampoline+0xe lock order ufs -> devfs attempted at: #0 0xffffffff80c92a7f at witness_checkorder+0xd8f #1 0xffffffff80bf2178 at lockmgr_lock_flags+0x178 #2 0xffffffff811b413c at VOP_LOCK1_APV+0x3c #3 0xffffffff80d283d4 at _vn_lock+0x54 #4 0xffffffff80d107f2 at vput_final+0x172 #5 0xffffffff80f4bf6d at ffs_unmount+0x38d #6 0xffffffff80d07102 at dounmount+0x812 #7 0xffffffff80d0687d at kern_unmount+0x2fd #8 0xffffffff810ea9c7 at amd64_syscall+0x147 #9 0xffffffff810bad9e at fast_syscall_common+0xf8 ** /dev/gpt/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 116 files, 227 used, 1265180 free (68 frags, 158139 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** Updating CPU Microcode... CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.08-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab Structured Extended Features3=0x9c000400 XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics Done. ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat/pkg /usr/local/lib/compat /usr/local/lib/compat/pkg /usr/local/lib/e2fsprogs /usr/local/lib/gcc10 /usr/local/lib/gcc8 /usr/local/lib/gcc9 /usr/local/lib/perl5/5.32/mach/CORE 32-bit compatibility ldconfig path: /usr/lib32 /usr/local/lib32/compat Setting hostname: mercat1.netperf.freebsd.org. Setting up harvesting: PURE_RDRAND,[UMA],[FS_ATIME],SWI,INTERRUPT,NET_NG,[NET_ETHER],NET_TUN,MOUSE,KEYBOARD,ATTACH,CACHED Feeding entropy: . Autoloading module: acpi_wmi.ko Autoloading module: ichsmb.ko Autoloading module: ioat.ko ioat0: mem 0xfb42c000-0xfb42ffff irq 31 at device 4.0 on pci1 ioat0: Capabilities: 2f7 ioat1: mem 0xfb428000-0xfb42bfff irq 39 at device 4.1 on pci1 ioat1: Capabilities: 2f7 ioat2: mem 0xfb424000-0xfb427fff irq 31 at device 4.2 on pci1 ioat2: Capabilities: f7 ioat3: mem 0xfb420000-0xfb423fff irq 39 at device 4.3 on pci1 ioat3: Capabilities: f7 ioat4: mem 0xfb41c000-0xfb41ffff irq 31 at device 4.4 on pci1 ioat4: Capabilities: f7 ioat5: mem 0xfb418000-0xfb41bfff irq 39 at device 4.5 on pci1 ioat5: Capabilities: f7 ioat6: mem 0xfb414000-0xfb417fff irq 31 at device 4.6 on pci1 ioat6: Capabilities: f7 ioat7: mem 0xfb410000-0xfb413fff irq 39 at device 4.7 on pci1 ioat7: Capabilities: f7 ichsmb0: port 0x580-0x59f mem 0xfb431000-0xfb4310ff irq 18 at device 31.3 on pci1 smbus0: on ichsmb0 acpi_wmi0: on acpi0 acpi_wmi0: cannot find EC device lo0: link state changed to UP Autoloading module: acpi_wmi.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Starting Network: igb1. igb1: flags=8822 metric 0 mtu 1500 options=4e507bb ether 0c:c4:7a:a8:cd:db media: Ethernet autoselect status: no carrier nd6 options=29 Autoloading module: ichsmb.ko Starting Network: mce0. mce0: flags=8822 metric 0 mtu 1500 options=7eed07bb ether 7c:fe:90:30:ee:38 media: Ethernet autoselect status: no carrier nd6 options=29 Starting Network: mce1. mce1: flags=8822 metric 0 mtu 1500 options=7eed07bb ether 7c:fe:90:30:ee:39 media: Ethernet autoselect status: no carrier nd6 options=29 Autoloading module: uhid.ko Autoloading module: ums.ko Autoloading module: usbhid.ko ums0 on uhub3 ums0: on usbus0 ums0: 3 buttons and [Z] coordinates ID=0 Starting dhclient. DHCPREQUEST on igb0 to 255.255.255.255 port 67 DHCPACK from 192if_delmulti_locked: detaching ifnet instance 0xfffff80004395800 .168.5.1 bound to 192.168.5.171 -- renewal in 300 seconds. add host 127.0.0.1: gateway lo0 fib 0: route already in table add host ::1: gateway lo0 fib 0: route already in table add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Creating and/or trimming log files. Recovering vi editor sessions:. Updating motd:. Clearing /tmp (X related). Starting syslogd. Starting watchdogd. No core dumps found. Setting date via ntp. 21 Jul 21:43:34 ntpdate[2615]: step time server 192.168.5.1 offset -0.507898 sec Starting rpcbind. NFS access cache time=60 Starting statd. Starting lockd. Starting powerd. Security policy loaded: MAC/ntpd (mac_ntpd) Starting ntpd. Mounting late filesystems:. Starting inetd. Configuring vt: blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting cron. sysctl: unknown oid 'debug.fail_point.pmap_allocpte_page_alloc' at line 12 Wed Jul 21 21:43 FreeBSD/amd64 (mercat1.netperf.freebsd.org) (ttyu1) login: Jul 21 21:43:41 mercat1 su[2767]: pho to root on /dev/pts/0 20210721 21:44:03 all (1/1): force4.sh UFS: forcibly unmounting /dev/md10 from /mnt 20210721 21:44:39 all (1/1): force4.sh UFS: forcibly unmounting /dev/md10 from /mnt 20210721 21:45:18 all (1/1): force4.sh UFS: forcibly unmounting /dev/md10 from /mnt 20210721 21:45:49 all (1/1): force4.sh UFS: forcibly unmounting /dev/md10 from /mnt 20210721 21:46:38 all (1/1): force4.sh UFS: forcibly unmounting /dev/md10 from /mnt 20210721 21:47:28 all (1/1): force4.sh UFS: forcibly unmounting /dev/md10 from /mnt 20210721 21:48:08 all (1/1): force4.sh Jul 21 21:48:22 mercat1 kernel: pid 16433 (mmap), uid 2007 inumber 57494 on /mnt: filesystem full Jul 21 21:48:28 mercat1 kernel: pid 16429 (link), uid 2007 inumber 33047 on /mnt: filesystem full UFS: forcibly unmounting /dev/md10 from /mnt 20210721 21:48:58 all (1/1): force4.sh Jul 21 21:49:06 mercat1 kernel: pid 19460 (mmap), uid 2007 inumber 47617 on /mnt: filesystem full Jul 21 21:49:19 mercat1 kernel: pid 19394 (mmap), uid 2007 inumber 51610 on /mnt: filesystem full UFS: forcibly unmounting /dev/md10 from /mnt 20210721 21:50:01 all (1/1): force4.sh UFS: forcibly unmounting /dev/md10 from /mnt 20210721 21:50:59 all (1/1): force4.sh UFS: forcibly unmounting /dev/md10 from /mnt 20210721 21:51:40 all (1/1): force4.sh Jul 21 21:51:56 mercat1 kernel: pid 25411 (openat), uid 2007 inumber 65827 on /mnt: out of inodes UFS: forcibly unmounting /dev/md10 from /mnt 20210721 21:52:27 all (1/1): force4.sh UFS: forcibly unmounting /dev/md10 from /mnt 20210721 21:53:14 all (1/1): force4.sh UFS: forcibly unmounting /dev/md10 from /mnt 20210721 21:54:04 all (1/1): force4.sh UFS: forcibly unmounting /dev/md10 from /mnt 20210721 21:54:52 all (1/1): force4.sh UFS: forcibly unmounting /dev/md10 from /mnt 20210721 21:55:58 all (1/1): force4.sh UFS: forcibly unmounting /dev/md10 from /mnt 20210721 21:56:41 all (1/1): force4.sh UFS: forcibly unmounting /dev/md10 from /mnt 20210721 21:57:27 all (1/1): force4.sh UFS: forcibly unmounting /dev/md10 from /mnt 20210721 21:58:34 all (1/1): force4.sh Jul 21 21:58:44 mercat1 kernel: pid 38356 (rw), uid 2007 inumber 36876 on /mnt: filesystem full Jul 21 21:59:08 mercat1 kernel: pid 38443 (link), uid 2007 inumber 32935 on /mnt: filesystem full Jul 21 21:59:16 mercat1 kernel: pid 38349 (mmap), uid 2007 inumber 53742 on /mnt: filesystem full UFS: forcibly unmounting /dev/md10 from /mnt 20210721 21:59:26 all (1/1): force4.sh UFS: forcibly unmounting /dev/md10 from /mnt 20210721 22:00:16 all (1/1): force4.sh Jul 21 22:00:34 mercat1 kernel: pid 41624 (creat), uid 2007 inumber 65808 on /mnt: out of inodes UFS: forcibly unmounting /dev/md10 from /mnt 20210721 22:00:51 all (1/1): force4.sh UFS: forcibly unmounting /dev/md10 from /mnt 20210721 22:01:47 all (1/1): force4.sh UFS: forcibly unmounting /dev/md10 from /mnt stress2: newblk leak: 2050/2055. stress2: mount leak: 13/44 20210721 22:02:40 all (1/1): force4.sh Jul 21 22:02:57 mercat1 kernel: pid 49947 (mkdir), uid 2007 inumber 131580 on /mnt: out of inodes UFS: forcibly unmounting /dev/md10 from /mnt stress2: freework leak: 827/832. stress2: newblk leak: 708/714. stress2: mount leak: 13/44 stress2: GEOM leak: 4/77 20210721 22:03:35 all (1/1): force4.sh UFS: forcibly unmounting /dev/md10 from /mnt 20210721 22:04:34 all (1/1): force4.sh Jul 21 22:04:46 mercat1 kernel: pid 53249 (rw), uid 2007 inumber 78718 on /mnt: filesystem full Jul 21 22:05:03 mercat1 kernel: pid 53271 (mmap), uid 2007 inumber 48547 on /mnt: filesystem full UFS: forcibly unmounting /dev/md10 from /mnt 20210721 22:05:26 all (1/1): force4.sh UFS: forcibly unmounting /dev/md10 from /mnt 20210721 22:06:30 all (1/1): force4.sh Jul 21 22:06:43 mercat1 kernel: pid 56852 (rw), uid 2007 inumber 69195 on /mnt: filesystem full Jul 21 22:07:15 mercat1 kernel: pid 56840 (rw), uid 2007 inumber 65826 on /mnt: filesystem full UFS: forcibly unmounting /dev/md10 from /mnt 20210721 22:07:28 all (1/1): force4.sh g_vfs_done():md10[WRITE(offset=15531520, length=32768)]error = 6 UFS: forcibly unmounting /dev/md10 from /mnt 20210721 22:08:13 all (1/1): force4.sh UFS: forcibly unmounting /dev/md10 from /mnt 20210721 22:09:00 all (1/1): force4.sh UFS: forcibly unmounting /dev/md10 from /mnt 20210721 22:09:37 all (1/1): force4.sh Jul 21 22:09:51 mercat1 kernel: pid 65661 (openat), uid 2007 inumber 32992 on /mnt: out of inodes UFS: forcibly unmounting /dev/md10 from /mnt 20210721 22:10:27 all (1/1): force4.sh UFS: forcibly unmounting /dev/md10 from /mnt Fatal trap 12: page fault while in kernel mode cpuid = 9; apic id = 09 fault virtual address = 0x0 fault code = supervisor read data, page not present instruction pointer = 0x20:0xffffffff80ab9179 stack pointer = 0x28:0xfffffe00e4880670 frame pointer = 0x28:0xfffffe00e48806a0 code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags = interrupt enabled, resume, IOPL = 0 current process = 0 (deferred_unmount ta) trap number = 12 panic: page fault cpuid = 9 time = 1626898287 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e4880310 vpanic() at vpanic+0x187/frame 0xfffffe00e4880370 panic() at panic+0x43/frame 0xfffffe00e48803d0 trap_fatal() at trap_fatal+0x387/frame 0xfffffe00e4880430 trap_pfault() at trap_pfault+0x99/frame 0xfffffe00e4880490 trap() at trap+0x2a7/frame 0xfffffe00e48805a0 calltrap() at calltrap+0x8/frame 0xfffffe00e48805a0 --- trap 0xc, rip = 0xffffffff80ab9179, rsp = 0xfffffe00e4880670, rbp = 0xfffffe00e48806a0 --- fifo_close() at fifo_close+0x19/frame 0xfffffe00e48806a0 VOP_CLOSE_APV() at VOP_CLOSE_APV+0x56/frame 0xfffffe00e48806c0 null_bypass() at null_bypass+0x12b/frame 0xfffffe00e4880840 VOP_CLOSE_APV() at VOP_CLOSE_APV+0x56/frame 0xfffffe00e4880860 vgonel() at vgonel+0x243/frame 0xfffffe00e48808c0 vflush() at vflush+0x321/frame 0xfffffe00e4880a00 nullfs_unmount() at nullfs_unmount+0x51/frame 0xfffffe00e4880a40 dounmount() at dounmount+0x812/frame 0xfffffe00e4880ab0 vfs_deferred_unmount() at vfs_deferred_unmount+0xf9/frame 0xfffffe00e4880b00 taskqueue_run_locked() at taskqueue_run_locked+0xaa/frame 0xfffffe00e4880b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc2/frame 0xfffffe00e4880bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4880bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4880bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- KDB: enter: panic [ thread pid 0 tid 100044 ] Stopped at kdb_enter+0x37: movq $0,0x1279bce(%rip) db> db> run pho db:0:pho> set $lines 20000 db:0:pho> run pho1 db:1:pho1> dump Dumping 1991 out of 32624 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% Dump complete db:1:pho1> bt Tracing pid 0 tid 100044 td 0xfffffe00e4ce5900 kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e4880310 vpanic() at vpanic+0x1b8/frame 0xfffffe00e4880370 panic() at panic+0x43/frame 0xfffffe00e48803d0 trap_fatal() at trap_fatal+0x387/frame 0xfffffe00e4880430 trap_pfault() at trap_pfault+0x99/frame 0xfffffe00e4880490 trap() at trap+0x2a7/frame 0xfffffe00e48805a0 calltrap() at calltrap+0x8/frame 0xfffffe00e48805a0 --- trap 0xc, rip = 0xffffffff80ab9179, rsp = 0xfffffe00e4880670, rbp = 0xfffffe00e48806a0 --- fifo_close() at fifo_close+0x19/frame 0xfffffe00e48806a0 VOP_CLOSE_APV() at VOP_CLOSE_APV+0x56/frame 0xfffffe00e48806c0 null_bypass() at null_bypass+0x12b/frame 0xfffffe00e4880840 VOP_CLOSE_APV() at VOP_CLOSE_APV+0x56/frame 0xfffffe00e4880860 vgonel() at vgonel+0x243/frame 0xfffffe00e48808c0 vflush() at vflush+0x321/frame 0xfffffe00e4880a00 nullfs_unmount() at nullfs_unmount+0x51/frame 0xfffffe00e4880a40 dounmount() at dounmount+0x812/frame 0xfffffe00e4880ab0 vfs_deferred_unmount() at vfs_deferred_unmount+0xf9/frame 0xfffffe00e4880b00 taskqueue_run_locked() at taskqueue_run_locked+0xaa/frame 0xfffffe00e4880b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc2/frame 0xfffffe00e4880bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4880bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4880bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:1:pho1> show allpcpu Current CPU: 9 cpuid = 0 dynamic pcpu = 0x9b4bc0 curthread = 0xfffffe014406f1e0: pid 68312 tid 100579 critnest 0 "mkdir" curpcb = 0xfffffe014406f6f0 fpcurthread = 0xfffffe014406f1e0: pid 68312 "mkdir" idlethread = 0xfffffe00e4c5b3a0: tid 100003 "idle: cpu0" self = 0xffffffff82610000 curpmap = 0xfffffe0145a3f500 tssp = 0xffffffff82610384 rsp0 = 0xfffffe0144472cc0 kcr3 = 0x800000044e52a11e ucr3 = 0x8000000362fae91e scr3 = 0x820df6f71 gs32p = 0xffffffff82610404 ldt = 0xffffffff82610444 tss = 0xffffffff82610434 curvnet = 0 spin locks held: cpuid = 1 dynamic pcpu = 0xfffffe00bb288bc0 curthread = 0xfffffe0146757c80: pid 68332 tid 100501 critnest 0 "symlink" curpcb = 0xfffffe0146758190 fpcurthread = 0xfffffe0146757c80: pid 68332 "symlink" idlethread = 0xfffffe00e4c5ac80: tid 100004 "idle: cpu1" self = 0xffffffff82611000 curpmap = 0xfffffe01440e8120 tssp = 0xffffffff82611384 rsp0 = 0xfffffe0145785cc0 kcr3 = 0x80000003574b4751 ucr3 = 0x800000004f414f51 scr3 = 0x24d25cf4b gs32p = 0xffffffff82611404 ldt = 0xffffffff82611444 tss = 0xffffffff82611434 curvnet = 0 spin locks held: cpuid = 2 dynamic pcpu = 0xfffffe00bb295bc0 curthread = 0xfffffe0144104900: pid 68331 tid 100441 critnest 0 "lockf" curpcb = 0xfffffe0144104e10 fpcurthread = 0xfffffe0144104900: pid 68331 "lockf" idlethread = 0xfffffe00e4c5a560: tid 100005 "idle: cpu2" self = 0xffffffff82612000 curpmap = 0xfffffe0143fd4b10 tssp = 0xffffffff82612384 rsp0 = 0xfffffe0145668cc0 kcr3 = 0x800000004fcf83f7 ucr3 = 0x80000005248a6bf7 scr3 = 0x799f20be8 gs32p = 0xffffffff82612404 ldt = 0xffffffff82612444 tss = 0xffffffff82612434 curvnet = 0 spin locks held: cpuid = 3 dynamic pcpu = 0xfffffe00bb2a2bc0 curthread = 0xfffffe01485dd900: pid 68291 tid 100571 critnest 0 "rename" curpcb = 0xfffffe01485dde10 fpcurthread = 0xfffffe01485dd900: pid 68291 "rename" idlethread = 0xfffffe00e4c59e40: tid 100006 "idle: cpu3" self = 0xffffffff82613000 curpmap = 0xfffffe014359e500 tssp = 0xffffffff82613384 rsp0 = 0xfffffe0147af3cc0 kcr3 = 0x800000017e99d20f ucr3 = 0x8000000332dfca0f scr3 = 0x4fbb1d5c gs32p = 0xffffffff82613404 ldt = 0xffffffff82613444 tss = 0xffffffff82613434 curvnet = 0 spin locks held: cpuid = 4 dynamic pcpu = 0xfffffe00bb2afbc0 curthread = 0xfffffe01478aa1e0: pid 68380 tid 100517 critnest 0 "creat" curpcb = 0xfffffe01478aa6f0 fpcurthread = 0xfffffe01478aa1e0: pid 68380 "creat" idlethread = 0xfffffe00e4c59720: tid 100007 "idle: cpu4" self = 0xffffffff82614000 curpmap = 0xfffffe0143fc4b10 tssp = 0xffffffff82614384 rsp0 = 0xfffffe01457e4cc0 kcr3 = 0x8000000524daa4a4 ucr3 = 0x8000000327bdaca4 scr3 = 0x4f7edf8e gs32p = 0xffffffff82614404 ldt = 0xffffffff82614444 tss = 0xffffffff82614434 curvnet = 0 spin locks held: cpuid = 5 dynamic pcpu = 0xfffffe00bb2bcbc0 curthread = 0xfffffe01499c0c80: pid 68371 tid 100600 critnest 0 "dirnprename" curpcb = 0xfffffe01499c1190 fpcurthread = 0xfffffe01499c0c80: pid 68371 "dirnprename" idlethread = 0xfffffe00e4c59000: tid 100008 "idle: cpu5" self = 0xffffffff82615000 curpmap = 0xfffffe0143fc4120 tssp = 0xffffffff82615384 rsp0 = 0xfffffe0147b92cc0 kcr3 = 0x80000005f052b790 ucr3 = 0x800000053c845f90 scr3 = 0x542365f7b gs32p = 0xffffffff82615404 ldt = 0xffffffff82615444 tss = 0xffffffff82615434 curvnet = 0 spin locks held: cpuid = 6 dynamic pcpu = 0xfffffe00bb2c9bc0 curthread = 0xfffffe010e59a740: pid 68336 tid 100253 critnest 0 "dirnprename" curpcb = 0xfffffe010e59ac50 fpcurthread = 0xfffffe010e59a740: pid 68336 "dirnprename" idlethread = 0xfffffe00e4c5d740: tid 100009 "idle: cpu6" self = 0xffffffff82616000 curpmap = 0xfffffe0149977b10 tssp = 0xffffffff82616384 rsp0 = 0xfffffe014163acc0 kcr3 = 0x80000005a71a3027 ucr3 = 0x8000000820ae2827 scr3 = 0x3576dbe76 gs32p = 0xffffffff82616404 ldt = 0xffffffff82616444 tss = 0xffffffff82616434 curvnet = 0 spin locks held: cpuid = 7 dynamic pcpu = 0xfffffe00bb2d6bc0 curthread = 0xfffffe0145906e40: pid 68407 tid 100544 critnest 0 "dirrename" curpcb = 0xfffffe0145907350 fpcurthread = 0xfffffe0145906e40: pid 68407 "dirrename" idlethread = 0xfffffe00e4c5d020: tid 100010 "idle: cpu7" self = 0xffffffff82617000 curpmap = 0xfffffe01478a5b10 tssp = 0xffffffff82617384 rsp0 = 0xfffffe0147a74cc0 kcr3 = 0x8000000436bdc17a ucr3 = 0x8000000524aad97a scr3 = 0x820005c6b gs32p = 0xffffffff82617404 ldt = 0xffffffff82617444 tss = 0xffffffff82617434 curvnet = 0 spin locks held: cpuid = 8 dynamic pcpu = 0xfffffe00bb2e3bc0 curthread = 0xfffffe01440ce3a0: pid 68328 tid 100406 critnest 0 "rename" curpcb = 0xfffffe01440ce8b0 fpcurthread = 0xfffffe01440ce3a0: pid 68328 "rename" idlethread = 0xfffffe00e4c5c900: tid 100011 "idle: cpu8" self = 0xffffffff82618000 curpmap = 0xfffffe01440fbb10 tssp = 0xffffffff82618384 rsp0 = 0xfffffe01445afcc0 kcr3 = 0x80000003272d8423 ucr3 = 0x800000017ef9fc23 scr3 = 0x6240bff2f gs32p = 0xffffffff82618404 ldt = 0xffffffff82618444 tss = 0xffffffff82618434 curvnet = 0 spin locks held: cpuid = 9 dynamic pcpu = 0xfffffe00bb2f0bc0 curthread = 0xfffffe00e4ce5900: pid 0 tid 100044 critnest 1 "deferred_unmount ta" curpcb = 0xfffffe00e4ce5e10 fpcurthread = none idlethread = 0xfffffe00e4c611e0: tid 100012 "idle: cpu9" self = 0xffffffff82619000 curpmap = 0xffffffff81e9cc50 tssp = 0xffffffff82619384 rsp0 = 0xfffffe00e4880cc0 kcr3 = 0x800000000255500f ucr3 = 0xffffffffffffffff scr3 = 0x820df6f73 gs32p = 0xffffffff82619404 ldt = 0xffffffff82619444 tss = 0xffffffff82619434 curvnet = 0 spin locks held: cpuid = 10 dynamic pcpu = 0xfffffe00bb2fdbc0 curthread = 0xfffffe0145906720: pid 68376 tid 100545 critnest 0 "mkfifo" curpcb = 0xfffffe0145906c30 fpcurthread = 0xfffffe0145906720: pid 68376 "mkfifo" idlethread = 0xfffffe00e4c60ac0: tid 100013 "idle: cpu10" self = 0xffffffff8261a000 curpmap = 0xfffffe0149978500 tssp = 0xffffffff8261a384 rsp0 = 0xfffffe0147a6fcc0 kcr3 = 0x80000006240d66e9 ucr3 = 0x80000005a7905ee9 scr3 = 0x799eecfc2 gs32p = 0xffffffff8261a404 ldt = 0xffffffff8261a444 tss = 0xffffffff8261a434 curvnet = 0 spin locks held: cpuid = 11 dynamic pcpu = 0xfffffe00bb30abc0 curthread = 0xfffffe01478bb020: pid 68388 tid 100537 critnest 0 "dirrename" curpcb = 0xfffffe01478bb530 fpcurthread = 0xfffffe01478bb020: pid 68388 "dirrename" idlethread = 0xfffffe00e4c603a0: tid 100014 "idle: cpu11" self = 0xffffffff8261b000 curpmap = 0xfffffe01440a1120 tssp = 0xffffffff8261b384 rsp0 = 0xfffffe0147a56cc0 kcr3 = 0x800000004a6f1299 ucr3 = 0x800000014c0caa99 scr3 = 0x4fbb0ca6 gs32p = 0xffffffff8261b404 ldt = 0xffffffff8261b444 tss = 0xffffffff8261b434 curvnet = 0 spin locks held: db:1:pho1> show alllocks Process 68386 (rename) thread 0xfffffe01478b93a0 (100534) exclusive lockmgr ufs (ufs) r = 0 (0xfffff8053c81f070) locked @ kern/vfs_subr.c:3012 Process 68304 (rw) thread 0xfffffe010e596720 (100509) exclusive lockmgr ufs (ufs) r = 0 (0xfffff80821b84368) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:732 Process 68293 (rw) thread 0xfffffe0144097560 (100383) exclusive lockmgr ufs (ufs) r = 0 (0xfffff8017f69ec50) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:732 Process 68280 (rw) thread 0xfffffe01441033a0 (100433) exclusive lockmgr ufs (ufs) r = 0 (0xfffff80821ad0c50) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:732 Process 2653 (rpc.lockd) thread 0xfffffe0143e851e0 (100297) exclusive sleep mutex sg_lock (sg_lock) r = 0 (0xfffff80074dfa100) locked @ rpc/svc.c:1088 Process 32 (bufdaemon) thread 0xfffffe014789e720 (100636) exclusive lockmgr ufs (ufs) r = 0 (0xfffff80608117660) locked @ kern/vfs_subr.c:3012 Process 1 (init) thread 0xfffffe00e4c5bac0 (100002) exclusive sx proctree (proctree) r = 0 (0xffffffff81a02a40) locked @ kern/kern_exit.c:1280 Process 0 (kernel) thread 0xfffffe00e4ce5900 (100044) exclusive lockmgr ufs (ufs) r = 0 (0xfffff806f83ff958) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:732 exclusive lockmgr ufs (ufs) r = 0 (0xfffff802d64d4070) locked @ kern/vfs_mount.c:2052 db:1:pho1> show lockedvnods Locked vnodes vnode 0xfffff802d64d4000: type VDIR usecount 1, writecount 0, refcount 2 seqc users 1 mountedhere 0xfffffe010e59fb80 hold count flags () flags (VIRF_MOUNTPOINT|VMP_LAZYLIST) lock type ufs: EXCL by thread 0xfffffe00e4ce5900 (pid 0, kernel, tid 100044) #0 0xffffffff80bf21e7 at lockmgr_lock_flags+0x1e7 #1 0xffffffff80f4e30d at ffs_lock+0x9d #2 0xffffffff811b413c at VOP_LOCK1_APV+0x3c #3 0xffffffff80d283d4 at _vn_lock+0x54 #4 0xffffffff80d06d69 at dounmount+0x479 #5 0xffffffff80d092c9 at vfs_deferred_unmount+0xf9 #6 0xffffffff80c849ca at taskqueue_run_locked+0xaa #7 0xffffffff80c85a52 at taskqueue_thread_loop+0xc2 #8 0xffffffff80bdbba0 at fork_exit+0x80 #9 0xffffffff810bb4fe at fork_trampoline+0xe nlink=2, effnlink=2, size=512, extsize 0 generation=2ea67e80, uid=0, gid=0, flags=0x0 ino 97671552, on dev gpt/work vnode 0xfffff806081175f0: type VLNK usecount 0, writecount 0, refcount 1 seqc users 0 hold count flags () flags (VI_DOINGINACT|VMP_LAZYLIST) lock type ufs: EXCL by thread 0xfffffe014789e720 (pid 32, bufdaemon, tid 100636) #0 0xffffffff80bf21e7 at lockmgr_lock_flags+0x1e7 #1 0xffffffff80f4e30d at ffs_lock+0x9d #2 0xffffffff811b413c at VOP_LOCK1_APV+0x3c #3 0xffffffff80d283d4 at _vn_lock+0x54 #4 0xffffffff80d1006a at vget_finish+0x7a #5 0xffffffff80cfe50c at vfs_hash_get+0xbc #6 0xffffffff80f49188 at ffs_vgetf+0x58 #7 0xffffffff80f3a6c0 at handle_workitem_remove+0x50 #8 0xffffffff80f2ef5d at process_worklist_item+0x2bd #9 0xffffffff80f29ac7 at softdep_process_worklist+0xb7 #10 0xffffffff80f2d71f at softdep_flush+0x10f #11 0xffffffff80bdbba0 at fork_exit+0x80 #12 0xffffffff810bb4fe at fork_trampoline+0xe nlink=0, effnlink=0, size=0, extsize 0 generation=b6c2eaef, uid=2007, gid=0, flags=0x0 ino 127441, on dev md10 vnode 0xfffff8053c81f000: type VLNK usecount 1, writecount 0, refcount 1 seqc users 0 hold count flags () flags (VMP_LAZYLIST) lock type ufs: EXCL by thread 0xfffffe01478b93a0 (pid 68386, rename, tid 100534) #0 0xffffffff80bf21e7 at lockmgr_lock_flags+0x1e7 #1 0xffffffff80f4e30d at ffs_lock+0x9d #2 0xffffffff811b413c at VOP_LOCK1_APV+0x3c #3 0xffffffff80d283d4 at _vn_lock+0x54 #4 0xffffffff80d1006a at vget_finish+0x7a #5 0xffffffff80cfe50c at vfs_hash_get+0xbc #6 0xffffffff80f49188 at ffs_vgetf+0x58 #7 0xffffffff80f3a6c0 at handle_workitem_remove+0x50 #8 0xffffffff80f2ef5d at process_worklist_item+0x2bd #9 0xffffffff80f2f47f at softdep_prelink+0x2cf #10 0xffffffff80f63589 at ufs_makeinode+0xb9 #11 0xffffffff80f5f274 at ufs_create+0x34 #12 0xffffffff811b0cc2 at VOP_CREATE_APV+0x62 #13 0xffffffff8274b17b at null_bypass+0x12b #14 0xffffffff811b0cc2 at VOP_CREATE_APV+0x62 #15 0xffffffff80d27829 at vn_open_cred+0x2b9 #16 0xffffffff80d1e6cc at kern_openat+0x28c #17 0xffffffff810ea9c7 at amd64_syscall+0x147 nlink=0, effnlink=0, size=0, extsize 0 generation=41ad7f07, uid=2007, gid=0, flags=0x0 ino 14361, on dev md10 vnode 0xfffff806f83ff8e8: type VFIFO usecount 1, writecount 0, refcount 3 seqc users 1 fifoinfo 0 hold count flags () flags () lock type ufs: EXCL by thread 0xfffffe00e4ce5900 (pid 0, kernel, tid 100044) #0 0xffffffff80bf21e7 at lockmgr_lock_flags+0x1e7 #1 0xffffffff80f4e30d at ffs_lock+0x9d #2 0xffffffff811b413c at VOP_LOCK1_APV+0x3c #3 0xffffffff8274bbe3 at null_lock+0xd3 #4 0xffffffff811b413c at VOP_LOCK1_APV+0x3c #5 0xffffffff80d283d4 at _vn_lock+0x54 #6 0xffffffff80d11460 at vflush+0xd0 #7 0xffffffff8274ac31 at nullfs_unmount+0x51 #8 0xffffffff80d07102 at dounmount+0x812 #9 0xffffffff80d092c9 at vfs_deferred_unmount+0xf9 #10 0xffffffff80c849ca at taskqueue_run_locked+0xaa #11 0xffffffff80c85a52 at taskqueue_thread_loop+0xc2 #12 0xffffffff80bdbba0 at fork_exit+0x80 #13 0xffffffff810bb4fe at fork_trampoline+0xe nlink=1, effnlink=1, size=0, extsize 0 generation=4a3c2e55, uid=2007, gid=0, flags=0x0 ino 123310, on dev md10, NULL v_fifoinfo vnode 0xfffff8017f69ebe0: type VREG usecount 1, writecount 1, refcount 238 seqc users 0 hold count flags () flags (VIRF_PGREAD|VMP_LAZYLIST) v_object 0xfffff80696384d68 ref 0 pages 1888 cleanbuf 235 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe0144097560 (pid 68293, rw, tid 100383) #0 0xffffffff80bf21e7 at lockmgr_lock_flags+0x1e7 #1 0xffffffff80f4e30d at ffs_lock+0x9d #2 0xffffffff811b413c at VOP_LOCK1_APV+0x3c #3 0xffffffff8274bbe3 at null_lock+0xd3 #4 0xffffffff811b413c at VOP_LOCK1_APV+0x3c #5 0xffffffff80d283d4 at _vn_lock+0x54 #6 0xffffffff80d2cbb1 at vn_write+0x1d1 #7 0xffffffff80d2c5b3 at vn_io_fault_doio+0x43 #8 0xffffffff80d28b93 at vn_io_fault1+0x163 #9 0xffffffff80d2669a at vn_io_fault+0x1ba #10 0xffffffff80c97ef1 at dofilewrite+0x81 #11 0xffffffff80c97a50 at sys_write+0xc0 #12 0xffffffff810ea9c7 at amd64_syscall+0x147 #13 0xffffffff810bad9e at fast_syscall_common+0xf8 nlink=1, effnlink=1, size=7696384, extsize 0 generation=3864a7bd, uid=2007, gid=0, flags=0x0 ino 8126, on dev md10 vnode 0xfffff80821b842f8: type VREG usecount 1, writecount 1, refcount 98 seqc users 0 hold count flags () flags (VIRF_PGREAD|VMP_LAZYLIST) v_object 0xfffff80608477b58 ref 0 pages 768 cleanbuf 95 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe010e596720 (pid 68304, rw, tid 100509) #0 0xffffffff80bf21e7 at lockmgr_lock_flags+0x1e7 #1 0xffffffff80f4e30d at ffs_lock+0x9d #2 0xffffffff811b413c at VOP_LOCK1_APV+0x3c #3 0xffffffff8274bbe3 at null_lock+0xd3 #4 0xffffffff811b413c at VOP_LOCK1_APV+0x3c #5 0xffffffff80d283d4 at _vn_lock+0x54 #6 0xffffffff80d2cbb1 at vn_write+0x1d1 #7 0xffffffff80d2c5b3 at vn_io_fault_doio+0x43 #8 0xffffffff80d28b93 at vn_io_fault1+0x163 #9 0xffffffff80d2669a at vn_io_fault+0x1ba #10 0xffffffff80c97ef1 at dofilewrite+0x81 #11 0xffffffff80c97a50 at sys_write+0xc0 #12 0xffffffff810ea9c7 at amd64_syscall+0x147 #13 0xffffffff810bad9e at fast_syscall_common+0xf8 nlink=1, effnlink=1, size=3112960, extsize 0 generation=5e4bc9c, uid=2007, gid=0, flags=0x0 ino 13356, on dev md10 vnode 0xfffff80821ad0be0: type VREG usecount 1, writecount 1, refcount 167 seqc users 0 hold count flags () flags (VIRF_PGREAD|VMP_LAZYLIST) v_object 0xfffff80351efe840 ref 0 pages 1320 cleanbuf 164 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe01441033a0 (pid 68280, rw, tid 100433) #0 0xffffffff80bf21e7 at lockmgr_lock_flags+0x1e7 #1 0xffffffff80f4e30d at ffs_lock+0x9d #2 0xffffffff811b413c at VOP_LOCK1_APV+0x3c #3 0xffffffff8274bbe3 at null_lock+0xd3 #4 0xffffffff811b413c at VOP_LOCK1_APV+0x3c #5 0xffffffff80d283d4 at _vn_lock+0x54 #6 0xffffffff80d2cbb1 at vn_write+0x1d1 #7 0xffffffff80d2c5b3 at vn_io_fault_doio+0x43 #8 0xffffffff80d28b93 at vn_io_fault1+0x163 #9 0xffffffff80d2669a at vn_io_fault+0x1ba #10 0xffffffff80c97ef1 at dofilewrite+0x81 #11 0xffffffff80c97a50 at sys_write+0xc0 #12 0xffffffff810ea9c7 at amd64_syscall+0x147 #13 0xffffffff810bad9e at fast_syscall_common+0xf8 nlink=1, effnlink=1, size=5369856, extsize 0 generation=5473ab1d, uid=2007, gid=0, flags=0x0 ino 14431, on dev md10 vnode 0xfffff803371602f8: type VFIFO usecount 1, writecount 0, refcount 2 seqc users 2 fifoinfo 0 hold count flags () flags (VIRF_DOOMED) lock type ufs: EXCL by thread 0xfffffe00e4ce5900 (pid 0, kernel, tid 100044) #0 0xffffffff80bf21e7 at lockmgr_lock_flags+0x1e7 #1 0xffffffff80f4e30d at ffs_lock+0x9d #2 0xffffffff811b413c at VOP_LOCK1_APV+0x3c #3 0xffffffff8274bbe3 at null_lock+0xd3 #4 0xffffffff811b413c at VOP_LOCK1_APV+0x3c #5 0xffffffff80d283d4 at _vn_lock+0x54 #6 0xffffffff80d11460 at vflush+0xd0 #7 0xffffffff8274ac31 at nullfs_unmount+0x51 #8 0xffffffff80d07102 at dounmount+0x812 #9 0xffffffff80d092c9 at vfs_deferred_unmount+0xf9 #10 0xffffffff80c849ca at taskqueue_run_locked+0xaa #11 0xffffffff80c85a52 at taskqueue_thread_loop+0xc2 #12 0xffffffff80bdbba0 at fork_exit+0x80 #13 0xffffffff810bb4fe at fork_trampoline+0xe vp=0xfffff803371602f8, lowervp=0xfffff806f83ff8e8 vnode 0xfffff803299d35f0: type VREG usecount 1, writecount 1, refcount 1 seqc users 0 hold count flags () flags (VIRF_PGREAD) v_object 0xfffff80696384d68 ref 0 pages 1888 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe0144097560 (pid 68293, rw, tid 100383) #0 0xffffffff80bf21e7 at lockmgr_lock_flags+0x1e7 #1 0xffffffff80f4e30d at ffs_lock+0x9d #2 0xffffffff811b413c at VOP_LOCK1_APV+0x3c #3 0xffffffff8274bbe3 at null_lock+0xd3 #4 0xffffffff811b413c at VOP_LOCK1_APV+0x3c #5 0xffffffff80d283d4 at _vn_lock+0x54 #6 0xffffffff80d2cbb1 at vn_write+0x1d1 #7 0xffffffff80d2c5b3 at vn_io_fault_doio+0x43 #8 0xffffffff80d28b93 at vn_io_fault1+0x163 #9 0xffffffff80d2669a at vn_io_fault+0x1ba #10 0xffffffff80c97ef1 at dofilewrite+0x81 #11 0xffffffff80c97a50 at sys_write+0xc0 #12 0xffffffff810ea9c7 at amd64_syscall+0x147 #13 0xffffffff810bad9e at fast_syscall_common+0xf8 vp=0xfffff803299d35f0, lowervp=0xfffff8017f69ebe0 vnode 0xfffff802204498e8: type VREG usecount 1, writecount 1, refcount 1 seqc users 0 hold count flags () flags (VIRF_PGREAD) v_object 0xfffff80608477b58 ref 0 pages 768 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe010e596720 (pid 68304, rw, tid 100509) #0 0xffffffff80bf21e7 at lockmgr_lock_flags+0x1e7 #1 0xffffffff80f4e30d at ffs_lock+0x9d #2 0xffffffff811b413c at VOP_LOCK1_APV+0x3c #3 0xffffffff8274bbe3 at null_lock+0xd3 #4 0xffffffff811b413c at VOP_LOCK1_APV+0x3c #5 0xffffffff80d283d4 at _vn_lock+0x54 #6 0xffffffff80d2cbb1 at vn_write+0x1d1 #7 0xffffffff80d2c5b3 at vn_io_fault_doio+0x43 #8 0xffffffff80d28b93 at vn_io_fault1+0x163 #9 0xffffffff80d2669a at vn_io_fault+0x1ba #10 0xffffffff80c97ef1 at dofilewrite+0x81 #11 0xffffffff80c97a50 at sys_write+0xc0 #12 0xffffffff810ea9c7 at amd64_syscall+0x147 #13 0xffffffff810bad9e at fast_syscall_common+0xf8 vp=0xfffff802204498e8, lowervp=0xfffff80821b842f8 vnode 0xfffff803298695f0: type VREG usecount 1, writecount 1, refcount 1 seqc users 0 hold count flags () flags (VIRF_PGREAD) v_object 0xfffff80351efe840 ref 0 pages 1320 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe01441033a0 (pid 68280, rw, tid 100433) #0 0xffffffff80bf21e7 at lockmgr_lock_flags+0x1e7 #1 0xffffffff80f4e30d at ffs_lock+0x9d #2 0xffffffff811b413c at VOP_LOCK1_APV+0x3c #3 0xffffffff8274bbe3 at null_lock+0xd3 #4 0xffffffff811b413c at VOP_LOCK1_APV+0x3c #5 0xffffffff80d283d4 at _vn_lock+0x54 #6 0xffffffff80d2cbb1 at vn_write+0x1d1 #7 0xffffffff80d2c5b3 at vn_io_fault_doio+0x43 #8 0xffffffff80d28b93 at vn_io_fault1+0x163 #9 0xffffffff80d2669a at vn_io_fault+0x1ba #10 0xffffffff80c97ef1 at dofilewrite+0x81 #11 0xffffffff80c97a50 at sys_write+0xc0 #12 0xffffffff810ea9c7 at amd64_syscall+0x147 #13 0xffffffff810bad9e at fast_syscall_common+0xf8 vp=0xfffff803298695f0, lowervp=0xfffff80821ad0be0 db:1:pho1> show mount 0xfffffe010ded2700 /dev/gpt/work on / (ufs) 0xfffffe010ded3280 devfs on /dev (devfs) 0xfffffe010e5df280 /dev/gpt/tmp on /tmp (ufs) 0xfffffe010e5a0700 /dev/md10 on /mnt (ufs) 0xfffffe010e59fb80 /mnt on /mnt2 (nullfs) More info: show mount db:1:pho1> show bufqueues bqempty: 75941 Buf domain 0 freebufs 13646 lofreebufs 219 hifreebufs 329 bufspace 21233664 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 1 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 1348 (18075648) dirtyq count 1 (32768) wakeup 0 lim 25 CPU 0, 3, 1, 22, 16, 21, 17, 12, 22, 0, 4, 20, Locked buffers: 0 space 0 Total buffers: 11821 space 21233664 Buf domain 1 freebufs 13906 lofreebufs 219 hifreebufs 329 bufspace 14036992 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 1 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 1116 (10891264) dirtyq count 1 (32768) wakeup 0 lim 25 CPU 15, 18, 4, 7, 1, 13, 5, 17, 6, 2, 5, 17, Locked buffers: 0 space 0 Total buffers: 7418 space 14036992 Buf domain 2 freebufs 13996 lofreebufs 219 hifreebufs 329 bufspace 12742656 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 1062 (11386880) dirtyq count 0 (0) wakeup 0 lim 25 CPU 2, 0, 1, 17, 16, 0, 0, 0, 7, 0, 18, 14, Locked buffers: 0 space 0 Total buffers: 10982 space 12742656 Buf domain 3 freebufs 14065 lofreebufs 219 hifreebufs 329 bufspace 10084352 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 1 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 966 (7839744) dirtyq count 1 (32768) wakeup 0 lim 25 CPU 19, 16, 0, 12, 0, 2, 1, 0, 21, 3, 19, 8, Locked buffers: 0 space 0 Total buffers: 6647 space 10084352 Buf domain 4 freebufs 13386 lofreebufs 219 hifreebufs 329 bufspace 31436800 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 5 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 1601 (26705920) dirtyq count 5 (131072) wakeup 0 lim 25 CPU 1, 8, 10, 17, 13, 9, 3, 18, 9, 11, 5, 17, Locked buffers: 20 space 655360 Total buffers: 9278 space 31436800 Buf domain 5 freebufs 13877 lofreebufs 219 hifreebufs 329 bufspace 14237696 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 1185 (12959744) dirtyq count 0 (0) wakeup 0 lim 25 CPU 4, 22, 1, 21, 3, 2, 1, 1, 10, 0, 1, 5, Locked buffers: 0 space 0 Total buffers: 7710 space 14237696 Buf domain 6 freebufs 13916 lofreebufs 219 hifreebufs 329 bufspace 13815808 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 1 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 1115 (11407360) dirtyq count 1 (32768) wakeup 0 lim 25 CPU 0, 14, 0, 10, 5, 17, 12, 18, 13, 2, 0, 10, Locked buffers: 0 space 0 Total buffers: 6678 space 13815808 db:1:pho1> show page vm_cnt.v_free_count: 7806062 vm_cnt.v_inactive_count: 2966 vm_cnt.v_active_count: 12009 vm_cnt.v_laundry_count: 36 vm_cnt.v_wire_count: 292174 vm_cnt.v_free_reserved: 10643 vm_cnt.v_free_min: 51261 vm_cnt.v_free_target: 173115 vm_cnt.v_inactive_target: 259672 db:1:pho1> show pageq pq_free 7806062 dom 0 page_cnt 8123602 free 7806062 pq_act 12009 pq_inact 2966 pq_laund 36 pq_unsw 0 db:0:pho> show freepages DOMAIN: 0 FREE LIST 0: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 001669 | 000000 11 (008192K) | 000167 | 000000 10 (004096K) | 000111 | 000000 09 (002048K) | 000162 | 000000 08 (001024K) | 000319 | 000001 07 (000512K) | 000431 | 000005 06 (000256K) | 000595 | 000023 05 (000128K) | 000751 | 000077 04 (000064K) | 001188 | 000180 03 (000032K) | 001826 | 000229 02 (000016K) | 003432 | 000346 01 (000008K) | 008062 | 000706 00 (000004K) | 000007 | 007045 FREE LIST 1: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000000 | 000000 09 (002048K) | 000000 | 000000 08 (001024K) | 000000 | 000000 07 (000512K) | 000000 | 000000 06 (000256K) | 000001 | 000000 05 (000128K) | 000001 | 000000 04 (000064K) | 000002 | 000000 03 (000032K) | 000000 | 000000 02 (000016K) | 000001 | 000000 01 (000008K) | 000000 | 000000 00 (000004K) | 000000 | 000000 db:0:pho> show uma Zone Size Used Free Requests Sleeps Bucket Total Mem XFree malloc-4096 4096 34129 28 129348 0 2 139907072 0 VNODE 760 63723 96022 28575929 0 129 121406200 0 FFS inode 1160 44100 44751 10810400 0 62 103067160 0 RADIX NODE 144 10491 512070 17295996 0 127 75248784 0 malloc-384 384 8850 123250 11260871 0 32 50726400 0 mbuf_cluster 2048 16140 6 390851 0 249 33067008 0 VM OBJECT 264 22245 71040 10800659 0 33 24627240 0 FFS2 dinode 256 44100 46410 10810399 0 63 23170560 0 malloc-256 256 14154 72951 37992015 0 66 22298880 0 malloc-128 128 42205 99217 26214599 0 127 18102016 0 mbuf_jumbo_page 4096 0 4299 20357075 0 249 17608704 0 BUF TRIE 144 426 105526 1439308 0 62 15257088 0 malloc-128 128 14222 85040 21722936 0 128 12705536 0 S VFS Cache 104 20253 75999 5988805 0 127 10010208 0 malloc-256 256 4158 33627 7362566 0 62 9672960 0 malloc-128 128 40461 17850 4621904 0 126 7463808 0 UMA Slabs 0 112 51799 1262 62827 0 126 5942832 0 malloc-64 64 29313 61659 17939527 0 254 5822208 0 mbuf 256 15522 4465 122772118 0 254 5116672 0 256 Bucket 2048 2265 17 515841 0 8 4673536 0 128 Bucket 1024 1100 2379 581772 0 16 3562496 0 vmem btag 56 45928 10436 71759 0 254 3156384 0 64 Bucket 512 3427 1957 451500 0 30 2756608 0 malloc-128 128 78 18212 395604023 0 126 2341120 0 malloc-128 128 435 17049 1791279 0 126 2237952 0 pbuf 2776 0 723 0 0 0 2007048 0 32 Bucket 256 3994 2441 274758 0 62 1647360 0 swblk 136 1301 10125 16595 0 62 1553936 0 DIRHASH 1024 494 1018 2393130 0 17 1548288 0 malloc-4096 4096 332 22 1800 0 2 1449984 0 malloc-4096 4096 236 106 69768 0 2 1400832 0 malloc-32768 32768 10 32 4101 0 1 1376256 0 g_bio 408 0 3190 1780952 0 32 1301520 0 mbuf_packet 256 8 4740 53646793 0 254 1215488 0 THREAD 1808 603 57 636 0 8 1193280 0 malloc-256 256 20 4525 13004790 0 62 1163520 0 malloc-65536 65536 3 12 3957 0 1 983040 0 malloc-65536 65536 2 12 538 0 1 917504 0 malloc-64 64 9758 3850 157422 0 254 870912 0 malloc-8192 8192 90 15 123 0 1 860160 0 malloc-65536 65536 1 12 89 0 1 851968 0 malloc-32768 32768 0 26 286 0 1 851968 0 VMSPACE 2544 152 178 69592 0 4 839520 0 MAP ENTRY 96 3739 3863 5692717 0 126 729792 0 L VFS Cache 320 388 1880 42983 0 30 725760 0 malloc-65536 65536 4 5 9 0 1 589824 0 malloc-32768 32768 2 15 130 0 1 557056 0 NAMEI 1024 112 424 218046998 0 17 548864 0 PROC 1336 233 169 69657 0 8 537072 0 malloc-16384 16384 4 28 4349 0 1 524288 0 UMA Zones 2048 228 7 228 0 8 481280 0 16 Bucket 144 1077 2143 173800 0 62 463680 0 4 Bucket 48 66 9510 40526 0 254 459648 0 malloc-8192 8192 29 24 95 0 1 434176 0 filedesc0 1072 186 213 69658 0 8 427728 0 malloc-32768 32768 13 0 13 0 1 425984 0 malloc-32768 32768 12 0 12 0 1 393216 0 lkpicurr 160 9 2391 9 0 62 384000 0 lkpimm 160 2 2323 2 0 62 372000 0 malloc-2048 2048 125 35 459 0 8 327680 0 malloc-32 32 8628 948 13381 0 254 306432 0 malloc-64 64 4149 576 4395 0 254 302400 0 8 Bucket 80 155 3495 1664840 0 126 292000 0 malloc-256 256 922 188 5499 0 62 284160 0 malloc-16384 16384 14 3 4834 0 1 278528 0 malloc-1024 1024 202 70 5040 0 16 278528 0 malloc-16 16 15320 1930 15486 0 254 276000 0 socket 944 52 232 6698 0 249 268096 0 pipe 744 10 310 35271 0 16 238080 0 malloc-1024 1024 62 170 38412 0 16 237568 0 ksiginfo 112 376 1676 7160 0 126 229824 0 malloc-512 512 67 373 264086 0 30 225280 0 malloc-64 64 43 3422 471782946 0 254 221760 0 malloc-8192 8192 0 27 508 0 1 221184 0 swpctrie 144 240 1132 1857 0 62 197568 0 malloc-128 128 1 1487 59698 0 126 190464 0 Files 80 184 2116 22493522 0 126 184000 0 malloc-8192 8192 19 3 3069 0 1 180224 0 malloc-2048 2048 10 66 7180 0 8 155648 0 malloc-4096 4096 19 18 2779 0 2 151552 0 malloc-1024 1024 66 82 87197 0 16 151552 0 PWD 32 73 4211 2697200 0 254 137088 0 2 Bucket 32 483 3801 81031 0 254 137088 0 malloc-65536 65536 2 0 2 0 1 131072 0 malloc-32768 32768 0 4 8 0 1 131072 0 malloc-384 384 137 203 4034 0 30 130560 0 Mountpoints 2944 5 39 70 0 4 129536 0 clpbuf 2776 0 42 92092 0 2 116592 0 TURNSTILE 136 661 179 661 0 62 114240 0 malloc-4096 4096 1 26 218 0 2 110592 0 ada_ccb 272 0 406 23771 0 30 110432 0 DEVCTL 1024 0 104 1158 0 0 106496 0 malloc-16384 16384 0 6 12 0 1 98304 0 malloc-8192 8192 12 0 12 0 1 98304 0 ttyinq 160 330 245 540 0 62 92000 0 malloc-384 384 31 199 1436 0 30 88320 0 ttyoutq 256 173 157 282 0 62 84480 0 malloc-16384 16384 5 0 5 0 1 81920 0 malloc-256 256 34 281 3255 0 62 80640 0 malloc-256 256 181 134 711 0 62 80640 0 malloc-128 128 69 551 325801 0 126 79360 0 UMA Kegs 384 197 6 197 0 30 77952 0 SLEEPQUEUE 88 661 203 661 0 126 76032 0 udp_inpcb 496 22 130 232 0 249 75392 0 unpcb 256 16 269 6433 0 249 72960 0 swrbuf 2776 0 25 1624 0 2 69400 0 malloc-65536 65536 1 0 1 0 1 65536 0 malloc-16384 16384 4 0 5 0 1 65536 0 malloc-4096 4096 15 1 26 0 2 65536 0 malloc-64 64 84 924 42668 0 254 64512 0 malloc-32 32 613 1403 27063 0 254 64512 0 malloc-4096 4096 7 8 22 0 2 61440 0 malloc-2048 2048 5 25 49 0 8 61440 0 malloc-1024 1024 3 57 708 0 16 61440 0 swwbuf 2776 0 22 8360 0 1 61072 0 malloc-32 32 456 1434 35878 0 254 60480 0 malloc-1024 1024 17 39 517 0 16 57344 0 malloc-1024 1024 19 33 38 0 16 53248 0 malloc-512 512 31 73 76 0 30 53248 0 malloc-16 16 568 2682 1094325 0 254 52000 0 kenv 258 18 177 21840 0 30 50310 0 malloc-384 384 25 105 10491 0 30 49920 0 malloc-2048 2048 0 24 157 0 8 49152 0 malloc-512 512 0 96 1888 0 30 49152 0 fakepg 104 0 468 528 0 126 48672 0 rl_entry 40 368 844 368 0 254 48480 0 udpcb 32 22 1490 232 0 254 48384 0 malloc-64 64 28 728 5428 0 254 48384 0 malloc-32 32 143 1369 27447 0 254 48384 0 malloc-16 16 51 2949 1546 0 254 48000 0 malloc-16 16 19 2981 125927 0 254 48000 0 malloc-16 16 832 2168 40419 0 254 48000 0 tcpcb 1080 11 31 16 0 249 45360 0 pcpu-16 16 44 2772 44 0 254 45056 0 PGRP 88 33 473 135 0 126 44528 0 malloc-32 32 11 1375 475 0 254 44352 0 malloc-32 32 134 1252 229 0 254 44352 0 malloc-512 512 1 79 1589 0 30 40960 0 pcpu-64 64 454 186 454 0 254 40960 0 pcpu-8 8 3502 1618 3509 0 254 40960 0 cpuset 104 27 345 27 0 126 38688 0 malloc-384 384 52 48 52 0 30 38400 0 malloc-32768 32768 1 0 1 0 1 32768 0 malloc-1024 1024 15 17 27 0 16 32768 0 malloc-32 32 24 984 80 0 254 32256 0 rtentry 176 12 149 15 0 62 28336 0 malloc-16 16 33 1717 47 0 254 28000 0 routing nhops 256 9 96 15 0 62 26880 0 tcp_inpcb 496 11 37 16 0 249 23808 0 malloc-128 128 42 144 52 0 126 23808 0 malloc-384 384 13 47 14 0 30 23040 0 malloc-64 64 4 311 8 0 254 20160 0 malloc-16 16 31 1219 60 0 254 20000 0 malloc-256 256 18 57 30 0 62 19200 0 malloc-256 256 20 55 20 0 62 19200 0 malloc-16384 16384 1 0 1 0 1 16384 0 malloc-8192 8192 2 0 2 0 1 16384 0 malloc-4096 4096 4 0 5 0 2 16384 0 malloc-512 512 6 26 52 0 30 16384 0 malloc-2048 2048 2 2 2 0 8 8192 0 malloc-64 64 8 118 9 0 254 8064 0 malloc-16 16 2 498 3 0 254 8000 0 ripcb 496 1 15 3 0 249 7936 0 FPU_save_area 832 1 8 1 0 16 7488 0 epoch_record pcpu 256 4 12 4 0 62 4096 0 malloc-2048 2048 2 0 2 0 8 4096 0 malloc-2048 2048 0 2 3 0 8 4096 0 malloc-1024 1024 4 0 4 0 16 4096 0 syncache 168 0 24 1 0 249 4032 0 malloc-32 32 0 126 2 0 254 4032 0 vtnet_tx_hdr 24 0 167 0 0 254 4008 0 UMA Slabs 1 176 9 13 9 0 62 3872 0 malloc-384 384 1 9 33 0 30 3840 0 KMAP ENTRY 96 36 3 36 0 0 3744 0 vmem 1856 1 1 1 0 8 3712 0 SMR CPU 32 3 92 3 0 254 3040 0 SMR SHARED 24 3 92 3 0 254 2280 0 FFS1 dinode 128 0 0 0 0 126 0 0 da_ccb 544 0 0 0 0 16 0 0 udplite_inpcb 496 0 0 0 0 249 0 0 tcp_log_node 120 0 0 0 0 126 0 0 tcp_log_bucket 176 0 0 0 0 62 0 0 tcp_log 416 0 0 0 0 249 0 0 tcpreass 48 0 0 0 0 254 0 0 tfo_ccache_entries 80 0 0 0 0 126 0 0 tfo 4 0 0 0 0 254 0 0 sackhole 32 0 0 0 0 254 0 0 hostcache 64 0 0 0 0 254 0 0 tcptw 88 0 0 0 0 249 0 0 ipq 56 0 0 0 0 254 0 0 IPsec SA lft_c 16 0 0 0 0 254 0 0 KNOTE 160 0 0 0 0 62 0 0 itimer 352 0 0 0 0 30 0 0 AIOLIO 272 0 0 0 0 30 0 0 AIOCB 552 0 0 0 0 16 0 0 AIOP 32 0 0 0 0 254 0 0 AIO 208 0 0 0 0 62 0 0 NCLNODE 736 0 0 0 0 16 0 0 TMPFS node 224 0 0 0 0 62 0 0 LTS VFS Cache 360 0 0 0 0 30 0 0 STS VFS Cache 144 0 0 0 0 62 0 0 cryptop 280 0 0 0 0 30 0 0 linux_dma_object 24 0 0 0 0 254 0 0 linux_dma_pctrie 144 0 0 0 0 62 0 0 IOMMU_MAP_ENTRY 120 0 0 0 0 126 0 0 ktls_session 192 0 0 0 0 62 0 0 mbuf_jumbo_16k 16384 0 0 0 0 249 0 0 mbuf_jumbo_9k 9216 0 0 0 0 249 0 0 audit_record 1280 0 0 0 0 8 0 0 domainset 40 0 0 0 0 254 0 0 MAC labels 40 0 0 0 0 254 0 0 vnpbuf 2776 0 0 0 0 5 0 0 mdpbuf 2776 0 0 0 0 1 0 0 nfspbuf 2776 0 0 0 0 2 0 0 umtx_shm 88 0 0 0 0 126 0 0 umtx pi 96 0 0 0 0 126 0 0 rangeset pctrie nodes 144 0 0 0 0 62 0 0 malloc-65536 65536 0 0 0 0 1 0 0 malloc-65536 65536 0 0 0 0 1 0 0 malloc-32768 32768 0 0 0 0 1 0 0 malloc-16384 16384 0 0 0 0 1 0 0 malloc-16384 16384 0 0 0 0 1 0 0 malloc-8192 8192 0 0 0 0 1 0 0 malloc-8192 8192 0 0 0 0 1 0 0 malloc-2048 2048 0 0 0 0 8 0 0 malloc-512 512 0 0 0 0 30 0 0 malloc-512 512 0 0 0 0 30 0 0 malloc-512 512 0 0 0 0 30 0 0 malloc-384 384 0 0 0 0 30 0 0 pcpu-32 32 0 0 0 0 254 0 0 pcpu-4 4 0 0 0 0 254 0 0 UMA Hash 256 0 0 0 0 62 0 0 db:0:pho> show umacache Zone Size Used Free Requests Bucket debugnet_mbuf_packet 2048 0 0 0 0 debugnet_mbuf_cluster 2048 -6144 0 0 0 debugnet_mbuf 256 -10240 0 0 0 ktls_buffers 16384 0 0 0 1 vm pgcache 4096 170971 7231 6349294 164 vm pgcache 4096 29181 3170 31314870 168 buf free cache 848 9139 20851 6147772 25 buffer arena-65 65536 0 0 0 1 buffer arena-61 61440 0 0 0 1 buffer arena-57 57344 0 0 0 1 buffer arena-53 53248 0 0 0 1 buffer arena-49 49152 0 0 0 1 buffer arena-45 45056 0 0 0 1 buffer arena-40 40960 0 0 0 1 buffer arena-36 36864 0 0 0 1 buffer arena-32 32768 6854 12423 2339658 10 buffer arena-28 28672 0 0 0 1 buffer arena-24 24576 0 0 0 1 buffer arena-20 20480 0 0 0 1 buffer arena-16 16384 8 39 52761 1 buffer arena-12 12288 0 0 0 1 buffer arena-81 8192 0 0 0 1 buffer arena-40 4096 0 0 0 2 kstack_cache 16384 603 19 636 1 db:0:pho> acttrace Tracing command kernel pid 0 tid 100044 td 0xfffffe00e4ce5900 (CPU 9) kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e4880310 vpanic() at vpanic+0x1b8/frame 0xfffffe00e4880370 panic() at panic+0x43/frame 0xfffffe00e48803d0 trap_fatal() at trap_fatal+0x387/frame 0xfffffe00e4880430 trap_pfault() at trap_pfault+0x99/frame 0xfffffe00e4880490 trap() at trap+0x2a7/frame 0xfffffe00e48805a0 calltrap() at calltrap+0x8/frame 0xfffffe00e48805a0 --- trap 0xc, rip = 0xffffffff80ab9179, rsp = 0xfffffe00e4880670, rbp = 0xfffffe00e48806a0 --- fifo_close() at fifo_close+0x19/frame 0xfffffe00e48806a0 VOP_CLOSE_APV() at VOP_CLOSE_APV+0x56/frame 0xfffffe00e48806c0 null_bypass() at null_bypass+0x12b/frame 0xfffffe00e4880840 VOP_CLOSE_APV() at VOP_CLOSE_APV+0x56/frame 0xfffffe00e4880860 vgonel() at vgonel+0x243/frame 0xfffffe00e48808c0 vflush() at vflush+0x321/frame 0xfffffe00e4880a00 nullfs_unmount() at nullfs_unmount+0x51/frame 0xfffffe00e4880a40 dounmount() at dounmount+0x812/frame 0xfffffe00e4880ab0 vfs_deferred_unmount() at vfs_deferred_unmount+0xf9/frame 0xfffffe00e4880b00 taskqueue_run_locked() at taskqueue_run_locked+0xaa/frame 0xfffffe00e4880b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc2/frame 0xfffffe00e4880bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4880bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4880bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command rename pid 68291 tid 100571 td 0xfffffe01485dd900 (CPU 3) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce3ae00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce3ae10 trap() at trap+0x56/frame 0xfffffe003ce3af20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce3af20 --- trap 0x13, rip = 0xffffffff80c70382, rsp = 0xfffffe0147af3230, rbp = 0xfffffe0147af3240 --- lock_delay() at lock_delay+0x22/frame 0xfffffe0147af3240 __mtx_lock_sleep() at __mtx_lock_sleep+0xe8/frame 0xfffffe0147af32d0 __mtx_lock_flags() at __mtx_lock_flags+0xef/frame 0xfffffe0147af3320 __mnt_vnode_next_all() at __mnt_vnode_next_all+0x42/frame 0xfffffe0147af3360 ffs_sync() at ffs_sync+0x174/frame 0xfffffe0147af3400 journal_check_space() at journal_check_space+0xe0/frame 0xfffffe0147af3430 softdep_prelink() at softdep_prelink+0x2d7/frame 0xfffffe0147af3480 ufs_makeinode() at ufs_makeinode+0xb9/frame 0xfffffe0147af3610 ufs_create() at ufs_create+0x34/frame 0xfffffe0147af3630 VOP_CREATE_APV() at VOP_CREATE_APV+0x62/frame 0xfffffe0147af3650 null_bypass() at null_bypass+0x12b/frame 0xfffffe0147af37d0 VOP_CREATE_APV() at VOP_CREATE_APV+0x62/frame 0xfffffe0147af37f0 vn_open_cred() at vn_open_cred+0x2b9/frame 0xfffffe0147af3960 kern_openat() at kern_openat+0x28c/frame 0xfffffe0147af3ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0147af3bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0147af3bf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8011aa60a, rsp = 0x7fffffffe128, rbp = 0x7fffffffe210 --- Tracing command mkdir pid 68312 tid 100579 td 0xfffffe014406f1e0 (CPU 0) cpustop_handler() at cpustop_handler+0x28/frame 0xffffffff81ff9220 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xffffffff81ff9230 trap() at trap+0x56/frame 0xffffffff81ff9340 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81ff9340 --- trap 0x13, rip = 0xffffffff80c70382, rsp = 0xfffffe0144472300, rbp = 0xfffffe0144472310 --- lock_delay() at lock_delay+0x22/frame 0xfffffe0144472310 __mtx_lock_sleep() at __mtx_lock_sleep+0xe8/frame 0xfffffe01444723a0 __mtx_lock_flags() at __mtx_lock_flags+0xef/frame 0xfffffe01444723f0 __mnt_vnode_next_all() at __mnt_vnode_next_all+0x42/frame 0xfffffe0144472430 ffs_sync() at ffs_sync+0x174/frame 0xfffffe01444724d0 journal_check_space() at journal_check_space+0xe0/frame 0xfffffe0144472500 softdep_prelink() at softdep_prelink+0x2d7/frame 0xfffffe0144472550 ufs_mkdir() at ufs_mkdir+0xbe/frame 0xfffffe01444726f0 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x65/frame 0xfffffe0144472710 null_bypass() at null_bypass+0x12b/frame 0xfffffe0144472890 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x65/frame 0xfffffe01444728b0 kern_mkdirat() at kern_mkdirat+0x1f7/frame 0xfffffe0144472ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0144472bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0144472bf0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x8011a7e4a, rsp = 0x7ffffffeb178, rbp = 0x7ffffffeb5b0 --- Tracing command rename pid 68328 tid 100406 td 0xfffffe01440ce3a0 (CPU 8) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce7be00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce7be10 trap() at trap+0x56/frame 0xfffffe003ce7bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce7bf20 --- trap 0x13, rip = 0xffffffff80c70382, rsp = 0xfffffe01445af230, rbp = 0xfffffe01445af240 --- lock_delay() at lock_delay+0x22/frame 0xfffffe01445af240 __mtx_lock_sleep() at __mtx_lock_sleep+0xe8/frame 0xfffffe01445af2d0 __mtx_lock_flags() at __mtx_lock_flags+0xef/frame 0xfffffe01445af320 __mnt_vnode_next_all() at __mnt_vnode_next_all+0x42/frame 0xfffffe01445af360 ffs_sync() at ffs_sync+0x174/frame 0xfffffe01445af400 journal_check_space() at journal_check_space+0xe0/frame 0xfffffe01445af430 softdep_prelink() at softdep_prelink+0x2d7/frame 0xfffffe01445af480 ufs_makeinode() at ufs_makeinode+0xb9/frame 0xfffffe01445af610 ufs_create() at ufs_create+0x34/frame 0xfffffe01445af630 VOP_CREATE_APV() at VOP_CREATE_APV+0x62/frame 0xfffffe01445af650 null_bypass() at null_bypass+0x12b/frame 0xfffffe01445af7d0 VOP_CREATE_APV() at VOP_CREATE_APV+0x62/frame 0xfffffe01445af7f0 vn_open_cred() at vn_open_cred+0x2b9/frame 0xfffffe01445af960 kern_openat() at kern_openat+0x28c/frame 0xfffffe01445afac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01445afbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01445afbf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8011aa60a, rsp = 0x7fffffffe128, rbp = 0x7fffffffe210 --- Tracing command lockf pid 68331 tid 100441 td 0xfffffe0144104900 (CPU 2) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce2de00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce2de10 trap() at trap+0x56/frame 0xfffffe003ce2df20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce2df20 --- trap 0x13, rip = 0xffffffff80c93087, rsp = 0xfffffe0145668430, rbp = 0xfffffe0145668460 --- witness_lock() at witness_lock+0xb7/frame 0xfffffe0145668460 __mtx_lock_flags() at __mtx_lock_flags+0x104/frame 0xfffffe01456684b0 __mnt_vnode_next_all() at __mnt_vnode_next_all+0x42/frame 0xfffffe01456684f0 ffs_sync() at ffs_sync+0x174/frame 0xfffffe0145668590 journal_check_space() at journal_check_space+0xe0/frame 0xfffffe01456685c0 softdep_prelink() at softdep_prelink+0x2d7/frame 0xfffffe0145668610 ufs_remove() at ufs_remove+0x8b/frame 0xfffffe0145668670 VOP_REMOVE_APV() at VOP_REMOVE_APV+0x85/frame 0xfffffe0145668690 null_bypass() at null_bypass+0x12b/frame 0xfffffe0145668810 null_remove() at null_remove+0x4e/frame 0xfffffe0145668840 VOP_REMOVE_APV() at VOP_REMOVE_APV+0x85/frame 0xfffffe0145668860 kern_funlinkat() at kern_funlinkat+0x32a/frame 0xfffffe0145668aa0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe0145668ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0145668bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0145668bf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x8011a758a, rsp = 0x7fffffffe318, rbp = 0x7fffffffe360 --- Tracing command symlink pid 68332 tid 100501 td 0xfffffe0146757c80 (CPU 1) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce20e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce20e10 trap() at trap+0x56/frame 0xfffffe003ce20f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce20f20 --- trap 0x13, rip = 0xffffffff80c70382, rsp = 0xfffffe01457852d0, rbp = 0xfffffe01457852e0 --- lock_delay() at lock_delay+0x22/frame 0xfffffe01457852e0 __mtx_lock_sleep() at __mtx_lock_sleep+0xe8/frame 0xfffffe0145785370 __mtx_lock_flags() at __mtx_lock_flags+0xef/frame 0xfffffe01457853c0 __mnt_vnode_next_all() at __mnt_vnode_next_all+0x42/frame 0xfffffe0145785400 ffs_sync() at ffs_sync+0x174/frame 0xfffffe01457854a0 journal_check_space() at journal_check_space+0xe0/frame 0xfffffe01457854d0 softdep_prelink() at softdep_prelink+0x2d7/frame 0xfffffe0145785520 ufs_makeinode() at ufs_makeinode+0xb9/frame 0xfffffe01457856b0 ufs_symlink() at ufs_symlink+0x38/frame 0xfffffe01457856e0 VOP_SYMLINK_APV() at VOP_SYMLINK_APV+0x65/frame 0xfffffe0145785700 null_bypass() at null_bypass+0x12b/frame 0xfffffe0145785880 VOP_SYMLINK_APV() at VOP_SYMLINK_APV+0x65/frame 0xfffffe01457858a0 kern_symlinkat() at kern_symlinkat+0x24f/frame 0xfffffe0145785ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0145785bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0145785bf0 --- syscall (57, FreeBSD ELF64, sys_symlink), rip = 0x8011a79aa, rsp = 0x7fffffffe2a8, rbp = 0x7fffffffe360 --- Tracing command dirnprename pid 68336 tid 100253 td 0xfffffe010e59a740 (CPU 6) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce61e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce61e10 trap() at trap+0x56/frame 0xfffffe003ce61f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce61f20 --- trap 0x13, rip = 0xffffffff80c70382, rsp = 0xfffffe014163a300, rbp = 0xfffffe014163a310 --- lock_delay() at lock_delay+0x22/frame 0xfffffe014163a310 __mtx_lock_sleep() at __mtx_lock_sleep+0xe8/frame 0xfffffe014163a3a0 __mtx_lock_flags() at __mtx_lock_flags+0xef/frame 0xfffffe014163a3f0 __mnt_vnode_next_all() at __mnt_vnode_next_all+0x42/frame 0xfffffe014163a430 ffs_sync() at ffs_sync+0x174/frame 0xfffffe014163a4d0 journal_check_space() at journal_check_space+0xe0/frame 0xfffffe014163a500 softdep_prelink() at softdep_prelink+0x2d7/frame 0xfffffe014163a550 ufs_mkdir() at ufs_mkdir+0xbe/frame 0xfffffe014163a6f0 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x65/frame 0xfffffe014163a710 null_bypass() at null_bypass+0x12b/frame 0xfffffe014163a890 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x65/frame 0xfffffe014163a8b0 kern_mkdirat() at kern_mkdirat+0x1f7/frame 0xfffffe014163aac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014163abf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014163abf0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x8011a7e4a, rsp = 0x7fffffffe208, rbp = 0x7fffffffe350 --- Tracing command dirnprename pid 68371 tid 100600 td 0xfffffe01499c0c80 (CPU 5) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce54e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce54e10 trap() at trap+0x56/frame 0xfffffe003ce54f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce54f20 --- trap 0x13, rip = 0xffffffff80c70382, rsp = 0xfffffe0147b92300, rbp = 0xfffffe0147b92310 --- lock_delay() at lock_delay+0x22/frame 0xfffffe0147b92310 __mtx_lock_sleep() at __mtx_lock_sleep+0xe8/frame 0xfffffe0147b923a0 __mtx_lock_flags() at __mtx_lock_flags+0xef/frame 0xfffffe0147b923f0 __mnt_vnode_next_all() at __mnt_vnode_next_all+0x42/frame 0xfffffe0147b92430 ffs_sync() at ffs_sync+0x174/frame 0xfffffe0147b924d0 journal_check_space() at journal_check_space+0xe0/frame 0xfffffe0147b92500 softdep_prelink() at softdep_prelink+0x2d7/frame 0xfffffe0147b92550 ufs_mkdir() at ufs_mkdir+0xbe/frame 0xfffffe0147b926f0 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x65/frame 0xfffffe0147b92710 null_bypass() at null_bypass+0x12b/frame 0xfffffe0147b92890 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x65/frame 0xfffffe0147b928b0 kern_mkdirat() at kern_mkdirat+0x1f7/frame 0xfffffe0147b92ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0147b92bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0147b92bf0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x8011a7e4a, rsp = 0x7fffffffe208, rbp = 0x7fffffffe350 --- Tracing command mkfifo pid 68376 tid 100545 td 0xfffffe0145906720 (CPU 10) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce95e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce95e10 trap() at trap+0x56/frame 0xfffffe003ce95f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce95f20 --- trap 0x13, rip = 0xffffffff80c70380, rsp = 0xfffffe0147a6f3c0, rbp = 0xfffffe0147a6f3d0 --- lock_delay() at lock_delay+0x20/frame 0xfffffe0147a6f3d0 __mtx_lock_sleep() at __mtx_lock_sleep+0xe8/frame 0xfffffe0147a6f460 __mtx_lock_flags() at __mtx_lock_flags+0xef/frame 0xfffffe0147a6f4b0 __mnt_vnode_next_all() at __mnt_vnode_next_all+0x42/frame 0xfffffe0147a6f4f0 ffs_sync() at ffs_sync+0x174/frame 0xfffffe0147a6f590 journal_check_space() at journal_check_space+0xe0/frame 0xfffffe0147a6f5c0 softdep_prelink() at softdep_prelink+0x2d7/frame 0xfffffe0147a6f610 ufs_remove() at ufs_remove+0x8b/frame 0xfffffe0147a6f670 VOP_REMOVE_APV() at VOP_REMOVE_APV+0x85/frame 0xfffffe0147a6f690 null_bypass() at null_bypass+0x12b/frame 0xfffffe0147a6f810 null_remove() at null_remove+0x4e/frame 0xfffffe0147a6f840 VOP_REMOVE_APV() at VOP_REMOVE_APV+0x85/frame 0xfffffe0147a6f860 kern_funlinkat() at kern_funlinkat+0x32a/frame 0xfffffe0147a6faa0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe0147a6fac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0147a6fbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0147a6fbf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x8011bf58a, rsp = 0x7fffffffe318, rbp = 0x7fffffffe360 --- Tracing command creat pid 68380 tid 100517 td 0xfffffe01478aa1e0 (CPU 4) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce47e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce47e10 trap() at trap+0x56/frame 0xfffffe003ce47f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce47f20 --- trap 0x13, rip = 0xffffffff80c70380, rsp = 0xfffffe01457e4230, rbp = 0xfffffe01457e4240 --- lock_delay() at lock_delay+0x20/frame 0xfffffe01457e4240 __mtx_lock_sleep() at __mtx_lock_sleep+0xe8/frame 0xfffffe01457e42d0 __mtx_lock_flags() at __mtx_lock_flags+0xef/frame 0xfffffe01457e4320 __mnt_vnode_next_all() at __mnt_vnode_next_all+0x42/frame 0xfffffe01457e4360 ffs_sync() at ffs_sync+0x174/frame 0xfffffe01457e4400 journal_check_space() at journal_check_space+0xe0/frame 0xfffffe01457e4430 softdep_prelink() at softdep_prelink+0x2d7/frame 0xfffffe01457e4480 ufs_makeinode() at ufs_makeinode+0xb9/frame 0xfffffe01457e4610 ufs_create() at ufs_create+0x34/frame 0xfffffe01457e4630 VOP_CREATE_APV() at VOP_CREATE_APV+0x62/frame 0xfffffe01457e4650 null_bypass() at null_bypass+0x12b/frame 0xfffffe01457e47d0 VOP_CREATE_APV() at VOP_CREATE_APV+0x62/frame 0xfffffe01457e47f0 vn_open_cred() at vn_open_cred+0x2b9/frame 0xfffffe01457e4960 kern_openat() at kern_openat+0x28c/frame 0xfffffe01457e4ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01457e4bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01457e4bf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8011aa60a, rsp = 0x7fffffffe2a8, rbp = 0x7fffffffe360 --- Tracing command dirrename pid 68388 tid 100537 td 0xfffffe01478bb020 (CPU 11) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003cea2e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003cea2e10 trap() at trap+0x56/frame 0xfffffe003cea2f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003cea2f20 --- trap 0x13, rip = 0xffffffff80c70382, rsp = 0xfffffe0147a56300, rbp = 0xfffffe0147a56310 --- lock_delay() at lock_delay+0x22/frame 0xfffffe0147a56310 __mtx_lock_sleep() at __mtx_lock_sleep+0xe8/frame 0xfffffe0147a563a0 __mtx_lock_flags() at __mtx_lock_flags+0xef/frame 0xfffffe0147a563f0 __mnt_vnode_next_all() at __mnt_vnode_next_all+0x42/frame 0xfffffe0147a56430 ffs_sync() at ffs_sync+0x174/frame 0xfffffe0147a564d0 journal_check_space() at journal_check_space+0xe0/frame 0xfffffe0147a56500 softdep_prelink() at softdep_prelink+0x2d7/frame 0xfffffe0147a56550 ufs_mkdir() at ufs_mkdir+0xbe/frame 0xfffffe0147a566f0 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x65/frame 0xfffffe0147a56710 null_bypass() at null_bypass+0x12b/frame 0xfffffe0147a56890 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x65/frame 0xfffffe0147a568b0 kern_mkdirat() at kern_mkdirat+0x1f7/frame 0xfffffe0147a56ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0147a56bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0147a56bf0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x8011a7e4a, rsp = 0x7fffffffe208, rbp = 0x7fffffffe350 --- Tracing command dirrename pid 68407 tid 100544 td 0xfffffe0145906e40 (CPU 7) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce6ee00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce6ee10 trap() at trap+0x56/frame 0xfffffe003ce6ef20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce6ef20 --- trap 0x13, rip = 0xffffffff80c70382, rsp = 0xfffffe0147a74300, rbp = 0xfffffe0147a74310 --- lock_delay() at lock_delay+0x22/frame 0xfffffe0147a74310 __mtx_lock_sleep() at __mtx_lock_sleep+0xe8/frame 0xfffffe0147a743a0 __mtx_lock_flags() at __mtx_lock_flags+0xef/frame 0xfffffe0147a743f0 __mnt_vnode_next_all() at __mnt_vnode_next_all+0x42/frame 0xfffffe0147a74430 ffs_sync() at ffs_sync+0x174/frame 0xfffffe0147a744d0 journal_check_space() at journal_check_space+0xe0/frame 0xfffffe0147a74500 softdep_prelink() at softdep_prelink+0x2d7/frame 0xfffffe0147a74550 ufs_mkdir() at ufs_mkdir+0xbe/frame 0xfffffe0147a746f0 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x65/frame 0xfffffe0147a74710 null_bypass() at null_bypass+0x12b/frame 0xfffffe0147a74890 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x65/frame 0xfffffe0147a748b0 kern_mkdirat() at kern_mkdirat+0x1f7/frame 0xfffffe0147a74ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0147a74bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0147a74bf0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x8011a7e4a, rsp = 0x7fffffffe208, rbp = 0x7fffffffe350 --- db:0:pho> ps pid ppid pgrp uid state wmesg wchan cmd 69652 68206 2770 0 S+ wait 0xfffff8024d7dd538 sh 69648 69277 2859 0 R egrep 69277 2897 2859 0 S wait 0xfffff80006193000 sh 68418 1 68228 2007 R+ dirrename 68416 1 68228 2007 R+ dirrename 68414 1 68228 2007 R+ dirrename 68413 1 68228 2007 R+ dirrename 68411 1 68228 2007 R+ dirrename 68410 1 68228 2007 R+ mkfifo 68408 1 68228 2007 R+ creat 68407 1 68228 2007 R+ CPU 7 dirrename 68406 1 68228 2007 R+ mkfifo 68405 1 68228 2007 R+ creat 68404 1 68228 2007 R+ dirrename 68403 1 68228 2007 R+ mkfifo 68401 1 68228 2007 R+ creat 68400 1 68228 2007 R+ dirrename 68398 1 68228 2007 R+ creat 68395 1 68228 2007 R+ dirrename 68394 1 68228 2007 R+ creat 68393 1 68228 2007 R+ mkdir 68392 1 68228 2007 R+ rename 68390 1 68228 2007 R+ lockf 68388 1 68228 2007 R+ CPU 11 dirrename 68387 1 68228 2007 R+ creat 68386 1 68228 2007 RL+ rename 68385 1 68228 2007 R+ mkdir 68383 1 68228 2007 R+ mkfifo 68382 1 68228 2007 R+ dirrename 68380 1 68228 2007 R+ CPU 4 creat 68379 1 68228 2007 R+ mkdir 68377 1 68228 2007 R+ fts 68376 1 68228 2007 R+ CPU 10 mkfifo 68375 1 68228 2007 R+ dirrename 68373 1 68228 2007 R+ creat 68372 1 68228 2007 R+ mkdir 68371 68318 68228 2007 R+ CPU 5 dirnprename 68369 1 68228 2007 R+ mkdir 68368 1 68228 2007 R+ creat 68367 1 68228 2007 R+ lockf 68366 1 68228 2007 R+ rename 68364 1 68228 2007 R+ symlink 68363 1 68228 2007 RE+ fts 68362 1 68228 2007 R+ mkdir 68361 1 68228 2007 R+ dirrename 68360 68318 68228 2007 R+ dirnprename 68359 1 68228 2007 R+ lockf 68358 1 68228 2007 R+ creat 68356 1 68228 2007 R+ rename 68353 1 68228 2007 R+ symlink 68352 1 68228 2007 R+ mkdir 68351 68318 68228 2007 R+ dirnprename 68349 1 68228 2007 R+ creat 68348 1 68228 2007 R+ rename 68347 1 68228 2007 R+ dirrename 68344 1 68228 2007 R+ mkdir 68343 1 68228 2007 R+ lockf 68342 68318 68228 2007 R+ dirnprename 68341 1 68228 2007 R+ symlink 68340 1 68228 2007 R+ creat 68339 1 68228 2007 R+ dirrename 68337 1 68228 2007 R+ rename 68336 68318 68228 2007 R+ CPU 6 dirnprename 68335 1 68228 2007 R+ fts 68333 1 68228 2007 R+ mkdir 68332 1 68228 2007 R+ CPU 1 symlink 68331 1 68228 2007 R+ CPU 2 lockf 68330 1 68228 2007 R+ creat 68328 1 68228 2007 R+ CPU 8 rename 68327 1 68228 2007 R+ fts 68326 1 68228 2007 R+ symlink 68325 1 68228 2007 R+ creat 68323 1 68228 2007 R+ dirrename 68321 1 68228 2007 R+ mkdir 68316 1 68228 2007 R+ symlink 68315 1 68228 2007 R+ rename 68314 1 68228 2007 R+ creat 68312 1 68228 2007 R+ CPU 0 mkdir 68306 1 68228 2007 R+ rename 68305 1 68228 2007 R+ creat 68304 1 68228 2007 R+ rw 68303 1 68228 2007 R+ fts 68302 1 68228 2007 R+ mkdir 68301 1 68228 2007 R+ lockf 68299 1 68228 2007 R+ fts 68298 1 68228 2007 R+ symlink 68297 1 68228 2007 R+ creat 68295 1 68228 2007 R+ rename 68293 1 68228 2007 R+ rw 68292 1 68228 2007 R+ fts 68291 1 68228 2007 R+ CPU 3 rename 68290 1 68228 2007 R+ symlink 68288 1 68228 2007 R+ lockf 68285 1 68228 2007 RE+ fts 68284 1 68228 2007 R+ rename 68283 1 68228 2007 R+ symlink 68281 1 68228 2007 RE+ fts 68280 1 68228 2007 R+ rw 68278 1 68228 2007 R+ symlink 68277 1 68228 2007 R+ fts 68273 1 68228 2007 R+ symlink 68271 1 68228 2007 R+ fts 68268 1 68228 2007 R+ fts 68267 1 68228 2007 R+ symlink 68265 1 68228 2007 R+ fts 68264 1 68228 2007 R+ symlink 68259 1 68228 2007 R+ symlink 68256 1 68228 2007 R+ lockf2 68255 1 68228 2007 R+ symlink 68253 1 68228 2007 R+ openat 68250 1 68228 2007 R+ symlink 68248 1 68228 2007 R+ lockf2 68244 1 68228 2007 R+ lockf2 68206 68204 2770 0 S+ wait 0xfffff802d6f86538 sh 68205 2770 2770 0 S+ piperd 0xfffff80019ffd000 tee 68204 2770 2770 0 S+ wait 0xfffff802d6d75000 sh 2900 2859 2859 0 S piperd 0xfffff800371beba0 sh 2898 2859 2859 0 S piperd 0xfffff80009ba22e8 awk 2897 2859 2859 0 S wait 0xfffff80074ec8538 sh 2859 1 2859 0 SWs wait 0xfffff800746bd000 sh 2770 2769 2770 0 S+ wait 0xfffff80074890538 sh 2769 2767 2769 0 SW+ wait 0xfffff80006877000 bash 2767 2766 2767 0 SW+ pause 0xfffff80074ec8b20 csh 2766 2761 2766 2006 SW+ wait 0xfffff800746bda70 su 2761 2760 2761 2006 SWs+ wait 0xfffff80003e49000 bash 2760 2757 2757 2006 S select 0xfffff80009a82d40 sshd 2757 2729 2757 0 Ss select 0xfffff80019df5ec0 sshd 2756 1 2756 0 Ss+ ttyin 0xfffff800060f38b0 getty 2755 1 2755 0 Ss+ ttyin 0xfffff800060f3cb0 getty 2754 1 2754 0 Ss+ ttyin 0xfffff80009c890b0 getty 2753 1 2753 0 Ss+ ttyin 0xfffff80009c894b0 getty 2752 1 2752 0 Ss+ ttyin 0xfffff80009c898b0 getty 2751 1 2751 0 Ss+ ttyin 0xfffff80009c89cb0 getty 2750 1 2750 0 Ss+ ttyin 0xfffff80009c930b0 getty 2749 1 2749 0 Ss+ ttyin 0xfffff80009c934b0 getty 2748 1 2748 0 Ss+ ttyin 0xfffff80009c938b0 getty 2747 1 2747 0 Ss+ ttyin 0xfffff80009c93cb0 getty 2733 1 2733 0 Ss nanslp 0xffffffff81ebc0a6 cron 2729 1 2729 0 Ss select 0xfffff80009b37cc0 sshd 2710 1 2710 0 Ss select 0xfffff80006037f40 inetd 2684 1 2684 123 Ss select 0xfffff80019df5d40 ntpd 2658 1 2658 0 Rs powerd 2653 1 2653 0 Rs NLM: master 2650 1 2650 0 Ss select 0xfffff80003b2acc0 rpc.statd 2625 1 2625 0 Ss select 0xfffff800198bf6c0 rpcbind 2603 1 2603 0 Ss nanslp 0xffffffff81ebc0a8 watchdogd 2595 1 2595 0 Ss select 0xfffff8000439e3c0 syslogd 2406 1 2406 0 Ss select 0xfffff80019df5f40 devd 2401 1 2401 65 Ss select 0xfffff80009b37d40 dhclient 2342 1 2342 0 Ss select 0xfffff80009b37dc0 dhclient 2339 1 2339 0 Ss select 0xfffff80009b37e40 dhclient 34 0 0 0 RL [syncer] 33 0 0 0 DL vlruwt 0xfffff80019b81a70 [vnlru] 32 0 0 0 RL (threaded) [bufdaemon] 100213 RunQ [bufdaemon] 100214 RunQ [bufspacedaemon-0] 100215 D - 0xffffffff81a13200 [bufspacedaemon-1] 100216 D - 0xffffffff81a1b4c0 [bufspacedaemon-2] 100217 D - 0xffffffff81a23780 [bufspacedaemon-3] 100218 D - 0xffffffff81a2ba40 [bufspacedaemon-4] 100219 D - 0xffffffff81a33d00 [bufspacedaemon-5] 100220 D - 0xffffffff81a3bfc0 [bufspacedaemon-6] 100233 D sdflush 0xfffff800041bf0e8 [/ worker] 100242 RunQ [/tmp worker] 100636 RunQ [/mnt worker] 31 0 0 0 DL psleep 0xffffffff81fd0208 [vmdaemon] 30 0 0 0 RL (threaded) [pagedaemon] 100211 RunQ [dom0] 100221 D launds 0xffffffff81fc4684 [laundry: dom0] 100222 D umarcl 0xffffffff80f70880 [uma] 29 0 0 0 DL idle 0xfffff80003acfa70 [enc_daemon1] 28 0 0 0 DL idle 0xfffff80003af8000 [enc_daemon0] 27 0 0 0 RL [rand_harvestq] 26 0 0 0 DL - 0xffffffff81fa7bdc [soaiod4] 25 0 0 0 DL - 0xffffffff81fa7bdc [soaiod3] 24 0 0 0 DL - 0xffffffff81fa7bdc [soaiod2] 23 0 0 0 DL - 0xffffffff81fa7bdc [soaiod1] 22 0 0 0 DL (threaded) [usb] 100140 D - 0xfffffe010a178440 [usbus0] 100141 D - 0xfffffe010a178498 [usbus0] 100142 D - 0xfffffe010a1784f0 [usbus0] 100143 D - 0xfffffe010a178548 [usbus0] 100144 D - 0xfffffe010a1785a0 [usbus0] 100146 D - 0xfffffe00e4d56cf0 [usbus1] 100147 D - 0xfffffe00e4d56d48 [usbus1] 100148 D - 0xfffffe00e4d56da0 [usbus1] 100149 D - 0xfffffe00e4d56df8 [usbus1] 100150 D - 0xfffffe00e4d56e50 [usbus1] 100151 D - 0xfffffe010a538cf0 [usbus2] 100152 D - 0xfffffe010a538d48 [usbus2] 100153 D - 0xfffffe010a538da0 [usbus2] 100154 D - 0xfffffe010a538df8 [usbus2] 100155 D - 0xfffffe010a538e50 [usbus2] 21 0 0 0 RL (threaded) [cam] 100133 D - 0xffffffff81bc7ac0 [doneq0] 100134 RunQ [doneq1] 100135 D - 0xffffffff81bc7bc0 [doneq2] 100136 D - 0xffffffff81bc7a40 [async] 100168 D - 0xffffffff81bc7910 [scanner] 20 0 0 0 DL seqstat 0xfffff80003e12488 [sequencer 00] 19 0 0 0 DL crypto_ 0xfffff80003df1fa0 [crypto returns 11] 18 0 0 0 DL crypto_ 0xfffff80003df1f50 [crypto returns 10] 17 0 0 0 DL crypto_ 0xfffff80003df1f00 [crypto returns 9] 16 0 0 0 DL crypto_ 0xfffff80003df1eb0 [crypto returns 8] 15 0 0 0 DL crypto_ 0xfffff80003df1e60 [crypto returns 7] 14 0 0 0 DL crypto_ 0xfffff80003df1e10 [crypto returns 6] 9 0 0 0 DL crypto_ 0xfffff80003df1dc0 [crypto returns 5] 8 0 0 0 DL crypto_ 0xfffff80003df1d70 [crypto returns 4] 7 0 0 0 DL crypto_ 0xfffff80003df1d20 [crypto returns 3] 6 0 0 0 DL crypto_ 0xfffff80003df1cd0 [crypto returns 2] 5 0 0 0 DL crypto_ 0xfffff80003df1c80 [crypto returns 1] 4 0 0 0 DL crypto_ 0xfffff80003df1c30 [crypto returns 0] 3 0 0 0 DL crypto_ 0xffffffff81fc1ba0 [crypto] 13 0 0 0 DL (threaded) [geom] 100104 D - 0xffffffff81e9b920 [g_event] 100105 D - 0xffffffff81e9b928 [g_up] 100106 D - 0xffffffff81e9b930 [g_down] 2 0 0 0 DL (threaded) [KTLS] 100077 D - 0xfffff80003d79800 [thr_0] 100078 D - 0xfffff80003d79880 [thr_1] 100079 D - 0xfffff80003d79900 [thr_2] 100080 D - 0xfffff80003d79980 [thr_3] 100081 D - 0xfffff80003d79a00 [thr_4] 100082 D - 0xfffff80003d79a80 [thr_5] 100083 D - 0xfffff80003d79b00 [thr_6] 100084 D - 0xfffff80003d79b80 [thr_7] 100085 D - 0xfffff80003d79c00 [thr_8] 100086 D - 0xfffff80003d79c80 [thr_9] 100087 D - 0xfffff80003d79d00 [thr_10] 100088 D - 0xfffff80003d79d80 [thr_11] 12 0 0 0 WL (threaded) [intr] 100046 I [swi6: task queue] 100047 I [swi6: Giant taskq] 100049 I [swi5: fast taskq] 100089 I [swi4: clock (0)] 100090 I [swi4: clock (1)] 100091 I [swi4: clock (2)] 100092 I [swi4: clock (3)] 100093 I [swi4: clock (4)] 100094 I [swi4: clock (5)] 100095 I [swi4: clock (6)] 100096 I [swi4: clock (7)] 100097 I [swi4: clock (8)] 100098 I [swi4: clock (9)] 100099 I [swi4: clock (10)] 100100 I [swi4: clock (11)] 100101 I [swi1: netisr 0] 100102 I [swi3: vm] 100137 I [swi4: apei] 100138 I [irq56: ahci0] 100139 I [irq19: xhci0] 100145 I [irq18: ehci0 ehci1+] 100156 I [irq71: ahci1] 100157 I [swi0: uart uart] 100175 I [irq73: mlx5_core0] 100176 I [irq74: mlx5_core0] 100177 I [irq72: mlx5_core0] 100178 I [irq75: mlx5_core0] 100179 I [irq76: mlx5_core0] 100180 I [irq77: mlx5_core0] 100181 I [irq78: mlx5_core0] 100182 I [irq79: mlx5_core0] 100183 I [irq80: mlx5_core0] 100184 I [irq81: mlx5_core0] 100185 I [irq82: mlx5_core0] 100186 I [irq83: mlx5_core0] 100187 I [irq84: mlx5_core0] 100188 I [irq85: mlx5_core0] 100189 I [irq86: mlx5_core0] 100195 I [irq88: mlx5_core1] 100196 I [irq89: mlx5_core1] 100197 I [irq87: mlx5_core1] 100198 I [irq90: mlx5_core1] 100199 I [irq91: mlx5_core1] 100200 I [irq92: mlx5_core1] 100201 I [irq93: mlx5_core1] 100202 I [irq94: mlx5_core1] 100203 I [irq95: mlx5_core1] 100204 I [irq96: mlx5_core1] 100205 I [irq97: mlx5_core1] 100206 I [irq98: mlx5_core1] 100207 I [irq99: mlx5_core1] 100208 I [irq100: mlx5_core1] 100209 I [irq101: mlx5_core1] 100271 I [irq102: ioat0] 100272 I [irq103: ioat1] 100273 I [irq104: ioat2] 100274 I [irq105: ioat3] 100275 I [irq106: ioat4] 100276 I [irq107: ioat5] 100277 I [irq108: ioat6] 100278 I [irq109: ioat7] 11 0 0 0 RL (threaded) [idle] 100003 CanRun [idle: cpu0] 100004 CanRun [idle: cpu1] 100005 CanRun [idle: cpu2] 100006 CanRun [idle: cpu3] 100007 CanRun [idle: cpu4] 100008 CanRun [idle: cpu5] 100009 CanRun [idle: cpu6] 100010 CanRun [idle: cpu7] 100011 CanRun [idle: cpu8] 100012 CanRun [idle: cpu9] 100013 CanRun [idle: cpu10] 100014 CanRun [idle: cpu11] 1 0 1 0 RLs [init] 10 0 0 0 DL audit_w 0xffffffff81fc20b0 [audit] 0 0 0 0 RLs (threaded) [kernel] 100000 D swapin 0xffffffff81e9beb0 [swapper] 100015 D - 0xfffff80003965c00 [softirq_0] 100016 D - 0xfffff80003965b00 [softirq_1] 100017 D - 0xfffff80003965a00 [softirq_2] 100018 D - 0xfffff80003965900 [softirq_3] 100019 D - 0xfffff80003965800 [softirq_4] 100020 D - 0xfffff80003965700 [softirq_5] 100021 D - 0xfffff80003965600 [softirq_6] 100022 D - 0xfffff80003965500 [softirq_7] 100023 D - 0xfffff80003965400 [softirq_8] 100024 D - 0xfffff80003965300 [softirq_9] 100025 D - 0xfffff80003965200 [softirq_10] 100026 D - 0xfffff80003965100 [softirq_11] 100027 D - 0xfffff80003965000 [if_io_tqg_0] 100028 D - 0xfffff80003b1ce00 [if_io_tqg_1] 100029 D - 0xfffff80003b1cd00 [if_io_tqg_2] 100030 D - 0xfffff80003b1cc00 [if_io_tqg_3] 100031 D - 0xfffff80003b1cb00 [if_io_tqg_4] 100032 D - 0xfffff80003b1ca00 [if_io_tqg_5] 100033 D - 0xfffff80003b1c900 [if_io_tqg_6] 100034 D - 0xfffff80003b1c800 [if_io_tqg_7] 100035 D - 0xfffff80003b1c700 [if_io_tqg_8] 100036 D - 0xfffff80003b1c600 [if_io_tqg_9] 100037 D - 0xfffff80003b1c500 [if_io_tqg_10] 100038 D - 0xfffff80003b1c400 [if_io_tqg_11] 100039 D - 0xfffff80003b1c300 [if_config_tqg_0] 100040 D - 0xfffff80003b1fb00 [pci_hp taskq] 100041 D - 0xfffff80003b1fa00 [aiod_kick taskq] 100042 D - 0xfffff80003b1f900 [kqueue_ctx taskq] 100043 D - 0xfffff80003b1f800 [inm_free taskq] 100044 Run CPU 9 [deferred_unmount ta] 100045 D - 0xfffff80003b1f600 [linuxkpi_irq_wq] 100048 D - 0xfffff80003b1f100 [thread taskq] 100050 D - 0xfffff80003b12d00 [in6m_free taskq] 100051 D - 0xfffff80003b12c00 [linuxkpi_short_wq_0] 100052 D - 0xfffff80003b12c00 [linuxkpi_short_wq_1] 100053 D - 0xfffff80003b12c00 [linuxkpi_short_wq_2] 100054 D - 0xfffff80003b12c00 [linuxkpi_short_wq_3] 100055 D - 0xfffff80003b12c00 [linuxkpi_short_wq_4] 100056 D - 0xfffff80003b12c00 [linuxkpi_short_wq_5] 100057 D - 0xfffff80003b12c00 [linuxkpi_short_wq_6] 100058 D - 0xfffff80003b12c00 [linuxkpi_short_wq_7] 100059 D - 0xfffff80003b12c00 [linuxkpi_short_wq_8] 100060 D - 0xfffff80003b12c00 [linuxkpi_short_wq_9] 100061 D - 0xfffff80003b12c00 [linuxkpi_short_wq_1] 100062 D - 0xfffff80003b12c00 [linuxkpi_short_wq_1] 100063 D - 0xfffff80003b12c00 [linuxkpi_short_wq_1] 100064 D - 0xfffff80003b12b00 [linuxkpi_long_wq_0] 100065 D - 0xfffff80003b12b00 [linuxkpi_long_wq_1] 100066 D - 0xfffff80003b12b00 [linuxkpi_long_wq_2] 100067 D - 0xfffff80003b12b00 [linuxkpi_long_wq_3] 100068 D - 0xfffff80003b12b00 [linuxkpi_long_wq_4] 100069 D - 0xfffff80003b12b00 [linuxkpi_long_wq_5] 100070 D - 0xfffff80003b12b00 [linuxkpi_long_wq_6] 100071 D - 0xfffff80003b12b00 [linuxkpi_long_wq_7] 100072 D - 0xfffff80003b12b00 [linuxkpi_long_wq_8] 100073 D - 0xfffff80003b12b00 [linuxkpi_long_wq_9] 100074 D - 0xfffff80003b12b00 [linuxkpi_long_wq_10] 100075 D - 0xfffff80003b12b00 [linuxkpi_long_wq_11] 100076 D - 0xfffff80003b12b00 [linuxkpi_long_wq_12] 100103 D - 0xfffff80003d22e00 [firmware taskq] 100107 D - 0xfffff80003d22d00 [crypto_0] 100108 D - 0xfffff80003d22d00 [crypto_1] 100109 D - 0xfffff80003d22d00 [crypto_2] 100110 D - 0xfffff80003d22d00 [crypto_3] 100111 D - 0xfffff80003d22d00 [crypto_4] 100112 D - 0xfffff80003d22d00 [crypto_5] 100113 D - 0xfffff80003d22d00 [crypto_6] 100114 D - 0xfffff80003d22d00 [crypto_7] 100115 D - 0xfffff80003d22d00 [crypto_8] 100116 D - 0xfffff80003d22d00 [crypto_9] 100117 D - 0xfffff80003d22d00 [crypto_10] 100118 D - 0xfffff80003d22d00 [crypto_11] 100158 D - 0xfffff80006128c00 [mca taskq] 100164 D - 0xfffff80009a9be00 [acpi_task_0] 100165 D - 0xfffff80009a9be00 [acpi_task_1] 100166 D - 0xfffff80009a9be00 [acpi_task_2] 100167 D - 0xfffff80003d22c00 [CAM taskq] 100171 D - 0xfffff80009d06e00 [mlx5_core0-rec] 100172 D - 0xfffff80009d06d00 [mlx5_core0-wdg] 100173 D - 0xfffff80009d06c00 [mlx5_core0-cmd] 100174 D - 0xfffff80009d06b00 [mlx5_page_allocator] 100190 D - 0xfffff800152eba00 [mlx5_esw_wq] 100191 D - 0xfffff800152eb900 [mlx5_core1-rec] 100192 D - 0xfffff800152eb800 [mlx5_core1-wdg] 100193 D - 0xfffff800152eb700 [mlx5_core1-cmd] 100194 D - 0xfffff800152eb600 [mlx5_page_allocator] 100210 D - 0xfffff800198c6500 [mlx5_esw_wq] 68225 68206 2770 0 DE+ proctre 0xffffffff81a02a40 su 68252 1 68228 2007 DE+ proctre 0xffffffff81a02a40 lockf2 68254 1 68228 2007 DE+ proctre 0xffffffff81a02a40 rw 68261 1 68228 2007 DE+ proctre 0xffffffff81a02a40 lockf2 68263 1 68228 2007 DE+ proctre 0xffffffff81a02a40 rw 68266 1 68228 2007 DE+ proctre 0xffffffff81a02a40 rw 68272 1 68228 2007 DE+ proctre 0xffffffff81a02a40 rw 68276 1 68228 2007 DE+ proctre 0xffffffff81a02a40 rw 68282 1 68228 2007 Z+ lockf 68286 1 68228 2007 DE+ proctre 0xffffffff81a02a40 rw 68296 1 68228 2007 Z+ lockf 68300 1 68228 2007 DE+ proctre 0xffffffff81a02a40 rw 68307 1 68228 2007 Z+ mkfifo 68308 1 68228 2007 DE+ proctre 0xffffffff81a02a40 symlink 68309 1 68228 2007 Z+ dirrename 68310 1 68228 2007 Z+ lockf 68311 1 68228 2007 DE+ proctre 0xffffffff81a02a40 rw 68313 1 68228 2007 DE+ proctre 0xffffffff81a02a40 swap 68317 1 68228 2007 DE+ proctre 0xffffffff81a02a40 fts 68318 1 68228 2007 DE+ proctre 0xffffffff81a02a40 dirnprename 68319 1 68228 2007 DE+ proctre 0xffffffff81a02a40 rw 68320 1 68228 2007 DE+ proctre 0xffffffff81a02a40 swap 68322 1 68228 2007 DE+ proctre 0xffffffff81a02a40 rename 68324 1 68228 2007 Z+ lockf 68329 1 68228 2007 DE+ proctre 0xffffffff81a02a40 swap 68334 1 68228 2007 DE+ proctre 0xffffffff81a02a40 swap 68338 1 68228 2007 DE+ proctre 0xffffffff81a02a40 lockf 68345 1 68228 2007 DE+ proctre 0xffffffff81a02a40 swap 68346 1 68228 2007 DE+ proctre 0xffffffff81a02a40 fts 68350 1 68228 2007 DE+ proctre 0xffffffff81a02a40 lockf 68354 1 68228 2007 DE+ proctre 0xffffffff81a02a40 dirrename 68357 1 68228 2007 DE+ proctre 0xffffffff81a02a40 fts 68378 1 68228 2007 DE+ proctre 0xffffffff81a02a40 rename 68396 1 68228 2007 Z+ mkfifo 68399 1 68228 2007 DE+ proctre 0xffffffff81a02a40 mkfifo 68409 1 68228 2007 DE+ proctre 0xffffffff81a02a40 swap 68412 1 68228 2007 DE+ proctre 0xffffffff81a02a40 swap 68415 1 68228 2007 DE+ proctre 0xffffffff81a02a40 swap 68417 1 68228 2007 DE+ proctre 0xffffffff81a02a40 swap 69579 1 68228 2007 Z+ lockf 69581 1 68228 2007 DE+ proctre 0xffffffff81a02a40 lockf 69582 1 68228 2007 DE+ proctre 0xffffffff81a02a40 lockf 69586 1 68228 2007 Z+ lockf 69587 1 68228 2007 DE+ proctre 0xffffffff81a02a40 lockf 69589 68338 68228 2007 DE+ proctre 0xffffffff81a02a40 lockf 69590 1 68228 2007 DE+ proctre 0xffffffff81a02a40 lockf 69647 69277 2859 0 DE proctre 0xffffffff81a02a40 sh 69657 69652 2770 0 DE+ proctre 0xffffffff81a02a40 pkill db:0:pho> allt Tracing command kernel pid 0 tid 100000 td 0xffffffff81e9c400 sched_switch() at sched_switch+0x5af/frame 0xffffffff8254dac0 mi_switch() at mi_switch+0x155/frame 0xffffffff8254dae0 sleepq_switch() at sleepq_switch+0x119/frame 0xffffffff8254db20 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xffffffff8254db60 _sleep() at _sleep+0x298/frame 0xffffffff8254dc00 swapper() at swapper+0x75/frame 0xffffffff8254dc60 mi_startup() at mi_startup+0x2f3/frame 0xffffffff8254dcb0 btext() at btext+0x22 Tracing command kernel pid 0 tid 100015 td 0xfffffe00e4c5fc80 sched_switch() at sched_switch+0x5af/frame 0xfffffe00377ccab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00377ccad0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00377ccb10 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00377ccb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377ccbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377ccbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377ccbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100016 td 0xfffffe00e4c5f560 sched_switch() at sched_switch+0x5af/frame 0xfffffe00377c7ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00377c7ad0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00377c7b10 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00377c7b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377c7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377c7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377c7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100017 td 0xfffffe00e4c5ee40 sched_switch() at sched_switch+0x5af/frame 0xfffffe00377d6ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00377d6ad0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00377d6b10 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00377d6b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377d6bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377d6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377d6bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100018 td 0xfffffe00e4c5e720 sched_switch() at sched_switch+0x5af/frame 0xfffffe00377d1ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00377d1ad0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00377d1b10 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00377d1b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377d1bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377d1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377d1bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100019 td 0xfffffe00e4c5e000 sched_switch() at sched_switch+0x5af/frame 0xfffffe00377e0ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00377e0ad0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00377e0b10 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00377e0b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377e0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377e0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377e0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xfffffe00e4c62740 sched_switch() at sched_switch+0x5af/frame 0xfffffe00377dbab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00377dbad0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00377dbb10 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00377dbb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377dbbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377dbbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377dbbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xfffffe00e4c62020 sched_switch() at sched_switch+0x5af/frame 0xfffffe00377eaab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00377eaad0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00377eab10 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00377eab80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377eabb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377eabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377eabf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xfffffe00e4c61900 sched_switch() at sched_switch+0x5af/frame 0xfffffe00377e5ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00377e5ad0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00377e5b10 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00377e5b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377e5bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377e5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377e5bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xfffffe00e4cde1e0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00377f4ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00377f4ad0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00377f4b10 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00377f4b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377f4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377f4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377f4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xfffffe00e4cddac0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00377efab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00377efad0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00377efb10 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00377efb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377efbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377efbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377efbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xfffffe00e4cdd3a0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00377feab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00377fead0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00377feb10 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00377feb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377febb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377febf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377febf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100026 td 0xfffffe00e4cdcc80 sched_switch() at sched_switch+0x5af/frame 0xfffffe00377f9ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00377f9ad0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00377f9b10 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00377f9b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377f9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377f9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377f9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100027 td 0xfffffe00e4cdc560 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4835ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4835ad0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4835b10 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00e4835b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4835bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4835bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4835bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100028 td 0xfffffe00e4cdbe40 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4830ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4830ad0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4830b10 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00e4830b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4830bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4830bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4830bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100029 td 0xfffffe00e4cdb720 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e483fab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e483fad0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e483fb10 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00e483fb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e483fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e483fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e483fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100030 td 0xfffffe00e4cdb000 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e483aab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e483aad0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e483ab10 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00e483ab80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e483abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e483abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e483abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100031 td 0xfffffe00e4cdf740 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4849ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4849ad0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4849b10 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00e4849b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4849bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4849bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4849bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100032 td 0xfffffe00e4cdf020 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4844ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4844ad0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4844b10 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00e4844b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4844bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4844bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4844bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100033 td 0xfffffe00e4cde900 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4853ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4853ad0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4853b10 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00e4853b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4853bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4853bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4853bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100034 td 0xfffffe00e4ce51e0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e484eab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e484ead0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e484eb10 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00e484eb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e484ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e484ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e484ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100035 td 0xfffffe00e4ce4ac0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e485dab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e485dad0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e485db10 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00e485db80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e485dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e485dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e485dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100036 td 0xfffffe00e4ce43a0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4858ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4858ad0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4858b10 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00e4858b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4858bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4858bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4858bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100037 td 0xfffffe00e4ce3c80 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4867ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4867ad0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4867b10 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00e4867b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4867bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4867bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4867bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100038 td 0xfffffe00e4ce3560 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4862ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4862ad0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4862b10 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00e4862b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4862bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4862bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4862bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100039 td 0xfffffe00e4ce2e40 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4871ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4871ad0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4871b10 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00e4871b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4871bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4871bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4871bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100040 td 0xfffffe00e4ce2720 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e486ca80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e486caa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e486cae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e486cb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e486cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e486cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e486cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100041 td 0xfffffe00e4ce2000 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e487ba80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e487baa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e487bae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e487bb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e487bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e487bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e487bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100042 td 0xfffffe00e4ce6740 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4876a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4876aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4876ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4876b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4876bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4876bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4876bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100043 td 0xfffffe00e4ce6020 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4885a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4885aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4885ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4885b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4885bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4885bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4885bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100044 td 0xfffffe00e4ce5900 (CPU 9) kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e4880310 vpanic() at vpanic+0x1b8/frame 0xfffffe00e4880370 panic() at panic+0x43/frame 0xfffffe00e48803d0 trap_fatal() at trap_fatal+0x387/frame 0xfffffe00e4880430 trap_pfault() at trap_pfault+0x99/frame 0xfffffe00e4880490 trap() at trap+0x2a7/frame 0xfffffe00e48805a0 calltrap() at calltrap+0x8/frame 0xfffffe00e48805a0 --- trap 0xc, rip = 0xffffffff80ab9179, rsp = 0xfffffe00e4880670, rbp = 0xfffffe00e48806a0 --- fifo_close() at fifo_close+0x19/frame 0xfffffe00e48806a0 VOP_CLOSE_APV() at VOP_CLOSE_APV+0x56/frame 0xfffffe00e48806c0 null_bypass() at null_bypass+0x12b/frame 0xfffffe00e4880840 VOP_CLOSE_APV() at VOP_CLOSE_APV+0x56/frame 0xfffffe00e4880860 vgonel() at vgonel+0x243/frame 0xfffffe00e48808c0 vflush() at vflush+0x321/frame 0xfffffe00e4880a00 nullfs_unmount() at nullfs_unmount+0x51/frame 0xfffffe00e4880a40 dounmount() at dounmount+0x812/frame 0xfffffe00e4880ab0 vfs_deferred_unmount() at vfs_deferred_unmount+0xf9/frame 0xfffffe00e4880b00 taskqueue_run_locked() at taskqueue_run_locked+0xaa/frame 0xfffffe00e4880b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc2/frame 0xfffffe00e4880bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4880bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4880bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100045 td 0xfffffe00e4cec1e0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e488fab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e488fad0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e488fb10 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00e488fb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe00e488fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e488fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e488fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100048 td 0xfffffe00e4ceac80 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4894a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4894aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4894ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4894b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4894bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4894bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4894bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100050 td 0xfffffe00e4ce9e40 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e489ea80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e489eaa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e489eae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e489eb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e489ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e489ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e489ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100051 td 0xfffffe00e4ce9720 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e48ada80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e48adaa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e48adae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e48adb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48adbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48adbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48adbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100052 td 0xfffffe00e4ce9000 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e48a8a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e48a8aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e48a8ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e48a8b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48a8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48a8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48a8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100053 td 0xfffffe00e4ced740 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e48b7a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e48b7aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e48b7ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e48b7b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48b7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48b7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48b7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100054 td 0xfffffe00e4ced020 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e48b2a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e48b2aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e48b2ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e48b2b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48b2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48b2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48b2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100055 td 0xfffffe00e4cec900 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e48c1a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e48c1aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e48c1ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e48c1b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48c1bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48c1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48c1bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100056 td 0xfffffe00e4cf11e0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e48bca80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e48bcaa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e48bcae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e48bcb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48bcbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48bcbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48bcbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100057 td 0xfffffe00e4cf0ac0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e48cba80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e48cbaa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e48cbae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e48cbb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48cbbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48cbbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48cbbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100058 td 0xfffffe00e4cf03a0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e48c6a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e48c6aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e48c6ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e48c6b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48c6bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48c6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48c6bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100059 td 0xfffffe00e4cefc80 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e48d5a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e48d5aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e48d5ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e48d5b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48d5bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48d5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48d5bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100060 td 0xfffffe00e4cef560 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e48d0a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e48d0aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e48d0ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e48d0b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48d0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48d0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48d0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100061 td 0xfffffe00e4ceee40 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e48dfa80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e48dfaa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e48dfae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e48dfb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48dfbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48dfbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48dfbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100062 td 0xfffffe00e4cee720 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e48daa80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e48daaa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e48daae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e48dab80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48dabb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48dabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48dabf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100063 td 0xfffffe00e4cee000 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e48e9a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e48e9aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e48e9ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e48e9b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48e9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48e9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48e9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100064 td 0xfffffe00e4cf2740 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e48e4a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e48e4aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e48e4ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e48e4b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48e4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48e4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48e4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100065 td 0xfffffe00e4cf2020 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e48f3a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e48f3aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e48f3ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e48f3b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48f3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48f3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48f3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100066 td 0xfffffe00e4cf1900 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e48eea80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e48eeaa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e48eeae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e48eeb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48eebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48eebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48eebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100067 td 0xfffffe00e4cf61e0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e48fda80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e48fdaa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e48fdae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e48fdb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48fdbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48fdbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48fdbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100068 td 0xfffffe00e4cf5ac0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e48f8a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e48f8aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e48f8ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e48f8b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48f8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48f8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48f8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100069 td 0xfffffe00e4cf53a0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4907a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4907aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4907ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4907b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4907bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4907bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4907bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100070 td 0xfffffe00e4cf4c80 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4902a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4902aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4902ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4902b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4902bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4902bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4902bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100071 td 0xfffffe00e4cf4560 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4911a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4911aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4911ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4911b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4911bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4911bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4911bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100072 td 0xfffffe00e4cf3e40 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e490ca80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e490caa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e490cae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e490cb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e490cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e490cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e490cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100073 td 0xfffffe00e4cf3720 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e491ba80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e491baa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e491bae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e491bb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e491bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e491bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e491bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100074 td 0xfffffe00e4cf3000 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4916a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4916aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4916ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4916b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4916bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4916bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4916bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100075 td 0xfffffe00e4cf7740 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4925a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4925aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4925ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4925b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4925bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4925bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4925bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100076 td 0xfffffe00e4cf7020 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4920a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4920aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4920ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4920b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4920bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4920bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4920bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100103 td 0xfffffe00e4d08560 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e49eda80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e49edaa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e49edae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e49edb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e49edbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49edbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49edbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100107 td 0xfffffe00e4d0b740 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4e04a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e04aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e04ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4e04b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e04bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e04bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e04bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100108 td 0xfffffe00e4d0b020 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e49fca80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e49fcaa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e49fcae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e49fcb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e49fcbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49fcbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49fcbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100109 td 0xfffffe00e4d0a900 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4e0ea80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e0eaa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e0eae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4e0eb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e0ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e0ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e0ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100110 td 0xfffffe00e4d241e0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4e09a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e09aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e09ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4e09b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e09bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e09bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e09bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100111 td 0xfffffe00e4d23ac0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4e18a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e18aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e18ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4e18b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e18bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e18bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e18bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100112 td 0xfffffe00e4d233a0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4e13a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e13aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e13ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4e13b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e13bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e13bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e13bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100113 td 0xfffffe00e4d22c80 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4e22a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e22aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e22ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4e22b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e22bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e22bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e22bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100114 td 0xfffffe00e4d22560 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4e1da80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e1daa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e1dae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4e1db80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e1dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e1dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e1dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100115 td 0xfffffe00e4d21e40 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4e2ca80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e2caa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e2cae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4e2cb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e2cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e2cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e2cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100116 td 0xfffffe00e4d21720 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4e27a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e27aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e27ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4e27b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e27bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e27bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e27bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100117 td 0xfffffe00e4d21000 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4e36a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e36aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e36ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4e36b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e36bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e36bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e36bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100118 td 0xfffffe00e4d25740 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4e31a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e31aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e31ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4e31b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e31bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e31bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e31bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100158 td 0xfffffe010a6c7000 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4f05ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4f05ad0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4f05b10 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00e4f05b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe00e4f05bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f05bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f05bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100164 td 0xfffffe010d9ddac0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4f53ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4f53ad0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4f53b10 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00e4f53b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe00e4f53bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f53bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f53bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100165 td 0xfffffe010d9dd3a0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4f62ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4f62ad0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4f62b10 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00e4f62b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe00e4f62bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f62bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f62bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100166 td 0xfffffe010d9dcc80 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4f5dab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4f5dad0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4f5db10 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00e4f5db80 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe00e4f5dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f5dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f5dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100167 td 0xfffffe010d9dc560 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4f6ca80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4f6caa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4f6cae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4f6cb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4f6cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f6cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f6cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100171 td 0xfffffe010df791e0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4f80a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4f80aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4f80ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4f80b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4f80bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f80bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f80bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100172 td 0xfffffe010df78ac0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4f7ba80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4f7baa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4f7bae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4f7bb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4f7bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f7bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f7bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100173 td 0xfffffe010df783a0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4f8aa80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4f8aaa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4f8aae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4f8ab80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4f8abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f8abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f8abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100174 td 0xfffffe010df77c80 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4f85a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4f85aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4f85ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4f85b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4f85bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f85bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f85bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100190 td 0xfffffe010e08b740 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4fd5a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4fd5aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4fd5ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4fd5b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4fd5bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4fd5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4fd5bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100191 td 0xfffffe010e08b020 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4fe4a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4fe4aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4fe4ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4fe4b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4fe4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4fe4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4fe4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100192 td 0xfffffe010e08a900 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4fdfa80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4fdfaa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4fdfae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4fdfb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4fdfbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4fdfbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4fdfbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100193 td 0xfffffe010e1731e0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4feea80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4feeaa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4feeae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4feeb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4feebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4feebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4feebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100194 td 0xfffffe010e172ac0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4fe9a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4fe9aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4fe9ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4fe9b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4fe9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4fe9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4fe9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100210 td 0xfffffe010dde8720 sched_switch() at sched_switch+0x5af/frame 0xfffffe010e63ba80 mi_switch() at mi_switch+0x155/frame 0xfffffe010e63baa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe010e63bae0 _sleep() at _sleep+0x32f/frame 0xfffffe010e63bb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010e63bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe010e63bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010e63bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command init pid 1 tid 100002 td 0xfffffe00e4c5bac0 sched_switch() at sched_switch+0x5af/frame 0xfffffe0037781670 mi_switch() at mi_switch+0x155/frame 0xfffffe0037781690 ipi_bitmap_handler() at ipi_bitmap_handler+0x87/frame 0xfffffe00377816c0 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0xb3/frame 0xfffffe00377816c0 --- interrupt, rip = 0xffffffff80bfedcc, rsp = 0xfffffe0037781790, rbp = 0xfffffe00377817d0 --- __mtx_lock_flags() at __mtx_lock_flags+0x4c/frame 0xfffffe00377817d0 proc_to_reap() at proc_to_reap+0x63/frame 0xfffffe0037781820 kern_wait6() at kern_wait6+0x1bb/frame 0xfffffe00377818c0 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0037781ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0037781bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0037781bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x28df8a, rsp = 0x7fffffffe718, rbp = 0x7fffffffe780 --- Tracing command KTLS pid 2 tid 100077 td 0xfffffe00e4d001e0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e49479b0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e49479d0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4947a10 _sleep() at _sleep+0x32f/frame 0xfffffe00e4947ab0 ktls_work_thread() at ktls_work_thread+0xdc/frame 0xfffffe00e4947bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4947bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4947bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command KTLS pid 2 tid 100078 td 0xfffffe00e4cffac0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e49429b0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e49429d0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4942a10 _sleep() at _sleep+0x32f/frame 0xfffffe00e4942ab0 ktls_work_thread() at ktls_work_thread+0xdc/frame 0xfffffe00e4942bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4942bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4942bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command KTLS pid 2 tid 100079 td 0xfffffe00e4cff3a0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e49519b0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e49519d0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4951a10 _sleep() at _sleep+0x32f/frame 0xfffffe00e4951ab0 ktls_work_thread() at ktls_work_thread+0xdc/frame 0xfffffe00e4951bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4951bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4951bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command KTLS pid 2 tid 100080 td 0xfffffe00e4cfec80 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e494c9b0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e494c9d0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e494ca10 _sleep() at _sleep+0x32f/frame 0xfffffe00e494cab0 ktls_work_thread() at ktls_work_thread+0xdc/frame 0xfffffe00e494cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e494cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e494cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command KTLS pid 2 tid 100081 td 0xfffffe00e4cfe560 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e495b9b0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e495b9d0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e495ba10 _sleep() at _sleep+0x32f/frame 0xfffffe00e495bab0 ktls_work_thread() at ktls_work_thread+0xdc/frame 0xfffffe00e495bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e495bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e495bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command KTLS pid 2 tid 100082 td 0xfffffe00e4cfde40 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e49569b0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e49569d0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4956a10 _sleep() at _sleep+0x32f/frame 0xfffffe00e4956ab0 ktls_work_thread() at ktls_work_thread+0xdc/frame 0xfffffe00e4956bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4956bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4956bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command KTLS pid 2 tid 100083 td 0xfffffe00e4cfd720 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e49659b0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e49659d0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4965a10 _sleep() at _sleep+0x32f/frame 0xfffffe00e4965ab0 ktls_work_thread() at ktls_work_thread+0xdc/frame 0xfffffe00e4965bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4965bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4965bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command KTLS pid 2 tid 100084 td 0xfffffe00e4cfd000 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e49609b0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e49609d0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4960a10 _sleep() at _sleep+0x32f/frame 0xfffffe00e4960ab0 ktls_work_thread() at ktls_work_thread+0xdc/frame 0xfffffe00e4960bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4960bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4960bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command KTLS pid 2 tid 100085 td 0xfffffe00e4d01740 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e496f9b0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e496f9d0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e496fa10 _sleep() at _sleep+0x32f/frame 0xfffffe00e496fab0 ktls_work_thread() at ktls_work_thread+0xdc/frame 0xfffffe00e496fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e496fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e496fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command KTLS pid 2 tid 100086 td 0xfffffe00e4d01020 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e496a9b0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e496a9d0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e496aa10 _sleep() at _sleep+0x32f/frame 0xfffffe00e496aab0 ktls_work_thread() at ktls_work_thread+0xdc/frame 0xfffffe00e496abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e496abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e496abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command KTLS pid 2 tid 100087 td 0xfffffe00e4d00900 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e49799b0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e49799d0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4979a10 _sleep() at _sleep+0x32f/frame 0xfffffe00e4979ab0 ktls_work_thread() at ktls_work_thread+0xdc/frame 0xfffffe00e4979bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4979bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4979bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command KTLS pid 2 tid 100088 td 0xfffffe00e4d051e0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e49749b0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e49749d0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4974a10 _sleep() at _sleep+0x32f/frame 0xfffffe00e4974ab0 ktls_work_thread() at ktls_work_thread+0xdc/frame 0xfffffe00e4974bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4974bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4974bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100119 td 0xfffffe00e4d25020 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4e40a70 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e40a90 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e40ad0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4e40b70 crypto_proc() at crypto_proc+0xbf/frame 0xfffffe00e4e40bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e40bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e40bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 0 pid 4 tid 100120 td 0xfffffe00e4d24900 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4e3ba70 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e3ba90 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e3bad0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4e3bb70 crypto_ret_proc() at crypto_ret_proc+0x144/frame 0xfffffe00e4e3bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e3bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e3bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 1 pid 5 tid 100121 td 0xfffffe00e4d291e0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4e4aa70 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e4aa90 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e4aad0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4e4ab70 crypto_ret_proc() at crypto_ret_proc+0x144/frame 0xfffffe00e4e4abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e4abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e4abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 2 pid 6 tid 100122 td 0xfffffe00e4d28ac0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4e45a70 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e45a90 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e45ad0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4e45b70 crypto_ret_proc() at crypto_ret_proc+0x144/frame 0xfffffe00e4e45bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e45bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e45bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 3 pid 7 tid 100123 td 0xfffffe00e4d283a0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4e54a70 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e54a90 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e54ad0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4e54b70 crypto_ret_proc() at crypto_ret_proc+0x144/frame 0xfffffe00e4e54bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e54bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e54bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 4 pid 8 tid 100124 td 0xfffffe00e4d27c80 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4e4fa70 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e4fa90 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e4fad0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4e4fb70 crypto_ret_proc() at crypto_ret_proc+0x144/frame 0xfffffe00e4e4fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e4fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e4fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 5 pid 9 tid 100125 td 0xfffffe00e4d27560 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4e5ea70 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e5ea90 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e5ead0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4e5eb70 crypto_ret_proc() at crypto_ret_proc+0x144/frame 0xfffffe00e4e5ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e5ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e5ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command audit pid 10 tid 100001 td 0xfffffe00e4c5c1e0 sched_switch() at sched_switch+0x5af/frame 0xfffffe0037786a90 mi_switch() at mi_switch+0x155/frame 0xfffffe0037786ab0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0037786af0 _cv_wait() at _cv_wait+0x166/frame 0xfffffe0037786b50 audit_worker() at audit_worker+0x9f/frame 0xfffffe0037786bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037786bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037786bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100003 td 0xfffffe00e4c5b3a0 sched_switch() at sched_switch+0x5af/frame 0xfffffe0037790ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037790ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe0037790bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037790bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037790bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffffe00e4c5ac80 sched_switch() at sched_switch+0x5af/frame 0xfffffe003778bac0 mi_switch() at mi_switch+0x155/frame 0xfffffe003778bae0 sched_idletd() at sched_idletd+0x41d/frame 0xfffffe003778bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003778bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003778bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffffe00e4c5a560 sched_switch() at sched_switch+0x5af/frame 0xfffffe003779aac0 mi_switch() at mi_switch+0x155/frame 0xfffffe003779aae0 sched_idletd() at sched_idletd+0x41d/frame 0xfffffe003779abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003779abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003779abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffffe00e4c59e40 sched_switch() at sched_switch+0x5af/frame 0xfffffe0037795ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037795ae0 sched_idletd() at sched_idletd+0x41d/frame 0xfffffe0037795bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037795bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037795bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffffe00e4c59720 sched_switch() at sched_switch+0x5af/frame 0xfffffe00377a4ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00377a4ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00377a4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377a4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377a4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffffe00e4c59000 sched_switch() at sched_switch+0x5af/frame 0xfffffe003779fac0 mi_switch() at mi_switch+0x155/frame 0xfffffe003779fae0 sched_idletd() at sched_idletd+0x41d/frame 0xfffffe003779fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003779fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003779fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffffe00e4c5d740 sched_switch() at sched_switch+0x5af/frame 0xfffffe00377aeac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00377aeae0 sched_idletd() at sched_idletd+0x41d/frame 0xfffffe00377aebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377aebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377aebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffffe00e4c5d020 sched_switch() at sched_switch+0x5af/frame 0xfffffe00377a9ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00377a9ae0 sched_idletd() at sched_idletd+0x41d/frame 0xfffffe00377a9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377a9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377a9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffffe00e4c5c900 sched_switch() at sched_switch+0x5af/frame 0xfffffe00377b8ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00377b8ae0 sched_idletd() at sched_idletd+0x9e/frame 0xfffffe00377b8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377b8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377b8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffffe00e4c611e0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00377b3ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00377b3ae0 sched_idletd() at sched_idletd+0x41d/frame 0xfffffe00377b3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377b3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377b3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffffe00e4c60ac0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00377c2ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00377c2ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00377c2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377c2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377c2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffffe00e4c603a0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00377bdac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00377bdae0 sched_idletd() at sched_idletd+0x41d/frame 0xfffffe00377bdbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377bdbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377bdbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100046 td 0xfffffe00e4cebac0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e488ab00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e488ab20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e488abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e488abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e488abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100047 td 0xfffffe00e4ceb3a0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4899b00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4899b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4899bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4899bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4899bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100049 td 0xfffffe00e4cea560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100089 td 0xfffffe00e4d04ac0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4983b00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4983b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4983bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4983bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4983bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100090 td 0xfffffe00e4d043a0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e497eb00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e497eb20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e497ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e497ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e497ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100091 td 0xfffffe00e4d03c80 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e498db00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e498db20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e498dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e498dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e498dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100092 td 0xfffffe00e4d03560 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4988b00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4988b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4988bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4988bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4988bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100093 td 0xfffffe00e4d02e40 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4997b00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4997b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4997bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4997bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4997bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100094 td 0xfffffe00e4d02720 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4992b00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4992b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4992bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4992bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4992bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100095 td 0xfffffe00e4d02000 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e49a1b00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e49a1b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e49a1bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49a1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49a1bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100096 td 0xfffffe00e4d06740 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e499cb00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e499cb20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e499cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e499cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e499cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100097 td 0xfffffe00e4d06020 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e49abb00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e49abb20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e49abbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49abbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49abbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100098 td 0xfffffe00e4d05900 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e49a6b00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e49a6b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e49a6bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49a6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49a6bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100099 td 0xfffffe00e4d0a1e0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e49b5b00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e49b5b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e49b5bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49b5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49b5bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100100 td 0xfffffe00e4d09ac0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e49b0b00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e49b0b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e49b0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49b0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49b0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100101 td 0xfffffe00e4d093a0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e49bfb00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e49bfb20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e49bfbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49bfbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49bfbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100102 td 0xfffffe00e4d08c80 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100137 td 0xfffffe00e4d3f740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100138 td 0xfffffe00e4d3f020 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4e95b00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e95b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4e95bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e95bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e95bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100139 td 0xfffffe00e4d3e900 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4ea4b00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4ea4b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4ea4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ea4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ea4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100145 td 0xfffffe010a17ae40 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4ec2b00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4ec2b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4ec2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ec2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ec2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100156 td 0xfffffe010a6c7e40 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100157 td 0xfffffe010a6c7720 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4f0ab00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4f0ab20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4f0abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f0abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f0abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100175 td 0xfffffe010df77560 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4f94b00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4f94b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4f94bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f94bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f94bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100176 td 0xfffffe010df76e40 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100177 td 0xfffffe010df76720 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100178 td 0xfffffe010df76000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100179 td 0xfffffe010df7a740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100180 td 0xfffffe010df7a020 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100181 td 0xfffffe010df79900 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100182 td 0xfffffe010e08a1e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100183 td 0xfffffe010e089ac0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100184 td 0xfffffe010e0893a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100185 td 0xfffffe010e088c80 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100186 td 0xfffffe010e088560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100187 td 0xfffffe010e087e40 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100188 td 0xfffffe010e087720 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100189 td 0xfffffe010e087000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100195 td 0xfffffe010e1723a0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4ff8b00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4ff8b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4ff8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ff8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ff8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100196 td 0xfffffe010e171c80 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100197 td 0xfffffe010e171560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100198 td 0xfffffe010e170e40 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100199 td 0xfffffe010e170720 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100200 td 0xfffffe010e170000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100201 td 0xfffffe010e174740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100202 td 0xfffffe010e174020 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100203 td 0xfffffe010e173900 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100204 td 0xfffffe010ddeb1e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100205 td 0xfffffe010ddeaac0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100206 td 0xfffffe010ddea3a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100207 td 0xfffffe010dde9c80 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100208 td 0xfffffe010dde9560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100209 td 0xfffffe010dde8e40 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100271 td 0xfffffe010e3bbc80 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100272 td 0xfffffe010e3bb560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100273 td 0xfffffe010e3bae40 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100274 td 0xfffffe010e3ba720 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100275 td 0xfffffe010e3ba000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100276 td 0xfffffe01435b7740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100277 td 0xfffffe01435b7020 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100278 td 0xfffffe01435b6900 fork_trampoline() at fork_trampoline Tracing command geom pid 13 tid 100104 td 0xfffffe00e4d07e40 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e49e8a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e49e8aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e49e8ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e49e8b80 g_run_events() at g_run_events+0x474/frame 0xfffffe00e49e8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49e8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49e8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100105 td 0xfffffe00e4d07720 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e49f7a70 mi_switch() at mi_switch+0x155/frame 0xfffffe00e49f7a90 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e49f7ad0 _sleep() at _sleep+0x32f/frame 0xfffffe00e49f7b70 g_io_schedule_up() at g_io_schedule_up+0x3c/frame 0xfffffe00e49f7ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe00e49f7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49f7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49f7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100106 td 0xfffffe00e4d07000 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e49f2a70 mi_switch() at mi_switch+0x155/frame 0xfffffe00e49f2a90 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e49f2ad0 _sleep() at _sleep+0x32f/frame 0xfffffe00e49f2b70 g_io_schedule_down() at g_io_schedule_down+0x4c/frame 0xfffffe00e49f2ba0 g_down_procbody() at g_down_procbody+0x5c/frame 0xfffffe00e49f2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49f2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49f2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 6 pid 14 tid 100126 td 0xfffffe00e4d26e40 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4e59a70 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e59a90 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e59ad0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4e59b70 crypto_ret_proc() at crypto_ret_proc+0x144/frame 0xfffffe00e4e59bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e59bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e59bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 7 pid 15 tid 100127 td 0xfffffe00e4d26720 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4e68a70 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e68a90 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e68ad0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4e68b70 crypto_ret_proc() at crypto_ret_proc+0x144/frame 0xfffffe00e4e68bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e68bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e68bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 8 pid 16 tid 100128 td 0xfffffe00e4d26000 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4e63a70 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e63a90 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e63ad0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4e63b70 crypto_ret_proc() at crypto_ret_proc+0x144/frame 0xfffffe00e4e63bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e63bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e63bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 9 pid 17 tid 100129 td 0xfffffe00e4d2a740 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4e72a70 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e72a90 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e72ad0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4e72b70 crypto_ret_proc() at crypto_ret_proc+0x144/frame 0xfffffe00e4e72bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e72bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e72bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 10 pid 18 tid 100130 td 0xfffffe00e4d2a020 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4e6da70 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e6da90 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e6dad0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4e6db70 crypto_ret_proc() at crypto_ret_proc+0x144/frame 0xfffffe00e4e6dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e6dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e6dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 11 pid 19 tid 100131 td 0xfffffe00e4d29900 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4e7ca70 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e7ca90 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e7cad0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4e7cb70 crypto_ret_proc() at crypto_ret_proc+0x144/frame 0xfffffe00e4e7cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e7cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e7cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sequencer 00 pid 20 tid 100132 td 0xfffffe00e4d3e1e0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4e77a70 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e77a90 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e77ad0 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4e77b30 seq_eventthread() at seq_eventthread+0x8c/frame 0xfffffe00e4e77bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e77bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e77bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 21 tid 100133 td 0xfffffe00e4d3dac0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4e86a60 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e86a80 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e86ac0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4e86b60 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe00e4e86bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e86bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e86bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 21 tid 100134 td 0xfffffe00e4d3d3a0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4e81a60 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e81a80 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e81ac0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4e81b60 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe00e4e81bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e81bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e81bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 21 tid 100135 td 0xfffffe00e4d3cc80 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4e90a60 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e90a80 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e90ac0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4e90b60 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe00e4e90bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e90bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e90bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 21 tid 100136 td 0xfffffe00e4d3c560 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4e8ba60 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e8ba80 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e8bac0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4e8bb60 xpt_async_td() at xpt_async_td+0x74/frame 0xfffffe00e4e8bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e8bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e8bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 21 tid 100168 td 0xfffffe010d9dbe40 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4f67a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4f67aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4f67ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4f67b80 xpt_scanner_thread() at xpt_scanner_thread+0x158/frame 0xfffffe00e4f67bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f67bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f67bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 22 tid 100140 td 0xfffffe010a17d1e0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4e9fac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e9fae0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e9fb20 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4e9fb80 usb_process() at usb_process+0xb3/frame 0xfffffe00e4e9fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e9fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e9fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 22 tid 100141 td 0xfffffe010a17cac0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4eaeac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4eaeae0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4eaeb20 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4eaeb80 usb_process() at usb_process+0xb3/frame 0xfffffe00e4eaebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4eaebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4eaebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 22 tid 100142 td 0xfffffe010a17c3a0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4ea9ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4ea9ae0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4ea9b20 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4ea9b80 usb_process() at usb_process+0xb3/frame 0xfffffe00e4ea9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ea9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ea9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 22 tid 100143 td 0xfffffe010a17bc80 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4eb8ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4eb8ae0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4eb8b20 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4eb8b80 usb_process() at usb_process+0xb3/frame 0xfffffe00e4eb8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4eb8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4eb8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 22 tid 100144 td 0xfffffe010a17b560 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4eb3ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4eb3ae0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4eb3b20 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4eb3b80 usb_process() at usb_process+0xb3/frame 0xfffffe00e4eb3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4eb3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4eb3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 22 tid 100146 td 0xfffffe010a17a720 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4ebdac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4ebdae0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4ebdb20 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4ebdb80 usb_process() at usb_process+0xb3/frame 0xfffffe00e4ebdbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ebdbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ebdbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 22 tid 100147 td 0xfffffe010a17a000 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4eccac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4eccae0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4eccb20 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4eccb80 usb_process() at usb_process+0xb3/frame 0xfffffe00e4eccbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4eccbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4eccbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 22 tid 100148 td 0xfffffe010a17e740 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4ec7ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4ec7ae0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4ec7b20 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4ec7b80 usb_process() at usb_process+0xb3/frame 0xfffffe00e4ec7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ec7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ec7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 22 tid 100149 td 0xfffffe010a17e020 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4ed6ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4ed6ae0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4ed6b20 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4ed6b80 usb_process() at usb_process+0xb3/frame 0xfffffe00e4ed6bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ed6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ed6bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 22 tid 100150 td 0xfffffe010a17d900 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4ed1ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4ed1ae0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4ed1b20 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4ed1b80 usb_process() at usb_process+0xb3/frame 0xfffffe00e4ed1bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ed1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ed1bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 22 tid 100151 td 0xfffffe010a6ca1e0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4eecac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4eecae0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4eecb20 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4eecb80 usb_process() at usb_process+0xb3/frame 0xfffffe00e4eecbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4eecbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4eecbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 22 tid 100152 td 0xfffffe010a6c9ac0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4ee7ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4ee7ae0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4ee7b20 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4ee7b80 usb_process() at usb_process+0xb3/frame 0xfffffe00e4ee7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ee7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ee7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 22 tid 100153 td 0xfffffe010a6c93a0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4ef6ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4ef6ae0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4ef6b20 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4ef6b80 usb_process() at usb_process+0xb3/frame 0xfffffe00e4ef6bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ef6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ef6bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 22 tid 100154 td 0xfffffe010a6c8c80 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4ef1ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4ef1ae0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4ef1b20 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4ef1b80 usb_process() at usb_process+0xb3/frame 0xfffffe00e4ef1bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ef1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ef1bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 22 tid 100155 td 0xfffffe010a6c8560 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4f00ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4f00ae0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4f00b20 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4f00b80 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f00bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f00bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f00bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod1 pid 23 tid 100159 td 0xfffffe00e4cf6900 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4f2ca30 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4f2ca50 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4f2ca90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e4f2cad0 _sleep() at _sleep+0x298/frame 0xfffffe00e4f2cb70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe00e4f2cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f2cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f2cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod2 pid 24 tid 100160 td 0xfffffe010a6cb740 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4f27a30 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4f27a50 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4f27a90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e4f27ad0 _sleep() at _sleep+0x298/frame 0xfffffe00e4f27b70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe00e4f27bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f27bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f27bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod3 pid 25 tid 100161 td 0xfffffe010a6cb020 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4f36a30 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4f36a50 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4f36a90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e4f36ad0 _sleep() at _sleep+0x298/frame 0xfffffe00e4f36b70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe00e4f36bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f36bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f36bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod4 pid 26 tid 100162 td 0xfffffe010a6ca900 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4f31a30 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4f31a50 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4f31a90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e4f31ad0 _sleep() at _sleep+0x298/frame 0xfffffe00e4f31b70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe00e4f31bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f31bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f31bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command rand_harvestq pid 27 tid 100163 td 0xfffffe010d9de1e0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4f589e0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4f58a00 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4f58a40 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e4f58a80 _sleep() at _sleep+0x298/frame 0xfffffe00e4f58b20 random_kthread() at random_kthread+0x87/frame 0xfffffe00e4f58bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f58bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f58bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon0 pid 28 tid 100169 td 0xfffffe010d9df740 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4f76a40 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4f76a60 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4f76aa0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4f76b40 enc_daemon() at enc_daemon+0xf6/frame 0xfffffe00e4f76bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f76bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f76bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon1 pid 29 tid 100170 td 0xfffffe010d9df020 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4f71a40 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4f71a60 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4f71aa0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4f71b40 enc_daemon() at enc_daemon+0xf6/frame 0xfffffe00e4f71bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f71bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f71bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100211 td 0xfffffe010dde8000 sched_switch() at sched_switch+0x5af/frame 0xfffffe010e64a770 mi_switch() at mi_switch+0x155/frame 0xfffffe010e64a790 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe010e64a7d0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010e64a810 _sleep() at _sleep+0x298/frame 0xfffffe010e64a8b0 vm_pageout_worker() at vm_pageout_worker+0x29c/frame 0xfffffe010e64ab70 vm_pageout() at vm_pageout+0x1d7/frame 0xfffffe010e64abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe010e64abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010e64abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100221 td 0xfffffe010dedd740 sched_switch() at sched_switch+0x5af/frame 0xfffffe01146fe830 mi_switch() at mi_switch+0x155/frame 0xfffffe01146fe850 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01146fe890 _sleep() at _sleep+0x32f/frame 0xfffffe01146fe930 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0xb9c/frame 0xfffffe01146febb0 fork_exit() at fork_exit+0x80/frame 0xfffffe01146febf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01146febf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100222 td 0xfffffe010dedd020 sched_switch() at sched_switch+0x5af/frame 0xfffffe01146f9a40 mi_switch() at mi_switch+0x155/frame 0xfffffe01146f9a60 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01146f9aa0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe01146f9ae0 _sleep() at _sleep+0x298/frame 0xfffffe01146f9b80 uma_reclaim_worker() at uma_reclaim_worker+0xc8/frame 0xfffffe01146f9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe01146f9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01146f9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vmdaemon pid 31 tid 100212 td 0xfffffe010ddec740 sched_switch() at sched_switch+0x5af/frame 0xfffffe010e645a40 mi_switch() at mi_switch+0x155/frame 0xfffffe010e645a60 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe010e645aa0 _sleep() at _sleep+0x32f/frame 0xfffffe010e645b40 vm_daemon() at vm_daemon+0x82/frame 0xfffffe010e645bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe010e645bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010e645bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100213 td 0xfffffe010ddec020 sched_switch() at sched_switch+0x5af/frame 0xfffffe010e660b10 mi_switch() at mi_switch+0x155/frame 0xfffffe010e660b30 kern_yield() at kern_yield+0x71/frame 0xfffffe010e660b70 buf_daemon() at buf_daemon+0x203/frame 0xfffffe010e660bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe010e660bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010e660bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100214 td 0xfffffe010dedc1e0 sched_switch() at sched_switch+0x5af/frame 0xfffffe010fa7ea10 mi_switch() at mi_switch+0x155/frame 0xfffffe010fa7ea30 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe010fa7ea70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010fa7eab0 _sleep() at _sleep+0x298/frame 0xfffffe010fa7eb50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe010fa7ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe010fa7ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010fa7ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100215 td 0xfffffe010dedbac0 sched_switch() at sched_switch+0x5af/frame 0xfffffe010f978a10 mi_switch() at mi_switch+0x155/frame 0xfffffe010f978a30 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe010f978a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010f978ab0 _sleep() at _sleep+0x298/frame 0xfffffe010f978b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe010f978bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe010f978bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010f978bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100216 td 0xfffffe010dedb3a0 sched_switch() at sched_switch+0x5af/frame 0xfffffe0110290a10 mi_switch() at mi_switch+0x155/frame 0xfffffe0110290a30 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0110290a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0110290ab0 _sleep() at _sleep+0x298/frame 0xfffffe0110290b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe0110290bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0110290bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0110290bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100217 td 0xfffffe010dedac80 sched_switch() at sched_switch+0x5af/frame 0xfffffe010ff88a10 mi_switch() at mi_switch+0x155/frame 0xfffffe010ff88a30 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe010ff88a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010ff88ab0 _sleep() at _sleep+0x298/frame 0xfffffe010ff88b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe010ff88bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe010ff88bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010ff88bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100218 td 0xfffffe010deda560 sched_switch() at sched_switch+0x5af/frame 0xfffffe0110aa2a10 mi_switch() at mi_switch+0x155/frame 0xfffffe0110aa2a30 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0110aa2a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0110aa2ab0 _sleep() at _sleep+0x298/frame 0xfffffe0110aa2b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe0110aa2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0110aa2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0110aa2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100219 td 0xfffffe010ded9e40 sched_switch() at sched_switch+0x5af/frame 0xfffffe0110699a10 mi_switch() at mi_switch+0x155/frame 0xfffffe0110699a30 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0110699a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0110699ab0 _sleep() at _sleep+0x298/frame 0xfffffe0110699b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe0110699bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0110699bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0110699bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100220 td 0xfffffe010ded9720 sched_switch() at sched_switch+0x5af/frame 0xfffffe01112c0a10 mi_switch() at mi_switch+0x155/frame 0xfffffe01112c0a30 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01112c0a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe01112c0ab0 _sleep() at _sleep+0x298/frame 0xfffffe01112c0b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe01112c0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe01112c0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01112c0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100233 td 0xfffffe00e4d3b720 sched_switch() at sched_switch+0x5af/frame 0xfffffe01415eda30 mi_switch() at mi_switch+0x155/frame 0xfffffe01415eda50 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01415eda90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe01415edad0 _sleep() at _sleep+0x298/frame 0xfffffe01415edb70 softdep_flush() at softdep_flush+0x188/frame 0xfffffe01415edbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe01415edbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01415edbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100242 td 0xfffffe010e5983a0 sched_switch() at sched_switch+0x5af/frame 0xfffffe014161fa30 mi_switch() at mi_switch+0x155/frame 0xfffffe014161fa50 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe014161fa90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe014161fad0 _sleep() at _sleep+0x298/frame 0xfffffe014161fb70 softdep_flush() at softdep_flush+0x188/frame 0xfffffe014161fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe014161fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe014161fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100636 td 0xfffffe014789e720 sched_switch() at sched_switch+0x5af/frame 0xfffffe0147bf37b0 mi_switch() at mi_switch+0x155/frame 0xfffffe0147bf37d0 __mtx_lock_sleep() at __mtx_lock_sleep+0x1c9/frame 0xfffffe0147bf3860 __mtx_lock_flags() at __mtx_lock_flags+0xef/frame 0xfffffe0147bf38b0 vn_start_secondary_write() at vn_start_secondary_write+0xda/frame 0xfffffe0147bf3920 ufs_inactive() at ufs_inactive+0x84/frame 0xfffffe0147bf3960 VOP_INACTIVE_APV() at VOP_INACTIVE_APV+0x59/frame 0xfffffe0147bf3980 vinactivef() at vinactivef+0xda/frame 0xfffffe0147bf39c0 vput_final() at vput_final+0x2fe/frame 0xfffffe0147bf3a20 handle_workitem_remove() at handle_workitem_remove+0x4b2/frame 0xfffffe0147bf3aa0 process_worklist_item() at process_worklist_item+0x2bd/frame 0xfffffe0147bf3b30 softdep_process_worklist() at softdep_process_worklist+0xb7/frame 0xfffffe0147bf3b70 softdep_flush() at softdep_flush+0x10f/frame 0xfffffe0147bf3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0147bf3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0147bf3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vnlru pid 33 tid 100223 td 0xfffffe010ddeb900 sched_switch() at sched_switch+0x5af/frame 0xfffffe010e65b9d0 mi_switch() at mi_switch+0x155/frame 0xfffffe010e65b9f0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe010e65ba30 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010e65ba70 _sleep() at _sleep+0x298/frame 0xfffffe010e65bb10 vnlru_proc() at vnlru_proc+0xa2c/frame 0xfffffe010e65bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe010e65bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010e65bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command syncer pid 34 tid 100224 td 0xfffffe010e3bd1e0 sched_switch() at sched_switch+0x5af/frame 0xfffffe01415d4a00 mi_switch() at mi_switch+0x155/frame 0xfffffe01415d4a20 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01415d4a60 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe01415d4aa0 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x19b/frame 0xfffffe01415d4b20 sched_sync() at sched_sync+0x63d/frame 0xfffffe01415d4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe01415d4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01415d4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command dhclient pid 2339 tid 100265 td 0xfffffe0143561020 sched_switch() at sched_switch+0x5af/frame 0xfffffe01416b1720 mi_switch() at mi_switch+0x155/frame 0xfffffe01416b1740 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01416b1780 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01416b17d0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01416b17e0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe01416b1840 seltdwait() at seltdwait+0x8d/frame 0xfffffe01416b1880 kern_select() at kern_select+0xa4e/frame 0xfffffe01416b1a80 sys_select() at sys_select+0x56/frame 0xfffffe01416b1ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01416b1bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01416b1bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8011e672a, rsp = 0x7fffffffe938, rbp = 0x7fffffffe9f0 --- Tracing command dhclient pid 2342 tid 100244 td 0xfffffe010e5b0740 sched_switch() at sched_switch+0x5af/frame 0xfffffe0141655760 mi_switch() at mi_switch+0x155/frame 0xfffffe0141655780 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01416557c0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0141655810 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0141655820 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe0141655880 seltdwait() at seltdwait+0x8d/frame 0xfffffe01416558c0 kern_poll_kfds() at kern_poll_kfds+0x41b/frame 0xfffffe0141655950 kern_poll() at kern_poll+0x9f/frame 0xfffffe0141655aa0 sys_poll() at sys_poll+0x50/frame 0xfffffe0141655ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0141655bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141655bf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8011e662a, rsp = 0x7fffffffeb78, rbp = 0x7fffffffebb0 --- Tracing command dhclient pid 2401 tid 100236 td 0xfffffe010e3bc3a0 sched_switch() at sched_switch+0x5af/frame 0xfffffe014161a710 mi_switch() at mi_switch+0x155/frame 0xfffffe014161a730 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe014161a770 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014161a7c0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe014161a800 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x19b/frame 0xfffffe014161a880 seltdwait() at seltdwait+0x7f/frame 0xfffffe014161a8c0 kern_poll_kfds() at kern_poll_kfds+0x41b/frame 0xfffffe014161a950 kern_poll() at kern_poll+0x9f/frame 0xfffffe014161aaa0 sys_poll() at sys_poll+0x50/frame 0xfffffe014161aac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014161abf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014161abf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8011e662a, rsp = 0x7fffffffeb78, rbp = 0x7fffffffebb0 --- Tracing command devd pid 2406 tid 100280 td 0xfffffe0143599c80 sched_switch() at sched_switch+0x5af/frame 0xfffffe01417326d0 mi_switch() at mi_switch+0x155/frame 0xfffffe01417326f0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0141732730 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0141732780 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe01417327c0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x19b/frame 0xfffffe0141732840 seltdwait() at seltdwait+0x7f/frame 0xfffffe0141732880 kern_select() at kern_select+0xa4e/frame 0xfffffe0141732a80 sys_select() at sys_select+0x56/frame 0xfffffe0141732ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0141732bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141732bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x28c62a, rsp = 0x7fffffffcab8, rbp = 0x7fffffffec50 --- Tracing command syslogd pid 2595 tid 100284 td 0xfffffe0143599560 sched_switch() at sched_switch+0x5af/frame 0xfffffe014172d720 mi_switch() at mi_switch+0x155/frame 0xfffffe014172d740 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe014172d780 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014172d7d0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe014172d7e0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe014172d840 seltdwait() at seltdwait+0x8d/frame 0xfffffe014172d880 kern_select() at kern_select+0xa4e/frame 0xfffffe014172da80 sys_select() at sys_select+0x56/frame 0xfffffe014172dac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014172dbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014172dbf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8011cb72a, rsp = 0x7fffffffe6b8, rbp = 0x7fffffffec20 --- Tracing command watchdogd pid 2603 tid 100298 td 0xfffffe0143e84ac0 sched_switch() at sched_switch+0x5af/frame 0xfffffe014177d870 mi_switch() at mi_switch+0x155/frame 0xfffffe014177d890 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe014177d8d0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014177d920 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe014177d960 _sleep() at _sleep+0x285/frame 0xfffffe014177da00 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e1/frame 0xfffffe014177da80 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe014177dac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014177dbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014177dbf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8011c15ca, rsp = 0x7fffffffe9e8, rbp = 0x7fffffffea30 --- Tracing command rpcbind pid 2625 tid 100235 td 0xfffffe010e3bcac0 sched_switch() at sched_switch+0x5af/frame 0xfffffe01415cf710 mi_switch() at mi_switch+0x155/frame 0xfffffe01415cf730 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01415cf770 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01415cf7c0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe01415cf800 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x19b/frame 0xfffffe01415cf880 seltdwait() at seltdwait+0x7f/frame 0xfffffe01415cf8c0 kern_poll_kfds() at kern_poll_kfds+0x41b/frame 0xfffffe01415cf950 kern_poll() at kern_poll+0x9f/frame 0xfffffe01415cfaa0 sys_poll() at sys_poll+0x50/frame 0xfffffe01415cfac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01415cfbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01415cfbf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8011bc62a, rsp = 0x7fffffffc978, rbp = 0x7fffffffeba0 --- Tracing command rpc.statd pid 2650 tid 100264 td 0xfffffe014359aac0 sched_switch() at sched_switch+0x5af/frame 0xfffffe01416d46d0 mi_switch() at mi_switch+0x155/frame 0xfffffe01416d46f0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01416d4730 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01416d4780 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe01416d47c0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x19b/frame 0xfffffe01416d4840 seltdwait() at seltdwait+0x7f/frame 0xfffffe01416d4880 kern_select() at kern_select+0xa4e/frame 0xfffffe01416d4a80 sys_select() at sys_select+0x56/frame 0xfffffe01416d4ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01416d4bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01416d4bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8011b672a, rsp = 0x7fffffffe9f8, rbp = 0x7fffffffeb40 --- Tracing command rpc.lockd pid 2653 tid 100297 td 0xfffffe0143e851e0 sched_switch() at sched_switch+0x5af/frame 0xfffffe01417826a0 mi_switch() at mi_switch+0x155/frame 0xfffffe01417826c0 ipi_bitmap_handler() at ipi_bitmap_handler+0x87/frame 0xfffffe01417826f0 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0xb3/frame 0xfffffe01417826f0 --- interrupt, rip = 0xffffffff80eeb511, rsp = 0xfffffe01417827c0, rbp = 0xfffffe01417828e0 --- svc_run_internal() at svc_run_internal+0xac1/frame 0xfffffe01417828e0 svc_run() at svc_run+0x250/frame 0xfffffe0141782940 sys_nlm_syscall() at sys_nlm_syscall+0x74a/frame 0xfffffe0141782ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0141782bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141782bf0 --- syscall (154, FreeBSD ELF64, sys_nlm_syscall), rip = 0x8011bef0a, rsp = 0x7fffffffeb58, rbp = 0x7fffffffec20 --- Tracing command powerd pid 2658 tid 100267 td 0xfffffe014359c740 sched_switch() at sched_switch+0x5af/frame 0xfffffe014167f6d0 mi_switch() at mi_switch+0x155/frame 0xfffffe014167f6f0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe014167f730 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014167f780 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe014167f7c0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x19b/frame 0xfffffe014167f840 seltdwait() at seltdwait+0x7f/frame 0xfffffe014167f880 kern_select() at kern_select+0xa4e/frame 0xfffffe014167fa80 sys_select() at sys_select+0x56/frame 0xfffffe014167fac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014167fbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014167fbf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8011c172a, rsp = 0x7fffffffeaf8, rbp = 0x7fffffffec30 --- Tracing command sh pid 68204 tid 100471 td 0xfffffe0144126560 sched_switch() at sched_switch+0x5af/frame 0xfffffe01456ef6d0 mi_switch() at mi_switch+0x155/frame 0xfffffe01456ef6f0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01456ef730 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01456ef780 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01456ef790 _sleep() at _sleep+0x325/frame 0xfffffe01456ef830 kern_wait6() at kern_wait6+0x474/frame 0xfffffe01456ef8c0 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe01456efac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01456efbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01456efbf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80120988a, rsp = 0x7fffffffe188, rbp = 0x7fffffffe230 --- Tracing command tee pid 68205 tid 100473 td 0xfffffe0144125e40 sched_switch() at sched_switch+0x5af/frame 0xfffffe0145708840 mi_switch() at mi_switch+0x155/frame 0xfffffe0145708860 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01457088a0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01457088f0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0145708900 _sleep() at _sleep+0x325/frame 0xfffffe01457089a0 pipe_read() at pipe_read+0x4c6/frame 0xfffffe0145708a00 dofileread() at dofileread+0x81/frame 0xfffffe0145708a50 sys_read() at sys_read+0xc0/frame 0xfffffe0145708ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0145708bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0145708bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8011a76aa, rsp = 0x7fffffffe5c8, rbp = 0x7fffffffe620 --- Tracing command sh pid 68206 tid 100531 td 0xfffffe01478b4ac0 sched_switch() at sched_switch+0x5af/frame 0xfffffe0147a2c6d0 mi_switch() at mi_switch+0x155/frame 0xfffffe0147a2c6f0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0147a2c730 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0147a2c780 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0147a2c790 _sleep() at _sleep+0x325/frame 0xfffffe0147a2c830 kern_wait6() at kern_wait6+0x474/frame 0xfffffe0147a2c8c0 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0147a2cac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0147a2cbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0147a2cbf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80120988a, rsp = 0x7fffffffe238, rbp = 0x7fffffffe2e0 --- Tracing command ntpd pid 2684 tid 100286 td 0xfffffe0143dbeac0 sched_switch() at sched_switch+0x5af/frame 0xfffffe0141750720 mi_switch() at mi_switch+0x155/frame 0xfffffe0141750740 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0141750780 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01417507d0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01417507e0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe0141750840 seltdwait() at seltdwait+0x8d/frame 0xfffffe0141750880 kern_select() at kern_select+0xa4e/frame 0xfffffe0141750a80 sys_select() at sys_select+0x56/frame 0xfffffe0141750ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0141750bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141750bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8015db72a, rsp = 0x7fffffffde58, rbp = 0x7fffffffde90 --- Tracing command su pid 68225 tid 100372 td 0xfffffe014408f740 sched_switch() at sched_switch+0x5af/frame 0xfffffe01444f1900 mi_switch() at mi_switch+0x155/frame 0xfffffe01444f1920 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01444f1960 _sx_xlock_hard() at _sx_xlock_hard+0x421/frame 0xfffffe01444f1a00 _sx_xlock() at _sx_xlock+0xbb/frame 0xfffffe01444f1a40 exit1() at exit1+0x655/frame 0xfffffe01444f1ab0 sys_sys_exit() at sys_sys_exit+0xd/frame 0xfffffe01444f1ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01444f1bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01444f1bf0 --- syscall (1, FreeBSD ELF64, sys_sys_exit), rip = 0x8011ef30a, rsp = 0x7fffffffdf88, rbp = 0x7fffffffdfa0 --- Tracing command lockf2 pid 68244 tid 100344 td 0xfffffe0143598000 sched_switch() at sched_switch+0x5af/frame 0xfffffe0144488400 mi_switch() at mi_switch+0x155/frame 0xfffffe0144488420 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0144488460 sleeplk() at sleeplk+0x100/frame 0xfffffe01444884c0 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d2/frame 0xfffffe0144488560 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe01444885a0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe01444885c0 null_lock() at null_lock+0xd3/frame 0xfffffe0144488620 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe0144488640 _vn_lock() at _vn_lock+0x54/frame 0xfffffe01444886a0 lookup() at lookup+0xc2/frame 0xfffffe0144488740 namei() at namei+0x379/frame 0xfffffe01444887f0 vn_open_cred() at vn_open_cred+0x487/frame 0xfffffe0144488960 kern_openat() at kern_openat+0x28c/frame 0xfffffe0144488ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0144488bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0144488bf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8011aa60a, rsp = 0x7fffffffe248, rbp = 0x7fffffffe330 --- Tracing command inetd pid 2710 tid 100247 td 0xfffffe010e599900 sched_switch() at sched_switch+0x5af/frame 0xfffffe014167a720 mi_switch() at mi_switch+0x155/frame 0xfffffe014167a740 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe014167a780 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014167a7d0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe014167a7e0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe014167a840 seltdwait() at seltdwait+0x8d/frame 0xfffffe014167a880 kern_select() at kern_select+0xa4e/frame 0xfffffe014167aa80 sys_select() at sys_select+0x56/frame 0xfffffe014167aac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014167abf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014167abf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8011e072a, rsp = 0x7fffffffdd78, rbp = 0x7fffffffec10 --- Tracing command lockf2 pid 68248 tid 100240 td 0xfffffe010e5af1e0 sched_switch() at sched_switch+0x5af/frame 0xfffffe0141644400 mi_switch() at mi_switch+0x155/frame 0xfffffe0141644420 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0141644460 sleeplk() at sleeplk+0x100/frame 0xfffffe01416444c0 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d2/frame 0xfffffe0141644560 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe01416445a0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe01416445c0 null_lock() at null_lock+0xd3/frame 0xfffffe0141644620 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe0141644640 _vn_lock() at _vn_lock+0x54/frame 0xfffffe01416446a0 lookup() at lookup+0xc2/frame 0xfffffe0141644740 namei() at namei+0x379/frame 0xfffffe01416447f0 vn_open_cred() at vn_open_cred+0x487/frame 0xfffffe0141644960 kern_openat() at kern_openat+0x28c/frame 0xfffffe0141644ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0141644bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141644bf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8011aa60a, rsp = 0x7fffffffe248, rbp = 0x7fffffffe330 --- Tracing command symlink pid 68250 tid 100261 td 0xfffffe010e57ac80 sched_switch() at sched_switch+0x5af/frame 0xfffffe01416c0360 mi_switch() at mi_switch+0x155/frame 0xfffffe01416c0380 kern_yield() at kern_yield+0x71/frame 0xfffffe01416c03c0 __mnt_vnode_next_all() at __mnt_vnode_next_all+0x27/frame 0xfffffe01416c0400 ffs_sync() at ffs_sync+0x174/frame 0xfffffe01416c04a0 journal_check_space() at journal_check_space+0xe0/frame 0xfffffe01416c04d0 softdep_prelink() at softdep_prelink+0x2d7/frame 0xfffffe01416c0520 ufs_makeinode() at ufs_makeinode+0xb9/frame 0xfffffe01416c06b0 ufs_symlink() at ufs_symlink+0x38/frame 0xfffffe01416c06e0 VOP_SYMLINK_APV() at VOP_SYMLINK_APV+0x65/frame 0xfffffe01416c0700 null_bypass() at null_bypass+0x12b/frame 0xfffffe01416c0880 VOP_SYMLINK_APV() at VOP_SYMLINK_APV+0x65/frame 0xfffffe01416c08a0 kern_symlinkat() at kern_symlinkat+0x24f/frame 0xfffffe01416c0ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01416c0bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01416c0bf0 --- syscall (57, FreeBSD ELF64, sys_symlink), rip = 0x8011a79aa, rsp = 0x7fffffffe2a8, rbp = 0x7fffffffe360 --- Tracing command lockf2 pid 68252 tid 100595 td 0xfffffe01478a7000 sched_switch() at sched_switch+0x5af/frame 0xfffffe0147b6f650 mi_switch() at mi_switch+0x155/frame 0xfffffe0147b6f670 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0147b6f6b0 _sx_xlock_hard() at _sx_xlock_hard+0x421/frame 0xfffffe0147b6f750 _sx_xlock() at _sx_xlock+0xbb/frame 0xfffffe0147b6f790 exit1() at exit1+0x655/frame 0xfffffe0147b6f800 sigexit() at sigexit+0x157/frame 0xfffffe0147b6fae0 postsig() at postsig+0x1aa/frame 0xfffffe0147b6fbb0 ast() at ast+0x4fb/frame 0xfffffe0147b6fbf0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe330 Tracing command openat pid 68253 tid 100388 td 0xfffffe014409a740 sched_switch() at sched_switch+0x5af/frame 0xfffffe0144564460 mi_switch() at mi_switch+0x155/frame 0xfffffe0144564480 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01445644c0 sleeplk() at sleeplk+0x100/frame 0xfffffe0144564520 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x402/frame 0xfffffe01445645d0 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe0144564610 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe0144564630 _vn_lock() at _vn_lock+0x54/frame 0xfffffe0144564690 vget_finish() at vget_finish+0x7a/frame 0xfffffe01445646c0 cache_lookup_dotdot() at cache_lookup_dotdot+0x1f5/frame 0xfffffe0144564730 vfs_cache_lookup() at vfs_cache_lookup+0x7b/frame 0xfffffe0144564780 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x5a/frame 0xfffffe01445647a0 null_lookup() at null_lookup+0xe9/frame 0xfffffe0144564820 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x5a/frame 0xfffffe0144564840 lookup() at lookup+0x4d1/frame 0xfffffe01445648e0 namei() at namei+0x379/frame 0xfffffe0144564990 kern_chdir() at kern_chdir+0xc9/frame 0xfffffe0144564ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0144564bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0144564bf0 --- syscall (12, FreeBSD ELF64, sys_chdir), rip = 0x8011a75aa, rsp = 0x7fffffffe018, rbp = 0x7fffffffe020 --- Tracing command rw pid 68254 tid 100431 td 0xfffffe01441041e0 sched_switch() at sched_switch+0x5af/frame 0xfffffe0145636650 mi_switch() at mi_switch+0x155/frame 0xfffffe0145636670 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01456366b0 _sx_xlock_hard() at _sx_xlock_hard+0x421/frame 0xfffffe0145636750 _sx_xlock() at _sx_xlock+0xbb/frame 0xfffffe0145636790 exit1() at exit1+0x655/frame 0xfffffe0145636800 sigexit() at sigexit+0x157/frame 0xfffffe0145636ae0 postsig() at postsig+0x1aa/frame 0xfffffe0145636bb0 ast() at ast+0x4fb/frame 0xfffffe0145636bf0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe360 Tracing command symlink pid 68255 tid 100422 td 0xfffffe01440e0900 sched_switch() at sched_switch+0x5af/frame 0xfffffe01445ff360 mi_switch() at mi_switch+0x155/frame 0xfffffe01445ff380 kern_yield() at kern_yield+0x71/frame 0xfffffe01445ff3c0 __mnt_vnode_next_all() at __mnt_vnode_next_all+0x27/frame 0xfffffe01445ff400 ffs_sync() at ffs_sync+0x174/frame 0xfffffe01445ff4a0 journal_check_space() at journal_check_space+0xe0/frame 0xfffffe01445ff4d0 softdep_prelink() at softdep_prelink+0x2d7/frame 0xfffffe01445ff520 ufs_makeinode() at ufs_makeinode+0xb9/frame 0xfffffe01445ff6b0 ufs_symlink() at ufs_symlink+0x38/frame 0xfffffe01445ff6e0 VOP_SYMLINK_APV() at VOP_SYMLINK_APV+0x65/frame 0xfffffe01445ff700 null_bypass() at null_bypass+0x12b/frame 0xfffffe01445ff880 VOP_SYMLINK_APV() at VOP_SYMLINK_APV+0x65/frame 0xfffffe01445ff8a0 kern_symlinkat() at kern_symlinkat+0x24f/frame 0xfffffe01445ffac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01445ffbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01445ffbf0 --- syscall (57, FreeBSD ELF64, sys_symlink), rip = 0x8011a79aa, rsp = 0x7fffffffe2a8, rbp = 0x7fffffffe360 --- Tracing command lockf2 pid 68256 tid 100585 td 0xfffffe0143d95900 sched_switch() at sched_switch+0x5af/frame 0xfffffe0147b4a400 mi_switch() at mi_switch+0x155/frame 0xfffffe0147b4a420 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0147b4a460 sleeplk() at sleeplk+0x100/frame 0xfffffe0147b4a4c0 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d2/frame 0xfffffe0147b4a560 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe0147b4a5a0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe0147b4a5c0 null_lock() at null_lock+0xd3/frame 0xfffffe0147b4a620 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe0147b4a640 _vn_lock() at _vn_lock+0x54/frame 0xfffffe0147b4a6a0 lookup() at lookup+0xc2/frame 0xfffffe0147b4a740 namei() at namei+0x379/frame 0xfffffe0147b4a7f0 vn_open_cred() at vn_open_cred+0x487/frame 0xfffffe0147b4a960 kern_openat() at kern_openat+0x28c/frame 0xfffffe0147b4aac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0147b4abf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0147b4abf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8011aa60a, rsp = 0x7fffffffe248, rbp = 0x7fffffffe330 --- Tracing command symlink pid 68259 tid 100376 td 0xfffffe0144098ac0 sched_switch() at sched_switch+0x5af/frame 0xfffffe0144523460 mi_switch() at mi_switch+0x155/frame 0xfffffe0144523480 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01445234c0 sleeplk() at sleeplk+0x100/frame 0xfffffe0144523520 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x402/frame 0xfffffe01445235d0 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe0144523610 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe0144523630 _vn_lock() at _vn_lock+0x54/frame 0xfffffe0144523690 vget_finish() at vget_finish+0x7a/frame 0xfffffe01445236c0 cache_lookup_dotdot() at cache_lookup_dotdot+0x1f5/frame 0xfffffe0144523730 vfs_cache_lookup() at vfs_cache_lookup+0x7b/frame 0xfffffe0144523780 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x5a/frame 0xfffffe01445237a0 null_lookup() at null_lookup+0xe9/frame 0xfffffe0144523820 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x5a/frame 0xfffffe0144523840 lookup() at lookup+0x4d1/frame 0xfffffe01445238e0 namei() at namei+0x379/frame 0xfffffe0144523990 kern_chdir() at kern_chdir+0xc9/frame 0xfffffe0144523ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0144523bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0144523bf0 --- syscall (12, FreeBSD ELF64, sys_chdir), rip = 0x8011a75aa, rsp = 0x7fffffffe098, rbp = 0x7fffffffe0a0 --- Tracing command lockf2 pid 68261 tid 100382 td 0xfffffe014408be40 sched_switch() at sched_switch+0x5af/frame 0xfffffe0144537650 mi_switch() at mi_switch+0x155/frame 0xfffffe0144537670 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01445376b0 _sx_xlock_hard() at _sx_xlock_hard+0x421/frame 0xfffffe0144537750 _sx_xlock() at _sx_xlock+0xbb/frame 0xfffffe0144537790 exit1() at exit1+0x655/frame 0xfffffe0144537800 sigexit() at sigexit+0x157/frame 0xfffffe0144537ae0 postsig() at postsig+0x1aa/frame 0xfffffe0144537bb0 ast() at ast+0x4fb/frame 0xfffffe0144537bf0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe330 Tracing command rw pid 68263 tid 100237 td 0xfffffe010e5991e0 sched_switch() at sched_switch+0x5af/frame 0xfffffe014160b650 mi_switch() at mi_switch+0x155/frame 0xfffffe014160b670 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe014160b6b0 _sx_xlock_hard() at _sx_xlock_hard+0x421/frame 0xfffffe014160b750 _sx_xlock() at _sx_xlock+0xbb/frame 0xfffffe014160b790 exit1() at exit1+0x655/frame 0xfffffe014160b800 sigexit() at sigexit+0x157/frame 0xfffffe014160bae0 postsig() at postsig+0x1aa/frame 0xfffffe014160bbb0 ast() at ast+0x4fb/frame 0xfffffe014160bbf0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe360 Tracing command symlink pid 68264 tid 100403 td 0xfffffe01440ae900 sched_switch() at sched_switch+0x5af/frame 0xfffffe01445aa360 mi_switch() at mi_switch+0x155/frame 0xfffffe01445aa380 kern_yield() at kern_yield+0x71/frame 0xfffffe01445aa3c0 __mnt_vnode_next_all() at __mnt_vnode_next_all+0x27/frame 0xfffffe01445aa400 ffs_sync() at ffs_sync+0x174/frame 0xfffffe01445aa4a0 journal_check_space() at journal_check_space+0xe0/frame 0xfffffe01445aa4d0 softdep_prelink() at softdep_prelink+0x2d7/frame 0xfffffe01445aa520 ufs_makeinode() at ufs_makeinode+0xb9/frame 0xfffffe01445aa6b0 ufs_symlink() at ufs_symlink+0x38/frame 0xfffffe01445aa6e0 VOP_SYMLINK_APV() at VOP_SYMLINK_APV+0x65/frame 0xfffffe01445aa700 null_bypass() at null_bypass+0x12b/frame 0xfffffe01445aa880 VOP_SYMLINK_APV() at VOP_SYMLINK_APV+0x65/frame 0xfffffe01445aa8a0 kern_symlinkat() at kern_symlinkat+0x24f/frame 0xfffffe01445aaac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01445aabf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01445aabf0 --- syscall (57, FreeBSD ELF64, sys_symlink), rip = 0x8011a79aa, rsp = 0x7fffffffe2a8, rbp = 0x7fffffffe360 --- Tracing command fts pid 68265 tid 100508 td 0xfffffe010e596e40 sched_switch() at sched_switch+0x5af/frame 0xfffffe01457b2480 mi_switch() at mi_switch+0x155/frame 0xfffffe01457b24a0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01457b24e0 sleeplk() at sleeplk+0x100/frame 0xfffffe01457b2540 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d2/frame 0xfffffe01457b25e0 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe01457b2620 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe01457b2640 null_lock() at null_lock+0xd3/frame 0xfffffe01457b26a0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe01457b26c0 _vn_lock() at _vn_lock+0x54/frame 0xfffffe01457b2720 lookup() at lookup+0xc2/frame 0xfffffe01457b27c0 namei() at namei+0x379/frame 0xfffffe01457b2870 kern_statat() at kern_statat+0x12d/frame 0xfffffe01457b29c0 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe01457b2ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01457b2bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01457b2bf0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x8011a93aa, rsp = 0x7fffffffe048, rbp = 0x7fffffffe100 --- Tracing command sshd pid 2729 tid 100299 td 0xfffffe0143e86740 sched_switch() at sched_switch+0x5af/frame 0xfffffe0141723720 mi_switch() at mi_switch+0x155/frame 0xfffffe0141723740 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0141723780 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01417237d0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01417237e0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe0141723840 seltdwait() at seltdwait+0x8d/frame 0xfffffe0141723880 kern_select() at kern_select+0xa4e/frame 0xfffffe0141723a80 sys_select() at sys_select+0x56/frame 0xfffffe0141723ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0141723bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141723bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80169972a, rsp = 0x7fffffffe5c8, rbp = 0x7fffffffe600 --- Tracing command rw pid 68266 tid 100358 td 0xfffffe014406ce40 sched_switch() at sched_switch+0x5af/frame 0xfffffe01444bf650 mi_switch() at mi_switch+0x155/frame 0xfffffe01444bf670 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01444bf6b0 _sx_xlock_hard() at _sx_xlock_hard+0x421/frame 0xfffffe01444bf750 _sx_xlock() at _sx_xlock+0xbb/frame 0xfffffe01444bf790 exit1() at exit1+0x655/frame 0xfffffe01444bf800 sigexit() at sigexit+0x157/frame 0xfffffe01444bfae0 postsig() at postsig+0x1aa/frame 0xfffffe01444bfbb0 ast() at ast+0x4fb/frame 0xfffffe01444bfbf0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe360 Tracing command symlink pid 68267 tid 100513 td 0xfffffe0146756720 sched_switch() at sched_switch+0x5af/frame 0xfffffe01457d0460 mi_switch() at mi_switch+0x155/frame 0xfffffe01457d0480 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01457d04c0 sleeplk() at sleeplk+0x100/frame 0xfffffe01457d0520 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x402/frame 0xfffffe01457d05d0 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe01457d0610 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe01457d0630 _vn_lock() at _vn_lock+0x54/frame 0xfffffe01457d0690 vget_finish() at vget_finish+0x7a/frame 0xfffffe01457d06c0 cache_lookup_dotdot() at cache_lookup_dotdot+0x1f5/frame 0xfffffe01457d0730 vfs_cache_lookup() at vfs_cache_lookup+0x7b/frame 0xfffffe01457d0780 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x5a/frame 0xfffffe01457d07a0 null_lookup() at null_lookup+0xe9/frame 0xfffffe01457d0820 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x5a/frame 0xfffffe01457d0840 lookup() at lookup+0x4d1/frame 0xfffffe01457d08e0 namei() at namei+0x379/frame 0xfffffe01457d0990 kern_chdir() at kern_chdir+0xc9/frame 0xfffffe01457d0ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01457d0bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01457d0bf0 --- syscall (12, FreeBSD ELF64, sys_chdir), rip = 0x8011a75aa, rsp = 0x7fffffffe098, rbp = 0x7fffffffe0a0 --- Tracing command fts pid 68268 tid 100387 td 0xfffffe0144096720 sched_switch() at sched_switch+0x5af/frame 0xfffffe014455a480 mi_switch() at mi_switch+0x155/frame 0xfffffe014455a4a0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe014455a4e0 sleeplk() at sleeplk+0x100/frame 0xfffffe014455a540 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d2/frame 0xfffffe014455a5e0 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe014455a620 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe014455a640 null_lock() at null_lock+0xd3/frame 0xfffffe014455a6a0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe014455a6c0 _vn_lock() at _vn_lock+0x54/frame 0xfffffe014455a720 lookup() at lookup+0xc2/frame 0xfffffe014455a7c0 namei() at namei+0x379/frame 0xfffffe014455a870 kern_statat() at kern_statat+0x12d/frame 0xfffffe014455a9c0 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe014455aac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014455abf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014455abf0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x8011a93aa, rsp = 0x7fffffffe048, rbp = 0x7fffffffe100 --- Tracing command cron pid 2733 tid 100295 td 0xfffffe0143dc0020 sched_switch() at sched_switch+0x5af/frame 0xfffffe0141778870 mi_switch() at mi_switch+0x155/frame 0xfffffe0141778890 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01417788d0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0141778920 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe0141778960 _sleep() at _sleep+0x285/frame 0xfffffe0141778a00 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e1/frame 0xfffffe0141778a80 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe0141778ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0141778bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141778bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8011d85ca, rsp = 0x7fffffffea48, rbp = 0x7fffffffec20 --- Tracing command fts pid 68271 tid 100558 td 0xfffffe01485a7020 sched_switch() at sched_switch+0x5af/frame 0xfffffe0147aad480 mi_switch() at mi_switch+0x155/frame 0xfffffe0147aad4a0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0147aad4e0 sleeplk() at sleeplk+0x100/frame 0xfffffe0147aad540 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d2/frame 0xfffffe0147aad5e0 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe0147aad620 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe0147aad640 null_lock() at null_lock+0xd3/frame 0xfffffe0147aad6a0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe0147aad6c0 _vn_lock() at _vn_lock+0x54/frame 0xfffffe0147aad720 lookup() at lookup+0xc2/frame 0xfffffe0147aad7c0 namei() at namei+0x379/frame 0xfffffe0147aad870 kern_statat() at kern_statat+0x12d/frame 0xfffffe0147aad9c0 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe0147aadac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0147aadbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0147aadbf0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x8011a93aa, rsp = 0x7fffffffe048, rbp = 0x7fffffffe100 --- Tracing command rw pid 68272 tid 100610 td 0xfffffe0145a39000 sched_switch() at sched_switch+0x5af/frame 0xfffffe0147bce650 mi_switch() at mi_switch+0x155/frame 0xfffffe0147bce670 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0147bce6b0 _sx_xlock_hard() at _sx_xlock_hard+0x421/frame 0xfffffe0147bce750 _sx_xlock() at _sx_xlock+0xbb/frame 0xfffffe0147bce790 exit1() at exit1+0x655/frame 0xfffffe0147bce800 sigexit() at sigexit+0x157/frame 0xfffffe0147bceae0 postsig() at postsig+0x1aa/frame 0xfffffe0147bcebb0 ast() at ast+0x4fb/frame 0xfffffe0147bcebf0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe360 Tracing command symlink pid 68273 tid 100507 td 0xfffffe010e597560 sched_switch() at sched_switch+0x5af/frame 0xfffffe01457a3460 mi_switch() at mi_switch+0x155/frame 0xfffffe01457a3480 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01457a34c0 sleeplk() at sleeplk+0x100/frame 0xfffffe01457a3520 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x402/frame 0xfffffe01457a35d0 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe01457a3610 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe01457a3630 _vn_lock() at _vn_lock+0x54/frame 0xfffffe01457a3690 vget_finish() at vget_finish+0x7a/frame 0xfffffe01457a36c0 cache_lookup_dotdot() at cache_lookup_dotdot+0x1f5/frame 0xfffffe01457a3730 vfs_cache_lookup() at vfs_cache_lookup+0x7b/frame 0xfffffe01457a3780 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x5a/frame 0xfffffe01457a37a0 null_lookup() at null_lookup+0xe9/frame 0xfffffe01457a3820 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x5a/frame 0xfffffe01457a3840 lookup() at lookup+0x4d1/frame 0xfffffe01457a38e0 namei() at namei+0x379/frame 0xfffffe01457a3990 kern_chdir() at kern_chdir+0xc9/frame 0xfffffe01457a3ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01457a3bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01457a3bf0 --- syscall (12, FreeBSD ELF64, sys_chdir), rip = 0x8011a75aa, rsp = 0x7fffffffe098, rbp = 0x7fffffffe0a0 --- Tracing command rw pid 68276 tid 100394 td 0xfffffe01440acc80 sched_switch() at sched_switch+0x5af/frame 0xfffffe0144573650 mi_switch() at mi_switch+0x155/frame 0xfffffe0144573670 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01445736b0 _sx_xlock_hard() at _sx_xlock_hard+0x421/frame 0xfffffe0144573750 _sx_xlock() at _sx_xlock+0xbb/frame 0xfffffe0144573790 exit1() at exit1+0x655/frame 0xfffffe0144573800 sigexit() at sigexit+0x157/frame 0xfffffe0144573ae0 postsig() at postsig+0x1aa/frame 0xfffffe0144573bb0 ast() at ast+0x4fb/frame 0xfffffe0144573bf0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe360 Tracing command fts pid 68277 tid 100396 td 0xfffffe01440abe40 sched_switch() at sched_switch+0x5af/frame 0xfffffe014457d480 mi_switch() at mi_switch+0x155/frame 0xfffffe014457d4a0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe014457d4e0 sleeplk() at sleeplk+0x100/frame 0xfffffe014457d540 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d2/frame 0xfffffe014457d5e0 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe014457d620 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe014457d640 null_lock() at null_lock+0xd3/frame 0xfffffe014457d6a0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe014457d6c0 _vn_lock() at _vn_lock+0x54/frame 0xfffffe014457d720 lookup() at lookup+0xc2/frame 0xfffffe014457d7c0 namei() at namei+0x379/frame 0xfffffe014457d870 kern_statat() at kern_statat+0x12d/frame 0xfffffe014457d9c0 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe014457dac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014457dbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014457dbf0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x8011a93aa, rsp = 0x7fffffffe048, rbp = 0x7fffffffe100 --- Tracing command symlink pid 68278 tid 100405 td 0xfffffe01440ceac0 sched_switch() at sched_switch+0x5af/frame 0xfffffe01445b42c0 mi_switch() at mi_switch+0x155/frame 0xfffffe01445b42e0 __mtx_lock_sleep() at __mtx_lock_sleep+0x1c9/frame 0xfffffe01445b4370 __mtx_lock_flags() at __mtx_lock_flags+0xef/frame 0xfffffe01445b43c0 __mnt_vnode_next_all() at __mnt_vnode_next_all+0x42/frame 0xfffffe01445b4400 ffs_sync() at ffs_sync+0x174/frame 0xfffffe01445b44a0 journal_check_space() at journal_check_space+0xe0/frame 0xfffffe01445b44d0 softdep_prelink() at softdep_prelink+0x2d7/frame 0xfffffe01445b4520 ufs_makeinode() at ufs_makeinode+0xb9/frame 0xfffffe01445b46b0 ufs_symlink() at ufs_symlink+0x38/frame 0xfffffe01445b46e0 VOP_SYMLINK_APV() at VOP_SYMLINK_APV+0x65/frame 0xfffffe01445b4700 null_bypass() at null_bypass+0x12b/frame 0xfffffe01445b4880 VOP_SYMLINK_APV() at VOP_SYMLINK_APV+0x65/frame 0xfffffe01445b48a0 kern_symlinkat() at kern_symlinkat+0x24f/frame 0xfffffe01445b4ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01445b4bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01445b4bf0 --- syscall (57, FreeBSD ELF64, sys_symlink), rip = 0x8011a79aa, rsp = 0x7fffffffe2a8, rbp = 0x7fffffffe360 --- Tracing command rw pid 68280 tid 100433 td 0xfffffe01441033a0 sched_switch() at sched_switch+0x5af/frame 0xfffffe01456400c0 mi_switch() at mi_switch+0x155/frame 0xfffffe01456400e0 __mtx_lock_sleep() at __mtx_lock_sleep+0x1c9/frame 0xfffffe0145640170 __mtx_lock_flags() at __mtx_lock_flags+0xef/frame 0xfffffe01456401c0 __mnt_vnode_next_all() at __mnt_vnode_next_all+0x42/frame 0xfffffe0145640200 ffs_sync() at ffs_sync+0x174/frame 0xfffffe01456402a0 journal_check_space() at journal_check_space+0xe0/frame 0xfffffe01456402d0 softdep_prealloc() at softdep_prealloc+0x17c/frame 0xfffffe0145640300 ffs_write() at ffs_write+0x3f/frame 0xfffffe01456403b0 VOP_WRITE_APV() at VOP_WRITE_APV+0xcf/frame 0xfffffe01456404c0 null_bypass() at null_bypass+0x12b/frame 0xfffffe0145640640 VOP_WRITE_APV() at VOP_WRITE_APV+0xcf/frame 0xfffffe0145640750 vn_write() at vn_write+0x2e7/frame 0xfffffe01456407e0 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe0145640840 vn_io_fault1() at vn_io_fault1+0x163/frame 0xfffffe0145640980 vn_io_fault() at vn_io_fault+0x1ba/frame 0xfffffe0145640a00 dofilewrite() at dofilewrite+0x81/frame 0xfffffe0145640a50 sys_write() at sys_write+0xc0/frame 0xfffffe0145640ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0145640bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0145640bf0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x8011aa8ca, rsp = 0x7fffffffd2a8, rbp = 0x7fffffffe360 --- Tracing command fts pid 68281 tid 100520 td 0xfffffe01478aa900 sched_switch() at sched_switch+0x5af/frame 0xfffffe01457f8230 mi_switch() at mi_switch+0x155/frame 0xfffffe01457f8250 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01457f8290 sleeplk() at sleeplk+0x100/frame 0xfffffe01457f82f0 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d2/frame 0xfffffe01457f8390 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe01457f83d0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe01457f83f0 null_lock() at null_lock+0xd3/frame 0xfffffe01457f8450 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe01457f8470 _vn_lock() at _vn_lock+0x54/frame 0xfffffe01457f84d0 vn_close1() at vn_close1+0xa2/frame 0xfffffe01457f8540 vn_closefile() at vn_closefile+0x4a/frame 0xfffffe01457f85c0 _fdrop() at _fdrop+0x1b/frame 0xfffffe01457f85e0 closef() at closef+0x1db/frame 0xfffffe01457f8670 fdescfree_fds() at fdescfree_fds+0xcc/frame 0xfffffe01457f86c0 fdescfree() at fdescfree+0x35d/frame 0xfffffe01457f8790 exit1() at exit1+0x4ae/frame 0xfffffe01457f8800 sigexit() at sigexit+0x157/frame 0xfffffe01457f8ae0 postsig() at postsig+0x1aa/frame 0xfffffe01457f8bb0 ast() at ast+0x4fb/frame 0xfffffe01457f8bf0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe100 Tracing command lockf pid 68282 tid 100327 td 0xfffffe0143f7f900 thread_exit() at thread_exit+0x203/frame 0xfffffe0144413790 exit1() at exit1+0xdde/frame 0xfffffe0144413800 sigexit() at sigexit+0x157/frame 0xfffffe0144413ae0 postsig() at postsig+0x1aa/frame 0xfffffe0144413bb0 ast() at ast+0x4fb/frame 0xfffffe0144413bf0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe2e0 Tracing command symlink pid 68283 tid 100359 td 0xfffffe014406c720 sched_switch() at sched_switch+0x5af/frame 0xfffffe01444ceb90 mi_switch() at mi_switch+0x155/frame 0xfffffe01444cebb0 ast() at ast+0x289/frame 0xfffffe01444cebf0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe360 Tracing command getty pid 2747 tid 100225 td 0xfffffe010e3be740 sched_switch() at sched_switch+0x5af/frame 0xfffffe01415de7c0 mi_switch() at mi_switch+0x155/frame 0xfffffe01415de7e0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01415de820 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01415de870 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01415de880 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe01415de8e0 tty_wait() at tty_wait+0x42/frame 0xfffffe01415de910 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe01415de970 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe01415de9a0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe01415dea00 dofileread() at dofileread+0x81/frame 0xfffffe01415dea50 sys_read() at sys_read+0xc0/frame 0xfffffe01415deac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01415debf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01415debf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8011c56aa, rsp = 0x7fffffffeb58, rbp = 0x7fffffffeba0 --- Tracing command rename pid 68284 tid 100352 td 0xfffffe014407b560 sched_switch() at sched_switch+0x5af/frame 0xfffffe01444b0280 mi_switch() at mi_switch+0x155/frame 0xfffffe01444b02a0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01444b02e0 sleeplk() at sleeplk+0x100/frame 0xfffffe01444b0340 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x402/frame 0xfffffe01444b03f0 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe01444b0430 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe01444b0450 _vn_lock() at _vn_lock+0x54/frame 0xfffffe01444b04b0 ufs_rename() at ufs_rename+0x8d9/frame 0xfffffe01444b06b0 VOP_RENAME_APV() at VOP_RENAME_APV+0x3c/frame 0xfffffe01444b06d0 null_bypass() at null_bypass+0x12b/frame 0xfffffe01444b0850 VOP_RENAME_APV() at VOP_RENAME_APV+0x3c/frame 0xfffffe01444b0870 kern_renameat() at kern_renameat+0x3dd/frame 0xfffffe01444b0ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01444b0bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01444b0bf0 --- syscall (128, FreeBSD ELF64, sys_rename), rip = 0x8011a7daa, rsp = 0x7fffffffe218, rbp = 0x7fffffffe360 --- Tracing command getty pid 2748 tid 100292 td 0xfffffe0143dbc720 sched_switch() at sched_switch+0x5af/frame 0xfffffe014175f7c0 mi_switch() at mi_switch+0x155/frame 0xfffffe014175f7e0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe014175f820 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014175f870 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe014175f880 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe014175f8e0 tty_wait() at tty_wait+0x42/frame 0xfffffe014175f910 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe014175f970 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe014175f9a0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe014175fa00 dofileread() at dofileread+0x81/frame 0xfffffe014175fa50 sys_read() at sys_read+0xc0/frame 0xfffffe014175fac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014175fbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014175fbf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8011c56aa, rsp = 0x7fffffffeb58, rbp = 0x7fffffffeba0 --- Tracing command fts pid 68285 tid 100374 td 0xfffffe014408e900 sched_switch() at sched_switch+0x5af/frame 0xfffffe0144519230 mi_switch() at mi_switch+0x155/frame 0xfffffe0144519250 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0144519290 sleeplk() at sleeplk+0x100/frame 0xfffffe01445192f0 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d2/frame 0xfffffe0144519390 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe01445193d0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe01445193f0 null_lock() at null_lock+0xd3/frame 0xfffffe0144519450 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe0144519470 _vn_lock() at _vn_lock+0x54/frame 0xfffffe01445194d0 vn_close1() at vn_close1+0xa2/frame 0xfffffe0144519540 vn_closefile() at vn_closefile+0x4a/frame 0xfffffe01445195c0 _fdrop() at _fdrop+0x1b/frame 0xfffffe01445195e0 closef() at closef+0x1db/frame 0xfffffe0144519670 fdescfree_fds() at fdescfree_fds+0xcc/frame 0xfffffe01445196c0 fdescfree() at fdescfree+0x35d/frame 0xfffffe0144519790 exit1() at exit1+0x4ae/frame 0xfffffe0144519800 sigexit() at sigexit+0x157/frame 0xfffffe0144519ae0 postsig() at postsig+0x1aa/frame 0xfffffe0144519bb0 ast() at ast+0x4fb/frame 0xfffffe0144519bf0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe100 Tracing command getty pid 2749 tid 100306 td 0xfffffe0143dbc000 sched_switch() at sched_switch+0x5af/frame 0xfffffe01417aa7c0 mi_switch() at mi_switch+0x155/frame 0xfffffe01417aa7e0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01417aa820 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01417aa870 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01417aa880 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe01417aa8e0 tty_wait() at tty_wait+0x42/frame 0xfffffe01417aa910 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe01417aa970 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe01417aa9a0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe01417aaa00 dofileread() at dofileread+0x81/frame 0xfffffe01417aaa50 sys_read() at sys_read+0xc0/frame 0xfffffe01417aaac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01417aabf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01417aabf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8011c56aa, rsp = 0x7fffffffeb58, rbp = 0x7fffffffeba0 --- Tracing command rw pid 68286 tid 100586 td 0xfffffe01499c21e0 sched_switch() at sched_switch+0x5af/frame 0xfffffe0147b45650 mi_switch() at mi_switch+0x155/frame 0xfffffe0147b45670 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0147b456b0 _sx_xlock_hard() at _sx_xlock_hard+0x421/frame 0xfffffe0147b45750 _sx_xlock() at _sx_xlock+0xbb/frame 0xfffffe0147b45790 exit1() at exit1+0x655/frame 0xfffffe0147b45800 sigexit() at sigexit+0x157/frame 0xfffffe0147b45ae0 postsig() at postsig+0x1aa/frame 0xfffffe0147b45bb0 ast() at ast+0x4fb/frame 0xfffffe0147b45bf0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe360 Tracing command getty pid 2750 tid 100307 td 0xfffffe0143f5c1e0 sched_switch() at sched_switch+0x5af/frame 0xfffffe01417a57c0 mi_switch() at mi_switch+0x155/frame 0xfffffe01417a57e0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01417a5820 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01417a5870 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01417a5880 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe01417a58e0 tty_wait() at tty_wait+0x42/frame 0xfffffe01417a5910 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe01417a5970 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe01417a59a0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe01417a5a00 dofileread() at dofileread+0x81/frame 0xfffffe01417a5a50 sys_read() at sys_read+0xc0/frame 0xfffffe01417a5ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01417a5bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01417a5bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8011c56aa, rsp = 0x7fffffffeb58, rbp = 0x7fffffffeba0 --- Tracing command getty pid 2751 tid 100308 td 0xfffffe0143f5bac0 sched_switch() at sched_switch+0x5af/frame 0xfffffe01417b47c0 mi_switch() at mi_switch+0x155/frame 0xfffffe01417b47e0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01417b4820 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01417b4870 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01417b4880 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe01417b48e0 tty_wait() at tty_wait+0x42/frame 0xfffffe01417b4910 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe01417b4970 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe01417b49a0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe01417b4a00 dofileread() at dofileread+0x81/frame 0xfffffe01417b4a50 sys_read() at sys_read+0xc0/frame 0xfffffe01417b4ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01417b4bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01417b4bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8011c56aa, rsp = 0x7fffffffeb58, rbp = 0x7fffffffeba0 --- Tracing command lockf pid 68288 tid 100606 td 0xfffffe0149982900 sched_switch() at sched_switch+0x5af/frame 0xfffffe0147bab470 mi_switch() at mi_switch+0x155/frame 0xfffffe0147bab490 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0147bab4d0 sleeplk() at sleeplk+0x100/frame 0xfffffe0147bab530 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d2/frame 0xfffffe0147bab5d0 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe0147bab610 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe0147bab630 null_lock() at null_lock+0xd3/frame 0xfffffe0147bab690 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe0147bab6b0 _vn_lock() at _vn_lock+0x54/frame 0xfffffe0147bab710 lookup() at lookup+0xc2/frame 0xfffffe0147bab7b0 namei() at namei+0x379/frame 0xfffffe0147bab860 kern_funlinkat() at kern_funlinkat+0x129/frame 0xfffffe0147babaa0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe0147babac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0147babbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0147babbf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x8011a758a, rsp = 0x7fffffffe318, rbp = 0x7fffffffe360 --- Tracing command getty pid 2752 tid 100309 td 0xfffffe0143f5b3a0 sched_switch() at sched_switch+0x5af/frame 0xfffffe01417af7c0 mi_switch() at mi_switch+0x155/frame 0xfffffe01417af7e0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01417af820 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01417af870 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01417af880 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe01417af8e0 tty_wait() at tty_wait+0x42/frame 0xfffffe01417af910 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe01417af970 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe01417af9a0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe01417afa00 dofileread() at dofileread+0x81/frame 0xfffffe01417afa50 sys_read() at sys_read+0xc0/frame 0xfffffe01417afac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01417afbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01417afbf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8011c56aa, rsp = 0x7fffffffeb58, rbp = 0x7fffffffeba0 --- Tracing command getty pid 2753 tid 100310 td 0xfffffe0143f5ac80 sched_switch() at sched_switch+0x5af/frame 0xfffffe01417be7c0 mi_switch() at mi_switch+0x155/frame 0xfffffe01417be7e0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01417be820 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01417be870 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01417be880 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe01417be8e0 tty_wait() at tty_wait+0x42/frame 0xfffffe01417be910 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe01417be970 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe01417be9a0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe01417bea00 dofileread() at dofileread+0x81/frame 0xfffffe01417bea50 sys_read() at sys_read+0xc0/frame 0xfffffe01417beac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01417bebf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01417bebf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8011c56aa, rsp = 0x7fffffffeb58, rbp = 0x7fffffffeba0 --- Tracing command symlink pid 68290 tid 100469 td 0xfffffe0145a3b3a0 sched_switch() at sched_switch+0x5af/frame 0xfffffe01456db2c0 mi_switch() at mi_switch+0x155/frame 0xfffffe01456db2e0 __mtx_lock_sleep() at __mtx_lock_sleep+0x1c9/frame 0xfffffe01456db370 __mtx_lock_flags() at __mtx_lock_flags+0xef/frame 0xfffffe01456db3c0 __mnt_vnode_next_all() at __mnt_vnode_next_all+0x42/frame 0xfffffe01456db400 ffs_sync() at ffs_sync+0x174/frame 0xfffffe01456db4a0 journal_check_space() at journal_check_space+0xe0/frame 0xfffffe01456db4d0 softdep_prelink() at softdep_prelink+0x2d7/frame 0xfffffe01456db520 ufs_makeinode() at ufs_makeinode+0xb9/frame 0xfffffe01456db6b0 ufs_symlink() at ufs_symlink+0x38/frame 0xfffffe01456db6e0 VOP_SYMLINK_APV() at VOP_SYMLINK_APV+0x65/frame 0xfffffe01456db700 null_bypass() at null_bypass+0x12b/frame 0xfffffe01456db880 VOP_SYMLINK_APV() at VOP_SYMLINK_APV+0x65/frame 0xfffffe01456db8a0 kern_symlinkat() at kern_symlinkat+0x24f/frame 0xfffffe01456dbac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01456dbbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01456dbbf0 --- syscall (57, FreeBSD ELF64, sys_symlink), rip = 0x8011a79aa, rsp = 0x7fffffffe2a8, rbp = 0x7fffffffe360 --- Tracing command getty pid 2754 tid 100311 td 0xfffffe0143f5a560 sched_switch() at sched_switch+0x5af/frame 0xfffffe01417b97c0 mi_switch() at mi_switch+0x155/frame 0xfffffe01417b97e0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01417b9820 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01417b9870 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01417b9880 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe01417b98e0 tty_wait() at tty_wait+0x42/frame 0xfffffe01417b9910 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe01417b9970 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe01417b99a0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe01417b9a00 dofileread() at dofileread+0x81/frame 0xfffffe01417b9a50 sys_read() at sys_read+0xc0/frame 0xfffffe01417b9ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01417b9bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01417b9bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8011c56aa, rsp = 0x7fffffffeb58, rbp = 0x7fffffffeba0 --- Tracing command rename pid 68291 tid 100571 td 0xfffffe01485dd900 (CPU 3) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce3ae00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce3ae10 trap() at trap+0x56/frame 0xfffffe003ce3af20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce3af20 --- trap 0x13, rip = 0xffffffff80c70382, rsp = 0xfffffe0147af3230, rbp = 0xfffffe0147af3240 --- lock_delay() at lock_delay+0x22/frame 0xfffffe0147af3240 __mtx_lock_sleep() at __mtx_lock_sleep+0xe8/frame 0xfffffe0147af32d0 __mtx_lock_flags() at __mtx_lock_flags+0xef/frame 0xfffffe0147af3320 __mnt_vnode_next_all() at __mnt_vnode_next_all+0x42/frame 0xfffffe0147af3360 ffs_sync() at ffs_sync+0x174/frame 0xfffffe0147af3400 journal_check_space() at journal_check_space+0xe0/frame 0xfffffe0147af3430 softdep_prelink() at softdep_prelink+0x2d7/frame 0xfffffe0147af3480 ufs_makeinode() at ufs_makeinode+0xb9/frame 0xfffffe0147af3610 ufs_create() at ufs_create+0x34/frame 0xfffffe0147af3630 VOP_CREATE_APV() at VOP_CREATE_APV+0x62/frame 0xfffffe0147af3650 null_bypass() at null_bypass+0x12b/frame 0xfffffe0147af37d0 VOP_CREATE_APV() at VOP_CREATE_APV+0x62/frame 0xfffffe0147af37f0 vn_open_cred() at vn_open_cred+0x2b9/frame 0xfffffe0147af3960 kern_openat() at kern_openat+0x28c/frame 0xfffffe0147af3ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0147af3bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0147af3bf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8011aa60a, rsp = 0x7fffffffe128, rbp = 0x7fffffffe210 --- Tracing command getty pid 2755 tid 100312 td 0xfffffe0143f59e40 sched_switch() at sched_switch+0x5af/frame 0xfffffe01417c87c0 mi_switch() at mi_switch+0x155/frame 0xfffffe01417c87e0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01417c8820 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01417c8870 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01417c8880 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe01417c88e0 tty_wait() at tty_wait+0x42/frame 0xfffffe01417c8910 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe01417c8970 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe01417c89a0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe01417c8a00 dofileread() at dofileread+0x81/frame 0xfffffe01417c8a50 sys_read() at sys_read+0xc0/frame 0xfffffe01417c8ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01417c8bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01417c8bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8011c56aa, rsp = 0x7fffffffeb58, rbp = 0x7fffffffeba0 --- Tracing command fts pid 68292 tid 100561 td 0xfffffe01485dd1e0 sched_switch() at sched_switch+0x5af/frame 0xfffffe0147ad0480 mi_switch() at mi_switch+0x155/frame 0xfffffe0147ad04a0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0147ad04e0 sleeplk() at sleeplk+0x100/frame 0xfffffe0147ad0540 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d2/frame 0xfffffe0147ad05e0 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe0147ad0620 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe0147ad0640 null_lock() at null_lock+0xd3/frame 0xfffffe0147ad06a0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe0147ad06c0 _vn_lock() at _vn_lock+0x54/frame 0xfffffe0147ad0720 lookup() at lookup+0xc2/frame 0xfffffe0147ad07c0 namei() at namei+0x379/frame 0xfffffe0147ad0870 kern_statat() at kern_statat+0x12d/frame 0xfffffe0147ad09c0 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe0147ad0ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0147ad0bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0147ad0bf0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x8011a93aa, rsp = 0x7fffffffe048, rbp = 0x7fffffffe100 --- Tracing command getty pid 2756 tid 100313 td 0xfffffe0143f59720 sched_switch() at sched_switch+0x5af/frame 0xfffffe01417c37c0 mi_switch() at mi_switch+0x155/frame 0xfffffe01417c37e0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01417c3820 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01417c3870 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01417c3880 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe01417c38e0 tty_wait() at tty_wait+0x42/frame 0xfffffe01417c3910 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe01417c3970 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe01417c39a0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe01417c3a00 dofileread() at dofileread+0x81/frame 0xfffffe01417c3a50 sys_read() at sys_read+0xc0/frame 0xfffffe01417c3ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01417c3bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01417c3bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8011c56aa, rsp = 0x7fffffffeb58, rbp = 0x7fffffffeba0 --- Tracing command rw pid 68293 tid 100383 td 0xfffffe0144097560 sched_switch() at sched_switch+0x5af/frame 0xfffffe0144546160 mi_switch() at mi_switch+0x155/frame 0xfffffe0144546180 kern_yield() at kern_yield+0x71/frame 0xfffffe01445461c0 __mnt_vnode_next_all() at __mnt_vnode_next_all+0x27/frame 0xfffffe0144546200 ffs_sync() at ffs_sync+0x174/frame 0xfffffe01445462a0 journal_check_space() at journal_check_space+0xe0/frame 0xfffffe01445462d0 softdep_prealloc() at softdep_prealloc+0x17c/frame 0xfffffe0144546300 ffs_write() at ffs_write+0x3f/frame 0xfffffe01445463b0 VOP_WRITE_APV() at VOP_WRITE_APV+0xcf/frame 0xfffffe01445464c0 null_bypass() at null_bypass+0x12b/frame 0xfffffe0144546640 VOP_WRITE_APV() at VOP_WRITE_APV+0xcf/frame 0xfffffe0144546750 vn_write() at vn_write+0x2e7/frame 0xfffffe01445467e0 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe0144546840 vn_io_fault1() at vn_io_fault1+0x163/frame 0xfffffe0144546980 vn_io_fault() at vn_io_fault+0x1ba/frame 0xfffffe0144546a00 dofilewrite() at dofilewrite+0x81/frame 0xfffffe0144546a50 sys_write() at sys_write+0xc0/frame 0xfffffe0144546ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0144546bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0144546bf0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x8011aa8ca, rsp = 0x7fffffffd2a8, rbp = 0x7fffffffe360 --- Tracing command sshd pid 2757 tid 100294 td 0xfffffe0143dc0740 sched_switch() at sched_switch+0x5af/frame 0xfffffe0141769760 mi_switch() at mi_switch+0x155/frame 0xfffffe0141769780 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01417697c0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0141769810 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0141769820 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe0141769880 seltdwait() at seltdwait+0x8d/frame 0xfffffe01417698c0 kern_poll_kfds() at kern_poll_kfds+0x41b/frame 0xfffffe0141769950 kern_poll() at kern_poll+0x9f/frame 0xfffffe0141769aa0 sys_poll() at sys_poll+0x50/frame 0xfffffe0141769ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0141769bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141769bf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x80169962a, rsp = 0x7fffffffe538, rbp = 0x7fffffffe570 --- Tracing command rename pid 68295 tid 100572 td 0xfffffe01485da720 sched_switch() at sched_switch+0x5af/frame 0xfffffe0147b02220 mi_switch() at mi_switch+0x155/frame 0xfffffe0147b02240 __mtx_lock_sleep() at __mtx_lock_sleep+0x1c9/frame 0xfffffe0147b022d0 __mtx_lock_flags() at __mtx_lock_flags+0xef/frame 0xfffffe0147b02320 __mnt_vnode_next_all() at __mnt_vnode_next_all+0x42/frame 0xfffffe0147b02360 ffs_sync() at ffs_sync+0x174/frame 0xfffffe0147b02400 journal_check_space() at journal_check_space+0xe0/frame 0xfffffe0147b02430 softdep_prelink() at softdep_prelink+0x2d7/frame 0xfffffe0147b02480 ufs_makeinode() at ufs_makeinode+0xb9/frame 0xfffffe0147b02610 ufs_create() at ufs_create+0x34/frame 0xfffffe0147b02630 VOP_CREATE_APV() at VOP_CREATE_APV+0x62/frame 0xfffffe0147b02650 null_bypass() at null_bypass+0x12b/frame 0xfffffe0147b027d0 VOP_CREATE_APV() at VOP_CREATE_APV+0x62/frame 0xfffffe0147b027f0 vn_open_cred() at vn_open_cred+0x2b9/frame 0xfffffe0147b02960 kern_openat() at kern_openat+0x28c/frame 0xfffffe0147b02ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0147b02bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0147b02bf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8011aa60a, rsp = 0x7fffffffe128, rbp = 0x7fffffffe210 --- Tracing command lockf pid 68296 tid 100317 td 0xfffffe0143598e40 thread_exit() at thread_exit+0x203/frame 0xfffffe01417e6790 exit1() at exit1+0xdde/frame 0xfffffe01417e6800 sigexit() at sigexit+0x157/frame 0xfffffe01417e6ae0 postsig() at postsig+0x1aa/frame 0xfffffe01417e6bb0 ast() at ast+0x4fb/frame 0xfffffe01417e6bf0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe2e0 Tracing command sshd pid 2760 tid 100302 td 0xfffffe01435b4c80 sched_switch() at sched_switch+0x5af/frame 0xfffffe0141787720 mi_switch() at mi_switch+0x155/frame 0xfffffe0141787740 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0141787780 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01417877d0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01417877e0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe0141787840 seltdwait() at seltdwait+0x8d/frame 0xfffffe0141787880 kern_select() at kern_select+0xa4e/frame 0xfffffe0141787a80 sys_select() at sys_select+0x56/frame 0xfffffe0141787ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0141787bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141787bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80169972a, rsp = 0x7fffffffa4c8, rbp = 0x7fffffffa500 --- Tracing command creat pid 68297 tid 100386 td 0xfffffe014408b000 sched_switch() at sched_switch+0x5af/frame 0xfffffe014454b220 mi_switch() at mi_switch+0x155/frame 0xfffffe014454b240 __mtx_lock_sleep() at __mtx_lock_sleep+0x1c9/frame 0xfffffe014454b2d0 __mtx_lock_flags() at __mtx_lock_flags+0xef/frame 0xfffffe014454b320 __mnt_vnode_next_all() at __mnt_vnode_next_all+0x42/frame 0xfffffe014454b360 ffs_sync() at ffs_sync+0x174/frame 0xfffffe014454b400 journal_check_space() at journal_check_space+0xe0/frame 0xfffffe014454b430 softdep_prelink() at softdep_prelink+0x2d7/frame 0xfffffe014454b480 ufs_makeinode() at ufs_makeinode+0xb9/frame 0xfffffe014454b610 ufs_create() at ufs_create+0x34/frame 0xfffffe014454b630 VOP_CREATE_APV() at VOP_CREATE_APV+0x62/frame 0xfffffe014454b650 null_bypass() at null_bypass+0x12b/frame 0xfffffe014454b7d0 VOP_CREATE_APV() at VOP_CREATE_APV+0x62/frame 0xfffffe014454b7f0 vn_open_cred() at vn_open_cred+0x2b9/frame 0xfffffe014454b960 kern_openat() at kern_openat+0x28c/frame 0xfffffe014454bac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014454bbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014454bbf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8011aa60a, rsp = 0x7fffffffe2a8, rbp = 0x7fffffffe360 --- Tracing command bash pid 2761 tid 100228 td 0xfffffe00e4d3be40 --- swapped out Tracing command symlink pid 68298 tid 100402 td 0xfffffe01440af020 sched_switch() at sched_switch+0x5af/frame 0xfffffe014459b360 mi_switch() at mi_switch+0x155/frame 0xfffffe014459b380 kern_yield() at kern_yield+0x71/frame 0xfffffe014459b3c0 __mnt_vnode_next_all() at __mnt_vnode_next_all+0x27/frame 0xfffffe014459b400 ffs_sync() at ffs_sync+0x174/frame 0xfffffe014459b4a0 journal_check_space() at journal_check_space+0xe0/frame 0xfffffe014459b4d0 softdep_prelink() at softdep_prelink+0x2d7/frame 0xfffffe014459b520 ufs_makeinode() at ufs_makeinode+0xb9/frame 0xfffffe014459b6b0 ufs_symlink() at ufs_symlink+0x38/frame 0xfffffe014459b6e0 VOP_SYMLINK_APV() at VOP_SYMLINK_APV+0x65/frame 0xfffffe014459b700 null_bypass() at null_bypass+0x12b/frame 0xfffffe014459b880 VOP_SYMLINK_APV() at VOP_SYMLINK_APV+0x65/frame 0xfffffe014459b8a0 kern_symlinkat() at kern_symlinkat+0x24f/frame 0xfffffe014459bac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014459bbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014459bbf0 --- syscall (57, FreeBSD ELF64, sys_symlink), rip = 0x8011a79aa, rsp = 0x7fffffffe2a8, rbp = 0x7fffffffe360 --- Tracing command fts pid 68299 tid 100512 td 0xfffffe0146756e40 sched_switch() at sched_switch+0x5af/frame 0xfffffe01457c1480 mi_switch() at mi_switch+0x155/frame 0xfffffe01457c14a0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01457c14e0 sleeplk() at sleeplk+0x100/frame 0xfffffe01457c1540 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d2/frame 0xfffffe01457c15e0 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe01457c1620 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe01457c1640 null_lock() at null_lock+0xd3/frame 0xfffffe01457c16a0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe01457c16c0 _vn_lock() at _vn_lock+0x54/frame 0xfffffe01457c1720 lookup() at lookup+0xc2/frame 0xfffffe01457c17c0 namei() at namei+0x379/frame 0xfffffe01457c1870 kern_statat() at kern_statat+0x12d/frame 0xfffffe01457c19c0 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe01457c1ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01457c1bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01457c1bf0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x8011a93aa, rsp = 0x7fffffffe048, rbp = 0x7fffffffe100 --- Tracing command rw pid 68300 tid 100369 td 0xfffffe014408dac0 sched_switch() at sched_switch+0x5af/frame 0xfffffe0144505650 mi_switch() at mi_switch+0x155/frame 0xfffffe0144505670 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01445056b0 _sx_xlock_hard() at _sx_xlock_hard+0x421/frame 0xfffffe0144505750 _sx_xlock() at _sx_xlock+0xbb/frame 0xfffffe0144505790 exit1() at exit1+0x655/frame 0xfffffe0144505800 sigexit() at sigexit+0x157/frame 0xfffffe0144505ae0 postsig() at postsig+0x1aa/frame 0xfffffe0144505bb0 ast() at ast+0x4fb/frame 0xfffffe0144505bf0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe360 Tracing command lockf pid 68301 tid 100337 td 0xfffffe0143fc0560 sched_switch() at sched_switch+0x5af/frame 0xfffffe0144454470 mi_switch() at mi_switch+0x155/frame 0xfffffe0144454490 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01444544d0 sleeplk() at sleeplk+0x100/frame 0xfffffe0144454530 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d2/frame 0xfffffe01444545d0 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe0144454610 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe0144454630 null_lock() at null_lock+0xd3/frame 0xfffffe0144454690 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe01444546b0 _vn_lock() at _vn_lock+0x54/frame 0xfffffe0144454710 lookup() at lookup+0xc2/frame 0xfffffe01444547b0 namei() at namei+0x379/frame 0xfffffe0144454860 kern_funlinkat() at kern_funlinkat+0x129/frame 0xfffffe0144454aa0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe0144454ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0144454bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0144454bf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x8011a758a, rsp = 0x7fffffffe318, rbp = 0x7fffffffe360 --- Tracing command mkdir pid 68302 tid 100522 td 0xfffffe01478a1900 sched_switch() at sched_switch+0x5af/frame 0xfffffe0147a045a0 mi_switch() at mi_switch+0x155/frame 0xfffffe0147a045c0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0147a04600 sleeplk() at sleeplk+0x100/frame 0xfffffe0147a04660 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d2/frame 0xfffffe0147a04700 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe0147a04740 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe0147a04760 null_lock() at null_lock+0xd3/frame 0xfffffe0147a047c0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe0147a047e0 _vn_lock() at _vn_lock+0x54/frame 0xfffffe0147a04840 lookup() at lookup+0xc2/frame 0xfffffe0147a048e0 namei() at namei+0x379/frame 0xfffffe0147a04990 kern_chdir() at kern_chdir+0xc9/frame 0xfffffe0147a04ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0147a04bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0147a04bf0 --- syscall (12, FreeBSD ELF64, sys_chdir), rip = 0x8011a75aa, rsp = 0x7fffffffdaf8, rbp = 0x7fffffffdf30 --- Tracing command su pid 2766 tid 100288 td 0xfffffe010e57a560 --- swapped out Tracing command fts pid 68303 tid 100241 td 0xfffffe010e57d020 sched_switch() at sched_switch+0x5af/frame 0xfffffe0141601480 mi_switch() at mi_switch+0x155/frame 0xfffffe01416014a0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01416014e0 sleeplk() at sleeplk+0x100/frame 0xfffffe0141601540 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d2/frame 0xfffffe01416015e0 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe0141601620 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe0141601640 null_lock() at null_lock+0xd3/frame 0xfffffe01416016a0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe01416016c0 _vn_lock() at _vn_lock+0x54/frame 0xfffffe0141601720 lookup() at lookup+0xc2/frame 0xfffffe01416017c0 namei() at namei+0x379/frame 0xfffffe0141601870 kern_statat() at kern_statat+0x12d/frame 0xfffffe01416019c0 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe0141601ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0141601bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141601bf0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x8011a93aa, rsp = 0x7fffffffe048, rbp = 0x7fffffffe100 --- Tracing command csh pid 2767 tid 100305 td 0xfffffe0143e85900 --- swapped out Tracing command rw pid 68304 tid 100509 td 0xfffffe010e596720 sched_switch() at sched_switch+0x5af/frame 0xfffffe01457ad0c0 mi_switch() at mi_switch+0x155/frame 0xfffffe01457ad0e0 __mtx_lock_sleep() at __mtx_lock_sleep+0x1c9/frame 0xfffffe01457ad170 __mtx_lock_flags() at __mtx_lock_flags+0xef/frame 0xfffffe01457ad1c0 __mnt_vnode_next_all() at __mnt_vnode_next_all+0x42/frame 0xfffffe01457ad200 ffs_sync() at ffs_sync+0x174/frame 0xfffffe01457ad2a0 journal_check_space() at journal_check_space+0xe0/frame 0xfffffe01457ad2d0 softdep_prealloc() at softdep_prealloc+0x17c/frame 0xfffffe01457ad300 ffs_write() at ffs_write+0x3f/frame 0xfffffe01457ad3b0 VOP_WRITE_APV() at VOP_WRITE_APV+0xcf/frame 0xfffffe01457ad4c0 null_bypass() at null_bypass+0x12b/frame 0xfffffe01457ad640 VOP_WRITE_APV() at VOP_WRITE_APV+0xcf/frame 0xfffffe01457ad750 vn_write() at vn_write+0x2e7/frame 0xfffffe01457ad7e0 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe01457ad840 vn_io_fault1() at vn_io_fault1+0x163/frame 0xfffffe01457ad980 vn_io_fault() at vn_io_fault+0x1ba/frame 0xfffffe01457ada00 dofilewrite() at dofilewrite+0x81/frame 0xfffffe01457ada50 sys_write() at sys_write+0xc0/frame 0xfffffe01457adac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01457adbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01457adbf0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x8011aa8ca, rsp = 0x7fffffffd2a8, rbp = 0x7fffffffe360 --- Tracing command creat pid 68305 tid 100333 td 0xfffffe0143fc3740 sched_switch() at sched_switch+0x5af/frame 0xfffffe0144440220 mi_switch() at mi_switch+0x155/frame 0xfffffe0144440240 __mtx_lock_sleep() at __mtx_lock_sleep+0x1c9/frame 0xfffffe01444402d0 __mtx_lock_flags() at __mtx_lock_flags+0xef/frame 0xfffffe0144440320 __mnt_vnode_next_all() at __mnt_vnode_next_all+0x42/frame 0xfffffe0144440360 ffs_sync() at ffs_sync+0x174/frame 0xfffffe0144440400 journal_check_space() at journal_check_space+0xe0/frame 0xfffffe0144440430 softdep_prelink() at softdep_prelink+0x2d7/frame 0xfffffe0144440480 ufs_makeinode() at ufs_makeinode+0xb9/frame 0xfffffe0144440610 ufs_create() at ufs_create+0x34/frame 0xfffffe0144440630 VOP_CREATE_APV() at VOP_CREATE_APV+0x62/frame 0xfffffe0144440650 null_bypass() at null_bypass+0x12b/frame 0xfffffe01444407d0 VOP_CREATE_APV() at VOP_CREATE_APV+0x62/frame 0xfffffe01444407f0 vn_open_cred() at vn_open_cred+0x2b9/frame 0xfffffe0144440960 kern_openat() at kern_openat+0x28c/frame 0xfffffe0144440ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0144440bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0144440bf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8011aa60a, rsp = 0x7fffffffe2a8, rbp = 0x7fffffffe360 --- Tracing command bash pid 2769 tid 100250 td 0xfffffe010e57c900 --- swapped out Tracing command rename pid 68306 tid 100521 td 0xfffffe01478a9ac0 sched_switch() at sched_switch+0x5af/frame 0xfffffe01457df1a0 mi_switch() at mi_switch+0x155/frame 0xfffffe01457df1c0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01457df200 sleeplk() at sleeplk+0x100/frame 0xfffffe01457df260 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x402/frame 0xfffffe01457df310 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe01457df350 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe01457df370 _vn_lock() at _vn_lock+0x54/frame 0xfffffe01457df3d0 vn_lock_pair() at vn_lock_pair+0x109/frame 0xfffffe01457df430 softdep_prelink() at softdep_prelink+0x35e/frame 0xfffffe01457df480 ufs_makeinode() at ufs_makeinode+0xb9/frame 0xfffffe01457df610 ufs_create() at ufs_create+0x34/frame 0xfffffe01457df630 VOP_CREATE_APV() at VOP_CREATE_APV+0x62/frame 0xfffffe01457df650 null_bypass() at null_bypass+0x12b/frame 0xfffffe01457df7d0 VOP_CREATE_APV() at VOP_CREATE_APV+0x62/frame 0xfffffe01457df7f0 vn_open_cred() at vn_open_cred+0x2b9/frame 0xfffffe01457df960 kern_openat() at kern_openat+0x28c/frame 0xfffffe01457dfac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01457dfbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01457dfbf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8011aa60a, rsp = 0x7fffffffe128, rbp = 0x7fffffffe210 --- Tracing command sh pid 2770 tid 100293 td 0xfffffe014355d000 sched_switch() at sched_switch+0x5af/frame 0xfffffe014176e6d0 mi_switch() at mi_switch+0x155/frame 0xfffffe014176e6f0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe014176e730 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014176e780 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe014176e790 _sleep() at _sleep+0x325/frame 0xfffffe014176e830 kern_wait6() at kern_wait6+0x474/frame 0xfffffe014176e8c0 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe014176eac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014176ebf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014176ebf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80120988a, rsp = 0x7fffffffe4e8, rbp = 0x7fffffffe590 --- Tracing command mkfifo pid 68307 tid 100281 td 0xfffffe014355de40 thread_exit() at thread_exit+0x203/frame 0xfffffe014173c790 exit1() at exit1+0xdde/frame 0xfffffe014173c800 sigexit() at sigexit+0x157/frame 0xfffffe014173cae0 postsig() at postsig+0x1aa/frame 0xfffffe014173cbb0 ast() at ast+0x4fb/frame 0xfffffe014173cbf0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe3d0 Tracing command symlink pid 68308 tid 100341 td 0xfffffe0143f7dc80 sched_switch() at sched_switch+0x5af/frame 0xfffffe0144468650 mi_switch() at mi_switch+0x155/frame 0xfffffe0144468670 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01444686b0 _sx_xlock_hard() at _sx_xlock_hard+0x421/frame 0xfffffe0144468750 _sx_xlock() at _sx_xlock+0xbb/frame 0xfffffe0144468790 exit1() at exit1+0x655/frame 0xfffffe0144468800 sigexit() at sigexit+0x157/frame 0xfffffe0144468ae0 postsig() at postsig+0x1aa/frame 0xfffffe0144468bb0 ast() at ast+0x4fb/frame 0xfffffe0144468bf0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe0a0 Tracing command dirrename pid 68309 tid 100487 td 0xfffffe0143e82e40 thread_exit() at thread_exit+0x203/frame 0xfffffe0145749790 exit1() at exit1+0xdde/frame 0xfffffe0145749800 sigexit() at sigexit+0x157/frame 0xfffffe0145749ae0 postsig() at postsig+0x1aa/frame 0xfffffe0145749bb0 ast() at ast+0x4fb/frame 0xfffffe0145749bf0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe3c0 Tracing command lockf pid 68310 tid 100232 td 0xfffffe010e57d740 thread_exit() at thread_exit+0x203/frame 0xfffffe0141606790 exit1() at exit1+0xdde/frame 0xfffffe0141606800 sigexit() at sigexit+0x157/frame 0xfffffe0141606ae0 postsig() at postsig+0x1aa/frame 0xfffffe0141606bb0 ast() at ast+0x4fb/frame 0xfffffe0141606bf0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe2e0 Tracing command rw pid 68311 tid 100368 td 0xfffffe014408e1e0 sched_switch() at sched_switch+0x5af/frame 0xfffffe014450a650 mi_switch() at mi_switch+0x155/frame 0xfffffe014450a670 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe014450a6b0 _sx_xlock_hard() at _sx_xlock_hard+0x421/frame 0xfffffe014450a750 _sx_xlock() at _sx_xlock+0xbb/frame 0xfffffe014450a790 exit1() at exit1+0x655/frame 0xfffffe014450a800 sigexit() at sigexit+0x157/frame 0xfffffe014450aae0 postsig() at postsig+0x1aa/frame 0xfffffe014450abb0 ast() at ast+0x4fb/frame 0xfffffe014450abf0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe360 Tracing command mkdir pid 68312 tid 100579 td 0xfffffe014406f1e0 (CPU 0) cpustop_handler() at cpustop_handler+0x28/frame 0xffffffff81ff9220 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xffffffff81ff9230 trap() at trap+0x56/frame 0xffffffff81ff9340 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81ff9340 --- trap 0x13, rip = 0xffffffff80c70382, rsp = 0xfffffe0144472300, rbp = 0xfffffe0144472310 --- lock_delay() at lock_delay+0x22/frame 0xfffffe0144472310 __mtx_lock_sleep() at __mtx_lock_sleep+0xe8/frame 0xfffffe01444723a0 __mtx_lock_flags() at __mtx_lock_flags+0xef/frame 0xfffffe01444723f0 __mnt_vnode_next_all() at __mnt_vnode_next_all+0x42/frame 0xfffffe0144472430 ffs_sync() at ffs_sync+0x174/frame 0xfffffe01444724d0 journal_check_space() at journal_check_space+0xe0/frame 0xfffffe0144472500 softdep_prelink() at softdep_prelink+0x2d7/frame 0xfffffe0144472550 ufs_mkdir() at ufs_mkdir+0xbe/frame 0xfffffe01444726f0 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x65/frame 0xfffffe0144472710 null_bypass() at null_bypass+0x12b/frame 0xfffffe0144472890 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x65/frame 0xfffffe01444728b0 kern_mkdirat() at kern_mkdirat+0x1f7/frame 0xfffffe0144472ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0144472bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0144472bf0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x8011a7e4a, rsp = 0x7ffffffeb178, rbp = 0x7ffffffeb5b0 --- Tracing command swap pid 68313 tid 100567 td 0xfffffe01485dae40 sched_switch() at sched_switch+0x5af/frame 0xfffffe0147adf650 mi_switch() at mi_switch+0x155/frame 0xfffffe0147adf670 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0147adf6b0 _sx_xlock_hard() at _sx_xlock_hard+0x421/frame 0xfffffe0147adf750 _sx_xlock() at _sx_xlock+0xbb/frame 0xfffffe0147adf790 exit1() at exit1+0x655/frame 0xfffffe0147adf800 sigexit() at sigexit+0x157/frame 0xfffffe0147adfae0 postsig() at postsig+0x1aa/frame 0xfffffe0147adfbb0 ast() at ast+0x4fb/frame 0xfffffe0147adfbf0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe360 Tracing command creat pid 68314 tid 100455 td 0xfffffe014407a000 sched_switch() at sched_switch+0x5af/frame 0xfffffe01444d32c0 mi_switch() at mi_switch+0x155/frame 0xfffffe01444d32e0 kern_yield() at kern_yield+0x71/frame 0xfffffe01444d3320 __mnt_vnode_next_all() at __mnt_vnode_next_all+0x27/frame 0xfffffe01444d3360 ffs_sync() at ffs_sync+0x174/frame 0xfffffe01444d3400 journal_check_space() at journal_check_space+0xe0/frame 0xfffffe01444d3430 softdep_prelink() at softdep_prelink+0x2d7/frame 0xfffffe01444d3480 ufs_makeinode() at ufs_makeinode+0xb9/frame 0xfffffe01444d3610 ufs_create() at ufs_create+0x34/frame 0xfffffe01444d3630 VOP_CREATE_APV() at VOP_CREATE_APV+0x62/frame 0xfffffe01444d3650 null_bypass() at null_bypass+0x12b/frame 0xfffffe01444d37d0 VOP_CREATE_APV() at VOP_CREATE_APV+0x62/frame 0xfffffe01444d37f0 vn_open_cred() at vn_open_cred+0x2b9/frame 0xfffffe01444d3960 kern_openat() at kern_openat+0x28c/frame 0xfffffe01444d3ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01444d3bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01444d3bf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8011aa60a, rsp = 0x7fffffffe2a8, rbp = 0x7fffffffe360 --- Tracing command rename pid 68315 tid 100611 td 0xfffffe01499b4740 sched_switch() at sched_switch+0x5af/frame 0xfffffe0147bc9480 mi_switch() at mi_switch+0x155/frame 0xfffffe0147bc94a0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0147bc94e0 sleeplk() at sleeplk+0x100/frame 0xfffffe0147bc9540 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d2/frame 0xfffffe0147bc95e0 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe0147bc9620 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe0147bc9640 null_lock() at null_lock+0xd3/frame 0xfffffe0147bc96a0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe0147bc96c0 _vn_lock() at _vn_lock+0x54/frame 0xfffffe0147bc9720 lookup() at lookup+0xc2/frame 0xfffffe0147bc97c0 namei() at namei+0x379/frame 0xfffffe0147bc9870 kern_renameat() at kern_renameat+0x10c/frame 0xfffffe0147bc9ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0147bc9bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0147bc9bf0 --- syscall (128, FreeBSD ELF64, sys_rename), rip = 0x8011a7daa, rsp = 0x7fffffffe218, rbp = 0x7fffffffe360 --- Tracing command symlink pid 68316 tid 100285 td 0xfffffe014355d720 sched_switch() at sched_switch+0x5af/frame 0xfffffe01417372c0 mi_switch() at mi_switch+0x155/frame 0xfffffe01417372e0 __mtx_lock_sleep() at __mtx_lock_sleep+0x1c9/frame 0xfffffe0141737370 __mtx_lock_flags() at __mtx_lock_flags+0xef/frame 0xfffffe01417373c0 __mnt_vnode_next_all() at __mnt_vnode_next_all+0x42/frame 0xfffffe0141737400 ffs_sync() at ffs_sync+0x174/frame 0xfffffe01417374a0 journal_check_space() at journal_check_space+0xe0/frame 0xfffffe01417374d0 softdep_prelink() at softdep_prelink+0x2d7/frame 0xfffffe0141737520 ufs_makeinode() at ufs_makeinode+0xb9/frame 0xfffffe01417376b0 ufs_symlink() at ufs_symlink+0x38/frame 0xfffffe01417376e0 VOP_SYMLINK_APV() at VOP_SYMLINK_APV+0x65/frame 0xfffffe0141737700 null_bypass() at null_bypass+0x12b/frame 0xfffffe0141737880 VOP_SYMLINK_APV() at VOP_SYMLINK_APV+0x65/frame 0xfffffe01417378a0 kern_symlinkat() at kern_symlinkat+0x24f/frame 0xfffffe0141737ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0141737bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141737bf0 --- syscall (57, FreeBSD ELF64, sys_symlink), rip = 0x8011a79aa, rsp = 0x7fffffffe2a8, rbp = 0x7fffffffe360 --- Tracing command fts pid 68317 tid 100476 td 0xfffffe0145a3d740 sched_switch() at sched_switch+0x5af/frame 0xfffffe0145712650 mi_switch() at mi_switch+0x155/frame 0xfffffe0145712670 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01457126b0 _sx_xlock_hard() at _sx_xlock_hard+0x421/frame 0xfffffe0145712750 _sx_xlock() at _sx_xlock+0xbb/frame 0xfffffe0145712790 exit1() at exit1+0x655/frame 0xfffffe0145712800 sigexit() at sigexit+0x157/frame 0xfffffe0145712ae0 postsig() at postsig+0x1aa/frame 0xfffffe0145712bb0 ast() at ast+0x4fb/frame 0xfffffe0145712bf0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe100 Tracing command dirnprename pid 68318 tid 100546 td 0xfffffe0145906000 sched_switch() at sched_switch+0x5af/frame 0xfffffe0147a7e650 mi_switch() at mi_switch+0x155/frame 0xfffffe0147a7e670 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0147a7e6b0 _sx_xlock_hard() at _sx_xlock_hard+0x421/frame 0xfffffe0147a7e750 _sx_xlock() at _sx_xlock+0xbb/frame 0xfffffe0147a7e790 exit1() at exit1+0x655/frame 0xfffffe0147a7e800 sigexit() at sigexit+0x157/frame 0xfffffe0147a7eae0 postsig() at postsig+0x1aa/frame 0xfffffe0147a7ebb0 ast() at ast+0x4fb/frame 0xfffffe0147a7ebf0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe3c0 Tracing command rw pid 68319 tid 100459 td 0xfffffe0144113560 sched_switch() at sched_switch+0x5af/frame 0xfffffe01456a9650 mi_switch() at mi_switch+0x155/frame 0xfffffe01456a9670 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01456a96b0 _sx_xlock_hard() at _sx_xlock_hard+0x421/frame 0xfffffe01456a9750 _sx_xlock() at _sx_xlock+0xbb/frame 0xfffffe01456a9790 exit1() at exit1+0x655/frame 0xfffffe01456a9800 sigexit() at sigexit+0x157/frame 0xfffffe01456a9ae0 postsig() at postsig+0x1aa/frame 0xfffffe01456a9bb0 ast() at ast+0x4fb/frame 0xfffffe01456a9bf0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe360 Tracing command swap pid 68320 tid 100412 td 0xfffffe01440e01e0 sched_switch() at sched_switch+0x5af/frame 0xfffffe01445cd650 mi_switch() at mi_switch+0x155/frame 0xfffffe01445cd670 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01445cd6b0 _sx_xlock_hard() at _sx_xlock_hard+0x421/frame 0xfffffe01445cd750 _sx_xlock() at _sx_xlock+0xbb/frame 0xfffffe01445cd790 exit1() at exit1+0x655/frame 0xfffffe01445cd800 sigexit() at sigexit+0x157/frame 0xfffffe01445cdae0 postsig() at postsig+0x1aa/frame 0xfffffe01445cdbb0 ast() at ast+0x4fb/frame 0xfffffe01445cdbf0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe360 Tracing command mkdir pid 68321 tid 100423 td 0xfffffe01440f51e0 sched_switch() at sched_switch+0x5af/frame 0xfffffe014560e2f0 mi_switch() at mi_switch+0x155/frame 0xfffffe014560e310 __mtx_lock_sleep() at __mtx_lock_sleep+0x1c9/frame 0xfffffe014560e3a0 __mtx_lock_flags() at __mtx_lock_flags+0xef/frame 0xfffffe014560e3f0 __mnt_vnode_next_all() at __mnt_vnode_next_all+0x42/frame 0xfffffe014560e430 ffs_sync() at ffs_sync+0x174/frame 0xfffffe014560e4d0 journal_check_space() at journal_check_space+0xe0/frame 0xfffffe014560e500 softdep_prelink() at softdep_prelink+0x2d7/frame 0xfffffe014560e550 ufs_mkdir() at ufs_mkdir+0xbe/frame 0xfffffe014560e6f0 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x65/frame 0xfffffe014560e710 null_bypass() at null_bypass+0x12b/frame 0xfffffe014560e890 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x65/frame 0xfffffe014560e8b0 kern_mkdirat() at kern_mkdirat+0x1f7/frame 0xfffffe014560eac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014560ebf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014560ebf0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x8011a7e4a, rsp = 0x7ffffffda5b8, rbp = 0x7ffffffda9f0 --- Tracing command rename pid 68322 tid 100460 td 0xfffffe01459091e0 sched_switch() at sched_switch+0x5af/frame 0xfffffe01456b3650 mi_switch() at mi_switch+0x155/frame 0xfffffe01456b3670 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01456b36b0 _sx_xlock_hard() at _sx_xlock_hard+0x421/frame 0xfffffe01456b3750 _sx_xlock() at _sx_xlock+0xbb/frame 0xfffffe01456b3790 exit1() at exit1+0x655/frame 0xfffffe01456b3800 sigexit() at sigexit+0x157/frame 0xfffffe01456b3ae0 postsig() at postsig+0x1aa/frame 0xfffffe01456b3bb0 ast() at ast+0x4fb/frame 0xfffffe01456b3bf0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe360 Tracing command dirrename pid 68323 tid 100477 td 0xfffffe0145a39e40 sched_switch() at sched_switch+0x5af/frame 0xfffffe014571c4c0 mi_switch() at mi_switch+0x155/frame 0xfffffe014571c4e0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe014571c520 sleeplk() at sleeplk+0x100/frame 0xfffffe014571c580 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d2/frame 0xfffffe014571c620 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe014571c660 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe014571c680 null_lock() at null_lock+0xd3/frame 0xfffffe014571c6e0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe014571c700 _vn_lock() at _vn_lock+0x54/frame 0xfffffe014571c760 lookup() at lookup+0xc2/frame 0xfffffe014571c800 namei() at namei+0x379/frame 0xfffffe014571c8b0 kern_mkdirat() at kern_mkdirat+0x145/frame 0xfffffe014571cac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014571cbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014571cbf0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x8011a7e4a, rsp = 0x7fffffffe208, rbp = 0x7fffffffe350 --- Tracing command lockf pid 68324 tid 100493 td 0xfffffe0143e82000 thread_exit() at thread_exit+0x203/frame 0xfffffe0145753790 exit1() at exit1+0xdde/frame 0xfffffe0145753800 sigexit() at sigexit+0x157/frame 0xfffffe0145753ae0 postsig() at postsig+0x1aa/frame 0xfffffe0145753bb0 ast() at ast+0x4fb/frame 0xfffffe0145753bf0 fast_syscall_common() at fast_syscall_common+0x1a5/frame 0xfffffe0145753bf0 --- syscall (0, FreeBSD ELF64, nosys), rip = 0x8011aa50a, rsp = 0x7fffffffe298, rbp = 0x7fffffffe2e0 --- Tracing command creat pid 68325 tid 100393 td 0xfffffe01440ad3a0 sched_switch() at sched_switch+0x5af/frame 0xfffffe0144578220 mi_switch() at mi_switch+0x155/frame 0xfffffe0144578240 __mtx_lock_sleep() at __mtx_lock_sleep+0x1c9/frame 0xfffffe01445782d0 __mtx_lock_flags() at __mtx_lock_flags+0xef/frame 0xfffffe0144578320 __mnt_vnode_next_all() at __mnt_vnode_next_all+0x42/frame 0xfffffe0144578360 ffs_sync() at ffs_sync+0x174/frame 0xfffffe0144578400 journal_check_space() at journal_check_space+0xe0/frame 0xfffffe0144578430 softdep_prelink() at softdep_prelink+0x2d7/frame 0xfffffe0144578480 ufs_makeinode() at ufs_makeinode+0xb9/frame 0xfffffe0144578610 ufs_create() at ufs_create+0x34/frame 0xfffffe0144578630 VOP_CREATE_APV() at VOP_CREATE_APV+0x62/frame 0xfffffe0144578650 null_bypass() at null_bypass+0x12b/frame 0xfffffe01445787d0 VOP_CREATE_APV() at VOP_CREATE_APV+0x62/frame 0xfffffe01445787f0 vn_open_cred() at vn_open_cred+0x2b9/frame 0xfffffe0144578960 kern_openat() at kern_openat+0x28c/frame 0xfffffe0144578ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0144578bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0144578bf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8011aa60a, rsp = 0x7fffffffe2a8, rbp = 0x7fffffffe360 --- Tracing command symlink pid 68326 tid 100526 td 0xfffffe01478ba1e0 sched_switch() at sched_switch+0x5af/frame 0xfffffe01457fd360 mi_switch() at mi_switch+0x155/frame 0xfffffe01457fd380 kern_yield() at kern_yield+0x71/frame 0xfffffe01457fd3c0 __mnt_vnode_next_all() at __mnt_vnode_next_all+0x27/frame 0xfffffe01457fd400 ffs_sync() at ffs_sync+0x174/frame 0xfffffe01457fd4a0 journal_check_space() at journal_check_space+0xe0/frame 0xfffffe01457fd4d0 softdep_prelink() at softdep_prelink+0x2d7/frame 0xfffffe01457fd520 ufs_makeinode() at ufs_makeinode+0xb9/frame 0xfffffe01457fd6b0 ufs_symlink() at ufs_symlink+0x38/frame 0xfffffe01457fd6e0 VOP_SYMLINK_APV() at VOP_SYMLINK_APV+0x65/frame 0xfffffe01457fd700 null_bypass() at null_bypass+0x12b/frame 0xfffffe01457fd880 VOP_SYMLINK_APV() at VOP_SYMLINK_APV+0x65/frame 0xfffffe01457fd8a0 kern_symlinkat() at kern_symlinkat+0x24f/frame 0xfffffe01457fdac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01457fdbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01457fdbf0 --- syscall (57, FreeBSD ELF64, sys_symlink), rip = 0x8011a79aa, rsp = 0x7fffffffe2a8, rbp = 0x7fffffffe360 --- Tracing command fts pid 68327 tid 100563 td 0xfffffe01485dc3a0 sched_switch() at sched_switch+0x5af/frame 0xfffffe0147ada480 mi_switch() at mi_switch+0x155/frame 0xfffffe0147ada4a0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0147ada4e0 sleeplk() at sleeplk+0x100/frame 0xfffffe0147ada540 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d2/frame 0xfffffe0147ada5e0 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe0147ada620 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe0147ada640 null_lock() at null_lock+0xd3/frame 0xfffffe0147ada6a0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe0147ada6c0 _vn_lock() at _vn_lock+0x54/frame 0xfffffe0147ada720 lookup() at lookup+0xc2/frame 0xfffffe0147ada7c0 namei() at namei+0x379/frame 0xfffffe0147ada870 kern_statat() at kern_statat+0x12d/frame 0xfffffe0147ada9c0 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe0147adaac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0147adabf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0147adabf0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x8011a93aa, rsp = 0x7fffffffe048, rbp = 0x7fffffffe100 --- Tracing command rename pid 68328 tid 100406 td 0xfffffe01440ce3a0 (CPU 8) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce7be00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce7be10 trap() at trap+0x56/frame 0xfffffe003ce7bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce7bf20 --- trap 0x13, rip = 0xffffffff80c70382, rsp = 0xfffffe01445af230, rbp = 0xfffffe01445af240 --- lock_delay() at lock_delay+0x22/frame 0xfffffe01445af240 __mtx_lock_sleep() at __mtx_lock_sleep+0xe8/frame 0xfffffe01445af2d0 __mtx_lock_flags() at __mtx_lock_flags+0xef/frame 0xfffffe01445af320 __mnt_vnode_next_all() at __mnt_vnode_next_all+0x42/frame 0xfffffe01445af360 ffs_sync() at ffs_sync+0x174/frame 0xfffffe01445af400 journal_check_space() at journal_check_space+0xe0/frame 0xfffffe01445af430 softdep_prelink() at softdep_prelink+0x2d7/frame 0xfffffe01445af480 ufs_makeinode() at ufs_makeinode+0xb9/frame 0xfffffe01445af610 ufs_create() at ufs_create+0x34/frame 0xfffffe01445af630 VOP_CREATE_APV() at VOP_CREATE_APV+0x62/frame 0xfffffe01445af650 null_bypass() at null_bypass+0x12b/frame 0xfffffe01445af7d0 VOP_CREATE_APV() at VOP_CREATE_APV+0x62/frame 0xfffffe01445af7f0 vn_open_cred() at vn_open_cred+0x2b9/frame 0xfffffe01445af960 kern_openat() at kern_openat+0x28c/frame 0xfffffe01445afac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01445afbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01445afbf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8011aa60a, rsp = 0x7fffffffe128, rbp = 0x7fffffffe210 --- Tracing command swap pid 68329 tid 100348 td 0xfffffe014407d1e0 sched_switch() at sched_switch+0x5af/frame 0xfffffe014449c650 mi_switch() at mi_switch+0x155/frame 0xfffffe014449c670 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe014449c6b0 _sx_xlock_hard() at _sx_xlock_hard+0x421/frame 0xfffffe014449c750 _sx_xlock() at _sx_xlock+0xbb/frame 0xfffffe014449c790 exit1() at exit1+0x655/frame 0xfffffe014449c800 sigexit() at sigexit+0x157/frame 0xfffffe014449cae0 postsig() at postsig+0x1aa/frame 0xfffffe014449cbb0 ast() at ast+0x4fb/frame 0xfffffe014449cbf0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe360 Tracing command creat pid 68330 tid 100336 td 0xfffffe0143fc2900 sched_switch() at sched_switch+0x5af/frame 0xfffffe014444a220 mi_switch() at mi_switch+0x155/frame 0xfffffe014444a240 __mtx_lock_sleep() at __mtx_lock_sleep+0x1c9/frame 0xfffffe014444a2d0 __mtx_lock_flags() at __mtx_lock_flags+0xef/frame 0xfffffe014444a320 __mnt_vnode_next_all() at __mnt_vnode_next_all+0x42/frame 0xfffffe014444a360 ffs_sync() at ffs_sync+0x174/frame 0xfffffe014444a400 journal_check_space() at journal_check_space+0xe0/frame 0xfffffe014444a430 softdep_prelink() at softdep_prelink+0x2d7/frame 0xfffffe014444a480 ufs_makeinode() at ufs_makeinode+0xb9/frame 0xfffffe014444a610 ufs_create() at ufs_create+0x34/frame 0xfffffe014444a630 VOP_CREATE_APV() at VOP_CREATE_APV+0x62/frame 0xfffffe014444a650 null_bypass() at null_bypass+0x12b/frame 0xfffffe014444a7d0 VOP_CREATE_APV() at VOP_CREATE_APV+0x62/frame 0xfffffe014444a7f0 vn_open_cred() at vn_open_cred+0x2b9/frame 0xfffffe014444a960 kern_openat() at kern_openat+0x28c/frame 0xfffffe014444aac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014444abf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014444abf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8011aa60a, rsp = 0x7fffffffe2a8, rbp = 0x7fffffffe360 --- Tracing command lockf pid 68331 tid 100441 td 0xfffffe0144104900 (CPU 2) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce2de00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce2de10 trap() at trap+0x56/frame 0xfffffe003ce2df20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce2df20 --- trap 0x13, rip = 0xffffffff80c93087, rsp = 0xfffffe0145668430, rbp = 0xfffffe0145668460 --- witness_lock() at witness_lock+0xb7/frame 0xfffffe0145668460 __mtx_lock_flags() at __mtx_lock_flags+0x104/frame 0xfffffe01456684b0 __mnt_vnode_next_all() at __mnt_vnode_next_all+0x42/frame 0xfffffe01456684f0 ffs_sync() at ffs_sync+0x174/frame 0xfffffe0145668590 journal_check_space() at journal_check_space+0xe0/frame 0xfffffe01456685c0 softdep_prelink() at softdep_prelink+0x2d7/frame 0xfffffe0145668610 ufs_remove() at ufs_remove+0x8b/frame 0xfffffe0145668670 VOP_REMOVE_APV() at VOP_REMOVE_APV+0x85/frame 0xfffffe0145668690 null_bypass() at null_bypass+0x12b/frame 0xfffffe0145668810 null_remove() at null_remove+0x4e/frame 0xfffffe0145668840 VOP_REMOVE_APV() at VOP_REMOVE_APV+0x85/frame 0xfffffe0145668860 kern_funlinkat() at kern_funlinkat+0x32a/frame 0xfffffe0145668aa0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe0145668ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0145668bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0145668bf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x8011a758a, rsp = 0x7fffffffe318, rbp = 0x7fffffffe360 --- Tracing command symlink pid 68332 tid 100501 td 0xfffffe0146757c80 (CPU 1) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce20e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce20e10 trap() at trap+0x56/frame 0xfffffe003ce20f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce20f20 --- trap 0x13, rip = 0xffffffff80c70382, rsp = 0xfffffe01457852d0, rbp = 0xfffffe01457852e0 --- lock_delay() at lock_delay+0x22/frame 0xfffffe01457852e0 __mtx_lock_sleep() at __mtx_lock_sleep+0xe8/frame 0xfffffe0145785370 __mtx_lock_flags() at __mtx_lock_flags+0xef/frame 0xfffffe01457853c0 __mnt_vnode_next_all() at __mnt_vnode_next_all+0x42/frame 0xfffffe0145785400 ffs_sync() at ffs_sync+0x174/frame 0xfffffe01457854a0 journal_check_space() at journal_check_space+0xe0/frame 0xfffffe01457854d0 softdep_prelink() at softdep_prelink+0x2d7/frame 0xfffffe0145785520 ufs_makeinode() at ufs_makeinode+0xb9/frame 0xfffffe01457856b0 ufs_symlink() at ufs_symlink+0x38/frame 0xfffffe01457856e0 VOP_SYMLINK_APV() at VOP_SYMLINK_APV+0x65/frame 0xfffffe0145785700 null_bypass() at null_bypass+0x12b/frame 0xfffffe0145785880 VOP_SYMLINK_APV() at VOP_SYMLINK_APV+0x65/frame 0xfffffe01457858a0 kern_symlinkat() at kern_symlinkat+0x24f/frame 0xfffffe0145785ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0145785bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0145785bf0 --- syscall (57, FreeBSD ELF64, sys_symlink), rip = 0x8011a79aa, rsp = 0x7fffffffe2a8, rbp = 0x7fffffffe360 --- Tracing command mkdir pid 68333 tid 100448 td 0xfffffe0144116740 sched_switch() at sched_switch+0x5af/frame 0xfffffe0145686460 mi_switch() at mi_switch+0x155/frame 0xfffffe0145686480 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01456864c0 sleeplk() at sleeplk+0x100/frame 0xfffffe0145686520 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x402/frame 0xfffffe01456865d0 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe0145686610 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe0145686630 _vn_lock() at _vn_lock+0x54/frame 0xfffffe0145686690 vget_finish() at vget_finish+0x7a/frame 0xfffffe01456866c0 cache_lookup_dotdot() at cache_lookup_dotdot+0x1f5/frame 0xfffffe0145686730 vfs_cache_lookup() at vfs_cache_lookup+0x7b/frame 0xfffffe0145686780 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x5a/frame 0xfffffe01456867a0 null_lookup() at null_lookup+0xe9/frame 0xfffffe0145686820 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x5a/frame 0xfffffe0145686840 lookup() at lookup+0x4d1/frame 0xfffffe01456868e0 namei() at namei+0x379/frame 0xfffffe0145686990 kern_chdir() at kern_chdir+0xc9/frame 0xfffffe0145686ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0145686bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0145686bf0 --- syscall (12, FreeBSD ELF64, sys_chdir), rip = 0x8011a75aa, rsp = 0x7fffffffdaf8, rbp = 0x7fffffffdf30 --- Tracing command swap pid 68334 tid 100249 td 0xfffffe01435601e0 sched_switch() at sched_switch+0x5af/frame 0xfffffe0141675650 mi_switch() at mi_switch+0x155/frame 0xfffffe0141675670 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01416756b0 _sx_xlock_hard() at _sx_xlock_hard+0x421/frame 0xfffffe0141675750 _sx_xlock() at _sx_xlock+0xbb/frame 0xfffffe0141675790 exit1() at exit1+0x655/frame 0xfffffe0141675800 sigexit() at sigexit+0x157/frame 0xfffffe0141675ae0 postsig() at postsig+0x1aa/frame 0xfffffe0141675bb0 ast() at ast+0x4fb/frame 0xfffffe0141675bf0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe360 Tracing command fts pid 68335 tid 100438 td 0xfffffe0144101000 sched_switch() at sched_switch+0x5af/frame 0xfffffe014564f400 mi_switch() at mi_switch+0x155/frame 0xfffffe014564f420 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe014564f460 sleeplk() at sleeplk+0x100/frame 0xfffffe014564f4c0 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d2/frame 0xfffffe014564f560 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe014564f5a0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe014564f5c0 null_lock() at null_lock+0xd3/frame 0xfffffe014564f620 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe014564f640 _vn_lock() at _vn_lock+0x54/frame 0xfffffe014564f6a0 lookup() at lookup+0xc2/frame 0xfffffe014564f740 namei() at namei+0x379/frame 0xfffffe014564f7f0 vn_open_cred() at vn_open_cred+0x487/frame 0xfffffe014564f960 kern_openat() at kern_openat+0x28c/frame 0xfffffe014564fac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014564fbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014564fbf0 --- syscall (5, FreeBSD ELF64, sys_open), rip = 0x8011a95ea, rsp = 0x7fffffffe1f8, rbp = 0x7fffffffe220 --- Tracing command dirnprename pid 68336 tid 100253 td 0xfffffe010e59a740 (CPU 6) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce61e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce61e10 trap() at trap+0x56/frame 0xfffffe003ce61f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce61f20 --- trap 0x13, rip = 0xffffffff80c70382, rsp = 0xfffffe014163a300, rbp = 0xfffffe014163a310 --- lock_delay() at lock_delay+0x22/frame 0xfffffe014163a310 __mtx_lock_sleep() at __mtx_lock_sleep+0xe8/frame 0xfffffe014163a3a0 __mtx_lock_flags() at __mtx_lock_flags+0xef/frame 0xfffffe014163a3f0 __mnt_vnode_next_all() at __mnt_vnode_next_all+0x42/frame 0xfffffe014163a430 ffs_sync() at ffs_sync+0x174/frame 0xfffffe014163a4d0 journal_check_space() at journal_check_space+0xe0/frame 0xfffffe014163a500 softdep_prelink() at softdep_prelink+0x2d7/frame 0xfffffe014163a550 ufs_mkdir() at ufs_mkdir+0xbe/frame 0xfffffe014163a6f0 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x65/frame 0xfffffe014163a710 null_bypass() at null_bypass+0x12b/frame 0xfffffe014163a890 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x65/frame 0xfffffe014163a8b0 kern_mkdirat() at kern_mkdirat+0x1f7/frame 0xfffffe014163aac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014163abf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014163abf0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x8011a7e4a, rsp = 0x7fffffffe208, rbp = 0x7fffffffe350 --- Tracing command rename pid 68337 tid 100269 td 0xfffffe01435b61e0 sched_switch() at sched_switch+0x5af/frame 0xfffffe01416e8280 mi_switch() at mi_switch+0x155/frame 0xfffffe01416e82a0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01416e82e0 sleeplk() at sleeplk+0x100/frame 0xfffffe01416e8340 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x402/frame 0xfffffe01416e83f0 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe01416e8430 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe01416e8450 _vn_lock() at _vn_lock+0x54/frame 0xfffffe01416e84b0 ufs_rename() at ufs_rename+0x8d9/frame 0xfffffe01416e86b0 VOP_RENAME_APV() at VOP_RENAME_APV+0x3c/frame 0xfffffe01416e86d0 null_bypass() at null_bypass+0x12b/frame 0xfffffe01416e8850 VOP_RENAME_APV() at VOP_RENAME_APV+0x3c/frame 0xfffffe01416e8870 kern_renameat() at kern_renameat+0x3dd/frame 0xfffffe01416e8ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01416e8bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01416e8bf0 --- syscall (128, FreeBSD ELF64, sys_rename), rip = 0x8011a7daa, rsp = 0x7fffffffe218, rbp = 0x7fffffffe360 --- Tracing command lockf pid 68338 tid 100407 td 0xfffffe01440cdc80 sched_switch() at sched_switch+0x5af/frame 0xfffffe01445be650 mi_switch() at mi_switch+0x155/frame 0xfffffe01445be670 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01445be6b0 _sx_xlock_hard() at _sx_xlock_hard+0x421/frame 0xfffffe01445be750 _sx_xlock() at _sx_xlock+0xbb/frame 0xfffffe01445be790 exit1() at exit1+0x655/frame 0xfffffe01445be800 sigexit() at sigexit+0x157/frame 0xfffffe01445beae0 postsig() at postsig+0x1aa/frame 0xfffffe01445bebb0 ast() at ast+0x4fb/frame 0xfffffe01445bebf0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe2e0 Tracing command dirrename pid 68339 tid 100300 td 0xfffffe01435b5ac0 sched_switch() at sched_switch+0x5af/frame 0xfffffe01416e32f0 mi_switch() at mi_switch+0x155/frame 0xfffffe01416e3310 __mtx_lock_sleep() at __mtx_lock_sleep+0x1c9/frame 0xfffffe01416e33a0 __mtx_lock_flags() at __mtx_lock_flags+0xef/frame 0xfffffe01416e33f0 __mnt_vnode_next_all() at __mnt_vnode_next_all+0x42/frame 0xfffffe01416e3430 ffs_sync() at ffs_sync+0x174/frame 0xfffffe01416e34d0 journal_check_space() at journal_check_space+0xe0/frame 0xfffffe01416e3500 softdep_prelink() at softdep_prelink+0x2d7/frame 0xfffffe01416e3550 ufs_mkdir() at ufs_mkdir+0xbe/frame 0xfffffe01416e36f0 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x65/frame 0xfffffe01416e3710 null_bypass() at null_bypass+0x12b/frame 0xfffffe01416e3890 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x65/frame 0xfffffe01416e38b0 kern_mkdirat() at kern_mkdirat+0x1f7/frame 0xfffffe01416e3ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01416e3bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01416e3bf0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x8011a7e4a, rsp = 0x7fffffffe208, rbp = 0x7fffffffe350 --- Tracing command creat pid 68340 tid 100255 td 0xfffffe010e5adc80 sched_switch() at sched_switch+0x5af/frame 0xfffffe01416892c0 mi_switch() at mi_switch+0x155/frame 0xfffffe01416892e0 kern_yield() at kern_yield+0x71/frame 0xfffffe0141689320 __mnt_vnode_next_all() at __mnt_vnode_next_all+0x27/frame 0xfffffe0141689360 ffs_sync() at ffs_sync+0x174/frame 0xfffffe0141689400 journal_check_space() at journal_check_space+0xe0/frame 0xfffffe0141689430 softdep_prelink() at softdep_prelink+0x2d7/frame 0xfffffe0141689480 ufs_makeinode() at ufs_makeinode+0xb9/frame 0xfffffe0141689610 ufs_create() at ufs_create+0x34/frame 0xfffffe0141689630 VOP_CREATE_APV() at VOP_CREATE_APV+0x62/frame 0xfffffe0141689650 null_bypass() at null_bypass+0x12b/frame 0xfffffe01416897d0 VOP_CREATE_APV() at VOP_CREATE_APV+0x62/frame 0xfffffe01416897f0 vn_open_cred() at vn_open_cred+0x2b9/frame 0xfffffe0141689960 kern_openat() at kern_openat+0x28c/frame 0xfffffe0141689ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0141689bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141689bf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8011aa60a, rsp = 0x7fffffffe2a8, rbp = 0x7fffffffe360 --- Tracing command symlink pid 68341 tid 100266 td 0xfffffe0143560900 sched_switch() at sched_switch+0x5af/frame 0xfffffe01416de360 mi_switch() at mi_switch+0x155/frame 0xfffffe01416de380 kern_yield() at kern_yield+0x71/frame 0xfffffe01416de3c0 __mnt_vnode_next_all() at __mnt_vnode_next_all+0x27/frame 0xfffffe01416de400 ffs_sync() at ffs_sync+0x174/frame 0xfffffe01416de4a0 journal_check_space() at journal_check_space+0xe0/frame 0xfffffe01416de4d0 softdep_prelink() at softdep_prelink+0x2d7/frame 0xfffffe01416de520 ufs_makeinode() at ufs_makeinode+0xb9/frame 0xfffffe01416de6b0 ufs_symlink() at ufs_symlink+0x38/frame 0xfffffe01416de6e0 VOP_SYMLINK_APV() at VOP_SYMLINK_APV+0x65/frame 0xfffffe01416de700 null_bypass() at null_bypass+0x12b/frame 0xfffffe01416de880 VOP_SYMLINK_APV() at VOP_SYMLINK_APV+0x65/frame 0xfffffe01416de8a0 kern_symlinkat() at kern_symlinkat+0x24f/frame 0xfffffe01416deac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01416debf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01416debf0 --- syscall (57, FreeBSD ELF64, sys_symlink), rip = 0x8011a79aa, rsp = 0x7fffffffe2a8, rbp = 0x7fffffffe360 --- Tracing command dirnprename pid 68342 tid 100488 td 0xfffffe0143e82720 sched_switch() at sched_switch+0x5af/frame 0xfffffe01457584c0 mi_switch() at mi_switch+0x155/frame 0xfffffe01457584e0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0145758520 sleeplk() at sleeplk+0x100/frame 0xfffffe0145758580 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d2/frame 0xfffffe0145758620 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe0145758660 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe0145758680 null_lock() at null_lock+0xd3/frame 0xfffffe01457586e0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe0145758700 _vn_lock() at _vn_lock+0x54/frame 0xfffffe0145758760 lookup() at lookup+0xc2/frame 0xfffffe0145758800 namei() at namei+0x379/frame 0xfffffe01457588b0 kern_mkdirat() at kern_mkdirat+0x145/frame 0xfffffe0145758ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0145758bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0145758bf0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x8011a7e4a, rsp = 0x7fffffffe208, rbp = 0x7fffffffe350 --- Tracing command lockf pid 68343 tid 100451 td 0xfffffe01441281e0 sched_switch() at sched_switch+0x5af/frame 0xfffffe014568b3b0 mi_switch() at mi_switch+0x155/frame 0xfffffe014568b3d0 __mtx_lock_sleep() at __mtx_lock_sleep+0x1c9/frame 0xfffffe014568b460 __mtx_lock_flags() at __mtx_lock_flags+0xef/frame 0xfffffe014568b4b0 __mnt_vnode_next_all() at __mnt_vnode_next_all+0x42/frame 0xfffffe014568b4f0 ffs_sync() at ffs_sync+0x174/frame 0xfffffe014568b590 journal_check_space() at journal_check_space+0xe0/frame 0xfffffe014568b5c0 softdep_prelink() at softdep_prelink+0x2d7/frame 0xfffffe014568b610 ufs_remove() at ufs_remove+0x8b/frame 0xfffffe014568b670 VOP_REMOVE_APV() at VOP_REMOVE_APV+0x85/frame 0xfffffe014568b690 null_bypass() at null_bypass+0x12b/frame 0xfffffe014568b810 null_remove() at null_remove+0x4e/frame 0xfffffe014568b840 VOP_REMOVE_APV() at VOP_REMOVE_APV+0x85/frame 0xfffffe014568b860 kern_funlinkat() at kern_funlinkat+0x32a/frame 0xfffffe014568baa0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe014568bac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014568bbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014568bbf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x8011a758a, rsp = 0x7fffffffe318, rbp = 0x7fffffffe360 --- Tracing command mkdir pid 68344 tid 100303 td 0xfffffe0143e843a0 sched_switch() at sched_switch+0x5af/frame 0xfffffe01417964b0 mi_switch() at mi_switch+0x155/frame 0xfffffe01417964d0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0141796510 sleeplk() at sleeplk+0x100/frame 0xfffffe0141796570 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x402/frame 0xfffffe0141796620 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe0141796660 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe0141796680 null_lock() at null_lock+0xd3/frame 0xfffffe01417966e0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe0141796700 _vn_lock() at _vn_lock+0x54/frame 0xfffffe0141796760 lookup() at lookup+0x3dc/frame 0xfffffe0141796800 namei() at namei+0x379/frame 0xfffffe01417968b0 kern_mkdirat() at kern_mkdirat+0x145/frame 0xfffffe0141796ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0141796bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141796bf0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x8011a7e4a, rsp = 0x7fffffffdaf8, rbp = 0x7fffffffdf30 --- Tracing command swap pid 68345 tid 100338 td 0xfffffe0143fbfe40 sched_switch() at sched_switch+0x5af/frame 0xfffffe014444f650 mi_switch() at mi_switch+0x155/frame 0xfffffe014444f670 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe014444f6b0 _sx_xlock_hard() at _sx_xlock_hard+0x421/frame 0xfffffe014444f750 _sx_xlock() at _sx_xlock+0xbb/frame 0xfffffe014444f790 exit1() at exit1+0x655/frame 0xfffffe014444f800 sigexit() at sigexit+0x157/frame 0xfffffe014444fae0 postsig() at postsig+0x1aa/frame 0xfffffe014444fbb0 ast() at ast+0x4fb/frame 0xfffffe014444fbf0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe360 Tracing command fts pid 68346 tid 100356 td 0xfffffe014406dc80 sched_switch() at sched_switch+0x5af/frame 0xfffffe01444b5650 mi_switch() at mi_switch+0x155/frame 0xfffffe01444b5670 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01444b56b0 _sx_xlock_hard() at _sx_xlock_hard+0x421/frame 0xfffffe01444b5750 _sx_xlock() at _sx_xlock+0xbb/frame 0xfffffe01444b5790 exit1() at exit1+0x655/frame 0xfffffe01444b5800 sigexit() at sigexit+0x157/frame 0xfffffe01444b5ae0 postsig() at postsig+0x1aa/frame 0xfffffe01444b5bb0 ast() at ast+0x4fb/frame 0xfffffe01444b5bf0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe100 Tracing command dirrename pid 68347 tid 100413 td 0xfffffe01440dfac0 sched_switch() at sched_switch+0x5af/frame 0xfffffe01445dc270 mi_switch() at mi_switch+0x155/frame 0xfffffe01445dc290 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01445dc2d0 sleeplk() at sleeplk+0x100/frame 0xfffffe01445dc330 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x402/frame 0xfffffe01445dc3e0 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe01445dc420 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe01445dc440 _vn_lock() at _vn_lock+0x54/frame 0xfffffe01445dc4a0 vn_lock_pair() at vn_lock_pair+0x109/frame 0xfffffe01445dc500 softdep_prelink() at softdep_prelink+0x35e/frame 0xfffffe01445dc550 ufs_mkdir() at ufs_mkdir+0xbe/frame 0xfffffe01445dc6f0 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x65/frame 0xfffffe01445dc710 null_bypass() at null_bypass+0x12b/frame 0xfffffe01445dc890 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x65/frame 0xfffffe01445dc8b0 kern_mkdirat() at kern_mkdirat+0x1f7/frame 0xfffffe01445dcac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01445dcbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01445dcbf0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x8011a7e4a, rsp = 0x7fffffffe208, rbp = 0x7fffffffe350 --- Tracing command rename pid 68348 tid 100486 td 0xfffffe0143e83560 sched_switch() at sched_switch+0x5af/frame 0xfffffe014574e1a0 mi_switch() at mi_switch+0x155/frame 0xfffffe014574e1c0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe014574e200 sleeplk() at sleeplk+0x100/frame 0xfffffe014574e260 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x402/frame 0xfffffe014574e310 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe014574e350 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe014574e370 _vn_lock() at _vn_lock+0x54/frame 0xfffffe014574e3d0 vn_lock_pair() at vn_lock_pair+0x109/frame 0xfffffe014574e430 softdep_prelink() at softdep_prelink+0x35e/frame 0xfffffe014574e480 ufs_makeinode() at ufs_makeinode+0xb9/frame 0xfffffe014574e610 ufs_create() at ufs_create+0x34/frame 0xfffffe014574e630 VOP_CREATE_APV() at VOP_CREATE_APV+0x62/frame 0xfffffe014574e650 null_bypass() at null_bypass+0x12b/frame 0xfffffe014574e7d0 VOP_CREATE_APV() at VOP_CREATE_APV+0x62/frame 0xfffffe014574e7f0 vn_open_cred() at vn_open_cred+0x2b9/frame 0xfffffe014574e960 kern_openat() at kern_openat+0x28c/frame 0xfffffe014574eac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014574ebf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014574ebf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8011aa60a, rsp = 0x7fffffffe128, rbp = 0x7fffffffe210 --- Tracing command creat pid 68349 tid 100245 td 0xfffffe010e59a020 sched_switch() at sched_switch+0x5af/frame 0xfffffe01416352c0 mi_switch() at mi_switch+0x155/frame 0xfffffe01416352e0 kern_yield() at kern_yield+0x71/frame 0xfffffe0141635320 __mnt_vnode_next_all() at __mnt_vnode_next_all+0x27/frame 0xfffffe0141635360 ffs_sync() at ffs_sync+0x174/frame 0xfffffe0141635400 journal_check_space() at journal_check_space+0xe0/frame 0xfffffe0141635430 softdep_prelink() at softdep_prelink+0x2d7/frame 0xfffffe0141635480 ufs_makeinode() at ufs_makeinode+0xb9/frame 0xfffffe0141635610 ufs_create() at ufs_create+0x34/frame 0xfffffe0141635630 VOP_CREATE_APV() at VOP_CREATE_APV+0x62/frame 0xfffffe0141635650 null_bypass() at null_bypass+0x12b/frame 0xfffffe01416357d0 VOP_CREATE_APV() at VOP_CREATE_APV+0x62/frame 0xfffffe01416357f0 vn_open_cred() at vn_open_cred+0x2b9/frame 0xfffffe0141635960 kern_openat() at kern_openat+0x28c/frame 0xfffffe0141635ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0141635bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141635bf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8011aa60a, rsp = 0x7fffffffe2a8, rbp = 0x7fffffffe360 --- Tracing command lockf pid 68350 tid 100257 td 0xfffffe010d9db000 sched_switch() at sched_switch+0x5af/frame 0xfffffe0141693650 mi_switch() at mi_switch+0x155/frame 0xfffffe0141693670 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01416936b0 _sx_xlock_hard() at _sx_xlock_hard+0x421/frame 0xfffffe0141693750 _sx_xlock() at _sx_xlock+0xbb/frame 0xfffffe0141693790 exit1() at exit1+0x655/frame 0xfffffe0141693800 sigexit() at sigexit+0x157/frame 0xfffffe0141693ae0 postsig() at postsig+0x1aa/frame 0xfffffe0141693bb0 ast() at ast+0x4fb/frame 0xfffffe0141693bf0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe310 Tracing command dirnprename pid 68351 tid 100482 td 0xfffffe0145909900 sched_switch() at sched_switch+0x5af/frame 0xfffffe01456e5390 mi_switch() at mi_switch+0x155/frame 0xfffffe01456e53b0 kern_yield() at kern_yield+0x71/frame 0xfffffe01456e53f0 __mnt_vnode_next_all() at __mnt_vnode_next_all+0x27/frame 0xfffffe01456e5430 ffs_sync() at ffs_sync+0x174/frame 0xfffffe01456e54d0 journal_check_space() at journal_check_space+0xe0/frame 0xfffffe01456e5500 softdep_prelink() at softdep_prelink+0x2d7/frame 0xfffffe01456e5550 ufs_mkdir() at ufs_mkdir+0xbe/frame 0xfffffe01456e56f0 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x65/frame 0xfffffe01456e5710 null_bypass() at null_bypass+0x12b/frame 0xfffffe01456e5890 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x65/frame 0xfffffe01456e58b0 kern_mkdirat() at kern_mkdirat+0x1f7/frame 0xfffffe01456e5ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01456e5bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01456e5bf0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x8011a7e4a, rsp = 0x7fffffffe208, rbp = 0x7fffffffe350 --- Tracing command mkdir pid 68352 tid 100418 td 0xfffffe01440dd720 sched_switch() at sched_switch+0x5af/frame 0xfffffe01445eb460 mi_switch() at mi_switch+0x155/frame 0xfffffe01445eb480 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01445eb4c0 sleeplk() at sleeplk+0x100/frame 0xfffffe01445eb520 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x402/frame 0xfffffe01445eb5d0 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe01445eb610 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe01445eb630 _vn_lock() at _vn_lock+0x54/frame 0xfffffe01445eb690 vn_lock_pair() at vn_lock_pair+0x9d/frame 0xfffffe01445eb6f0 softdep_prelink() at softdep_prelink+0x35e/frame 0xfffffe01445eb740 ufs_rmdir() at ufs_rmdir+0xef/frame 0xfffffe01445eb790 VOP_RMDIR_APV() at VOP_RMDIR_APV+0x85/frame 0xfffffe01445eb7b0 null_bypass() at null_bypass+0x12b/frame 0xfffffe01445eb930 VOP_RMDIR_APV() at VOP_RMDIR_APV+0x85/frame 0xfffffe01445eb950 kern_frmdirat() at kern_frmdirat+0x39a/frame 0xfffffe01445ebac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01445ebbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01445ebbf0 --- syscall (137, FreeBSD ELF64, sys_rmdir), rip = 0x8011a7e6a, rsp = 0x7fffffffdaf8, rbp = 0x7fffffffdf30 --- Tracing command symlink pid 68353 tid 100259 td 0xfffffe0143561740 sched_switch() at sched_switch+0x5af/frame 0xfffffe01416b6360 mi_switch() at mi_switch+0x155/frame 0xfffffe01416b6380 kern_yield() at kern_yield+0x71/frame 0xfffffe01416b63c0 __mnt_vnode_next_all() at __mnt_vnode_next_all+0x27/frame 0xfffffe01416b6400 ffs_sync() at ffs_sync+0x174/frame 0xfffffe01416b64a0 journal_check_space() at journal_check_space+0xe0/frame 0xfffffe01416b64d0 softdep_prelink() at softdep_prelink+0x2d7/frame 0xfffffe01416b6520 ufs_makeinode() at ufs_makeinode+0xb9/frame 0xfffffe01416b66b0 ufs_symlink() at ufs_symlink+0x38/frame 0xfffffe01416b66e0 VOP_SYMLINK_APV() at VOP_SYMLINK_APV+0x65/frame 0xfffffe01416b6700 null_bypass() at null_bypass+0x12b/frame 0xfffffe01416b6880 VOP_SYMLINK_APV() at VOP_SYMLINK_APV+0x65/frame 0xfffffe01416b68a0 kern_symlinkat() at kern_symlinkat+0x24f/frame 0xfffffe01416b6ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01416b6bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01416b6bf0 --- syscall (57, FreeBSD ELF64, sys_symlink), rip = 0x8011a79aa, rsp = 0x7fffffffe2a8, rbp = 0x7fffffffe360 --- Tracing command dirrename pid 68354 tid 100564 td 0xfffffe01485dbc80 sched_switch() at sched_switch+0x5af/frame 0xfffffe0147ad5650 mi_switch() at mi_switch+0x155/frame 0xfffffe0147ad5670 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0147ad56b0 _sx_xlock_hard() at _sx_xlock_hard+0x421/frame 0xfffffe0147ad5750 _sx_xlock() at _sx_xlock+0xbb/frame 0xfffffe0147ad5790 exit1() at exit1+0x655/frame 0xfffffe0147ad5800 sigexit() at sigexit+0x157/frame 0xfffffe0147ad5ae0 postsig() at postsig+0x1aa/frame 0xfffffe0147ad5bb0 ast() at ast+0x4fb/frame 0xfffffe0147ad5bf0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe350 Tracing command rename pid 68356 tid 100279 td 0xfffffe014359a3a0 sched_switch() at sched_switch+0x5af/frame 0xfffffe01416cf2c0 mi_switch() at mi_switch+0x155/frame 0xfffffe01416cf2e0 kern_yield() at kern_yield+0x71/frame 0xfffffe01416cf320 __mnt_vnode_next_all() at __mnt_vnode_next_all+0x27/frame 0xfffffe01416cf360 ffs_sync() at ffs_sync+0x174/frame 0xfffffe01416cf400 journal_check_space() at journal_check_space+0xe0/frame 0xfffffe01416cf430 softdep_prelink() at softdep_prelink+0x2d7/frame 0xfffffe01416cf480 ufs_makeinode() at ufs_makeinode+0xb9/frame 0xfffffe01416cf610 ufs_create() at ufs_create+0x34/frame 0xfffffe01416cf630 VOP_CREATE_APV() at VOP_CREATE_APV+0x62/frame 0xfffffe01416cf650 null_bypass() at null_bypass+0x12b/frame 0xfffffe01416cf7d0 VOP_CREATE_APV() at VOP_CREATE_APV+0x62/frame 0xfffffe01416cf7f0 vn_open_cred() at vn_open_cred+0x2b9/frame 0xfffffe01416cf960 kern_openat() at kern_openat+0x28c/frame 0xfffffe01416cfac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01416cfbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01416cfbf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8011aa60a, rsp = 0x7fffffffe128, rbp = 0x7fffffffe210 --- Tracing command fts pid 68357 tid 100612 td 0xfffffe01499b4020 sched_switch() at sched_switch+0x5af/frame 0xfffffe0147bd8650 mi_switch() at mi_switch+0x155/frame 0xfffffe0147bd8670 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0147bd86b0 _sx_xlock_hard() at _sx_xlock_hard+0x421/frame 0xfffffe0147bd8750 _sx_xlock() at _sx_xlock+0xbb/frame 0xfffffe0147bd8790 exit1() at exit1+0x655/frame 0xfffffe0147bd8800 sigexit() at sigexit+0x157/frame 0xfffffe0147bd8ae0 postsig() at postsig+0x1aa/frame 0xfffffe0147bd8bb0 ast() at ast+0x4fb/frame 0xfffffe0147bd8bf0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe100 Tracing command creat pid 68358 tid 100231 td 0xfffffe010e57bac0 sched_switch() at sched_switch+0x5af/frame 0xfffffe01415fc2c0 mi_switch() at mi_switch+0x155/frame 0xfffffe01415fc2e0 kern_yield() at kern_yield+0x71/frame 0xfffffe01415fc320 __mnt_vnode_next_all() at __mnt_vnode_next_all+0x27/frame 0xfffffe01415fc360 ffs_sync() at ffs_sync+0x174/frame 0xfffffe01415fc400 journal_check_space() at journal_check_space+0xe0/frame 0xfffffe01415fc430 softdep_prelink() at softdep_prelink+0x2d7/frame 0xfffffe01415fc480 ufs_makeinode() at ufs_makeinode+0xb9/frame 0xfffffe01415fc610 ufs_create() at ufs_create+0x34/frame 0xfffffe01415fc630 VOP_CREATE_APV() at VOP_CREATE_APV+0x62/frame 0xfffffe01415fc650 null_bypass() at null_bypass+0x12b/frame 0xfffffe01415fc7d0 VOP_CREATE_APV() at VOP_CREATE_APV+0x62/frame 0xfffffe01415fc7f0 vn_open_cred() at vn_open_cred+0x2b9/frame 0xfffffe01415fc960 kern_openat() at kern_openat+0x28c/frame 0xfffffe01415fcac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01415fcbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01415fcbf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8011aa60a, rsp = 0x7fffffffe2a8, rbp = 0x7fffffffe360 --- Tracing command lockf pid 68359 tid 100362 td 0xfffffe014407e020 sched_switch() at sched_switch+0x5af/frame 0xfffffe01444dd470 mi_switch() at mi_switch+0x155/frame 0xfffffe01444dd490 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01444dd4d0 sleeplk() at sleeplk+0x100/frame 0xfffffe01444dd530 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d2/frame 0xfffffe01444dd5d0 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe01444dd610 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe01444dd630 null_lock() at null_lock+0xd3/frame 0xfffffe01444dd690 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe01444dd6b0 _vn_lock() at _vn_lock+0x54/frame 0xfffffe01444dd710 lookup() at lookup+0xc2/frame 0xfffffe01444dd7b0 namei() at namei+0x379/frame 0xfffffe01444dd860 kern_funlinkat() at kern_funlinkat+0x129/frame 0xfffffe01444ddaa0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe01444ddac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01444ddbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01444ddbf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x8011a758a, rsp = 0x7fffffffe318, rbp = 0x7fffffffe360 --- Tracing command dirnprename pid 68360 tid 100345 td 0xfffffe0144070740 sched_switch() at sched_switch+0x5af/frame 0xfffffe01444834c0 mi_switch() at mi_switch+0x155/frame 0xfffffe01444834e0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0144483520 sleeplk() at sleeplk+0x100/frame 0xfffffe0144483580 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d2/frame 0xfffffe0144483620 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe0144483660 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe0144483680 null_lock() at null_lock+0xd3/frame 0xfffffe01444836e0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe0144483700 _vn_lock() at _vn_lock+0x54/frame 0xfffffe0144483760 lookup() at lookup+0xc2/frame 0xfffffe0144483800 namei() at namei+0x379/frame 0xfffffe01444838b0 kern_mkdirat() at kern_mkdirat+0x145/frame 0xfffffe0144483ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0144483bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0144483bf0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x8011a7e4a, rsp = 0x7fffffffe208, rbp = 0x7fffffffe350 --- Tracing command dirrename pid 68361 tid 100229 td 0xfffffe010e3be020 sched_switch() at sched_switch+0x5af/frame 0xfffffe01415d9270 mi_switch() at mi_switch+0x155/frame 0xfffffe01415d9290 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01415d92d0 sleeplk() at sleeplk+0x100/frame 0xfffffe01415d9330 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x402/frame 0xfffffe01415d93e0 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe01415d9420 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe01415d9440 _vn_lock() at _vn_lock+0x54/frame 0xfffffe01415d94a0 vn_lock_pair() at vn_lock_pair+0x109/frame 0xfffffe01415d9500 softdep_prelink() at softdep_prelink+0x35e/frame 0xfffffe01415d9550 ufs_mkdir() at ufs_mkdir+0xbe/frame 0xfffffe01415d96f0 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x65/frame 0xfffffe01415d9710 null_bypass() at null_bypass+0x12b/frame 0xfffffe01415d9890 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x65/frame 0xfffffe01415d98b0 kern_mkdirat() at kern_mkdirat+0x1f7/frame 0xfffffe01415d9ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01415d9bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01415d9bf0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x8011a7e4a, rsp = 0x7fffffffe208, rbp = 0x7fffffffe350 --- Tracing command mkdir pid 68362 tid 100428 td 0xfffffe01440f6740 sched_switch() at sched_switch+0x5af/frame 0xfffffe014561d270 mi_switch() at mi_switch+0x155/frame 0xfffffe014561d290 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe014561d2d0 sleeplk() at sleeplk+0x100/frame 0xfffffe014561d330 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x402/frame 0xfffffe014561d3e0 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe014561d420 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe014561d440 _vn_lock() at _vn_lock+0x54/frame 0xfffffe014561d4a0 vn_lock_pair() at vn_lock_pair+0x109/frame 0xfffffe014561d500 softdep_prelink() at softdep_prelink+0x35e/frame 0xfffffe014561d550 ufs_mkdir() at ufs_mkdir+0xbe/frame 0xfffffe014561d6f0 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x65/frame 0xfffffe014561d710 null_bypass() at null_bypass+0x12b/frame 0xfffffe014561d890 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x65/frame 0xfffffe014561d8b0 kern_mkdirat() at kern_mkdirat+0x1f7/frame 0xfffffe014561dac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014561dbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014561dbf0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x8011a7e4a, rsp = 0x7fffffffdaf8, rbp = 0x7fffffffdf30 --- Tracing command fts pid 68363 tid 100527 td 0xfffffe01478a8c80 sched_switch() at sched_switch+0x5af/frame 0xfffffe0147a09230 mi_switch() at mi_switch+0x155/frame 0xfffffe0147a09250 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0147a09290 sleeplk() at sleeplk+0x100/frame 0xfffffe0147a092f0 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d2/frame 0xfffffe0147a09390 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe0147a093d0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe0147a093f0 null_lock() at null_lock+0xd3/frame 0xfffffe0147a09450 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe0147a09470 _vn_lock() at _vn_lock+0x54/frame 0xfffffe0147a094d0 vn_close1() at vn_close1+0xa2/frame 0xfffffe0147a09540 vn_closefile() at vn_closefile+0x4a/frame 0xfffffe0147a095c0 _fdrop() at _fdrop+0x1b/frame 0xfffffe0147a095e0 closef() at closef+0x1db/frame 0xfffffe0147a09670 fdescfree_fds() at fdescfree_fds+0xcc/frame 0xfffffe0147a096c0 fdescfree() at fdescfree+0x35d/frame 0xfffffe0147a09790 exit1() at exit1+0x4ae/frame 0xfffffe0147a09800 sigexit() at sigexit+0x157/frame 0xfffffe0147a09ae0 postsig() at postsig+0x1aa/frame 0xfffffe0147a09bb0 ast() at ast+0x4fb/frame 0xfffffe0147a09bf0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe100 Tracing command symlink pid 68364 tid 100607 td 0xfffffe01499b31e0 sched_switch() at sched_switch+0x5af/frame 0xfffffe0147bba2c0 mi_switch() at mi_switch+0x155/frame 0xfffffe0147bba2e0 __mtx_lock_sleep() at __mtx_lock_sleep+0x1c9/frame 0xfffffe0147bba370 __mtx_lock_flags() at __mtx_lock_flags+0xef/frame 0xfffffe0147bba3c0 __mnt_vnode_next_all() at __mnt_vnode_next_all+0x42/frame 0xfffffe0147bba400 ffs_sync() at ffs_sync+0x174/frame 0xfffffe0147bba4a0 journal_check_space() at journal_check_space+0xe0/frame 0xfffffe0147bba4d0 softdep_prelink() at softdep_prelink+0x2d7/frame 0xfffffe0147bba520 ufs_makeinode() at ufs_makeinode+0xb9/frame 0xfffffe0147bba6b0 ufs_symlink() at ufs_symlink+0x38/frame 0xfffffe0147bba6e0 VOP_SYMLINK_APV() at VOP_SYMLINK_APV+0x65/frame 0xfffffe0147bba700 null_bypass() at null_bypass+0x12b/frame 0xfffffe0147bba880 VOP_SYMLINK_APV() at VOP_SYMLINK_APV+0x65/frame 0xfffffe0147bba8a0 kern_symlinkat() at kern_symlinkat+0x24f/frame 0xfffffe0147bbaac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0147bbabf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0147bbabf0 --- syscall (57, FreeBSD ELF64, sys_symlink), rip = 0x8011a79aa, rsp = 0x7fffffffe2a8, rbp = 0x7fffffffe360 --- Tracing command rename pid 68366 tid 100573 td 0xfffffe0144112720 sched_switch() at sched_switch+0x5af/frame 0xfffffe0147ae91a0 mi_switch() at mi_switch+0x155/frame 0xfffffe0147ae91c0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0147ae9200 sleeplk() at sleeplk+0x100/frame 0xfffffe0147ae9260 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x402/frame 0xfffffe0147ae9310 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe0147ae9350 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe0147ae9370 _vn_lock() at _vn_lock+0x54/frame 0xfffffe0147ae93d0 vn_lock_pair() at vn_lock_pair+0x109/frame 0xfffffe0147ae9430 softdep_prelink() at softdep_prelink+0x35e/frame 0xfffffe0147ae9480 ufs_makeinode() at ufs_makeinode+0xb9/frame 0xfffffe0147ae9610 ufs_create() at ufs_create+0x34/frame 0xfffffe0147ae9630 VOP_CREATE_APV() at VOP_CREATE_APV+0x62/frame 0xfffffe0147ae9650 null_bypass() at null_bypass+0x12b/frame 0xfffffe0147ae97d0 VOP_CREATE_APV() at VOP_CREATE_APV+0x62/frame 0xfffffe0147ae97f0 vn_open_cred() at vn_open_cred+0x2b9/frame 0xfffffe0147ae9960 kern_openat() at kern_openat+0x28c/frame 0xfffffe0147ae9ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0147ae9bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0147ae9bf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8011aa60a, rsp = 0x7fffffffe128, rbp = 0x7fffffffe210 --- Tracing command lockf pid 68367 tid 100318 td 0xfffffe01435b4560 sched_switch() at sched_switch+0x5af/frame 0xfffffe01417f0470 mi_switch() at mi_switch+0x155/frame 0xfffffe01417f0490 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01417f04d0 sleeplk() at sleeplk+0x100/frame 0xfffffe01417f0530 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d2/frame 0xfffffe01417f05d0 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe01417f0610 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe01417f0630 null_lock() at null_lock+0xd3/frame 0xfffffe01417f0690 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe01417f06b0 _vn_lock() at _vn_lock+0x54/frame 0xfffffe01417f0710 lookup() at lookup+0xc2/frame 0xfffffe01417f07b0 namei() at namei+0x379/frame 0xfffffe01417f0860 kern_funlinkat() at kern_funlinkat+0x129/frame 0xfffffe01417f0aa0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe01417f0ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01417f0bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01417f0bf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x8011a758a, rsp = 0x7fffffffe318, rbp = 0x7fffffffe360 --- Tracing command creat pid 68368 tid 100334 td 0xfffffe0143fc3020 sched_switch() at sched_switch+0x5af/frame 0xfffffe014443b110 mi_switch() at mi_switch+0x155/frame 0xfffffe014443b130 ipi_bitmap_handler() at ipi_bitmap_handler+0x87/frame 0xfffffe014443b160 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0xb3/frame 0xfffffe014443b160 --- interrupt, rip = 0xffffffff80c70382, rsp = 0xfffffe014443b230, rbp = 0xfffffe014443b240 --- lock_delay() at lock_delay+0x22/frame 0xfffffe014443b240 __mtx_lock_sleep() at __mtx_lock_sleep+0xe8/frame 0xfffffe014443b2d0 __mtx_lock_flags() at __mtx_lock_flags+0xef/frame 0xfffffe014443b320 __mnt_vnode_next_all() at __mnt_vnode_next_all+0x42/frame 0xfffffe014443b360 ffs_sync() at ffs_sync+0x174/frame 0xfffffe014443b400 journal_check_space() at journal_check_space+0xe0/frame 0xfffffe014443b430 softdep_prelink() at softdep_prelink+0x2d7/frame 0xfffffe014443b480 ufs_makeinode() at ufs_makeinode+0xb9/frame 0xfffffe014443b610 ufs_create() at ufs_create+0x34/frame 0xfffffe014443b630 VOP_CREATE_APV() at VOP_CREATE_APV+0x62/frame 0xfffffe014443b650 null_bypass() at null_bypass+0x12b/frame 0xfffffe014443b7d0 VOP_CREATE_APV() at VOP_CREATE_APV+0x62/frame 0xfffffe014443b7f0 vn_open_cred() at vn_open_cred+0x2b9/frame 0xfffffe014443b960 kern_openat() at kern_openat+0x28c/frame 0xfffffe014443bac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014443bbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014443bbf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8011aa60a, rsp = 0x7fffffffe2a8, rbp = 0x7fffffffe360 --- Tracing command mkdir pid 68369 tid 100289 td 0xfffffe0143dbdc80 sched_switch() at sched_switch+0x5af/frame 0xfffffe014175a560 mi_switch() at mi_switch+0x155/frame 0xfffffe014175a580 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe014175a5c0 sleeplk() at sleeplk+0x100/frame 0xfffffe014175a620 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d2/frame 0xfffffe014175a6c0 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe014175a700 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe014175a720 null_lock() at null_lock+0xd3/frame 0xfffffe014175a780 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe014175a7a0 _vn_lock() at _vn_lock+0x54/frame 0xfffffe014175a800 lookup() at lookup+0xc2/frame 0xfffffe014175a8a0 namei() at namei+0x379/frame 0xfffffe014175a950 kern_frmdirat() at kern_frmdirat+0x15e/frame 0xfffffe014175aac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014175abf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014175abf0 --- syscall (137, FreeBSD ELF64, sys_rmdir), rip = 0x8011a7e6a, rsp = 0x7fffffffdaf8, rbp = 0x7fffffffdf30 --- Tracing command dirnprename pid 68371 tid 100600 td 0xfffffe01499c0c80 (CPU 5) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce54e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce54e10 trap() at trap+0x56/frame 0xfffffe003ce54f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce54f20 --- trap 0x13, rip = 0xffffffff80c70382, rsp = 0xfffffe0147b92300, rbp = 0xfffffe0147b92310 --- lock_delay() at lock_delay+0x22/frame 0xfffffe0147b92310 __mtx_lock_sleep() at __mtx_lock_sleep+0xe8/frame 0xfffffe0147b923a0 __mtx_lock_flags() at __mtx_lock_flags+0xef/frame 0xfffffe0147b923f0 __mnt_vnode_next_all() at __mnt_vnode_next_all+0x42/frame 0xfffffe0147b92430 ffs_sync() at ffs_sync+0x174/frame 0xfffffe0147b924d0 journal_check_space() at journal_check_space+0xe0/frame 0xfffffe0147b92500 softdep_prelink() at softdep_prelink+0x2d7/frame 0xfffffe0147b92550 ufs_mkdir() at ufs_mkdir+0xbe/frame 0xfffffe0147b926f0 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x65/frame 0xfffffe0147b92710 null_bypass() at null_bypass+0x12b/frame 0xfffffe0147b92890 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x65/frame 0xfffffe0147b928b0 kern_mkdirat() at kern_mkdirat+0x1f7/frame 0xfffffe0147b92ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0147b92bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0147b92bf0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x8011a7e4a, rsp = 0x7fffffffe208, rbp = 0x7fffffffe350 --- Tracing command mkdir pid 68372 tid 100452 td 0xfffffe01440cd560 sched_switch() at sched_switch+0x5af/frame 0xfffffe01445b9580 mi_switch() at mi_switch+0x155/frame 0xfffffe01445b95a0 kern_yield() at kern_yield+0x71/frame 0xfffffe01445b95e0 __mnt_vnode_next_all() at __mnt_vnode_next_all+0x27/frame 0xfffffe01445b9620 ffs_sync() at ffs_sync+0x174/frame 0xfffffe01445b96c0 journal_check_space() at journal_check_space+0xe0/frame 0xfffffe01445b96f0 softdep_prelink() at softdep_prelink+0x2d7/frame 0xfffffe01445b9740 ufs_rmdir() at ufs_rmdir+0xef/frame 0xfffffe01445b9790 VOP_RMDIR_APV() at VOP_RMDIR_APV+0x85/frame 0xfffffe01445b97b0 null_bypass() at null_bypass+0x12b/frame 0xfffffe01445b9930 VOP_RMDIR_APV() at VOP_RMDIR_APV+0x85/frame 0xfffffe01445b9950 kern_frmdirat() at kern_frmdirat+0x39a/frame 0xfffffe01445b9ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01445b9bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01445b9bf0 --- syscall (137, FreeBSD ELF64, sys_rmdir), rip = 0x8011a7e6a, rsp = 0x7fffffffdaf8, rbp = 0x7fffffffdf30 --- Tracing command creat pid 68373 tid 100535 td 0xfffffe0144128900 sched_switch() at sched_switch+0x5af/frame 0xfffffe0147a40110 mi_switch() at mi_switch+0x155/frame 0xfffffe0147a40130 ipi_bitmap_handler() at ipi_bitmap_handler+0x87/frame 0xfffffe0147a40160 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0xb3/frame 0xfffffe0147a40160 --- interrupt, rip = 0xffffffff80c70380, rsp = 0xfffffe0147a40230, rbp = 0xfffffe0147a40240 --- lock_delay() at lock_delay+0x20/frame 0xfffffe0147a40240 __mtx_lock_sleep() at __mtx_lock_sleep+0xe8/frame 0xfffffe0147a402d0 __mtx_lock_flags() at __mtx_lock_flags+0xef/frame 0xfffffe0147a40320 __mnt_vnode_next_all() at __mnt_vnode_next_all+0x42/frame 0xfffffe0147a40360 ffs_sync() at ffs_sync+0x174/frame 0xfffffe0147a40400 journal_check_space() at journal_check_space+0xe0/frame 0xfffffe0147a40430 softdep_prelink() at softdep_prelink+0x2d7/frame 0xfffffe0147a40480 ufs_makeinode() at ufs_makeinode+0xb9/frame 0xfffffe0147a40610 ufs_create() at ufs_create+0x34/frame 0xfffffe0147a40630 VOP_CREATE_APV() at VOP_CREATE_APV+0x62/frame 0xfffffe0147a40650 null_bypass() at null_bypass+0x12b/frame 0xfffffe0147a407d0 VOP_CREATE_APV() at VOP_CREATE_APV+0x62/frame 0xfffffe0147a407f0 vn_open_cred() at vn_open_cred+0x2b9/frame 0xfffffe0147a40960 kern_openat() at kern_openat+0x28c/frame 0xfffffe0147a40ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0147a40bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0147a40bf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8011aa60a, rsp = 0x7fffffffe2a8, rbp = 0x7fffffffe360 --- Tracing command dirrename pid 68375 tid 100227 td 0xfffffe010d9de900 sched_switch() at sched_switch+0x5af/frame 0xfffffe01415e8270 mi_switch() at mi_switch+0x155/frame 0xfffffe01415e8290 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01415e82d0 sleeplk() at sleeplk+0x100/frame 0xfffffe01415e8330 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x402/frame 0xfffffe01415e83e0 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe01415e8420 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe01415e8440 _vn_lock() at _vn_lock+0x54/frame 0xfffffe01415e84a0 vn_lock_pair() at vn_lock_pair+0x109/frame 0xfffffe01415e8500 softdep_prelink() at softdep_prelink+0x35e/frame 0xfffffe01415e8550 ufs_mkdir() at ufs_mkdir+0xbe/frame 0xfffffe01415e86f0 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x65/frame 0xfffffe01415e8710 null_bypass() at null_bypass+0x12b/frame 0xfffffe01415e8890 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x65/frame 0xfffffe01415e88b0 kern_mkdirat() at kern_mkdirat+0x1f7/frame 0xfffffe01415e8ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01415e8bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01415e8bf0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x8011a7e4a, rsp = 0x7fffffffe208, rbp = 0x7fffffffe350 --- Tracing command mkfifo pid 68376 tid 100545 td 0xfffffe0145906720 (CPU 10) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce95e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce95e10 trap() at trap+0x56/frame 0xfffffe003ce95f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce95f20 --- trap 0x13, rip = 0xffffffff80c70380, rsp = 0xfffffe0147a6f3c0, rbp = 0xfffffe0147a6f3d0 --- lock_delay() at lock_delay+0x20/frame 0xfffffe0147a6f3d0 __mtx_lock_sleep() at __mtx_lock_sleep+0xe8/frame 0xfffffe0147a6f460 __mtx_lock_flags() at __mtx_lock_flags+0xef/frame 0xfffffe0147a6f4b0 __mnt_vnode_next_all() at __mnt_vnode_next_all+0x42/frame 0xfffffe0147a6f4f0 ffs_sync() at ffs_sync+0x174/frame 0xfffffe0147a6f590 journal_check_space() at journal_check_space+0xe0/frame 0xfffffe0147a6f5c0 softdep_prelink() at softdep_prelink+0x2d7/frame 0xfffffe0147a6f610 ufs_remove() at ufs_remove+0x8b/frame 0xfffffe0147a6f670 VOP_REMOVE_APV() at VOP_REMOVE_APV+0x85/frame 0xfffffe0147a6f690 null_bypass() at null_bypass+0x12b/frame 0xfffffe0147a6f810 null_remove() at null_remove+0x4e/frame 0xfffffe0147a6f840 VOP_REMOVE_APV() at VOP_REMOVE_APV+0x85/frame 0xfffffe0147a6f860 kern_funlinkat() at kern_funlinkat+0x32a/frame 0xfffffe0147a6faa0 sys_unlink() at sys_unlink+0x28/frame 0xfffffe0147a6fac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0147a6fbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0147a6fbf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x8011bf58a, rsp = 0x7fffffffe318, rbp = 0x7fffffffe360 --- Tracing command fts pid 68377 tid 100506 td 0xfffffe010e597c80 sched_switch() at sched_switch+0x5af/frame 0xfffffe01457a8480 mi_switch() at mi_switch+0x155/frame 0xfffffe01457a84a0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01457a84e0 sleeplk() at sleeplk+0x100/frame 0xfffffe01457a8540 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d2/frame 0xfffffe01457a85e0 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe01457a8620 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe01457a8640 null_lock() at null_lock+0xd3/frame 0xfffffe01457a86a0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe01457a86c0 _vn_lock() at _vn_lock+0x54/frame 0xfffffe01457a8720 lookup() at lookup+0xc2/frame 0xfffffe01457a87c0 namei() at namei+0x379/frame 0xfffffe01457a8870 kern_statat() at kern_statat+0x12d/frame 0xfffffe01457a89c0 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe01457a8ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01457a8bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01457a8bf0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x8011a93aa, rsp = 0x7fffffffe048, rbp = 0x7fffffffe100 --- Tracing command rename pid 68378 tid 100270 td 0xfffffe014355e560 sched_switch() at sched_switch+0x5af/frame 0xfffffe01416c5650 mi_switch() at mi_switch+0x155/frame 0xfffffe01416c5670 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01416c56b0 _sx_xlock_hard() at _sx_xlock_hard+0x421/frame 0xfffffe01416c5750 _sx_xlock() at _sx_xlock+0xbb/frame 0xfffffe01416c5790 exit1() at exit1+0x655/frame 0xfffffe01416c5800 sigexit() at sigexit+0x157/frame 0xfffffe01416c5ae0 postsig() at postsig+0x1aa/frame 0xfffffe01416c5bb0 ast() at ast+0x4fb/frame 0xfffffe01416c5bf0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe210 Tracing command mkdir pid 68379 tid 100424 td 0xfffffe01440f4ac0 sched_switch() at sched_switch+0x5af/frame 0xfffffe01456094c0 mi_switch() at mi_switch+0x155/frame 0xfffffe01456094e0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0145609520 sleeplk() at sleeplk+0x100/frame 0xfffffe0145609580 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d2/frame 0xfffffe0145609620 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe0145609660 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe0145609680 null_lock() at null_lock+0xd3/frame 0xfffffe01456096e0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe0145609700 _vn_lock() at _vn_lock+0x54/frame 0xfffffe0145609760 lookup() at lookup+0xc2/frame 0xfffffe0145609800 namei() at namei+0x379/frame 0xfffffe01456098b0 kern_mkdirat() at kern_mkdirat+0x145/frame 0xfffffe0145609ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0145609bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0145609bf0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x8011a7e4a, rsp = 0x7fffffffdaf8, rbp = 0x7fffffffdf30 --- Tracing command creat pid 68380 tid 100517 td 0xfffffe01478aa1e0 (CPU 4) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce47e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce47e10 trap() at trap+0x56/frame 0xfffffe003ce47f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce47f20 --- trap 0x13, rip = 0xffffffff80c70380, rsp = 0xfffffe01457e4230, rbp = 0xfffffe01457e4240 --- lock_delay() at lock_delay+0x20/frame 0xfffffe01457e4240 __mtx_lock_sleep() at __mtx_lock_sleep+0xe8/frame 0xfffffe01457e42d0 __mtx_lock_flags() at __mtx_lock_flags+0xef/frame 0xfffffe01457e4320 __mnt_vnode_next_all() at __mnt_vnode_next_all+0x42/frame 0xfffffe01457e4360 ffs_sync() at ffs_sync+0x174/frame 0xfffffe01457e4400 journal_check_space() at journal_check_space+0xe0/frame 0xfffffe01457e4430 softdep_prelink() at softdep_prelink+0x2d7/frame 0xfffffe01457e4480 ufs_makeinode() at ufs_makeinode+0xb9/frame 0xfffffe01457e4610 ufs_create() at ufs_create+0x34/frame 0xfffffe01457e4630 VOP_CREATE_APV() at VOP_CREATE_APV+0x62/frame 0xfffffe01457e4650 null_bypass() at null_bypass+0x12b/frame 0xfffffe01457e47d0 VOP_CREATE_APV() at VOP_CREATE_APV+0x62/frame 0xfffffe01457e47f0 vn_open_cred() at vn_open_cred+0x2b9/frame 0xfffffe01457e4960 kern_openat() at kern_openat+0x28c/frame 0xfffffe01457e4ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01457e4bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01457e4bf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8011aa60a, rsp = 0x7fffffffe2a8, rbp = 0x7fffffffe360 --- Tracing command dirrename pid 68382 tid 100466 td 0xfffffe0145a3c1e0 sched_switch() at sched_switch+0x5af/frame 0xfffffe01456c7390 mi_switch() at mi_switch+0x155/frame 0xfffffe01456c73b0 kern_yield() at kern_yield+0x71/frame 0xfffffe01456c73f0 __mnt_vnode_next_all() at __mnt_vnode_next_all+0x27/frame 0xfffffe01456c7430 ffs_sync() at ffs_sync+0x174/frame 0xfffffe01456c74d0 journal_check_space() at journal_check_space+0xe0/frame 0xfffffe01456c7500 softdep_prelink() at softdep_prelink+0x2d7/frame 0xfffffe01456c7550 ufs_mkdir() at ufs_mkdir+0xbe/frame 0xfffffe01456c76f0 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x65/frame 0xfffffe01456c7710 null_bypass() at null_bypass+0x12b/frame 0xfffffe01456c7890 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x65/frame 0xfffffe01456c78b0 kern_mkdirat() at kern_mkdirat+0x1f7/frame 0xfffffe01456c7ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01456c7bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01456c7bf0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x8011a7e4a, rsp = 0x7fffffffe208, rbp = 0x7fffffffe350 --- Tracing command mkfifo pid 68383 tid 100447 td 0xfffffe01440f2000 sched_switch() at sched_switch+0x5af/frame 0xfffffe0145677250 mi_switch() at mi_switch+0x155/frame 0xfffffe0145677270 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01456772b0 sleeplk() at sleeplk+0x100/frame 0xfffffe0145677310 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x402/frame 0xfffffe01456773c0 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe0145677400 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe0145677420 _vn_lock() at _vn_lock+0x54/frame 0xfffffe0145677480 vn_lock_pair() at vn_lock_pair+0x109/frame 0xfffffe01456774e0 softdep_prelink() at softdep_prelink+0x35e/frame 0xfffffe0145677530 ufs_makeinode() at ufs_makeinode+0xb9/frame 0xfffffe01456776c0 ufs_mknod() at ufs_mknod+0x3c/frame 0xfffffe01456776f0 VOP_MKNOD_APV() at VOP_MKNOD_APV+0x62/frame 0xfffffe0145677710 null_bypass() at null_bypass+0x12b/frame 0xfffffe0145677890 VOP_MKNOD_APV() at VOP_MKNOD_APV+0x62/frame 0xfffffe01456778b0 kern_mkfifoat() at kern_mkfifoat+0x205/frame 0xfffffe0145677ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0145677bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0145677bf0 --- syscall (132, FreeBSD ELF64, sys_mkfifo), rip = 0x8011bfdea, rsp = 0x7fffffffe318, rbp = 0x7fffffffe360 --- Tracing command mkdir pid 68385 tid 100549 td 0xfffffe01478b2720 sched_switch() at sched_switch+0x5af/frame 0xfffffe0147a83560 mi_switch() at mi_switch+0x155/frame 0xfffffe0147a83580 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0147a835c0 sleeplk() at sleeplk+0x100/frame 0xfffffe0147a83620 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d2/frame 0xfffffe0147a836c0 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe0147a83700 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe0147a83720 null_lock() at null_lock+0xd3/frame 0xfffffe0147a83780 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe0147a837a0 _vn_lock() at _vn_lock+0x54/frame 0xfffffe0147a83800 lookup() at lookup+0xc2/frame 0xfffffe0147a838a0 namei() at namei+0x379/frame 0xfffffe0147a83950 kern_frmdirat() at kern_frmdirat+0x15e/frame 0xfffffe0147a83ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0147a83bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0147a83bf0 --- syscall (137, FreeBSD ELF64, sys_rmdir), rip = 0x8011a7e6a, rsp = 0x7fffffffdaf8, rbp = 0x7fffffffdf30 --- Tracing command rename pid 68386 tid 100534 td 0xfffffe01478b93a0 sched_switch() at sched_switch+0x5af/frame 0xfffffe0147a30ed0 mi_switch() at mi_switch+0x155/frame 0xfffffe0147a30ef0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0147a30f30 sleeplk() at sleeplk+0x100/frame 0xfffffe0147a30f90 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x402/frame 0xfffffe0147a31040 __lockmgr_args() at __lockmgr_args+0x1fe/frame 0xfffffe0147a310e0 getblkx() at getblkx+0x1bb/frame 0xfffffe0147a311a0 breadn_flags() at breadn_flags+0x44/frame 0xfffffe0147a31210 ffs_breadz() at ffs_breadz+0x5a/frame 0xfffffe0147a31290 ffs_update() at ffs_update+0x136/frame 0xfffffe0147a31320 handle_workitem_remove() at handle_workitem_remove+0x4a9/frame 0xfffffe0147a313a0 process_worklist_item() at process_worklist_item+0x2bd/frame 0xfffffe0147a31430 softdep_prelink() at softdep_prelink+0x2cf/frame 0xfffffe0147a31480 ufs_makeinode() at ufs_makeinode+0xb9/frame 0xfffffe0147a31610 ufs_create() at ufs_create+0x34/frame 0xfffffe0147a31630 VOP_CREATE_APV() at VOP_CREATE_APV+0x62/frame 0xfffffe0147a31650 null_bypass() at null_bypass+0x12b/frame 0xfffffe0147a317d0 VOP_CREATE_APV() at VOP_CREATE_APV+0x62/frame 0xfffffe0147a317f0 vn_open_cred() at vn_open_cred+0x2b9/frame 0xfffffe0147a31960 kern_openat() at kern_openat+0x28c/frame 0xfffffe0147a31ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0147a31bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0147a31bf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8011aa60a, rsp = 0x7fffffffe128, rbp = 0x7fffffffe210 --- Tracing command creat pid 68387 tid 100472 td 0xfffffe0145a3ac80 sched_switch() at sched_switch+0x5af/frame 0xfffffe01456fe2c0 mi_switch() at mi_switch+0x155/frame 0xfffffe01456fe2e0 kern_yield() at kern_yield+0x71/frame 0xfffffe01456fe320 __mnt_vnode_next_all() at __mnt_vnode_next_all+0x27/frame 0xfffffe01456fe360 ffs_sync() at ffs_sync+0x174/frame 0xfffffe01456fe400 journal_check_space() at journal_check_space+0xe0/frame 0xfffffe01456fe430 softdep_prelink() at softdep_prelink+0x2d7/frame 0xfffffe01456fe480 ufs_makeinode() at ufs_makeinode+0xb9/frame 0xfffffe01456fe610 ufs_create() at ufs_create+0x34/frame 0xfffffe01456fe630 VOP_CREATE_APV() at VOP_CREATE_APV+0x62/frame 0xfffffe01456fe650 null_bypass() at null_bypass+0x12b/frame 0xfffffe01456fe7d0 VOP_CREATE_APV() at VOP_CREATE_APV+0x62/frame 0xfffffe01456fe7f0 vn_open_cred() at vn_open_cred+0x2b9/frame 0xfffffe01456fe960 kern_openat() at kern_openat+0x28c/frame 0xfffffe01456feac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01456febf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01456febf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8011aa60a, rsp = 0x7fffffffe2a8, rbp = 0x7fffffffe360 --- Tracing command dirrename pid 68388 tid 100537 td 0xfffffe01478bb020 (CPU 11) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003cea2e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003cea2e10 trap() at trap+0x56/frame 0xfffffe003cea2f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003cea2f20 --- trap 0x13, rip = 0xffffffff80c70382, rsp = 0xfffffe0147a56300, rbp = 0xfffffe0147a56310 --- lock_delay() at lock_delay+0x22/frame 0xfffffe0147a56310 __mtx_lock_sleep() at __mtx_lock_sleep+0xe8/frame 0xfffffe0147a563a0 __mtx_lock_flags() at __mtx_lock_flags+0xef/frame 0xfffffe0147a563f0 __mnt_vnode_next_all() at __mnt_vnode_next_all+0x42/frame 0xfffffe0147a56430 ffs_sync() at ffs_sync+0x174/frame 0xfffffe0147a564d0 journal_check_space() at journal_check_space+0xe0/frame 0xfffffe0147a56500 softdep_prelink() at softdep_prelink+0x2d7/frame 0xfffffe0147a56550 ufs_mkdir() at ufs_mkdir+0xbe/frame 0xfffffe0147a566f0 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x65/frame 0xfffffe0147a56710 null_bypass() at null_bypass+0x12b/frame 0xfffffe0147a56890 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x65/frame 0xfffffe0147a568b0 kern_mkdirat() at kern_mkdirat+0x1f7/frame 0xfffffe0147a56ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0147a56bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0147a56bf0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x8011a7e4a, rsp = 0x7fffffffe208, rbp = 0x7fffffffe350 --- Tracing command lockf pid 68390 tid 100608 td 0xfffffe01499b2ac0 sched_switch() at sched_switch+0x5af/frame 0xfffffe0147bb5400 mi_switch() at mi_switch+0x155/frame 0xfffffe0147bb5420 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0147bb5460 sleeplk() at sleeplk+0x100/frame 0xfffffe0147bb54c0 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d2/frame 0xfffffe0147bb5560 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe0147bb55a0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe0147bb55c0 null_lock() at null_lock+0xd3/frame 0xfffffe0147bb5620 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe0147bb5640 _vn_lock() at _vn_lock+0x54/frame 0xfffffe0147bb56a0 lookup() at lookup+0xc2/frame 0xfffffe0147bb5740 namei() at namei+0x379/frame 0xfffffe0147bb57f0 vn_open_cred() at vn_open_cred+0x11e/frame 0xfffffe0147bb5960 kern_openat() at kern_openat+0x28c/frame 0xfffffe0147bb5ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0147bb5bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0147bb5bf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8011aa60a, rsp = 0x7fffffffe228, rbp = 0x7fffffffe310 --- Tracing command rename pid 68392 tid 100416 td 0xfffffe01440de560 sched_switch() at sched_switch+0x5af/frame 0xfffffe01445e1400 mi_switch() at mi_switch+0x155/frame 0xfffffe01445e1420 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01445e1460 sleeplk() at sleeplk+0x100/frame 0xfffffe01445e14c0 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d2/frame 0xfffffe01445e1560 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe01445e15a0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe01445e15c0 null_lock() at null_lock+0xd3/frame 0xfffffe01445e1620 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe01445e1640 _vn_lock() at _vn_lock+0x54/frame 0xfffffe01445e16a0 lookup() at lookup+0xc2/frame 0xfffffe01445e1740 namei() at namei+0x379/frame 0xfffffe01445e17f0 vn_open_cred() at vn_open_cred+0x11e/frame 0xfffffe01445e1960 kern_openat() at kern_openat+0x28c/frame 0xfffffe01445e1ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01445e1bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01445e1bf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8011aa60a, rsp = 0x7fffffffe128, rbp = 0x7fffffffe210 --- Tracing command mkdir pid 68393 tid 100554 td 0xfffffe014403b020 sched_switch() at sched_switch+0x5af/frame 0xfffffe0147aa8460 mi_switch() at mi_switch+0x155/frame 0xfffffe0147aa8480 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0147aa84c0 sleeplk() at sleeplk+0x100/frame 0xfffffe0147aa8520 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x402/frame 0xfffffe0147aa85d0 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe0147aa8610 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe0147aa8630 _vn_lock() at _vn_lock+0x54/frame 0xfffffe0147aa8690 vget_finish() at vget_finish+0x7a/frame 0xfffffe0147aa86c0 cache_lookup_dotdot() at cache_lookup_dotdot+0x1f5/frame 0xfffffe0147aa8730 vfs_cache_lookup() at vfs_cache_lookup+0x7b/frame 0xfffffe0147aa8780 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x5a/frame 0xfffffe0147aa87a0 null_lookup() at null_lookup+0xe9/frame 0xfffffe0147aa8820 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x5a/frame 0xfffffe0147aa8840 lookup() at lookup+0x4d1/frame 0xfffffe0147aa88e0 namei() at namei+0x379/frame 0xfffffe0147aa8990 kern_chdir() at kern_chdir+0xc9/frame 0xfffffe0147aa8ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0147aa8bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0147aa8bf0 --- syscall (12, FreeBSD ELF64, sys_chdir), rip = 0x8011a75aa, rsp = 0x7fffffffdaf8, rbp = 0x7fffffffdf30 --- Tracing command creat pid 68394 tid 100426 td 0xfffffe0143f5d020 sched_switch() at sched_switch+0x5af/frame 0xfffffe01417ff220 mi_switch() at mi_switch+0x155/frame 0xfffffe01417ff240 __mtx_lock_sleep() at __mtx_lock_sleep+0x1c9/frame 0xfffffe01417ff2d0 __mtx_lock_flags() at __mtx_lock_flags+0xef/frame 0xfffffe01417ff320 __mnt_vnode_next_all() at __mnt_vnode_next_all+0x42/frame 0xfffffe01417ff360 ffs_sync() at ffs_sync+0x174/frame 0xfffffe01417ff400 journal_check_space() at journal_check_space+0xe0/frame 0xfffffe01417ff430 softdep_prelink() at softdep_prelink+0x2d7/frame 0xfffffe01417ff480 ufs_makeinode() at ufs_makeinode+0xb9/frame 0xfffffe01417ff610 ufs_create() at ufs_create+0x34/frame 0xfffffe01417ff630 VOP_CREATE_APV() at VOP_CREATE_APV+0x62/frame 0xfffffe01417ff650 null_bypass() at null_bypass+0x12b/frame 0xfffffe01417ff7d0 VOP_CREATE_APV() at VOP_CREATE_APV+0x62/frame 0xfffffe01417ff7f0 vn_open_cred() at vn_open_cred+0x2b9/frame 0xfffffe01417ff960 kern_openat() at kern_openat+0x28c/frame 0xfffffe01417ffac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01417ffbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01417ffbf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8011aa60a, rsp = 0x7fffffffe2a8, rbp = 0x7fffffffe360 --- Tracing command dirrename pid 68395 tid 100397 td 0xfffffe01440ab720 sched_switch() at sched_switch+0x5af/frame 0xfffffe014458c4b0 mi_switch() at mi_switch+0x155/frame 0xfffffe014458c4d0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe014458c510 sleeplk() at sleeplk+0x100/frame 0xfffffe014458c570 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x402/frame 0xfffffe014458c620 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe014458c660 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe014458c680 null_lock() at null_lock+0xd3/frame 0xfffffe014458c6e0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe014458c700 _vn_lock() at _vn_lock+0x54/frame 0xfffffe014458c760 lookup() at lookup+0x3dc/frame 0xfffffe014458c800 namei() at namei+0x379/frame 0xfffffe014458c8b0 kern_mkdirat() at kern_mkdirat+0x145/frame 0xfffffe014458cac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014458cbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014458cbf0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x8011a7e4a, rsp = 0x7fffffffe208, rbp = 0x7fffffffe350 --- Tracing command sh pid 2859 tid 100315 td 0xfffffe010e579720 --- swapped out Tracing command mkfifo pid 68396 tid 100556 td 0xfffffe01478a7e40 thread_exit() at thread_exit+0x203/frame 0xfffffe0147a1da40 exit1() at exit1+0xdde/frame 0xfffffe0147a1dab0 sys_sys_exit() at sys_sys_exit+0xd/frame 0xfffffe0147a1dac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0147a1dbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0147a1dbf0 --- syscall (1, FreeBSD ELF64, sys_sys_exit), rip = 0x8011c230a, rsp = 0x7fffffffdd58, rbp = 0x7fffffffdd60 --- Tracing command creat pid 68398 tid 100238 td 0xfffffe010e598ac0 sched_switch() at sched_switch+0x5af/frame 0xfffffe0141624220 mi_switch() at mi_switch+0x155/frame 0xfffffe0141624240 __mtx_lock_sleep() at __mtx_lock_sleep+0x1c9/frame 0xfffffe01416242d0 __mtx_lock_flags() at __mtx_lock_flags+0xef/frame 0xfffffe0141624320 __mnt_vnode_next_all() at __mnt_vnode_next_all+0x42/frame 0xfffffe0141624360 ffs_sync() at ffs_sync+0x174/frame 0xfffffe0141624400 journal_check_space() at journal_check_space+0xe0/frame 0xfffffe0141624430 softdep_prelink() at softdep_prelink+0x2d7/frame 0xfffffe0141624480 ufs_makeinode() at ufs_makeinode+0xb9/frame 0xfffffe0141624610 ufs_create() at ufs_create+0x34/frame 0xfffffe0141624630 VOP_CREATE_APV() at VOP_CREATE_APV+0x62/frame 0xfffffe0141624650 null_bypass() at null_bypass+0x12b/frame 0xfffffe01416247d0 VOP_CREATE_APV() at VOP_CREATE_APV+0x62/frame 0xfffffe01416247f0 vn_open_cred() at vn_open_cred+0x2b9/frame 0xfffffe0141624960 kern_openat() at kern_openat+0x28c/frame 0xfffffe0141624ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0141624bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141624bf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8011aa60a, rsp = 0x7fffffffe2a8, rbp = 0x7fffffffe360 --- Tracing command mkfifo pid 68399 tid 100367 td 0xfffffe010e5ac000 sched_switch() at sched_switch+0x5af/frame 0xfffffe01444fb650 mi_switch() at mi_switch+0x155/frame 0xfffffe01444fb670 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01444fb6b0 _sx_xlock_hard() at _sx_xlock_hard+0x421/frame 0xfffffe01444fb750 _sx_xlock() at _sx_xlock+0xbb/frame 0xfffffe01444fb790 exit1() at exit1+0x655/frame 0xfffffe01444fb800 sigexit() at sigexit+0x157/frame 0xfffffe01444fbae0 postsig() at postsig+0x1aa/frame 0xfffffe01444fbbb0 ast() at ast+0x4fb/frame 0xfffffe01444fbbf0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe360 Tracing command dirrename pid 68400 tid 100485 td 0xfffffe0143e83c80 sched_switch() at sched_switch+0x5af/frame 0xfffffe0141791270 mi_switch() at mi_switch+0x155/frame 0xfffffe0141791290 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01417912d0 sleeplk() at sleeplk+0x100/frame 0xfffffe0141791330 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x402/frame 0xfffffe01417913e0 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe0141791420 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe0141791440 _vn_lock() at _vn_lock+0x54/frame 0xfffffe01417914a0 vn_lock_pair() at vn_lock_pair+0x109/frame 0xfffffe0141791500 softdep_prelink() at softdep_prelink+0x35e/frame 0xfffffe0141791550 ufs_mkdir() at ufs_mkdir+0xbe/frame 0xfffffe01417916f0 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x65/frame 0xfffffe0141791710 null_bypass() at null_bypass+0x12b/frame 0xfffffe0141791890 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x65/frame 0xfffffe01417918b0 kern_mkdirat() at kern_mkdirat+0x1f7/frame 0xfffffe0141791ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0141791bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141791bf0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x8011a7e4a, rsp = 0x7fffffffe208, rbp = 0x7fffffffe350 --- Tracing command creat pid 68401 tid 100498 td 0xfffffe014747f020 sched_switch() at sched_switch+0x5af/frame 0xfffffe0145771220 mi_switch() at mi_switch+0x155/frame 0xfffffe0145771240 __mtx_lock_sleep() at __mtx_lock_sleep+0x1c9/frame 0xfffffe01457712d0 __mtx_lock_flags() at __mtx_lock_flags+0xef/frame 0xfffffe0145771320 __mnt_vnode_next_all() at __mnt_vnode_next_all+0x42/frame 0xfffffe0145771360 ffs_sync() at ffs_sync+0x174/frame 0xfffffe0145771400 journal_check_space() at journal_check_space+0xe0/frame 0xfffffe0145771430 softdep_prelink() at softdep_prelink+0x2d7/frame 0xfffffe0145771480 ufs_makeinode() at ufs_makeinode+0xb9/frame 0xfffffe0145771610 ufs_create() at ufs_create+0x34/frame 0xfffffe0145771630 VOP_CREATE_APV() at VOP_CREATE_APV+0x62/frame 0xfffffe0145771650 null_bypass() at null_bypass+0x12b/frame 0xfffffe01457717d0 VOP_CREATE_APV() at VOP_CREATE_APV+0x62/frame 0xfffffe01457717f0 vn_open_cred() at vn_open_cred+0x2b9/frame 0xfffffe0145771960 kern_openat() at kern_openat+0x28c/frame 0xfffffe0145771ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0145771bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0145771bf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8011aa60a, rsp = 0x7fffffffe2a8, rbp = 0x7fffffffe360 --- Tracing command mkfifo pid 68403 tid 100390 td 0xfffffe014409a020 sched_switch() at sched_switch+0x5af/frame 0xfffffe014455f4c0 mi_switch() at mi_switch+0x155/frame 0xfffffe014455f4e0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe014455f520 sleeplk() at sleeplk+0x100/frame 0xfffffe014455f580 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d2/frame 0xfffffe014455f620 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe014455f660 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe014455f680 null_lock() at null_lock+0xd3/frame 0xfffffe014455f6e0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe014455f700 _vn_lock() at _vn_lock+0x54/frame 0xfffffe014455f760 lookup() at lookup+0xc2/frame 0xfffffe014455f800 namei() at namei+0x379/frame 0xfffffe014455f8b0 kern_mkfifoat() at kern_mkfifoat+0x145/frame 0xfffffe014455fac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014455fbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014455fbf0 --- syscall (132, FreeBSD ELF64, sys_mkfifo), rip = 0x8011bfdea, rsp = 0x7fffffffe318, rbp = 0x7fffffffe360 --- Tracing command dirrename pid 68404 tid 100350 td 0xfffffe014407c3a0 sched_switch() at sched_switch+0x5af/frame 0xfffffe01444a6270 mi_switch() at mi_switch+0x155/frame 0xfffffe01444a6290 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01444a62d0 sleeplk() at sleeplk+0x100/frame 0xfffffe01444a6330 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x402/frame 0xfffffe01444a63e0 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe01444a6420 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe01444a6440 _vn_lock() at _vn_lock+0x54/frame 0xfffffe01444a64a0 vn_lock_pair() at vn_lock_pair+0x109/frame 0xfffffe01444a6500 softdep_prelink() at softdep_prelink+0x35e/frame 0xfffffe01444a6550 ufs_mkdir() at ufs_mkdir+0xbe/frame 0xfffffe01444a66f0 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x65/frame 0xfffffe01444a6710 null_bypass() at null_bypass+0x12b/frame 0xfffffe01444a6890 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x65/frame 0xfffffe01444a68b0 kern_mkdirat() at kern_mkdirat+0x1f7/frame 0xfffffe01444a6ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01444a6bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01444a6bf0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x8011a7e4a, rsp = 0x7fffffffe208, rbp = 0x7fffffffe350 --- Tracing command creat pid 68405 tid 100301 td 0xfffffe01435b53a0 sched_switch() at sched_switch+0x5af/frame 0xfffffe014178c2c0 mi_switch() at mi_switch+0x155/frame 0xfffffe014178c2e0 kern_yield() at kern_yield+0x71/frame 0xfffffe014178c320 __mnt_vnode_next_all() at __mnt_vnode_next_all+0x27/frame 0xfffffe014178c360 ffs_sync() at ffs_sync+0x174/frame 0xfffffe014178c400 journal_check_space() at journal_check_space+0xe0/frame 0xfffffe014178c430 softdep_prelink() at softdep_prelink+0x2d7/frame 0xfffffe014178c480 ufs_makeinode() at ufs_makeinode+0xb9/frame 0xfffffe014178c610 ufs_create() at ufs_create+0x34/frame 0xfffffe014178c630 VOP_CREATE_APV() at VOP_CREATE_APV+0x62/frame 0xfffffe014178c650 null_bypass() at null_bypass+0x12b/frame 0xfffffe014178c7d0 VOP_CREATE_APV() at VOP_CREATE_APV+0x62/frame 0xfffffe014178c7f0 vn_open_cred() at vn_open_cred+0x2b9/frame 0xfffffe014178c960 kern_openat() at kern_openat+0x28c/frame 0xfffffe014178cac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014178cbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014178cbf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8011aa60a, rsp = 0x7fffffffe2a8, rbp = 0x7fffffffe360 --- Tracing command mkfifo pid 68406 tid 100555 td 0xfffffe014403a900 sched_switch() at sched_switch+0x5af/frame 0xfffffe0147aa34c0 mi_switch() at mi_switch+0x155/frame 0xfffffe0147aa34e0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0147aa3520 sleeplk() at sleeplk+0x100/frame 0xfffffe0147aa3580 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d2/frame 0xfffffe0147aa3620 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe0147aa3660 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe0147aa3680 null_lock() at null_lock+0xd3/frame 0xfffffe0147aa36e0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe0147aa3700 _vn_lock() at _vn_lock+0x54/frame 0xfffffe0147aa3760 lookup() at lookup+0xc2/frame 0xfffffe0147aa3800 namei() at namei+0x379/frame 0xfffffe0147aa38b0 kern_mkfifoat() at kern_mkfifoat+0x145/frame 0xfffffe0147aa3ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0147aa3bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0147aa3bf0 --- syscall (132, FreeBSD ELF64, sys_mkfifo), rip = 0x8011bfdea, rsp = 0x7fffffffe318, rbp = 0x7fffffffe360 --- Tracing command dirrename pid 68407 tid 100544 td 0xfffffe0145906e40 (CPU 7) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce6ee00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce6ee10 trap() at trap+0x56/frame 0xfffffe003ce6ef20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce6ef20 --- trap 0x13, rip = 0xffffffff80c70382, rsp = 0xfffffe0147a74300, rbp = 0xfffffe0147a74310 --- lock_delay() at lock_delay+0x22/frame 0xfffffe0147a74310 __mtx_lock_sleep() at __mtx_lock_sleep+0xe8/frame 0xfffffe0147a743a0 __mtx_lock_flags() at __mtx_lock_flags+0xef/frame 0xfffffe0147a743f0 __mnt_vnode_next_all() at __mnt_vnode_next_all+0x42/frame 0xfffffe0147a74430 ffs_sync() at ffs_sync+0x174/frame 0xfffffe0147a744d0 journal_check_space() at journal_check_space+0xe0/frame 0xfffffe0147a74500 softdep_prelink() at softdep_prelink+0x2d7/frame 0xfffffe0147a74550 ufs_mkdir() at ufs_mkdir+0xbe/frame 0xfffffe0147a746f0 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x65/frame 0xfffffe0147a74710 null_bypass() at null_bypass+0x12b/frame 0xfffffe0147a74890 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x65/frame 0xfffffe0147a748b0 kern_mkdirat() at kern_mkdirat+0x1f7/frame 0xfffffe0147a74ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0147a74bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0147a74bf0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x8011a7e4a, rsp = 0x7fffffffe208, rbp = 0x7fffffffe350 --- Tracing command creat pid 68408 tid 100398 td 0xfffffe01440ab000 sched_switch() at sched_switch+0x5af/frame 0xfffffe0144587220 mi_switch() at mi_switch+0x155/frame 0xfffffe0144587240 __mtx_lock_sleep() at __mtx_lock_sleep+0x1c9/frame 0xfffffe01445872d0 __mtx_lock_flags() at __mtx_lock_flags+0xef/frame 0xfffffe0144587320 __mnt_vnode_next_all() at __mnt_vnode_next_all+0x42/frame 0xfffffe0144587360 ffs_sync() at ffs_sync+0x174/frame 0xfffffe0144587400 journal_check_space() at journal_check_space+0xe0/frame 0xfffffe0144587430 softdep_prelink() at softdep_prelink+0x2d7/frame 0xfffffe0144587480 ufs_makeinode() at ufs_makeinode+0xb9/frame 0xfffffe0144587610 ufs_create() at ufs_create+0x34/frame 0xfffffe0144587630 VOP_CREATE_APV() at VOP_CREATE_APV+0x62/frame 0xfffffe0144587650 null_bypass() at null_bypass+0x12b/frame 0xfffffe01445877d0 VOP_CREATE_APV() at VOP_CREATE_APV+0x62/frame 0xfffffe01445877f0 vn_open_cred() at vn_open_cred+0x2b9/frame 0xfffffe0144587960 kern_openat() at kern_openat+0x28c/frame 0xfffffe0144587ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0144587bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0144587bf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8011aa60a, rsp = 0x7fffffffe2a8, rbp = 0x7fffffffe360 --- Tracing command swap pid 68409 tid 100322 td 0xfffffe0143f5d740 sched_switch() at sched_switch+0x5af/frame 0xfffffe0144404650 mi_switch() at mi_switch+0x155/frame 0xfffffe0144404670 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01444046b0 _sx_xlock_hard() at _sx_xlock_hard+0x421/frame 0xfffffe0144404750 _sx_xlock() at _sx_xlock+0xbb/frame 0xfffffe0144404790 exit1() at exit1+0x655/frame 0xfffffe0144404800 sigexit() at sigexit+0x157/frame 0xfffffe0144404ae0 postsig() at postsig+0x1aa/frame 0xfffffe0144404bb0 ast() at ast+0x4fb/frame 0xfffffe0144404bf0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe360 Tracing command mkfifo pid 68410 tid 100354 td 0xfffffe014406eac0 sched_switch() at sched_switch+0x5af/frame 0xfffffe014446d4c0 mi_switch() at mi_switch+0x155/frame 0xfffffe014446d4e0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe014446d520 sleeplk() at sleeplk+0x100/frame 0xfffffe014446d580 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d2/frame 0xfffffe014446d620 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe014446d660 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe014446d680 null_lock() at null_lock+0xd3/frame 0xfffffe014446d6e0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe014446d700 _vn_lock() at _vn_lock+0x54/frame 0xfffffe014446d760 lookup() at lookup+0xc2/frame 0xfffffe014446d800 namei() at namei+0x379/frame 0xfffffe014446d8b0 kern_mkfifoat() at kern_mkfifoat+0x145/frame 0xfffffe014446dac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014446dbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014446dbf0 --- syscall (132, FreeBSD ELF64, sys_mkfifo), rip = 0x8011bfdea, rsp = 0x7fffffffe318, rbp = 0x7fffffffe360 --- Tracing command dirrename pid 68411 tid 100592 td 0xfffffe014789fc80 sched_switch() at sched_switch+0x5af/frame 0xfffffe0147b402f0 mi_switch() at mi_switch+0x155/frame 0xfffffe0147b40310 __mtx_lock_sleep() at __mtx_lock_sleep+0x1c9/frame 0xfffffe0147b403a0 __mtx_lock_flags() at __mtx_lock_flags+0xef/frame 0xfffffe0147b403f0 __mnt_vnode_next_all() at __mnt_vnode_next_all+0x42/frame 0xfffffe0147b40430 ffs_sync() at ffs_sync+0x174/frame 0xfffffe0147b404d0 journal_check_space() at journal_check_space+0xe0/frame 0xfffffe0147b40500 softdep_prelink() at softdep_prelink+0x2d7/frame 0xfffffe0147b40550 ufs_mkdir() at ufs_mkdir+0xbe/frame 0xfffffe0147b406f0 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x65/frame 0xfffffe0147b40710 null_bypass() at null_bypass+0x12b/frame 0xfffffe0147b40890 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x65/frame 0xfffffe0147b408b0 kern_mkdirat() at kern_mkdirat+0x1f7/frame 0xfffffe0147b40ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0147b40bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0147b40bf0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x8011a7e4a, rsp = 0x7fffffffe208, rbp = 0x7fffffffe350 --- Tracing command swap pid 68412 tid 100541 td 0xfffffe01459083a0 sched_switch() at sched_switch+0x5af/frame 0xfffffe01456bd650 mi_switch() at mi_switch+0x155/frame 0xfffffe01456bd670 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01456bd6b0 _sx_xlock_hard() at _sx_xlock_hard+0x421/frame 0xfffffe01456bd750 _sx_xlock() at _sx_xlock+0xbb/frame 0xfffffe01456bd790 exit1() at exit1+0x655/frame 0xfffffe01456bd800 sigexit() at sigexit+0x157/frame 0xfffffe01456bdae0 postsig() at postsig+0x1aa/frame 0xfffffe01456bdbb0 ast() at ast+0x4fb/frame 0xfffffe01456bdbf0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe360 Tracing command dirrename pid 68413 tid 100491 td 0xfffffe0146758ac0 sched_switch() at sched_switch+0x5af/frame 0xfffffe014575d270 mi_switch() at mi_switch+0x155/frame 0xfffffe014575d290 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe014575d2d0 sleeplk() at sleeplk+0x100/frame 0xfffffe014575d330 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x402/frame 0xfffffe014575d3e0 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe014575d420 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe014575d440 _vn_lock() at _vn_lock+0x54/frame 0xfffffe014575d4a0 vn_lock_pair() at vn_lock_pair+0x109/frame 0xfffffe014575d500 softdep_prelink() at softdep_prelink+0x35e/frame 0xfffffe014575d550 ufs_mkdir() at ufs_mkdir+0xbe/frame 0xfffffe014575d6f0 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x65/frame 0xfffffe014575d710 null_bypass() at null_bypass+0x12b/frame 0xfffffe014575d890 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x65/frame 0xfffffe014575d8b0 kern_mkdirat() at kern_mkdirat+0x1f7/frame 0xfffffe014575dac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014575dbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014575dbf0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x8011a7e4a, rsp = 0x7fffffffe208, rbp = 0x7fffffffe350 --- Tracing command dirrename pid 68414 tid 100404 td 0xfffffe01440cf1e0 sched_switch() at sched_switch+0x5af/frame 0xfffffe01445a54c0 mi_switch() at mi_switch+0x155/frame 0xfffffe01445a54e0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01445a5520 sleeplk() at sleeplk+0x100/frame 0xfffffe01445a5580 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d2/frame 0xfffffe01445a5620 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe01445a5660 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe01445a5680 null_lock() at null_lock+0xd3/frame 0xfffffe01445a56e0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe01445a5700 _vn_lock() at _vn_lock+0x54/frame 0xfffffe01445a5760 lookup() at lookup+0xc2/frame 0xfffffe01445a5800 namei() at namei+0x379/frame 0xfffffe01445a58b0 kern_mkdirat() at kern_mkdirat+0x145/frame 0xfffffe01445a5ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01445a5bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01445a5bf0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x8011a7e4a, rsp = 0x7fffffffe208, rbp = 0x7fffffffe350 --- Tracing command swap pid 68415 tid 100283 td 0xfffffe0143dbf1e0 sched_switch() at sched_switch+0x5af/frame 0xfffffe01416d9650 mi_switch() at mi_switch+0x155/frame 0xfffffe01416d9670 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01416d96b0 _sx_xlock_hard() at _sx_xlock_hard+0x421/frame 0xfffffe01416d9750 _sx_xlock() at _sx_xlock+0xbb/frame 0xfffffe01416d9790 exit1() at exit1+0x655/frame 0xfffffe01416d9800 sigexit() at sigexit+0x157/frame 0xfffffe01416d9ae0 postsig() at postsig+0x1aa/frame 0xfffffe01416d9bb0 ast() at ast+0x4fb/frame 0xfffffe01416d9bf0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe360 Tracing command dirrename pid 68416 tid 100599 td 0xfffffe014747b720 sched_switch() at sched_switch+0x5af/frame 0xfffffe0147b83270 mi_switch() at mi_switch+0x155/frame 0xfffffe0147b83290 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0147b832d0 sleeplk() at sleeplk+0x100/frame 0xfffffe0147b83330 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x402/frame 0xfffffe0147b833e0 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe0147b83420 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe0147b83440 _vn_lock() at _vn_lock+0x54/frame 0xfffffe0147b834a0 vn_lock_pair() at vn_lock_pair+0x109/frame 0xfffffe0147b83500 softdep_prelink() at softdep_prelink+0x35e/frame 0xfffffe0147b83550 ufs_mkdir() at ufs_mkdir+0xbe/frame 0xfffffe0147b836f0 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x65/frame 0xfffffe0147b83710 null_bypass() at null_bypass+0x12b/frame 0xfffffe0147b83890 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x65/frame 0xfffffe0147b838b0 kern_mkdirat() at kern_mkdirat+0x1f7/frame 0xfffffe0147b83ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0147b83bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0147b83bf0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x8011a7e4a, rsp = 0x7fffffffe208, rbp = 0x7fffffffe350 --- Tracing command swap pid 68417 tid 100326 td 0xfffffe0143f80020 sched_switch() at sched_switch+0x5af/frame 0xfffffe0144418650 mi_switch() at mi_switch+0x155/frame 0xfffffe0144418670 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01444186b0 _sx_xlock_hard() at _sx_xlock_hard+0x421/frame 0xfffffe0144418750 _sx_xlock() at _sx_xlock+0xbb/frame 0xfffffe0144418790 exit1() at exit1+0x655/frame 0xfffffe0144418800 sigexit() at sigexit+0x157/frame 0xfffffe0144418ae0 postsig() at postsig+0x1aa/frame 0xfffffe0144418bb0 ast() at ast+0x4fb/frame 0xfffffe0144418bf0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe360 Tracing command dirrename pid 68418 tid 100449 td 0xfffffe0144116020 sched_switch() at sched_switch+0x5af/frame 0xfffffe01456814c0 mi_switch() at mi_switch+0x155/frame 0xfffffe01456814e0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0145681520 sleeplk() at sleeplk+0x100/frame 0xfffffe0145681580 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d2/frame 0xfffffe0145681620 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe0145681660 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe0145681680 null_lock() at null_lock+0xd3/frame 0xfffffe01456816e0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe0145681700 _vn_lock() at _vn_lock+0x54/frame 0xfffffe0145681760 lookup() at lookup+0xc2/frame 0xfffffe0145681800 namei() at namei+0x379/frame 0xfffffe01456818b0 kern_mkdirat() at kern_mkdirat+0x145/frame 0xfffffe0145681ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0145681bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0145681bf0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x8011a7e4a, rsp = 0x7fffffffe208, rbp = 0x7fffffffe350 --- Tracing command sh pid 2897 tid 100329 td 0xfffffe0143fc21e0 sched_switch() at sched_switch+0x5af/frame 0xfffffe014442c6d0 mi_switch() at mi_switch+0x155/frame 0xfffffe014442c6f0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe014442c730 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014442c780 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe014442c790 _sleep() at _sleep+0x325/frame 0xfffffe014442c830 kern_wait6() at kern_wait6+0x474/frame 0xfffffe014442c8c0 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe014442cac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014442cbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014442cbf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80120988a, rsp = 0x7fffffffe228, rbp = 0x7fffffffe2d0 --- Tracing command awk pid 2898 tid 100330 td 0xfffffe0143fc1ac0 sched_switch() at sched_switch+0x5af/frame 0xfffffe0144427840 mi_switch() at mi_switch+0x155/frame 0xfffffe0144427860 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01444278a0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01444278f0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0144427900 _sleep() at _sleep+0x325/frame 0xfffffe01444279a0 pipe_read() at pipe_read+0x4c6/frame 0xfffffe0144427a00 dofileread() at dofileread+0x81/frame 0xfffffe0144427a50 sys_read() at sys_read+0xc0/frame 0xfffffe0144427ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0144427bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0144427bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8012166aa, rsp = 0x7fffffffe1f8, rbp = 0x7fffffffe210 --- Tracing command sh pid 2900 tid 100331 td 0xfffffe0143fc13a0 sched_switch() at sched_switch+0x5af/frame 0xfffffe0144436840 mi_switch() at mi_switch+0x155/frame 0xfffffe0144436860 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01444368a0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01444368f0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0144436900 _sleep() at _sleep+0x325/frame 0xfffffe01444369a0 pipe_read() at pipe_read+0x4c6/frame 0xfffffe0144436a00 dofileread() at dofileread+0x81/frame 0xfffffe0144436a50 sys_read() at sys_read+0xc0/frame 0xfffffe0144436ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0144436bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0144436bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8012096aa, rsp = 0x7fffffffdcc8, rbp = 0x7fffffffe1f0 --- Tracing command sh pid 69277 tid 100291 td 0xfffffe0143dbce40 sched_switch() at sched_switch+0x5af/frame 0xfffffe01417646d0 mi_switch() at mi_switch+0x155/frame 0xfffffe01417646f0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0141764730 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0141764780 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0141764790 _sleep() at _sleep+0x325/frame 0xfffffe0141764830 kern_wait6() at kern_wait6+0x474/frame 0xfffffe01417648c0 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0141764ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0141764bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141764bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80120988a, rsp = 0x7fffffffdfe8, rbp = 0x7fffffffe090 --- Tracing command lockf pid 69579 tid 100503 td 0xfffffe01478a11e0 thread_exit() at thread_exit+0x203/frame 0xfffffe014578f790 exit1() at exit1+0xdde/frame 0xfffffe014578f800 sigexit() at sigexit+0x157/frame 0xfffffe014578fae0 postsig() at postsig+0x1aa/frame 0xfffffe014578fbb0 ast() at ast+0x4fb/frame 0xfffffe014578fbf0 fast_syscall_common() at fast_syscall_common+0x1a5/frame 0xfffffe014578fbf0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x8011aa6aa, rsp = 0x7fffffffe2e8, rbp = 0x7fffffffe310 --- Tracing command lockf pid 69581 tid 100389 td 0xfffffe0144096000 sched_switch() at sched_switch+0x5af/frame 0xfffffe0144555650 mi_switch() at mi_switch+0x155/frame 0xfffffe0144555670 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01445556b0 _sx_xlock_hard() at _sx_xlock_hard+0x421/frame 0xfffffe0144555750 _sx_xlock() at _sx_xlock+0xbb/frame 0xfffffe0144555790 exit1() at exit1+0x655/frame 0xfffffe0144555800 sigexit() at sigexit+0x157/frame 0xfffffe0144555ae0 postsig() at postsig+0x1aa/frame 0xfffffe0144555bb0 ast() at ast+0x4fb/frame 0xfffffe0144555bf0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe310 Tracing command lockf pid 69582 tid 100581 td 0xfffffe0143d96740 sched_switch() at sched_switch+0x5af/frame 0xfffffe0147b36650 mi_switch() at mi_switch+0x155/frame 0xfffffe0147b36670 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0147b366b0 _sx_xlock_hard() at _sx_xlock_hard+0x421/frame 0xfffffe0147b36750 _sx_xlock() at _sx_xlock+0xbb/frame 0xfffffe0147b36790 exit1() at exit1+0x655/frame 0xfffffe0147b36800 sigexit() at sigexit+0x157/frame 0xfffffe0147b36ae0 postsig() at postsig+0x1aa/frame 0xfffffe0147b36bb0 ast() at ast+0x4fb/frame 0xfffffe0147b36bf0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe310 Tracing command lockf pid 69586 tid 100467 td 0xfffffe0145a3bac0 thread_exit() at thread_exit+0x203/frame 0xfffffe01456e0790 exit1() at exit1+0xdde/frame 0xfffffe01456e0800 sigexit() at sigexit+0x157/frame 0xfffffe01456e0ae0 postsig() at postsig+0x1aa/frame 0xfffffe01456e0bb0 ast() at ast+0x4fb/frame 0xfffffe01456e0bf0 fast_syscall_common() at fast_syscall_common+0x1a5/frame 0xfffffe01456e0bf0 --- syscall (0, FreeBSD ELF64, nosys), rip = 0x8011aa50a, rsp = 0x7fffffffe298, rbp = 0x7fffffffe2e0 --- Tracing command lockf pid 69587 tid 100601 td 0xfffffe01478b7e40 sched_switch() at sched_switch+0x5af/frame 0xfffffe0147b9c650 mi_switch() at mi_switch+0x155/frame 0xfffffe0147b9c670 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0147b9c6b0 _sx_xlock_hard() at _sx_xlock_hard+0x421/frame 0xfffffe0147b9c750 _sx_xlock() at _sx_xlock+0xbb/frame 0xfffffe0147b9c790 exit1() at exit1+0x655/frame 0xfffffe0147b9c800 sigexit() at sigexit+0x157/frame 0xfffffe0147b9cae0 postsig() at postsig+0x1aa/frame 0xfffffe0147b9cbb0 ast() at ast+0x4fb/frame 0xfffffe0147b9cbf0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe310 Tracing command lockf pid 69589 tid 100323 td 0xfffffe0143f59000 sched_switch() at sched_switch+0x5af/frame 0xfffffe014440e650 mi_switch() at mi_switch+0x155/frame 0xfffffe014440e670 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe014440e6b0 _sx_xlock_hard() at _sx_xlock_hard+0x421/frame 0xfffffe014440e750 _sx_xlock() at _sx_xlock+0xbb/frame 0xfffffe014440e790 exit1() at exit1+0x655/frame 0xfffffe014440e800 sigexit() at sigexit+0x157/frame 0xfffffe014440eae0 postsig() at postsig+0x1aa/frame 0xfffffe014440ebb0 ast() at ast+0x4fb/frame 0xfffffe014440ebf0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe310 Tracing command lockf pid 69590 tid 100565 td 0xfffffe01485db560 sched_switch() at sched_switch+0x5af/frame 0xfffffe0147ae4650 mi_switch() at mi_switch+0x155/frame 0xfffffe0147ae4670 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0147ae46b0 _sx_xlock_hard() at _sx_xlock_hard+0x421/frame 0xfffffe0147ae4750 _sx_xlock() at _sx_xlock+0xbb/frame 0xfffffe0147ae4790 exit1() at exit1+0x655/frame 0xfffffe0147ae4800 sigexit() at sigexit+0x157/frame 0xfffffe0147ae4ae0 postsig() at postsig+0x1aa/frame 0xfffffe0147ae4bb0 ast() at ast+0x4fb/frame 0xfffffe0147ae4bf0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe310 Tracing command sh pid 69647 tid 100510 td 0xfffffe010e596000 sched_switch() at sched_switch+0x5af/frame 0xfffffe01457bc900 mi_switch() at mi_switch+0x155/frame 0xfffffe01457bc920 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01457bc960 _sx_xlock_hard() at _sx_xlock_hard+0x421/frame 0xfffffe01457bca00 _sx_xlock() at _sx_xlock+0xbb/frame 0xfffffe01457bca40 exit1() at exit1+0x655/frame 0xfffffe01457bcab0 sys_sys_exit() at sys_sys_exit+0xd/frame 0xfffffe01457bcac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01457bcbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01457bcbf0 --- syscall (1, FreeBSD ELF64, sys_sys_exit), rip = 0x80120930a, rsp = 0x7fffffffe4a8, rbp = 0x7fffffffe5a0 --- Tracing command egrep pid 69648 tid 100316 td 0xfffffe010e579000 sched_switch() at sched_switch+0x5af/frame 0xfffffe01417dc590 mi_switch() at mi_switch+0x155/frame 0xfffffe01417dc5b0 kern_yield() at kern_yield+0x71/frame 0xfffffe01417dc5f0 uiomove_fromphys() at uiomove_fromphys+0x171/frame 0xfffffe01417dc660 vn_read_from_obj() at vn_read_from_obj+0x161/frame 0xfffffe01417dc740 VOP_READ_PGCACHE_APV() at VOP_READ_PGCACHE_APV+0x34/frame 0xfffffe01417dc760 vn_read() at vn_read+0x94/frame 0xfffffe01417dc7e0 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe01417dc840 vn_io_fault1() at vn_io_fault1+0x163/frame 0xfffffe01417dc980 vn_io_fault() at vn_io_fault+0x1ba/frame 0xfffffe01417dca00 dofileread() at dofileread+0x81/frame 0xfffffe01417dca50 sys_read() at sys_read+0xc0/frame 0xfffffe01417dcac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01417dcbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01417dcbf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8010450aa, rsp = 0x7fffffffd9b8, rbp = 0x7fffffffdad0 --- Tracing command sh pid 69652 tid 100370 td 0xfffffe014408d3a0 sched_switch() at sched_switch+0x5af/frame 0xfffffe01445146d0 mi_switch() at mi_switch+0x155/frame 0xfffffe01445146f0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0144514730 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0144514780 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0144514790 _sleep() at _sleep+0x325/frame 0xfffffe0144514830 kern_wait6() at kern_wait6+0x474/frame 0xfffffe01445148c0 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0144514ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0144514bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0144514bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80120988a, rsp = 0x7fffffffe098, rbp = 0x7fffffffe140 --- Tracing command pkill pid 69657 tid 100478 td 0xfffffe0145a3d020 sched_switch() at sched_switch+0x5af/frame 0xfffffe014570d900 mi_switch() at mi_switch+0x155/frame 0xfffffe014570d920 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe014570d960 _sx_xlock_hard() at _sx_xlock_hard+0x421/frame 0xfffffe014570da00 _sx_xlock() at _sx_xlock+0xbb/frame 0xfffffe014570da40 exit1() at exit1+0x655/frame 0xfffffe014570dab0 sys_sys_exit() at sys_sys_exit+0xd/frame 0xfffffe014570dac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014570dbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014570dbf0 --- syscall (1, FreeBSD ELF64, sys_sys_exit), rip = 0x8011c630a, rsp = 0x7fffffffdb08, rbp = 0x7fffffffdb20 --- db> reset cpu_reset: Restarting BSP cpu_reset_proxy: Stopped CPU 9 (kgdb) bt #0 __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:55 #1 doadump (textdump=textdump@entry=0x0) at ../../../kern/kern_shutdown.c:399 #2 0xffffffff804ce7fa in db_dump (dummy=, dummy2=, dummy3=, dummy4=) at ../../../ddb/db_command.c:575 #3 0xffffffff804ce6b2 in db_command (last_cmdp=, cmd_table=, dopager=dopager@entry=0x0) at ../../../ddb/db_command.c:482 #4 0xffffffff804ce746 in db_command_script (command=command@entry=0xffffffff81bd27c0 "dump") at ../../../ddb/db_command.c:553 #5 0xffffffff804d3bb8 in db_script_exec (scriptname=0xffffffff81bd2130 "dump", warnifnotfound=) at ../../../ddb/db_script.c:304 #6 0xffffffff804ce6b2 in db_command (last_cmdp=, cmd_table=, dopager=dopager@entry=0x0) at ../../../ddb/db_command.c:482 #7 0xffffffff804ce746 in db_command_script (command=command@entry=0xffffffff81bd2752 "run pho1") at ../../../ddb/db_command.c:553 #8 0xffffffff804d3bb8 in db_script_exec (scriptname=0xffffffff81bd2130 "dump", warnifnotfound=) at ../../../ddb/db_script.c:304 #9 0xffffffff804ce6b2 in db_command (last_cmdp=, cmd_table=, dopager=dopager@entry=0x1) at ../../../ddb/db_command.c:482 #10 0xffffffff804ce32d in db_command_loop () at ../../../ddb/db_command.c:535 #11 0xffffffff804d1aa6 in db_trap (type=, code=) at ../../../ddb/db_main.c:270 #12 0xffffffff80c6f5f7 in kdb_trap (type=type@entry=0x3, code=code@entry=0x0, tf=tf@entry=0xfffffe00e4880240) at ../../../kern/subr_kdb.c:727 #13 0xffffffff810e9bd3 in trap (frame=0xfffffe00e4880240) at ../../../amd64/amd64/trap.c:607 #14 #15 kdb_enter (why=0xffffffff812e497a "panic", msg=) at ../../../kern/subr_kdb.c:506 #16 0xffffffff80c22b98 in vpanic (fmt=0xffffffff811f5d80 "%s", ap=, ap@entry=0xfffffe00e48803b0) at ../../../kern/kern_shutdown.c:907 #17 0xffffffff80c22923 in panic (fmt=0xffffffff81e9d8e8 "\377\030*\201\377\377\377\377") at ../../../kern/kern_shutdown.c:843 #18 0xffffffff810e9fd7 in trap_fatal (frame=0xfffffe00e48805b0, eva=0x0) at ../../../amd64/amd64/trap.c:944 #19 0xffffffff810ea079 in trap_pfault (frame=frame@entry=0xfffffe00e48805b0, usermode=0x0, signo=, signo@entry=0x0, ucode=, ucode@entry=0x0) at ../../../amd64/amd64/trap.c:763 #20 0xffffffff810e9677 in trap (frame=0xfffffe00e48805b0) at ../../../amd64/amd64/trap.c:441 #21 #22 fifo_close (ap=0xfffffe00e4880870) at ../../../fs/fifofs/fifo_vnops.c:286 #23 0xffffffff811b1396 in VOP_CLOSE_APV (vop=0xffffffff81b65918 , a=0xfffffe00e4880870) at vnode_if.c:498 #24 0xffffffff8274b17b in null_bypass (ap=0xfffffe00e4880870) at /usr/src/sys/fs/nullfs/null_vnops.c:295 #25 0xffffffff811b1396 in VOP_CLOSE_APV (vop=0xffffffff8274e3d0 , a=a@entry=0xfffffe00e4880870) at vnode_if.c:498 #26 0xffffffff80d12033 in VOP_CLOSE (vp=0xfffff803371602f8, fflag=0x4, cred=0x0, td=0xfffffe00e4ce5900) at ./vnode_if.h:249 #27 vgonel (vp=vp@entry=0xfffff803371602f8) at ../../../kern/vfs_subr.c:4001 #28 0xffffffff80d116b1 in vflush (mp=mp@entry=0xfffffe010e59fb80, rootrefs=rootrefs@entry=0x0, flags=, flags@entry=0x2, td=, td@entry=0xfffffe00e4ce5900) at ../../../kern/vfs_subr.c:3813 #29 0xffffffff8274ac31 in nullfs_unmount (mp=0xfffffe010e59fb80, mntflags=) at /usr/src/sys/fs/nullfs/null_vfsops.c:243 #30 0xffffffff80d07102 in dounmount (mp=0xfffffe00e4880870, mp@entry=0xfffffe010e59fb80, flags=flags@entry=0x300000080000, td=0xfffffe00e4ce5900) at ../../../kern/vfs_mount.c:2139 #31 0xffffffff80d092c9 in vfs_deferred_unmount (argi=, pending=) at ../../../kern/vfs_mount.c:1931 #32 0xffffffff80c849ca in taskqueue_run_locked (queue=queue@entry=0xfffff80003b1f700) at ../../../kern/subr_taskqueue.c:476 #33 0xffffffff80c85a52 in taskqueue_thread_loop (arg=arg@entry=0xffffffff81faaad8 ) at ../../../kern/subr_taskqueue.c:793 #34 0xffffffff80bdbba0 in fork_exit (callout=0xffffffff80c85990 , arg=0xffffffff81faaad8 , frame=0xfffffe00e4880c00) at ../../../kern/kern_fork.c:1083 #35 (kgdb) f 22 #22 fifo_close (ap=0xfffffe00e4880870) at ../../../fs/fifofs/fifo_vnops.c:286 286 cpipe = fip->fi_pipe; (kgdb) l 281 struct fifoinfo *fip; 282 struct pipe *cpipe; 283 284 vp = ap->a_vp; 285 fip = vp->v_fifoinfo; 286 cpipe = fip->fi_pipe; 287 ASSERT_VOP_ELOCKED(vp, "fifo_close"); 288 if (ap->a_fflag & FREAD) { 289 fip->fi_readers--; 290 if (fip->fi_readers == 0) { (kgdb) info loc vp = 0xfffff806f83ff8e8 fip = 0x0 cpipe = (kgdb) p *vp $1 = {v_type = VFIFO, v_irflag = 0x0, v_seqc = 0x1, v_nchash = 0xb19ad98a, v_hash = 0x1e1ae, v_op = 0xffffffff81b65918 , v_data = 0xfffffe014c31dd98, v_mount = 0xfffffe010e5a0700, v_nmntvnodes = {tqe_next = 0xfffff806997c22f8, tqe_prev = 0xfffff80337e72320}, {v_mountedhere = 0x0, v_unpcb = 0x0, v_rdev = 0x0, v_fifoinfo = 0x0}, v_hashlist = {le_next = 0x0, le_prev = 0xfffffe010d1ada48}, v_cache_src = {lh_first = 0x0}, v_cache_dst = {tqh_first = 0x0, tqh_last = 0xfffff806f83ff940}, v_cache_dd = 0x0, v_lock = {lock_object = {lo_name = 0xffffffff811e38e7 "ufs", lo_flags = 0x6fb0008, lo_data = 0x0, lo_witness = 0xfffff8087fd83e00}, lk_lock = 0xfffffe00e4ce5900, lk_exslpfail = 0x0, lk_pri = 0x60, lk_timo = 0x33, lk_stack = {depth = 0xe, pcs = {0xffffffff80bf21e7, 0xffffffff80f4e30d, 0xffffffff811b413c, 0xffffffff8274bbe3, 0xffffffff811b413c, 0xffffffff80d283d4, 0xffffffff80d11460, 0xffffffff8274ac31, 0xffffffff80d07102, 0xffffffff80d092c9, 0xffffffff80c849ca, 0xffffffff80c85a52, 0xffffffff80bdbba0, 0xffffffff810bb4fe, 0x0, 0x0, 0x0, 0x0}}}, v_interlock = {lock_object = {lo_name = 0xffffffff81332525 "vnode interlock", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xfffff8087fd75580}, mtx_lock = 0x0}, v_vnlock = 0xfffff806f83ff958, v_vnodelist = {tqe_next = 0xfffff802932e58e8, tqe_prev = 0xfffff8038dacbd38}, v_lazylist = {tqe_next = 0xffffffffffffffff, tqe_prev = 0xffffffffffffffff}, v_bufobj = { bo_lock = {lock_object = {lo_name = 0xffffffff812ea94f "bufobj interlock", lo_flags = 0x5230000, lo_data = 0x0, lo_witness = 0xfffff8087fd80900}, rw_lock = 0x1}, bo_ops = 0xffffffff81b25b90 , bo_object = 0x0, bo_synclist = {le_next = 0xffffffffffffffff, le_prev = 0xffffffffffffffff}, bo_private = 0xfffff806f83ff8e8, bo_clean = {bv_hd = {tqh_first = 0x0, tqh_last = 0xfffff806f83ffaa8}, bv_root = {pt_root = 0x0}, bv_cnt = 0x0}, bo_dirty = {bv_hd = {tqh_first = 0x0, tqh_last = 0xfffff806f83ffac8}, bv_root = {pt_root = 0x0}, bv_cnt = 0x0}, bo_numoutput = 0x0, bo_flag = 0x0, bo_domain = 0x1, bo_bsize = 0x8000}, v_pollinfo = 0x0, v_label = 0x0, v_lockf = 0x0, v_rl = {rl_waiters = {tqh_first = 0x0, tqh_last = 0xfffff806f83ffb10}, rl_currdep = 0x0}, v_holdcnt = 0x3, v_usecount = 0x1, v_iflag = 0x0, v_vflag = 0x0, v_mflag = 0x0, v_dbatchcpu = 0xffff, v_writecount = 0x0, v_seqc_users = 0x1, v_unlock_stack = {depth = 0x0, pcs = {0x0 }}, v_upper_vnode = 0xfffff803371602f8} (kgdb) f 26 #26 0xffffffff80d12033 in VOP_CLOSE (vp=0xfffff803371602f8, fflag=0x4, cred=0x0, td=0xfffffe00e4ce5900) at ./vnode_if.h:249 249 return (VOP_CLOSE_APV(vp->v_op, &a)); (kgdb) l 244 a.a_gen.a_desc = &vop_close_desc; 245 a.a_vp = vp; 246 a.a_fflag = fflag; 247 a.a_cred = cred; 248 a.a_td = td; 249 return (VOP_CLOSE_APV(vp->v_op, &a)); 250 } 251 252 struct vop_fplookup_vexec_args { 253 struct vop_generic_args a_gen; (kgdb) info loc a = {a_gen = {a_desc = 0xffffffff81b8b3b8 }, a_vp = 0xfffff806f83ff8e8, a_fflag = 0x4, a_cred = 0x0, a_td = 0xfffffe00e4ce5900} (kgdb) p a $6 = {a_gen = {a_desc = 0xffffffff81b8b3b8 }, a_vp = 0xfffff806f83ff8e8, a_fflag = 0x4, a_cred = 0x0, a_td = 0xfffffe00e4ce5900} (kgdb) p *a->a_vp $8 = {v_type = VFIFO, v_irflag = 0x0, v_seqc = 0x1, v_nchash = 0xb19ad98a, v_hash = 0x1e1ae, v_op = 0xffffffff81b65918 , v_data = 0xfffffe014c31dd98, v_mount = 0xfffffe010e5a0700, v_nmntvnodes = {tqe_next = 0xfffff806997c22f8, tqe_prev = 0xfffff80337e72320}, {v_mountedhere = 0x0, v_unpcb = 0x0, v_rdev = 0x0, v_fifoinfo = 0x0}, v_hashlist = {le_next = 0x0, le_prev = 0xfffffe010d1ada48}, v_cache_src = {lh_first = 0x0}, v_cache_dst = {tqh_first = 0x0, tqh_last = 0xfffff806f83ff940}, v_cache_dd = 0x0, v_lock = {lock_object = {lo_name = 0xffffffff811e38e7 "ufs", lo_flags = 0x6fb0008, lo_data = 0x0, lo_witness = 0xfffff8087fd83e00}, lk_lock = 0xfffffe00e4ce5900, lk_exslpfail = 0x0, lk_pri = 0x60, lk_timo = 0x33, lk_stack = {depth = 0xe, pcs = {0xffffffff80bf21e7, 0xffffffff80f4e30d, 0xffffffff811b413c, 0xffffffff8274bbe3, 0xffffffff811b413c, 0xffffffff80d283d4, 0xffffffff80d11460, 0xffffffff8274ac31, 0xffffffff80d07102, 0xffffffff80d092c9, 0xffffffff80c849ca, 0xffffffff80c85a52, 0xffffffff80bdbba0, 0xffffffff810bb4fe, 0x0, 0x0, 0x0, 0x0}}}, v_interlock = {lock_object = {lo_name = 0xffffffff81332525 "vnode interlock", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xfffff8087fd75580}, mtx_lock = 0x0}, v_vnlock = 0xfffff806f83ff958, v_vnodelist = {tqe_next = 0xfffff802932e58e8, tqe_prev = 0xfffff8038dacbd38}, v_lazylist = {tqe_next = 0xffffffffffffffff, tqe_prev = 0xffffffffffffffff}, v_bufobj = { bo_lock = {lock_object = {lo_name = 0xffffffff812ea94f "bufobj interlock", lo_flags = 0x5230000, lo_data = 0x0, lo_witness = 0xfffff8087fd80900}, rw_lock = 0x1}, bo_ops = 0xffffffff81b25b90 , bo_object = 0x0, bo_synclist = {le_next = 0xffffffffffffffff, le_prev = 0xffffffffffffffff}, bo_private = 0xfffff806f83ff8e8, bo_clean = {bv_hd = {tqh_first = 0x0, tqh_last = 0xfffff806f83ffaa8}, bv_root = {pt_root = 0x0}, bv_cnt = 0x0}, bo_dirty = {bv_hd = {tqh_first = 0x0, tqh_last = 0xfffff806f83ffac8}, bv_root = {pt_root = 0x0}, bv_cnt = 0x0}, bo_numoutput = 0x0, bo_flag = 0x0, bo_domain = 0x1, bo_bsize = 0x8000}, v_pollinfo = 0x0, v_label = 0x0, v_lockf = 0x0, v_rl = {rl_waiters = {tqh_first = 0x0, tqh_last = 0xfffff806f83ffb10}, rl_currdep = 0x0}, v_holdcnt = 0x3, v_usecount = 0x1, v_iflag = 0x0, v_vflag = 0x0, v_mflag = 0x0, v_dbatchcpu = 0xffff, v_writecount = 0x0, v_seqc_users = 0x1, v_unlock_stack = {depth = 0x0, pcs = {0x0 }}, v_upper_vnode = 0xfffff803371602f8} (kgdb) f 28 #28 0xffffffff80d116b1 in vflush (mp=mp@entry=0xfffffe010e59fb80, rootrefs=rootrefs@entry=0x0, flags=, flags@entry=0x2, td=, td@entry=0xfffffe00e4ce5900) at ../../../kern/vfs_subr.c:3813 3813 vgonel(vp); (kgdb) l 3808 * vnode data structures and we are done. 3809 * 3810 * If FORCECLOSE is set, forcibly close the vnode. 3811 */ 3812 if (vp->v_usecount == 0 || (flags & FORCECLOSE)) { 3813 vgonel(vp); 3814 } else { 3815 busy++; 3816 #ifdef DIAGNOSTIC 3817 if (busyprt) (kgdb) info loc vattr = {va_type = 3834120448, va_mode = 0x0, va_padding0 = 0x0, va_uid = 0x7fd75580, va_gid = 0xfffff808, va_nlink = 0xfffff80436327000, va_fsid = 0x1, va_fileid = 0xfffffe010e59fbd8, va_size = 0x246, va_blocksize = 0x8, va_atime = {tv_sec = 0xfffff80436327130, tv_nsec = 0x0}, va_mtime = { tv_sec = 0x1, tv_nsec = 0x0}, va_ctime = {tv_sec = 0x8, tv_nsec = 0xe63}, va_birthtime = {tv_sec = 0xffffffff81273956, tv_nsec = 0xe63}, va_gen = 0x246, va_flags = 0x8, va_rdev = 0xfffff80436327130, va_bytes = 0x0, va_filerev = 0x1, va_vaflags = 0x0, va_spare = 0xfffff80436327148} rootvp = busy = 0x0 error = mvp = 0xfffff80524b3d800 vp = 0xfffff803371602f8 (kgdb) p *vp $9 = {v_type = VFIFO, v_irflag = 0x1, v_seqc = 0x1, v_nchash = 0x6831b763, v_hash = 0x19b8b01, v_op = 0xffffffff8274e3d0 , v_data = 0xfffff80767995f00, v_mount = 0xfffffe010e59fb80, v_nmntvnodes = {tqe_next = 0xfffff80524b3d800, tqe_prev = 0xfffffe010e59fc08}, { v_mountedhere = 0x0, v_unpcb = 0x0, v_rdev = 0x0, v_fifoinfo = 0x0}, v_hashlist = {le_next = 0xffffffffffffffff, le_prev = 0xffffffffffffffff}, v_cache_src = {lh_first = 0x0}, v_cache_dst = {tqh_first = 0x0, tqh_last = 0xfffff80337160350}, v_cache_dd = 0x0, v_lock = {lock_object = { lo_name = 0xffffffff8274d05e "nullfs", lo_flags = 0x6fb0008, lo_data = 0x0, lo_witness = 0xfffff8087fd84b80}, lk_lock = 0x1, lk_exslpfail = 0x0, lk_pri = 0x60, lk_timo = 0x33, lk_stack = {depth = 0xd, pcs = {0xffffffff80bf21e7, 0xffffffff80f4e30d, 0xffffffff811b413c, 0xffffffff80d283d4, 0xffffffff80d1006a, 0xffffffff80cfe50c, 0xffffffff80f49188, 0xffffffff80f3a6c0, 0xffffffff80f2ef5d, 0xffffffff80f29ac7, 0xffffffff80f2d71f, 0xffffffff80bdbba0, 0xffffffff810bb4fe, 0x0, 0x0, 0x0, 0x0, 0x0}}}, v_interlock = {lock_object = {lo_name = 0xffffffff81332525 "vnode interlock", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xfffff8087fd75580}, mtx_lock = 0x0}, v_vnlock = 0xfffff806f83ff958, v_vnodelist = {tqe_next = 0xfffff8053c99ebe0, tqe_prev = 0xfffff8004ac07748}, v_lazylist = {tqe_next = 0xffffffffffffffff, tqe_prev = 0xffffffffffffffff}, v_bufobj = { bo_lock = {lock_object = {lo_name = 0xffffffff812ea94f "bufobj interlock", lo_flags = 0x5230000, lo_data = 0x0, lo_witness = 0xfffff8087fd80900}, rw_lock = 0x1}, bo_ops = 0xffffffff81b25b90 , bo_object = 0x0, bo_synclist = {le_next = 0xffffffffffffffff, le_prev = 0xffffffffffffffff}, bo_private = 0xfffff803371602f8, bo_clean = {bv_hd = {tqh_first = 0x0, tqh_last = 0xfffff803371604b8}, bv_root = {pt_root = 0x0}, bv_cnt = 0x0}, bo_dirty = {bv_hd = {tqh_first = 0x0, tqh_last = 0xfffff803371604d8}, bv_root = {pt_root = 0x0}, bv_cnt = 0x0}, bo_numoutput = 0x0, bo_flag = 0x0, bo_domain = 0x5, bo_bsize = 0x8000}, v_pollinfo = 0x0, v_label = 0x0, v_lockf = 0x0, v_rl = {rl_waiters = {tqh_first = 0x0, tqh_last = 0xfffff80337160520}, rl_currdep = 0x0}, v_holdcnt = 0x2, v_usecount = 0x1, v_iflag = 0x0, v_vflag = 0x0, v_mflag = 0x0, v_dbatchcpu = 0xffff, v_writecount = 0x0, v_seqc_users = 0x2, v_unlock_stack = {depth = 0xc, pcs = {0xffffffff80cfa752, 0xffffffff80f4e540, 0xffffffff80f2f3fa, 0xffffffff80f60bab, 0xffffffff811b2ed5, 0xffffffff8274b17b, 0xffffffff8274b82e, 0xffffffff811b2ed5, 0xffffffff80d200fa, 0xffffffff80d1fdc8, 0xffffffff810ea9c7, 0xffffffff810bad9e, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0}}, v_upper_vnode = 0x0} (kgdb) p *mp $10 = {mnt_vfs_ops = 0x1, mnt_kern_flag = 0x41006b49, mnt_flag = 0x1000, mnt_pcpu = 0xfffffe018c03bfe0, mnt_rootvnode = 0x0, mnt_vnodecovered = 0xfffff802d64d4000, mnt_op = 0xffffffff8274e2a8 , mnt_vfc = 0xffffffff8274e258 , mnt_mtx = {lock_object = { lo_name = 0xffffffff811c07ec "struct mount mtx", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xfffff8087fd75b80}, mtx_lock = 0x0}, mnt_gen = 0x6, mnt_list = {tqe_next = 0x0, tqe_prev = 0xfffffe010e5a0768}, mnt_syncer = 0x0, mnt_ref = 0x4bff, mnt_nvnodelist = { tqh_first = 0xfffff803371602f8, tqh_last = 0xfffff802f8b7a028}, mnt_nvnodelistsize = 0x4bfc, mnt_writeopcount = 0x1, mnt_opt = 0xfffff8000609db90, mnt_optnew = 0x0, mnt_stat = {f_version = 0x20140518, f_type = 0x35, f_flags = 0x100201000, f_bsize = 0x1000, f_iosize = 0x8000, f_blocks = 0x3df87, f_bfree = 0x3d776, f_bavail = 0x38824, f_files = 0x201fe, f_ffree = 0x201fb, f_syncwrites = 0x0, f_asyncwrites = 0x0, f_syncreads = 0x0, f_asyncreads = 0x0, f_spare = {0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0}, f_namemax = 0xff, f_owner = 0x0, f_fsid = {val = { 0x2900ff21, 0x29}}, f_charspare = '\000' , f_fstypename = "nullfs\000\000\000\000\000\000\000\000\000", f_mntfromname = "/mnt", '\000' , f_mntonname = "/mnt2", '\000' }, mnt_cred = 0xfffff80524588900, mnt_data = 0xfffff80767da8480, mnt_time = 0x0, mnt_iosize_max = 0x10000, mnt_export = 0x0, mnt_label = 0x0, mnt_hashseed = 0x1d72832, mnt_lockref = 0x0, mnt_secondary_writes = 0x0, mnt_secondary_accwrites = 0x0, mnt_susp_owner = 0x0, mnt_gjprovider = 0x0, mnt_listmtx = {lock_object = { lo_name = 0xffffffff8125bc69 "struct mount vlist mtx", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xfffff8087fd83980}, mtx_lock = 0x0}, mnt_lazyvnodelist = {tqh_first = 0x0, tqh_last = 0xfffffe010e5a05c8}, mnt_lazyvnodelistsize = 0x0, mnt_upper_pending = 0x0, mnt_explock = { lock_object = {lo_name = 0xffffffff81294e11 "explock", lo_flags = 0x6730000, lo_data = 0x0, lo_witness = 0xfffff8087fd81500}, lk_lock = 0x1, lk_exslpfail = 0x0, lk_pri = 0x60, lk_timo = 0x0, lk_stack = {depth = 0x0, pcs = {0x0 }}}, mnt_uppers = {tqh_first = 0x0, tqh_last = 0xfffffe010e5a06a0}, mnt_notify = {tqh_first = 0x0, tqh_last = 0xfffffe010e5a06b0}, mnt_taskqueue_link = {stqe_next = 0xfffffe010e5a0700}, mnt_taskqueue_flags = 0x300000080000} (kgdb) diff --git a/sys/fs/nullfs/null.h b/sys/fs/nullfs/null.h index 6fdac4b1006e..a41625536d65 100644 --- a/sys/fs/nullfs/null.h +++ b/sys/fs/nullfs/null.h @@ -45,6 +45,8 @@ struct null_mount { struct mount *nullm_vfs; struct vnode *nullm_lowerrootvp; /* Ref to lower root vnode */ uint64_t nullm_flags; + struct mount_upper_node upper_node; + struct mount_upper_node notify_node; }; #ifdef _KERNEL diff --git a/sys/fs/nullfs/null_subr.c b/sys/fs/nullfs/null_subr.c index fb6a13449df7..e4ce525ebe03 100644 --- a/sys/fs/nullfs/null_subr.c +++ b/sys/fs/nullfs/null_subr.c @@ -287,6 +287,7 @@ null_nodeget(mp, lowervp, vpp) null_destroy_proto(vp, xp); return (0); } +lowervp->v_upper_vnode = vp; *vpp = vp; return (0); diff --git a/sys/fs/nullfs/null_vfsops.c b/sys/fs/nullfs/null_vfsops.c index 4914e5fc2dbf..73301c9275d2 100644 --- a/sys/fs/nullfs/null_vfsops.c +++ b/sys/fs/nullfs/null_vfsops.c @@ -163,7 +163,8 @@ nullfs_mount(struct mount *mp) * Save pointer to underlying FS and the reference to the * lower root vnode. */ - xmp->nullm_vfs = vfs_pin_from_vp(lowerrootvp); + xmp->nullm_vfs = vfs_register_upper_from_vp(lowerrootvp, mp, + &xmp->upper_node); if (xmp->nullm_vfs == NULL) { vput(lowerrootvp); free(xmp, M_NULLFSMNT); @@ -178,7 +179,7 @@ nullfs_mount(struct mount *mp) */ error = null_nodeget(mp, lowerrootvp, &nullm_rootvp); if (error != 0) { - vfs_unpin(xmp->nullm_vfs); + vfs_unregister_upper(xmp->nullm_vfs, &xmp->upper_node); vrele(lowerrootvp); free(xmp, M_NULLFSMNT); return (error); @@ -195,6 +196,11 @@ nullfs_mount(struct mount *mp) (xmp->nullm_vfs->mnt_kern_flag & MNTK_NULL_NOCACHE) != 0) xmp->nullm_flags &= ~NULLM_CACHE; + if ((xmp->nullm_flags & NULLM_CACHE) != 0) { + vfs_register_for_notification(xmp->nullm_vfs, mp, + &xmp->notify_node); + } + MNT_ILOCK(mp); if ((xmp->nullm_flags & NULLM_CACHE) != 0) { mp->mnt_kern_flag |= lowerrootvp->v_mount->mnt_kern_flag & @@ -206,13 +212,6 @@ nullfs_mount(struct mount *mp) (MNTK_USES_BCACHE | MNTK_NO_IOPF | MNTK_UNMAPPED_BUFS); MNT_IUNLOCK(mp); vfs_getnewfsid(mp); - if ((xmp->nullm_flags & NULLM_CACHE) != 0) { - MNT_ILOCK(xmp->nullm_vfs); - TAILQ_INSERT_TAIL(&xmp->nullm_vfs->mnt_uppers, mp, - mnt_upper_link); - MNT_IUNLOCK(xmp->nullm_vfs); - } - vfs_mountedfrom(mp, target); vput(nullm_rootvp); @@ -230,7 +229,6 @@ nullfs_unmount(mp, mntflags) int mntflags; { struct null_mount *mntdata; - struct mount *ump; int error, flags; NULLFSDEBUG("nullfs_unmount: mp = %p\n", (void *)mp); @@ -259,17 +257,11 @@ nullfs_unmount(mp, mntflags) * Finally, throw away the null_mount structure */ mntdata = mp->mnt_data; - ump = mntdata->nullm_vfs; if ((mntdata->nullm_flags & NULLM_CACHE) != 0) { - MNT_ILOCK(ump); - while ((ump->mnt_kern_flag & MNTK_VGONE_UPPER) != 0) { - ump->mnt_kern_flag |= MNTK_VGONE_WAITER; - msleep(&ump->mnt_uppers, &ump->mnt_mtx, 0, "vgnupw", 0); - } - TAILQ_REMOVE(&ump->mnt_uppers, mp, mnt_upper_link); - MNT_IUNLOCK(ump); + vfs_unregister_for_notification(mntdata->nullm_vfs, + &mntdata->notify_node); } - vfs_unpin(ump); + vfs_unregister_upper(mntdata->nullm_vfs, &mntdata->upper_node); vrele(mntdata->nullm_lowerrootvp); mp->mnt_data = NULL; free(mntdata, M_NULLFSMNT); diff --git a/sys/fs/nullfs/null_vnops.c b/sys/fs/nullfs/null_vnops.c index aeebce4ed086..66e5b634acd7 100644 --- a/sys/fs/nullfs/null_vnops.c +++ b/sys/fs/nullfs/null_vnops.c @@ -223,13 +223,12 @@ int null_bypass(struct vop_generic_args *ap) { struct vnode **this_vp_p; - int error; struct vnode *old_vps[VDESC_MAX_VPS]; struct vnode **vps_p[VDESC_MAX_VPS]; struct vnode ***vppp; struct vnode *lvp; struct vnodeop_desc *descp = ap->a_desc; - int reles, i; + int error, i, reles; if (null_bug_bypass) printf ("null_bypass: %s\n", descp->vdesc_name); @@ -252,26 +251,39 @@ null_bypass(struct vop_generic_args *ap) for (i = 0; i < VDESC_MAX_VPS; reles >>= 1, i++) { if (descp->vdesc_vp_offsets[i] == VDESC_NO_OFFSET) break; /* bail out at end of list */ - vps_p[i] = this_vp_p = - VOPARG_OFFSETTO(struct vnode**,descp->vdesc_vp_offsets[i],ap); + vps_p[i] = this_vp_p = VOPARG_OFFSETTO(struct vnode **, + descp->vdesc_vp_offsets[i],ap); + /* * We're not guaranteed that any but the first vnode * are of our type. Check for and don't map any * that aren't. (We must always map first vp or vclean fails.) */ - if (i && (*this_vp_p == NULLVP || + if (i != 0 && (*this_vp_p == NULLVP || (*this_vp_p)->v_op != &null_vnodeops)) { old_vps[i] = NULLVP; } else { old_vps[i] = *this_vp_p; *(vps_p[i]) = NULLVPTOLOWERVP(*this_vp_p); + + /* + * The upper vnode reference to the lower + * vnode is the only reference that keeps our + * pointer to the lower vnode alive. If lower + * vnode is relocked during the VOP call, + * upper vnode might become unlocked and + * reclaimed, which invalidates our reference. + * Add a transient hold around VOP call. + */ + vhold(*this_vp_p); + /* * XXX - Several operations have the side effect * of vrele'ing their vp's. We must account for * that. (This should go away in the future.) */ if (reles & VDESC_VP0_WILLRELE) - VREF(*this_vp_p); + vref(*this_vp_p); } } @@ -279,9 +291,9 @@ null_bypass(struct vop_generic_args *ap) * Call the operation on the lower layer * with the modified argument structure. */ - if (vps_p[0] && *vps_p[0]) + if (vps_p[0] != NULL && *vps_p[0] != NULL) { error = VCALL(ap); - else { + } else { printf("null_bypass: no map for %s\n", descp->vdesc_name); error = EINVAL; } @@ -295,10 +307,11 @@ null_bypass(struct vop_generic_args *ap) for (i = 0; i < VDESC_MAX_VPS; reles >>= 1, i++) { if (descp->vdesc_vp_offsets[i] == VDESC_NO_OFFSET) break; /* bail out at end of list */ - if (old_vps[i]) { + if (old_vps[i] != NULL) { lvp = *(vps_p[i]); /* + * Get rid of the transient hold on lvp. * If lowervp was unlocked during VOP * operation, nullfs upper vnode could have * been reclaimed, which changes its v_vnlock @@ -306,11 +319,14 @@ null_bypass(struct vop_generic_args *ap) * must move lock ownership from lower to * upper (reclaimed) vnode. */ - if (lvp != NULLVP && - VOP_ISLOCKED(lvp) == LK_EXCLUSIVE && - old_vps[i]->v_vnlock != lvp->v_vnlock) { - VOP_UNLOCK(lvp); - VOP_LOCK(old_vps[i], LK_EXCLUSIVE | LK_RETRY); + if (lvp != NULLVP) { + if (VOP_ISLOCKED(lvp) == LK_EXCLUSIVE && + old_vps[i]->v_vnlock != lvp->v_vnlock) { + VOP_UNLOCK(lvp); + VOP_LOCK(old_vps[i], LK_EXCLUSIVE | + LK_RETRY); + } + vdrop(lvp); } *(vps_p[i]) = old_vps[i]; @@ -328,17 +344,18 @@ null_bypass(struct vop_generic_args *ap) * (Assumes that the lower layer always returns * a VREF'ed vpp unless it gets an error.) */ - if (descp->vdesc_vpp_offset != VDESC_NO_OFFSET && !error) { + if (descp->vdesc_vpp_offset != VDESC_NO_OFFSET && error == 0) { /* * XXX - even though some ops have vpp returned vp's, * several ops actually vrele this before returning. * We must avoid these ops. * (This should go away when these ops are regularized.) */ - vppp = VOPARG_OFFSETTO(struct vnode***, - descp->vdesc_vpp_offset,ap); - if (*vppp) - error = null_nodeget(old_vps[0]->v_mount, **vppp, *vppp); + vppp = VOPARG_OFFSETTO(struct vnode ***, + descp->vdesc_vpp_offset,ap); + if (*vppp != NULL) + error = null_nodeget(old_vps[0]->v_mount, **vppp, + *vppp); } return (error); @@ -419,11 +436,12 @@ null_lookup(struct vop_lookup_args *ap) * dvp to be reclaimed due to shared v_vnlock. Check for the * doomed state and return error. */ - if ((error == 0 || error == EJUSTRETURN) && - VN_IS_DOOMED(dvp)) { - error = ENOENT; - if (lvp != NULL) - vput(lvp); + if (VN_IS_DOOMED(dvp)) { + if (error == 0 || error == EJUSTRETURN) { + if (lvp != NULL) + vput(lvp); + error = ENOENT; + } /* * If vgone() did reclaimed dvp before curthread @@ -849,6 +867,7 @@ null_reclaim(struct vop_reclaim_args *ap) vp->v_data = NULL; vp->v_object = NULL; vp->v_vnlock = &vp->v_lock; +lowervp->v_upper_vnode = NULL; /* * If we were opened for write, we leased the write reference @@ -1050,6 +1069,7 @@ struct vop_vector null_vnodeops = { .vop_bypass = null_bypass, .vop_access = null_access, .vop_accessx = null_accessx, + .vop_advlock = vop_stdadvlock, .vop_advlockpurge = vop_stdadvlockpurge, .vop_bmap = VOP_EOPNOTSUPP, .vop_stat = null_stat, diff --git a/sys/fs/unionfs/union.h b/sys/fs/unionfs/union.h index 64706b2b21a2..96180480dbec 100644 --- a/sys/fs/unionfs/union.h +++ b/sys/fs/unionfs/union.h @@ -57,6 +57,8 @@ struct unionfs_mount { struct vnode *um_lowervp; /* VREFed once */ struct vnode *um_uppervp; /* VREFed once */ struct vnode *um_rootvp; /* ROOT vnode */ + struct mount_upper_node um_lower_link; /* node in lower FS list of uppers */ + struct mount_upper_node um_upper_link; /* node in upper FS list of uppers */ unionfs_copymode um_copymode; unionfs_whitemode um_whitemode; uid_t um_uid; diff --git a/sys/fs/unionfs/union_vfsops.c b/sys/fs/unionfs/union_vfsops.c index 96a30f0ae8b5..c17650dedc63 100644 --- a/sys/fs/unionfs/union_vfsops.c +++ b/sys/fs/unionfs/union_vfsops.c @@ -292,14 +292,16 @@ unionfs_domount(struct mount *mp) return (error); } - lowermp = vfs_pin_from_vp(ump->um_lowervp); - uppermp = vfs_pin_from_vp(ump->um_uppervp); + lowermp = vfs_register_upper_from_vp(ump->um_lowervp, mp, + &ump->um_lower_link); + uppermp = vfs_register_upper_from_vp(ump->um_uppervp, mp, + &ump->um_upper_link); if (lowermp == NULL || uppermp == NULL) { if (lowermp != NULL) - vfs_unpin(lowermp); + vfs_unregister_upper(lowermp, &ump->um_lower_link); if (uppermp != NULL) - vfs_unpin(uppermp); + vfs_unregister_upper(uppermp, &ump->um_upper_link); free(ump, M_UNIONFSMNT); mp->mnt_data = NULL; return (ENOENT); @@ -357,8 +359,8 @@ unionfs_unmount(struct mount *mp, int mntflags) if (error) return (error); - vfs_unpin(ump->um_lowervp->v_mount); - vfs_unpin(ump->um_uppervp->v_mount); + vfs_unregister_upper(ump->um_lowervp->v_mount, &ump->um_lower_link); + vfs_unregister_upper(ump->um_uppervp->v_mount, &ump->um_upper_link); free(ump, M_UNIONFSMNT); mp->mnt_data = NULL; diff --git a/sys/kern/vfs_default.c b/sys/kern/vfs_default.c index 63bca7810847..bd6a0f769c8d 100644 --- a/sys/kern/vfs_default.c +++ b/sys/kern/vfs_default.c @@ -556,7 +556,7 @@ vop_stdunlock(ap) } */ *ap; { struct vnode *vp = ap->a_vp; - +if (vp->v_upper_vnode != NULL) stack_save(&vp->v_upper_vnode->v_unlock_stack); return (lockmgr_unlock(vp->v_vnlock)); } diff --git a/sys/kern/vfs_mount.c b/sys/kern/vfs_mount.c index 8b4426209818..6d7bc181d4b0 100644 --- a/sys/kern/vfs_mount.c +++ b/sys/kern/vfs_mount.c @@ -65,6 +65,7 @@ __FBSDID("$FreeBSD$"); #include #include #include +#include #include #include @@ -89,6 +90,11 @@ static bool default_autoro = false; SYSCTL_BOOL(_vfs, OID_AUTO, default_autoro, CTLFLAG_RW, &default_autoro, 0, "Retry failed r/w mount as r/o if no explicit ro/rw option is specified"); +static bool recursive_forced_unmount = false; +SYSCTL_BOOL(_vfs, OID_AUTO, recursive_forced_unmount, CTLFLAG_RW, + &recursive_forced_unmount, 0, "Recursively unmount stacked upper mounts" + " when a file system is forcibly unmounted"); + MALLOC_DEFINE(M_MOUNT, "mount", "vfs mount structure"); MALLOC_DEFINE(M_STATFS, "statfs", "statfs structure"); static uma_zone_t mount_zone; @@ -103,6 +109,16 @@ MTX_SYSINIT(mountlist, &mountlist_mtx, "mountlist", MTX_DEF); EVENTHANDLER_LIST_DEFINE(vfs_mounted); EVENTHANDLER_LIST_DEFINE(vfs_unmounted); +static void vfs_deferred_unmount(void *arg, int pending); +static struct task deferred_unmount_task = + TASK_INITIALIZER(0, vfs_deferred_unmount, NULL);; +static struct mtx deferred_unmount_lock; +MTX_SYSINIT(deferred_unmount, &deferred_unmount_lock, "deferred_unmount", + MTX_DEF); +static STAILQ_HEAD(, mount) deferred_unmount_list = + STAILQ_HEAD_INITIALIZER(deferred_unmount_list); +TASKQUEUE_DEFINE_THREAD(deferred_unmount); + static void mount_devctl_event(const char *type, struct mount *mp, bool donew); /* @@ -505,8 +521,21 @@ vfs_ref(struct mount *mp) MNT_IUNLOCK(mp); } +/* + * Register ump as an upper mount of the mount associated with + * vnode vp. This registration will be tracked through + * mount_upper_node upper, which should be allocated by the + * caller and stored in per-mount data associated with mp. + * + * If successful, this function will return the mount associated + * with vp, and will ensure that it cannot be unmounted until + * ump has been unregistered as one of its upper mounts. + * + * Upon failure this function will return NULL. + */ struct mount * -vfs_pin_from_vp(struct vnode *vp) +vfs_register_upper_from_vp(struct vnode *vp, struct mount *ump, + struct mount_upper_node *upper) { struct mount *mp; @@ -514,26 +543,81 @@ vfs_pin_from_vp(struct vnode *vp) if (mp == NULL) return (NULL); MNT_ILOCK(mp); - if (mp != vp->v_mount || (mp->mnt_kern_flag & MNTK_UNMOUNT) != 0) { + if (mp != vp->v_mount || + ((mp->mnt_kern_flag & (MNTK_UNMOUNT | MNTK_RECURSE)) != 0)) { MNT_IUNLOCK(mp); return (NULL); } + KASSERT(ump != mp, ("upper and lower mounts are identical")); + upper->mp = ump; MNT_REF(mp); - KASSERT(mp->mnt_pinned_count < INT_MAX, - ("mount pinned count overflow")); - ++mp->mnt_pinned_count; + TAILQ_INSERT_TAIL(&mp->mnt_uppers, upper, mnt_upper_link); MNT_IUNLOCK(mp); return (mp); } +/* + * Register upper mount ump to receive vnode unlink/reclaim + * notifications from lower mount mp. This registration will + * be tracked through mount_upper_node upper, which should be + * allocated by the caller and stored in per-mount data + * associated with mp. + * + * ump must already be registered as an upper mount of mp + * through a call to vfs_register_upper_from_vp(). + */ void -vfs_unpin(struct mount *mp) +vfs_register_for_notification(struct mount *mp, struct mount *ump, + struct mount_upper_node *upper) +{ + upper->mp = ump; + MNT_ILOCK(mp); + TAILQ_INSERT_TAIL(&mp->mnt_notify, upper, mnt_upper_link); + MNT_IUNLOCK(mp); +} + +static void +vfs_drain_upper_locked(struct mount *mp) +{ + mtx_assert(MNT_MTX(mp), MA_OWNED); + while (mp->mnt_upper_pending != 0) { + mp->mnt_kern_flag |= MNTK_UPPER_WAITER; + msleep(&mp->mnt_uppers, MNT_MTX(mp), 0, "mntupw", 0); + } +} + +/* + * Undo a previous call to vfs_register_for_notification(). + * The mount represented by upper must be currently registered + * as an upper mount for mp. + */ +void +vfs_unregister_for_notification(struct mount *mp, + struct mount_upper_node *upper) +{ + MNT_ILOCK(mp); + vfs_drain_upper_locked(mp); + TAILQ_REMOVE(&mp->mnt_notify, upper, mnt_upper_link); + MNT_IUNLOCK(mp); +} + +/* + * Undo a previous call to vfs_register_upper_from_vp(). + * This must be done before mp can be unmounted. + */ +void +vfs_unregister_upper(struct mount *mp, struct mount_upper_node *upper) { MNT_ILOCK(mp); - KASSERT(mp->mnt_pinned_count > 0, ("mount pinned count underflow")); KASSERT((mp->mnt_kern_flag & MNTK_UNMOUNT) == 0, - ("mount pinned with pending unmount")); - --mp->mnt_pinned_count; + ("registered upper with pending unmount")); + vfs_drain_upper_locked(mp); + TAILQ_REMOVE(&mp->mnt_uppers, upper, mnt_upper_link); + if ((mp->mnt_kern_flag & MNTK_TASKQUEUE_WAITER) != 0 && + TAILQ_EMPTY(&mp->mnt_uppers)) { + mp->mnt_kern_flag &= ~MNTK_TASKQUEUE_WAITER; + wakeup(&mp->mnt_taskqueue_link); + } MNT_REL(mp); MNT_IUNLOCK(mp); } @@ -600,8 +684,10 @@ vfs_mount_alloc(struct vnode *vp, struct vfsconf *vfsp, const char *fspath, mac_mount_create(cred, mp); #endif arc4rand(&mp->mnt_hashseed, sizeof mp->mnt_hashseed, 0); + mp->mnt_upper_pending = 0; TAILQ_INIT(&mp->mnt_uppers); - mp->mnt_pinned_count = 0; + TAILQ_INIT(&mp->mnt_notify); + mp->mnt_taskqueue_flags = 0; return (mp); } @@ -640,9 +726,9 @@ vfs_mount_destroy(struct mount *mp) vn_printf(vp, "dangling vnode "); panic("unmount: dangling vnode"); } - KASSERT(mp->mnt_pinned_count == 0, - ("mnt_pinned_count = %d", mp->mnt_pinned_count)); + KASSERT(mp->mnt_upper_pending == 0, ("mnt_upper_pending")); KASSERT(TAILQ_EMPTY(&mp->mnt_uppers), ("mnt_uppers")); + KASSERT(TAILQ_EMPTY(&mp->mnt_notify), ("mnt_notify")); if (mp->mnt_nvnodelistsize != 0) panic("vfs_mount_destroy: nonzero nvnodelistsize"); if (mp->mnt_lazyvnodelistsize != 0) @@ -1799,17 +1885,166 @@ vfs_mount_fetch_counter(struct mount *mp, enum mount_counter which) return (sum); } +static bool +deferred_unmount_enqueue(struct mount *mp, uint64_t flags, bool requeue) +{ + bool enqueued; + + enqueued = false; + mtx_lock(&deferred_unmount_lock); + if ((mp->mnt_taskqueue_flags & MNT_DEFERRED) == 0 || requeue) { + mp->mnt_taskqueue_flags = flags | MNT_DEFERRED; + STAILQ_INSERT_TAIL(&deferred_unmount_list, mp, + mnt_taskqueue_link); + enqueued = true; + } + mtx_unlock(&deferred_unmount_lock); + + if (enqueued) { + taskqueue_enqueue(taskqueue_deferred_unmount, + &deferred_unmount_task); + } + + return (enqueued); +} + +/* + * Taskqueue handler for processing async/recursive unmounts + */ +static void +vfs_deferred_unmount(void *argi __unused, int pending __unused) +{ + STAILQ_HEAD(, mount) local_unmounts; + uint64_t flags; + struct mount *mp, *tmp; + bool unmounted; + + STAILQ_INIT(&local_unmounts); + mtx_lock(&deferred_unmount_lock); + STAILQ_CONCAT(&local_unmounts, &deferred_unmount_list); + mtx_unlock(&deferred_unmount_lock); + + STAILQ_FOREACH_SAFE(mp, &local_unmounts, mnt_taskqueue_link, tmp) { + flags = mp->mnt_taskqueue_flags; + KASSERT((flags & MNT_DEFERRED) != 0, + ("taskqueue unmount without MNT_DEFERRED")); + if (dounmount(mp, flags, curthread) != 0) { + MNT_ILOCK(mp); + unmounted = ((mp->mnt_kern_flag & MNTK_REFEXPIRE) != 0); + MNT_IUNLOCK(mp); + if (!unmounted) + deferred_unmount_enqueue(mp, flags, true); + else + vfs_rel(mp); + } + } +} + /* * Do the actual filesystem unmount. */ int -dounmount(struct mount *mp, int flags, struct thread *td) +dounmount(struct mount *mp, uint64_t flags, struct thread *td) { + struct mount_upper_node *upper; struct vnode *coveredvp, *rootvp; int error; uint64_t async_flag; int mnt_gen_r; + KASSERT((flags & MNT_DEFERRED) == 0 || + (flags & (MNT_RECURSE | MNT_FORCE)) == (MNT_RECURSE | MNT_FORCE), + ("MNT_DEFERRED requires MNT_RECURSE | MNT_FORCE")); + + /* + * If the caller has explicitly requested the unmount to be handled by + * the taskqueue and we're not already in taskqueue context, queue + * up the unmount request and exit. This is done prior to any + * credential checks; MNT_DEFERRED should be used only for kernel- + * initiated unmounts and will therefore be processed with the + * (kernel) credentials of the taskqueue thread. Still, callers + * should be sure this is the behavior they want. + */ + if ((flags & MNT_DEFERRED) != 0 && + taskqueue_member(taskqueue_deferred_unmount, curthread) == 0) { + if (!deferred_unmount_enqueue(mp, flags, false)) + vfs_rel(mp); + return (EINPROGRESS); + } + + /* + * Only privileged root, or (if MNT_USER is set) the user that did the + * original mount is permitted to unmount this filesystem. + * This check should be made prior to queueing up any recursive + * unmounts of upper filesystems. Those unmounts will be executed + * with kernel thread credentials and are expected to succeed, so + * we must at least ensure the originating context has sufficient + * privilege to unmount the base filesystem before proceeding with + * the uppers. + */ + error = vfs_suser(mp, td); + if (error != 0) { + KASSERT((flags & MNT_DEFERRED) == 0, + ("taskqueue unmount with insufficient privilege")); + vfs_rel(mp); + return (error); + } + + if (recursive_forced_unmount && ((flags & MNT_FORCE) != 0)) + flags |= MNT_RECURSE; + + if ((flags & MNT_RECURSE) != 0) { + KASSERT((flags & MNT_FORCE) != 0, + ("MNT_RECURSE requires MNT_FORCE")); + + MNT_ILOCK(mp); + /* + * Set MNTK_RECURSE to prevent new upper mounts from being + * added, and note that an operation on the uppers list is in + * progress. This will ensure that unregistration from the + * uppers list, and therefore any pending unmount of the upper + * FS, can't complete until after we finish walking the list. + */ + mp->mnt_kern_flag |= MNTK_RECURSE; + mp->mnt_upper_pending++; + TAILQ_FOREACH(upper, &mp->mnt_uppers, mnt_upper_link) { + MNT_IUNLOCK(mp); + vfs_ref(upper->mp); + if (!deferred_unmount_enqueue(upper->mp, flags, false)) + vfs_rel(upper->mp); + MNT_ILOCK(mp); + } + mp->mnt_upper_pending--; + if ((mp->mnt_kern_flag & MNTK_UPPER_WAITER) != 0 && + mp->mnt_upper_pending == 0) { + mp->mnt_kern_flag &= ~MNTK_UPPER_WAITER; + wakeup(&mp->mnt_uppers); + } + /* + * If we're not on the taskqueue, wait until the uppers list + * is drained before proceeding with unmount. Otherwise, if + * we are on the taskqueue and there are still pending uppers, + * just re-enqueue on the end of the taskqueue. + */ + if ((flags & MNT_DEFERRED) == 0) { + while (!TAILQ_EMPTY(&mp->mnt_uppers)) { + mp->mnt_kern_flag |= MNTK_TASKQUEUE_WAITER; + msleep(&mp->mnt_taskqueue_link, MNT_MTX(mp), 0, + "umntqw", 0); + } + } else if (!TAILQ_EMPTY(&mp->mnt_uppers)) { + MNT_IUNLOCK(mp); + deferred_unmount_enqueue(mp, flags, true); + return (0); + } + MNT_IUNLOCK(mp); + KASSERT(TAILQ_EMPTY(&mp->mnt_uppers), ("mnt_uppers not empty")); + } + + /* Allow the taskqueue to safely re-enqueue on failure */ + if ((flags & MNT_DEFERRED) != 0) + vfs_ref(mp); + if ((coveredvp = mp->mnt_vnodecovered) != NULL) { mnt_gen_r = mp->mnt_gen; VI_LOCK(coveredvp); @@ -1828,27 +2063,13 @@ dounmount(struct mount *mp, int flags, struct thread *td) } } - /* - * Only privileged root, or (if MNT_USER is set) the user that did the - * original mount is permitted to unmount this filesystem. - */ - error = vfs_suser(mp, td); - if (error != 0) { - if (coveredvp != NULL) { - VOP_UNLOCK(coveredvp); - vdrop(coveredvp); - } - vfs_rel(mp); - return (error); - } - vfs_op_enter(mp); vn_start_write(NULL, &mp, V_WAIT | V_MNTREF); MNT_ILOCK(mp); if ((mp->mnt_kern_flag & MNTK_UNMOUNT) != 0 || (mp->mnt_flag & MNT_UPDATE) != 0 || - mp->mnt_pinned_count != 0) { + !TAILQ_EMPTY(&mp->mnt_uppers)) { dounmount_cleanup(mp, coveredvp, 0); return (EBUSY); } @@ -1952,6 +2173,7 @@ dounmount(struct mount *mp, int flags, struct thread *td) } return (error); } + mtx_lock(&mountlist_mtx); TAILQ_REMOVE(&mountlist, mp, mnt_list); mtx_unlock(&mountlist_mtx); @@ -1977,6 +2199,8 @@ dounmount(struct mount *mp, int flags, struct thread *td) } if (mp == rootdevmp) rootdevmp = NULL; + if ((flags & MNT_DEFERRED) != 0) + vfs_rel(mp); vfs_mount_destroy(mp); return (0); } diff --git a/sys/kern/vfs_subr.c b/sys/kern/vfs_subr.c index a2f25bf78495..dfef7257deb9 100644 --- a/sys/kern/vfs_subr.c +++ b/sys/kern/vfs_subr.c @@ -831,9 +831,9 @@ vfs_busy(struct mount *mp, int flags) * valid. */ while (mp->mnt_kern_flag & MNTK_UNMOUNT) { - KASSERT(mp->mnt_pinned_count == 0, - ("%s: non-zero pinned count %d with pending unmount", - __func__, mp->mnt_pinned_count)); + KASSERT(TAILQ_EMPTY(&mp->mnt_uppers), + ("%s: non-empty upper mount list with pending unmount", + __func__)); if (flags & MBF_NOWAIT || mp->mnt_kern_flag & MNTK_REFEXPIRE) { MNT_REL(mp); MNT_IUNLOCK(mp); @@ -1842,6 +1842,9 @@ getnewvnode(const char *tag, struct mount *mp, struct vop_vector *vops, */ vp->v_hash = (uintptr_t)vp >> vnsz2log; +vp->v_upper_vnode = NULL; +stack_zero(&vp->v_unlock_stack); + *vpp = vp; return (0); } @@ -3891,61 +3894,44 @@ vgone(struct vnode *vp) VI_UNLOCK(vp); } -static void -notify_lowervp_vfs_dummy(struct mount *mp __unused, - struct vnode *lowervp __unused) -{ -} - /* * Notify upper mounts about reclaimed or unlinked vnode. */ void vfs_notify_upper(struct vnode *vp, int event) { - static struct vfsops vgonel_vfsops = { - .vfs_reclaim_lowervp = notify_lowervp_vfs_dummy, - .vfs_unlink_lowervp = notify_lowervp_vfs_dummy, - }; - struct mount *mp, *ump, *mmp; + struct mount *mp; + struct mount_upper_node *ump; - mp = vp->v_mount; + mp = atomic_load_ptr(&vp->v_mount); if (mp == NULL) return; - if (TAILQ_EMPTY(&mp->mnt_uppers)) + if (TAILQ_EMPTY(&mp->mnt_notify)) return; - mmp = malloc(sizeof(struct mount), M_TEMP, M_WAITOK | M_ZERO); - mmp->mnt_op = &vgonel_vfsops; - mmp->mnt_kern_flag |= MNTK_MARKER; MNT_ILOCK(mp); - mp->mnt_kern_flag |= MNTK_VGONE_UPPER; - for (ump = TAILQ_FIRST(&mp->mnt_uppers); ump != NULL;) { - if ((ump->mnt_kern_flag & MNTK_MARKER) != 0) { - ump = TAILQ_NEXT(ump, mnt_upper_link); - continue; - } - TAILQ_INSERT_AFTER(&mp->mnt_uppers, ump, mmp, mnt_upper_link); + mp->mnt_upper_pending++; + KASSERT(mp->mnt_upper_pending > 0, + ("%s: mnt_upper_pending %d", __func__, mp->mnt_upper_pending)); + TAILQ_FOREACH(ump, &mp->mnt_notify, mnt_upper_link) { MNT_IUNLOCK(mp); switch (event) { case VFS_NOTIFY_UPPER_RECLAIM: - VFS_RECLAIM_LOWERVP(ump, vp); + VFS_RECLAIM_LOWERVP(ump->mp, vp); break; case VFS_NOTIFY_UPPER_UNLINK: - VFS_UNLINK_LOWERVP(ump, vp); + VFS_UNLINK_LOWERVP(ump->mp, vp); break; default: KASSERT(0, ("invalid event %d", event)); break; } MNT_ILOCK(mp); - ump = TAILQ_NEXT(mmp, mnt_upper_link); - TAILQ_REMOVE(&mp->mnt_uppers, mmp, mnt_upper_link); } - free(mmp, M_TEMP); - mp->mnt_kern_flag &= ~MNTK_VGONE_UPPER; - if ((mp->mnt_kern_flag & MNTK_VGONE_WAITER) != 0) { - mp->mnt_kern_flag &= ~MNTK_VGONE_WAITER; + mp->mnt_upper_pending--; + if ((mp->mnt_kern_flag & MNTK_UPPER_WAITER) != 0 && + mp->mnt_upper_pending == 0) { + mp->mnt_kern_flag &= ~MNTK_UPPER_WAITER; wakeup(&mp->mnt_uppers); } MNT_IUNLOCK(mp); @@ -4376,12 +4362,12 @@ DB_SHOW_COMMAND(mount, db_show_mount) MNT_KERN_FLAG(MNTK_EXTENDED_SHARED); MNT_KERN_FLAG(MNTK_SHARED_WRITES); MNT_KERN_FLAG(MNTK_NO_IOPF); - MNT_KERN_FLAG(MNTK_VGONE_UPPER); - MNT_KERN_FLAG(MNTK_VGONE_WAITER); + MNT_KERN_FLAG(MNTK_RECURSE); + MNT_KERN_FLAG(MNTK_UPPER_WAITER); MNT_KERN_FLAG(MNTK_LOOKUP_EXCL_DOTDOT); - MNT_KERN_FLAG(MNTK_MARKER); MNT_KERN_FLAG(MNTK_USES_BCACHE); MNT_KERN_FLAG(MNTK_FPLOOKUP); + MNT_KERN_FLAG(MNTK_TASKQUEUE_WAITER); MNT_KERN_FLAG(MNTK_NOASYNC); MNT_KERN_FLAG(MNTK_UNMOUNT); MNT_KERN_FLAG(MNTK_MWAIT); diff --git a/sys/sys/mount.h b/sys/sys/mount.h index 693293b12370..016c7e9c188d 100644 --- a/sys/sys/mount.h +++ b/sys/sys/mount.h @@ -190,6 +190,19 @@ struct mount_pcpu { _Static_assert(sizeof(struct mount_pcpu) == 16, "the struct is allocated from pcpu 16 zone"); +/* + * Structure for tracking a stacked filesystem mounted above another + * filesystem. This is expected to be stored in the upper FS' per-mount data. + * + * Lock reference: + * i - lower mount interlock + * c - constant from node initialization + */ +struct mount_upper_node { + struct mount *mp; /* (c) mount object for upper FS */ + TAILQ_ENTRY(mount_upper_node) mnt_upper_link; /* (i) position in uppers list */ +}; + /* * Structure per mounted filesystem. Each mounted filesystem has an * array of operations and an instance record. The filesystems are @@ -199,8 +212,8 @@ _Static_assert(sizeof(struct mount_pcpu) == 16, * l - mnt_listmtx * m - mountlist_mtx * i - interlock - * i* - interlock of uppers' list head * v - vnode freelist mutex + * d - deferred unmount list mutex * * Unmarked fields are considered stable as long as a ref is held. * @@ -242,10 +255,12 @@ struct mount { struct mtx mnt_listmtx; struct vnodelst mnt_lazyvnodelist; /* (l) list of lazy vnodes */ int mnt_lazyvnodelistsize; /* (l) # of lazy vnodes */ - int mnt_pinned_count; /* (i) unmount prevented */ + int mnt_upper_pending; /* (i) # of pending ops on mnt_uppers */ struct lock mnt_explock; /* vfs_export walkers lock */ - TAILQ_ENTRY(mount) mnt_upper_link; /* (i*) we in the all uppers */ - TAILQ_HEAD(, mount) mnt_uppers; /* (i) upper mounts over us */ + TAILQ_HEAD(, mount_upper_node) mnt_uppers; /* (i) upper mounts over us */ + TAILQ_HEAD(, mount_upper_node) mnt_notify; /* (i) upper mounts for notification */ + STAILQ_ENTRY(mount) mnt_taskqueue_link; /* (d) our place in deferred unmount list */ + uint64_t mnt_taskqueue_flags; /* (d) unmount flags passed from taskqueue */ }; #endif /* _WANT_MOUNT || _KERNEL */ @@ -438,9 +453,13 @@ struct mntoptnames { #define MNT_BYFSID 0x0000000008000000ULL /* specify filesystem by ID. */ #define MNT_NOCOVER 0x0000001000000000ULL /* Do not cover a mount point */ #define MNT_EMPTYDIR 0x0000002000000000ULL /* Only mount on empty dir */ -#define MNT_CMDFLAGS (MNT_UPDATE | MNT_DELEXPORT | MNT_RELOAD | \ +#define MNT_RECURSE 0x0000100000000000ULL /* recursively unmount uppers */ +#define MNT_DEFERRED 0x0000200000000000ULL /* unmount in async context */ +#define MNT_CMDFLAGS (MNT_UPDATE | MNT_DELEXPORT | MNT_RELOAD | \ MNT_FORCE | MNT_SNAPSHOT | MNT_NONBUSY | \ - MNT_BYFSID | MNT_NOCOVER | MNT_EMPTYDIR) + MNT_BYFSID | MNT_NOCOVER | MNT_EMPTYDIR | \ + MNT_RECURSE | MNT_DEFERRED) + /* * Internal filesystem control flags stored in mnt_kern_flag. * @@ -466,10 +485,9 @@ struct mntoptnames { #define MNTK_NO_IOPF 0x00000100 /* Disallow page faults during reads and writes. Filesystem shall properly handle i/o state on EFAULT. */ -#define MNTK_VGONE_UPPER 0x00000200 -#define MNTK_VGONE_WAITER 0x00000400 +#define MNTK_RECURSE 0x00000200 /* pending recursive unmount */ +#define MNTK_UPPER_WAITER 0x00000400 /* waiting to drain MNTK_UPPER_PENDING */ #define MNTK_LOOKUP_EXCL_DOTDOT 0x00000800 -#define MNTK_MARKER 0x00001000 #define MNTK_UNMAPPED_BUFS 0x00002000 #define MNTK_USES_BCACHE 0x00004000 /* FS uses the buffer cache. */ #define MNTK_TEXT_REFS 0x00008000 /* Keep use ref for text */ @@ -477,8 +495,9 @@ struct mntoptnames { #define MNTK_UNIONFS 0x00020000 /* A hack for F_ISUNIONSTACK */ #define MNTK_FPLOOKUP 0x00040000 /* fast path lookup is supported */ #define MNTK_SUSPEND_ALL 0x00080000 /* Suspended by all-fs suspension */ -#define MNTK_NOASYNC 0x00800000 /* disable async */ -#define MNTK_UNMOUNT 0x01000000 /* unmount in progress */ +#define MNTK_TASKQUEUE_WAITER 0x00100000 /* Waiting on unmount taskqueue */ +#define MNTK_NOASYNC 0x00800000 /* disable async */ +#define MNTK_UNMOUNT 0x01000000 /* unmount in progress */ #define MNTK_MWAIT 0x02000000 /* waiting for unmount to finish */ #define MNTK_SUSPEND 0x08000000 /* request write suspension */ #define MNTK_SUSPEND2 0x04000000 /* block secondary writes */ @@ -952,7 +971,7 @@ vfs_statfs_t __vfs_statfs; * exported vnode operations */ -int dounmount(struct mount *, int, struct thread *); +int dounmount(struct mount *, uint64_t, struct thread *); int kernel_mount(struct mntarg *ma, uint64_t flags); int kernel_vmount(int flags, ...); @@ -1012,8 +1031,13 @@ struct mount *vfs_mount_alloc(struct vnode *, struct vfsconf *, const char *, int vfs_suser(struct mount *, struct thread *); void vfs_unbusy(struct mount *); void vfs_unmountall(void); -struct mount *vfs_pin_from_vp(struct vnode *); -void vfs_unpin(struct mount *); +struct mount *vfs_register_upper_from_vp(struct vnode *, + struct mount *ump, struct mount_upper_node *); +void vfs_register_for_notification(struct mount *, struct mount *, + struct mount_upper_node *); +void vfs_unregister_for_notification(struct mount *, + struct mount_upper_node *); +void vfs_unregister_upper(struct mount *, struct mount_upper_node *); extern TAILQ_HEAD(mntlist, mount) mountlist; /* mounted filesystem list */ extern struct mtx_padalign mountlist_mtx; extern struct nfs_public nfs_pub; diff --git a/sys/sys/vnode.h b/sys/sys/vnode.h index 64fb00c5845e..9b79f855927b 100644 --- a/sys/sys/vnode.h +++ b/sys/sys/vnode.h @@ -100,6 +100,7 @@ struct vpollinfo { #if defined(_KERNEL) || defined(_KVM_VNODE) +#include struct vnode { /* * Fields which define the identity of the vnode. These fields are @@ -173,6 +174,9 @@ struct vnode { int v_writecount; /* I ref count of writers or (negative) text users */ int v_seqc_users; /* i modifications pending */ + +struct stack v_unlock_stack; +struct vnode *v_upper_vnode; }; #ifndef DEBUG_LOCKS @@ -182,7 +186,7 @@ struct vnode { * to the structure and there is nothing which can be done to prevent growth * then so be it. But don't grow it without a good reason. */ -_Static_assert(sizeof(struct vnode) <= 448, "vnode size crosses 448 bytes"); +//_Static_assert(sizeof(struct vnode) <= 448, "vnode size crosses 448 bytes"); #endif #endif diff --git a/sys/ufs/ffs/ffs_vfsops.c b/sys/ufs/ffs/ffs_vfsops.c index 6b7407eb88f9..2ff71cc3e4d1 100644 --- a/sys/ufs/ffs/ffs_vfsops.c +++ b/sys/ufs/ffs/ffs_vfsops.c @@ -281,28 +281,8 @@ ffs_check_blkno(struct mount *mp, ino_t inum, ufs2_daddr_t daddr, int blksize) } /* - * Initiate a forcible unmount. + * On first ENXIO error, initiate an asynchronous forcible unmount. * Used to unmount filesystems whose underlying media has gone away. - */ -static void -ffs_fsfail_unmount(void *v, int pending) -{ - struct fsfail_task *etp; - struct mount *mp; - - etp = v; - - /* - * Find our mount and get a ref on it, then try to unmount. - */ - mp = vfs_getvfs(&etp->fsid); - if (mp != NULL) - dounmount(mp, MNT_FORCE, curthread); - free(etp, M_UFSMNT); -} - -/* - * On first ENXIO error, start a task that forcibly unmounts the filesystem. * * Return true if a cleanup is in progress. */ @@ -320,25 +300,18 @@ ffs_fsfail_cleanup(struct ufsmount *ump, int error) int ffs_fsfail_cleanup_locked(struct ufsmount *ump, int error) { - struct fsfail_task *etp; - struct task *tp; - mtx_assert(UFS_MTX(ump), MA_OWNED); if (error == ENXIO && (ump->um_flags & UM_FSFAIL_CLEANUP) == 0) { ump->um_flags |= UM_FSFAIL_CLEANUP; /* * Queue an async forced unmount. */ - etp = ump->um_fsfail_task; - ump->um_fsfail_task = NULL; - if (etp != NULL) { - tp = &etp->task; - TASK_INIT(tp, 0, ffs_fsfail_unmount, etp); - taskqueue_enqueue(taskqueue_thread, tp); - printf("UFS: forcibly unmounting %s from %s\n", - ump->um_mountp->mnt_stat.f_mntfromname, - ump->um_mountp->mnt_stat.f_mntonname); - } + vfs_ref(ump->um_mountp); + dounmount(ump->um_mountp, + MNT_FORCE | MNT_RECURSE | MNT_DEFERRED, curthread); + printf("UFS: forcibly unmounting %s from %s\n", + ump->um_mountp->mnt_stat.f_mntfromname, + ump->um_mountp->mnt_stat.f_mntonname); } return ((ump->um_flags & UM_FSFAIL_CLEANUP) != 0); } @@ -1046,7 +1019,6 @@ ffs_mountfs(odevvp, mp, td) struct g_consumer *cp; struct mount *nmp; struct vnode *devvp; - struct fsfail_task *etp; int candelete, canspeedup; off_t loc; @@ -1334,9 +1306,6 @@ ffs_mountfs(odevvp, mp, td) (void) ufs_extattr_autostart(mp, td); #endif /* !UFS_EXTATTR_AUTOSTART */ #endif /* !UFS_EXTATTR */ - etp = malloc(sizeof *ump->um_fsfail_task, M_UFSMNT, M_WAITOK | M_ZERO); - etp->fsid = mp->mnt_stat.f_fsid; - ump->um_fsfail_task = etp; return (0); out: if (fs != NULL) { @@ -1583,8 +1552,6 @@ ffs_unmount(mp, mntflags) free(fs->fs_csp, M_UFSMNT); free(fs->fs_si, M_UFSMNT); free(fs, M_UFSMNT); - if (ump->um_fsfail_task != NULL) - free(ump->um_fsfail_task, M_UFSMNT); free(ump, M_UFSMNT); mp->mnt_data = NULL; MNT_ILOCK(mp); diff --git a/sys/ufs/ufs/ufsmount.h b/sys/ufs/ufs/ufsmount.h index 6071faec795c..f2951d74d44c 100644 --- a/sys/ufs/ufs/ufsmount.h +++ b/sys/ufs/ufs/ufsmount.h @@ -67,10 +67,6 @@ struct inodedep; TAILQ_HEAD(inodedeplst, inodedep); LIST_HEAD(bmsafemaphd, bmsafemap); LIST_HEAD(trimlist_hashhead, ffs_blkfree_trim_params); -struct fsfail_task { - struct task task; - fsid_t fsid; -}; #include #include @@ -123,7 +119,6 @@ struct ufsmount { struct taskqueue *um_trim_tq; /* (c) trim request queue */ struct trimlist_hashhead *um_trimhash; /* (i) trimlist hash table */ u_long um_trimlisthashsize; /* (i) trim hash table size-1 */ - struct fsfail_task *um_fsfail_task; /* (i) task for fsfail cleanup*/ /* (c) - below function ptrs */ int (*um_balloc)(struct vnode *, off_t, int, struct ucred *, int, struct buf **); -- Test scenario: misc/force4.sh