panic: cache_fplookup_next: invalidated entry 0xfffff8057d43a6e8 found but vnode state does not match, vmcore.274 KDB: debugger backends: ddb KDB: current backend: ddb ---<>--- Copyright (c) 1992-2021 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 14.0-CURRENT #0 main-n244506-d4a6843bb12-dirty: Fri Jan 29 10:38:22 CET 2021 pho@mercat1.netperf.freebsd.org:/usr/src/sys/amd64/compile/PHO amd64 FreeBSD clang version 11.0.1 (git@github.com:llvm/llvm-project.git llvmorg-11.0.1-rc2-0-g43ff75f2c3f) WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. VT(vga): resolution 640x480 CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.06-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics real memory = 34359738368 (32768 MB) avail memory = 33178238976 (31641 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 12 CPUs FreeBSD/SMP: 1 package(s) x 6 core(s) x 2 hardware threads random: registering fast source Intel Secure Key RNG random: fast provider: "Intel Secure Key RNG" random: unblocking device. ioapic0 irqs 0-23 ioapic1 irqs 24-47 Launching APs: 1 3 7 5 4 8 10 6 2 11 9 Timecounter "TSC-low" frequency 1750032126 Hz quality 1000 KTLS: Initialized 12 threads random: entropy device external interface WARNING: Device "kbd" is Giant locked and may be deleted before FreeBSD 13.0. kbd1 at kbdmux0 000.000054 [4350] netmap_init netmap: loaded module [ath_hal] loaded nexus0 vtvga0: cryptosoft0: aesni0: acpi0: acpi0: Power Button (fixed) cpu0: on acpi0 atrtc0: port 0x70-0x71,0x74-0x77 irq 8 on acpi0 atrtc0: registered as a time-of-day clock, resolution 1.000000s Event timer "RTC" frequency 32768 Hz quality 0 attimer0: port 0x40-0x43,0x50-0x53 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Event timer "HPET" frequency 14318180 Hz quality 350 Event timer "HPET1" frequency 14318180 Hz quality 340 Event timer "HPET2" frequency 14318180 Hz quality 340 Event timer "HPET3" frequency 14318180 Hz quality 340 Event timer "HPET4" frequency 14318180 Hz quality 340 Event timer "HPET5" frequency 14318180 Hz quality 340 Event timer "HPET6" frequency 14318180 Hz quality 340 Event timer "HPET7" frequency 14318180 Hz quality 340 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 pcib0: on acpi0 pci0: on pcib0 pci0: at device 11.1 (no driver attached) pci0: at device 11.2 (no driver attached) pci0: at device 16.1 (no driver attached) pci0: at device 16.6 (no driver attached) pci0: at device 18.1 (no driver attached) acpi_syscontainer0: on acpi0 acpi_syscontainer1: on acpi0 acpi_syscontainer2: on acpi0 acpi_syscontainer3: on acpi0 apei0: on acpi0 pcib1: port 0xcf8-0xcff on acpi0 pci1: on pcib1 pcib2: irq 26 at device 1.0 on pci1 pci2: on pcib2 pcib3: irq 32 at device 2.0 on pci1 pci3: on pcib3 pci3: at device 0.0 (no driver attached) pci3: at device 0.1 (no driver attached) pcib4: irq 40 at device 3.0 on pci1 pci4: on pcib4 pci1: at device 17.0 (no driver attached) ahci0: port 0xf110-0xf117,0xf100-0xf103,0xf0f0-0xf0f7,0xf0e0-0xf0e3,0xf020-0xf03f mem 0xfb438000-0xfb4387ff irq 16 at device 17.4 on pci1 ahci0: AHCI v1.30 with 4 6Gbps ports, Port Multiplier not supported ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahcich2: at channel 2 on ahci0 ahcich3: at channel 3 on ahci0 ahciem0: on ahci0 xhci0: mem 0xfb400000-0xfb40ffff irq 19 at device 20.0 on pci1 xhci0: 32 bytes context size, 64-bit DMA usbus0 on xhci0 usbus0: 5.0Gbps Super Speed USB v3.0 pci1: at device 22.0 (no driver attached) pci1: at device 22.1 (no driver attached) ehci0: mem 0xfb434000-0xfb4343ff irq 18 at device 26.0 on pci1 usbus1: EHCI version 1.0 usbus1 on ehci0 usbus1: 480Mbps High Speed USB v2.0 pcib5: irq 16 at device 28.0 on pci1 pci5: on pcib5 pcib6: irq 18 at device 28.2 on pci1 pci6: on pcib6 pcib7: at device 0.0 on pci6 pci7: on pcib7 vgapci0: port 0xe000-0xe07f mem 0xfa000000-0xfaffffff,0xfb000000-0xfb01ffff irq 18 at device 0.0 on pci7 vgapci0: Boot video device pcib8: irq 16 at device 28.4 on pci1 pci8: on pcib8 igb0: port 0xd020-0xd03f mem 0xfb320000-0xfb33ffff,0xfb344000-0xfb347fff irq 16 at device 0.0 on pci8 igb0: Using 1024 TX descriptors and 1024 RX descriptors igb0: queue equality override not set, capping rx_queues at 6 and tx_queues at** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 68 files, 759 used, 1264648 free (96 frags, 158069 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** Updating CPU Microcode... ugen0.3: at usbus0 ukbd0 on uhub3 ukbd0: on usbus0 kbd2 at ukbd0 CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.06-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab Structured Extended Features3=0x9c000400 XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics Done. Setting up harvesting: PURE_RDRAND,[UMA],[FS_ATIME],SWI,INTERRUPT,NET_NG,[NET_ETHER],NET_TUN,MOUSE,KEYBOARD,ATTACH,CACHED Feeding entropy: . ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat/pkg /usr/local/lib/compat /usr/local/lib/compat/pkg /usr/local/lib/e2fsprogs /usr/local/lib/gcc8 /usr/local/lib/gcc9 /usr/local/lib/perl5/5.30/mach/CORE 32-bit compatibility ldconfig path: /usr/lib32 /usr/local/lib32/compat Setting hostname: mercat1.netperf.freebsd.org. Autoloading module: acpi_wmi.ko Autoloading module: ichsmb.ko Autoloading module: ioat.ko ioat0: mem 0xfb42c000-0xfb42ffff irq 31 at device 4.0 on pci1 ioat0: Capabilities: 2f7 ioat1: mem 0xfb428000-0xfb42bfff irq 39 at device 4.1 on pci1 ioat1: Capabilities: 2f7 ioat2: mem 0xfb424000-0xfb427fff irq 31 at device 4.2 on pci1 ioat2: Capabilities: f7 ioat3: mem 0xfb420000-0xfb423fff irq 39 at device 4.3 on pci1 ioat3: Capabilities: f7 ioat4: mem 0xfb41c000-0xfb41ffff irq 31 at device 4.4 on pci1 ioat4: Capabilities: f7 ioat5: mem 0xfb418000-0xfb41bfff irq 39 at device 4.5 on pci1 ioat5: Capabilities: f7 ioat6: mem 0xfb414000-0xfb417fff irq 31 at device 4.6 on pci1 ioat6: Capabilities: f7 ioat7: mem 0xfb410000-0xfb413fff irq 39 at device 4.7 on pci1 ioat7: Capabilities: f7 ichsmb0: port 0x580-0x59f mem 0xfb431000-0xfb4310ff irq 18 at device 31.3 on pci1 smbus0: on ichsmb0 acpi_wmi0: on acpi0 acpi_wmi0: cannot find EC device lo0: link state changed to UP Autoloading module: acpi_wmi.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Starting Network: igb1. igb1: flags=8822 metric 0 mtu 1500 options=4e507bb ether 0c:c4:7a:a8:cd:db media: Ethernet autoselect status: no carrier nd6 options=29 Autoloading module: ichsmb.ko Autoloading module: uhid.ko Autoloading module: ums.ko Autoloading module: usbhid.ko ums0 on uhub3 ums0: on usbus0 ums0: 3 buttons and [Z] coordinates ID=0 Starting dhclient. DHCPREQUEST on igb0 to 255.255.255.255 port 67 DHCPACK from 192if_delmulti_locked: detaching ifnet instance 0xfffff800044a4800 .168.5.1 bound to 192.168.5.171 -- renewal in 300 seconds. add host 127.0.0.1: gateway lo0 fib 0: route already in table add host ::1: gateway lo0 fib 0: route already in table add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Updating motd:. Recovering vi editor sessions:. Creating and/or trimming log files. Clearing /tmp (X related). Starting syslogd. Setting date via ntp. 29 Jan 10:41:03 ntpdate[2362]: step time server 192.168.5.1 offset -0.900458 sec Starting watchdogd. No core dumps found. Starting rpcbind. NFS access cache time=60 Starting statd. Starting lockd. Mounting late filesystems:. Security policy loaded: MAC/ntpd (mac_ntpd) Starting ntpd. Starting powerd. Performing sanity check on sshd configuration. Starting sshd. Configuring vt: blanktime. Starting cron. Starting inetd. sysctl: unknown oid 'debug.fail_point.pmap_allocpte_page_alloc' at line 12 Fri Jan 29 10:41 FreeBSD/amd64 (mercat1.netperf.freebsd.org) (ttyu1) login: root Jan 29 10:41:07 mercat1 login[2514]: ROOT LOGIN (root) ON ttyu1 Last login: Fri Jan 29 08:16:10 on ttyu1 FreeBSD 14.0-CURRENT (PHO) #0 main-n244506-d4a6843bb12-dirty: Fri Jan 29 10:38:22 CET 2021 root@mercat1:~ # Jan 29 10:41:12 mercat1 su[2528]: pho to root on /dev/pts/0 20210129 10:41:26 all (1/1): rename2.sh 20210129 11:39:59 *** Excessive run time: rename2.sh, 58 min stress2: pts leak: 1/2 20210129 11:39:59 all.sh done, elapsed 0 day(s), 00:58.33 20210129 12:43:43 all (1/733): 1st.sh 20210129 12:43:45 all (2/733): 256m.sh 20210129 12:43:47 all (3/733): audit.sh 20210129 12:43:48 all (4/733): beneath3.sh 20210129 12:43:50 all (5/733): beneath4.sh stress2: freework leak: 3/6. stress2: newblk leak: 1/5. 20210129 12:43:52 all (6/733): buildworld.sh 20210129 12:43:54 all (7/733): buildworld2.sh 20210129 12:43:56 all (8/733): cpuset.sh 20210129 12:43:57 all (9/733): crossmp2.sh 20210129 12:43:59 all (10/733): crossmp6.sh 20210129 12:44:01 all (11/733): datagram2.sh 20210129 12:44:03 all (12/733): datagram3.sh 20210129 12:44:04 all (13/733): datamove.sh stress2: freework leak: 8/11. 20210129 12:44:06 all (14/733): datamove3.sh 20210129 12:44:08 all (15/733): devfs2.sh 20210129 12:44:10 all (16/733): devfs5.sh 20210129 12:44:11 all (17/733): dtrace_fault.sh 20210129 12:44:13 all (18/733): dumpfs.sh 20210129 12:44:15 all (19/733): dup2.sh 20210129 12:44:17 all (20/733): execi386.sh stress2: freework leak: 1/4. 20210129 12:44:19 all (21/733): extattr_set_fd.sh 20210129 12:44:21 all (22/733): extattrctl.sh lock order reversal: 1st 0xfffff8068c86fe40 ufs_extattr_sx (ufs_extattr_sx, sx) @ ufs/ufs/ufs_extattr.c:119 2nd 0xfffff8029ffb8cf0 ufs (ufs, lockmgr) @ ufs/ffs/ffs_vfsops.c:2007 lock order ufs -> ufs_extattr_sx established at: #0 0xffffffff80c6d27d at witness_checkorder+0x46d #1 0xffffffff80c08457 at _sx_xlock+0x67 #2 0xffffffff80ed7622 at ufs_extattr_vnode_inactive+0x42 #3 0xffffffff80ed7f97 at ufs_inactive+0x217 #4 0xffffffff8112ddb9 at VOP_INACTIVE_APV+0x59 #5 0xffffffff80ce9f25 at vinactivef+0xf5 #6 0xffffffff80ce964a at vput_final+0x25a #7 0xffffffff80cfd304 at kern_frmdirat+0x1e4 #8 0xffffffff81069057 at amd64_syscall+0x147 #9 0xffffffff8103c2be at fast_syscall_common+0xf8 lock order ufs_extattr_sx -> ufs attempted at: #0 0xffffffff80c6dbdc at witness_checkorder+0xdcc #1 0xffffffff80bce13c at lockmgr_xlock_hard+0x6c #2 0xffffffff80bcee85 at __lockmgr_args+0x625 #3 0xffffffff80eca2cd at ffs_vgetf+0x15d #4 0xffffffff80edf2bb at ufs_root+0x1b #5 0xffffffff80cee5c0 at vfs_cache_root_fallback+0x120 #6 0xffffffff80ed614f at ufs_extattr_autostart+0x5f #7 0xffffffff80ecc849 at ffs_mount+0x1d99 #8 0xffffffff80cdecef at vfs_domount+0x8af #9 0xffffffff80cdd762 at vfs_donmount+0x872 #10 0xffffffff80cdceb9 at sys_nmount+0x69 #11 0xffffffff81069057 at amd64_syscall+0x147 #12 0xffffffff8103c2be at fast_syscall_common+0xf8 20210129 12:44:22 all (23/733): fcntl3.sh 20210129 12:44:24 all (24/733): fexecve.sh 20210129 12:44:26 all (25/733): fifo.sh 20210129 12:44:28 all (26/733): fsck2.sh 20210129 12:44:29 all (27/733): fsck3.sh Superblock check-hash failed: recorded check-hash 0xd9a020c8 != computed check-hash 0xbfa7f440 (Ignored) Superblock check-hash failed: recorded check-hash 0xd9a020c8 != computed check-hash 0xbfa7f440 (Ignored) Superblock check-hash failed: recorded check-hash 0xd9a020c8 != computed check-hash 0xa50d017e (Ignored) Superblock check-hash failed: recorded check-hash 0xd9a020c8 != computed check-hash 0xa50d017e (Ignored) Superblock check-hash failed: recorded check-hash 0xd9a020c8 != computed check-hash 0x1be83a8b (Ignored) Superblock check-hash failed: recorded check-hash 0xd9a020c8 != computed check-hash 0x1be83a8b (Ignored) Superblock check-hash failed: recorded check-hash 0xd9a020c8 != computed check-hash 0x37189ceb (Ignored) Superblock check-hash failed: recorded check-hash 0xd9a020c8 != computed check-hash 0x37189ceb (Ignored) 20210129 12:44:31 all (28/733): fsck4.sh 20210129 12:44:33 all (29/733): gnop3.sh 20210129 12:44:35 all (30/733): gnop5.sh GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. 20210129 12:44:37 all (31/733): holdcnt0.sh 20210129 12:44:38 all (32/733): holdcnt02.sh 20210129 12:44:40 all (33/733): holdcnt03.sh 20210129 12:44:42 all (34/733): holdcnt04.sh 20210129 12:44:43 all (35/733): holdcnt05.sh 20210129 12:44:45 all (36/733): isofs2.sh lock order reversal: 1st 0xfffff80009917570 ufs (ufs, lockmgr) @ kern/vfs_mount.c:1742 2nd 0xfffff80009326570 devfs (devfs, lockmgr) @ kern/vfs_subr.c:3133 lock order devfs -> ufs established at: #0 0xffffffff80c6d27d at witness_checkorder+0x46d #1 0xffffffff80bcda32 at lockmgr_lock_flags+0x172 #2 0xffffffff80ecf15d at ffs_lock+0x9d #3 0xffffffff8112e220 at VOP_LOCK1_APV+0x40 #4 0xffffffff80d00d84 at _vn_lock+0x54 #5 0xffffffff80cdf341 at vfs_domount+0xf01 #6 0xffffffff80cdd762 at vfs_donmount+0x872 #7 0xffffffff80ce1f07 at kernel_mount+0x57 #8 0xffffffff80ce48d1 at parse_mount+0x4a1 #9 0xffffffff80ce2d37 at vfs_mountroot+0x587 #10 0xffffffff80b8be4f at start_init+0x1f #11 0xffffffff80bb81b0 at fork_exit+0x80 #12 0xffffffff8103ca1e at fork_trampoline+0xe lock order ufs -> devfs attempted at: #0 0xffffffff80c6dbdc at witness_checkorder+0xdcc #1 0xffffffff80bcda32 at lockmgr_lock_flags+0x172 #2 0xffffffff8112e220 at VOP_LOCK1_APV+0x40 #3 0xffffffff80d00d84 at _vn_lock+0x54 #4 0xffffffff80ce9503 at vput_final+0x113 #5 0xffffffff80b7ecc1 at cd9660_unmount+0xb1 #6 0xffffffff80ce042b at dounmount+0x43b #7 0xffffffff80cdff7c at kern_unmount+0x2fc #8 0xffffffff81069057 at amd64_syscall+0x147 #9 0xffffffff8103c2be at fast_syscall_common+0xf8 stress2: freework leak: 11/14. stress2: newblk leak: 10/14. 20210129 12:44:47 all (37/733): jail2.sh 20210129 12:44:49 all (38/733): jail3.sh 20210129 12:44:50 all (39/733): jail4.sh 20210129 12:44:52 all (40/733): jexec.sh 20210129 12:44:54 all (41/733): kern_umtx_inf_loop.sh 20210129 12:44:56 all (42/733): kevent10.sh 20210129 12:44:57 all (43/733): kevent3.sh 20210129 12:44:59 all (44/733): ldt.sh 20210129 12:45:01 all (45/733): ldt2.sh 20210129 12:45:03 all (46/733): libMicro.sh 20210129 12:45:04 all (47/733): linux.sh 20210129 12:45:06 all (48/733): lockd.sh 20210129 12:45:08 all (49/733): lockf.sh 20210129 12:45:09 all (50/733): lookup_shared.sh 20210129 12:45:11 all (51/733): mac.sh 20210129 12:45:13 all (52/733): mac_chkexec.sh 20210129 12:45:14 all (53/733): machipc.sh 20210129 12:45:16 all (54/733): machipc2.sh 20210129 12:45:18 all (55/733): maxmemdom.sh 20210129 12:45:19 all (56/733): md4.sh 20210129 12:45:21 all (57/733): md5.sh stress2: freework leak: 12/15. stress2: newblk leak: 146/152. stress2: indirdep leak: 1/1 20210129 12:45:23 all (58/733): md6.sh 20210129 12:45:25 all (59/733): mdconfig.sh 20210129 12:45:26 all (60/733): mdconfig3.sh stress2: freework leak: 12/15. stress2: newblk leak: 147/152. stress2: indirdep leak: 1/1 20210129 12:45:28 all (61/733): memguard4.sh 20210129 12:45:30 all (62/733): mkfifo5.sh 20210129 12:45:32 all (63/733): mkfifo7.sh 20210129 12:45:33 all (64/733): mlockall5.sh stress2: newblk leak: 2/8. 20210129 12:45:35 all (65/733): mmap.sh 20210129 12:45:37 all (66/733): mmap12.sh 20210129 12:45:39 all (67/733): mmap16.sh 20210129 12:45:40 all (68/733): mmap17.sh 20210129 12:45:42 all (69/733): mmap20.sh 20210129 12:45:44 all (70/733): mmap28.sh 20210129 12:45:46 all (71/733): mmap30.sh 20210129 12:45:47 all (72/733): mmap33.sh stress2: newblk leak: 2/7. stress2: indirdep leak: 1/1 20210129 12:45:49 all (73/733): mmap35.sh 20210129 12:45:51 all (74/733): mmap36.sh stress2: newblk leak: 2/6. 20210129 12:45:52 all (75/733): mount.sh stress2: indirdep leak: 1/1 20210129 12:45:54 all (76/733): mprotect.sh 20210129 12:45:56 all (77/733): msdos2.sh 20210129 12:45:58 all (78/733): msdos3.sh stress2: newblk leak: 1/6. 20210129 12:45:59 all (79/733): msdos7.sh lock order reversal: 1st 0xfffff8068ca4f2f0 msdosfs (msdosfs, lockmgr) @ kern/vfs_syscalls.c:3498 2nd 0xfffff800097b3a70 devfs (devfs, lockmgr) @ fs/msdosfs/msdosfs_vnops.c:853 lock order msdosfs -> devfs attempted at: #0 0xffffffff80c6dbdc at witness_checkorder+0xdcc #1 0xffffffff80bcf505 at lockmgr_xlock+0x55 #2 0xffffffff8112e220 at VOP_LOCK1_APV+0x40 #3 0xffffffff80d00d84 at _vn_lock+0x54 #4 0xffffffff80aa322c at msdosfs_fsync+0x4c #5 0xffffffff8112ce59 at VOP_FSYNC_APV+0x59 #6 0xffffffff80cfc762 at kern_fsync+0x1c2 #7 0xffffffff81069057 at amd64_syscall+0x147 #8 0xffffffff8103c2be at fast_syscall_common+0xf8 20210129 12:46:01 all (80/733): msdos8.sh 20210129 12:46:03 all (81/733): msetdomain.sh 20210129 12:46:05 all (82/733): nanosleep.sh 20210129 12:46:06 all (83/733): nfs.sh 20210129 12:46:08 all (84/733): nfs12.sh stress2: indirdep leak: 1/1 20210129 12:46:10 all (85/733): nfs14.sh 20210129 12:46:11 all (86/733): nfs15.sh 20210129 12:46:13 all (87/733): nfs17.sh 20210129 12:46:15 all (88/733): nfs3.sh 20210129 12:46:16 all (89/733): nfs4.sh 20210129 12:46:18 all (90/733): nfs7.sh 20210129 12:46:20 all (91/733): nfs8.sh 20210129 12:46:21 all (92/733): nfs9.sh 20210129 12:46:23 all (93/733): nfs_halfpage.sh 20210129 12:46:25 all (94/733): nfs_halfpage2.sh stress2: indirdep leak: 1/1 20210129 12:46:27 all (95/733): nfsdelegation.sh 20210129 12:46:28 all (96/733): nfsdepth.sh 20210129 12:46:30 all (97/733): nfsrename.sh stress2: indirdep leak: 1/1 20210129 12:46:32 all (98/733): nfssillyrename.sh 20210129 12:46:33 all (99/733): nullfs13.sh stress2: indirdep leak: 1/1 20210129 12:46:35 all (100/733): nullfs14.sh 20210129 12:46:37 all (101/733): nullfs15.sh 20210129 12:46:39 all (102/733): nullfs21.sh 20210129 12:46:40 all (103/733): nullfs23.sh 20210129 12:46:42 all (104/733): nullfs4.sh stress2: mount leak: 13/44 20210129 12:46:44 all (105/733): nullfs6.sh 20210129 12:46:45 all (106/733): nullfs7.sh stress2: newblk leak: 11/16. stress2: indirdep leak: 1/1 20210129 12:46:47 all (107/733): nullfs9.sh 20210129 12:46:49 all (108/733): numa.sh 20210129 12:46:51 all (109/733): oom.sh stress2: indirdep leak: 1/1 20210129 12:46:52 all (110/733): open.sh 20210129 12:46:54 all (111/733): parallelmount2.sh 20210129 12:46:56 all (112/733): pathconf.sh 20210129 12:46:57 all (113/733): pathconf2.sh 20210129 12:46:59 all (114/733): pcatch.sh 20210129 12:47:01 all (115/733): pcatch2.sh 20210129 12:47:02 all (116/733): ping.sh 20210129 12:47:04 all (117/733): pkru.sh 20210129 12:47:06 all (118/733): pkru2.sh 20210129 12:47:07 all (119/733): pmc8.sh hwpmc: SOFT/16/64/0x67 TSC/1/64/0x20 IAP/4/48/0x3ff IAF/3/48/0x67 lock order reversal: 1st 0xffffffff81c96ff8 kernel linker (kernel linker, sx) @ kern/kern_linker.c:1136 2nd 0xffffffff81c9af80 pmc-sx (pmc-sx, sx) @ /usr/src/sys/dev/hwpmc/hwpmc_mod.c:5783 lock order pmc-sx -> kernel linker established at: lock order kernel linker -> pmc-sx attempted at: 20210129 12:47:09 all (120/733): poll.sh stress2: indirdep leak: 1/1 20210129 12:47:11 all (121/733): posix_fadvise.sh 20210129 12:47:13 all (122/733): posix_fadvise2.sh stress2: indirdep leak: 1/1 20210129 12:47:14 all (123/733): procfs5.sh 20210129 12:47:16 all (124/733): procfs6.sh 20210129 12:47:18 all (125/733): procstat.sh 20210129 12:47:19 all (126/733): pthread9.sh 20210129 12:47:21 all (127/733): ptrace.sh 20210129 12:47:23 all (128/733): ptrace3.sh stress2: indirdep leak: 1/1 20210129 12:47:25 all (129/733): pts2.sh 20210129 12:47:27 all (130/733): quota5.sh 20210129 12:47:28 all (131/733): random.sh 20210129 12:47:31 all (132/733): rename13.sh stress2: indirdep leak: 1/1 20210129 12:47:32 all (133/733): rename4.sh 20210129 12:47:34 all (134/733): revoke.sh stress2: indirdep leak: 1/1 20210129 12:47:36 all (135/733): routetbl.sh 20210129 12:47:38 all (136/733): ruby.sh stress2: indirdep leak: 1/1 20210129 12:47:39 all (137/733): schedfuzz.sh 20210129 12:47:41 all (138/733): scp.sh 20210129 12:47:43 all (139/733): seekdir.sh 20210129 12:47:45 all (140/733): segnp.sh stress2: indirdep leak: 1/1 20210129 12:47:46 all (141/733): segregs.sh 20210129 12:47:48 all (142/733): select3.sh 20210129 12:47:50 all (143/733): sendfile19.sh 20210129 12:47:51 all (144/733): sendfile20.sh stress2: indirdep leak: 1/1 20210129 12:47:53 all (145/733): sendfile6.sh 20210129 12:47:55 all (146/733): setuid.sh 20210129 12:47:57 all (147/733): shm_super.sh 20210129 12:47:59 all (148/733): sigaltstack.sh 20210129 12:48:00 all (149/733): sigreturn.sh 20210129 12:48:02 all (150/733): sigstop.sh 20210129 12:48:04 all (151/733): snap12.sh stress2: indirdep leak: 1/1 20210129 12:48:06 all (152/733): snap2-1.sh lock order reversal: 1st 0xfffffe0037948010 bufwait (bufwait, lockmgr) @ ufs/ffs/ffs_vnops.c:310 2nd 0xfffff80009799830 snaplk (snaplk, lockmgr) @ ufs/ffs/ffs_snapshot.c:2348 lock order snaplk -> bufwait established at: #0 0xffffffff80c6d27d at witness_checkorder+0x46d #1 0xffffffff80bce13c at lockmgr_xlock_hard+0x6c #2 0xffffffff80bcee85 at __lockmgr_args+0x625 #3 0xffffffff80cc0754 at getnewbuf+0x334 #4 0xffffffff80cbdac7 at getblkx+0x367 #5 0xffffffff80cc0402 at getblk+0x22 #6 0xffffffff80ea0d84 at ffs_balloc_ufs2+0xcf4 #7 0xffffffff80ea7073 at expunge_ufs2+0x433 #8 0xffffffff80ea4f19 at ffs_snapshot+0x11a9 #9 0xffffffff80ecb717 at ffs_mount+0xc67 #10 0xffffffff80cdec07 at vfs_domount+0x7c7 #11 0xffffffff80cdd762 at vfs_donmount+0x872 #12 0xffffffff80cdceb9 at sys_nmount+0x69 #13 0xffffffff81069057 at amd64_syscall+0x147 #14 0xffffffff8103c2be at fast_syscall_common+0xf8 lock order bufwait -> snaplk attempted at: #0 0xffffffff80c6dbdc at witness_checkorder+0xdcc #1 0xffffffff80bce13c at lockmgr_xlock_hard+0x6c #2 0xffffffff80bcee85 at __lockmgr_args+0x625 #3 0xffffffff80ea99c6 at ffs_copyonwrite+0x166 #4 0xffffffff80ece04e at ffs_geom_strategy+0xce #5 0xffffffff80ee3cf3 at ufs_strategy+0x83 #6 0xffffffff8112e691 at VOP_STRATEGY_APV+0x61 #7 0xffffffff80cbbc6e at bufstrategy+0x3e #8 0xffffffff80cbbb0c at bufwrite+0x24c #9 0xffffffff80ed00b4 at ffs_syncvnode+0x384 #10 0xffffffff80ecefef at ffs_fsync+0x1f #11 0xffffffff8112ce59 at VOP_FSYNC_APV+0x59 #12 0xffffffff80ee167b at ufs_remove+0x10b #13 0xffffffff8112d011 at VOP_REMOVE_APV+0x81 #14 0xffffffff80cf8bfd at kern_funlinkat+0x31d #15 0xffffffff80cf88d8 at sys_unlink+0x28 #16 0xffffffff81069057 at amd64_syscall+0x147 #17 0xffffffff8103c2be at fast_syscall_common+0xf8 lock order reversal: 1st 0xfffff80009799830 snaplk (snaplk, lockmgr) @ ufs/ufs/ufs_vnops.c:1035 2nd 0xfffff8029ff1ecf0 ufs (ufs, lockmgr) @ ufs/ffs/ffs_snapshot.c:1662 lock order ufs -> snaplk established at: #0 0xffffffff80c6d27d at witness_checkorder+0x46d #1 0xffffffff80bcd93c at lockmgr_lock_flags+0x7c #2 0xffffffff80ecf15d at ffs_lock+0x9d #3 0xffffffff8112e220 at VOP_LOCK1_APV+0x40 #4 0xffffffff80d00d84 at _vn_lock+0x54 #5 0xffffffff80ce8dda at vget_finish+0x7a #6 0xffffffff80cd86ff at vfs_hash_get+0xbf #7 0xffffffff80eca1c9 at ffs_vgetf+0x59 #8 0xffffffff80ed9118 at ufs_lookup_ino+0xf08 #9 0xffffffff8112acf6 at VOP_CACHEDLOOKUP_APV+0x56 #10 0xffffffff80cc9f66 at vfs_cache_lookup+0xa6 #11 0xffffffff8112ab46 at VOP_LOOKUP_APV+0x56 #12 0xffffffff80cdaea1 at lookup+0x441 #13 0xffffffff80cda30c at namei+0x6ac #14 0xffffffff80d004fd at vn_open_cred+0x38d #15 0xffffffff80cf726f at kern_openat+0x26f #16 0xffffffff81069057 at amd64_syscall+0x147 #17 0xffffffff8103c2be at fast_syscall_common+0xf8 lock order snaplk -> ufs attempted at: #0 0xffffffff80c6dbdc at witness_checkorder+0xdcc #1 0xffffffff80bce13c at lockmgr_xlock_hard+0x6c #2 0xffffffff80bcee85 at __lockmgr_args+0x625 #3 0xffffffff80ea7edb at ffs_snapremove+0x10b #4 0xffffffff80ea22da at ffs_truncate+0x27a #5 0xffffffff80ed7f2f at ufs_inactive+0x1af #6 0xffffffff8112ddb9 at VOP_INACTIVE_APV+0x59 #7 0xffffffff80ce9f25 at vinactivef+0xf5 #8 0xffffffff80ce964a at vput_final+0x25a #9 0xffffffff80cf8b59 at kern_funlinkat+0x279 #10 0xffffffff80cf88d8 at sys_unlink+0x28 #11 0xffffffff81069057 at amd64_syscall+0x147 #12 0xffffffff8103c2be at fast_syscall_common+0xf8 stress2: freework leak: 11/16. 20210129 12:48:08 all (153/733): snap2.sh 20210129 12:48:10 all (154/733): sndstat.sh 20210129 12:48:11 all (155/733): socketpair.sh 20210129 12:48:13 all (156/733): socketpair2.sh 20210129 12:48:15 all (157/733): suj2.sh stress2: newblk leak: 1/6. stress2: indirdep leak: 1/1 20210129 12:48:17 all (158/733): suj32.sh 20210129 12:48:19 all (159/733): suj35.sh 20210129 12:48:21 all (160/733): suj7.sh Failed to find journal. Use tunefs to create one Failed to start journal: 2 stress2: newblk leak: 1/7. 20210129 12:48:22 all (161/733): suj8.sh Jan 29 12:48:24 mercat1 kernel: pid 4873 (dd), uid 0 inumber 4 on /mnt: filesystem full Jan 29 12:48:24 mercat1 kernel: pid 4889 (dd), uid 0 inumber 5 on /mnt: filesystem full 20210129 12:48:24 all (162/733): syzkaller1.sh 20210129 12:48:26 all (163/733): syzkaller2.sh stress2: indirdep leak: 1/1 20210129 12:48:28 all (164/733): syzkaller22.sh 20210129 12:48:30 all (165/733): syzkaller3.sh stress2: indirdep leak: 1/1 20210129 12:48:32 all (166/733): syzkaller5.sh 20210129 12:48:33 all (167/733): syzkaller6.sh 20210129 12:48:35 all (168/733): temp.sh 20210129 12:48:37 all (169/733): tmpfs15.sh 20210129 12:48:39 all (170/733): tmpfs4.sh 20210129 12:48:41 all (171/733): tmpfs6.sh stress2: indirdep leak: 1/1 20210129 12:48:43 all (172/733): trim5.sh 20210129 12:48:44 all (173/733): trim6.sh 20210129 12:48:46 all (174/733): trim7.sh 20210129 12:48:48 all (175/733): trim8.sh stress2: indirdep leak: 1/1 20210129 12:48:50 all (176/733): truncate4.sh 20210129 12:48:52 all (177/733): truncate6.sh 20210129 12:48:53 all (178/733): tvnlru.sh 20210129 12:48:55 all (179/733): ufssuspend.sh 20210129 12:48:57 all (180/733): uma_zalloc_arg.sh 20210129 12:48:59 all (181/733): vfork.sh stress2: indirdep leak: 1/1 20210129 12:49:01 all (182/733): vmio.sh 20210129 12:49:02 all (183/733): watchman.sh 20210129 12:49:04 all (184/733): zfs.sh 20210129 12:49:06 all (185/733): zfs10.sh 20210129 12:49:08 all (186/733): zfs2.sh 20210129 12:49:09 all (187/733): zfs3.sh stress2: indirdep leak: 1/1 20210129 12:49:11 all (188/733): zfs4.sh 20210129 12:49:13 all (189/733): zfs5.sh 20210129 12:49:15 all (190/733): zfs6.sh 20210129 12:49:16 all (191/733): zfs7.sh 20210129 12:49:18 all (192/733): zfs8.sh 20210129 12:49:20 all (193/733): beneath.sh stress2: freework leak: 2/7. stress2: indirdep leak: 1/1 20210129 12:49:22 all (194/733): beneath2.sh 20210129 12:49:24 all (195/733): datagram.sh 20210129 12:49:26 all (196/733): ext2fs3.sh stress2: newblk leak: 1/6. 20210129 12:49:29 all (197/733): extattr.sh stress2: indirdep leak: 1/1 20210129 12:49:32 all (198/733): fcntl.sh 20210129 12:49:34 all (199/733): geomleak.sh stress2: newblk leak: 21/26. 20210129 12:49:37 all (200/733): jail.sh 20210129 12:49:38 all (201/733): killpg.sh 20210129 12:49:41 all (202/733): md9.sh 20210129 12:49:44 all (203/733): mmap24.sh 20210129 12:49:46 all (204/733): mmap25.sh 20210129 12:49:49 all (205/733): mmap26.sh 20210129 12:49:51 all (206/733): mmap8.sh 20210129 12:49:54 all (207/733): mmap9.sh 20210129 12:49:57 all (208/733): mountro3.sh stress2: freework leak: 11/15. stress2: newblk leak: 2036/2041. stress2: indirdep leak: 2/2 20210129 12:50:00 all (209/733): msdos9.sh 20210129 12:50:02 all (210/733): nullfs10.sh stress2: newblk leak: 1/6. 20210129 12:50:04 all (211/733): nullfs12.sh 20210129 12:50:07 all (212/733): nullfs16.sh 20210129 12:50:10 all (213/733): nullfs3.sh 20210129 12:50:13 all (214/733): openlock.sh 20210129 12:50:16 all (215/733): pipe_enomem.sh kern.ipc.maxpipekva exceeded; see tuning(7) 20210129 12:50:18 all (216/733): ptrace11.sh 20210129 12:50:21 all (217/733): ptrace8.sh 20210129 12:50:23 all (218/733): quota6.sh lock order reversal: 1st 0xfffff8074cca6e90 FFS (FFS Lock, sleep mutex) @ ufs/ufs/ufs_quota.c:759 2nd 0xfffffe014464bbc0 struct mount mtx (struct mount mtx, sleep mutex) @ ufs/ufs/ufs_quota.c:765 lock order struct mount mtx -> FFS Lock established at: #0 0xffffffff80c6d27d at witness_checkorder+0x46d #1 0xffffffff80bda614 at __mtx_lock_flags+0x94 #2 0xffffffff80eaaf7e at softdep_flushfiles+0x38e #3 0xffffffff80ecca79 at ffs_unmount+0xa9 #4 0xffffffff80ce042b at dounmount+0x43b #5 0xffffffff80cdff7c at kern_unmount+0x2fc #6 0xffffffff81069057 at amd64_syscall+0x147 #7 0xffffffff8103c2be at fast_syscall_common+0xf8 lock order FFS Lock -> struct mount mtx attempted at: #0 0xffffffff80c6dbdc at witness_checkorder+0xdcc #1 0xffffffff80bda614 at __mtx_lock_flags+0x94 #2 0xffffffff80edde5d at quotaoff_inchange+0xbd #3 0xffffffff80eca0f3 at ffs_flushfiles+0x123 #4 0xffffffff80eaac8d at softdep_flushfiles+0x9d #5 0xffffffff80ecca79 at ffs_unmount+0xa9 #6 0xffffffff80ce042b at dounmount+0x43b #7 0xffffffff80cdff7c at kern_unmount+0x2fc #8 0xffffffff81069057 at amd64_syscall+0x147 #9 0xffffffff8103c2be at fast_syscall_common+0xf8 stress2: freework leak: 8/12. stress2: newblk leak: 744/749. stress2: indirdep leak: 4/4 20210129 12:50:27 all (219/733): quota9.sh stress2: freework leak: 8/15. stress2: newblk leak: 1585/1594. stress2: indirdep leak: 1/2 20210129 12:50:30 all (220/733): recursiveflushes.sh 20210129 12:50:32 all (221/733): rwlock_ronly.sh 20210129 12:50:34 all (222/733): sendfile.sh stress2: freework leak: 11/16. stress2: newblk leak: 146/152. stress2: indirdep leak: 1/1 20210129 12:50:36 all (223/733): sendfile2.sh stress2: indirdep leak: 1/2 20210129 12:50:38 all (224/733): sendfile4.sh stress2: newblk leak: 92/183. 20210129 12:50:40 all (225/733): snap.sh stress2: freework leak: 12/16. 20210129 12:50:42 all (226/733): snap10.sh stress2: indirdep leak: 1/1 20210129 12:50:45 all (227/733): tmpfs7.sh 20210129 12:50:47 all (228/733): trim2.sh 20210129 12:50:49 all (229/733): umtx_suspend.sh 20210129 12:50:52 all (230/733): unlink.sh stress2: freework leak: 11/16. stress2: newblk leak: 4094/4101. stress2: indirdep leak: 2/2 20210129 12:50:55 all (231/733): vm_fault_dontneed.sh 20210129 12:50:57 all (232/733): datamove4.sh stress2: newblk leak: 2/8. stress2: indirdep leak: 1/1 20210129 12:51:00 all (233/733): devfd.sh 20210129 12:51:04 all (234/733): dup.sh 20210129 12:51:08 all (235/733): extattr3.sh stress2: indirdep leak: 1/1 20210129 12:51:12 all (236/733): fpclone2.sh stress2: freework leak: 1/6. 20210129 12:51:20 all (237/733): kevent8.sh stress2: indirdep leak: 1/1 20210129 12:51:24 all (238/733): maxproc.sh 20210129 12:51:26 all (239/733): mmap13.sh 20210129 12:51:30 all (240/733): mmap23.sh stress2: indirdep leak: 1/1 20210129 12:51:34 all (241/733): mmap4.sh vnode_pager_putpages: I/O error 28 0xfffff8057ac79c80: type VREG usecount 0, writecount 0, refcount 3203 seqc users 0 hold count flags () flags (VIRF_PGREAD|VI_DOINGINACT|VMP_LAZYLIST) v_object 0xfffff803f8266840 ref 0 pages 25608 cleanbuf 3200 dirtybuf 1 lock type ufs: EXCL by thread 0xfffffe01c41b4300 (pid 50072, mmap4, tid 102739) #0 0xffffffff80bcda95 at lockmgr_lock_flags+0x1d5 #1 0xffffffff80ecf15d at ffs_lock+0x9d #2 0xffffffff8112e220 at VOP_LOCK1_APV+0x40 #3 0xffffffff80d00d84 at _vn_lock+0x54 #4 0xffffffff80ce9503 at vput_final+0x113 #5 0xffffffff80efd69d at vm_map_process_deferred+0xad #6 0xffffffff80f052ee at vm_map_remove+0xee Jan 29 12:51:35 #7 0xffffffff80efcef9 at vmspace_exit+0xa9 mercat1 kernel: #8 0xffffffff80bb2be2 at exit1+0x562 pid 50072 (mmap4#9 0xffffffff80bb267d at sys_sys_exit+0xd ), uid 0 inumber#10 0xffffffff81069057 at amd64_syscall+0x147 4 on /mnt: file#11 0xffffffff8103c2be at fast_syscall_common+0xf8 nlink=1, effnlink=1, size=104857600, extsize 0 generation=51a222fc, uid=0, gid=0, flags=0x0 ino 4, on dev md10a vnode_pager_putpages: residual I/O 32768 at 9760 0xfffff8057ac79c80: type VREG usecount 0, writecount 0, refcount 3203 seqc users 0 hold count flags () flags (VIRF_PGREAD|VI_DOINGINACT|VMP_LAZYLIST) v_object 0xfffff803f8266840 ref 0 pages 25608 cleanbuf 3200 dirtybuf 1 lock type ufs: EXCL by thread 0xfffffe01c41b4300 (pid 50072, mmap4, tid 102739) #system full 0 0xffffffff80bcda95 at lockmgr_lock_flags+0x1d5 #1 0xffffffff80ecf15d at ffs_lock+0x9d #2 0xffffffff8112e220 at VOP_LOCK1_APV+0x40 #3 0xffffffff80d00d84 at _vn_lock+0x54 #4 0xffffffff80ce9503 at vput_final+0x113 #5 0xffffffff80efd69d at vm_map_process_deferred+0xad #6 0xffffffff80f052ee at vm_map_remove+0xee #7 0xffffffff80efcef9 at vmspace_exit+0xa9 #8 0xffffffff80bb2be2 at exit1+0x562 #9 0xffffffff80bb267d at sys_sys_exit+0xd #10 0xffffffff81069057 at amd64_syscall+0x147 #11 0xffffffff8103c2be at fast_syscall_common+0xf8 nlink=1, effnlink=1, size=104857600, extsize 0 generation=51a222fc, uid=0, gid=0, flags=0x0 ino 4, on dev md10a vnode_pager_putpages: zero-length write at 40075264 resid 131072 0xfffff8057ac79c80: type VREG usecount 1, writecount 0, refcount 3203 seqc users 0 hold count flags () flags (VIRF_PGREAD|VMP_LAZYLIST) v_object 0xfffff803f8266840 ref 0 pages 25608 cleanbuf 3201 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe01c41b5100 (pid 50080, umount, tid 102737) #0 0xffffffff80bcda95 at lockmgr_lock_flags+0x1d5 #1 0xffffffff80ecf15d at ffs_lock+0x9d #2 0xffffffff8112e220 at VOP_LOCK1_APV+0x40 Jan 29 12:51:37 #3 0xffffffff80d00d84 at _vn_lock+0x54 mercat1 kernel: #4 0xffffffff80ce8dda at vget_finish+0x7a pid 50080 (umoun#5 0xffffffff80cebda3 at vfs_periodic_msync_inactive+0x1b3 t), uid 0 inumbe#6 0xffffffff80ce03c6 at dounmount+0x3d6 r 4 on /mnt: fil#7 0xffffffff80cdff7c at kern_unmount+0x2fc esystem full #8 0xffffffff81069057 at amd64_syscall+0x147 #9 0xffffffff8103c2be at fast_syscall_common+0xf8 nlink=1, effnlink=1, size=104857600, extsize 0 generation=51a222fc, uid=0, gid=0, flags=0x0 ino 4, on dev md10a 20210129 12:51:37 all (242/733): mountro2.sh 20210129 12:51:41 all (243/733): newfs5.sh stress2: freework leak: 11/15. 20210129 12:51:44 all (244/733): procfs2.sh 20210129 12:51:48 all (245/733): pthread.sh 20210129 12:51:51 all (246/733): spin.sh stress2: indirdep leak: 1/1 20210129 12:51:54 all (247/733): tmpfs23.sh 20210129 12:51:58 all (248/733): tmpfs5.sh 20210129 12:52:02 all (249/733): truncate5.sh 20210129 12:52:05 all (250/733): udp.sh 20210129 12:52:09 all (251/733): udp2.sh stress2: indirdep leak: 1/1 20210129 12:52:13 all (252/733): contigmalloc2.sh stress2: freework leak: 3/8. stress2: newblk leak: 1/8. 20210129 12:52:16 all (253/733): contigmalloc3.sh 20210129 12:52:18 all (254/733): kevent2.sh 20210129 12:52:22 all (255/733): mkfifo6.sh stress2: indirdep leak: 1/1 20210129 12:52:27 all (256/733): mountro4.sh 20210129 12:52:32 all (257/733): procfs3.sh 20210129 12:52:37 all (258/733): ptrace2.sh 20210129 12:52:42 all (259/733): sparse.sh stress2: newblk leak: 1/7. stress2: indirdep leak: 1/1 20210129 12:52:50 all (260/733): truncate3.sh 20210129 12:52:55 all (261/733): truncate7.sh 20210129 12:53:00 all (262/733): unix_socket.sh 20210129 12:53:04 all (263/733): datamove5.sh lock order reversal: 1st 0xfffff8068c1e2a70 nullfs (nullfs, lockmgr) @ /usr/src/sys/fs/nullfs/null_vnops.c:836 2nd 0xfffffe0038f78688 bufwait (bufwait, lockmgr) @ ufs/ffs/ffs_softdep.c:7548 lock order nullfs -> bufwait attempted at: #0 0xffffffff80c6dbdc at witness_checkorder+0xdcc #1 0xffffffff80bce13c at lockmgr_xlock_hard+0x6c #2 0xffffffff80bcee85 at __lockmgr_args+0x625 #3 0xffffffff80eb6eae at trunc_dependencies+0x7de #4 0xffffffff80eb80ad at softdep_setup_freeblocks+0x7dd #5 0xffffffff80ea27de at ffs_truncate+0x77e #6 0xffffffff80ed7f2f at ufs_inactive+0x1af #7 0xffffffff8112ddb9 at VOP_INACTIVE_APV+0x59 #8 0xffffffff80ce9f25 at vinactivef+0xf5 #9 0xffffffff80ce964a at vput_final+0x25a #10 0xffffffff8234ab56 at null_reclaim+0xf6 #11 0xffffffff8112e0a9 at VOP_RECLAIM_APV+0x59 #12 0xffffffff80ceaed3 at vgonel+0x423 #13 0xffffffff80ceb64c at vrecycle+0x5c #14 0xffffffff8234a9f7 at null_inactive+0x57 #15 0xffffffff8112ddb9 at VOP_INACTIVE_APV+0x59 #16 0xffffffff80ce9f25 at vinactivef+0xf5 #17 0xffffffff80ce964a at vput_final+0x25a stress2: newblk leak: 1/7. stress2: indirdep leak: 1/1 20210129 12:53:10 all (264/733): linger3.sh 20210129 12:53:16 all (265/733): mlockall4.sh 20210129 12:53:23 all (266/733): pdfork.sh 20210129 12:53:26 all (267/733): procfs.sh panic: cache_fplookup_next: invalidated entry 0xfffff8057d43a6e8 found but vnode state does not match cpuid = 8 time = 1611921209 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe014b3b75a0 vpanic() at vpanic+0x181/frame 0xfffffe014b3b75f0 panic() at panic+0x43/frame 0xfffffe014b3b7650 cache_fplookup() at cache_fplookup+0xd15/frame 0xfffffe014b3b7740 namei() at namei+0x12c/frame 0xfffffe014b3b7800 vn_open_cred() at vn_open_cred+0x107/frame 0xfffffe014b3b7960 kern_openat() at kern_openat+0x26f/frame 0xfffffe014b3b7ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014b3b7bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014b3b7bf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8003a250a, rsp = 0x7fffffffdc48, rbp = 0x7fffffffdd30 --- KDB: enter: panic [ thread pid 79099 tid 101737 ] Stopped at kdb_enter+0x37: movq $0,0x109742e(%rip) db> run pho db:0:pho> set $lines 20000 db:0:pho> run pho1 db:1:pho1> dump Dumping 1602 out of 32628 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% Dump complete db:1:pho1> bt Tracing pid 79099 tid 101737 td 0xfffffe0144957c00 kdb_enter() at kdb_enter+0x37/frame 0xfffffe014b3b75a0 vpanic() at vpanic+0x1b2/frame 0xfffffe014b3b75f0 panic() at panic+0x43/frame 0xfffffe014b3b7650 cache_fplookup() at cache_fplookup+0xd15/frame 0xfffffe014b3b7740 namei() at namei+0x12c/frame 0xfffffe014b3b7800 vn_open_cred() at vn_open_cred+0x107/frame 0xfffffe014b3b7960 kern_openat() at kern_openat+0x26f/frame 0xfffffe014b3b7ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014b3b7bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014b3b7bf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8003a250a, rsp = 0x7fffffffdc48, rbp = 0x7fffffffdd30 --- db:1:pho1> show allpcpu Current CPU: 8 cpuid = 0 dynamic pcpu = 0x79f580 curthread = 0xfffffe01439b6700: pid 79113 tid 100348 critnest 0 "date" curpcb = 0xfffffe01439b6c10 fpcurthread = 0xfffffe01439b6700: pid 79113 "date" idlethread = 0xfffffe00e4d16300: tid 100003 "idle: cpu0" self = 0xffffffff82210000 curpmap = 0xfffffe0179a95500 tssp = 0xffffffff82210384 rsp0 = 0xfffffe0144057cc0 kcr3 = 0x800000073e4c96da ucr3 = 0x8000000583ceeeda scr3 = 0x583ceeeda gs32p = 0xffffffff82210404 ldt = 0xffffffff82210444 tss = 0xffffffff82210434 curvnet = 0 spin locks held: cpuid = 1 dynamic pcpu = 0xfffffe00bb55d580 curthread = 0xfffffe01448ed800: pid 79104 tid 101661 critnest 0 "mount" curpcb = 0xfffffe01448edd10 fpcurthread = 0xfffffe01448ed800: pid 79104 "mount" idlethread = 0xfffffe00e4d15c00: tid 100004 "idle: cpu1" self = 0xffffffff82211000 curpmap = 0xfffffe0179b66b10 tssp = 0xffffffff82211384 rsp0 = 0xfffffe014b23bcc0 kcr3 = 0x800000057af1b39a ucr3 = 0x8000000583cbcb9a scr3 = 0x583cbcb9a gs32p = 0xffffffff82211404 ldt = 0xffffffff82211444 tss = 0xffffffff82211434 curvnet = 0 spin locks held: cpuid = 2 dynamic pcpu = 0xfffffe00bb569580 curthread = 0xfffffe0143dda100: pid 79096 tid 101619 critnest 0 "mount" curpcb = 0xfffffe0143dda610 fpcurthread = 0xfffffe0143dda100: pid 79096 "mount" idlethread = 0xfffffe00e4d15500: tid 100005 "idle: cpu2" self = 0xffffffff82212000 curpmap = 0xfffffe0179b58120 tssp = 0xffffffff82212384 rsp0 = 0xfffffe01440eacc0 kcr3 = 0x8000000699c8f646 ucr3 = 0x8000000699cdfe46 scr3 = 0x699cdfe46 gs32p = 0xffffffff82212404 ldt = 0xffffffff82212444 tss = 0xffffffff82212434 curvnet = 0 spin locks held: cpuid = 3 dynamic pcpu = 0xfffffe00bb575580 curthread = 0xfffffe010dc33000: pid 2175 tid 100164 critnest 0 "devd" curpcb = 0xfffffe010dc33510 fpcurthread = 0xfffffe010dc33000: pid 2175 "devd" idlethread = 0xfffffe00e4d14e00: tid 100006 "idle: cpu3" self = 0xffffffff82213000 curpmap = 0xfffffe0142f2f120 tssp = 0xffffffff82213384 rsp0 = 0xfffffe0140ea5cc0 kcr3 = 0x800000029f590005 ucr3 = 0x800000029f593805 scr3 = 0x699c0de89 gs32p = 0xffffffff82213404 ldt = 0xffffffff82213444 tss = 0xffffffff82213434 curvnet = 0 spin locks held: cpuid = 4 dynamic pcpu = 0xfffffe00bb581580 curthread = 0xfffffe0144abd800: pid 79100 tid 101625 critnest 1 "date" curpcb = 0xfffffe0144abdd10 fpcurthread = 0xfffffe0144abd800: pid 79100 "date" idlethread = 0xfffffe00e4d14700: tid 100007 "idle: cpu4" self = 0xffffffff82214000 curpmap = 0xffffffff81c95860 tssp = 0xffffffff82214384 rsp0 = 0xfffffe0144183cc0 kcr3 = 0x8000000002138005 ucr3 = 0xffffffffffffffff scr3 = 0x5ed722999 gs32p = 0xffffffff82214404 ldt = 0xffffffff82214444 tss = 0xffffffff82214434 curvnet = 0 spin locks held: cpuid = 5 dynamic pcpu = 0xfffffe00bb58d580 curthread = 0xfffffe0127533500: pid 78326 tid 100188 critnest 0 "ls" curpcb = 0xfffffe0127533a10 fpcurthread = 0xfffffe0127533500: pid 78326 "ls" idlethread = 0xfffffe00e4d14000: tid 100008 "idle: cpu5" self = 0xffffffff82215000 curpmap = 0xfffffe01b787f120 tssp = 0xffffffff82215384 rsp0 = 0xfffffe0140f37cc0 kcr3 = 0x8000000583981177 ucr3 = 0x800000057cba0977 scr3 = 0x57dc85af3 gs32p = 0xffffffff82215404 ldt = 0xffffffff82215444 tss = 0xffffffff82215434 curvnet = 0 spin locks held: cpuid = 6 dynamic pcpu = 0xfffffe00bb599580 curthread = 0xfffffe01c4119500: pid 79080 tid 102687 critnest 0 "mount" curpcb = 0xfffffe01c4119a10 fpcurthread = 0xfffffe01c4119500: pid 79080 "mount" idlethread = 0xfffffe00e4d17800: tid 100009 "idle: cpu6" self = 0xffffffff82216000 curpmap = 0xfffffe0197728b10 tssp = 0xffffffff82216384 rsp0 = 0xfffffe01c4371cc0 kcr3 = 0x80000005ed725258 ucr3 = 0x8000000580df4a58 scr3 = 0x699d0aa57 gs32p = 0xffffffff82216404 ldt = 0xffffffff82216444 tss = 0xffffffff82216434 curvnet = 0 spin locks held: cpuid = 7 dynamic pcpu = 0xfffffe00bb5a5580 curthread = 0xfffffe01c41b3c00: pid 79102 tid 102740 critnest 0 "umount" curpcb = 0xfffffe01c41b4110 fpcurthread = 0xfffffe01c41b3c00: pid 79102 "umount" idlethread = 0xfffffe00e4d1d100: tid 100010 "idle: cpu7" self = 0xffffffff82217000 curpmap = 0xfffffe01b5240b10 tssp = 0xffffffff82217384 rsp0 = 0xfffffe01d3072cc0 kcr3 = 0x800000057bb03404 ucr3 = 0x8000000699395c04 scr3 = 0x699395c04 gs32p = 0xffffffff82217404 ldt = 0xffffffff82217444 tss = 0xffffffff82217434 curvnet = 0 spin locks held: cpuid = 8 dynamic pcpu = 0xfffffe00bb5b1580 curthread = 0xfffffe0144957c00: pid 79099 tid 101737 critnest 2 "mount" curpcb = 0xfffffe0144958110 fpcurthread = 0xfffffe0144957c00: pid 79099 "mount" idlethread = 0xfffffe00e4d1ca00: tid 100011 "idle: cpu8" self = 0xffffffff82218000 curpmap = 0xfffffe0199596b10 tssp = 0xffffffff82218384 rsp0 = 0xfffffe014b3b7cc0 kcr3 = 0x800000057b7e7198 ucr3 = 0x800000057e2e1998 scr3 = 0x57f838999 gs32p = 0xffffffff82218404 ldt = 0xffffffff82218444 tss = 0xffffffff82218434 curvnet = 0 spin locks held: cpuid = 9 dynamic pcpu = 0xfffffe00bb5bd580 curthread = 0xfffffe01439a6700: pid 78468 tid 100316 critnest 0 "ls" curpcb = 0xfffffe01439a6c10 fpcurthread = 0xfffffe01439a6700: pid 78468 "ls" idlethread = 0xfffffe00e4d1c300: tid 100012 "idle: cpu9" self = 0xffffffff82219000 curpmap = 0xfffffe0197739500 tssp = 0xffffffff82219384 rsp0 = 0xfffffe0143fb7cc0 kcr3 = 0x8000000583abd5d4 ucr3 = 0x8000000583248dd4 scr3 = 0x73d595ef0 gs32p = 0xffffffff82219404 ldt = 0xffffffff82219444 tss = 0xffffffff82219434 curvnet = 0 spin locks held: cpuid = 10 dynamic pcpu = 0xfffffe00bb5c9580 curthread = 0xfffffe01439b7500: pid 79106 tid 100346 critnest 0 "grep" curpcb = 0xfffffe01439b7a10 fpcurthread = none idlethread = 0xfffffe00e4d1bc00: tid 100013 "idle: cpu10" self = 0xffffffff8221a000 curpmap = 0xfffffe0144940b10 tssp = 0xffffffff8221a384 rsp0 = 0xfffffe014404dcc0 kcr3 = 0x8000000583d69099 ucr3 = 0x8000000699875899 scr3 = 0x699875899 gs32p = 0xffffffff8221a404 ldt = 0xffffffff8221a444 tss = 0xffffffff8221a434 curvnet = 0 spin locks held: cpuid = 11 dynamic pcpu = 0xfffffe00bb5d5580 curthread = 0xfffffe01cb6f3500: pid 79108 tid 102669 critnest 0 "mount" curpcb = 0xfffffe01cb6f3a10 fpcurthread = 0xfffffe01cb6f3500: pid 79108 "mount" idlethread = 0xfffffe00e4d1b500: tid 100014 "idle: cpu11" self = 0xffffffff8221b000 curpmap = 0xfffffe0199596120 tssp = 0xffffffff8221b384 rsp0 = 0xfffffe01c4317cc0 kcr3 = 0x800000057e2a25a7 ucr3 = 0x8000000699d0ada7 scr3 = 0x699d0ada7 gs32p = 0xffffffff8221b404 ldt = 0xffffffff8221b444 tss = 0xffffffff8221b434 curvnet = 0 spin locks held: db:1:pho1> show alllocks Process 79113 (date) thread 0xfffffe01439b6700 (100348) exclusive rw pmap pv list (pmap pv list) r = 0 (0xfffffe0037601880) locked @ amd64/amd64/pmap.c:5549 exclusive sleep mutex pmap (pmap) r = 0 (0xfffffe0179a95500) locked @ amd64/amd64/pmap.c:7219 shared rw vm object (vm object) r = 0 (0xfffff800060edb58) locked @ vm/vm_map.c:2671 exclusive sx vm map (user) (vm map (user)) r = 0 (0xfffffe0179a95440) locked @ vm/vm_map.c:1987 Process 79112 (sh) thread 0xfffffe0142d41500 (100250) shared lockmgr ufs (ufs) r = 0 (0xfffff8000915da70) locked @ kern/vfs_subr.c:2916 Process 79111 (mount) thread 0xfffffe0143de5a00 (101608) shared lockmgr ufs (ufs) r = 0 (0xfffff80009164cf0) locked @ kern/vfs_lookup.c:884 Process 79110 (grep) thread 0xfffffe01439b6e00 (100347) shared lockmgr ufs (ufs) r = 0 (0xfffff80009164cf0) locked @ kern/vfs_lookup.c:884 Process 79108 (mount) thread 0xfffffe01cb6f3500 (102669) exclusive rw pmap pv list (pmap pv list) r = 0 (0xfffffe00376019c0) locked @ amd64/amd64/pmap.c:5549 exclusive sleep mutex pmap (pmap) r = 0 (0xfffffe0199596120) locked @ amd64/amd64/pmap.c:7219 shared rw vm object (vm object) r = 0 (0xfffff800092b1d68) locked @ vm/vm_map.c:2671 exclusive sx vm map (user) (vm map (user)) r = 0 (0xfffffe0199596060) locked @ vm/vm_map.c:1987 Process 79104 (mount) thread 0xfffffe01448ed800 (101661) exclusive sleep mutex pmap (pmap) r = 0 (0xfffffe0179b66b10) locked @ amd64/amd64/pmap.c:6039 exclusive sx vm map (user) (vm map (user)) r = 0 (0xfffffe0179b66a50) locked @ vm/vm_mmap.c:598 Process 79101 (mount) thread 0xfffffe01448b7100 (101761) shared lockmgr ufs (ufs) r = 0 (0xfffff80009164cf0) locked @ kern/vfs_lookup.c:884 Process 79102 (umount) thread 0xfffffe01c41b3c00 (102740) exclusive rw pmap pv list (pmap pv list) r = 0 (0xfffffe00376096c0) locked @ amd64/amd64/pmap.c:5549 exclusive sleep mutex pmap (pmap) r = 0 (0xfffffe01b5240b10) locked @ amd64/amd64/pmap.c:7219 shared rw vm object (vm object) r = 0 (0xfffff800060edb58) locked @ vm/vm_map.c:2671 exclusive sx vm map (user) (vm map (user)) r = 0 (0xfffffe01b5240a50) locked @ vm/vm_map.c:1987 Process 79096 (mount) thread 0xfffffe0143dda100 (101619) exclusive sleep mutex pmap (pmap) r = 0 (0xfffffe0179b58120) locked @ amd64/amd64/pmap.c:7219 shared rw vm object (vm object) r = 0 (0xfffff800060edb58) locked @ vm/vm_map.c:2671 exclusive sx vm map (user) (vm map (user)) r = 0 (0xfffffe0179b58060) locked @ vm/vm_map.c:1987 Process 79085 (umount) thread 0xfffffe01448fe700 (101677) exclusive lockmgr ufs (ufs) r = 0 (0xfffff80699f8a2f0) locked @ kern/vfs_mount.c:1742 Process 79080 (mount) thread 0xfffffe01c4119500 (102687) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0037871608) locked @ kern/vfs_bio.c:3902 exclusive lockmgr ufs (ufs) r = 0 (0xfffff80009164a70) locked @ kern/vfs_lookup.c:1081 Process 78726 (ls) thread 0xfffffe014379e800 (100218) exclusive lockmgr pseudofs (pseudofs) r = 0 (0xfffff8057de657f0) locked @ kern/vfs_lookup.c:884 Process 78468 (ls) thread 0xfffffe01439a6700 (100316) exclusive lockmgr pseudofs (pseudofs) r = 0 (0xfffff8057d1b82f0) locked @ kern/vfs_syscalls.c:4141 Process 78376 (ls) thread 0xfffffe01c41b3500 (102741) exclusive lockmgr pseudofs (pseudofs) r = 0 (0xfffff805807a9070) locked @ kern/vfs_syscalls.c:4141 Process 78326 (ls) thread 0xfffffe0127533500 (100188) exclusive sleep mutex pfs_node (pfs_node) r = 0 (0xfffff800061b0e08) locked @ fs/pseudofs/pseudofs_internal.h:104 shared sx allproc (allproc) r = 0 (0xffffffff81802740) locked @ fs/pseudofs/pseudofs_vnops.c:887 exclusive lockmgr pseudofs (pseudofs) r = 0 (0xfffff80582a962f0) locked @ kern/vfs_syscalls.c:4141 db:1:pho1> show lockedvnods Locked vnodes vnode 0xfffff8000915da00: type VREG usecount 2, writecount -316, refcount 2 seqc users 0 hold count flags () flags (VIRF_PGREAD) v_object 0xfffff8000610fd68 ref 305 pages 28 cleanbuf 0 dirtybuf 0 lock type ufs: SHARED (count 1) #0 0xffffffff80bcda95 at lockmgr_lock_flags+0x1d5 #1 0xffffffff80ecf15d at ffs_lock+0x9d #2 0xffffffff8112e220 at VOP_LOCK1_APV+0x40 #3 0xffffffff80d00d84 at _vn_lock+0x54 #4 0xffffffff80ce8dda at vget_finish+0x7a #5 0xffffffff80ccf9ba at cache_fplookup_final_child+0x4a #6 0xffffffff80ccc052 at cache_fplookup+0x872 #7 0xffffffff80cd9d8c at namei+0x12c #8 0xffffffff80b8522d at elf64_load_file+0x11d #9 0xffffffff80b84269 at exec_elf64_imgact+0xfa9 #10 0xffffffff80bafadd at kern_execve+0x62d #11 0xffffffff80baf13a at sys_execve+0x5a #12 0xffffffff81069057 at amd64_syscall+0x147 #13 0xffffffff8103c2be at fast_syscall_common+0xf8 nlink=1, effnlink=1, size=114600, extsize 0 generation=7e14d196, uid=0, gid=0, flags=0x20000 ino 14927640, on dev gpt/work vnode 0xfffff80009164c80: type VDIR usecount 3, writecount 0, refcount 3 seqc users 0 mountedhere 0 hold count flags () flags (VMP_LAZYLIST) v_object 0xfffff8000610f210 ref 0 pages 1 cleanbuf 0 dirtybuf 0 lock type ufs: SHARED (count 3) #0 0xffffffff80bcda95 at lockmgr_lock_flags+0x1d5 #1 0xffffffff80ecf15d at ffs_lock+0x9d #2 0xffffffff8112e220 at VOP_LOCK1_APV+0x40 #3 0xffffffff80d00d84 at _vn_lock+0x54 #4 0xffffffff80cdab35 at lookup+0xd5 #5 0xffffffff80cda30c at namei+0x6ac #6 0xffffffff80d004fd at vn_open_cred+0x38d #7 0xffffffff80cf726f at kern_openat+0x26f #8 0xffffffff81069057 at amd64_syscall+0x147 #9 0xffffffff8103c2be at fast_syscall_common+0xf8 nlink=25, effnlink=25, size=512, extsize 0 generation=536d3786, uid=0, gid=0, flags=0x0 ino 7704576, on dev gpt/work vnode 0xfffff80009164a00: type VDIR usecount 12, writecount 0, refcount 5 seqc users 0 mountedhere 0 hold count flags () flags (VMP_LAZYLIST) v_object 0xfffff8000610f108 ref 0 pages 1 cleanbuf 0 dirtybuf 1 lock type ufs: EXCL by thread 0xfffffe01c4119500 (pid 79080, mount, tid 102687) #0 0xffffffff80bce58e at lockmgr_xlock_hard+0x4be #1 0xffffffff80ecf15d at ffs_lock+0x9d #2 0xffffffff8112e220 at VOP_LOCK1_APV+0x40 #3 0xffffffff80d00d84 at _vn_lock+0x54 #4 0xffffffff80cdadad at lookup+0x34d #5 0xffffffff80cda30c at namei+0x6ac #6 0xffffffff80cf8a4c at kern_funlinkat+0x16c #7 0xffffffff80cf8dc4 at sys_funlinkat+0x44 #8 0xffffffff81069057 at amd64_syscall+0x147 #9 0xffffffff8103c2be at fast_syscall_common+0xf8 nlink=7, effnlink=7, size=1024, extsize 0 generation=701e8cd8, uid=0, gid=0, flags=0x0 ino 7704578, on dev gpt/work vnode 0xfffff80699f8a280: type VDIR usecount 1, writecount 0, refcount 2 seqc users 1 mountedhere 0xfffffe0144648000 hold count flags () flags (VIRF_MOUNTPOINT) v_object 0xfffff8057a379738 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe01448fe700 (pid 79085, umount, tid 101677) #0 0xffffffff80bcda95 at lockmgr_lock_flags+0x1d5 #1 0xffffffff80ecf15d at ffs_lock+0x9d #2 0xffffffff8112e220 at VOP_LOCK1_APV+0x40 #3 0xffffffff80d00d84 at _vn_lock+0x54 #4 0xffffffff80ce0069 at dounmount+0x79 #5 0xffffffff80cdff7c at kern_unmount+0x2fc #6 0xffffffff81069057 at amd64_syscall+0x147 #7 0xffffffff8103c2be at fast_syscall_common+0xf8 nlink=2, effnlink=2, size=512, extsize 0 generation=5f73253, uid=0, gid=0, flags=0x0 ino 106499712, on dev gpt/work vnode 0xfffff8057de65780: type VDIR usecount 3, writecount 0, refcount 2 seqc users 0 mountedhere 0 hold count flags () flags (VV_ROOT) lock type pseudofs: EXCL by thread 0xfffffe014379e800 (pid 78726, ls, tid 100218) #0 0xffffffff80bcda95 at lockmgr_lock_flags+0x1d5 #1 0xffffffff8112e220 at VOP_LOCK1_APV+0x40 #2 0xffffffff80d00d84 at _vn_lock+0x54 #3 0xffffffff80cdab35 at lookup+0xd5 #4 0xffffffff80cda30c at namei+0x6ac #5 0xffffffff80cf95b0 at kern_statat+0x130 #6 0xffffffff80cf9c9f at sys_fstatat+0x2f #7 0xffffffff81069057 at amd64_syscall+0x147 #8 0xffffffff8103c2be at fast_syscall_common+0xf8 vnode 0xfffff8057d1b8280: type VDIR usecount 1, writecount 0, refcount 1 seqc users 0 mountedhere 0 hold count flags () flags (VV_ROOT) lock type pseudofs: EXCL by thread 0xfffffe01439a6700 (pid 78468, ls, tid 100316) #0 0xffffffff80bce58e at lockmgr_xlock_hard+0x4be #1 0xffffffff80bcee85 at __lockmgr_args+0x625 #2 0xffffffff80bcd9ff at lockmgr_lock_flags+0x13f #3 0xffffffff8112e220 at VOP_LOCK1_APV+0x40 #4 0xffffffff80d00d84 at _vn_lock+0x54 #5 0xffffffff80cfda60 at kern_getdirentries+0x180 #6 0xffffffff80cfdce9 at sys_getdirentries+0x29 #7 0xffffffff81069057 at amd64_syscall+0x147 #8 0xffffffff8103c2be at fast_syscall_common+0xf8 vnode 0xfffff805807a9000: type VDIR usecount 1, writecount 0, refcount 1 seqc users 0 mountedhere 0 hold count flags () flags (VV_ROOT) lock type pseudofs: EXCL by thread 0xfffffe01c41b3500 (pid 78376, ls, tid 102741) #0 0xffffffff80bce58e at lockmgr_xlock_hard+0x4be #1 0xffffffff80bcee85 at __lockmgr_args+0x625 #2 0xffffffff80bcd9ff at lockmgr_lock_flags+0x13f #3 0xffffffff8112e220 at VOP_LOCK1_APV+0x40 #4 0xffffffff80d00d84 at _vn_lock+0x54 #5 0xffffffff80cfda60 at kern_getdirentries+0x180 #6 0xffffffff80cfdce9 at sys_getdirentries+0x29 #7 0xffffffff81069057 at amd64_syscall+0x147 #8 0xffffffff8103c2be at fast_syscall_common+0xf8 vnode 0xfffff80582a96280: type VDIR usecount 1, writecount 0, refcount 1 seqc users 0 mountedhere 0 hold count flags () flags (VV_ROOT) lock type pseudofs: EXCL by thread 0xfffffe0127533500 (pid 78326, ls, tid 100188) #0 0xffffffff80bce58e at lockmgr_xlock_hard+0x4be #1 0xffffffff80bcee85 at __lockmgr_args+0x625 #2 0xffffffff80bcd9ff at lockmgr_lock_flags+0x13f #3 0xffffffff8112e220 at VOP_LOCK1_APV+0x40 #4 0xffffffff80d00d84 at _vn_lock+0x54 #5 0xffffffff80cfda60 at kern_getdirentries+0x180 #6 0xffffffff80cfdce9 at sys_getdirentries+0x29 #7 0xffffffff81069057 at amd64_syscall+0x147 #8 0xffffffff8103c2be at fast_syscall_common+0xf8 db:1:pho1> show mount 0xfffffe010dc22700 /dev/gpt/work on / (ufs) 0xfffffe010dc23280 devfs on /dev (devfs) 0xfffffe0142e48280 /dev/gpt/tmp on /tmp (ufs) 0xfffffe0142e46b80 procfs on /proc (procfs) 0xfffffe0144651700 procfs on /mnt11 (procfs) 0xfffffe0144648000 procfs on /mnt10 (procfs) 0xfffffe0144648b80 procfs on /mnt15 (procfs) 0xfffffe014464bb80 procfs on /mnt20 (procfs) 0xfffffe014463db80 procfs on /mnt12 (procfs) 0xfffffe0144669700 procfs on /mnt13 (procfs) 0xfffffe0143d72280 procfs on /mnt18 (procfs) 0xfffffe014466b000 procfs on /mnt22 (procfs) 0xfffffe0144628000 procfs on /mnt14 (procfs) 0xfffffe0144645000 procfs on /mnt19 (procfs) More info: show mount db:1:pho1> show bufqueues bqempty: 67531 Buf domain 0 freebufs 14438 lofreebufs 219 hifreebufs 329 bufspace 6615040 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 28 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 628 (4505600) dirtyq count 28 (888832) wakeup 0 lim 25 CPU 4, 7, 0, 3, 9, 1, 2, 2, 4, 5, 0, 2, Locked buffers: 0 space 0 Total buffers: 4919 space 6615040 Buf domain 1 freebufs 14559 lofreebufs 219 hifreebufs 329 bufspace 2437120 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 570 (2367488) dirtyq count 0 (0) wakeup 0 lim 25 CPU 0, 0, 0, 0, 3, 0, 0, 0, 0, 1, 0, 0, Locked buffers: 0 space 0 Total buffers: 5653 space 2437120 Buf domain 2 freebufs 14560 lofreebufs 219 hifreebufs 329 bufspace 2383872 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 1 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 572 (2379776) dirtyq count 1 (4096) wakeup 0 lim 25 CPU 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, Locked buffers: 0 space 0 Total buffers: 5682 space 2383872 Buf domain 3 freebufs 13430 lofreebufs 219 hifreebufs 329 bufspace 34390016 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 1700 (34377728) dirtyq count 0 (0) wakeup 0 lim 25 CPU 0, 1, 0, 0, 0, 0, 0, 1, 1, 0, 0, 0, Locked buffers: 0 space 0 Total buffers: 5789 space 34390016 Buf domain 4 freebufs 13581 lofreebufs 219 hifreebufs 329 bufspace 28622848 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 1549 (28602368) dirtyq count 0 (0) wakeup 0 lim 25 CPU 1, 0, 0, 0, 0, 1, 0, 1, 0, 0, 0, 0, Locked buffers: 0 space 0 Total buffers: 5876 space 28622848 Buf domain 5 freebufs 14048 lofreebufs 219 hifreebufs 329 bufspace 13328384 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 54 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 1010 (11038720) dirtyq count 54 (1740800) wakeup 0 lim 25 CPU 0, 0, 0, 15, 3, 0, 0, 0, 0, 3, 0, 0, Locked buffers: 0 space 0 Total buffers: 5216 space 13328384 Buf domain 6 freebufs 14444 lofreebufs 219 hifreebufs 329 bufspace 4825088 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 5 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 682 (4653056) dirtyq count 5 (135168) wakeup 0 lim 25 CPU 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, Locked buffers: 2 space 36864 Total buffers: 5218 space 4825088 db:1:pho1> show page vm_cnt.v_free_count: 7885204 vm_cnt.v_inactive_count: 34452 vm_cnt.v_active_count: 9744 vm_cnt.v_laundry_count: 0 vm_cnt.v_wire_count: 192772 vm_cnt.v_free_reserved: 10644 vm_cnt.v_free_min: 51267 vm_cnt.v_free_target: 173136 vm_cnt.v_inactive_target: 259704 db:1:pho1> show pageq pq_free 7885204 dom 0 page_cnt 8124626 free 7885204 pq_act 9744 pq_inact 34452 pq_laund 0 pq_unsw 0 db:0:pho> show freepages DOMAIN: 0 FREE LIST 0: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 001688 | 000000 11 (008192K) | 000067 | 000000 10 (004096K) | 000176 | 000001 09 (002048K) | 000128 | 000000 08 (001024K) | 000161 | 000000 07 (000512K) | 000162 | 000000 06 (000256K) | 000283 | 000001 05 (000128K) | 000324 | 000001 04 (000064K) | 000098 | 000006 03 (000032K) | 000252 | 000015 02 (000016K) | 000865 | 000180 01 (000008K) | 001775 | 002335 00 (000004K) | 000001 | 005582 FREE LIST 1: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000000 | 000000 09 (002048K) | 000000 | 000000 08 (001024K) | 000000 | 000000 07 (000512K) | 000000 | 000000 06 (000256K) | 000001 | 000000 05 (000128K) | 000001 | 000000 04 (000064K) | 000002 | 000000 03 (000032K) | 000000 | 000000 02 (000016K) | 000001 | 000000 01 (000008K) | 000000 | 000000 00 (000004K) | 000000 | 000000 db:0:pho> show uma Zone Size Used Free Requests Sleeps Bucket Total Mem XFree FFS inode 1128 8217 24256 68160 0 8 36629544 0 pipe 744 20 45905 907527 0 16 34168200 0 mbuf_cluster 2048 15962 6 16029 0 254 32702464 0 VNODE 640 10241 23173 181778 0 22 21384960 0 malloc-256 256 162 74043 139924370 0 62 18996480 0 BUF TRIE 144 357 105595 578565 0 63 15257088 0 RADIX NODE 144 12994 85788 23272247 0 65 14224608 0 malloc-128 128 81926 1619 1257648 0 126 10693760 0 malloc-2048 2048 4 5006 125929 0 8 10260480 0 malloc-128 128 76950 2007 139648183 0 126 10106496 0 malloc-384 384 247 24513 182889 0 30 9507840 0 malloc-256 256 712 32573 243431 0 62 8520960 0 malloc-8192 8192 0 1030 5254 0 1 8437760 0 FFS2 dinode 256 8217 24393 68148 0 62 8348160 0 Files 80 291 92759 7206145 0 126 7444000 0 mbuf 256 16447 4043 85039 0 254 5245440 0 UMA Slabs 0 112 16805 27796 49679 0 126 4995312 0 malloc-4096 4096 147 960 903263 0 2 4534272 0 malloc-128 128 885 25403 99913 0 126 3364864 0 vmem btag 56 50592 300 51544 0 254 2849952 0 THREAD 1792 1325 241 247162 0 9 2806272 0 VMSPACE 2544 107 988 878347 0 4 2785680 0 malloc-16 16 163824 2426 1233906 0 254 2660000 0 VM OBJECT 264 8721 864 10778847 0 31 2530440 0 32 Bucket 256 2549 7171 103936 0 62 2488320 0 malloc-32 32 72416 1294 98525 0 254 2358720 0 malloc-4096 4096 11 536 96864 0 2 2240512 0 MAP ENTRY 96 3577 17843 40316094 0 126 2056320 0 malloc-32768 32768 20 41 6826 0 1 1998848 0 pbuf 2784 0 688 0 0 0 1915392 0 128 Bucket 1024 1668 171 1416340 0 16 1883136 0 256 Bucket 2048 787 103 84271 0 8 1822720 0 malloc-4096 4096 381 29 6862 0 2 1679360 0 PROC 1320 147 1035 878516 0 8 1560240 0 S VFS Cache 104 9816 5121 140527256 0 128 1553448 0 64 Bucket 512 2613 251 54543 0 30 1466368 0 filedesc0 1072 146 1128 878516 0 12 1365728 0 malloc-32768 32768 0 36 8108 0 1 1179648 0 DIRHASH 1024 768 344 2102 0 16 1138688 0 malloc-128 128 8 7742 9742 0 126 992000 0 mbuf_packet 256 13 3662 16134 0 254 940800 0 malloc-65536 65536 2 12 26 0 1 917504 0 16 Bucket 144 3779 2521 77454 0 62 907200 0 malloc-65536 65536 1 12 1425 0 1 851968 0 malloc-16384 16384 2 50 706381 0 2 851968 0 malloc-64 64 12625 605 22738 0 254 846720 0 malloc-16384 16384 13 37 3978 0 1 819200 0 malloc-65536 65536 1 11 136 0 1 786432 0 socket 944 57 699 8551 0 254 713664 0 malloc-8192 8192 86 1 89 0 1 712704 0 DEVCTL 1024 0 664 4441 0 0 679936 0 malloc-64 64 8572 1256 3526260 0 254 628992 0 malloc-32768 32768 0 19 835 0 1 622592 0 8 Bucket 80 6686 1064 2953775 0 126 620000 0 g_bio 408 0 1500 1940098 0 33 612000 0 malloc-256 256 1470 840 247581 0 62 591360 0 malloc-65536 65536 5 3 3078 0 1 524288 0 malloc-64 64 3503 4435 883541 0 254 508032 0 malloc-128 128 3182 724 394229 0 126 499968 0 UMA Zones 2048 232 3 234 0 8 481280 0 malloc-384 384 1184 56 1194 0 30 476160 0 malloc-65536 65536 6 1 7 0 1 458752 0 malloc-32768 32768 12 0 12 0 1 393216 0 Mountpoints 2944 14 110 661 0 4 365056 0 malloc-32768 32768 3 8 19 0 1 360448 0 malloc-32768 32768 2 9 22 0 1 360448 0 malloc-2048 2048 88 80 428028 0 8 344064 0 malloc-1024 1024 192 132 792 0 16 331776 0 malloc-65536 65536 0 5 13 0 1 327680 0 malloc-16384 16384 5 15 50 0 1 327680 0 ksiginfo 112 1156 1688 115317 0 126 318528 0 NAMEI 1024 13 291 286749932 0 16 311296 0 malloc-2048 2048 18 134 74742 0 8 311296 0 malloc-4096 4096 39 35 7116 0 2 303104 0 malloc-8192 8192 5 31 2120 0 1 294912 0 2 Bucket 32 4091 5107 400052 0 254 294336 0 malloc-8192 8192 3 32 161 0 1 286720 0 malloc-128 128 506 1664 308030 0 126 277760 0 malloc-384 384 173 527 785537 0 30 268800 0 malloc-64 64 688 3407 334957 0 254 262080 0 malloc-32 32 6744 1446 27828 0 254 262080 0 malloc-256 256 26 979 101475 0 62 257280 0 malloc-16 16 14262 1488 114510 0 254 252000 0 clpbuf 2784 0 90 2943 0 2 250560 0 malloc-256 256 76 869 24142 0 62 241920 0 malloc-64 64 483 3171 910513 0 254 233856 0 malloc-32768 32768 1 6 3010 0 1 229376 0 TURNSTILE 136 1567 113 1567 0 62 228480 0 malloc-64 64 202 3137 883667 0 254 213696 0 malloc-16384 16384 0 13 427 0 1 212992 0 unpcb 256 20 760 7982 0 254 199680 0 malloc-32 32 1919 4255 63854 0 254 197568 0 TMPFS node 224 0 846 30277 0 62 189504 0 4 Bucket 48 296 3148 105597 0 254 165312 0 malloc-256 256 83 562 13191 0 62 165120 0 malloc-32768 32768 5 0 5 0 1 163840 0 malloc-8192 8192 13 7 89 0 1 163840 0 malloc-2048 2048 54 24 82 0 8 159744 0 malloc-8192 8192 15 4 19 0 1 155648 0 SLEEPQUEUE 88 1567 193 1567 0 126 154880 0 malloc-64 64 33 2361 1861 0 254 153216 0 malloc-16384 16384 4 5 9 0 1 147456 0 KNOTE 160 0 900 368084 0 62 144000 0 malloc-8192 8192 14 3 2326 0 1 139264 0 malloc-4096 4096 16 17 556 0 2 135168 0 malloc-256 256 225 300 7306 0 62 134400 0 malloc-16384 16384 8 0 10 0 1 131072 0 malloc-8192 8192 14 2 16 0 1 131072 0 malloc-1024 1024 65 63 11666 0 16 131072 0 malloc-128 128 717 306 460205 0 126 130944 0 malloc-4096 4096 2 29 500259 0 2 126976 0 PWD 32 34 3872 177585 0 254 124992 0 ttyinq 160 345 405 5205 0 62 120000 0 ttyoutq 256 181 284 2770 0 62 119040 0 tcpcb 1048 12 98 70 0 254 115280 0 malloc-32 32 276 3126 199957 0 254 108864 0 udp_inpcb 488 22 170 450 0 254 93696 0 malloc-512 512 118 58 10235 0 30 90112 0 malloc-2048 2048 6 34 5692 0 8 81920 0 malloc-1024 1024 2 78 921259 0 16 81920 0 UMA Kegs 384 202 1 204 0 30 77952 0 malloc-65536 65536 1 0 1 0 1 65536 0 malloc-65536 65536 1 0 1 0 1 65536 0 malloc-1024 1024 0 64 62 0 16 65536 0 malloc-1024 1024 10 54 1603 0 16 65536 0 malloc-1024 1024 29 35 554 0 16 65536 0 malloc-1024 1024 9 51 144 0 16 61440 0 malloc-1024 1024 28 28 3901 0 16 57344 0 malloc-32 32 484 1280 3621 0 254 56448 0 vnpbuf 2784 0 20 2484 0 10 55680 0 malloc-384 384 66 74 210 0 30 53760 0 malloc-128 128 174 229 252 0 126 51584 0 malloc-384 384 21 109 7905 0 30 49920 0 malloc-512 512 2 94 500396 0 30 49152 0 pcpu-64 64 454 314 458 0 254 49152 0 fakepg 104 0 468 1261 0 126 48672 0 PGRP 88 35 517 806 0 126 48576 0 rl_entry 40 350 862 353 0 254 48480 0 udpcb 32 22 1490 450 0 254 48384 0 malloc-64 64 22 734 100193 0 254 48384 0 malloc-32 32 0 1512 1914 0 254 48384 0 malloc-32 32 106 1406 48605 0 254 48384 0 malloc-32 32 112 1400 12219 0 254 48384 0 malloc-16 16 295 2705 81521 0 254 48000 0 malloc-16 16 129 2871 33900 0 254 48000 0 malloc-16 16 59 2941 192 0 254 48000 0 malloc-16 16 76 2924 427987 0 254 48000 0 kenv 258 0 180 21583 0 30 46440 0 malloc-384 384 2 118 2617 0 30 46080 0 malloc-512 512 8 80 811 0 30 45056 0 pcpu-16 16 124 2692 124 0 254 45056 0 pcpu-8 8 3357 2275 3379 0 254 45056 0 malloc-16 16 321 2429 28745 0 254 44000 0 tcp_inpcb 488 12 68 70 0 254 39040 0 mdpbuf 2784 0 14 12124 0 1 38976 0 syncache 168 0 216 19 0 254 36288 0 malloc-16384 16384 0 2 2 0 1 32768 0 malloc-512 512 0 64 45 0 30 32768 0 tcptw 88 0 368 17 0 254 32384 0 cpuset 104 27 283 27 0 126 32240 0 malloc-512 512 5 51 1268 0 30 28672 0 rtentry 176 12 149 15 0 62 28336 0 routing nhops 256 9 96 15 0 62 26880 0 malloc-512 512 0 48 7 0 30 24576 0 malloc-512 512 12 36 20 0 30 24576 0 malloc-384 384 20 30 165 0 30 19200 0 malloc-256 256 14 61 28 0 62 19200 0 dtrace_state_cache 16384 0 1 1 0 1 16384 0 mbuf_jumbo_page 4096 0 4 4 0 254 16384 0 malloc-16384 16384 1 0 1 0 1 16384 0 malloc-2048 2048 4 4 929 0 8 16384 0 malloc-512 512 3 29 5 0 30 16384 0 FFS1 dinode 128 0 124 11 0 126 15872 0 ripcb 488 1 31 11 0 254 15616 0 L VFS Cache 320 26 10 26 0 30 11520 0 malloc-4096 4096 0 2 14 0 2 8192 0 malloc-2048 2048 2 2 2 0 8 8192 0 umtx pi 96 0 84 2 0 126 8064 0 KMAP ENTRY 96 76 5 100 0 0 7776 0 sctp_ep 1280 0 6 2 0 254 7680 0 FPU_save_area 832 1 8 1 0 16 7488 0 epoch_record pcpu 256 4 12 4 0 62 4096 0 malloc-4096 4096 1 0 1 0 2 4096 0 malloc-2048 2048 0 2 1 0 8 4096 0 hostcache 96 1 41 1 0 254 4032 0 vtnet_tx_hdr 24 0 167 0 0 254 4008 0 itimer 352 0 11 1 0 30 3872 0 UMA Slabs 1 176 10 12 10 0 62 3872 0 vmem 1856 1 1 1 0 8 3712 0 SMR CPU 32 2 61 2 0 254 2016 0 SMR SHARED 24 2 61 2 0 254 1512 0 taskq_zone 192 0 0 0 0 62 0 0 sctp_asconf_ack 48 0 0 0 0 254 0 0 sctp_asconf 40 0 0 0 0 254 0 0 sctp_stream_msg_out 112 0 0 0 0 254 0 0 sctp_readq 152 0 0 0 0 254 0 0 sctp_chunk 152 0 0 0 0 254 0 0 sctp_raddr 736 0 0 0 0 254 0 0 sctp_laddr 48 0 0 0 0 254 0 0 sctp_asoc 2288 0 0 0 0 254 0 0 swblk 136 0 0 0 0 62 0 0 swpctrie 144 0 0 0 0 62 0 0 udplite_inpcb 488 0 0 0 0 254 0 0 tcp_log_node 120 0 0 0 0 126 0 0 tcp_log_bucket 176 0 0 0 0 62 0 0 tcp_log 416 0 0 0 0 254 0 0 tcpreass 48 0 0 0 0 254 0 0 tfo_ccache_entries 80 0 0 0 0 126 0 0 tfo 4 0 0 0 0 254 0 0 sackhole 32 0 0 0 0 254 0 0 ipq 56 0 0 0 0 254 0 0 IPsec SA lft_c 16 0 0 0 0 254 0 0 AIOLIO 272 0 0 0 0 30 0 0 AIOCB 552 0 0 0 0 16 0 0 AIOP 32 0 0 0 0 254 0 0 AIO 208 0 0 0 0 62 0 0 NCLNODE 744 0 0 0 0 16 0 0 LTS VFS Cache 360 0 0 0 0 30 0 0 STS VFS Cache 144 0 0 0 0 62 0 0 cryptop 280 0 0 0 0 30 0 0 IOMMU_MAP_ENTRY 120 0 0 0 0 126 0 0 ktls_session 192 0 0 0 0 62 0 0 mbuf_jumbo_16k 16384 0 0 0 0 254 0 0 mbuf_jumbo_9k 9216 0 0 0 0 254 0 0 audit_record 1280 0 0 0 0 8 0 0 domainset 40 0 0 0 0 254 0 0 MAC labels 40 0 0 0 0 254 0 0 nfspbuf 2784 0 0 0 0 2 0 0 swwbuf 2784 0 0 0 0 1 0 0 swrbuf 2784 0 0 0 0 2 0 0 umtx_shm 88 0 0 0 0 126 0 0 rangeset pctrie nodes 144 0 0 0 0 62 0 0 malloc-384 384 0 0 0 0 30 0 0 malloc-16 16 0 0 0 0 254 0 0 pcpu-32 32 0 0 0 0 254 0 0 pcpu-4 4 0 0 0 0 254 0 0 UMA Hash 256 0 0 0 0 62 0 0 db:0:pho> show umacache Zone Size Used Free Requests Bucket debugnet_mbuf_packet 2048 0 0 0 0 debugnet_mbuf_cluster 2048 -6144 0 0 0 debugnet_mbuf 256 -10240 0 0 0 vm pgcache 4096 81560 2440 24533399 169 vm pgcache 4096 31942 2577 35745985 169 buf free cache 856 6871 31529 382258 18 buffer arena-65 65536 0 63 156 1 buffer arena-61 61440 0 0 0 1 buffer arena-57 57344 0 0 0 1 buffer arena-53 53248 0 0 0 1 buffer arena-49 49152 0 0 0 1 buffer arena-45 45056 0 0 0 1 buffer arena-40 40960 0 0 0 1 buffer arena-36 36864 0 0 0 1 buffer arena-32 32768 4247 21927 146203 6 buffer arena-28 28672 0 0 0 1 buffer arena-24 24576 0 0 0 1 buffer arena-20 20480 0 0 0 1 buffer arena-16 16384 3 4401 67062 1 buffer arena-12 12288 0 0 0 1 buffer arena-81 8192 0 0 0 1 buffer arena-40 4096 0 0 0 2 kstack_cache 16384 1325 83 247162 2 db:0:pho> acttrace Tracing command devd pid 2175 tid 100164 td 0xfffffe010dc33000 (CPU 3) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003cf06e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003cf06e10 trap() at trap+0x56/frame 0xfffffe003cf06f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003cf06f20 --- trap 0x13, rip = 0xffffffff80cadf39, rsp = 0xfffffe0140ea59a0, rbp = 0xfffffe0140ea5a20 --- kern_sendit() at kern_sendit+0x329/frame 0xfffffe0140ea5a20 sendit() at sendit+0x1db/frame 0xfffffe0140ea5a70 sys_sendto() at sys_sendto+0x4d/frame 0xfffffe0140ea5ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0140ea5bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0140ea5bf0 --- syscall (133, FreeBSD ELF64, sys_sendto), rip = 0x28c70a, rsp = 0x7fffffffbb78, rbp = 0x7fffffffc9d0 --- Tracing command ls pid 78326 tid 100188 td 0xfffffe0127533500 (CPU 5) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003cf1ee00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003cf1ee10 trap() at trap+0x56/frame 0xfffffe003cf1ef20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003cf1ef20 --- trap 0x13, rip = 0xffffffff80bda5cc, rsp = 0xfffffe0140f37870, rbp = 0xfffffe0140f378b0 --- __mtx_lock_flags() at __mtx_lock_flags+0x4c/frame 0xfffffe0140f378b0 pfs_iterate() at pfs_iterate+0x10a/frame 0xfffffe0140f378f0 pfs_readdir() at pfs_readdir+0x260/frame 0xfffffe0140f37980 VOP_READDIR_APV() at VOP_READDIR_APV+0x59/frame 0xfffffe0140f379a0 kern_getdirentries() at kern_getdirentries+0x1fb/frame 0xfffffe0140f37a90 sys_getdirentries() at sys_getdirentries+0x29/frame 0xfffffe0140f37ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0140f37bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0140f37bf0 --- syscall (554, FreeBSD ELF64, sys_getdirentries), rip = 0x80041832a, rsp = 0x7fffffffdd48, rbp = 0x7fffffffdd80 --- Tracing command ls pid 78468 tid 100316 td 0xfffffe01439a6700 (CPU 9) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003cf4ee00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003cf4ee10 trap() at trap+0x56/frame 0xfffffe003cf4ef20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003cf4ef20 --- trap 0x13, rip = 0xffffffff80c09732, rsp = 0xfffffe0143fb7830, rbp = 0xfffffe0143fb78b0 --- _sx_slock_hard() at _sx_slock_hard+0x1a2/frame 0xfffffe0143fb78b0 _sx_slock_int() at _sx_slock_int+0xdb/frame 0xfffffe0143fb78f0 pfs_readdir() at pfs_readdir+0x1c6/frame 0xfffffe0143fb7980 VOP_READDIR_APV() at VOP_READDIR_APV+0x59/frame 0xfffffe0143fb79a0 kern_getdirentries() at kern_getdirentries+0x1fb/frame 0xfffffe0143fb7a90 sys_getdirentries() at sys_getdirentries+0x29/frame 0xfffffe0143fb7ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0143fb7bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0143fb7bf0 --- syscall (554, FreeBSD ELF64, sys_getdirentries), rip = 0x80041832a, rsp = 0x7fffffffdd48, rbp = 0x7fffffffdd80 --- Tracing command mount pid 79080 tid 102687 td 0xfffffe01c4119500 (CPU 6) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003cf2ae00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003cf2ae10 trap() at trap+0x56/frame 0xfffffe003cf2af20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003cf2af20 --- trap 0x13, rip = 0xffffffff80cbe201, rsp = 0xfffffe01c4371420, rbp = 0xfffffe01c4371480 --- breada() at breada+0x1/frame 0xfffffe01c4371480 ffs_blkatoff() at ffs_blkatoff+0x89/frame 0xfffffe01c43714f0 ufs_lookup_ino() at ufs_lookup_ino+0x664/frame 0xfffffe01c4371660 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0x56/frame 0xfffffe01c4371680 vfs_cache_lookup() at vfs_cache_lookup+0xa6/frame 0xfffffe01c43716d0 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x56/frame 0xfffffe01c43716f0 lookup() at lookup+0x441/frame 0xfffffe01c4371790 namei() at namei+0x6ac/frame 0xfffffe01c4371850 kern_funlinkat() at kern_funlinkat+0x16c/frame 0xfffffe01c4371aa0 sys_funlinkat() at sys_funlinkat+0x44/frame 0xfffffe01c4371ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01c4371bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01c4371bf0 --- syscall (568, FreeBSD ELF64, sys_funlinkat), rip = 0x8003a208a, rsp = 0x7fffffffe478, rbp = 0x7fffffffe590 --- Tracing command mount pid 79096 tid 101619 td 0xfffffe0143dda100 (CPU 2) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003cefae00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003cefae10 trap() at trap+0x56/frame 0xfffffe003cefaf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003cefaf20 --- trap 0x13, rip = 0xffffffff80bf863a, rsp = 0xfffffe01440ea5e0, rbp = 0xfffffe01440ea610 --- _rw_wlock_cookie() at _rw_wlock_cookie+0x7a/frame 0xfffffe01440ea610 pmap_try_insert_pv_entry() at pmap_try_insert_pv_entry+0xd2/frame 0xfffffe01440ea650 pmap_enter_quick_locked() at pmap_enter_quick_locked+0x1ee/frame 0xfffffe01440ea6c0 pmap_enter_object() at pmap_enter_object+0x259/frame 0xfffffe01440ea730 vm_map_pmap_enter() at vm_map_pmap_enter+0x2e9/frame 0xfffffe01440ea7b0 vm_map_insert() at vm_map_insert+0x5b9/frame 0xfffffe01440ea850 vm_map_fixed() at vm_map_fixed+0x110/frame 0xfffffe01440ea8b0 vm_mmap_object() at vm_mmap_object+0x1c2/frame 0xfffffe01440ea920 vn_mmap() at vn_mmap+0x159/frame 0xfffffe01440ea9a0 kern_mmap() at kern_mmap+0x599/frame 0xfffffe01440eaa80 sys_mmap() at sys_mmap+0x42/frame 0xfffffe01440eaac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01440eabf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01440eabf0 --- syscall (477, FreeBSD ELF64, sys_mmap), rip = 0x8002227ea, rsp = 0x7fffffffcb28, rbp = 0x7fffffffcca0 --- Tracing command mount pid 79099 tid 101737 td 0xfffffe0144957c00 (CPU 8) kdb_enter() at kdb_enter+0x37/frame 0xfffffe014b3b75a0 vpanic() at vpanic+0x1b2/frame 0xfffffe014b3b75f0 panic() at panic+0x43/frame 0xfffffe014b3b7650 cache_fplookup() at cache_fplookup+0xd15/frame 0xfffffe014b3b7740 namei() at namei+0x12c/frame 0xfffffe014b3b7800 vn_open_cred() at vn_open_cred+0x107/frame 0xfffffe014b3b7960 kern_openat() at kern_openat+0x26f/frame 0xfffffe014b3b7ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014b3b7bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014b3b7bf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8003a250a, rsp = 0x7fffffffdc48, rbp = 0x7fffffffdd30 --- Tracing command date pid 79100 tid 101625 td 0xfffffe0144abd800 (CPU 4) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003cf12e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003cf12e10 trap() at trap+0x56/frame 0xfffffe003cf12f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003cf12f20 --- trap 0x13, rip = 0xffffffff80c08777, rsp = 0xfffffe0144183970, rbp = 0xfffffe0144183a00 --- _sx_xlock_hard() at _sx_xlock_hard+0x267/frame 0xfffffe0144183a00 _sx_xlock() at _sx_xlock+0xba/frame 0xfffffe0144183a40 exit1() at exit1+0x5ea/frame 0xfffffe0144183ab0 sys_sys_exit() at sys_sys_exit+0xd/frame 0xfffffe0144183ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0144183bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0144183bf0 --- syscall (1, FreeBSD ELF64, sys_sys_exit), rip = 0x80038920a, rsp = 0x7fffffffe0c8, rbp = 0x7fffffffe0e0 --- Tracing command umount pid 79102 tid 102740 td 0xfffffe01c41b3c00 (CPU 7) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003cf36e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003cf36e10 trap() at trap+0x56/frame 0xfffffe003cf36f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003cf36f20 --- trap 0x13, rip = 0xffffffff8105660a, rsp = 0xfffffe01d3072620, rbp = 0xfffffe01d3072650 --- pmap_try_insert_pv_entry() at pmap_try_insert_pv_entry+0xda/frame 0xfffffe01d3072650 pmap_enter_quick_locked() at pmap_enter_quick_locked+0x1ee/frame 0xfffffe01d30726c0 pmap_enter_object() at pmap_enter_object+0x259/frame 0xfffffe01d3072730 vm_map_pmap_enter() at vm_map_pmap_enter+0x2e9/frame 0xfffffe01d30727b0 vm_map_insert() at vm_map_insert+0x5b9/frame 0xfffffe01d3072850 vm_map_fixed() at vm_map_fixed+0x110/frame 0xfffffe01d30728b0 vm_mmap_object() at vm_mmap_object+0x1c2/frame 0xfffffe01d3072920 vn_mmap() at vn_mmap+0x159/frame 0xfffffe01d30729a0 kern_mmap() at kern_mmap+0x599/frame 0xfffffe01d3072a80 sys_mmap() at sys_mmap+0x42/frame 0xfffffe01d3072ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01d3072bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01d3072bf0 --- syscall (477, FreeBSD ELF64, sys_mmap), rip = 0x8002217ea, rsp = 0x7fffffffcb18, rbp = 0x7fffffffcc90 --- Tracing command mount pid 79104 tid 101661 td 0xfffffe01448ed800 (CPU 1) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ceeee00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ceeee10 trap() at trap+0x56/frame 0xfffffe003ceeef20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ceeef20 --- trap 0x13, rip = 0xffffffff80c6e797, rsp = 0xfffffe014b23b900, rbp = 0xfffffe014b23b930 --- witness_unlock() at witness_unlock+0xe7/frame 0xfffffe014b23b930 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe014b23b960 pmap_remove() at pmap_remove+0x5c2/frame 0xfffffe014b23b9e0 vm_map_delete() at vm_map_delete+0x20f/frame 0xfffffe014b23ba40 kern_munmap() at kern_munmap+0x99/frame 0xfffffe014b23bac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014b23bbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014b23bbf0 --- syscall (73, FreeBSD ELF64, sys_munmap), rip = 0x80022268a, rsp = 0x7fffffffcb38, rbp = 0x7fffffffcca0 --- Tracing command grep pid 79106 tid 100346 td 0xfffffe01439b7500 (CPU 10) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003cf5ae00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003cf5ae10 trap() at trap+0x56/frame 0xfffffe003cf5af20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003cf5af20 --- trap 0x13, rip = 0x8002247d0, rsp = 0x7fffffffdad0, rbp = 0x7fffffffdad0 --- Tracing command mount pid 79108 tid 102669 td 0xfffffe01cb6f3500 (CPU 11) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003cf66e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003cf66e10 trap() at trap+0x56/frame 0xfffffe003cf66f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003cf66f20 --- trap 0x13, rip = 0xffffffff81054c1e, rsp = 0xfffffe01c4317660, rbp = 0xfffffe01c43176c0 --- pmap_enter_quick_locked() at pmap_enter_quick_locked+0x2ce/frame 0xfffffe01c43176c0 pmap_enter_object() at pmap_enter_object+0x259/frame 0xfffffe01c4317730 vm_map_pmap_enter() at vm_map_pmap_enter+0x2e9/frame 0xfffffe01c43177b0 vm_map_insert() at vm_map_insert+0x5b9/frame 0xfffffe01c4317850 vm_map_fixed() at vm_map_fixed+0x110/frame 0xfffffe01c43178b0 vm_mmap_object() at vm_mmap_object+0x1c2/frame 0xfffffe01c4317920 vn_mmap() at vn_mmap+0x159/frame 0xfffffe01c43179a0 kern_mmap() at kern_mmap+0x599/frame 0xfffffe01c4317a80 sys_mmap() at sys_mmap+0x42/frame 0xfffffe01c4317ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01c4317bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01c4317bf0 --- syscall (477, FreeBSD ELF64, sys_mmap), rip = 0x8002227ea, rsp = 0x7fffffffcb38, rbp = 0x7fffffffcca0 --- Tracing command date pid 79113 tid 100348 td 0xfffffe01439b6700 (CPU 0) cpustop_handler() at cpustop_handler+0x28/frame 0xffffffff81df1720 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xffffffff81df1730 trap() at trap+0x56/frame 0xffffffff81df1840 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81df1840 --- trap 0x13, rip = 0xffffffff81054704, rsp = 0xfffffe01440576d0, rbp = 0xfffffe0144057730 --- pmap_enter_object() at pmap_enter_object+0xa4/frame 0xfffffe0144057730 vm_map_pmap_enter() at vm_map_pmap_enter+0x2e9/frame 0xfffffe01440577b0 vm_map_insert() at vm_map_insert+0x5b9/frame 0xfffffe0144057850 vm_map_fixed() at vm_map_fixed+0x110/frame 0xfffffe01440578b0 vm_mmap_object() at vm_mmap_object+0x1c2/frame 0xfffffe0144057920 vn_mmap() at vn_mmap+0x159/frame 0xfffffe01440579a0 kern_mmap() at kern_mmap+0x599/frame 0xfffffe0144057a80 sys_mmap() at sys_mmap+0x42/frame 0xfffffe0144057ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0144057bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0144057bf0 --- syscall (477, FreeBSD ELF64, sys_mmap), rip = 0x8002217ea, rsp = 0x7fffffffcb28, rbp = 0x7fffffffcca0 --- db:0:pho> ps pid ppid pgrp uid state wmesg wchan cmd 79117 75087 36379 0 RV+ sh 79116 79109 36379 0 RV+ sh 79115 75082 36379 0 RV+ sh 79113 79103 36379 0 R+ CPU 0 date 79112 75079 36379 0 R+ sh 79111 75079 36379 0 R+ mount 79110 75028 36379 0 R+ grep 79109 75042 36379 0 D+ ppwait 0xfffff804cdce6a10 sh 79108 75028 36379 0 R+ CPU 11 mount 79107 75052 36379 0 R+ grep 79106 75057 36379 0 R+ CPU 10 grep 79104 75052 36379 0 R+ CPU 1 mount 79105 75050 36379 0 R+ mount 79103 75032 36379 0 S+ piperd 0xfffff8029f97c5d0 sh 79101 75057 36379 0 R+ mount 79102 75071 36379 0 R+ CPU 7 umount 79100 79097 36379 0 RE+ CPU 4 date 79099 75065 36379 0 R+ CPU 8 mount 79098 75076 36379 0 S+ piperd 0xfffff804a7cce000 grep 79097 75030 36379 0 S+ wait 0xfffff8057c0d5528 sh 79096 75076 36379 0 R+ CPU 2 mount 79085 75026 36379 0 R+ umount 79080 75038 36379 0 R+ CPU 6 mount 79076 75029 36379 0 R+ ls 79075 75053 36379 0 R+ ls 79019 75027 36379 0 R+ ls 78998 75081 36379 0 R+ ls 78874 75035 36379 0 R+ ls 78869 75031 36379 0 R+ ls 78864 75091 36379 0 R+ ls 78810 75077 36379 0 D+ vfs_bus 0xfffffe0144648000 ls 78809 75067 36379 0 R+ ls 78788 75039 36379 0 R+ ls 78726 75044 36379 0 R+ ls 78468 75051 36379 0 R+ CPU 9 ls 78376 75083 36379 0 R+ ls 78326 75058 36379 0 R+ CPU 5 ls 75091 74957 36379 0 S+ wait 0xfffff804cdca4528 sh 75087 74957 36379 0 D+ ppwait 0xfffff8057c46ff38 sh 75083 74957 36379 0 S+ wait 0xfffff8068c1f1000 sh 75082 74957 36379 0 D+ ppwait 0xfffff8057c601f38 sh 75081 74957 36379 0 S+ wait 0xfffff800091eaa50 sh 75079 74957 36379 0 S+ wait 0xfffff8057f23e528 sh 75077 74957 36379 0 S+ wait 0xfffff8057f159a50 sh 75076 74957 36379 0 S+ wait 0xfffff80009317528 sh 75073 74957 36379 0 R+ sh 75071 74957 36379 0 S+ wait 0xfffff804cd8f5000 sh 75067 74957 36379 0 S+ wait 0xfffff804cd598a50 sh 75065 74957 36379 0 S+ wait 0xfffff8057f23ea50 sh 75058 74957 36379 0 S+ wait 0xfffff8057f36d000 sh 75057 74957 36379 0 S+ wait 0xfffff800094ab528 sh 75053 74957 36379 0 S+ wait 0xfffff8057f474a50 sh 75052 74957 36379 0 S+ wait 0xfffff8057cffc000 sh 75051 74957 36379 0 S+ wait 0xfffff804cd6fea50 sh 75050 74957 36379 0 S+ wait 0xfffff8029fd9e528 sh 75044 74957 36379 0 S+ wait 0xfffff804cd4c5528 sh 75042 74957 36379 0 S+ piperd 0xfffff8029f98c8b8 sh 75039 74957 36379 0 S+ wait 0xfffff804cd67e528 sh 75038 74957 36379 0 S+ wait 0xfffff804cde09000 sh 75035 74957 36379 0 S+ wait 0xfffff804cd194528 sh 75032 74957 36379 0 S+ piperd 0xfffff8004df772e8 sh 75031 74957 36379 0 S+ wait 0xfffff804cd287528 sh 75030 74957 36379 0 S+ piperd 0xfffff800098d4ba0 sh 75029 74957 36379 0 S+ wait 0xfffff8068c1f1a50 sh 75028 74957 36379 0 S+ wait 0xfffff8029ff6f000 sh 75027 74957 36379 0 S+ wait 0xfffff804cd46f000 sh 75026 74957 36379 0 S+ wait 0xfffff8057f2f5528 sh 74958 36379 36379 0 S+ piperd 0xfffff8029ff64ba0 tee 74957 74956 36379 0 S+ pause 0xfffff8029f7740b0 sh 74956 36379 36379 0 S+ wait 0xfffff804cd8f5528 sh 74694 2651 2613 0 S nanslp 0xffffffff81cb4ce7 sleep 32714 0 0 0 DL ftcl 0xffffffff82ca6534 [ftcleanup] 6446 0 0 0 DL waiting 0xffffffff823cb498 [sctp_iterator] 36379 2530 36379 0 S+ wait 0xfffff8068c360528 sh 82492 82491 82492 2006 Ss+ select 0xfffff80003be2bc0 bash 82491 82488 82488 2006 S select 0xfffff80009341640 sshd 82488 2482 82488 0 Ss select 0xfffff80003be2a40 sshd 2654 2613 2613 0 S piperd 0xfffff800093188b8 sh 2652 2613 2613 0 S piperd 0xfffff8000991f5d0 awk 2651 2613 2613 0 S wait 0xfffff80009c98a50 sh 2613 1 2613 0 Ss wait 0xfffff8004d30e000 sh 2530 2528 2530 0 S+ select 0xfffff80003be2d40 bash 2528 2527 2528 0 S+ pause 0xfffff8000456db00 csh 2527 2522 2527 2006 S+ wait 0xfffff80009112a50 su 2522 2521 2522 2006 Ss+ wait 0xfffff8004d127000 bash 2521 2518 2518 2006 S select 0xfffff80009ec8d40 sshd 2518 2482 2518 0 Ss select 0xfffff80009441b40 sshd 2515 2514 2515 0 S+ ttyin 0xfffff800061318b0 csh 2514 1 2514 0 Ss+ wait 0xfffff8004d127528 login 2513 1 2513 0 Ss+ ttyin 0xfffff800061414b0 getty 2512 1 2512 0 Ss+ ttyin 0xfffff800092584b0 getty 2511 1 2511 0 Ss+ ttyin 0xfffff80009258cb0 getty 2510 1 2510 0 Ss+ ttyin 0xfffff8000925b4b0 getty 2509 1 2509 0 Ss+ ttyin 0xfffff8000925bcb0 getty 2508 1 2508 0 Ss+ ttyin 0xfffff800092604b0 getty 2507 1 2507 0 Ss+ ttyin 0xfffff80009260cb0 getty 2506 1 2506 0 Ss+ ttyin 0xfffff800092634b0 getty 2505 1 2505 0 Ss+ ttyin 0xfffff80009263cb0 getty 2494 1 2494 0 Ss select 0xfffff800094418c0 inetd 2491 1 2491 0 Ss nanslp 0xffffffff81cb4ce5 cron 2482 1 2482 0 Ss select 0xfffff8029f3808c0 sshd 2453 1 2453 0 Ss select 0xfffff8000406a8c0 powerd 2450 1 2450 123 Ss select 0xfffff80009441940 ntpd 2411 1 2411 0 Ss rpcsvc 0xfffff8029f2d5b60 NLM: master 2408 1 2408 0 Ss select 0xfffff8029f380a40 rpc.statd 2386 1 2386 0 Ss select 0xfffff80009222540 rpcbind 2369 1 2369 0 Ss nanslp 0xffffffff81cb4ce6 watchdogd 2354 1 2354 0 Ss select 0xfffff800092225c0 syslogd 2175 1 2175 0 Rs CPU 3 devd 2170 1 2170 65 Ss select 0xfffff80009ec8bc0 dhclient 2111 1 2111 0 Ss select 0xfffff8029f380b40 dhclient 2108 1 2108 0 Ss select 0xfffff8029f380ac0 dhclient 34 0 0 0 DL syncer 0xffffffff81da41b8 [syncer] 33 0 0 0 DL vlruwt 0xfffff8000943e528 [vnlru] 32 0 0 0 DL (threaded) [bufdaemon] 100143 D qsleep 0xffffffff81da32a0 [bufdaemon] 100144 D - 0xffffffff8180ac80 [bufspacedaemon-0] 100145 D - 0xffffffff81812f40 [bufspacedaemon-1] 100146 D - 0xffffffff8181b200 [bufspacedaemon-2] 100147 D - 0xffffffff818234c0 [bufspacedaemon-3] 100148 D - 0xffffffff8182b780 [bufspacedaemon-4] 100149 D - 0xffffffff81833a40 [bufspacedaemon-5] 100150 D - 0xffffffff8183bd00 [bufspacedaemon-6] 100165 D sdflush 0xfffff80003b64ce8 [/ worker] 100170 D sdflush 0xfffff800092a50e8 [/tmp worker] 31 0 0 0 DL psleep 0xffffffff81dc86c8 [vmdaemon] 30 0 0 0 DL (threaded) [pagedaemon] 100141 D psleep 0xffffffff81dbcb38 [dom0] 100151 D launds 0xffffffff81dbcb44 [laundry: dom0] 100152 D umarcl 0xffffffff80ef0fe0 [uma] 29 0 0 0 DL idle 0xfffff8000923f000 [enc_daemon1] 28 0 0 0 DL idle 0xfffff8000923f528 [enc_daemon0] 27 0 0 0 DL - 0xffffffff81ae8ff8 [rand_harvestq] 26 0 0 0 DL - 0xffffffff81da085c [soaiod4] 25 0 0 0 DL - 0xffffffff81da085c [soaiod3] 24 0 0 0 DL - 0xffffffff81da085c [soaiod2] 23 0 0 0 DL - 0xffffffff81da085c [soaiod1] 22 0 0 0 DL (threaded) [usb] 100110 D - 0xfffffe010a23d440 [usbus0] 100111 D - 0xfffffe010a23d498 [usbus0] 100112 D - 0xfffffe010a23d4f0 [usbus0] 100113 D - 0xfffffe010a23d548 [usbus0] 100114 D - 0xfffffe010a23d5a0 [usbus0] 100116 D - 0xfffffe00e5006cf0 [usbus1] 100117 D - 0xfffffe00e5006d48 [usbus1] 100118 D - 0xfffffe00e5006da0 [usbus1] 100119 D - 0xfffffe00e5006df8 [usbus1] 100120 D - 0xfffffe00e5006e50 [usbus1] 100121 D - 0xfffffe010a4e4cf0 [usbus2] 100122 D - 0xfffffe010a4e4d48 [usbus2] 100123 D - 0xfffffe010a4e4da0 [usbus2] 100124 D - 0xfffffe010a4e4df8 [usbus2] 100125 D - 0xfffffe010a4e4e50 [usbus2] 21 0 0 0 RL (threaded) [cam] 100104 D - 0xffffffff819c0d40 [doneq0] 100105 RunQ [doneq1] 100106 D - 0xffffffff819c0e40 [doneq2] 100138 D - 0xffffffff819c0c10 [scanner] 20 0 0 0 DL crypto_ 0xfffff80003c6ec50 [crypto returns 11] 19 0 0 0 DL crypto_ 0xfffff80003c6ebf0 [crypto returns 10] 18 0 0 0 DL crypto_ 0xfffff80003c6eb90 [crypto returns 9] 17 0 0 0 DL crypto_ 0xfffff80003c6eb30 [crypto returns 8] 16 0 0 0 DL crypto_ 0xfffff80003c6ead0 [crypto returns 7] 15 0 0 0 DL crypto_ 0xfffff80003c6ea70 [crypto returns 6] 9 0 0 0 DL crypto_ 0xfffff80003c6ea10 [crypto returns 5] 8 0 0 0 DL crypto_ 0xfffff80003c6e9b0 [crypto returns 4] 7 0 0 0 DL crypto_ 0xfffff80003c6e950 [crypto returns 3] 6 0 0 0 DL crypto_ 0xfffff80003c6e8f0 [crypto returns 2] 5 0 0 0 DL crypto_ 0xfffff80003c6e890 [crypto returns 1] 4 0 0 0 DL crypto_ 0xfffff80003c6e830 [crypto returns 0] 3 0 0 0 DL crypto_ 0xffffffff81dba030 [crypto] 14 0 0 0 DL seqstat 0xfffff80003aa4c88 [sequencer 00] 13 0 0 0 DL (threaded) [geom] 100075 D - 0xffffffff81c94560 [g_event] 100076 D - 0xffffffff81c94568 [g_up] 100077 D - 0xffffffff81c94570 [g_down] 2 0 0 0 DL (threaded) [KTLS] 100048 D - 0xfffff80003b2d800 [thr_0] 100049 D - 0xfffff80003b2d880 [thr_1] 100050 D - 0xfffff80003b2d900 [thr_2] 100051 D - 0xfffff80003b2d980 [thr_3] 100052 D - 0xfffff80003b2da00 [thr_4] 100053 D - 0xfffff80003b2da80 [thr_5] 100054 D - 0xfffff80003b2db00 [thr_6] 100055 D - 0xfffff80003b2db80 [thr_7] 100056 D - 0xfffff80003b2dc00 [thr_8] 100057 D - 0xfffff80003b2dc80 [thr_9] 100058 D - 0xfffff80003b2dd00 [thr_10] 100059 D - 0xfffff80003b2dd80 [thr_11] 12 0 0 0 WL (threaded) [intr] 100041 I [swi6: task queue] 100042 I [swi6: Giant taskq] 100046 I [swi5: fast taskq] 100060 I [swi1: netisr 0] 100061 I [swi3: vm] 100062 I [swi4: clock (0)] 100063 I [swi4: clock (1)] 100064 I [swi4: clock (2)] 100065 I [swi4: clock (3)] 100066 I [swi4: clock (4)] 100067 I [swi4: clock (5)] 100068 I [swi4: clock (6)] 100069 I [swi4: clock (7)] 100070 I [swi4: clock (8)] 100071 I [swi4: clock (9)] 100072 I [swi4: clock (10)] 100073 I [swi4: clock (11)] 100107 I [swi4: apei] 100108 I [irq56: ahci0] 100109 I [irq19: xhci0] 100115 I [irq18: ehci0 ehci1+] 100126 I [irq71: ahci1] 100127 I [swi0: uart uart] 100195 I [irq72: ioat0] 100196 I [irq73: ioat1] 100197 I [irq74: ioat2] 100198 I [irq75: ioat3] 100199 I [irq76: ioat4] 100200 I [irq77: ioat5] 100201 I [irq78: ioat6] 100202 I [irq79: ioat7] 11 0 0 0 RL (threaded) [idle] 100003 CanRun [idle: cpu0] 100004 CanRun [idle: cpu1] 100005 CanRun [idle: cpu2] 100006 CanRun [idle: cpu3] 100007 CanRun [idle: cpu4] 100008 CanRun [idle: cpu5] 100009 CanRun [idle: cpu6] 100010 CanRun [idle: cpu7] 100011 CanRun [idle: cpu8] 100012 CanRun [idle: cpu9] 100013 CanRun [idle: cpu10] 100014 CanRun [idle: cpu11] 1 0 1 0 SLs wait 0xfffff80003a6d528 [init] 10 0 0 0 DL audit_w 0xffffffff81dba550 [audit] 0 0 0 0 DLs (threaded) [kernel] 100000 D swapin 0xffffffff81c94af0 [swapper] 100015 D - 0xfffff80003a4ce00 [if_io_tqg_0] 100016 D - 0xfffff80003a4cd00 [if_io_tqg_1] 100017 D - 0xfffff80003a4cc00 [if_io_tqg_2] 100018 D - 0xfffff80003a4cb00 [if_io_tqg_3] 100019 D - 0xfffff80003a4ca00 [if_io_tqg_4] 100020 D - 0xfffff80003a4c900 [if_io_tqg_5] 100021 D - 0xfffff80003a4c800 [if_io_tqg_6] 100022 D - 0xfffff80003a4c700 [if_io_tqg_7] 100023 D - 0xfffff80003a4c600 [if_io_tqg_8] 100024 D - 0xfffff80003a4c500 [if_io_tqg_9] 100025 D - 0xfffff80003a4c400 [if_io_tqg_10] 100026 D - 0xfffff80003a4c300 [if_io_tqg_11] 100027 D - 0xfffff80003a4c200 [if_config_tqg_0] 100028 D - 0xfffff80003a4c100 [softirq_0] 100029 D - 0xfffff80003a4c000 [softirq_1] 100030 D - 0xfffff80003a45e00 [softirq_2] 100031 D - 0xfffff80003a45d00 [softirq_3] 100032 D - 0xfffff80003a45c00 [softirq_4] 100033 D - 0xfffff80003a45b00 [softirq_5] 100034 D - 0xfffff80003a45a00 [softirq_6] 100035 D - 0xfffff80003a45900 [softirq_7] 100036 D - 0xfffff80003a45800 [softirq_8] 100037 D - 0xfffff80003a45700 [softirq_9] 100038 D - 0xfffff80003a45600 [softirq_10] 100039 D - 0xfffff80003a45500 [softirq_11] 100040 D - 0xfffff80003a41e00 [kqueue_ctx taskq] 100043 D - 0xfffff80003a41b00 [thread taskq] 100044 D - 0xfffff80003a41a00 [inm_free taskq] 100045 D - 0xfffff80003a41900 [aiod_kick taskq] 100047 D - 0xfffff80003a41700 [in6m_free taskq] 100074 D - 0xfffff80003ae8e00 [firmware taskq] 100079 D - 0xfffff80003ae8400 [crypto_0] 100080 D - 0xfffff80003ae8400 [crypto_1] 100081 D - 0xfffff80003ae8400 [crypto_2] 100082 D - 0xfffff80003ae8400 [crypto_3] 100083 D - 0xfffff80003ae8400 [crypto_4] 100084 D - 0xfffff80003ae8400 [crypto_5] 100085 D - 0xfffff80003ae8400 [crypto_6] 100086 D - 0xfffff80003ae8400 [crypto_7] 100087 D - 0xfffff80003ae8400 [crypto_8] 100088 D - 0xfffff80003ae8400 [crypto_9] 100089 D - 0xfffff80003ae8400 [crypto_10] 100090 D - 0xfffff80003ae8400 [crypto_11] 100128 D - 0xfffff80006231e00 [mca taskq] 100134 D - 0xfffff80009269e00 [acpi_task_0] 100135 D - 0xfffff80009269e00 [acpi_task_1] 100136 D - 0xfffff80009269e00 [acpi_task_2] 100137 D - 0xfffff80003dcbd00 [CAM taskq] 101870 D - 0xfffff80003a41400 [dtrace_taskq] 101871 D - 0xfffff800094db400 [system_taskq_0] 101872 D - 0xfffff800094db400 [system_taskq_1] 101873 D - 0xfffff800094db400 [system_taskq_2] 101874 D - 0xfffff800094db400 [system_taskq_3] 101875 D - 0xfffff800094db400 [system_taskq_4] 101876 D - 0xfffff800094db400 [system_taskq_5] 101877 D - 0xfffff800094db400 [system_taskq_6] 101878 D - 0xfffff800094db400 [system_taskq_7] 101879 D - 0xfffff800094db400 [system_taskq_8] 101880 D - 0xfffff800094db400 [system_taskq_9] 101881 D - 0xfffff800094db400 [system_taskq_10] 101882 D - 0xfffff800094db400 [system_taskq_11] db:0:pho> allt Tracing command kernel pid 0 tid 100000 td 0xffffffff81c95020 sched_switch() at sched_switch+0x5b3/frame 0xffffffff82131ab0 mi_switch() at mi_switch+0x155/frame 0xffffffff82131ad0 sleepq_switch() at sleepq_switch+0x109/frame 0xffffffff82131b10 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xffffffff82131b50 _sleep() at _sleep+0x29b/frame 0xffffffff82131c00 swapper() at swapper+0x75/frame 0xffffffff82131c60 mi_startup() at mi_startup+0x2ed/frame 0xffffffff82131cb0 btext() at btext+0x2c Tracing command kernel pid 0 tid 100015 td 0xfffffe00e4d1ae00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00377ccab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00377ccad0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00377ccb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377ccb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00377ccbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377ccbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377ccbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100016 td 0xfffffe00e4d1a700 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00377c7ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00377c7ad0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00377c7b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377c7b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00377c7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377c7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377c7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100017 td 0xfffffe00e4d1a000 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00377d6ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00377d6ad0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00377d6b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377d6b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00377d6bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377d6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377d6bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100018 td 0xfffffe00e4d1d800 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00377d1ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00377d1ad0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00377d1b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377d1b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00377d1bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377d1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377d1bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100019 td 0xfffffe00e4d9e100 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00377e0ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00377e0ad0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00377e0b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377e0b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00377e0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377e0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377e0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xfffffe00e4d9da00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00377dbab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00377dbad0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00377dbb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377dbb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00377dbbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377dbbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377dbbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xfffffe00e4d9d300 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00377eaab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00377eaad0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00377eab10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377eab80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00377eabb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377eabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377eabf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xfffffe00e4d9cc00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00377e5ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00377e5ad0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00377e5b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377e5b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00377e5bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377e5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377e5bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xfffffe00e4d9c500 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00377f4ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00377f4ad0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00377f4b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377f4b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00377f4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377f4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377f4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xfffffe00e4d9be00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00377efab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00377efad0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00377efb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377efb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00377efbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377efbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377efbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xfffffe00e4d9b700 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00377feab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00377fead0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00377feb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377feb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00377febb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377febf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377febf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100026 td 0xfffffe00e4d9b000 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00377f9ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00377f9ad0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00377f9b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377f9b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00377f9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377f9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377f9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100027 td 0xfffffe00e4d9e800 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4a35ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4a35ad0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4a35b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00e4a35b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00e4a35bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4a35bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4a35bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100028 td 0xfffffe00e4da6100 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4a30ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4a30ad0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4a30b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00e4a30b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00e4a30bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4a30bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4a30bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100029 td 0xfffffe00e4da5a00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4a3fab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4a3fad0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4a3fb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00e4a3fb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00e4a3fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4a3fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4a3fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100030 td 0xfffffe00e4da5300 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4a3aab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4a3aad0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4a3ab10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00e4a3ab80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00e4a3abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4a3abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4a3abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100031 td 0xfffffe00e4da4c00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4a49ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4a49ad0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4a49b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00e4a49b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00e4a49bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4a49bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4a49bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100032 td 0xfffffe00e4da4500 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4a44ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4a44ad0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4a44b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00e4a44b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00e4a44bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4a44bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4a44bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100033 td 0xfffffe00e4da3e00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4a53ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4a53ad0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4a53b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00e4a53b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00e4a53bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4a53bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4a53bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100034 td 0xfffffe00e4da3700 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4a4eab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4a4ead0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4a4eb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00e4a4eb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00e4a4ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4a4ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4a4ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100035 td 0xfffffe00e4da3000 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4a5dab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4a5dad0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4a5db10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00e4a5db80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00e4a5dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4a5dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4a5dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100036 td 0xfffffe00e4da6800 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4a58ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4a58ad0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4a58b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00e4a58b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00e4a58bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4a58bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4a58bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100037 td 0xfffffe00e4daa100 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4a67ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4a67ad0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4a67b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00e4a67b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00e4a67bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4a67bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4a67bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100038 td 0xfffffe00e4da9a00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4a62ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4a62ad0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4a62b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00e4a62b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00e4a62bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4a62bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4a62bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100039 td 0xfffffe00e4da9300 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4a71ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4a71ad0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4a71b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00e4a71b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00e4a71bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4a71bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4a71bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100040 td 0xfffffe00e4da8c00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4a6ca70 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4a6ca90 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4a6cad0 _sleep() at _sleep+0x2b4/frame 0xfffffe00e4a6cb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00e4a6cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4a6cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4a6cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100043 td 0xfffffe00e4da7700 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4a85a70 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4a85a90 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4a85ad0 _sleep() at _sleep+0x2b4/frame 0xfffffe00e4a85b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00e4a85bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4a85bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4a85bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100044 td 0xfffffe00e4da7000 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4a80a70 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4a80a90 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4a80ad0 _sleep() at _sleep+0x2b4/frame 0xfffffe00e4a80b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00e4a80bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4a80bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4a80bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100045 td 0xfffffe00e4daa800 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4a8fa70 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4a8fa90 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4a8fad0 _sleep() at _sleep+0x2b4/frame 0xfffffe00e4a8fb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00e4a8fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4a8fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4a8fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100047 td 0xfffffe00e4dada00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4a99a70 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4a99a90 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4a99ad0 _sleep() at _sleep+0x2b4/frame 0xfffffe00e4a99b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00e4a99bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4a99bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4a99bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100074 td 0xfffffe003cf3c000 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4b61a70 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4b61a90 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4b61ad0 _sleep() at _sleep+0x2b4/frame 0xfffffe00e4b61b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00e4b61bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4b61bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4b61bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100079 td 0xfffffe003cf31c00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4b70a70 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4b70a90 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4b70ad0 _sleep() at _sleep+0x2b4/frame 0xfffffe00e4b70b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00e4b70bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4b70bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4b70bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100080 td 0xfffffe003cf31500 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4b7fa70 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4b7fa90 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4b7fad0 _sleep() at _sleep+0x2b4/frame 0xfffffe00e4b7fb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00e4b7fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4b7fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4b7fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100081 td 0xfffffe003cf30e00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4b7aa70 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4b7aa90 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4b7aad0 _sleep() at _sleep+0x2b4/frame 0xfffffe00e4b7ab80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00e4b7abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4b7abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4b7abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100082 td 0xfffffe003cf30700 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4b89a70 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4b89a90 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4b89ad0 _sleep() at _sleep+0x2b4/frame 0xfffffe00e4b89b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00e4b89bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4b89bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4b89bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100083 td 0xfffffe003cf30000 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4b84a70 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4b84a90 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4b84ad0 _sleep() at _sleep+0x2b4/frame 0xfffffe00e4b84b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00e4b84bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4b84bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4b84bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100084 td 0xfffffe003cf33800 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4b93a70 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4b93a90 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4b93ad0 _sleep() at _sleep+0x2b4/frame 0xfffffe00e4b93b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00e4b93bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4b93bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4b93bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100085 td 0xfffffe003cf1b100 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4b8ea70 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4b8ea90 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4b8ead0 _sleep() at _sleep+0x2b4/frame 0xfffffe00e4b8eb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00e4b8ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4b8ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4b8ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100086 td 0xfffffe003cf1aa00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4b9da70 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4b9da90 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4b9dad0 _sleep() at _sleep+0x2b4/frame 0xfffffe00e4b9db80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00e4b9dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4b9dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4b9dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100087 td 0xfffffe003cf1a300 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4b98a70 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4b98a90 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4b98ad0 _sleep() at _sleep+0x2b4/frame 0xfffffe00e4b98b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00e4b98bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4b98bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4b98bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100088 td 0xfffffe003cf19c00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4ba7a70 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4ba7a90 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4ba7ad0 _sleep() at _sleep+0x2b4/frame 0xfffffe00e4ba7b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00e4ba7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ba7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ba7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100089 td 0xfffffe003cf19500 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4ba2a70 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4ba2a90 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4ba2ad0 _sleep() at _sleep+0x2b4/frame 0xfffffe00e4ba2b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00e4ba2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ba2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ba2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100090 td 0xfffffe003cf18e00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4bb1a70 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4bb1a90 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4bb1ad0 _sleep() at _sleep+0x2b4/frame 0xfffffe00e4bb1b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00e4bb1bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4bb1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4bb1bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100128 td 0xfffffe010a76d700 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4e79ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e79ad0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4e79b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00e4e79b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xef/frame 0xfffffe00e4e79bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e79bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e79bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100134 td 0xfffffe010da8e100 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4eafab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4eafad0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4eafb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00e4eafb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xef/frame 0xfffffe00e4eafbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4eafbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4eafbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100135 td 0xfffffe010da8da00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4ebeab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4ebead0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4ebeb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00e4ebeb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xef/frame 0xfffffe00e4ebebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ebebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ebebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100136 td 0xfffffe010da8d300 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4eb9ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4eb9ad0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4eb9b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00e4eb9b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xef/frame 0xfffffe00e4eb9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4eb9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4eb9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100137 td 0xfffffe010da8cc00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4ec8a70 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4ec8a90 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4ec8ad0 _sleep() at _sleep+0x2b4/frame 0xfffffe00e4ec8b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00e4ec8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ec8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ec8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 101870 td 0xfffffe0143d37a00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe014b47fa70 mi_switch() at mi_switch+0x155/frame 0xfffffe014b47fa90 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe014b47fad0 _sleep() at _sleep+0x2b4/frame 0xfffffe014b47fb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe014b47fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe014b47fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe014b47fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 101871 td 0xfffffe0143de6800 sched_switch() at sched_switch+0x5b3/frame 0xfffffe014b457a70 mi_switch() at mi_switch+0x155/frame 0xfffffe014b457a90 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe014b457ad0 _sleep() at _sleep+0x2b4/frame 0xfffffe014b457b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe014b457bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe014b457bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe014b457bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 101872 td 0xfffffe0143dca100 sched_switch() at sched_switch+0x5b3/frame 0xfffffe014b45ca70 mi_switch() at mi_switch+0x155/frame 0xfffffe014b45ca90 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe014b45cad0 _sleep() at _sleep+0x2b4/frame 0xfffffe014b45cb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe014b45cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe014b45cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe014b45cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 101873 td 0xfffffe0143dcc500 sched_switch() at sched_switch+0x5b3/frame 0xfffffe014b475a70 mi_switch() at mi_switch+0x155/frame 0xfffffe014b475a90 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe014b475ad0 _sleep() at _sleep+0x2b4/frame 0xfffffe014b475b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe014b475bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe014b475bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe014b475bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 101874 td 0xfffffe0144abae00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe014b43ea70 mi_switch() at mi_switch+0x155/frame 0xfffffe014b43ea90 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe014b43ead0 _sleep() at _sleep+0x2b4/frame 0xfffffe014b43eb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe014b43ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe014b43ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe014b43ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 101875 td 0xfffffe0143950a00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe0144002a70 mi_switch() at mi_switch+0x155/frame 0xfffffe0144002a90 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe0144002ad0 _sleep() at _sleep+0x2b4/frame 0xfffffe0144002b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0144002bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0144002bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0144002bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 101876 td 0xfffffe0143d37300 sched_switch() at sched_switch+0x5b3/frame 0xfffffe0144168a70 mi_switch() at mi_switch+0x155/frame 0xfffffe0144168a90 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe0144168ad0 _sleep() at _sleep+0x2b4/frame 0xfffffe0144168b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0144168bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0144168bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0144168bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 101877 td 0xfffffe014394fc00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe014b47aa70 mi_switch() at mi_switch+0x155/frame 0xfffffe014b47aa90 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe014b47aad0 _sleep() at _sleep+0x2b4/frame 0xfffffe014b47ab80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe014b47abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe014b47abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe014b47abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 101878 td 0xfffffe0143dd8c00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe01440c2a70 mi_switch() at mi_switch+0x155/frame 0xfffffe01440c2a90 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe01440c2ad0 _sleep() at _sleep+0x2b4/frame 0xfffffe01440c2b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe01440c2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe01440c2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01440c2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 101879 td 0xfffffe0143dd7e00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe014b466a70 mi_switch() at mi_switch+0x155/frame 0xfffffe014b466a90 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe014b466ad0 _sleep() at _sleep+0x2b4/frame 0xfffffe014b466b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe014b466bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe014b466bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe014b466bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 101880 td 0xfffffe0143d36c00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe0143fb2a70 mi_switch() at mi_switch+0x155/frame 0xfffffe0143fb2a90 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe0143fb2ad0 _sleep() at _sleep+0x2b4/frame 0xfffffe0143fb2b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0143fb2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0143fb2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0143fb2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 101881 td 0xfffffe0143d38100 sched_switch() at sched_switch+0x5b3/frame 0xfffffe014b44da70 mi_switch() at mi_switch+0x155/frame 0xfffffe014b44da90 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe014b44dad0 _sleep() at _sleep+0x2b4/frame 0xfffffe014b44db80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe014b44dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe014b44dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe014b44dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 101882 td 0xfffffe01439a6000 sched_switch() at sched_switch+0x5b3/frame 0xfffffe014b495a70 mi_switch() at mi_switch+0x155/frame 0xfffffe014b495a90 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe014b495ad0 _sleep() at _sleep+0x2b4/frame 0xfffffe014b495b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe014b495bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe014b495bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe014b495bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command init pid 1 tid 100002 td 0xfffffe00e4d16a00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00377816c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00377816e0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe0037781720 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0037781770 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0037781780 _sleep() at _sleep+0x2aa/frame 0xfffffe0037781830 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00377818c0 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0037781ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0037781bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0037781bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x28d2ca, rsp = 0x7fffffffe718, rbp = 0x7fffffffe780 --- Tracing command KTLS pid 2 tid 100048 td 0xfffffe00e4dae800 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4abb980 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4abb9a0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4abb9e0 _sleep() at _sleep+0x2b4/frame 0xfffffe00e4abba90 ktls_work_thread() at ktls_work_thread+0xd8/frame 0xfffffe00e4abbbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4abbbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4abbbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command KTLS pid 2 tid 100049 td 0xfffffe003cf57100 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4ab6980 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4ab69a0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4ab69e0 _sleep() at _sleep+0x2b4/frame 0xfffffe00e4ab6a90 ktls_work_thread() at ktls_work_thread+0xd8/frame 0xfffffe00e4ab6bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ab6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ab6bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command KTLS pid 2 tid 100050 td 0xfffffe003cf56a00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4ac5980 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4ac59a0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4ac59e0 _sleep() at _sleep+0x2b4/frame 0xfffffe00e4ac5a90 ktls_work_thread() at ktls_work_thread+0xd8/frame 0xfffffe00e4ac5bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ac5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ac5bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command KTLS pid 2 tid 100051 td 0xfffffe003cf56300 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4ac0980 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4ac09a0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4ac09e0 _sleep() at _sleep+0x2b4/frame 0xfffffe00e4ac0a90 ktls_work_thread() at ktls_work_thread+0xd8/frame 0xfffffe00e4ac0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ac0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ac0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command KTLS pid 2 tid 100052 td 0xfffffe003cf55c00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4acf980 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4acf9a0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4acf9e0 _sleep() at _sleep+0x2b4/frame 0xfffffe00e4acfa90 ktls_work_thread() at ktls_work_thread+0xd8/frame 0xfffffe00e4acfbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4acfbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4acfbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command KTLS pid 2 tid 100053 td 0xfffffe003cf55500 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4aca980 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4aca9a0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4aca9e0 _sleep() at _sleep+0x2b4/frame 0xfffffe00e4acaa90 ktls_work_thread() at ktls_work_thread+0xd8/frame 0xfffffe00e4acabb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4acabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4acabf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command KTLS pid 2 tid 100054 td 0xfffffe003cf54e00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4ad9980 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4ad99a0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4ad99e0 _sleep() at _sleep+0x2b4/frame 0xfffffe00e4ad9a90 ktls_work_thread() at ktls_work_thread+0xd8/frame 0xfffffe00e4ad9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ad9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ad9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command KTLS pid 2 tid 100055 td 0xfffffe003cf54700 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4ad4980 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4ad49a0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4ad49e0 _sleep() at _sleep+0x2b4/frame 0xfffffe00e4ad4a90 ktls_work_thread() at ktls_work_thread+0xd8/frame 0xfffffe00e4ad4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ad4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ad4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command KTLS pid 2 tid 100056 td 0xfffffe003cf54000 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4ae3980 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4ae39a0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4ae39e0 _sleep() at _sleep+0x2b4/frame 0xfffffe00e4ae3a90 ktls_work_thread() at ktls_work_thread+0xd8/frame 0xfffffe00e4ae3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ae3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ae3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command KTLS pid 2 tid 100057 td 0xfffffe003cf57800 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4ade980 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4ade9a0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4ade9e0 _sleep() at _sleep+0x2b4/frame 0xfffffe00e4adea90 ktls_work_thread() at ktls_work_thread+0xd8/frame 0xfffffe00e4adebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4adebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4adebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command KTLS pid 2 tid 100058 td 0xfffffe003cf4b100 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4aed980 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4aed9a0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4aed9e0 _sleep() at _sleep+0x2b4/frame 0xfffffe00e4aeda90 ktls_work_thread() at ktls_work_thread+0xd8/frame 0xfffffe00e4aedbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4aedbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4aedbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command KTLS pid 2 tid 100059 td 0xfffffe003cf4aa00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4ae8980 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4ae89a0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4ae89e0 _sleep() at _sleep+0x2b4/frame 0xfffffe00e4ae8a90 ktls_work_thread() at ktls_work_thread+0xd8/frame 0xfffffe00e4ae8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ae8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ae8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100091 td 0xfffffe003cf18700 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4baca60 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4baca80 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4bacac0 _sleep() at _sleep+0x2b4/frame 0xfffffe00e4bacb70 crypto_proc() at crypto_proc+0x27f/frame 0xfffffe00e4bacbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4bacbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4bacbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 0 pid 4 tid 100092 td 0xfffffe003cf18000 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4bbba60 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4bbba80 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4bbbac0 _sleep() at _sleep+0x2b4/frame 0xfffffe00e4bbbb70 crypto_ret_proc() at crypto_ret_proc+0x222/frame 0xfffffe00e4bbbbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4bbbbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4bbbbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 1 pid 5 tid 100093 td 0xfffffe003cf1b800 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4bb6a60 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4bb6a80 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4bb6ac0 _sleep() at _sleep+0x2b4/frame 0xfffffe00e4bb6b70 crypto_ret_proc() at crypto_ret_proc+0x222/frame 0xfffffe00e4bb6bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4bb6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4bb6bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 2 pid 6 tid 100094 td 0xfffffe003cf0f100 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4bc5a60 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4bc5a80 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4bc5ac0 _sleep() at _sleep+0x2b4/frame 0xfffffe00e4bc5b70 crypto_ret_proc() at crypto_ret_proc+0x222/frame 0xfffffe00e4bc5bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4bc5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4bc5bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 3 pid 7 tid 100095 td 0xfffffe003cf0ea00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4bc0a60 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4bc0a80 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4bc0ac0 _sleep() at _sleep+0x2b4/frame 0xfffffe00e4bc0b70 crypto_ret_proc() at crypto_ret_proc+0x222/frame 0xfffffe00e4bc0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4bc0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4bc0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 4 pid 8 tid 100096 td 0xfffffe003cf0e300 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4bcfa60 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4bcfa80 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4bcfac0 _sleep() at _sleep+0x2b4/frame 0xfffffe00e4bcfb70 crypto_ret_proc() at crypto_ret_proc+0x222/frame 0xfffffe00e4bcfbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4bcfbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4bcfbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 5 pid 9 tid 100097 td 0xfffffe003cf0dc00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4bcaa60 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4bcaa80 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4bcaac0 _sleep() at _sleep+0x2b4/frame 0xfffffe00e4bcab70 crypto_ret_proc() at crypto_ret_proc+0x222/frame 0xfffffe00e4bcabb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4bcabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4bcabf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command audit pid 10 tid 100001 td 0xfffffe00e4d17100 sched_switch() at sched_switch+0x5b3/frame 0xfffffe0037786a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037786aa0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe0037786ae0 _cv_wait() at _cv_wait+0x16d/frame 0xfffffe0037786b40 audit_worker() at audit_worker+0x9f/frame 0xfffffe0037786bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037786bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037786bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100003 td 0xfffffe00e4d16300 sched_switch() at sched_switch+0x5b3/frame 0xfffffe0037790ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037790ae0 sched_idletd() at sched_idletd+0x9e/frame 0xfffffe0037790bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037790bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037790bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffffe00e4d15c00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe003778bac0 mi_switch() at mi_switch+0x155/frame 0xfffffe003778bae0 sched_idletd() at sched_idletd+0x9e/frame 0xfffffe003778bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003778bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003778bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffffe00e4d15500 sched_switch() at sched_switch+0x5b3/frame 0xfffffe003779aac0 mi_switch() at mi_switch+0x155/frame 0xfffffe003779aae0 sched_idletd() at sched_idletd+0x9e/frame 0xfffffe003779abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003779abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003779abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffffe00e4d14e00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe0037795ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037795ae0 sched_idletd() at sched_idletd+0x9e/frame 0xfffffe0037795bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037795bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037795bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffffe00e4d14700 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00377a4ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00377a4ae0 sched_idletd() at sched_idletd+0x9e/frame 0xfffffe00377a4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377a4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377a4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffffe00e4d14000 sched_switch() at sched_switch+0x5b3/frame 0xfffffe003779fac0 mi_switch() at mi_switch+0x155/frame 0xfffffe003779fae0 sched_idletd() at sched_idletd+0x9e/frame 0xfffffe003779fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003779fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003779fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffffe00e4d17800 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00377aeac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00377aeae0 sched_idletd() at sched_idletd+0x41d/frame 0xfffffe00377aebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377aebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377aebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffffe00e4d1d100 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00377a9ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00377a9ae0 sched_idletd() at sched_idletd+0x9e/frame 0xfffffe00377a9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377a9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377a9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffffe00e4d1ca00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00377b8ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00377b8ae0 sched_idletd() at sched_idletd+0x9e/frame 0xfffffe00377b8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377b8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377b8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffffe00e4d1c300 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00377b3ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00377b3ae0 sched_idletd() at sched_idletd+0x9e/frame 0xfffffe00377b3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377b3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377b3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffffe00e4d1bc00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00377c2ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00377c2ae0 sched_idletd() at sched_idletd+0x41d/frame 0xfffffe00377c2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377c2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377c2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffffe00e4d1b500 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00377bdac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00377bdae0 sched_idletd() at sched_idletd+0x41d/frame 0xfffffe00377bdbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377bdbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377bdbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100041 td 0xfffffe00e4da8500 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4a7bb00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4a7bb20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4a7bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4a7bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4a7bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100042 td 0xfffffe00e4da7e00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4a76b00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4a76b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4a76bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4a76bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4a76bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100046 td 0xfffffe00e4dae100 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100060 td 0xfffffe003cf4a300 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4af7b00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4af7b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4af7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4af7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4af7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100061 td 0xfffffe003cf49c00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100062 td 0xfffffe003cf49500 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4b01b00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4b01b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4b01bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4b01bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4b01bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100063 td 0xfffffe003cf48e00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4afcb00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4afcb20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4afcbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4afcbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4afcbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100064 td 0xfffffe003cf48700 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4b0bb00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4b0bb20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4b0bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4b0bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4b0bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100065 td 0xfffffe003cf48000 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4b06b00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4b06b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4b06bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4b06bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4b06bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100066 td 0xfffffe003cf4b800 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4b15b00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4b15b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4b15bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4b15bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4b15bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100067 td 0xfffffe003cf3f100 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4b10b00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4b10b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4b10bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4b10bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4b10bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100068 td 0xfffffe003cf3ea00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100069 td 0xfffffe003cf3e300 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100070 td 0xfffffe003cf3dc00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100071 td 0xfffffe003cf3d500 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100072 td 0xfffffe003cf3ce00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100073 td 0xfffffe003cf3c700 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100107 td 0xfffffe003cef7800 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100108 td 0xfffffe00e501b100 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4e09b00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e09b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4e09bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e09bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e09bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100109 td 0xfffffe00e501aa00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4e18b00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e18b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4e18bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e18bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e18bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100115 td 0xfffffe00e5018000 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4e36b00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e36b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4e36bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e36bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e36bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100126 td 0xfffffe010a76e500 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100127 td 0xfffffe010a76de00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4e7eb00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e7eb20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4e7ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e7ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e7ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100195 td 0xfffffe010a3c4e00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100196 td 0xfffffe010a3c4700 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100197 td 0xfffffe010a3c4000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100198 td 0xfffffe0142f18800 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100199 td 0xfffffe01433f6100 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100200 td 0xfffffe01433f5a00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100201 td 0xfffffe01433f5300 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100202 td 0xfffffe01433f4c00 fork_trampoline() at fork_trampoline Tracing command geom pid 13 tid 100075 td 0xfffffe003cf3f800 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4b5ca70 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4b5ca90 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4b5cad0 _sleep() at _sleep+0x2b4/frame 0xfffffe00e4b5cb80 g_run_events() at g_run_events+0x54/frame 0xfffffe00e4b5cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4b5cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4b5cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100076 td 0xfffffe003cf33100 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4b6ba60 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4b6ba80 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4b6bac0 _sleep() at _sleep+0x2b4/frame 0xfffffe00e4b6bb70 g_io_schedule_up() at g_io_schedule_up+0x3c/frame 0xfffffe00e4b6bba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe00e4b6bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4b6bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4b6bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100077 td 0xfffffe003cf32a00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4b66a60 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4b66a80 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4b66ac0 _sleep() at _sleep+0x2b4/frame 0xfffffe00e4b66b70 g_io_schedule_down() at g_io_schedule_down+0x4c/frame 0xfffffe00e4b66ba0 g_down_procbody() at g_down_procbody+0x5c/frame 0xfffffe00e4b66bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4b66bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4b66bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sequencer 00 pid 14 tid 100078 td 0xfffffe003cf32300 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4b75a70 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4b75a90 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4b75ad0 _cv_wait() at _cv_wait+0x16d/frame 0xfffffe00e4b75b30 seq_eventthread() at seq_eventthread+0x91/frame 0xfffffe00e4b75bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4b75bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4b75bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 6 pid 15 tid 100098 td 0xfffffe003cf0d500 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4bd9a60 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4bd9a80 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4bd9ac0 _sleep() at _sleep+0x2b4/frame 0xfffffe00e4bd9b70 crypto_ret_proc() at crypto_ret_proc+0x222/frame 0xfffffe00e4bd9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4bd9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4bd9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 7 pid 16 tid 100099 td 0xfffffe003cf0ce00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4bd4a60 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4bd4a80 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4bd4ac0 _sleep() at _sleep+0x2b4/frame 0xfffffe00e4bd4b70 crypto_ret_proc() at crypto_ret_proc+0x222/frame 0xfffffe00e4bd4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4bd4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4bd4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 8 pid 17 tid 100100 td 0xfffffe003cf0c700 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4be3a60 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4be3a80 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4be3ac0 _sleep() at _sleep+0x2b4/frame 0xfffffe00e4be3b70 crypto_ret_proc() at crypto_ret_proc+0x222/frame 0xfffffe00e4be3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4be3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4be3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 9 pid 18 tid 100101 td 0xfffffe003cf0c000 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4bdea60 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4bdea80 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4bdeac0 _sleep() at _sleep+0x2b4/frame 0xfffffe00e4bdeb70 crypto_ret_proc() at crypto_ret_proc+0x222/frame 0xfffffe00e4bdebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4bdebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4bdebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 10 pid 19 tid 100102 td 0xfffffe003cf0f800 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4beda60 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4beda80 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4bedac0 _sleep() at _sleep+0x2b4/frame 0xfffffe00e4bedb70 crypto_ret_proc() at crypto_ret_proc+0x222/frame 0xfffffe00e4bedbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4bedbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4bedbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 11 pid 20 tid 100103 td 0xfffffe003cef7100 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4be8a60 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4be8a80 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4be8ac0 _sleep() at _sleep+0x2b4/frame 0xfffffe00e4be8b70 crypto_ret_proc() at crypto_ret_proc+0x222/frame 0xfffffe00e4be8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4be8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4be8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 21 tid 100104 td 0xfffffe003cef6a00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4bf7a50 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4bf7a70 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4bf7ab0 _sleep() at _sleep+0x2b4/frame 0xfffffe00e4bf7b60 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe00e4bf7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4bf7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4bf7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 21 tid 100105 td 0xfffffe003cef6300 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4bf2a50 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4bf2a70 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4bf2ab0 _sleep() at _sleep+0x2b4/frame 0xfffffe00e4bf2b60 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe00e4bf2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4bf2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4bf2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 21 tid 100106 td 0xfffffe003cef5c00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4e04a50 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e04a70 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4e04ab0 _sleep() at _sleep+0x2b4/frame 0xfffffe00e4e04b60 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe00e4e04bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e04bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e04bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 21 tid 100138 td 0xfffffe010da8c500 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4ec3a70 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4ec3a90 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4ec3ad0 _sleep() at _sleep+0x2b4/frame 0xfffffe00e4ec3b80 xpt_scanner_thread() at xpt_scanner_thread+0x138/frame 0xfffffe00e4ec3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ec3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ec3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 22 tid 100110 td 0xfffffe00e501a300 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4e13ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e13ae0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4e13b20 _cv_wait() at _cv_wait+0x16d/frame 0xfffffe00e4e13b80 usb_process() at usb_process+0xb3/frame 0xfffffe00e4e13bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e13bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e13bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 22 tid 100111 td 0xfffffe00e5019c00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4e22ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e22ae0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4e22b20 _cv_wait() at _cv_wait+0x16d/frame 0xfffffe00e4e22b80 usb_process() at usb_process+0xb3/frame 0xfffffe00e4e22bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e22bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e22bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 22 tid 100112 td 0xfffffe00e5019500 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4e1dac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e1dae0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4e1db20 _cv_wait() at _cv_wait+0x16d/frame 0xfffffe00e4e1db80 usb_process() at usb_process+0xb3/frame 0xfffffe00e4e1dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e1dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e1dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 22 tid 100113 td 0xfffffe00e5018e00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4e2cac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e2cae0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4e2cb20 _cv_wait() at _cv_wait+0x16d/frame 0xfffffe00e4e2cb80 usb_process() at usb_process+0xb3/frame 0xfffffe00e4e2cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e2cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e2cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 22 tid 100114 td 0xfffffe00e5018700 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4e27ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e27ae0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4e27b20 _cv_wait() at _cv_wait+0x16d/frame 0xfffffe00e4e27b80 usb_process() at usb_process+0xb3/frame 0xfffffe00e4e27bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e27bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e27bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 22 tid 100116 td 0xfffffe00e501b800 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4e31ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e31ae0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4e31b20 _cv_wait() at _cv_wait+0x16d/frame 0xfffffe00e4e31b80 usb_process() at usb_process+0xb3/frame 0xfffffe00e4e31bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e31bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e31bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 22 tid 100117 td 0xfffffe010a3c7100 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4e40ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e40ae0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4e40b20 _cv_wait() at _cv_wait+0x16d/frame 0xfffffe00e4e40b80 usb_process() at usb_process+0xb3/frame 0xfffffe00e4e40bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e40bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e40bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 22 tid 100118 td 0xfffffe010a3c6a00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4e3bac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e3bae0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4e3bb20 _cv_wait() at _cv_wait+0x16d/frame 0xfffffe00e4e3bb80 usb_process() at usb_process+0xb3/frame 0xfffffe00e4e3bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e3bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e3bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 22 tid 100119 td 0xfffffe010a3c6300 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4e4aac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e4aae0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4e4ab20 _cv_wait() at _cv_wait+0x16d/frame 0xfffffe00e4e4ab80 usb_process() at usb_process+0xb3/frame 0xfffffe00e4e4abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e4abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e4abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 22 tid 100120 td 0xfffffe010a3c5c00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4e45ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e45ae0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4e45b20 _cv_wait() at _cv_wait+0x16d/frame 0xfffffe00e4e45b80 usb_process() at usb_process+0xb3/frame 0xfffffe00e4e45bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e45bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e45bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 22 tid 100121 td 0xfffffe010a3c7800 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4e60ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e60ae0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4e60b20 _cv_wait() at _cv_wait+0x16d/frame 0xfffffe00e4e60b80 usb_process() at usb_process+0xb3/frame 0xfffffe00e4e60bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e60bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e60bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 22 tid 100122 td 0xfffffe010a770100 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4e5bac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e5bae0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4e5bb20 _cv_wait() at _cv_wait+0x16d/frame 0xfffffe00e4e5bb80 usb_process() at usb_process+0xb3/frame 0xfffffe00e4e5bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e5bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e5bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 22 tid 100123 td 0xfffffe010a76fa00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4e6aac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e6aae0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4e6ab20 _cv_wait() at _cv_wait+0x16d/frame 0xfffffe00e4e6ab80 usb_process() at usb_process+0xb3/frame 0xfffffe00e4e6abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e6abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e6abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 22 tid 100124 td 0xfffffe010a76f300 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4e65ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e65ae0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4e65b20 _cv_wait() at _cv_wait+0x16d/frame 0xfffffe00e4e65b80 usb_process() at usb_process+0xb3/frame 0xfffffe00e4e65bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e65bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e65bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 22 tid 100125 td 0xfffffe010a76ec00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4e74ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e74ae0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4e74b20 _cv_wait() at _cv_wait+0x16d/frame 0xfffffe00e4e74b80 usb_process() at usb_process+0xb3/frame 0xfffffe00e4e74bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e74bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e74bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod1 pid 23 tid 100129 td 0xfffffe010a770800 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4e94a20 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e94a40 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4e94a80 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e4e94ac0 _sleep() at _sleep+0x29b/frame 0xfffffe00e4e94b70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe00e4e94bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e94bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e94bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod2 pid 24 tid 100130 td 0xfffffe010d708100 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4e8fa20 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e8fa40 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4e8fa80 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e4e8fac0 _sleep() at _sleep+0x29b/frame 0xfffffe00e4e8fb70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe00e4e8fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e8fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e8fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod3 pid 25 tid 100131 td 0xfffffe010d707a00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4e9ea20 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e9ea40 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4e9ea80 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e4e9eac0 _sleep() at _sleep+0x29b/frame 0xfffffe00e4e9eb70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe00e4e9ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e9ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e9ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod4 pid 26 tid 100132 td 0xfffffe010d707300 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4e99a20 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e99a40 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4e99a80 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e4e99ac0 _sleep() at _sleep+0x29b/frame 0xfffffe00e4e99b70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe00e4e99bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e99bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e99bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command rand_harvestq pid 27 tid 100133 td 0xfffffe010d708800 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4eb49d0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4eb49f0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4eb4a30 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e4eb4a70 _sleep() at _sleep+0x29b/frame 0xfffffe00e4eb4b20 random_kthread() at random_kthread+0x67/frame 0xfffffe00e4eb4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4eb4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4eb4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon0 pid 28 tid 100139 td 0xfffffe010d706c00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4ed2a30 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4ed2a50 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4ed2a90 _sleep() at _sleep+0x2b4/frame 0xfffffe00e4ed2b40 enc_daemon() at enc_daemon+0xe4/frame 0xfffffe00e4ed2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ed2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ed2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon1 pid 29 tid 100140 td 0xfffffe010d706500 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4ecda30 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4ecda50 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4ecda90 _sleep() at _sleep+0x2b4/frame 0xfffffe00e4ecdb40 enc_daemon() at enc_daemon+0xe4/frame 0xfffffe00e4ecdbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ecdbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ecdbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100141 td 0xfffffe010da8be00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4edc760 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4edc780 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4edc7c0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e4edc800 _sleep() at _sleep+0x29b/frame 0xfffffe00e4edc8b0 vm_pageout_worker() at vm_pageout_worker+0x28c/frame 0xfffffe00e4edcb70 vm_pageout() at vm_pageout+0x21e/frame 0xfffffe00e4edcbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4edcbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4edcbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100151 td 0xfffffe010dc36800 sched_switch() at sched_switch+0x5b3/frame 0xfffffe0112075820 mi_switch() at mi_switch+0x155/frame 0xfffffe0112075840 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe0112075880 _sleep() at _sleep+0x2b4/frame 0xfffffe0112075930 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0xc3c/frame 0xfffffe0112075bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0112075bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0112075bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100152 td 0xfffffe010dd07100 sched_switch() at sched_switch+0x5b3/frame 0xfffffe0111d6da30 mi_switch() at mi_switch+0x155/frame 0xfffffe0111d6da50 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe0111d6da90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0111d6dad0 _sleep() at _sleep+0x29b/frame 0xfffffe0111d6db80 uma_reclaim_worker() at uma_reclaim_worker+0xb8/frame 0xfffffe0111d6dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0111d6dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0111d6dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vmdaemon pid 31 tid 100142 td 0xfffffe010da8b700 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4ed7a30 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4ed7a50 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4ed7a90 _sleep() at _sleep+0x2b4/frame 0xfffffe00e4ed7b40 vm_daemon() at vm_daemon+0x82/frame 0xfffffe00e4ed7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ed7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ed7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100143 td 0xfffffe010da8b000 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4ef2a10 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4ef2a30 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4ef2a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e4ef2ab0 _sleep() at _sleep+0x29b/frame 0xfffffe00e4ef2b60 buf_daemon() at buf_daemon+0x121/frame 0xfffffe00e4ef2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ef2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ef2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100144 td 0xfffffe010da8e800 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4ffda00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4ffda20 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4ffda60 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e4ffdaa0 _sleep() at _sleep+0x29b/frame 0xfffffe00e4ffdb50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00e4ffdbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ffdbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ffdbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100145 td 0xfffffe010dc36100 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4ff8a00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4ff8a20 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4ff8a60 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e4ff8aa0 _sleep() at _sleep+0x29b/frame 0xfffffe00e4ff8b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00e4ff8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ff8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ff8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100146 td 0xfffffe010dc35a00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe010fc33a00 mi_switch() at mi_switch+0x155/frame 0xfffffe010fc33a20 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe010fc33a60 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010fc33aa0 _sleep() at _sleep+0x29b/frame 0xfffffe010fc33b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe010fc33bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe010fc33bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010fc33bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100147 td 0xfffffe010dc35300 sched_switch() at sched_switch+0x5b3/frame 0xfffffe010f92ba00 mi_switch() at mi_switch+0x155/frame 0xfffffe010f92ba20 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe010f92ba60 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010f92baa0 _sleep() at _sleep+0x29b/frame 0xfffffe010f92bb50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe010f92bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe010f92bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010f92bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100148 td 0xfffffe010dc34c00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe0110142a00 mi_switch() at mi_switch+0x155/frame 0xfffffe0110142a20 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe0110142a60 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0110142aa0 _sleep() at _sleep+0x29b/frame 0xfffffe0110142b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe0110142bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0110142bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0110142bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100149 td 0xfffffe010dc34500 sched_switch() at sched_switch+0x5b3/frame 0xfffffe011013da00 mi_switch() at mi_switch+0x155/frame 0xfffffe011013da20 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe011013da60 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe011013daa0 _sleep() at _sleep+0x29b/frame 0xfffffe011013db50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe011013dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe011013dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe011013dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100150 td 0xfffffe010dc33e00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe0110752a00 mi_switch() at mi_switch+0x155/frame 0xfffffe0110752a20 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe0110752a60 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0110752aa0 _sleep() at _sleep+0x29b/frame 0xfffffe0110752b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe0110752bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0110752bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0110752bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100165 td 0xfffffe0141017800 sched_switch() at sched_switch+0x5b3/frame 0xfffffe0140eafa30 mi_switch() at mi_switch+0x155/frame 0xfffffe0140eafa50 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe0140eafa90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0140eafad0 _sleep() at _sleep+0x29b/frame 0xfffffe0140eafb80 softdep_flush() at softdep_flush+0x16b/frame 0xfffffe0140eafbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0140eafbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0140eafbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100170 td 0xfffffe0127533c00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe01273f4a30 mi_switch() at mi_switch+0x155/frame 0xfffffe01273f4a50 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe01273f4a90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe01273f4ad0 _sleep() at _sleep+0x29b/frame 0xfffffe01273f4b80 softdep_flush() at softdep_flush+0x16b/frame 0xfffffe01273f4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe01273f4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01273f4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vnlru pid 33 tid 100153 td 0xfffffe010dd07800 sched_switch() at sched_switch+0x5b3/frame 0xfffffe00e4eed9c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4eed9e0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00e4eeda20 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e4eeda60 _sleep() at _sleep+0x29b/frame 0xfffffe00e4eedb10 vnlru_proc() at vnlru_proc+0xaac/frame 0xfffffe00e4eedbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4eedbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4eedbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command syncer pid 34 tid 100154 td 0xfffffe0127535100 sched_switch() at sched_switch+0x5b3/frame 0xfffffe01273d1a10 mi_switch() at mi_switch+0x155/frame 0xfffffe01273d1a30 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe01273d1a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe01273d1ab0 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x18e/frame 0xfffffe01273d1b20 sched_sync() at sched_sync+0x67c/frame 0xfffffe01273d1bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe01273d1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01273d1bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sshd pid 82488 tid 100248 td 0xfffffe0143913100 sched_switch() at sched_switch+0x5b3/frame 0xfffffe0143e8b7b0 mi_switch() at mi_switch+0x155/frame 0xfffffe0143e8b7d0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe0143e8b810 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0143e8b860 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0143e8b870 _cv_wait_sig() at _cv_wait_sig+0x16b/frame 0xfffffe0143e8b8e0 seltdwait() at seltdwait+0x88/frame 0xfffffe0143e8b920 kern_poll() at kern_poll+0x467/frame 0xfffffe0143e8baa0 sys_poll() at sys_poll+0x50/frame 0xfffffe0143e8bac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0143e8bbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0143e8bbf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x80087352a, rsp = 0x7fffffffe548, rbp = 0x7fffffffe580 --- Tracing command sshd pid 82491 tid 100193 td 0xfffffe01420b5a00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe0140f5f730 mi_switch() at mi_switch+0x155/frame 0xfffffe0140f5f750 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe0140f5f790 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0140f5f7e0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0140f5f7f0 _cv_wait_sig() at _cv_wait_sig+0x16b/frame 0xfffffe0140f5f860 seltdwait() at seltdwait+0x88/frame 0xfffffe0140f5f8a0 kern_select() at kern_select+0x8c2/frame 0xfffffe0140f5fa80 sys_select() at sys_select+0x56/frame 0xfffffe0140f5fac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0140f5fbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0140f5fbf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80087362a, rsp = 0x7fffffffa4e8, rbp = 0x7fffffffa520 --- Tracing command bash pid 82492 tid 100308 td 0xfffffe01433f4500 sched_switch() at sched_switch+0x5b3/frame 0xfffffe0140f9a6f0 mi_switch() at mi_switch+0x155/frame 0xfffffe0140f9a710 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe0140f9a750 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0140f9a7a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0140f9a7b0 _cv_wait_sig() at _cv_wait_sig+0x16b/frame 0xfffffe0140f9a820 seltdwait() at seltdwait+0x88/frame 0xfffffe0140f9a860 kern_select() at kern_select+0x8c2/frame 0xfffffe0140f9aa40 sys_pselect() at sys_pselect+0x127/frame 0xfffffe0140f9aac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0140f9abf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0140f9abf0 --- syscall (522, FreeBSD ELF64, sys_pselect), rip = 0x80051156a, rsp = 0x7fffffffd6c8, rbp = 0x7fffffffd790 --- Tracing command sleep pid 74694 tid 102732 td 0xfffffe01c419b500 sched_switch() at sched_switch+0x5b3/frame 0xfffffe01d304a860 mi_switch() at mi_switch+0x155/frame 0xfffffe01d304a880 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe01d304a8c0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01d304a910 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe01d304a950 _sleep() at _sleep+0x289/frame 0xfffffe01d304aa00 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e1/frame 0xfffffe01d304aa80 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe01d304aac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01d304abf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01d304abf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003864ca, rsp = 0x7fffffffe5d8, rbp = 0x7fffffffe620 --- Tracing command sh pid 74956 tid 101696 td 0xfffffe0144912000 sched_switch() at sched_switch+0x5b3/frame 0xfffffe014b2e06c0 mi_switch() at mi_switch+0x155/frame 0xfffffe014b2e06e0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe014b2e0720 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014b2e0770 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe014b2e0780 _sleep() at _sleep+0x2aa/frame 0xfffffe014b2e0830 kern_wait6() at kern_wait6+0x482/frame 0xfffffe014b2e08c0 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe014b2e0ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014b2e0bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014b2e0bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003e678a, rsp = 0x7fffffffa2d8, rbp = 0x7fffffffa380 --- Tracing command sh pid 74957 tid 100247 td 0xfffffe0143905800 sched_switch() at sched_switch+0x5b3/frame 0xfffffe0143e548c0 mi_switch() at mi_switch+0x155/frame 0xfffffe0143e548e0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe0143e54920 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0143e54970 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0143e54980 _sleep() at _sleep+0x2aa/frame 0xfffffe0143e54a30 kern_sigsuspend() at kern_sigsuspend+0xec/frame 0xfffffe0143e54a90 sys_sigsuspend() at sys_sigsuspend+0x31/frame 0xfffffe0143e54ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0143e54bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0143e54bf0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x8003e66ea, rsp = 0x7fffffffe298, rbp = 0x7fffffffe340 --- Tracing command tee pid 74958 tid 101717 td 0xfffffe014493ea00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe014b353830 mi_switch() at mi_switch+0x155/frame 0xfffffe014b353850 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe014b353890 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014b3538e0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe014b3538f0 _sleep() at _sleep+0x2aa/frame 0xfffffe014b3539a0 pipe_read() at pipe_read+0x4c6/frame 0xfffffe014b353a00 dofileread() at dofileread+0x81/frame 0xfffffe014b353a50 sys_read() at sys_read+0xbc/frame 0xfffffe014b353ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014b353bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014b353bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8003865aa, rsp = 0x7fffffffe5d8, rbp = 0x7fffffffe630 --- Tracing command sh pid 75026 tid 102737 td 0xfffffe01c41b5100 sched_switch() at sched_switch+0x5b3/frame 0xfffffe01d306d6c0 mi_switch() at mi_switch+0x155/frame 0xfffffe01d306d6e0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe01d306d720 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01d306d770 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01d306d780 _sleep() at _sleep+0x2aa/frame 0xfffffe01d306d830 kern_wait6() at kern_wait6+0x482/frame 0xfffffe01d306d8c0 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe01d306dac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01d306dbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01d306dbf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003e678a, rsp = 0x7fffffffe0b8, rbp = 0x7fffffffe160 --- Tracing command sh pid 75027 tid 101640 td 0xfffffe01448d8e00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe01441c46c0 mi_switch() at mi_switch+0x155/frame 0xfffffe01441c46e0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe01441c4720 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01441c4770 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01441c4780 _sleep() at _sleep+0x2aa/frame 0xfffffe01441c4830 kern_wait6() at kern_wait6+0x482/frame 0xfffffe01441c48c0 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe01441c4ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01441c4bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01441c4bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003e678a, rsp = 0x7fffffffe1c8, rbp = 0x7fffffffe270 --- Tracing command sh pid 75028 tid 100325 td 0xfffffe01439b8300 sched_switch() at sched_switch+0x5b3/frame 0xfffffe0143fdf6c0 mi_switch() at mi_switch+0x155/frame 0xfffffe0143fdf6e0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe0143fdf720 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0143fdf770 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0143fdf780 _sleep() at _sleep+0x2aa/frame 0xfffffe0143fdf830 kern_wait6() at kern_wait6+0x482/frame 0xfffffe0143fdf8c0 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0143fdfac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0143fdfbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0143fdfbf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003e678a, rsp = 0x7fffffffe258, rbp = 0x7fffffffe300 --- Tracing command sh pid 75029 tid 100244 td 0xfffffe0142f15000 sched_switch() at sched_switch+0x5b3/frame 0xfffffe0143e4a6c0 mi_switch() at mi_switch+0x155/frame 0xfffffe0143e4a6e0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe0143e4a720 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0143e4a770 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0143e4a780 _sleep() at _sleep+0x2aa/frame 0xfffffe0143e4a830 kern_wait6() at kern_wait6+0x482/frame 0xfffffe0143e4a8c0 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0143e4aac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0143e4abf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0143e4abf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003e678a, rsp = 0x7fffffffe1c8, rbp = 0x7fffffffe270 --- Tracing command sh pid 75030 tid 102734 td 0xfffffe01c419a700 sched_switch() at sched_switch+0x5b3/frame 0xfffffe01d3054830 mi_switch() at mi_switch+0x155/frame 0xfffffe01d3054850 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe01d3054890 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01d30548e0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01d30548f0 _sleep() at _sleep+0x2aa/frame 0xfffffe01d30549a0 pipe_read() at pipe_read+0x4c6/frame 0xfffffe01d3054a00 dofileread() at dofileread+0x81/frame 0xfffffe01d3054a50 sys_read() at sys_read+0xbc/frame 0xfffffe01d3054ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01d3054bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01d3054bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8003e65aa, rsp = 0x7fffffffdf78, rbp = 0x7fffffffe0c0 --- Tracing command sh pid 75031 tid 101630 td 0xfffffe0144995500 sched_switch() at sched_switch+0x5b3/frame 0xfffffe01441926c0 mi_switch() at mi_switch+0x155/frame 0xfffffe01441926e0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe0144192720 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0144192770 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0144192780 _sleep() at _sleep+0x2aa/frame 0xfffffe0144192830 kern_wait6() at kern_wait6+0x482/frame 0xfffffe01441928c0 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0144192ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0144192bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0144192bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003e678a, rsp = 0x7fffffffe1c8, rbp = 0x7fffffffe270 --- Tracing command sh pid 75032 tid 101679 td 0xfffffe0144901800 sched_switch() at sched_switch+0x5b3/frame 0xfffffe014b295830 mi_switch() at mi_switch+0x155/frame 0xfffffe014b295850 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe014b295890 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014b2958e0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe014b2958f0 _sleep() at _sleep+0x2aa/frame 0xfffffe014b2959a0 pipe_read() at pipe_read+0x4c6/frame 0xfffffe014b295a00 dofileread() at dofileread+0x81/frame 0xfffffe014b295a50 sys_read() at sys_read+0xbc/frame 0xfffffe014b295ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014b295bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014b295bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8003e65aa, rsp = 0x7fffffffdf78, rbp = 0x7fffffffe0c0 --- Tracing command sh pid 75035 tid 101609 td 0xfffffe0143dc7700 sched_switch() at sched_switch+0x5b3/frame 0xfffffe0143e406c0 mi_switch() at mi_switch+0x155/frame 0xfffffe0143e406e0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe0143e40720 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0143e40770 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0143e40780 _sleep() at _sleep+0x2aa/frame 0xfffffe0143e40830 kern_wait6() at kern_wait6+0x482/frame 0xfffffe0143e408c0 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0143e40ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0143e40bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0143e40bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003e678a, rsp = 0x7fffffffe1c8, rbp = 0x7fffffffe270 --- Tracing command sh pid 75038 tid 101763 td 0xfffffe01448b6300 sched_switch() at sched_switch+0x5b3/frame 0xfffffe014b4396c0 mi_switch() at mi_switch+0x155/frame 0xfffffe014b4396e0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe014b439720 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014b439770 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe014b439780 _sleep() at _sleep+0x2aa/frame 0xfffffe014b439830 kern_wait6() at kern_wait6+0x482/frame 0xfffffe014b4398c0 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe014b439ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014b439bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014b439bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003e678a, rsp = 0x7fffffffe0b8, rbp = 0x7fffffffe160 --- Tracing command sh pid 75039 tid 101678 td 0xfffffe01448fe000 sched_switch() at sched_switch+0x5b3/frame 0xfffffe014b2866c0 mi_switch() at mi_switch+0x155/frame 0xfffffe014b2866e0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe014b286720 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014b286770 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe014b286780 _sleep() at _sleep+0x2aa/frame 0xfffffe014b286830 kern_wait6() at kern_wait6+0x482/frame 0xfffffe014b2868c0 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe014b286ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014b286bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014b286bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003e678a, rsp = 0x7fffffffe1c8, rbp = 0x7fffffffe270 --- Tracing command sh pid 75042 tid 101709 td 0xfffffe0144932300 sched_switch() at sched_switch+0x5b3/frame 0xfffffe014b32b830 mi_switch() at mi_switch+0x155/frame 0xfffffe014b32b850 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe014b32b890 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014b32b8e0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe014b32b8f0 _sleep() at _sleep+0x2aa/frame 0xfffffe014b32b9a0 pipe_read() at pipe_read+0x4c6/frame 0xfffffe014b32ba00 dofileread() at dofileread+0x81/frame 0xfffffe014b32ba50 sys_read() at sys_read+0xbc/frame 0xfffffe014b32bac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014b32bbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014b32bbf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8003e65aa, rsp = 0x7fffffffdf78, rbp = 0x7fffffffe0c0 --- Tracing command sh pid 75044 tid 101651 td 0xfffffe01448e0000 sched_switch() at sched_switch+0x5b3/frame 0xfffffe014b2096c0 mi_switch() at mi_switch+0x155/frame 0xfffffe014b2096e0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe014b209720 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014b209770 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe014b209780 _sleep() at _sleep+0x2aa/frame 0xfffffe014b209830 kern_wait6() at kern_wait6+0x482/frame 0xfffffe014b2098c0 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe014b209ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014b209bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014b209bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003e678a, rsp = 0x7fffffffe1c8, rbp = 0x7fffffffe270 --- Tracing command sh pid 75050 tid 100317 td 0xfffffe01439af800 sched_switch() at sched_switch+0x5b3/frame 0xfffffe0143f806c0 mi_switch() at mi_switch+0x155/frame 0xfffffe0143f806e0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe0143f80720 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0143f80770 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0143f80780 _sleep() at _sleep+0x2aa/frame 0xfffffe0143f80830 kern_wait6() at kern_wait6+0x482/frame 0xfffffe0143f808c0 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0143f80ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0143f80bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0143f80bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003e678a, rsp = 0x7fffffffe0b8, rbp = 0x7fffffffe160 --- Tracing command sh pid 75051 tid 101671 td 0xfffffe0144901100 sched_switch() at sched_switch+0x5b3/frame 0xfffffe014b26d6c0 mi_switch() at mi_switch+0x155/frame 0xfffffe014b26d6e0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe014b26d720 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014b26d770 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe014b26d780 _sleep() at _sleep+0x2aa/frame 0xfffffe014b26d830 kern_wait6() at kern_wait6+0x482/frame 0xfffffe014b26d8c0 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe014b26dac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014b26dbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014b26dbf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003e678a, rsp = 0x7fffffffe1c8, rbp = 0x7fffffffe270 --- Tracing command sh pid 75052 tid 102720 td 0xfffffe01c417ea00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe01d300e6c0 mi_switch() at mi_switch+0x155/frame 0xfffffe01d300e6e0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe01d300e720 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01d300e770 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01d300e780 _sleep() at _sleep+0x2aa/frame 0xfffffe01d300e830 kern_wait6() at kern_wait6+0x482/frame 0xfffffe01d300e8c0 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe01d300eac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01d300ebf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01d300ebf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003e678a, rsp = 0x7fffffffe258, rbp = 0x7fffffffe300 --- Tracing command sh pid 75053 tid 102742 td 0xfffffe01c41b2e00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe01d307c6c0 mi_switch() at mi_switch+0x155/frame 0xfffffe01d307c6e0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe01d307c720 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01d307c770 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01d307c780 _sleep() at _sleep+0x2aa/frame 0xfffffe01d307c830 kern_wait6() at kern_wait6+0x482/frame 0xfffffe01d307c8c0 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe01d307cac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01d307cbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01d307cbf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003e678a, rsp = 0x7fffffffe1c8, rbp = 0x7fffffffe270 --- Tracing command sh pid 75057 tid 100184 td 0xfffffe0142ef0800 sched_switch() at sched_switch+0x5b3/frame 0xfffffe0140eec6c0 mi_switch() at mi_switch+0x155/frame 0xfffffe0140eec6e0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe0140eec720 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0140eec770 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0140eec780 _sleep() at _sleep+0x2aa/frame 0xfffffe0140eec830 kern_wait6() at kern_wait6+0x482/frame 0xfffffe0140eec8c0 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0140eecac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0140eecbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0140eecbf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003e678a, rsp = 0x7fffffffe258, rbp = 0x7fffffffe300 --- Tracing command sh pid 75058 tid 102735 td 0xfffffe01c419a000 sched_switch() at sched_switch+0x5b3/frame 0xfffffe01d30636c0 mi_switch() at mi_switch+0x155/frame 0xfffffe01d30636e0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe01d3063720 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01d3063770 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01d3063780 _sleep() at _sleep+0x2aa/frame 0xfffffe01d3063830 kern_wait6() at kern_wait6+0x482/frame 0xfffffe01d30638c0 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe01d3063ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01d3063bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01d3063bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003e678a, rsp = 0x7fffffffe1c8, rbp = 0x7fffffffe270 --- Tracing command sh pid 75065 tid 102724 td 0xfffffe01c417ce00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe01d30226c0 mi_switch() at mi_switch+0x155/frame 0xfffffe01d30226e0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe01d3022720 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01d3022770 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01d3022780 _sleep() at _sleep+0x2aa/frame 0xfffffe01d3022830 kern_wait6() at kern_wait6+0x482/frame 0xfffffe01d30228c0 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe01d3022ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01d3022bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01d3022bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003e678a, rsp = 0x7fffffffe0b8, rbp = 0x7fffffffe160 --- Tracing command sh pid 75067 tid 101656 td 0xfffffe01448ebc00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe014b2186c0 mi_switch() at mi_switch+0x155/frame 0xfffffe014b2186e0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe014b218720 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014b218770 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe014b218780 _sleep() at _sleep+0x2aa/frame 0xfffffe014b218830 kern_wait6() at kern_wait6+0x482/frame 0xfffffe014b2188c0 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe014b218ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014b218bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014b218bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003e678a, rsp = 0x7fffffffe1c8, rbp = 0x7fffffffe270 --- Tracing command sh pid 75071 tid 101697 td 0xfffffe0144915800 sched_switch() at sched_switch+0x5b3/frame 0xfffffe014b2ef6c0 mi_switch() at mi_switch+0x155/frame 0xfffffe014b2ef6e0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe014b2ef720 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014b2ef770 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe014b2ef780 _sleep() at _sleep+0x2aa/frame 0xfffffe014b2ef830 kern_wait6() at kern_wait6+0x482/frame 0xfffffe014b2ef8c0 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe014b2efac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014b2efbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014b2efbf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003e678a, rsp = 0x7fffffffe0b8, rbp = 0x7fffffffe160 --- Tracing command sh pid 75073 tid 101620 td 0xfffffe0143abae00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe014407a870 mi_switch() at mi_switch+0x155/frame 0xfffffe014407a890 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe014407a8d0 _sx_xlock_hard() at _sx_xlock_hard+0x41e/frame 0xfffffe014407a970 _sx_xlock() at _sx_xlock+0xba/frame 0xfffffe014407a9b0 fork1() at fork1+0x856/frame 0xfffffe014407aa60 sys_vfork() at sys_vfork+0x54/frame 0xfffffe014407aac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014407abf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014407abf0 --- syscall (66, FreeBSD ELF64, sys_vfork), rip = 0x8003e33fd, rsp = 0x7fffffffe200, rbp = 0x7fffffffe2b0 --- Tracing command sh pid 75076 tid 100212 td 0xfffffe0142f17300 sched_switch() at sched_switch+0x5b3/frame 0xfffffe0140fdd6c0 mi_switch() at mi_switch+0x155/frame 0xfffffe0140fdd6e0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe0140fdd720 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0140fdd770 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0140fdd780 _sleep() at _sleep+0x2aa/frame 0xfffffe0140fdd830 kern_wait6() at kern_wait6+0x482/frame 0xfffffe0140fdd8c0 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0140fddac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0140fddbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0140fddbf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003e678a, rsp = 0x7fffffffe258, rbp = 0x7fffffffe300 --- Tracing command sh pid 75077 tid 102727 td 0xfffffe01c417f800 sched_switch() at sched_switch+0x5b3/frame 0xfffffe01d303b6c0 mi_switch() at mi_switch+0x155/frame 0xfffffe01d303b6e0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe01d303b720 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01d303b770 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01d303b780 _sleep() at _sleep+0x2aa/frame 0xfffffe01d303b830 kern_wait6() at kern_wait6+0x482/frame 0xfffffe01d303b8c0 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe01d303bac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01d303bbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01d303bbf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003e678a, rsp = 0x7fffffffe1c8, rbp = 0x7fffffffe270 --- Tracing command sh pid 75079 tid 102725 td 0xfffffe01c417c700 sched_switch() at sched_switch+0x5b3/frame 0xfffffe01d30316c0 mi_switch() at mi_switch+0x155/frame 0xfffffe01d30316e0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe01d3031720 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01d3031770 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01d3031780 _sleep() at _sleep+0x2aa/frame 0xfffffe01d3031830 kern_wait6() at kern_wait6+0x482/frame 0xfffffe01d30318c0 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe01d3031ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01d3031bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01d3031bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003e678a, rsp = 0x7fffffffe258, rbp = 0x7fffffffe300 --- Tracing command sh pid 75081 tid 100167 td 0xfffffe010d705e00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe0140eb96c0 mi_switch() at mi_switch+0x155/frame 0xfffffe0140eb96e0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe0140eb9720 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0140eb9770 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0140eb9780 _sleep() at _sleep+0x2aa/frame 0xfffffe0140eb9830 kern_wait6() at kern_wait6+0x482/frame 0xfffffe0140eb98c0 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0140eb9ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0140eb9bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0140eb9bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003e678a, rsp = 0x7fffffffe1c8, rbp = 0x7fffffffe270 --- Tracing command sh pid 75082 tid 101614 td 0xfffffe01420b3700 sched_switch() at sched_switch+0x5b3/frame 0xfffffe0143fbc960 mi_switch() at mi_switch+0x155/frame 0xfffffe0143fbc980 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe0143fbc9c0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0143fbca00 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x18e/frame 0xfffffe0143fbca70 fork_rfppwait() at fork_rfppwait+0xc8/frame 0xfffffe0143fbcac0 amd64_syscall() at amd64_syscall+0x6f0/frame 0xfffffe0143fbcbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0143fbcbf0 --- syscall (79115), rip = 0x8003e33fd, rsp = 0x7fffffffe0f0, rbp = 0x7fffffffe1a0 --- Tracing command sh pid 75083 tid 100326 td 0xfffffe0141014000 sched_switch() at sched_switch+0x5b3/frame 0xfffffe0143fe96c0 mi_switch() at mi_switch+0x155/frame 0xfffffe0143fe96e0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe0143fe9720 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0143fe9770 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0143fe9780 _sleep() at _sleep+0x2aa/frame 0xfffffe0143fe9830 kern_wait6() at kern_wait6+0x482/frame 0xfffffe0143fe98c0 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0143fe9ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0143fe9bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0143fe9bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003e678a, rsp = 0x7fffffffe1c8, rbp = 0x7fffffffe270 --- Tracing command sh pid 75087 tid 100176 td 0xfffffe0142d43800 sched_switch() at sched_switch+0x5b3/frame 0xfffffe01273ea960 mi_switch() at mi_switch+0x155/frame 0xfffffe01273ea980 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe01273ea9c0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe01273eaa00 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x18e/frame 0xfffffe01273eaa70 fork_rfppwait() at fork_rfppwait+0xc8/frame 0xfffffe01273eaac0 amd64_syscall() at amd64_syscall+0x6f0/frame 0xfffffe01273eabf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01273eabf0 --- syscall (79117), rip = 0x8003e33fd, rsp = 0x7fffffffe0f0, rbp = 0x7fffffffe1a0 --- Tracing command sh pid 75091 tid 101747 td 0xfffffe014489b500 sched_switch() at sched_switch+0x5b3/frame 0xfffffe014b3e96c0 mi_switch() at mi_switch+0x155/frame 0xfffffe014b3e96e0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe014b3e9720 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014b3e9770 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe014b3e9780 _sleep() at _sleep+0x2aa/frame 0xfffffe014b3e9830 kern_wait6() at kern_wait6+0x482/frame 0xfffffe014b3e98c0 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe014b3e9ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014b3e9bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014b3e9bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003e678a, rsp = 0x7fffffffe1c8, rbp = 0x7fffffffe270 --- Tracing command dhclient pid 2108 tid 100204 td 0xfffffe00e4dab700 sched_switch() at sched_switch+0x5b3/frame 0xfffffe0140f3c730 mi_switch() at mi_switch+0x155/frame 0xfffffe0140f3c750 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe0140f3c790 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0140f3c7e0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0140f3c7f0 _cv_wait_sig() at _cv_wait_sig+0x16b/frame 0xfffffe0140f3c860 seltdwait() at seltdwait+0x88/frame 0xfffffe0140f3c8a0 kern_select() at kern_select+0x8c2/frame 0xfffffe0140f3ca80 sys_select() at sys_select+0x56/frame 0xfffffe0140f3cac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0140f3cbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0140f3cbf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8003c062a, rsp = 0x7fffffffe958, rbp = 0x7fffffffea10 --- Tracing command dhclient pid 2111 tid 100186 td 0xfffffe0142f18100 sched_switch() at sched_switch+0x5b3/frame 0xfffffe0140f2d7b0 mi_switch() at mi_switch+0x155/frame 0xfffffe0140f2d7d0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe0140f2d810 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0140f2d860 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0140f2d870 _cv_wait_sig() at _cv_wait_sig+0x16b/frame 0xfffffe0140f2d8e0 seltdwait() at seltdwait+0x88/frame 0xfffffe0140f2d920 kern_poll() at kern_poll+0x467/frame 0xfffffe0140f2daa0 sys_poll() at sys_poll+0x50/frame 0xfffffe0140f2dac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0140f2dbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0140f2dbf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003c052a, rsp = 0x7fffffffeba8, rbp = 0x7fffffffebd0 --- Tracing command dhclient pid 2170 tid 100161 td 0xfffffe0127534300 sched_switch() at sched_switch+0x5b3/frame 0xfffffe01273f9780 mi_switch() at mi_switch+0x155/frame 0xfffffe01273f97a0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe01273f97e0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01273f9830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe01273f9870 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x18e/frame 0xfffffe01273f98e0 seltdwait() at seltdwait+0x79/frame 0xfffffe01273f9920 kern_poll() at kern_poll+0x467/frame 0xfffffe01273f9aa0 sys_poll() at sys_poll+0x50/frame 0xfffffe01273f9ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01273f9bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01273f9bf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003c052a, rsp = 0x7fffffffeb98, rbp = 0x7fffffffebd0 --- Tracing command devd pid 2175 tid 100164 td 0xfffffe010dc33000 (CPU 3) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003cf06e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003cf06e10 trap() at trap+0x56/frame 0xfffffe003cf06f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003cf06f20 --- trap 0x13, rip = 0xffffffff80cadf39, rsp = 0xfffffe0140ea59a0, rbp = 0xfffffe0140ea5a20 --- kern_sendit() at kern_sendit+0x329/frame 0xfffffe0140ea5a20 sendit() at sendit+0x1db/frame 0xfffffe0140ea5a70 sys_sendto() at sys_sendto+0x4d/frame 0xfffffe0140ea5ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0140ea5bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0140ea5bf0 --- syscall (133, FreeBSD ELF64, sys_sendto), rip = 0x28c70a, rsp = 0x7fffffffbb78, rbp = 0x7fffffffc9d0 --- Tracing command syslogd pid 2354 tid 100159 td 0xfffffe0127535800 sched_switch() at sched_switch+0x5b3/frame 0xfffffe01273ef730 mi_switch() at mi_switch+0x155/frame 0xfffffe01273ef750 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe01273ef790 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01273ef7e0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01273ef7f0 _cv_wait_sig() at _cv_wait_sig+0x16b/frame 0xfffffe01273ef860 seltdwait() at seltdwait+0x88/frame 0xfffffe01273ef8a0 kern_select() at kern_select+0x8c2/frame 0xfffffe01273efa80 sys_select() at sys_select+0x56/frame 0xfffffe01273efac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01273efbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01273efbf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8003a962a, rsp = 0x7fffffffe6b8, rbp = 0x7fffffffec30 --- Tracing command watchdogd pid 2369 tid 100172 td 0xfffffe010dd05c00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe0140ee7860 mi_switch() at mi_switch+0x155/frame 0xfffffe0140ee7880 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe0140ee78c0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0140ee7910 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe0140ee7950 _sleep() at _sleep+0x289/frame 0xfffffe0140ee7a00 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e1/frame 0xfffffe0140ee7a80 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe0140ee7ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0140ee7bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0140ee7bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003a04ca, rsp = 0x7fffffffea08, rbp = 0x7fffffffea50 --- Tracing command rpcbind pid 2386 tid 100181 td 0xfffffe0142d42a00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe0140f23780 mi_switch() at mi_switch+0x155/frame 0xfffffe0140f237a0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe0140f237e0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0140f23830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe0140f23870 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x18e/frame 0xfffffe0140f238e0 seltdwait() at seltdwait+0x79/frame 0xfffffe0140f23920 kern_poll() at kern_poll+0x467/frame 0xfffffe0140f23aa0 sys_poll() at sys_poll+0x50/frame 0xfffffe0140f23ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0140f23bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0140f23bf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x80039b52a, rsp = 0x7fffffffc9a8, rbp = 0x7fffffffebc0 --- Tracing command rpc.statd pid 2408 tid 100217 td 0xfffffe0142f16c00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe0140fd8700 mi_switch() at mi_switch+0x155/frame 0xfffffe0140fd8720 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe0140fd8760 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0140fd87b0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe0140fd87f0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x18e/frame 0xfffffe0140fd8860 seltdwait() at seltdwait+0x79/frame 0xfffffe0140fd88a0 kern_select() at kern_select+0x8c2/frame 0xfffffe0140fd8a80 sys_select() at sys_select+0x56/frame 0xfffffe0140fd8ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0140fd8bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0140fd8bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80039562a, rsp = 0x7fffffffea18, rbp = 0x7fffffffeb60 --- Tracing command rpc.lockd pid 2411 tid 100216 td 0xfffffe01420b4500 sched_switch() at sched_switch+0x5b3/frame 0xfffffe0140fec650 mi_switch() at mi_switch+0x155/frame 0xfffffe0140fec670 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe0140fec6b0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0140fec700 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe0140fec740 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x18e/frame 0xfffffe0140fec7b0 svc_run_internal() at svc_run_internal+0xac1/frame 0xfffffe0140fec8e0 svc_run() at svc_run+0x253/frame 0xfffffe0140fec940 sys_nlm_syscall() at sys_nlm_syscall+0x74d/frame 0xfffffe0140fecac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0140fecbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0140fecbf0 --- syscall (154, FreeBSD ELF64, sys_nlm_syscall), rip = 0x80039de0a, rsp = 0x7fffffffeb78, rbp = 0x7fffffffec30 --- Tracing command ntpd pid 2450 tid 100171 td 0xfffffe010dd06300 sched_switch() at sched_switch+0x5b3/frame 0xfffffe01273fe730 mi_switch() at mi_switch+0x155/frame 0xfffffe01273fe750 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe01273fe790 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01273fe7e0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01273fe7f0 _cv_wait_sig() at _cv_wait_sig+0x16b/frame 0xfffffe01273fe860 seltdwait() at seltdwait+0x88/frame 0xfffffe01273fe8a0 kern_select() at kern_select+0x8c2/frame 0xfffffe01273fea80 sys_select() at sys_select+0x56/frame 0xfffffe01273feac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01273febf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01273febf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8007a362a, rsp = 0x7fffffffde68, rbp = 0x7fffffffdea0 --- Tracing command powerd pid 2453 tid 100191 td 0xfffffe0142eef300 sched_switch() at sched_switch+0x5b3/frame 0xfffffe0140f4b700 mi_switch() at mi_switch+0x155/frame 0xfffffe0140f4b720 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe0140f4b760 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0140f4b7b0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe0140f4b7f0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x18e/frame 0xfffffe0140f4b860 seltdwait() at seltdwait+0x79/frame 0xfffffe0140f4b8a0 kern_select() at kern_select+0x8c2/frame 0xfffffe0140f4ba80 sys_select() at sys_select+0x56/frame 0xfffffe0140f4bac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0140f4bbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0140f4bbf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8003a062a, rsp = 0x7fffffffeaf8, rbp = 0x7fffffffec40 --- Tracing command sshd pid 2482 tid 100213 td 0xfffffe014379e100 sched_switch() at sched_switch+0x5b3/frame 0xfffffe0140fe7730 mi_switch() at mi_switch+0x155/frame 0xfffffe0140fe7750 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe0140fe7790 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0140fe77e0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0140fe77f0 _cv_wait_sig() at _cv_wait_sig+0x16b/frame 0xfffffe0140fe7860 seltdwait() at seltdwait+0x88/frame 0xfffffe0140fe78a0 kern_select() at kern_select+0x8c2/frame 0xfffffe0140fe7a80 sys_select() at sys_select+0x56/frame 0xfffffe0140fe7ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0140fe7bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0140fe7bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80087362a, rsp = 0x7fffffffe5d8, rbp = 0x7fffffffe610 --- Tracing command cron pid 2491 tid 100194 td 0xfffffe0127532e00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe0140f32860 mi_switch() at mi_switch+0x155/frame 0xfffffe0140f32880 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe0140f328c0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0140f32910 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe0140f32950 _sleep() at _sleep+0x289/frame 0xfffffe0140f32a00 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e1/frame 0xfffffe0140f32a80 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe0140f32ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0140f32bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0140f32bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003b74ca, rsp = 0x7fffffffea58, rbp = 0x7fffffffec30 --- Tracing command inetd pid 2494 tid 100215 td 0xfffffe01420b4c00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe0140ff1730 mi_switch() at mi_switch+0x155/frame 0xfffffe0140ff1750 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe0140ff1790 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0140ff17e0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0140ff17f0 _cv_wait_sig() at _cv_wait_sig+0x16b/frame 0xfffffe0140ff1860 seltdwait() at seltdwait+0x88/frame 0xfffffe0140ff18a0 kern_select() at kern_select+0x8c2/frame 0xfffffe0140ff1a80 sys_select() at sys_select+0x56/frame 0xfffffe0140ff1ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0140ff1bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0140ff1bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8003be62a, rsp = 0x7fffffffdd88, rbp = 0x7fffffffec20 --- Tracing command getty pid 2505 tid 100155 td 0xfffffe010a76d000 sched_switch() at sched_switch+0x5b3/frame 0xfffffe01273db7b0 mi_switch() at mi_switch+0x155/frame 0xfffffe01273db7d0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe01273db810 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01273db860 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01273db870 _cv_wait_sig() at _cv_wait_sig+0x16b/frame 0xfffffe01273db8e0 tty_wait() at tty_wait+0x42/frame 0xfffffe01273db910 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe01273db970 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe01273db9a0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe01273dba00 dofileread() at dofileread+0x81/frame 0xfffffe01273dba50 sys_read() at sys_read+0xbc/frame 0xfffffe01273dbac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01273dbbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01273dbbf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8003a35aa, rsp = 0x7fffffffeb68, rbp = 0x7fffffffebb0 --- Tracing command getty pid 2506 tid 100160 td 0xfffffe0127534a00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe01273cc7b0 mi_switch() at mi_switch+0x155/frame 0xfffffe01273cc7d0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe01273cc810 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01273cc860 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01273cc870 _cv_wait_sig() at _cv_wait_sig+0x16b/frame 0xfffffe01273cc8e0 tty_wait() at tty_wait+0x42/frame 0xfffffe01273cc910 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe01273cc970 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe01273cc9a0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe01273cca00 dofileread() at dofileread+0x81/frame 0xfffffe01273cca50 sys_read() at sys_read+0xbc/frame 0xfffffe01273ccac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01273ccbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01273ccbf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8003a35aa, rsp = 0x7fffffffeb68, rbp = 0x7fffffffebb0 --- Tracing command getty pid 2507 tid 100162 td 0xfffffe010dd06a00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe0140e9b7b0 mi_switch() at mi_switch+0x155/frame 0xfffffe0140e9b7d0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe0140e9b810 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0140e9b860 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0140e9b870 _cv_wait_sig() at _cv_wait_sig+0x16b/frame 0xfffffe0140e9b8e0 tty_wait() at tty_wait+0x42/frame 0xfffffe0140e9b910 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe0140e9b970 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe0140e9b9a0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe0140e9ba00 dofileread() at dofileread+0x81/frame 0xfffffe0140e9ba50 sys_read() at sys_read+0xbc/frame 0xfffffe0140e9bac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0140e9bbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0140e9bbf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8003a35aa, rsp = 0x7fffffffeb68, rbp = 0x7fffffffebb0 --- Tracing command getty pid 2508 tid 100223 td 0xfffffe003cef4e00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe0143e097b0 mi_switch() at mi_switch+0x155/frame 0xfffffe0143e097d0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe0143e09810 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0143e09860 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0143e09870 _cv_wait_sig() at _cv_wait_sig+0x16b/frame 0xfffffe0143e098e0 tty_wait() at tty_wait+0x42/frame 0xfffffe0143e09910 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe0143e09970 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe0143e099a0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe0143e09a00 dofileread() at dofileread+0x81/frame 0xfffffe0143e09a50 sys_read() at sys_read+0xbc/frame 0xfffffe0143e09ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0143e09bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0143e09bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8003a35aa, rsp = 0x7fffffffeb68, rbp = 0x7fffffffebb0 --- Tracing command getty pid 2509 tid 100224 td 0xfffffe003cef4700 sched_switch() at sched_switch+0x5b3/frame 0xfffffe0143e047b0 mi_switch() at mi_switch+0x155/frame 0xfffffe0143e047d0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe0143e04810 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0143e04860 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0143e04870 _cv_wait_sig() at _cv_wait_sig+0x16b/frame 0xfffffe0143e048e0 tty_wait() at tty_wait+0x42/frame 0xfffffe0143e04910 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe0143e04970 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe0143e049a0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe0143e04a00 dofileread() at dofileread+0x81/frame 0xfffffe0143e04a50 sys_read() at sys_read+0xbc/frame 0xfffffe0143e04ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0143e04bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0143e04bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8003a35aa, rsp = 0x7fffffffeb68, rbp = 0x7fffffffebb0 --- Tracing command getty pid 2510 tid 100225 td 0xfffffe003cef4000 sched_switch() at sched_switch+0x5b3/frame 0xfffffe0143e137b0 mi_switch() at mi_switch+0x155/frame 0xfffffe0143e137d0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe0143e13810 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0143e13860 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0143e13870 _cv_wait_sig() at _cv_wait_sig+0x16b/frame 0xfffffe0143e138e0 tty_wait() at tty_wait+0x42/frame 0xfffffe0143e13910 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe0143e13970 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe0143e139a0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe0143e13a00 dofileread() at dofileread+0x81/frame 0xfffffe0143e13a50 sys_read() at sys_read+0xbc/frame 0xfffffe0143e13ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0143e13bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0143e13bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8003a35aa, rsp = 0x7fffffffeb68, rbp = 0x7fffffffebb0 --- Tracing command getty pid 2511 tid 100226 td 0xfffffe014382d100 sched_switch() at sched_switch+0x5b3/frame 0xfffffe0143e0e7b0 mi_switch() at mi_switch+0x155/frame 0xfffffe0143e0e7d0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe0143e0e810 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0143e0e860 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0143e0e870 _cv_wait_sig() at _cv_wait_sig+0x16b/frame 0xfffffe0143e0e8e0 tty_wait() at tty_wait+0x42/frame 0xfffffe0143e0e910 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe0143e0e970 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe0143e0e9a0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe0143e0ea00 dofileread() at dofileread+0x81/frame 0xfffffe0143e0ea50 sys_read() at sys_read+0xbc/frame 0xfffffe0143e0eac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0143e0ebf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0143e0ebf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8003a35aa, rsp = 0x7fffffffeb68, rbp = 0x7fffffffebb0 --- Tracing command getty pid 2512 tid 100227 td 0xfffffe014382ca00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe0143e1d7b0 mi_switch() at mi_switch+0x155/frame 0xfffffe0143e1d7d0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe0143e1d810 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0143e1d860 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0143e1d870 _cv_wait_sig() at _cv_wait_sig+0x16b/frame 0xfffffe0143e1d8e0 tty_wait() at tty_wait+0x42/frame 0xfffffe0143e1d910 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe0143e1d970 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe0143e1d9a0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe0143e1da00 dofileread() at dofileread+0x81/frame 0xfffffe0143e1da50 sys_read() at sys_read+0xbc/frame 0xfffffe0143e1dac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0143e1dbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0143e1dbf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8003a35aa, rsp = 0x7fffffffeb68, rbp = 0x7fffffffebb0 --- Tracing command getty pid 2513 tid 100228 td 0xfffffe014382c300 sched_switch() at sched_switch+0x5b3/frame 0xfffffe0143e187b0 mi_switch() at mi_switch+0x155/frame 0xfffffe0143e187d0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe0143e18810 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0143e18860 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0143e18870 _cv_wait_sig() at _cv_wait_sig+0x16b/frame 0xfffffe0143e188e0 tty_wait() at tty_wait+0x42/frame 0xfffffe0143e18910 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe0143e18970 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe0143e189a0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe0143e18a00 dofileread() at dofileread+0x81/frame 0xfffffe0143e18a50 sys_read() at sys_read+0xbc/frame 0xfffffe0143e18ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0143e18bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0143e18bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8003a35aa, rsp = 0x7fffffffeb68, rbp = 0x7fffffffebb0 --- Tracing command login pid 2514 tid 100229 td 0xfffffe014382bc00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe0143e276c0 mi_switch() at mi_switch+0x155/frame 0xfffffe0143e276e0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe0143e27720 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0143e27770 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0143e27780 _sleep() at _sleep+0x2aa/frame 0xfffffe0143e27830 kern_wait6() at kern_wait6+0x482/frame 0xfffffe0143e278c0 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0143e27ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0143e27bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0143e27bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003d078a, rsp = 0x7fffffffeae8, rbp = 0x7fffffffeca0 --- Tracing command csh pid 2515 tid 100230 td 0xfffffe0142eeec00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe0140f467b0 mi_switch() at mi_switch+0x155/frame 0xfffffe0140f467d0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe0140f46810 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0140f46860 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0140f46870 _cv_wait_sig() at _cv_wait_sig+0x16b/frame 0xfffffe0140f468e0 tty_wait() at tty_wait+0x42/frame 0xfffffe0140f46910 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe0140f46970 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe0140f469a0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe0140f46a00 dofileread() at dofileread+0x81/frame 0xfffffe0140f46a50 sys_read() at sys_read+0xbc/frame 0xfffffe0140f46ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0140f46bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0140f46bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80047d5aa, rsp = 0x7fffffffe178, rbp = 0x7fffffffe1a0 --- Tracing command sshd pid 2518 tid 100189 td 0xfffffe00e4dabe00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe0140f417b0 mi_switch() at mi_switch+0x155/frame 0xfffffe0140f417d0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe0140f41810 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0140f41860 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0140f41870 _cv_wait_sig() at _cv_wait_sig+0x16b/frame 0xfffffe0140f418e0 seltdwait() at seltdwait+0x88/frame 0xfffffe0140f41920 kern_poll() at kern_poll+0x467/frame 0xfffffe0140f41aa0 sys_poll() at sys_poll+0x50/frame 0xfffffe0140f41ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0140f41bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0140f41bf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x80087352a, rsp = 0x7fffffffe548, rbp = 0x7fffffffe580 --- Tracing command sshd pid 2521 tid 100180 td 0xfffffe010dd04e00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe0140f19730 mi_switch() at mi_switch+0x155/frame 0xfffffe0140f19750 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe0140f19790 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0140f197e0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0140f197f0 _cv_wait_sig() at _cv_wait_sig+0x16b/frame 0xfffffe0140f19860 seltdwait() at seltdwait+0x88/frame 0xfffffe0140f198a0 kern_select() at kern_select+0x8c2/frame 0xfffffe0140f19a80 sys_select() at sys_select+0x56/frame 0xfffffe0140f19ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0140f19bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0140f19bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80087362a, rsp = 0x7fffffffa4e8, rbp = 0x7fffffffa520 --- Tracing command bash pid 2522 tid 100231 td 0xfffffe014382b500 sched_switch() at sched_switch+0x5b3/frame 0xfffffe0143e226c0 mi_switch() at mi_switch+0x155/frame 0xfffffe0143e226e0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe0143e22720 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0143e22770 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0143e22780 _sleep() at _sleep+0x2aa/frame 0xfffffe0143e22830 kern_wait6() at kern_wait6+0x482/frame 0xfffffe0143e228c0 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0143e22ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0143e22bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0143e22bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80051178a, rsp = 0x7fffffffe718, rbp = 0x7fffffffe770 --- Tracing command su pid 2527 tid 100232 td 0xfffffe014382ae00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe0143e316c0 mi_switch() at mi_switch+0x155/frame 0xfffffe0143e316e0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe0143e31720 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0143e31770 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0143e31780 _sleep() at _sleep+0x2aa/frame 0xfffffe0143e31830 kern_wait6() at kern_wait6+0x482/frame 0xfffffe0143e318c0 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0143e31ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0143e31bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0143e31bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003ce78a, rsp = 0x7fffffffe5a8, rbp = 0x7fffffffeae0 --- Tracing command csh pid 2528 tid 100190 td 0xfffffe0141016300 sched_switch() at sched_switch+0x5b3/frame 0xfffffe0140f0a8c0 mi_switch() at mi_switch+0x155/frame 0xfffffe0140f0a8e0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe0140f0a920 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0140f0a970 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0140f0a980 _sleep() at _sleep+0x2aa/frame 0xfffffe0140f0aa30 kern_sigsuspend() at kern_sigsuspend+0xec/frame 0xfffffe0140f0aa90 sys_sigsuspend() at sys_sigsuspend+0x31/frame 0xfffffe0140f0aac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0140f0abf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0140f0abf0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x80047d6ea, rsp = 0x7fffffffdf88, rbp = 0x7fffffffe010 --- Tracing command bash pid 2530 tid 100233 td 0xfffffe0142eee500 sched_switch() at sched_switch+0x5b3/frame 0xfffffe0143e3b6f0 mi_switch() at mi_switch+0x155/frame 0xfffffe0143e3b710 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe0143e3b750 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0143e3b7a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0143e3b7b0 _cv_wait_sig() at _cv_wait_sig+0x16b/frame 0xfffffe0143e3b820 seltdwait() at seltdwait+0x88/frame 0xfffffe0143e3b860 kern_select() at kern_select+0x8c2/frame 0xfffffe0143e3ba40 sys_pselect() at sys_pselect+0x127/frame 0xfffffe0143e3bac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0143e3bbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0143e3bbf0 --- syscall (522, FreeBSD ELF64, sys_pselect), rip = 0x80051156a, rsp = 0x7fffffffd588, rbp = 0x7fffffffd650 --- Tracing command sh pid 2613 tid 100240 td 0xfffffe0142eed700 sched_switch() at sched_switch+0x5b3/frame 0xfffffe0143e636c0 mi_switch() at mi_switch+0x155/frame 0xfffffe0143e636e0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe0143e63720 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0143e63770 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0143e63780 _sleep() at _sleep+0x2aa/frame 0xfffffe0143e63830 kern_wait6() at kern_wait6+0x482/frame 0xfffffe0143e638c0 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0143e63ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0143e63bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0143e63bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003e678a, rsp = 0x7fffffffe408, rbp = 0x7fffffffe4b0 --- Tracing command sh pid 2651 tid 100185 td 0xfffffe0142eefa00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe0140f006c0 mi_switch() at mi_switch+0x155/frame 0xfffffe0140f006e0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe0140f00720 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0140f00770 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0140f00780 _sleep() at _sleep+0x2aa/frame 0xfffffe0140f00830 kern_wait6() at kern_wait6+0x482/frame 0xfffffe0140f008c0 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0140f00ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0140f00bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0140f00bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003e678a, rsp = 0x7fffffffe148, rbp = 0x7fffffffe1f0 --- Tracing command awk pid 2652 tid 100179 td 0xfffffe0141016a00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe0140f0f830 mi_switch() at mi_switch+0x155/frame 0xfffffe0140f0f850 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe0140f0f890 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0140f0f8e0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0140f0f8f0 _sleep() at _sleep+0x2aa/frame 0xfffffe0140f0f9a0 pipe_read() at pipe_read+0x4c6/frame 0xfffffe0140f0fa00 dofileread() at dofileread+0x81/frame 0xfffffe0140f0fa50 sys_read() at sys_read+0xbc/frame 0xfffffe0140f0fac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0140f0fbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0140f0fbf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8003eb5aa, rsp = 0x7fffffffe248, rbp = 0x7fffffffe260 --- Tracing command sh pid 2654 tid 100166 td 0xfffffe01420b6100 sched_switch() at sched_switch+0x5b3/frame 0xfffffe0140eaa830 mi_switch() at mi_switch+0x155/frame 0xfffffe0140eaa850 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe0140eaa890 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0140eaa8e0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0140eaa8f0 _sleep() at _sleep+0x2aa/frame 0xfffffe0140eaa9a0 pipe_read() at pipe_read+0x4c6/frame 0xfffffe0140eaaa00 dofileread() at dofileread+0x81/frame 0xfffffe0140eaaa50 sys_read() at sys_read+0xbc/frame 0xfffffe0140eaaac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0140eaabf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0140eaabf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8003e65aa, rsp = 0x7fffffffdd08, rbp = 0x7fffffffe230 --- Tracing command sh pid 36379 tid 100342 td 0xfffffe01439e3c00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe01440436c0 mi_switch() at mi_switch+0x155/frame 0xfffffe01440436e0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe0144043720 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0144043770 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0144043780 _sleep() at _sleep+0x2aa/frame 0xfffffe0144043830 kern_wait6() at kern_wait6+0x482/frame 0xfffffe01440438c0 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0144043ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0144043bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0144043bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003e678a, rsp = 0x7fffffffa628, rbp = 0x7fffffffa6d0 --- Tracing command ls pid 78326 tid 100188 td 0xfffffe0127533500 (CPU 5) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003cf1ee00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003cf1ee10 trap() at trap+0x56/frame 0xfffffe003cf1ef20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003cf1ef20 --- trap 0x13, rip = 0xffffffff80bda5cc, rsp = 0xfffffe0140f37870, rbp = 0xfffffe0140f378b0 --- __mtx_lock_flags() at __mtx_lock_flags+0x4c/frame 0xfffffe0140f378b0 pfs_iterate() at pfs_iterate+0x10a/frame 0xfffffe0140f378f0 pfs_readdir() at pfs_readdir+0x260/frame 0xfffffe0140f37980 VOP_READDIR_APV() at VOP_READDIR_APV+0x59/frame 0xfffffe0140f379a0 kern_getdirentries() at kern_getdirentries+0x1fb/frame 0xfffffe0140f37a90 sys_getdirentries() at sys_getdirentries+0x29/frame 0xfffffe0140f37ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0140f37bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0140f37bf0 --- syscall (554, FreeBSD ELF64, sys_getdirentries), rip = 0x80041832a, rsp = 0x7fffffffdd48, rbp = 0x7fffffffdd80 --- Tracing command ls pid 78376 tid 102741 td 0xfffffe01c41b3500 sched_switch() at sched_switch+0x5b3/frame 0xfffffe01d30817c0 mi_switch() at mi_switch+0x155/frame 0xfffffe01d30817e0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe01d3081820 _sx_slock_hard() at _sx_slock_hard+0x2af/frame 0xfffffe01d30818b0 _sx_slock_int() at _sx_slock_int+0xdb/frame 0xfffffe01d30818f0 pfs_readdir() at pfs_readdir+0x1c6/frame 0xfffffe01d3081980 VOP_READDIR_APV() at VOP_READDIR_APV+0x59/frame 0xfffffe01d30819a0 kern_getdirentries() at kern_getdirentries+0x1fb/frame 0xfffffe01d3081a90 sys_getdirentries() at sys_getdirentries+0x29/frame 0xfffffe01d3081ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01d3081bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01d3081bf0 --- syscall (554, FreeBSD ELF64, sys_getdirentries), rip = 0x80041832a, rsp = 0x7fffffffdd48, rbp = 0x7fffffffdd80 --- Tracing command ls pid 78468 tid 100316 td 0xfffffe01439a6700 (CPU 9) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003cf4ee00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003cf4ee10 trap() at trap+0x56/frame 0xfffffe003cf4ef20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003cf4ef20 --- trap 0x13, rip = 0xffffffff80c09732, rsp = 0xfffffe0143fb7830, rbp = 0xfffffe0143fb78b0 --- _sx_slock_hard() at _sx_slock_hard+0x1a2/frame 0xfffffe0143fb78b0 _sx_slock_int() at _sx_slock_int+0xdb/frame 0xfffffe0143fb78f0 pfs_readdir() at pfs_readdir+0x1c6/frame 0xfffffe0143fb7980 VOP_READDIR_APV() at VOP_READDIR_APV+0x59/frame 0xfffffe0143fb79a0 kern_getdirentries() at kern_getdirentries+0x1fb/frame 0xfffffe0143fb7a90 sys_getdirentries() at sys_getdirentries+0x29/frame 0xfffffe0143fb7ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0143fb7bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0143fb7bf0 --- syscall (554, FreeBSD ELF64, sys_getdirentries), rip = 0x80041832a, rsp = 0x7fffffffdd48, rbp = 0x7fffffffdd80 --- Tracing command ls pid 78726 tid 100218 td 0xfffffe014379e800 sched_switch() at sched_switch+0x5b3/frame 0xfffffe0140f504f0 mi_switch() at mi_switch+0x155/frame 0xfffffe0140f50510 __mtx_lock_sleep() at __mtx_lock_sleep+0x1cc/frame 0xfffffe0140f505a0 __mtx_lock_flags() at __mtx_lock_flags+0xe5/frame 0xfffffe0140f505f0 pfs_lookup() at pfs_lookup+0x167/frame 0xfffffe0140f50680 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0x56/frame 0xfffffe0140f506a0 vfs_cache_lookup() at vfs_cache_lookup+0xa6/frame 0xfffffe0140f506f0 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x56/frame 0xfffffe0140f50710 lookup() at lookup+0x441/frame 0xfffffe0140f507b0 namei() at namei+0x6ac/frame 0xfffffe0140f50870 kern_statat() at kern_statat+0x130/frame 0xfffffe0140f509c0 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe0140f50ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0140f50bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0140f50bf0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x8004182aa, rsp = 0x7fffffffdbd8, rbp = 0x7fffffffdc90 --- Tracing command ls pid 78788 tid 102714 td 0xfffffe01c4161500 sched_switch() at sched_switch+0x5b3/frame 0xfffffe01c43ee630 mi_switch() at mi_switch+0x155/frame 0xfffffe01c43ee650 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe01c43ee690 sleeplk() at sleeplk+0xf2/frame 0xfffffe01c43ee6f0 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x3f5/frame 0xfffffe01c43ee790 __lockmgr_args() at __lockmgr_args+0x625/frame 0xfffffe01c43ee830 lockmgr_lock_flags() at lockmgr_lock_flags+0x13f/frame 0xfffffe01c43ee880 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe01c43ee8a0 _vn_lock() at _vn_lock+0x54/frame 0xfffffe01c43ee900 vn_statfile() at vn_statfile+0x3a/frame 0xfffffe01c43ee970 kern_fstat() at kern_fstat+0x8f/frame 0xfffffe01c43ee9c0 sys_fstat() at sys_fstat+0x1d/frame 0xfffffe01c43eeac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01c43eebf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01c43eebf0 --- syscall (551, FreeBSD ELF64, sys_fstat), rip = 0x80041828a, rsp = 0x7fffffffdca8, rbp = 0x7fffffffdd50 --- Tracing command ls pid 78809 tid 101650 td 0xfffffe01448e0700 sched_switch() at sched_switch+0x5b3/frame 0xfffffe01441f64c0 mi_switch() at mi_switch+0x155/frame 0xfffffe01441f64e0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe01441f6520 sleeplk() at sleeplk+0xf2/frame 0xfffffe01441f6580 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x3f5/frame 0xfffffe01441f6620 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe01441f6640 _vn_lock() at _vn_lock+0x54/frame 0xfffffe01441f66a0 lookup() at lookup+0xd5/frame 0xfffffe01441f6740 namei() at namei+0x6ac/frame 0xfffffe01441f6800 vn_open_cred() at vn_open_cred+0x38d/frame 0xfffffe01441f6960 kern_openat() at kern_openat+0x26f/frame 0xfffffe01441f6ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01441f6bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01441f6bf0 --- syscall (5, FreeBSD ELF64, sys_open), rip = 0x8004184ea, rsp = 0x7fffffffdd58, rbp = 0x7fffffffde70 --- Tracing command ls pid 78810 tid 101698 td 0xfffffe0144927100 sched_switch() at sched_switch+0x5b3/frame 0xfffffe014b2ea430 mi_switch() at mi_switch+0x155/frame 0xfffffe014b2ea450 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe014b2ea490 _sleep() at _sleep+0x2b4/frame 0xfffffe014b2ea540 vfs_busy() at vfs_busy+0x231/frame 0xfffffe014b2ea580 pfs_lookup() at pfs_lookup+0x24f/frame 0xfffffe014b2ea610 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0x56/frame 0xfffffe014b2ea630 vfs_cache_lookup() at vfs_cache_lookup+0xa6/frame 0xfffffe014b2ea680 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x56/frame 0xfffffe014b2ea6a0 lookup() at lookup+0x441/frame 0xfffffe014b2ea740 namei() at namei+0x6ac/frame 0xfffffe014b2ea800 vn_open_cred() at vn_open_cred+0x38d/frame 0xfffffe014b2ea960 kern_openat() at kern_openat+0x26f/frame 0xfffffe014b2eaac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014b2eabf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014b2eabf0 --- syscall (5, FreeBSD ELF64, sys_open), rip = 0x8004184ea, rsp = 0x7fffffffdc98, rbp = 0x7fffffffddb0 --- Tracing command ls pid 78864 tid 101701 td 0xfffffe0144925c00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe014b303b90 mi_switch() at mi_switch+0x155/frame 0xfffffe014b303bb0 ast() at ast+0x289/frame 0xfffffe014b303bf0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffddb0 Tracing command ls pid 78869 tid 101765 td 0xfffffe01448b5500 sched_switch() at sched_switch+0x5b3/frame 0xfffffe014b443700 mi_switch() at mi_switch+0x155/frame 0xfffffe014b443720 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe014b443760 sleeplk() at sleeplk+0xf2/frame 0xfffffe014b4437c0 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x3f5/frame 0xfffffe014b443860 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe014b443880 _vn_lock() at _vn_lock+0x54/frame 0xfffffe014b4438e0 vn_close1() at vn_close1+0xa2/frame 0xfffffe014b443950 vn_closefile() at vn_closefile+0x4a/frame 0xfffffe014b4439d0 _fdrop() at _fdrop+0x1b/frame 0xfffffe014b4439f0 closef() at closef+0x1d9/frame 0xfffffe014b443a80 closefp_impl() at closefp_impl+0x77/frame 0xfffffe014b443ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014b443bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014b443bf0 --- syscall (6, FreeBSD ELF64, sys_close), rip = 0x8004183ca, rsp = 0x7fffffffdc98, rbp = 0x7fffffffddb0 --- Tracing command ls pid 78874 tid 101059 td 0xfffffe0141014700 sched_switch() at sched_switch+0x5b3/frame 0xfffffe01440ef4c0 mi_switch() at mi_switch+0x155/frame 0xfffffe01440ef4e0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe01440ef520 sleeplk() at sleeplk+0xf2/frame 0xfffffe01440ef580 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x3f5/frame 0xfffffe01440ef620 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe01440ef640 _vn_lock() at _vn_lock+0x54/frame 0xfffffe01440ef6a0 lookup() at lookup+0xd5/frame 0xfffffe01440ef740 namei() at namei+0x6ac/frame 0xfffffe01440ef800 vn_open_cred() at vn_open_cred+0x38d/frame 0xfffffe01440ef960 kern_openat() at kern_openat+0x26f/frame 0xfffffe01440efac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01440efbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01440efbf0 --- syscall (5, FreeBSD ELF64, sys_open), rip = 0x8004184ea, rsp = 0x7fffffffdd58, rbp = 0x7fffffffde70 --- Tracing command ls pid 78998 tid 101706 td 0xfffffe0144927800 sched_switch() at sched_switch+0x5b3/frame 0xfffffe014b3123b0 mi_switch() at mi_switch+0x155/frame 0xfffffe014b3123d0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe014b312410 sleeplk() at sleeplk+0xf2/frame 0xfffffe014b312470 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x3f5/frame 0xfffffe014b312510 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe014b312530 _vn_lock() at _vn_lock+0x54/frame 0xfffffe014b312590 vget_finish() at vget_finish+0x7a/frame 0xfffffe014b3125c0 cache_lookup_dotdot() at cache_lookup_dotdot+0x1d5/frame 0xfffffe014b312630 vfs_cache_lookup() at vfs_cache_lookup+0x7b/frame 0xfffffe014b312680 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x56/frame 0xfffffe014b3126a0 lookup() at lookup+0x441/frame 0xfffffe014b312740 namei() at namei+0x6ac/frame 0xfffffe014b312800 vn_open_cred() at vn_open_cred+0x38d/frame 0xfffffe014b312960 kern_openat() at kern_openat+0x26f/frame 0xfffffe014b312ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014b312bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014b312bf0 --- syscall (5, FreeBSD ELF64, sys_open), rip = 0x8004184ea, rsp = 0x7fffffffdc98, rbp = 0x7fffffffddb0 --- Tracing command ls pid 79019 tid 100252 td 0xfffffe0143912300 sched_switch() at sched_switch+0x5b3/frame 0xfffffe0143e9f630 mi_switch() at mi_switch+0x155/frame 0xfffffe0143e9f650 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe0143e9f690 sleeplk() at sleeplk+0xf2/frame 0xfffffe0143e9f6f0 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x3f5/frame 0xfffffe0143e9f790 __lockmgr_args() at __lockmgr_args+0x625/frame 0xfffffe0143e9f830 lockmgr_lock_flags() at lockmgr_lock_flags+0x13f/frame 0xfffffe0143e9f880 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe0143e9f8a0 _vn_lock() at _vn_lock+0x54/frame 0xfffffe0143e9f900 vn_statfile() at vn_statfile+0x3a/frame 0xfffffe0143e9f970 kern_fstat() at kern_fstat+0x8f/frame 0xfffffe0143e9f9c0 sys_fstat() at sys_fstat+0x1d/frame 0xfffffe0143e9fac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0143e9fbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0143e9fbf0 --- syscall (551, FreeBSD ELF64, sys_fstat), rip = 0x80041828a, rsp = 0x7fffffffdbe8, rbp = 0x7fffffffdc90 --- Tracing command ls pid 79075 tid 101700 td 0xfffffe0144926300 sched_switch() at sched_switch+0x5b3/frame 0xfffffe014b2f4530 mi_switch() at mi_switch+0x155/frame 0xfffffe014b2f4550 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe014b2f4590 sleeplk() at sleeplk+0xf2/frame 0xfffffe014b2f45f0 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x3f5/frame 0xfffffe014b2f4690 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe014b2f46b0 _vn_lock() at _vn_lock+0x54/frame 0xfffffe014b2f4710 lookup() at lookup+0xd5/frame 0xfffffe014b2f47b0 namei() at namei+0x6ac/frame 0xfffffe014b2f4870 kern_statat() at kern_statat+0x130/frame 0xfffffe014b2f49c0 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe014b2f4ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014b2f4bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014b2f4bf0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x8004182aa, rsp = 0x7fffffffdbd8, rbp = 0x7fffffffdc90 --- Tracing command ls pid 79076 tid 101660 td 0xfffffe01448ea000 sched_switch() at sched_switch+0x5b3/frame 0xfffffe014b22c530 mi_switch() at mi_switch+0x155/frame 0xfffffe014b22c550 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe014b22c590 sleeplk() at sleeplk+0xf2/frame 0xfffffe014b22c5f0 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x3f5/frame 0xfffffe014b22c690 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe014b22c6b0 _vn_lock() at _vn_lock+0x54/frame 0xfffffe014b22c710 lookup() at lookup+0xd5/frame 0xfffffe014b22c7b0 namei() at namei+0x6ac/frame 0xfffffe014b22c870 kern_statat() at kern_statat+0x130/frame 0xfffffe014b22c9c0 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe014b22cac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014b22cbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014b22cbf0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x8004182aa, rsp = 0x7fffffffdbd8, rbp = 0x7fffffffdc90 --- Tracing command mount pid 79080 tid 102687 td 0xfffffe01c4119500 (CPU 6) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003cf2ae00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003cf2ae10 trap() at trap+0x56/frame 0xfffffe003cf2af20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003cf2af20 --- trap 0x13, rip = 0xffffffff80cbe201, rsp = 0xfffffe01c4371420, rbp = 0xfffffe01c4371480 --- breada() at breada+0x1/frame 0xfffffe01c4371480 ffs_blkatoff() at ffs_blkatoff+0x89/frame 0xfffffe01c43714f0 ufs_lookup_ino() at ufs_lookup_ino+0x664/frame 0xfffffe01c4371660 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0x56/frame 0xfffffe01c4371680 vfs_cache_lookup() at vfs_cache_lookup+0xa6/frame 0xfffffe01c43716d0 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x56/frame 0xfffffe01c43716f0 lookup() at lookup+0x441/frame 0xfffffe01c4371790 namei() at namei+0x6ac/frame 0xfffffe01c4371850 kern_funlinkat() at kern_funlinkat+0x16c/frame 0xfffffe01c4371aa0 sys_funlinkat() at sys_funlinkat+0x44/frame 0xfffffe01c4371ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01c4371bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01c4371bf0 --- syscall (568, FreeBSD ELF64, sys_funlinkat), rip = 0x8003a208a, rsp = 0x7fffffffe478, rbp = 0x7fffffffe590 --- Tracing command umount pid 79085 tid 101677 td 0xfffffe01448fe700 sched_switch() at sched_switch+0x5b3/frame 0xfffffe014b28b600 mi_switch() at mi_switch+0x155/frame 0xfffffe014b28b620 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe014b28b660 sleeplk() at sleeplk+0xf2/frame 0xfffffe014b28b6c0 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x3f5/frame 0xfffffe014b28b760 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe014b28b780 _vn_lock() at _vn_lock+0x54/frame 0xfffffe014b28b7e0 vflush() at vflush+0xd0/frame 0xfffffe014b28b930 dounmount() at dounmount+0x43b/frame 0xfffffe014b28b9a0 kern_unmount() at kern_unmount+0x2fc/frame 0xfffffe014b28bac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014b28bbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014b28bbf0 --- syscall (22, FreeBSD ELF64, sys_unmount), rip = 0x8003865aa, rsp = 0x7fffffffd238, rbp = 0x7fffffffd770 --- Tracing command mount pid 79096 tid 101619 td 0xfffffe0143dda100 (CPU 2) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003cefae00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003cefae10 trap() at trap+0x56/frame 0xfffffe003cefaf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003cefaf20 --- trap 0x13, rip = 0xffffffff80bf863a, rsp = 0xfffffe01440ea5e0, rbp = 0xfffffe01440ea610 --- _rw_wlock_cookie() at _rw_wlock_cookie+0x7a/frame 0xfffffe01440ea610 pmap_try_insert_pv_entry() at pmap_try_insert_pv_entry+0xd2/frame 0xfffffe01440ea650 pmap_enter_quick_locked() at pmap_enter_quick_locked+0x1ee/frame 0xfffffe01440ea6c0 pmap_enter_object() at pmap_enter_object+0x259/frame 0xfffffe01440ea730 vm_map_pmap_enter() at vm_map_pmap_enter+0x2e9/frame 0xfffffe01440ea7b0 vm_map_insert() at vm_map_insert+0x5b9/frame 0xfffffe01440ea850 vm_map_fixed() at vm_map_fixed+0x110/frame 0xfffffe01440ea8b0 vm_mmap_object() at vm_mmap_object+0x1c2/frame 0xfffffe01440ea920 vn_mmap() at vn_mmap+0x159/frame 0xfffffe01440ea9a0 kern_mmap() at kern_mmap+0x599/frame 0xfffffe01440eaa80 sys_mmap() at sys_mmap+0x42/frame 0xfffffe01440eaac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01440eabf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01440eabf0 --- syscall (477, FreeBSD ELF64, sys_mmap), rip = 0x8002227ea, rsp = 0x7fffffffcb28, rbp = 0x7fffffffcca0 --- Tracing command sh pid 79097 tid 102674 td 0xfffffe01ccba6100 sched_switch() at sched_switch+0x5b3/frame 0xfffffe01c43266c0 mi_switch() at mi_switch+0x155/frame 0xfffffe01c43266e0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe01c4326720 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01c4326770 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01c4326780 _sleep() at _sleep+0x2aa/frame 0xfffffe01c4326830 kern_wait6() at kern_wait6+0x482/frame 0xfffffe01c43268c0 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe01c4326ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01c4326bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01c4326bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003e678a, rsp = 0x7fffffffd818, rbp = 0x7fffffffd8c0 --- Tracing command grep pid 79098 tid 102670 td 0xfffffe01cb6f2e00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe01c4312830 mi_switch() at mi_switch+0x155/frame 0xfffffe01c4312850 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe01c4312890 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01c43128e0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01c43128f0 _sleep() at _sleep+0x2aa/frame 0xfffffe01c43129a0 pipe_read() at pipe_read+0x4c6/frame 0xfffffe01c4312a00 dofileread() at dofileread+0x81/frame 0xfffffe01c4312a50 sys_read() at sys_read+0xbc/frame 0xfffffe01c4312ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01c4312bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01c4312bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80039f5aa, rsp = 0x7fffffffe048, rbp = 0x7fffffffe150 --- Tracing command mount pid 79099 tid 101737 td 0xfffffe0144957c00 (CPU 8) kdb_enter() at kdb_enter+0x37/frame 0xfffffe014b3b75a0 vpanic() at vpanic+0x1b2/frame 0xfffffe014b3b75f0 panic() at panic+0x43/frame 0xfffffe014b3b7650 cache_fplookup() at cache_fplookup+0xd15/frame 0xfffffe014b3b7740 namei() at namei+0x12c/frame 0xfffffe014b3b7800 vn_open_cred() at vn_open_cred+0x107/frame 0xfffffe014b3b7960 kern_openat() at kern_openat+0x26f/frame 0xfffffe014b3b7ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014b3b7bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014b3b7bf0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8003a250a, rsp = 0x7fffffffdc48, rbp = 0x7fffffffdd30 --- Tracing command date pid 79100 tid 101625 td 0xfffffe0144abd800 (CPU 4) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003cf12e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003cf12e10 trap() at trap+0x56/frame 0xfffffe003cf12f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003cf12f20 --- trap 0x13, rip = 0xffffffff80c08777, rsp = 0xfffffe0144183970, rbp = 0xfffffe0144183a00 --- _sx_xlock_hard() at _sx_xlock_hard+0x267/frame 0xfffffe0144183a00 _sx_xlock() at _sx_xlock+0xba/frame 0xfffffe0144183a40 exit1() at exit1+0x5ea/frame 0xfffffe0144183ab0 sys_sys_exit() at sys_sys_exit+0xd/frame 0xfffffe0144183ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0144183bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0144183bf0 --- syscall (1, FreeBSD ELF64, sys_sys_exit), rip = 0x80038920a, rsp = 0x7fffffffe0c8, rbp = 0x7fffffffe0e0 --- Tracing command mount pid 79101 tid 101761 td 0xfffffe01448b7100 sched_switch() at sched_switch+0x5b3/frame 0xfffffe014b42f380 mi_switch() at mi_switch+0x155/frame 0xfffffe014b42f3a0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe014b42f3e0 sleeplk() at sleeplk+0xf2/frame 0xfffffe014b42f440 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d5/frame 0xfffffe014b42f4e0 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe014b42f520 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe014b42f540 _vn_lock() at _vn_lock+0x54/frame 0xfffffe014b42f5a0 vget_finish() at vget_finish+0x7a/frame 0xfffffe014b42f5d0 cache_lookup() at cache_lookup+0x3c4/frame 0xfffffe014b42f630 vfs_cache_lookup() at vfs_cache_lookup+0x7b/frame 0xfffffe014b42f680 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x56/frame 0xfffffe014b42f6a0 lookup() at lookup+0x441/frame 0xfffffe014b42f740 namei() at namei+0x6ac/frame 0xfffffe014b42f800 vn_open_cred() at vn_open_cred+0x38d/frame 0xfffffe014b42f960 kern_openat() at kern_openat+0x26f/frame 0xfffffe014b42fac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014b42fbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014b42fbf0 --- syscall (5, FreeBSD ELF64, sys_open), rip = 0x800222aba, rsp = 0x7fffffffcad8, rbp = 0x7fffffffcca0 --- Tracing command umount pid 79102 tid 102740 td 0xfffffe01c41b3c00 (CPU 7) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003cf36e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003cf36e10 trap() at trap+0x56/frame 0xfffffe003cf36f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003cf36f20 --- trap 0x13, rip = 0xffffffff8105660a, rsp = 0xfffffe01d3072620, rbp = 0xfffffe01d3072650 --- pmap_try_insert_pv_entry() at pmap_try_insert_pv_entry+0xda/frame 0xfffffe01d3072650 pmap_enter_quick_locked() at pmap_enter_quick_locked+0x1ee/frame 0xfffffe01d30726c0 pmap_enter_object() at pmap_enter_object+0x259/frame 0xfffffe01d3072730 vm_map_pmap_enter() at vm_map_pmap_enter+0x2e9/frame 0xfffffe01d30727b0 vm_map_insert() at vm_map_insert+0x5b9/frame 0xfffffe01d3072850 vm_map_fixed() at vm_map_fixed+0x110/frame 0xfffffe01d30728b0 vm_mmap_object() at vm_mmap_object+0x1c2/frame 0xfffffe01d3072920 vn_mmap() at vn_mmap+0x159/frame 0xfffffe01d30729a0 kern_mmap() at kern_mmap+0x599/frame 0xfffffe01d3072a80 sys_mmap() at sys_mmap+0x42/frame 0xfffffe01d3072ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01d3072bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01d3072bf0 --- syscall (477, FreeBSD ELF64, sys_mmap), rip = 0x8002217ea, rsp = 0x7fffffffcb18, rbp = 0x7fffffffcc90 --- Tracing command sh pid 79103 tid 102667 td 0xfffffe01cb6f4300 sched_switch() at sched_switch+0x5b3/frame 0xfffffe01c430d830 mi_switch() at mi_switch+0x155/frame 0xfffffe01c430d850 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe01c430d890 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01c430d8e0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01c430d8f0 _sleep() at _sleep+0x2aa/frame 0xfffffe01c430d9a0 pipe_read() at pipe_read+0x4c6/frame 0xfffffe01c430da00 dofileread() at dofileread+0x81/frame 0xfffffe01c430da50 sys_read() at sys_read+0xbc/frame 0xfffffe01c430dac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01c430dbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01c430dbf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8003e65aa, rsp = 0x7fffffffd908, rbp = 0x7fffffffda50 --- Tracing command mount pid 79104 tid 101661 td 0xfffffe01448ed800 (CPU 1) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ceeee00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ceeee10 trap() at trap+0x56/frame 0xfffffe003ceeef20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ceeef20 --- trap 0x13, rip = 0xffffffff80c6e797, rsp = 0xfffffe014b23b900, rbp = 0xfffffe014b23b930 --- witness_unlock() at witness_unlock+0xe7/frame 0xfffffe014b23b930 __mtx_unlock_flags() at __mtx_unlock_flags+0x4d/frame 0xfffffe014b23b960 pmap_remove() at pmap_remove+0x5c2/frame 0xfffffe014b23b9e0 vm_map_delete() at vm_map_delete+0x20f/frame 0xfffffe014b23ba40 kern_munmap() at kern_munmap+0x99/frame 0xfffffe014b23bac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014b23bbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014b23bbf0 --- syscall (73, FreeBSD ELF64, sys_munmap), rip = 0x80022268a, rsp = 0x7fffffffcb38, rbp = 0x7fffffffcca0 --- Tracing command mount pid 79105 tid 102738 td 0xfffffe01c41b4a00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe01d3068580 mi_switch() at mi_switch+0x155/frame 0xfffffe01d30685a0 kern_yield() at kern_yield+0x71/frame 0xfffffe01d30685e0 uiomove_fromphys() at uiomove_fromphys+0x171/frame 0xfffffe01d3068650 vn_read_from_obj() at vn_read_from_obj+0x159/frame 0xfffffe01d3068730 VOP_READ_PGCACHE_APV() at VOP_READ_PGCACHE_APV+0x38/frame 0xfffffe01d3068750 vn_read() at vn_read+0x94/frame 0xfffffe01d30687d0 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe01d3068830 vn_io_fault1() at vn_io_fault1+0x16c/frame 0xfffffe01d3068980 vn_io_fault() at vn_io_fault+0x1ba/frame 0xfffffe01d3068a00 dofileread() at dofileread+0x81/frame 0xfffffe01d3068a50 sys_read() at sys_read+0xbc/frame 0xfffffe01d3068ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01d3068bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01d3068bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800222afa, rsp = 0x7fffffffd9c8, rbp = 0x7fffffffdae0 --- Tracing command grep pid 79106 tid 100346 td 0xfffffe01439b7500 (CPU 10) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003cf5ae00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003cf5ae10 trap() at trap+0x56/frame 0xfffffe003cf5af20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003cf5af20 --- trap 0x13, rip = 0x8002247d0, rsp = 0x7fffffffdad0, rbp = 0x7fffffffdad0 --- Tracing command grep pid 79107 tid 102723 td 0xfffffe01c417d500 sched_switch() at sched_switch+0x5b3/frame 0xfffffe01d3027580 mi_switch() at mi_switch+0x155/frame 0xfffffe01d30275a0 kern_yield() at kern_yield+0x71/frame 0xfffffe01d30275e0 uiomove_fromphys() at uiomove_fromphys+0x171/frame 0xfffffe01d3027650 vn_read_from_obj() at vn_read_from_obj+0x159/frame 0xfffffe01d3027730 VOP_READ_PGCACHE_APV() at VOP_READ_PGCACHE_APV+0x38/frame 0xfffffe01d3027750 vn_read() at vn_read+0x94/frame 0xfffffe01d30277d0 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe01d3027830 vn_io_fault1() at vn_io_fault1+0x16c/frame 0xfffffe01d3027980 vn_io_fault() at vn_io_fault+0x1ba/frame 0xfffffe01d3027a00 dofileread() at dofileread+0x81/frame 0xfffffe01d3027a50 sys_read() at sys_read+0xbc/frame 0xfffffe01d3027ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01d3027bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01d3027bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800223afa, rsp = 0x7fffffffd9e8, rbp = 0x7fffffffdb00 --- Tracing command mount pid 79108 tid 102669 td 0xfffffe01cb6f3500 (CPU 11) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003cf66e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003cf66e10 trap() at trap+0x56/frame 0xfffffe003cf66f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003cf66f20 --- trap 0x13, rip = 0xffffffff81054c1e, rsp = 0xfffffe01c4317660, rbp = 0xfffffe01c43176c0 --- pmap_enter_quick_locked() at pmap_enter_quick_locked+0x2ce/frame 0xfffffe01c43176c0 pmap_enter_object() at pmap_enter_object+0x259/frame 0xfffffe01c4317730 vm_map_pmap_enter() at vm_map_pmap_enter+0x2e9/frame 0xfffffe01c43177b0 vm_map_insert() at vm_map_insert+0x5b9/frame 0xfffffe01c4317850 vm_map_fixed() at vm_map_fixed+0x110/frame 0xfffffe01c43178b0 vm_mmap_object() at vm_mmap_object+0x1c2/frame 0xfffffe01c4317920 vn_mmap() at vn_mmap+0x159/frame 0xfffffe01c43179a0 kern_mmap() at kern_mmap+0x599/frame 0xfffffe01c4317a80 sys_mmap() at sys_mmap+0x42/frame 0xfffffe01c4317ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01c4317bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01c4317bf0 --- syscall (477, FreeBSD ELF64, sys_mmap), rip = 0x8002227ea, rsp = 0x7fffffffcb38, rbp = 0x7fffffffcca0 --- Tracing command sh pid 79109 tid 101645 td 0xfffffe01448e2a00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe01441e7960 mi_switch() at mi_switch+0x155/frame 0xfffffe01441e7980 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe01441e79c0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe01441e7a00 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x18e/frame 0xfffffe01441e7a70 fork_rfppwait() at fork_rfppwait+0xc8/frame 0xfffffe01441e7ac0 amd64_syscall() at amd64_syscall+0x6f0/frame 0xfffffe01441e7bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01441e7bf0 --- syscall (79116), rip = 0x8003e33fd, rsp = 0x7fffffffd5f0, rbp = 0x7fffffffd6a0 --- Tracing command grep pid 79110 tid 100347 td 0xfffffe01439b6e00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe0144048380 mi_switch() at mi_switch+0x155/frame 0xfffffe01440483a0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe01440483e0 sleeplk() at sleeplk+0xf2/frame 0xfffffe0144048440 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d5/frame 0xfffffe01440484e0 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe0144048520 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe0144048540 _vn_lock() at _vn_lock+0x54/frame 0xfffffe01440485a0 vget_finish() at vget_finish+0x7a/frame 0xfffffe01440485d0 cache_lookup() at cache_lookup+0x3c4/frame 0xfffffe0144048630 vfs_cache_lookup() at vfs_cache_lookup+0x7b/frame 0xfffffe0144048680 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x56/frame 0xfffffe01440486a0 lookup() at lookup+0x441/frame 0xfffffe0144048740 namei() at namei+0x6ac/frame 0xfffffe0144048800 vn_open_cred() at vn_open_cred+0x38d/frame 0xfffffe0144048960 kern_openat() at kern_openat+0x26f/frame 0xfffffe0144048ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0144048bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0144048bf0 --- syscall (5, FreeBSD ELF64, sys_open), rip = 0x800223aba, rsp = 0x7fffffffcac8, rbp = 0x7fffffffcc90 --- Tracing command mount pid 79111 tid 101608 td 0xfffffe0143de5a00 sched_switch() at sched_switch+0x5b3/frame 0xfffffe01440bd380 mi_switch() at mi_switch+0x155/frame 0xfffffe01440bd3a0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe01440bd3e0 sleeplk() at sleeplk+0xf2/frame 0xfffffe01440bd440 lockmgr_slock_hard() at lockmgr_slock_hard+0x3d5/frame 0xfffffe01440bd4e0 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe01440bd520 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe01440bd540 _vn_lock() at _vn_lock+0x54/frame 0xfffffe01440bd5a0 vget_finish() at vget_finish+0x7a/frame 0xfffffe01440bd5d0 cache_lookup() at cache_lookup+0x3c4/frame 0xfffffe01440bd630 vfs_cache_lookup() at vfs_cache_lookup+0x7b/frame 0xfffffe01440bd680 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x56/frame 0xfffffe01440bd6a0 lookup() at lookup+0x441/frame 0xfffffe01440bd740 namei() at namei+0x6ac/frame 0xfffffe01440bd800 vn_open_cred() at vn_open_cred+0x38d/frame 0xfffffe01440bd960 kern_openat() at kern_openat+0x26f/frame 0xfffffe01440bdac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01440bdbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01440bdbf0 --- syscall (5, FreeBSD ELF64, sys_open), rip = 0x800222aba, rsp = 0x7fffffffcad8, rbp = 0x7fffffffcca0 --- Tracing command sh pid 79112 tid 100250 td 0xfffffe0142d41500 sched_switch() at sched_switch+0x5b3/frame 0xfffffe0140fce360 mi_switch() at mi_switch+0x155/frame 0xfffffe0140fce380 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe0140fce3c0 _vm_page_busy_sleep() at _vm_page_busy_sleep+0x110/frame 0xfffffe0140fce410 vm_page_acquire_unlocked() at vm_page_acquire_unlocked+0x166/frame 0xfffffe0140fce470 vm_page_grab_valid_unlocked() at vm_page_grab_valid_unlocked+0x51/frame 0xfffffe0140fce4b0 vm_imgact_map_page() at vm_imgact_map_page+0x20/frame 0xfffffe0140fce4d0 elf64_load_sections() at elf64_load_sections+0x227/frame 0xfffffe0140fce560 elf64_load_file() at elf64_load_file+0x27a/frame 0xfffffe0140fce5d0 exec_elf64_imgact() at exec_elf64_imgact+0xfa9/frame 0xfffffe0140fce6d0 kern_execve() at kern_execve+0x62d/frame 0xfffffe0140fcea30 sys_execve() at sys_execve+0x5a/frame 0xfffffe0140fceac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0140fcebf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0140fcebf0 --- syscall (59, FreeBSD ELF64, sys_execve), rip = 0x8003e38ea, rsp = 0x7fffffffdf78, rbp = 0x7fffffffe0c0 --- Tracing command date pid 79113 tid 100348 td 0xfffffe01439b6700 (CPU 0) cpustop_handler() at cpustop_handler+0x28/frame 0xffffffff81df1720 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xffffffff81df1730 trap() at trap+0x56/frame 0xffffffff81df1840 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81df1840 --- trap 0x13, rip = 0xffffffff81054704, rsp = 0xfffffe01440576d0, rbp = 0xfffffe0144057730 --- pmap_enter_object() at pmap_enter_object+0xa4/frame 0xfffffe0144057730 vm_map_pmap_enter() at vm_map_pmap_enter+0x2e9/frame 0xfffffe01440577b0 vm_map_insert() at vm_map_insert+0x5b9/frame 0xfffffe0144057850 vm_map_fixed() at vm_map_fixed+0x110/frame 0xfffffe01440578b0 vm_mmap_object() at vm_mmap_object+0x1c2/frame 0xfffffe0144057920 vn_mmap() at vn_mmap+0x159/frame 0xfffffe01440579a0 kern_mmap() at kern_mmap+0x599/frame 0xfffffe0144057a80 sys_mmap() at sys_mmap+0x42/frame 0xfffffe0144057ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0144057bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0144057bf0 --- syscall (477, FreeBSD ELF64, sys_mmap), rip = 0x8002217ea, rsp = 0x7fffffffcb28, rbp = 0x7fffffffcca0 --- Tracing command sh pid 79115 tid 102682 td 0xfffffe01ccba6800 fork_trampoline() at fork_trampoline Tracing command sh pid 79116 tid 101744 td 0xfffffe014489ca00 fork_trampoline() at fork_trampoline Tracing command sh pid 79117 tid 102676 td 0xfffffe01ccba5300 fork_trampoline() at fork_trampoline Tracing command sctp_iterator pid 6446 tid 100295 td 0xfffffe01439a8300 sched_switch() at sched_switch+0x5b3/frame 0xfffffe0143f53a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0143f53aa0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe0143f53ae0 _sleep() at _sleep+0x2b4/frame 0xfffffe0143f53b90 sctp_iterator_thread() at sctp_iterator_thread+0x59/frame 0xfffffe0143f53bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0143f53bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0143f53bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command ftcleanup pid 32714 tid 101715 td 0xfffffe0144933800 sched_switch() at sched_switch+0x5b3/frame 0xfffffe014b349a50 mi_switch() at mi_switch+0x155/frame 0xfffffe014b349a70 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe014b349ab0 _sleep() at _sleep+0x2b4/frame 0xfffffe014b349b60 fasttrap_pid_cleanup_cb() at fasttrap_pid_cleanup_cb+0x269/frame 0xfffffe014b349bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe014b349bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe014b349bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db> reset cpu_reset: Restarting BSP cpu_reset_proxy: Stopped CPU 8 (kgdb) bt #0 __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:55 #1 doadump (textdump=textdump@entry=0x0) at ../../../kern/kern_shutdown.c:399 #2 0xffffffff804b8f8a in db_dump (dummy=, dummy2=, dummy3=, dummy4=) at ../../../ddb/db_command.c:575 #3 0xffffffff804b8d50 in db_command (last_cmdp=, cmd_table=, dopager=dopager@entry=0x0) at ../../../ddb/db_command.c:482 #4 0xffffffff804b8ed6 in db_command_script (command=command@entry=0xffffffff819cb400 "dump") at ../../../ddb/db_command.c:553 #5 0xffffffff804bdf18 in db_script_exec (scriptname=0xffffffff819cad70 "dump", warnifnotfound=) at ../../../ddb/db_script.c:304 #6 0xffffffff804b8d50 in db_command (last_cmdp=, cmd_table=, dopager=dopager@entry=0x0) at ../../../ddb/db_command.c:482 #7 0xffffffff804b8ed6 in db_command_script (command=command@entry=0xffffffff819cb392 "run pho1") at ../../../ddb/db_command.c:553 #8 0xffffffff804bdf18 in db_script_exec (scriptname=0xffffffff819cad70 "dump", warnifnotfound=) at ../../../ddb/db_script.c:304 #9 0xffffffff804b8d50 in db_command (last_cmdp=, cmd_table=, dopager=dopager@entry=0x1) at ../../../ddb/db_command.c:482 #10 0xffffffff804b8aad in db_command_loop () at ../../../ddb/db_command.c:535 #11 0xffffffff804bbe16 in db_trap (type=, code=) at ../../../ddb/db_main.c:270 #12 0xffffffff80c4aa34 in kdb_trap (type=type@entry=0x3, code=code@entry=0x0, tf=, tf@entry=0xfffffe014b3b74d0) at ../../../kern/subr_kdb.c:727 #13 0xffffffff8106821e in trap (frame=0xfffffe014b3b74d0) at ../../../amd64/amd64/trap.c:576 #14 #15 kdb_enter (why=0xffffffff8124ed0d "panic", msg=) at ../../../kern/subr_kdb.c:506 #16 0xffffffff80bfe232 in vpanic (fmt=, ap=, ap@entry=0xfffffe014b3b7630) at ../../../kern/kern_shutdown.c:907 #17 0xffffffff80bfdfc3 in panic (fmt=0xffffffff81c964f8 "\310\364 \201\377\377\377\377") at ../../../kern/kern_shutdown.c:843 #18 0xffffffff80ccc4f5 in cache_fplookup_next (fpl=0xfffffe014b3b76a8) at ../../../kern/vfs_cache.c:5001 #19 cache_fplookup_impl (dvp=, fpl=0xfffffe014b3b76a8) at ../../../kern/vfs_cache.c:5619 #20 cache_fplookup (ndp=ndp@entry=0xfffffe014b3b7978, status=status@entry=0xfffffe014b3b77b4, pwdp=pwdp@entry=0xfffffe014b3b77c0) at ../../../kern/vfs_cache.c:5790 #21 0xffffffff80cd9d8c in namei (ndp=ndp@entry=0xfffffe014b3b7978) at ../../../kern/vfs_lookup.c:602 #22 0xffffffff80d00277 in vn_open_cred (ndp=ndp@entry=0xfffffe014b3b7978, flagp=flagp@entry=0xfffffe014b3b7a94, cmode=cmode@entry=0x180, vn_open_flags=vn_open_flags@entry=0x0, cred=0xfffff800040e7400, fp=0xfffff804a7b8a320) at ../../../kern/vfs_vnops.c:252 #23 0xffffffff80d0016d in vn_open (ndp=0xffffffff81c964f8 , ndp@entry=0xfffffe014b3b7978, flagp=0x80, flagp@entry=0xfffffe014b3b7a94, cmode=0x4b3b7490, cmode@entry=0x180, fp=0x1d0) at ../../../kern/vfs_vnops.c:193 #24 0xffffffff80cf726f in kern_openat (td=0xfffffe0144957c00, fd=0x3, path=0x800a10409 , pathseg=UIO_USERSPACE, flags=0x100206, mode=) at ../../../kern/vfs_syscalls.c:1143 #25 0xffffffff81069057 in syscallenter (td=0xfffffe0144957c00) at ../../../amd64/amd64/../../kern/subr_syscall.c:189 #26 amd64_syscall (td=0xfffffe0144957c00, traced=0x0) at ../../../amd64/amd64/trap.c:1156 #27 #28 0x00000008003a250a in ?? () Backtrace stopped: Cannot access memory at address 0x7fffffffdc48 (kgdb) f 18 #18 0xffffffff80ccc4f5 in cache_fplookup_next (fpl=0xfffffe014b3b76a8) at ../../../kern/vfs_cache.c:5001 5001 panic("%s: invalidated entry %p found but vnode state does not match", __func__, ncp); (kgdb) l 4996 */ 4997 if (!cache_ncp_canuse(ncp)) { 4998 counter_u64_add(numinvraces, 1); 4999 if (!(VOP_ISLOCKED(tvp) || seqc_in_modify(vn_seqc_read_any(dvp)) || 5000 seqc_in_modify(vn_seqc_read_any(tvp)))) { 5001 panic("%s: invalidated entry %p found but vnode state does not match", __func__, ncp); 5002 } 5003 } 5004 #endif 5005 fpl->tvp = tvp; (kgdb) info loc cnp = dvp = 0xfffff80009164a00 hash = 0xafdb6de8 ncp = 0xfffff8057d43a6e8 error = nc_flag = tvp = 0xfffff806992fea00 _ncp = _nc_flag = __seqc = __seqc = __seqc = (kgdb) p *ncp $1 = {nc_src = {le_next = 0xffffffffffffffff, le_prev = 0xffffffffffffffff}, nc_dst = {tqe_next = 0xffffffffffffffff, tqe_prev = 0xffffffffffffffff}, nc_hash = {csle_next = 0x0}, nc_dvp = 0xfffff80009164a00, n_un = {nu_vp = 0xfffff806992fea00, nu_neg = {neg_flag = 0x0, neg_hit = 0xea}}, nc_flag = 0x40, nc_nlen = 0xa, nc_name = 0xfffff8057d43a722 "mountd.pid"} (kgdb) p *fpl $1 = {ndp = 0xfffffe014b3b7978, cnp = 0xfffffe014b3b79f8, nulchar = 0xfffff8068c2eb40a "", pwd = 0xfffffe014b3b77c0, dvp = 0xfffff80009164a00, tvp = 0xfffffe014b3b7720, dvp_seqc = 0x97a, tvp_seqc = 0xffffffff, snd = {cn_nameptr = 0xfffff8068c2eb400 "mountd.pid", ni_pathlen = 0xb}, snd_outer = {ni_pathlen = 0xb, cn_flags = 0x4804f}, line = 0x44957c00, status = CACHE_FPL_STATUS_UNSET, in_smr = 0x1, fsearch = 0x0, savename = 0x0, debug = {ni_pathlen = 0x1}} (kgdb) p *tvp $2 = {v_type = VREG, v_irflag = 0x2, v_seqc = 0x4, v_nchash = 0x910e65b5, v_op = 0xffffffff8195ebd8 , v_data = 0xfffffe01783a68d0, v_mount = 0xfffffe010dc22700, v_nmntvnodes = {tqe_next = 0x0, tqe_prev = 0xfffff8057d6d82a8}, {v_mountedhere = 0x0, v_unpcb = 0x0, v_rdev = 0x0, v_fifoinfo = 0x0}, v_hashlist = {le_next = 0x0, le_prev = 0xfffffe010c74b0a8}, v_cache_src = {lh_first = 0x0}, v_cache_dst = {tqh_first = 0x0, tqh_last = 0xfffff806992fea58}, v_cache_dd = 0x0, v_lock = {lock_object = {lo_name = 0xffffffff8115b7ac "ufs", lo_flags = 0x6fb0000, lo_data = 0x0, lo_witness = 0xfffff8087fd82c80}, lk_lock = 0x1, lk_exslpfail = 0x0, lk_timo = 0x33, lk_pri = 0x60, lk_stack = {depth = 0x9, pcs = {0xffffffff80bcda95, 0xffffffff80ecf15d, 0xffffffff8112e220, 0xffffffff80d00d84, 0xffffffff80cff81a, 0xffffffff80ba004f, 0xffffffff80ba012d, 0xffffffff81069057, 0xffffffff8103c2be, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0}}}, v_interlock = {lock_object = {lo_name = 0xffffffff81298d9d "vnode interlock", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xfffff8087fd75580}, mtx_lock = 0x0}, v_vnlock = 0xfffff806992fea70, v_vnodelist = {tqe_next = 0xfffff80699305000, tqe_prev = 0xfffff806992fe660}, v_lazylist = {tqe_next = 0x0, tqe_prev = 0xfffff8029ff2fb70}, v_bufobj = {bo_lock = {lock_object = { lo_name = 0xffffffff81254cec "bufobj interlock", lo_flags = 0x5230000, lo_data = 0x0, lo_witness = 0xfffff8087fd7fe00}, rw_lock = 0x1}, bo_ops = 0xffffffff81923710 , bo_object = 0xfffff805830ace70, bo_synclist = {le_next = 0xffffffffffffffff, le_prev = 0xffffffffffffffff}, bo_private = 0xfffff806992fea00, bo_clean = {bv_hd = {tqh_first = 0x0, tqh_last = 0xfffff806992febc8}, bv_root = {pt_root = 0x0}, bv_cnt = 0x0}, bo_dirty = {bv_hd = {tqh_first = 0x0, tqh_last = 0xfffff806992febe8}, bv_root = {pt_root = 0x0}, bv_cnt = 0x0}, bo_numoutput = 0x0, bo_flag = 0x0, bo_domain = 0x1, bo_bsize = 0x8000}, v_pollinfo = 0x0, v_label = 0x0, v_lockf = 0xfffff8068c978a80, v_rl = {rl_waiters = {tqh_first = 0x0, tqh_last = 0xfffff806992fec30}, rl_currdep = 0x0}, v_cstart = 0x0, v_lasta = 0x0, v_lastw = 0x0, v_clen = 0x0, v_holdcnt = 0x1, v_usecount = 0x1, v_iflag = 0x0, v_vflag = 0x0, v_mflag = 0x1, v_dbatchcpu = 0xffff, v_writecount = 0x1, v_seqc_users = 0x0, v_hash = 0x75c036} (kgdb) p *dvp $3 = {v_type = VDIR, v_irflag = 0x0, v_seqc = 0x97a, v_nchash = 0x35a88290, v_op = 0xffffffff8195ebd8 , v_data = 0xfffffe0127573468, v_mount = 0xfffffe010dc22700, v_nmntvnodes = {tqe_next = 0xfffff80009164500, tqe_prev = 0xfffff80009164ca8}, {v_mountedhere = 0x0, v_unpcb = 0x0, v_rdev = 0x0, v_fifoinfo = 0x0}, v_hashlist = {le_next = 0x0, le_prev = 0xfffffe010c732f08}, v_cache_src = {lh_first = 0xfffff8029f75e680}, v_cache_dst = {tqh_first = 0xfffff800060f6a28, tqh_last = 0xfffff800060f6a38}, v_cache_dd = 0xfffff800060f6a28, v_lock = { lock_object = {lo_name = 0xffffffff8115b7ac "ufs", lo_flags = 0x6fb0000, lo_data = 0x0, lo_witness = 0xfffff8087fd82c80}, lk_lock = 0xfffffe01c4119500, lk_exslpfail = 0x0, lk_timo = 0x33, lk_pri = 0x60, lk_stack = {depth = 0xa, pcs = {0xffffffff80bce58e, 0xffffffff80ecf15d, 0xffffffff8112e220, 0xffffffff80d00d84, 0xffffffff80cdadad, 0xffffffff80cda30c, 0xffffffff80cf8a4c, 0xffffffff80cf8dc4, 0xffffffff81069057, 0xffffffff8103c2be, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0}}}, v_interlock = {lock_object = { lo_name = 0xffffffff81298d9d "vnode interlock", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xfffff8087fd75580}, mtx_lock = 0x0}, v_vnlock = 0xfffff80009164a70, v_vnodelist = {tqe_next = 0xfffff80009164c80, tqe_prev = 0xfffff80009164660}, v_lazylist = { tqe_next = 0xfffff800060b3500, tqe_prev = 0xfffffe010dc23150}, v_bufobj = {bo_lock = {lock_object = {lo_name = 0xffffffff81254cec "bufobj interlock", lo_flags = 0x5230000, lo_data = 0x0, lo_witness = 0xfffff8087fd7fe00}, rw_lock = 0x1}, bo_ops = 0xffffffff81923710 , bo_object = 0xfffff8000610f108, bo_synclist = {le_next = 0xfffff8068c7b5400, le_prev = 0xfffff80009064e98}, bo_private = 0xfffff80009164a00, bo_clean = {bv_hd = {tqh_first = 0x0, tqh_last = 0xfffff80009164bc8}, bv_root = { pt_root = 0x0}, bv_cnt = 0x0}, bo_dirty = {bv_hd = {tqh_first = 0xfffffe0037871588, tqh_last = 0xfffffe00378715e8}, bv_root = {pt_root = 0xfffffe00378716f1}, bv_cnt = 0x1}, bo_numoutput = 0x0, bo_flag = 0x1, bo_domain = 0x6, bo_bsize = 0x8000}, v_pollinfo = 0x0, v_label = 0x0, v_lockf = 0x0, v_rl = {rl_waiters = {tqh_first = 0x0, tqh_last = 0xfffff80009164c30}, rl_currdep = 0x0}, v_cstart = 0x0, v_lasta = 0x0, v_lastw = 0x0, v_clen = 0x0, v_holdcnt = 0x5, v_usecount = 0xc, v_iflag = 0x0, v_vflag = 0x0, v_mflag = 0x1, v_dbatchcpu = 0xffff, v_writecount = 0x0, v_seqc_users = 0x0, v_hash = 0x759002} (kgdb) diff --git a/sys/kern/vfs_cache.c b/sys/kern/vfs_cache.c index ff8aad14001..92aa49a058d 100644 --- a/sys/kern/vfs_cache.c +++ b/sys/kern/vfs_cache.c @@ -479,6 +479,7 @@ STATNODE_COUNTER(fullpathfail2, numfullpathfail2, STATNODE_COUNTER(fullpathfail4, numfullpathfail4, "Number of fullpath search errors (ENOMEM)"); STATNODE_COUNTER(fullpathfound, numfullpathfound, "Number of successful fullpath calls"); STATNODE_COUNTER(symlinktoobig, symlinktoobig, "Number of times symlink did not fit the cache"); +STATNODE_COUNTER(invraces, numinvraces, ""); /* * Debug or developer statistics. @@ -2434,12 +2435,6 @@ cache_enter_time(struct vnode *dvp, struct vnode *vp, struct componentname *cnp, ncp->nc_name); } - /* - * Insert the new namecache entry into the appropriate chain - * within the cache entries table. - */ - CK_SLIST_INSERT_HEAD(ncpp, ncp, nc_hash); - atomic_thread_fence_rel(); /* * Mark the entry as fully constructed. @@ -2447,6 +2442,14 @@ cache_enter_time(struct vnode *dvp, struct vnode *vp, struct componentname *cnp, */ atomic_store_char(&ncp->nc_flag, ncp->nc_flag & ~NCF_WIP); + /* + * Insert the new namecache entry into the appropriate chain + * within the cache entries table. + * + * cache_fplookup_next depends on the entry marked as valid by that time. + */ + CK_SLIST_INSERT_HEAD(ncpp, ncp, nc_hash); + cache_enter_unlock(&cel); if (ndd != NULL) cache_free(ndd); @@ -3714,6 +3717,7 @@ static bool cache_fplookup_is_mp(struct cache_fpl *fpl); static int cache_fplookup_cross_mount(struct cache_fpl *fpl); static int cache_fplookup_partial_setup(struct cache_fpl *fpl); static int cache_fplookup_skip_slashes(struct cache_fpl *fpl); +static int cache_fplookup_trailingslash(struct cache_fpl *fpl); static int cache_fplookup_preparse(struct cache_fpl *fpl); static void cache_fpl_pathlen_dec(struct cache_fpl *fpl); static void cache_fpl_pathlen_inc(struct cache_fpl *fpl); @@ -3971,6 +3975,13 @@ cache_fpl_islastcn(struct nameidata *ndp) return (*ndp->ni_next == 0); } +static bool +cache_fpl_istrailingslash(struct cache_fpl *fpl) +{ + + return (*(fpl->nulchar - 1) == '/'); +} + static bool cache_fpl_isdotdot(struct componentname *cnp) { @@ -4201,6 +4212,15 @@ cache_fplookup_final_modifying(struct cache_fpl *fpl) if (cnp->cn_nameiop == DELETE || cnp->cn_nameiop == RENAME) docache = false; + /* + * Regular lookup nulifies the slash, which we don't do here. + * Don't take chances with filesystem routines seeing it for + * the last entry. + */ + if (cache_fpl_istrailingslash(fpl)) { + return (cache_fpl_partial(fpl)); + } + mp = atomic_load_ptr(&dvp->v_mount); if (__predict_false(mp == NULL)) { return (cache_fpl_aborted(fpl)); @@ -4307,11 +4327,22 @@ cache_fplookup_final_modifying(struct cache_fpl *fpl) } /* - * Check if the target is either a symlink or a mount point. - * Since we expect this to be the terminal vnode it should - * almost never be true. + * If they want the symlink itself we are fine, but if they want to + * follow it regular lookup has to be engaged. + */ + if (tvp->v_type == VLNK) { + if ((cnp->cn_flags & FOLLOW) != 0) { + vput(dvp); + vput(tvp); + return (cache_fpl_aborted(fpl)); + } + } + + /* + * Since we expect this to be the terminal vnode it should almost never + * be a mount point. */ - if (__predict_false(tvp->v_type == VLNK || cache_fplookup_is_mp(fpl))) { + if (__predict_false(cache_fplookup_is_mp(fpl))) { vput(dvp); vput(tvp); return (cache_fpl_aborted(fpl)); @@ -4522,7 +4553,6 @@ cache_fplookup_noentry(struct cache_fpl *fpl) dvp = fpl->dvp; dvp_seqc = fpl->dvp_seqc; - MPASS(*(cnp->cn_nameptr) != '/'); MPASS((cnp->cn_flags & MAKEENTRY) == 0); MPASS((cnp->cn_flags & ISDOTDOT) == 0); MPASS(!cache_fpl_isdotdot(cnp)); @@ -4535,6 +4565,14 @@ cache_fplookup_noentry(struct cache_fpl *fpl) return (cache_fpl_handled_error(fpl, ENAMETOOLONG)); } + if (cnp->cn_nameptr[0] == '/') { + return (cache_fplookup_skip_slashes(fpl)); + } + + if (cnp->cn_nameptr[0] == '\0') { + return (cache_fplookup_trailingslash(fpl)); + } + if (cnp->cn_nameiop != LOOKUP) { fpl->tvp = NULL; return (cache_fplookup_modifying(fpl)); @@ -4551,6 +4589,15 @@ cache_fplookup_noentry(struct cache_fpl *fpl) return (cache_fpl_partial(fpl)); } + /* + * Regular lookup nulifies the slash, which we don't do here. + * Don't take chances with filesystem routines seeing it for + * the last entry. + */ + if (cache_fpl_istrailingslash(fpl)) { + return (cache_fpl_partial(fpl)); + } + /* * Secure access to dvp; check cache_fplookup_partial_setup for * reasoning. @@ -4614,7 +4661,15 @@ cache_fplookup_noentry(struct cache_fpl *fpl) return (cache_fpl_handled(fpl)); } - if (__predict_false(tvp->v_type == VLNK || cache_fplookup_is_mp(fpl))) { + if (tvp->v_type == VLNK) { + if ((cnp->cn_flags & FOLLOW) != 0) { + vput(dvp); + vput(tvp); + return (cache_fpl_aborted(fpl)); + } + } + + if (__predict_false(cache_fplookup_is_mp(fpl))) { vput(dvp); vput(tvp); return (cache_fpl_aborted(fpl)); @@ -4773,6 +4828,7 @@ cache_symlink_resolve(struct cache_fpl *fpl, const char *string, size_t len) { struct nameidata *ndp; struct componentname *cnp; + size_t adjust; ndp = fpl->ndp; cnp = fpl->cnp; @@ -4781,6 +4837,12 @@ cache_symlink_resolve(struct cache_fpl *fpl, const char *string, size_t len) return (ENOENT); } + if (__predict_false(len > MAXPATHLEN - 2)) { + if (cache_fpl_istrailingslash(fpl)) { + return (EAGAIN); + } + } + ndp->ni_pathlen = fpl->nulchar - cnp->cn_nameptr - cnp->cn_namelen + 1; #ifdef INVARIANTS if (ndp->ni_pathlen != fpl->debug.ni_pathlen) { @@ -4798,15 +4860,22 @@ cache_symlink_resolve(struct cache_fpl *fpl, const char *string, size_t len) return (ELOOP); } + adjust = len; if (ndp->ni_pathlen > 1) { bcopy(ndp->ni_next, cnp->cn_pnbuf + len, ndp->ni_pathlen); } else { - cnp->cn_pnbuf[len] = '\0'; + if (cache_fpl_istrailingslash(fpl)) { + adjust = len + 1; + cnp->cn_pnbuf[len] = '/'; + cnp->cn_pnbuf[len + 1] = '\0'; + } else { + cnp->cn_pnbuf[len] = '\0'; + } } bcopy(string, cnp->cn_pnbuf, len); - ndp->ni_pathlen += len; - cache_fpl_pathlen_add(fpl, len); + ndp->ni_pathlen += adjust; + cache_fpl_pathlen_add(fpl, adjust); cnp->cn_nameptr = cnp->cn_pnbuf; fpl->nulchar = &cnp->cn_nameptr[ndp->ni_pathlen - 1]; @@ -4906,9 +4975,6 @@ cache_fplookup_next(struct cache_fpl *fpl) } if (__predict_false(ncp == NULL)) { - if (cnp->cn_nameptr[0] == '/') { - return (cache_fplookup_skip_slashes(fpl)); - } return (cache_fplookup_noentry(fpl)); } @@ -4918,10 +4984,24 @@ cache_fplookup_next(struct cache_fpl *fpl) return (cache_fplookup_neg(fpl, ncp, hash)); } +#ifdef INVARIANTS + /* + * TODO: the current API evicts entries during lookup before descending + * into filesystem code. This should be fixed to have filesystems evict + * explicitly instead. In the meantime assert that if an entry is on + * the way to be destroyed, the resulting state will allow us to abort + * the lookup without checking for it (and relying on seqc). Either the + * vnode is locked and on the way to modify seqc or said counters are + * already set. + */ if (!cache_ncp_canuse(ncp)) { - return (cache_fpl_partial(fpl)); + counter_u64_add(numinvraces, 1); + if (!(VOP_ISLOCKED(tvp) || seqc_in_modify(vn_seqc_read_any(dvp)) || + seqc_in_modify(vn_seqc_read_any(tvp)))) { + panic("%s: invalidated entry %p found but vnode state does not match", __func__, ncp); + } } - +#endif fpl->tvp = tvp; fpl->tvp_seqc = vn_seqc_read_any(tvp); if (seqc_in_modify(fpl->tvp_seqc)) { @@ -5175,21 +5255,6 @@ cache_fplookup_preparse(struct cache_fpl *fpl) ("%s: mismatch on string (%p != %p) [%s]\n", __func__, &cnp->cn_nameptr[fpl->debug.ni_pathlen - 2], fpl->nulchar - 1, cnp->cn_pnbuf)); - if (__predict_false(*(fpl->nulchar - 1) == '/')) { - /* - * TODO - * Regular lookup performs the following: - * *ndp->ni_next = '\0'; - * cnp->cn_flags |= TRAILINGSLASH; - * - * Which is problematic since it modifies data read - * from userspace. Then if fast path lookup was to - * abort we would have to either restore it or convey - * the flag. Since this is a corner case just ignore - * it for simplicity. - */ - return (cache_fpl_aborted(fpl)); - } return (0); } @@ -5235,27 +5300,6 @@ cache_fplookup_parse(struct cache_fpl *fpl) * then it could not have been too long to begin with. */ ndp->ni_next = cp; - -#ifdef INVARIANTS - /* - * Code below is only here to assure compatibility with regular lookup. - * It covers handling of trailing slashes and names like "/", both of - * which of can be taken care of upfront which lockless lookup does - * in cache_fplookup_preparse. Regular lookup performs these for each - * path component. - */ - while (*cp == '/' && (cp[1] == '/' || cp[1] == '\0')) { - cp++; - if (*cp == '\0') { - panic("%s: ran into TRAILINGSLASH handling from [%s]\n", - __func__, cnp->cn_pnbuf); - } - } - - if (cnp->cn_nameptr[0] == '\0') { - panic("%s: ran into degenerate name from [%s]\n", __func__, cnp->cn_pnbuf); - } -#endif } static void @@ -5320,6 +5364,139 @@ cache_fplookup_skip_slashes(struct cache_fpl *fpl) return (0); } +/* + * Handle trailing slashes (e.g., "foo/"). + * + * If a trailing slash is found the terminal vnode must be a directory. + * Regular lookup shortens the path by nulifying the first trailing slash and + * sets the TRAILINGSLASH to denote this took place. There are several checks + * on it performed later. + * + * Similarly to spurious slashes, lockless lookup handles this in a speculative + * manner relying on an invariant that a non-directory vnode will get a miss. + * In this case cn_nameptr[0] == '\0' and cn_namelen == 0. + * + * Thus for a path like "foo/bar/" the code unwinds the state back to 'bar/' + * and denotes this is the last path component, which avoids looping back. + * + * Only plain lookups are supported for now to restrict corner cases to handle. + */ +static int __noinline +cache_fplookup_trailingslash(struct cache_fpl *fpl) +{ +#ifdef INVARIANTS + size_t ni_pathlen; +#endif + struct nameidata *ndp; + struct componentname *cnp; + struct namecache *ncp; + struct vnode *tvp; + char *cn_nameptr_orig, *cn_nameptr_slash; + seqc_t tvp_seqc; + u_char nc_flag; + + ndp = fpl->ndp; + cnp = fpl->cnp; + tvp = fpl->tvp; + tvp_seqc = fpl->tvp_seqc; + + MPASS(fpl->dvp == fpl->tvp); + KASSERT(cache_fpl_istrailingslash(fpl), + ("%s: expected trailing slash at %p; string [%s]\n", __func__, fpl->nulchar - 1, + cnp->cn_pnbuf)); + KASSERT(cnp->cn_nameptr[0] == '\0', + ("%s: expected nul char at %p; string [%s]\n", __func__, &cnp->cn_nameptr[0], + cnp->cn_pnbuf)); + KASSERT(cnp->cn_namelen == 0, + ("%s: namelen 0 but got %ld; string [%s]\n", __func__, cnp->cn_namelen, + cnp->cn_pnbuf)); + MPASS(cnp->cn_nameptr > cnp->cn_pnbuf); + + if (cnp->cn_nameiop != LOOKUP) { + return (cache_fpl_aborted(fpl)); + } + + if (__predict_false(tvp->v_type != VDIR)) { + if (!vn_seqc_consistent(tvp, tvp_seqc)) { + return (cache_fpl_aborted(fpl)); + } + cache_fpl_smr_exit(fpl); + return (cache_fpl_handled_error(fpl, ENOTDIR)); + } + + /* + * Denote the last component. + */ + ndp->ni_next = &cnp->cn_nameptr[0]; + MPASS(cache_fpl_islastcn(ndp)); + + /* + * Unwind trailing slashes. + */ + cn_nameptr_orig = cnp->cn_nameptr; + while (cnp->cn_nameptr >= cnp->cn_pnbuf) { + cnp->cn_nameptr--; + if (cnp->cn_nameptr[0] != '/') { + break; + } + } + + /* + * Unwind to the beginning of the path component. + * + * Note the path may or may not have started with a slash. + */ + cn_nameptr_slash = cnp->cn_nameptr; + while (cnp->cn_nameptr > cnp->cn_pnbuf) { + cnp->cn_nameptr--; + if (cnp->cn_nameptr[0] == '/') { + break; + } + } + if (cnp->cn_nameptr[0] == '/') { + cnp->cn_nameptr++; + } + + cnp->cn_namelen = cn_nameptr_slash - cnp->cn_nameptr + 1; + cache_fpl_pathlen_add(fpl, cn_nameptr_orig - cnp->cn_nameptr); + cache_fpl_checkpoint(fpl); + +#ifdef INVARIANTS + ni_pathlen = fpl->nulchar - cnp->cn_nameptr + 1; + if (ni_pathlen != fpl->debug.ni_pathlen) { + panic("%s: mismatch (%zu != %zu) nulchar %p nameptr %p [%s] ; full string [%s]\n", + __func__, ni_pathlen, fpl->debug.ni_pathlen, fpl->nulchar, + cnp->cn_nameptr, cnp->cn_nameptr, cnp->cn_pnbuf); + } +#endif + + /* + * The previous directory is this one. + */ + if (cnp->cn_nameptr[0] == '.' && cnp->cn_namelen == 1) { + return (0); + } + + /* + * The previous directory is something else. + */ + tvp = fpl->tvp; + ncp = atomic_load_consume_ptr(&tvp->v_cache_dd); + if (__predict_false(ncp == NULL)) { + return (cache_fpl_aborted(fpl)); + } + nc_flag = atomic_load_char(&ncp->nc_flag); + if ((nc_flag & NCF_ISDOTDOT) != 0) { + return (cache_fpl_aborted(fpl)); + } + fpl->dvp = ncp->nc_dvp; + fpl->dvp_seqc = vn_seqc_read_any(fpl->dvp); + if (seqc_in_modify(fpl->dvp_seqc)) { + return (cache_fpl_aborted(fpl)); + } + return (0); +} + /* * See the API contract for VOP_FPLOOKUP_VEXEC. */ -- Test scenario: misc/procfs.sh