panic: refcount 0xfffffe014411849c wraparound, vmcore.378 KDB: debugger backends: ddb KDB: current backend: ddb ---<>--- Copyright (c) 1992-2021 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 14.0-CURRENT #2 main-n248167-4d1597691916-dirty: Sat Jul 24 19:02:12 CEST 2021 pho@mercat1.netperf.freebsd.org:/usr/src/sys/amd64/compile/PHO amd64 FreeBSD clang version 12.0.1 (git@github.com:llvm/llvm-project.git llvmorg-12.0.1-0-gfed41342a82f) WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. VT(vga): resolution 640x480 CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.08-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics real memory = 34359738368 (32768 MB) avail memory = 33174138880 (31637 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 12 CPUs FreeBSD/SMP: 1 package(s) x 6 core(s) x 2 hardware threads random: registering fast source Intel Secure Key RNG random: fast provider: "Intel Secure Key RNG" random: unblocking device. ioapic0 irqs 0-23 ioapic1 irqs 24-47 Launching APs: 1 11 8 4 6 2 5 10 3 7 9 Timecounter "TSC-low" frequency 1750037910 Hz quality 1000 random: entropy device external interface kbd1 at kbdmux0 mlx5en: Mellanox Ethernet driver 3.6.0 (December 2020) vtvga0: smbios0: at iomem 0xf0560-0xf057e smbios0: Version: 2.8, BCD Revision: 2.7 aesni0: acpi0: acpi0: Power Button (fixed) cpu0: on acpi0 atrtc0: port 0x70-0x71,0x74-0x77 irq 8 on acpi0 atrtc0: registered as a time-of-day clock, resolution 1.000000s Event timer "RTC" frequency 32768 Hz quality 0 attimer0: port 0x40-0x43,0x50-0x53 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Event timer "HPET" frequency 14318180 Hz quality 350 Event timer "HPET1" frequency 14318180 Hz quality 340 Event timer "HPET2" frequency 14318180 Hz quality 340 Event timer "HPET3" frequency 14318180 Hz quality 340 Event timer "HPET4" frequency 14318180 Hz quality 340 Event timer "HPET5" frequency 14318180 Hz quality 340 Event timer "HPET6" frequency 14318180 Hz quality 340 Event timer "HPET7" frequency 14318180 Hz quality 340 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 pcib0: on acpi0 pci0: on pcib0 pci0: at device 11.1 (no driver attached) pci0: at device 11.2 (no driver attached) pci0: at device 16.1 (no driver attached) pci0: at device 16.6 (no driver attached) pci0: at device 18.1 (no driver attached) acpi_syscontainer0: on acpi0 acpi_syscontainer1: on acpi0 acpi_syscontainer2: on acpi0 acpi_syscontainer3: on acpi0 apei0: on acpi0 pcib1: port 0xcf8-0xcff on acpi0 pci1: on pcib1 pcib2: irq 26 at device 1.0 on pci1 pci2: on pcib2 pcib3: irq 32 at device 2.0 on pci1 pci3: on pcib3 pci3: at device 0.0 (no driver attached) pci3: at device 0.1 (no driver attached) pcib4: irq 40 at device 3.0 on pci1 pci4: on pcib4 pci1: at device 17.0 (no driver attached) ahci0: port 0xf110-0xf117,0xf100-0xf103,0xf0f0-0xf0f7,0xf0e0-0xf0e3,0xf020-0xf03f mem 0xfb438000-0xfb4387ff irq 16 at device 17.4 on pci1 ahci0: AHCI v1.30 with 4 6Gbps ports, Port Multiplier not supported ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahcich2: at channel 2 on ahci0 ahcich3: at channel 3 on ahci0 ahciem0: on ahci0 xhci0: mem 0xfb400000-0xfb40ffff irq 19 at device 20.0 on pci1 xhci0: 32 bytes context size, 64-bit DMA usbus0 on xhci0 usbus0: 5.0Gbps Super Speed USB v3.0 pci1: at device 22.0 (no driver attached) pci1: at device 22.1 (no driver attached) ehci0: mem 0xfb434000-0xfb4343ff irq 18 at device 26.0 on pci1 usbus1: EHCI version 1.0 usbus1 on ehci0 usbus1: 480Mbps High Speed USB v2.0 pcib5: irq 16 at device 28.0 on pci1 pci5: on pcib5 pcib6: irq 18 at device 28.2 on pci1 pci6: on pcib6 pcib7: at device 0.0 on pci6 pci7: on pcib7 vgapci0: port 0xe000-0xe07f mem 0xfa000000-0xfaffffff,0xfb000000-0xfb01ffff irq 18 at device 0.0 on pci7 vgapci0: Boot video device pcib8: irq 16 at device 28.4 on pci1 pci8: on pcib8 igb0: port 0xd020-0xd03f mem 0xfb320000-0xfb33ffff,0xfb344000-0xfb347fff irq 16 at device 0.0 on pci8 igb0: Using 1024 TX descriptors and 1024 RX descriptors igb0: queue equality override not set, capping rx_queues at 6 and tx_queues at 6 igb0: Using 6 RX queues 6 TX queues igb0: Using MSI-X interrupts Setting hostuuid: 00000000-0000-0000-0000-002590uhub3: 4 ports with 3 removable, self powered c99976. Setting hostid: 0x90b83241. uhub4: 6 ports with 6 removable, self powered Starting file system checks: uhub5: 8 ports with 8 removable, self powered WARNING: / was not properly dismounted Mounting local filesystems:WARNING: /tmp wa. ugen0.3: at usbus0 ukbd0 on uhub3 ukbd0: on usbus0 kbd2 at ukbd0 fscklock order reversal: 1st 0xfffffe010e3fea38 ufs (ufs, lockmgr) @ kern/vfs_mount.c:2052 2nd 0xfffffe010e5b4588 devfs (devfs, lockmgr) @ kern/vfs_subr.c:3251 lock order devfs -> ufs established at: #0 0xffffffff80c921b9 at witness_checkorder+0x459 #1 0xffffffff80bf2178 at lockmgr_lock_flags+0x178 #2 0xffffffff80f4e33d at ffs_lock+0x9d #3 0xffffffff811b413c at VOP_LOCK1_APV+0x3c #4 0xffffffff80d28414 at _vn_lock+0x54 #5 0xffffffff80d05cbb at vfs_domount+0xf5b #6 0xffffffff80d03860 at vfs_donmount+0x880 #7 0xffffffff80d08c67 at kernel_mount+0x57 #8 0xffffffff80d0b831 at parse_mount+0x4b1 #9 0xffffffff80d09f13 at vfs_mountroot+0x7b3 #10 0xffffffff80bae96f at start_init+0x1f #11 0xffffffff80bdbba0 at fork_exit+0x80 #12 0xffffffff810bb52e at fork_trampoline+0xe lock order ufs -> devfs attempted at: #0 0xffffffff80c92aef at witness_checkorder+0xd8f #1 0xffffffff80bf2178 at lockmgr_lock_flags+0x178 #2 0xffffffff811b413c at VOP_LOCK1_APV+0x3c #3 0xffffffff80d28414 at _vn_lock+0x54 #4 0xffffffff80d10832 at vput_final+0x172 #5 0xffffffff80f4bf9d at ffs_unmount+0x38d #6 0xffffffff80d07152 at dounmount+0x812 #7 0xffffffff80d068cd at kern_unmount+0x2fd #8 0xffffffff810ea9c7 at amd64_syscall+0x147 #9 0xffffffff810badce at fast_syscall_common+0xf8 ** /dev/gpt/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 132 files, 265 used, 1265142 free (78 frags, 158133 blocks, 0.0% fragmentation) ***** FILE SYSTEM MARKED CLEAN ***** Updating CPU Microcode... CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.08-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab Structured Extended Features3=0x9c000400 XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics Done. ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat/pkg /usr/local/lib/compat /usr/local/lib/compat/pkg /usr/local/lib/e2fsprogs /usr/local/lib/gcc10 /usr/local/lib/gcc8 /usr/local/lib/gcc9 /usr/local/lib/perl5/5.32/mach/CORE 32-bit compatibility ldconfig path: /usr/lib32 /usr/local/lib32/compat Setting hostname: mercat1.netperf.freebsd.org. Setting up harvesting: PURE_RDRAND,[UMA],[FS_ATIME],SWI,INTERRUPT,NET_NG,[NET_ETHER],NET_TUN,MOUSE,KEYBOARD,ATTACH,CACHED Feeding entropy: . Autoloading module: acpi_wmi.ko Autoloading module: ichsmb.ko Autoloading module: ioat.ko ioat0: mem 0xfb42c000-0xfb42ffff irq 31 at device 4.0 on pci1 ioat0: Capabilities: 2f7 ioat1: mem 0xfb428000-0xfb42bfff irq 39 at device 4.1 on pci1 ioat1: Capabilities: 2f7 ioat2: mem 0xfb424000-0xfb427fff irq 31 at device 4.2 on pci1 ioat2: Capabilities: f7 ioat3: mem 0xfb420000-0xfb423fff irq 39 at device 4.3 on pci1 ioat3: Capabilities: f7 ioat4: mem 0xfb41c000-0xfb41ffff irq 31 at device 4.4 on pci1 ioat4: Capabilities: f7 ioat5: mem 0xfb418000-0xfb41bfff irq 39 at device 4.5 on pci1 ioat5: Capabilities: f7 ioat6: mem 0xfb414000-0xfb417fff irq 31 at device 4.6 on pci1 ioat6: Capabilities: f7 ioat7: mem 0xfb410000-0xfb413fff irq 39 at device 4.7 on pci1 ioat7: Capabilities: f7 ichsmb0: port 0x580-0x59f mem 0xfb431000-0xfb4310ff irq 18 at device 31.3 on pci1 smbus0: on ichsmb0 acpi_wmi0: on acpi0 acpi_wmi0: cannot find EC device lo0: link state changed to UP Starting Network: lo0 igb0 igb1 mce0 mce1. lo0: flags=8049 metric 0 mtu 16384 options=680003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x3 inet 127.0.0.1 netmask 0xff000000 groups: lo nd6 options=21 igb0: flags=8863 metric 0 mtu 1500 options=4e507bb ether 0c:c4:7a:a8:cd:da inet6 fe80::ec4:7aff:fea8:cdda%igb0 prefixlen 64 scopeid 0x1 media: Ethernet autoselect status: no carrier nd6 options=21 igb1: flags=8822 metric 0 mtu 1500 options=4e507bb ether 0c:c4:7a:a8:cd:db media: Ethernet autoselect status: no carrier nd6 options=29 metric 0 mtu 1500 options=7eed07bb ether 7c:fe:90:30:ee:38 media: Ethernet autoselect status: no carrier nd6 options=29 mce1: flags=8822 metric 0 mtu 1500 options=7eed07bb ether 7c:fe:90:30:ee:39 media: Ethernet autoselect status: no carrier nd6 options=29 Starting devd. igb0: link state changed to UP Autoloading module: acpi_wmi.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Starting Network: igb1. igb1: flags=8822 metric 0 mtu 1500 options=4e507bb ether 0c:c4:7a:a8:cd:db media: Ethernet autoselect status: no carrier nd6 options=29 Autoloading module: ichsmb.ko Starting Network: mce0. mce0: flags=8822 metric 0 mtu 1500 options=7eed07bb ether 7c:fe:90:30:ee:38 media: Ethernet autoselect status: no carrier nd6 options=29 Starting Network: mce1. mce1: flags=8822 metric 0 mtu 1500 options=7eed07bb ether 7c:fe:90:30:ee:39 media: Ethernet autoselect status: no carrier nd6 options=29 Autoloading module: uhid.ko Autoloading module: ums.ko Autoloading module: usbhid.ko ums0 on uhub3 ums0: on usbus0 ums0: 3 buttons and [Z] coordinates ID=0 Starting dhclient. DHCPREQUEST on igb0 to 255.255.255.255 port 67 DHCPACK from 192if_delmulti_locked: detaching ifnet instance 0xfffff800044ef800 .168.5.1 bound to 192.168.5.171 -- renewal in 300 seconds. add host 127.0.0.1: gateway lo0 fib 0: route already in table add host ::1: gateway lo0 fib 0: route already in table add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Creating and/or trimming log files. Recovering vi editor sessions:. Updating motd:. Clearing /tmp (X related). Starting syslogd. Starting watchdogd. No core dumps found. Setting date via ntp. 24 Jul 19:18:57 ntpdate[2615]: step time server 192.168.5.1 offset -0.933600 sec Starting rpcbind. NFS access cache time=60 Starting statd. Starting lockd. Starting powerd. Security policy loaded: MAC/ntpd (mac_ntpd) Starting ntpd. Mounting late filesystems:. Starting inetd. Configuring vt: blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting cron. sysctl: unknown oid 'debug.fail_point.pmap_allocpte_page_alloc' at line 12 Sat Jul 24 19:18 FreeBSD/amd64 (mercat1.netperf.freebsd.org) (ttyu1) login: Jul 24 19:20:28 mercat1 sshd[2761]: error: PAM: Authentication error for pho from 192.168.5.1 Jul 24 19:20:31 mercat1 su[2772]: pho to root on /dev/pts/0 20210724 19:22:58 all (1/1): f4.sh panic: refcount 0xfffffe014411849c wraparound cpuid = 6 time = 1627147380 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe01416c1410 vpanic() at vpanic+0x187/frame 0xfffffe01416c1470 panic() at panic+0x43/frame 0xfffffe01416c14d0 _refcount_update_saturated() at _refcount_update_saturated+0x15/frame 0xfffffe01416c14e0 vput() at vput+0x7f/frame 0xfffffe01416c1510 ffs_vput_pair() at ffs_vput_pair+0x6b/frame 0xfffffe01416c15a0 ufs_rename() at ufs_rename+0xcc2/frame 0xfffffe01416c17a0 VOP_RENAME_APV() at VOP_RENAME_APV+0x3c/frame 0xfffffe01416c17c0 null_rename() at null_rename+0x194/frame 0xfffffe01416c1850 VOP_RENAME_APV() at VOP_RENAME_APV+0x3c/frame 0xfffffe01416c1870 kern_renameat() at kern_renameat+0x3dd/frame 0xfffffe01416c1ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01416c1bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01416c1bf0 --- syscall (128, FreeBSD ELF64, sys_rename), rip = 0x8011a68da, rsp = 0x7fffffffe318, rbp = 0x7fffffffe460 --- KDB: enter: panic [ thread pid 4111 tid 100270 ] Stopped at kdb_enter+0x37: movq $0,0x1279b5e(%rip) db> run pho db:0:pho> set $lines 20000 db:0:pho> run pho1 db:1:pho1> dump Dumping 1431 out of 32624 MB:..2%..11%..21%..31%..41%..51%..61%..71%..81%..91% Dump complete db:1:pho1> bt Tracing pid 4111 tid 100270 td 0xfffffe010e5a0e40 kdb_enter() at kdb_enter+0x37/frame 0xfffffe01416c1410 vpanic() at vpanic+0x1b8/frame 0xfffffe01416c1470 panic() at panic+0x43/frame 0xfffffe01416c14d0 _refcount_update_saturated() at _refcount_update_saturated+0x15/frame 0xfffffe01416c14e0 vput() at vput+0x7f/frame 0xfffffe01416c1510 ffs_vput_pair() at ffs_vput_pair+0x6b/frame 0xfffffe01416c15a0 ufs_rename() at ufs_rename+0xcc2/frame 0xfffffe01416c17a0 VOP_RENAME_APV() at VOP_RENAME_APV+0x3c/frame 0xfffffe01416c17c0 null_rename() at null_rename+0x194/frame 0xfffffe01416c1850 VOP_RENAME_APV() at VOP_RENAME_APV+0x3c/frame 0xfffffe01416c1870 kern_renameat() at kern_renameat+0x3dd/frame 0xfffffe01416c1ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01416c1bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01416c1bf0 --- syscall (128, FreeBSD ELF64, sys_rename), rip = 0x8011a68da, rsp = 0x7fffffffe318, rbp = 0x7fffffffe460 --- db:1:pho1> show allpcpu Current CPU: 6 cpuid = 0 dynamic pcpu = 0x9b4bc0 curthread = 0xfffffe00e4c5b3a0: pid 11 tid 100003 critnest 1 "idle: cpu0" curpcb = 0xfffffe00e4c5b8b0 fpcurthread = none idlethread = 0xfffffe00e4c5b3a0: tid 100003 "idle: cpu0" self = 0xffffffff82610000 curpmap = 0xffffffff81e9cc50 tssp = 0xffffffff82610384 rsp0 = 0xfffffe0037790cc0 kcr3 = 0x8000000002555001 ucr3 = 0xffffffffffffffff scr3 = 0x2c9e78f1 gs32p = 0xffffffff82610404 ldt = 0xffffffff82610444 tss = 0xffffffff82610434 curvnet = 0 spin locks held: cpuid = 1 dynamic pcpu = 0xfffffe00bb288bc0 curthread = 0xfffffe01441e3020: pid 4133 tid 100361 critnest 0 "swap" curpcb = 0xfffffe01441e3530 fpcurthread = 0xfffffe01441e3020: pid 4133 "swap" idlethread = 0xfffffe00e4c5ac80: tid 100004 "idle: cpu1" self = 0xffffffff82611000 curpmap = 0xfffffe0144210b10 tssp = 0xffffffff82611384 rsp0 = 0xfffffe01444eecc0 kcr3 = 0x800000002ccc717f ucr3 = 0x80000002b449697f scr3 = 0x2b449697f gs32p = 0xffffffff82611404 ldt = 0xffffffff82611444 tss = 0xffffffff82611434 curvnet = 0 spin locks held: cpuid = 2 dynamic pcpu = 0xfffffe00bb295bc0 curthread = 0xfffffe00e4c5a560: pid 11 tid 100005 critnest 1 "idle: cpu2" curpcb = 0xfffffe00e4c5aa70 fpcurthread = none idlethread = 0xfffffe00e4c5a560: tid 100005 "idle: cpu2" self = 0xffffffff82612000 curpmap = 0xffffffff81e9cc50 tssp = 0xffffffff82612384 rsp0 = 0xfffffe003779acc0 kcr3 = 0x8000000002555001 ucr3 = 0xffffffffffffffff scr3 = 0x1587dea0e gs32p = 0xffffffff82612404 ldt = 0xffffffff82612444 tss = 0xffffffff82612434 curvnet = 0 spin locks held: cpuid = 3 dynamic pcpu = 0xfffffe00bb2a2bc0 curthread = 0xfffffe00e4c59e40: pid 11 tid 100006 critnest 1 "idle: cpu3" curpcb = 0xfffffe00e4c5a350 fpcurthread = none idlethread = 0xfffffe00e4c59e40: tid 100006 "idle: cpu3" self = 0xffffffff82613000 curpmap = 0xffffffff81e9cc50 tssp = 0xffffffff82613384 rsp0 = 0xfffffe0037795cc0 kcr3 = 0x8000000002555001 ucr3 = 0xffffffffffffffff scr3 = 0x158dc39f8 gs32p = 0xffffffff82613404 ldt = 0xffffffff82613444 tss = 0xffffffff82613434 curvnet = 0 spin locks held: cpuid = 4 dynamic pcpu = 0xfffffe00bb2afbc0 curthread = 0xfffffe00e4c59720: pid 11 tid 100007 critnest 1 "idle: cpu4" curpcb = 0xfffffe00e4c59c30 fpcurthread = none idlethread = 0xfffffe00e4c59720: tid 100007 "idle: cpu4" self = 0xffffffff82614000 curpmap = 0xffffffff81e9cc50 tssp = 0xffffffff82614384 rsp0 = 0xfffffe00377a4cc0 kcr3 = 0x8000000002555001 ucr3 = 0xffffffffffffffff scr3 = 0x2cae79bf gs32p = 0xffffffff82614404 ldt = 0xffffffff82614444 tss = 0xffffffff82614434 curvnet = 0 spin locks held: cpuid = 5 dynamic pcpu = 0xfffffe00bb2bcbc0 curthread = 0xfffffe00e4c59000: pid 11 tid 100008 critnest 1 "idle: cpu5" curpcb = 0xfffffe00e4c59510 fpcurthread = none idlethread = 0xfffffe00e4c59000: tid 100008 "idle: cpu5" self = 0xffffffff82615000 curpmap = 0xffffffff81e9cc50 tssp = 0xffffffff82615384 rsp0 = 0xfffffe003779fcc0 kcr3 = 0x8000000002555001 ucr3 = 0xffffffffffffffff scr3 = 0x1586429d2 gs32p = 0xffffffff82615404 ldt = 0xffffffff82615444 tss = 0xffffffff82615434 curvnet = 0 spin locks held: cpuid = 6 dynamic pcpu = 0xfffffe00bb2c9bc0 curthread = 0xfffffe010e5a0e40: pid 4111 tid 100270 critnest 1 "rename" curpcb = 0xfffffe010e5a1350 fpcurthread = 0xfffffe010e5a0e40: pid 4111 "rename" idlethread = 0xfffffe00e4c5d740: tid 100009 "idle: cpu6" self = 0xffffffff82616000 curpmap = 0xfffffe010e5a5120 tssp = 0xffffffff82616384 rsp0 = 0xfffffe01416c1cc0 kcr3 = 0x800000005c3eb243 ucr3 = 0x80000001580ffa43 scr3 = 0x1580ffa43 gs32p = 0xffffffff82616404 ldt = 0xffffffff82616444 tss = 0xffffffff82616434 curvnet = 0 spin locks held: cpuid = 7 dynamic pcpu = 0xfffffe00bb2d6bc0 curthread = 0xfffffe00e4c5d020: pid 11 tid 100010 critnest 1 "idle: cpu7" curpcb = 0xfffffe00e4c5d530 fpcurthread = none idlethread = 0xfffffe00e4c5d020: tid 100010 "idle: cpu7" self = 0xffffffff82617000 curpmap = 0xffffffff81e9cc50 tssp = 0xffffffff82617384 rsp0 = 0xfffffe00377a9cc0 kcr3 = 0x8000000002555001 ucr3 = 0xffffffffffffffff scr3 = 0x2b45fc9b1 gs32p = 0xffffffff82617404 ldt = 0xffffffff82617444 tss = 0xffffffff82617434 curvnet = 0 spin locks held: cpuid = 8 dynamic pcpu = 0xfffffe00bb2e3bc0 curthread = 0xfffffe00e4c5c900: pid 11 tid 100011 critnest 1 "idle: cpu8" curpcb = 0xfffffe00e4c5ce10 fpcurthread = none idlethread = 0xfffffe00e4c5c900: tid 100011 "idle: cpu8" self = 0xffffffff82618000 curpmap = 0xffffffff81e9cc50 tssp = 0xffffffff82618384 rsp0 = 0xfffffe00377b8cc0 kcr3 = 0x8000000002555001 ucr3 = 0xffffffffffffffff scr3 = 0x158b929ec gs32p = 0xffffffff82618404 ldt = 0xffffffff82618444 tss = 0xffffffff82618434 curvnet = 0 spin locks held: cpuid = 9 dynamic pcpu = 0xfffffe00bb2f0bc0 curthread = 0xfffffe00e4c611e0: pid 11 tid 100012 critnest 1 "idle: cpu9" curpcb = 0xfffffe00e4c616f0 fpcurthread = none idlethread = 0xfffffe00e4c611e0: tid 100012 "idle: cpu9" self = 0xffffffff82619000 curpmap = 0xffffffff81e9cc50 tssp = 0xffffffff82619384 rsp0 = 0xfffffe00377b3cc0 kcr3 = 0x8000000002555001 ucr3 = 0xffffffffffffffff scr3 = 0x2b41b6a0c gs32p = 0xffffffff82619404 ldt = 0xffffffff82619444 tss = 0xffffffff82619434 curvnet = 0 spin locks held: cpuid = 10 dynamic pcpu = 0xfffffe00bb2fdbc0 curthread = 0xfffffe00e4c60ac0: pid 11 tid 100013 critnest 1 "idle: cpu10" curpcb = 0xfffffe00e4c60fd0 fpcurthread = none idlethread = 0xfffffe00e4c60ac0: tid 100013 "idle: cpu10" self = 0xffffffff8261a000 curpmap = 0xffffffff81e9cc50 tssp = 0xffffffff8261a384 rsp0 = 0xfffffe00377c2cc0 kcr3 = 0x8000000002555001 ucr3 = 0xffffffffffffffff scr3 = 0x15869a9e9 gs32p = 0xffffffff8261a404 ldt = 0xffffffff8261a444 tss = 0xffffffff8261a434 curvnet = 0 spin locks held: cpuid = 11 dynamic pcpu = 0xfffffe00bb30abc0 curthread = 0xfffffe00e4c603a0: pid 11 tid 100014 critnest 1 "idle: cpu11" curpcb = 0xfffffe00e4c608b0 fpcurthread = none idlethread = 0xfffffe00e4c603a0: tid 100014 "idle: cpu11" self = 0xffffffff8261b000 curpmap = 0xffffffff81e9cc50 tssp = 0xffffffff8261b384 rsp0 = 0xfffffe00377bdcc0 kcr3 = 0x8000000002555001 ucr3 = 0xffffffffffffffff scr3 = 0x158a7ea1a gs32p = 0xffffffff8261b404 ldt = 0xffffffff8261b444 tss = 0xffffffff8261b434 curvnet = 0 spin locks held: db:1:pho1> show alllocks Process 4111 (rename) thread 0xfffffe010e5a0e40 (100270) exclusive lockmgr ufs (ufs) r = 0 (0xfffffe01441182c8) locked @ ufs/ufs/ufs_vnops.c:1292 db:1:pho1> show lockedvnods Locked vnodes vnode 0xfffffe0144118258: type VDIR usecount -1, writecount 0, refcount 5 seqc users 0 mountedhere 0 hold count flags () flags (VMP_LAZYLIST) v_object 0xfffff800211f5420 ref 0 pages 0 cleanbuf 0 dirtybuf 1 lock type ufs: EXCL by thread 0xfffffe010e5a0e40 (pid 4111, rename, tid 100270) #0 0xffffffff80bf21e7 at lockmgr_lock_flags+0x1e7 #1 0xffffffff80f4e33d at ffs_lock+0x9d #2 0xffffffff811b413c at VOP_LOCK1_APV+0x3c #3 0xffffffff80d28414 at _vn_lock+0x54 #4 0xffffffff80f6102a at ufs_rename+0x10a #5 0xffffffff811b326c at VOP_RENAME_APV+0x3c #6 0xffffffff8274b9d4 at null_rename+0x194 #7 0xffffffff811b326c at VOP_RENAME_APV+0x3c #8 0xffffffff80d2413d at kern_renameat+0x3dd #9 0xffffffff810ea9c7 at amd64_syscall+0x147 #10 0xffffffff810badce at fast_syscall_common+0xf8 nlink=10, effnlink=10, size=25088, extsize 0 generation=17a6ec72, uid=2007, gid=0, flags=0x0 ino 32896, on dev md10 vnode 0xfffffe0144118000: type VDIR usecount 9, writecount 0, refcount 2 seqc users 0 mountedhere 0 hold count flags () flags () lock type ufs: EXCL by thread 0xfffffe010e5a0e40 (pid 4111, rename, tid 100270) #0 0xffffffff80bf21e7 at lockmgr_lock_flags+0x1e7 #1 0xffffffff80f4e33d at ffs_lock+0x9d #2 0xffffffff811b413c at VOP_LOCK1_APV+0x3c #3 0xffffffff80d28414 at _vn_lock+0x54 #4 0xffffffff80f6102a at ufs_rename+0x10a #5 0xffffffff811b326c at VOP_RENAME_APV+0x3c #6 0xffffffff8274b9d4 at null_rename+0x194 #7 0xffffffff811b326c at VOP_RENAME_APV+0x3c #8 0xffffffff80d2413d at kern_renameat+0x3dd #9 0xffffffff810ea9c7 at amd64_syscall+0x147 #10 0xffffffff810badce at fast_syscall_common+0xf8 vp=0xfffffe0144118000, lowervp=0xfffffe0144118258 db:1:pho1> show mount 0xfffffe010e152700 /dev/gpt/work on / (ufs) 0xfffffe010e153280 devfs on /dev (devfs) 0xfffffe010e5d4280 /dev/gpt/tmp on /tmp (ufs) 0xfffffe0144154280 /dev/md10 on /mnt (ufs) 0xfffffe010e5d3700 /mnt on /mnt2 (nullfs) More info: show mount db:1:pho1> show bufqueues bqempty: 103339 Buf domain 0 freebufs 14585 lofreebufs 219 hifreebufs 329 bufspace 11796480 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 144 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 268 (6557696) dirtyq count 144 (1282048) wakeup 0 lim 25 CPU 0, 6, 5, 15, 12, 12, 18, 18, 21, 9, 5, 15, Locked buffers: 0 space 0 Total buffers: 548 space 11796480 Buf domain 1 freebufs 14837 lofreebufs 219 hifreebufs 329 bufspace 3801088 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 106 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 75 (991232) dirtyq count 106 (524288) wakeup 0 lim 25 CPU 0, 13, 20, 11, 15, 2, 6, 12, 4, 12, 4, 16, Locked buffers: 0 space 0 Total buffers: 296 space 3801088 Buf domain 2 freebufs 14837 lofreebufs 219 hifreebufs 329 bufspace 3493888 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 125 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 100 (1769472) dirtyq count 125 (602112) wakeup 0 lim 25 CPU 2, 9, 4, 8, 13, 2, 3, 3, 5, 8, 5, 9, Locked buffers: 0 space 0 Total buffers: 296 space 3493888 Buf domain 3 freebufs 14771 lofreebufs 219 hifreebufs 329 bufspace 5795840 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 131 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 99 (1904640) dirtyq count 131 (1216512) wakeup 0 lim 25 CPU 7, 20, 15, 9, 17, 7, 9, 9, 6, 11, 8, 14, Locked buffers: 0 space 0 Total buffers: 362 space 5795840 Buf domain 4 freebufs 14809 lofreebufs 219 hifreebufs 329 bufspace 4247552 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 115 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 50 (483328) dirtyq count 115 (471040) wakeup 0 lim 25 CPU 21, 21, 11, 10, 10, 6, 4, 22, 16, 10, 12, 16, Locked buffers: 0 space 0 Total buffers: 324 space 4247552 Buf domain 5 freebufs 14795 lofreebufs 219 hifreebufs 329 bufspace 4706304 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 116 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 100 (1921024) dirtyq count 116 (520192) wakeup 0 lim 25 CPU 23, 18, 11, 3, 16, 7, 3, 5, 13, 0, 9, 14, Locked buffers: 0 space 0 Total buffers: 338 space 4706304 Buf domain 6 freebufs 14798 lofreebufs 219 hifreebufs 329 bufspace 4882432 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 111 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 125 (2650112) dirtyq count 111 (524288) wakeup 0 lim 25 CPU 16, 7, 18, 13, 2, 2, 3, 1, 5, 7, 6, 19, Locked buffers: 0 space 0 Total buffers: 335 space 4882432 db:1:pho1> show page vm_cnt.v_free_count: 7961624 vm_cnt.v_inactive_count: 698 vm_cnt.v_active_count: 21932 vm_cnt.v_laundry_count: 0 vm_cnt.v_wire_count: 136578 vm_cnt.v_free_reserved: 10643 vm_cnt.v_free_min: 51261 vm_cnt.v_free_target: 173115 vm_cnt.v_inactive_target: 259672 db:1:pho1> show pageq pq_free 7961624 dom 0 page_cnt 8123602 free 7961624 pq_act 21932 pq_inact 698 pq_laund 0 pq_unsw 0 db:0:pho> show freepages DOMAIN: 0 FREE LIST 0: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 001899 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000001 | 000001 09 (002048K) | 000001 | 000001 08 (001024K) | 000000 | 000000 07 (000512K) | 000001 | 000000 06 (000256K) | 000001 | 000001 05 (000128K) | 000000 | 000000 04 (000064K) | 000000 | 000000 03 (000032K) | 000000 | 000000 02 (000016K) | 000004 | 000001 01 (000008K) | 000048 | 000000 00 (000004K) | 000163 | 000000 FREE LIST 1: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000000 | 000000 09 (002048K) | 000000 | 000000 08 (001024K) | 000000 | 000000 07 (000512K) | 000000 | 000000 06 (000256K) | 000001 | 000000 05 (000128K) | 000001 | 000000 04 (000064K) | 000002 | 000000 03 (000032K) | 000000 | 000000 02 (000016K) | 000001 | 000000 01 (000008K) | 000000 | 000000 00 (000004K) | 000000 | 000000 db:0:pho> show uma Zone Size Used Free Requests Sleeps Bucket Total Mem XFree malloc-4096 4096 34130 10 128607 0 2 139837440 0 mbuf_cluster 2048 12438 26 12464 0 254 25526272 0 BUF TRIE 144 311 105641 795 0 62 15257088 0 malloc-128 128 42032 190 1162498 0 126 5404416 0 UMA Slabs 0 112 42308 25 42308 0 126 4741296 0 mbuf 256 16430 295 19413 0 254 4281600 0 FFS inode 1160 2974 50 3046 0 8 3507840 0 VNODE 600 4888 104 4967 0 16 2995200 0 pbuf 2776 0 804 0 0 0 2231904 0 malloc-128 128 15484 202 15546 0 126 2007808 0 malloc-4096 4096 332 11 594 0 2 1404928 0 RADIX NODE 144 8051 1130 190057 0 63 1322064 0 256 Bucket 2048 472 18 9378 0 8 1003520 0 malloc-16384 16384 4 49 3403 0 1 868352 0 malloc-65536 65536 1 12 77 0 1 851968 0 VM OBJECT 264 3041 184 70395 0 30 851400 0 malloc-384 384 1995 45 2131 0 30 783360 0 malloc-64 64 11528 631 28603 0 254 778176 0 FFS2 dinode 256 2974 56 3046 0 62 775680 0 vmem btag 56 13404 408 13404 0 254 773472 0 malloc-32768 32768 10 13 3957 0 1 753664 0 malloc-8192 8192 90 1 91 0 1 745472 0 THREAD 1808 366 30 367 0 8 715968 0 malloc-64 64 9579 1383 26113 0 254 701568 0 DEVCTL 1024 0 676 596 0 0 692224 0 malloc-65536 65536 4 5 9 0 1 589824 0 malloc-65536 65536 3 6 3933 0 1 589824 0 malloc-4096 4096 119 18 4150 0 2 561152 0 UMA Zones 2048 228 7 228 0 8 481280 0 malloc-32768 32768 13 0 13 0 1 425984 0 malloc-256 256 1539 111 5882 0 62 422400 0 malloc-32768 32768 12 0 12 0 1 393216 0 lkpicurr 160 9 2416 9 0 62 388000 0 lkpimm 160 2 2323 2 0 62 372000 0 128 Bucket 1024 247 112 2792 0 16 367616 0 MAP ENTRY 96 2395 1427 231386 0 126 366912 0 DIRHASH 1024 293 31 628 0 16 331776 0 VMSPACE 2544 81 48 4107 0 4 328176 0 malloc-2048 2048 125 33 457 0 8 323584 0 malloc-32 32 8634 816 9024 0 254 302400 0 malloc-16384 16384 14 4 4834 0 1 294912 0 malloc-64 64 4149 387 4267 0 254 290304 0 malloc-16 16 15320 1430 15488 0 254 268000 0 malloc-65536 65536 2 2 18 0 1 262144 0 filedesc0 1072 117 114 4142 0 8 247632 0 malloc-1024 1024 202 38 4933 0 16 245760 0 malloc-8192 8192 29 0 31 0 1 237568 0 PROC 1336 116 61 4141 0 8 236472 0 malloc-256 256 831 84 3757 0 62 234240 0 S VFS Cache 104 1807 338 1905 0 126 223080 0 malloc-256 256 685 140 4951 0 62 211200 0 pipe 744 8 257 1805 0 16 197160 0 malloc-8192 8192 19 5 3069 0 1 196608 0 g_bio 408 0 480 24263 0 30 195840 0 malloc-2048 2048 10 80 7036 0 8 184320 0 malloc-16384 16384 4 7 13 0 1 180224 0 malloc-128 128 1229 166 1720 0 126 178560 0 32 Bucket 256 204 486 1808 0 62 176640 0 malloc-128 128 876 457 21599 0 126 170624 0 64 Bucket 512 220 76 3751 0 30 151552 0 ksiginfo 112 139 1193 486 0 126 149184 0 socket 944 51 89 5783 0 254 132160 0 malloc-65536 65536 2 0 2 0 1 131072 0 malloc-32768 32768 0 4 8 0 1 131072 0 Files 80 129 1121 41382 0 126 100000 0 malloc-32768 32768 2 1 3 0 1 98304 0 malloc-8192 8192 12 0 12 0 1 98304 0 malloc-1024 1024 66 30 6441 0 16 98304 0 ttyinq 160 330 270 540 0 62 96000 0 malloc-4096 4096 20 3 2747 0 2 94208 0 ada_ccb 272 0 336 5278 0 30 91392 0 ttyoutq 256 173 172 282 0 62 88320 0 malloc-16384 16384 5 0 5 0 1 81920 0 UMA Kegs 384 197 6 197 0 30 77952 0 malloc-384 384 137 63 148 0 30 76800 0 TURNSTILE 136 397 149 397 0 62 74256 0 NAMEI 1024 2 70 76397 0 16 73728 0 malloc-8192 8192 0 9 48 0 1 73728 0 malloc-256 256 181 104 576 0 62 72960 0 tcpcb 1080 11 52 21 0 254 68040 0 malloc-65536 65536 1 0 1 0 1 65536 0 malloc-32 32 613 1403 27058 0 254 64512 0 malloc-4096 4096 15 0 26 0 2 61440 0 malloc-4096 4096 7 8 19 0 2 61440 0 malloc-1024 1024 17 43 272 0 16 61440 0 udp_inpcb 496 22 98 184 0 254 59520 0 malloc-1024 1024 19 37 38 0 16 57344 0 16 Bucket 144 184 208 1005 0 62 56448 0 8 Bucket 80 135 565 24791 0 126 56000 0 malloc-256 256 36 174 924 0 62 53760 0 malloc-1024 1024 3 49 97 0 16 53248 0 malloc-512 512 44 60 96 0 30 53248 0 malloc-32 32 450 1188 19651 0 254 52416 0 malloc-16 16 568 2682 1094325 0 254 52000 0 SLEEPQUEUE 88 397 179 397 0 126 50688 0 kenv 258 18 177 21840 0 30 50310 0 malloc-384 384 25 105 10437 0 30 49920 0 malloc-256 256 23 172 1922 0 62 49920 0 malloc-16384 16384 0 3 12 0 1 49152 0 rl_entry 40 102 1110 102 0 254 48480 0 PWD 32 22 1490 521 0 254 48384 0 malloc-64 64 84 672 118 0 254 48384 0 malloc-64 64 29 727 109 0 254 48384 0 malloc-32 32 143 1369 411 0 254 48384 0 4 Bucket 48 29 979 395 0 254 48384 0 2 Bucket 32 266 1246 37929 0 254 48384 0 malloc-16 16 830 2170 33705 0 254 48000 0 malloc-128 128 69 303 305 0 126 47616 0 malloc-128 128 60 312 89 0 126 47616 0 Mountpoints 2944 5 11 7 0 4 47104 0 unpcb 256 15 165 5566 0 254 46080 0 malloc-4096 4096 1 10 21 0 2 45056 0 malloc-512 512 31 57 44 0 30 45056 0 pcpu-8 8 3502 2130 3509 0 254 45056 0 udpcb 32 22 1364 184 0 254 44352 0 malloc-64 64 41 652 67136 0 254 44352 0 malloc-16 16 36 2714 63 0 254 44000 0 malloc-1024 1024 9 31 66 0 16 40960 0 pcpu-64 64 454 186 454 0 254 40960 0 PGRP 88 33 427 78 0 126 40480 0 malloc-32 32 134 1126 166 0 254 40320 0 cpuset 104 27 345 27 0 126 38688 0 mbuf_packet 256 0 150 159 0 254 38400 0 malloc-384 384 52 48 52 0 30 38400 0 malloc-1024 1024 16 20 28 0 16 36864 0 malloc-512 512 0 72 235 0 30 36864 0 malloc-16 16 53 2197 364 0 254 36000 0 tcp_inpcb 496 15 57 21 0 254 35712 0 malloc-32768 32768 1 0 1 0 1 32768 0 malloc-512 512 6 58 61 0 30 32768 0 rtentry 176 12 172 15 0 62 32384 0 malloc-16 16 33 1967 47 0 254 32000 0 malloc-128 128 1 247 31 0 126 31744 0 malloc-128 128 43 205 53 0 126 31744 0 routing nhops 256 9 111 15 0 62 30720 0 malloc-384 384 13 67 14 0 30 30720 0 malloc-512 512 1 55 1524 0 30 28672 0 malloc-32 32 24 858 48 0 254 28224 0 malloc-32 32 11 745 82 0 254 24192 0 clpbuf 2776 0 8 5 0 2 22208 0 malloc-4096 4096 4 1 5 0 2 20480 0 malloc-2048 2048 5 5 6 0 8 20480 0 malloc-16 16 31 1219 60 0 254 20000 0 malloc-256 256 20 55 20 0 62 19200 0 malloc-16384 16384 1 0 1 0 1 16384 0 malloc-8192 8192 2 0 2 0 1 16384 0 pcpu-16 16 16 1008 16 0 254 16384 0 NCLNODE 736 0 22 2 0 16 16192 0 malloc-64 64 4 248 8 0 254 16128 0 malloc-384 384 31 9 31 0 30 15360 0 malloc-256 256 18 42 30 0 62 15360 0 malloc-2048 2048 0 6 23 0 8 12288 0 KNOTE 160 0 75 6 0 62 12000 0 malloc-384 384 1 29 35 0 30 11520 0 mbuf_jumbo_page 4096 0 2 2 0 254 8192 0 malloc-2048 2048 2 2 2 0 8 8192 0 fakepg 104 0 78 8 0 126 8112 0 tcptw 88 4 88 4 0 254 8096 0 malloc-64 64 8 118 9 0 254 8064 0 malloc-16 16 2 498 3 0 254 8000 0 ripcb 496 1 15 3 0 254 7936 0 FPU_save_area 832 1 8 1 0 16 7488 0 epoch_record pcpu 256 4 12 4 0 62 4096 0 malloc-2048 2048 2 0 2 0 8 4096 0 malloc-2048 2048 0 2 3 0 8 4096 0 malloc-1024 1024 4 0 4 0 16 4096 0 hostcache 64 1 62 1 0 254 4032 0 syncache 168 0 24 1 0 254 4032 0 STS VFS Cache 144 0 28 1 0 62 4032 0 malloc-32 32 0 126 2 0 254 4032 0 vtnet_tx_hdr 24 0 167 0 0 254 4008 0 UMA Slabs 1 176 10 12 10 0 62 3872 0 KMAP ENTRY 96 36 3 36 0 0 3744 0 vmem 1856 1 1 1 0 8 3712 0 SMR CPU 32 3 92 3 0 254 3040 0 SMR SHARED 24 3 92 3 0 254 2280 0 FFS1 dinode 128 0 0 0 0 126 0 0 swblk 136 0 0 0 0 62 0 0 swpctrie 144 0 0 0 0 62 0 0 da_ccb 544 0 0 0 0 16 0 0 udplite_inpcb 496 0 0 0 0 254 0 0 tcp_log_node 120 0 0 0 0 126 0 0 tcp_log_bucket 176 0 0 0 0 62 0 0 tcp_log 416 0 0 0 0 254 0 0 tcpreass 48 0 0 0 0 254 0 0 tfo_ccache_entries 80 0 0 0 0 126 0 0 tfo 4 0 0 0 0 254 0 0 sackhole 32 0 0 0 0 254 0 0 ipq 56 0 0 0 0 254 0 0 IPsec SA lft_c 16 0 0 0 0 254 0 0 itimer 352 0 0 0 0 30 0 0 AIOLIO 272 0 0 0 0 30 0 0 AIOCB 552 0 0 0 0 16 0 0 AIOP 32 0 0 0 0 254 0 0 AIO 208 0 0 0 0 62 0 0 TMPFS node 224 0 0 0 0 62 0 0 LTS VFS Cache 360 0 0 0 0 30 0 0 L VFS Cache 320 0 0 0 0 30 0 0 cryptop 280 0 0 0 0 30 0 0 linux_dma_object 24 0 0 0 0 254 0 0 linux_dma_pctrie 144 0 0 0 0 62 0 0 IOMMU_MAP_ENTRY 120 0 0 0 0 126 0 0 ktls_session 192 0 0 0 0 62 0 0 mbuf_jumbo_16k 16384 0 0 0 0 254 0 0 mbuf_jumbo_9k 9216 0 0 0 0 254 0 0 audit_record 1280 0 0 0 0 8 0 0 domainset 40 0 0 0 0 254 0 0 MAC labels 40 0 0 0 0 254 0 0 vnpbuf 2776 0 0 0 0 10 0 0 mdpbuf 2776 0 0 0 0 1 0 0 nfspbuf 2776 0 0 0 0 2 0 0 swwbuf 2776 0 0 0 0 1 0 0 swrbuf 2776 0 0 0 0 2 0 0 umtx_shm 88 0 0 0 0 126 0 0 umtx pi 96 0 0 0 0 126 0 0 rangeset pctrie nodes 144 0 0 0 0 62 0 0 malloc-65536 65536 0 0 0 0 1 0 0 malloc-65536 65536 0 0 0 0 1 0 0 malloc-32768 32768 0 0 0 0 1 0 0 malloc-32768 32768 0 0 0 0 1 0 0 malloc-16384 16384 0 0 0 0 1 0 0 malloc-16384 16384 0 0 0 0 1 0 0 malloc-8192 8192 0 0 0 0 1 0 0 malloc-8192 8192 0 0 0 0 1 0 0 malloc-2048 2048 0 0 0 0 8 0 0 malloc-512 512 0 0 0 0 30 0 0 malloc-512 512 0 0 0 0 30 0 0 malloc-512 512 0 0 0 0 30 0 0 malloc-384 384 0 0 0 0 30 0 0 pcpu-32 32 0 0 0 0 254 0 0 pcpu-4 4 0 0 0 0 254 0 0 UMA Hash 256 0 0 0 0 62 0 0 db:0:pho> show umacache Zone Size Used Free Requests Bucket debugnet_mbuf_packet 2048 0 0 0 0 debugnet_mbuf_cluster 2048 -6144 0 0 0 debugnet_mbuf 256 -10240 0 0 0 ktls_buffers 16384 0 0 0 1 vm pgcache 4096 55763 840 185566 169 vm pgcache 4096 13157 1332 262282 169 buf free cache 848 2499 93 2612 16 buffer arena-65 65536 0 1 1 1 buffer arena-61 61440 0 0 0 1 buffer arena-57 57344 0 0 0 1 buffer arena-53 53248 0 0 0 1 buffer arena-49 49152 0 0 0 1 buffer arena-45 45056 0 0 0 1 buffer arena-40 40960 0 0 0 1 buffer arena-36 36864 0 0 0 1 buffer arena-32 32768 1171 0 1245 1 buffer arena-28 28672 0 0 0 1 buffer arena-24 24576 0 0 0 1 buffer arena-20 20480 0 0 0 1 buffer arena-16 16384 9 4 20 1 buffer arena-12 12288 0 0 0 1 buffer arena-81 8192 0 0 0 1 buffer arena-40 4096 0 0 0 2 kstack_cache 16384 366 8 367 2 db:0:pho> acttrace Tracing command idle pid 11 tid 100003 td 0xfffffe00e4c5b3a0 (CPU 0) cpustop_handler() at cpustop_handler+0x28/frame 0xffffffff81ff9220 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xffffffff81ff9230 trap() at trap+0x56/frame 0xffffffff81ff9340 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81ff9340 --- trap 0x13, rip = 0xffffffff810a50d6, rsp = 0xfffffe0037790a60, rbp = 0xfffffe0037790a60 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0037790a60 acpi_cpu_idle() at acpi_cpu_idle+0x288/frame 0xfffffe0037790aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe0037790ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe0037790ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe0037790bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037790bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037790bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffffe00e4c5a560 (CPU 2) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce2de00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce2de10 trap() at trap+0x56/frame 0xfffffe003ce2df20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce2df20 --- trap 0x13, rip = 0xffffffff810a50d6, rsp = 0xfffffe003779aa60, rbp = 0xfffffe003779aa60 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe003779aa60 acpi_cpu_idle() at acpi_cpu_idle+0x288/frame 0xfffffe003779aaa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe003779aac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe003779aae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe003779abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003779abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003779abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffffe00e4c59e40 (CPU 3) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce3ae00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce3ae10 trap() at trap+0x56/frame 0xfffffe003ce3af20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce3af20 --- trap 0x13, rip = 0xffffffff810a50d6, rsp = 0xfffffe0037795a60, rbp = 0xfffffe0037795a60 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0037795a60 acpi_cpu_idle() at acpi_cpu_idle+0x288/frame 0xfffffe0037795aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe0037795ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe0037795ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe0037795bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037795bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037795bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffffe00e4c59720 (CPU 4) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce47e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce47e10 trap() at trap+0x56/frame 0xfffffe003ce47f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce47f20 --- trap 0x13, rip = 0xffffffff810a50d6, rsp = 0xfffffe00377a4a60, rbp = 0xfffffe00377a4a60 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00377a4a60 acpi_cpu_idle() at acpi_cpu_idle+0x288/frame 0xfffffe00377a4aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00377a4ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00377a4ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00377a4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377a4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377a4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffffe00e4c59000 (CPU 5) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce54e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce54e10 trap() at trap+0x56/frame 0xfffffe003ce54f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce54f20 --- trap 0x13, rip = 0xffffffff810a50d6, rsp = 0xfffffe003779fa60, rbp = 0xfffffe003779fa60 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe003779fa60 acpi_cpu_idle() at acpi_cpu_idle+0x288/frame 0xfffffe003779faa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe003779fac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe003779fae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe003779fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003779fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003779fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffffe00e4c5d020 (CPU 7) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce6ee00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce6ee10 trap() at trap+0x56/frame 0xfffffe003ce6ef20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce6ef20 --- trap 0x13, rip = 0xffffffff810a50d6, rsp = 0xfffffe00377a9a60, rbp = 0xfffffe00377a9a60 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00377a9a60 acpi_cpu_idle() at acpi_cpu_idle+0x288/frame 0xfffffe00377a9aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00377a9ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00377a9ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00377a9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377a9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377a9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffffe00e4c5c900 (CPU 8) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce7be00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce7be10 trap() at trap+0x56/frame 0xfffffe003ce7bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce7bf20 --- trap 0x13, rip = 0xffffffff810a50d6, rsp = 0xfffffe00377b8a60, rbp = 0xfffffe00377b8a60 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00377b8a60 acpi_cpu_idle() at acpi_cpu_idle+0x288/frame 0xfffffe00377b8aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00377b8ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00377b8ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00377b8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377b8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377b8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffffe00e4c611e0 (CPU 9) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce88e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce88e10 trap() at trap+0x56/frame 0xfffffe003ce88f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce88f20 --- trap 0x13, rip = 0xffffffff810a50d6, rsp = 0xfffffe00377b3a60, rbp = 0xfffffe00377b3a60 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00377b3a60 acpi_cpu_idle() at acpi_cpu_idle+0x288/frame 0xfffffe00377b3aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00377b3ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00377b3ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00377b3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377b3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377b3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffffe00e4c60ac0 (CPU 10) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce95e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce95e10 trap() at trap+0x56/frame 0xfffffe003ce95f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce95f20 --- trap 0x13, rip = 0xffffffff810a50d6, rsp = 0xfffffe00377c2a60, rbp = 0xfffffe00377c2a60 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00377c2a60 acpi_cpu_idle() at acpi_cpu_idle+0x288/frame 0xfffffe00377c2aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00377c2ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00377c2ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00377c2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377c2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377c2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffffe00e4c603a0 (CPU 11) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003cea2e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003cea2e10 trap() at trap+0x56/frame 0xfffffe003cea2f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003cea2f20 --- trap 0x13, rip = 0xffffffff810a50d6, rsp = 0xfffffe00377bda60, rbp = 0xfffffe00377bda60 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00377bda60 acpi_cpu_idle() at acpi_cpu_idle+0x288/frame 0xfffffe00377bdaa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00377bdac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00377bdae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00377bdbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377bdbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377bdbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command rename pid 4111 tid 100270 td 0xfffffe010e5a0e40 (CPU 6) kdb_enter() at kdb_enter+0x37/frame 0xfffffe01416c1410 vpanic() at vpanic+0x1b8/frame 0xfffffe01416c1470 panic() at panic+0x43/frame 0xfffffe01416c14d0 _refcount_update_saturated() at _refcount_update_saturated+0x15/frame 0xfffffe01416c14e0 vput() at vput+0x7f/frame 0xfffffe01416c1510 ffs_vput_pair() at ffs_vput_pair+0x6b/frame 0xfffffe01416c15a0 ufs_rename() at ufs_rename+0xcc2/frame 0xfffffe01416c17a0 VOP_RENAME_APV() at VOP_RENAME_APV+0x3c/frame 0xfffffe01416c17c0 null_rename() at null_rename+0x194/frame 0xfffffe01416c1850 VOP_RENAME_APV() at VOP_RENAME_APV+0x3c/frame 0xfffffe01416c1870 kern_renameat() at kern_renameat+0x3dd/frame 0xfffffe01416c1ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01416c1bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01416c1bf0 --- syscall (128, FreeBSD ELF64, sys_rename), rip = 0x8011a68da, rsp = 0x7fffffffe318, rbp = 0x7fffffffe460 --- Tracing command swap pid 4133 tid 100361 td 0xfffffe01441e3020 (CPU 1) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce20e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce20e10 trap() at trap+0x56/frame 0xfffffe003ce20f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce20f20 --- trap 0x13, rip = 0xffffffff810ba605, rsp = 0xffffffff826112d0, rbp = 0x7fffffffe100 --- Xpage_pti() at Xpage_pti+0x5/frame 0x7fffffffe100 db:0:pho> ps pid ppid pgrp uid state wmesg wchan cmd 4141 4140 4103 2007 S+ nanslp 0xffffffff81ebc0a5 dirrename 4140 4109 4103 2007 S+ wait 0xfffff800042e4000 dirrename 4139 4129 4103 2007 S+ nanslp 0xffffffff81ebc0a7 swap 4138 4129 4103 2007 S+ nanslp 0xffffffff81ebc0a4 swap 4137 4129 4103 2007 S+ nanslp 0xffffffff81ebc0a5 swap 4136 4129 4103 2007 S+ nanslp 0xffffffff81ebc0ab swap 4135 4129 4103 2007 S+ nanslp 0xffffffff81ebc0a7 swap 4134 4129 4103 2007 S+ nanslp 0xffffffff81ebc0a3 swap 4133 4129 4103 2007 R+ CPU 1 swap 4132 4129 4103 2007 S+ nanslp 0xffffffff81ebc0a7 swap 4131 4129 4103 2007 S+ nanslp 0xffffffff81ebc0ab swap 4130 4129 4103 2007 S+ nanslp 0xffffffff81ebc0a7 swap 4129 4107 4103 2007 S+ wait 0xfffff80158b75538 swap 4128 4119 4103 2007 S+ nanslp 0xffffffff81ebc0a9 dirnprename 4127 4119 4103 2007 S+ nanslp 0xffffffff81ebc0a2 dirnprename 4126 4119 4103 2007 S+ nanslp 0xffffffff81ebc0aa dirnprename 4125 4119 4103 2007 S+ nanslp 0xffffffff81ebc0a2 dirnprename 4124 4119 4103 2007 S+ nanslp 0xffffffff81ebc0a4 dirnprename 4123 4119 4103 2007 S+ nanslp 0xffffffff81ebc0a0 dirnprename 4122 4119 4103 2007 S+ nanslp 0xffffffff81ebc0a7 dirnprename 4121 4119 4103 2007 S+ nanslp 0xffffffff81ebc0ab dirnprename 4120 4119 4103 2007 S+ nanslp 0xffffffff81ebc0a6 dirnprename 4119 4108 4103 2007 S+ wait 0xfffff80158473000 dirnprename 4118 4110 4103 2007 S+ nanslp 0xffffffff81ebc0aa rename 4117 4110 4103 2007 S+ nanslp 0xffffffff81ebc0a5 rename 4116 4110 4103 2007 S+ nanslp 0xffffffff81ebc0a8 rename 4115 4110 4103 2007 S+ nanslp 0xffffffff81ebc0a2 rename 4114 4110 4103 2007 S+ nanslp 0xffffffff81ebc0aa rename 4113 4110 4103 2007 S+ nanslp 0xffffffff81ebc0ab rename 4112 4110 4103 2007 S+ nanslp 0xffffffff81ebc0a6 rename 4111 4110 4103 2007 R+ CPU 6 rename 4110 4106 4103 2007 S+ wait 0xfffff8002c572538 rename 4109 4105 4103 2007 S+ nanslp 0xffffffff81ebc0a2 dirrename 4108 4105 4103 2007 S+ nanslp 0xffffffff81ebc0a2 dirnprename 4107 4105 4103 2007 S+ nanslp 0xffffffff81ebc0a5 swap 4106 4105 4103 2007 S+ nanslp 0xffffffff81ebc0a8 rename 4105 4104 4103 2007 S+ wait 0xfffff80158214000 run 4104 4103 4103 2007 S+ wait 0xfffff8002461a538 run 4103 4100 4103 2007 S+ nanslp 0xffffffff81ebc0a2 run 4102 4080 2798 0 S+ nanslp 0xffffffff81ebc0a3 sleep 4100 4080 2798 0 S+ wait 0xfffff8005c356a70 su 4092 0 0 0 DL mdwait 0xfffff802b46a6000 [md10] 4081 2798 2798 0 S+ piperd 0xfffff802b453c2e8 tee 4080 4079 2798 0 S+ wait 0xfffff80158231000 sh 4079 2798 2798 0 S+ wait 0xfffff80158473a70 sh 4074 2922 2883 0 S nanslp 0xffffffff81ebc0a6 sleep 2925 2883 2883 0 S piperd 0xfffff8015864a8b8 sh 2923 2883 2883 0 S piperd 0xfffff80006082ba0 awk 2922 2883 2883 0 S wait 0xfffff8002ca0fa70 sh 2883 1 2883 0 Ss wait 0xfffff802b436f538 sh 2798 2774 2798 0 S+ wait 0xfffff800042e4a70 sh 2790 0 0 0 SL - 0xffffffff81e83a00 [newnfs 0] 2774 2772 2774 0 S+ wait 0xfffff8002c958000 bash 2772 2771 2772 0 S+ pause 0xfffff8002c9585e8 csh 2771 2766 2771 2006 S+ wait 0xfffff8002126ca70 su 2766 2765 2766 2006 Ss+ wait 0xfffff8002461a000 bash 2765 2761 2761 2006 S select 0xfffff800060c1e40 sshd 2761 2729 2761 0 Ss select 0xfffff8002c5843c0 sshd 2756 1 2756 0 Ss+ ttyin 0xfffff800045a08b0 getty 2755 1 2755 0 Ss+ ttyin 0xfffff800045a0cb0 getty 2754 1 2754 0 Ss+ ttyin 0xfffff800213e10b0 getty 2753 1 2753 0 Ss+ ttyin 0xfffff800213e14b0 getty 2752 1 2752 0 Ss+ ttyin 0xfffff800213e18b0 getty 2751 1 2751 0 Ss+ ttyin 0xfffff800213e1cb0 getty 2750 1 2750 0 Ss+ ttyin 0xfffff800213eb0b0 getty 2749 1 2749 0 Ss+ ttyin 0xfffff800213eb4b0 getty 2748 1 2748 0 Ss+ ttyin 0xfffff800213eb8b0 getty 2747 1 2747 0 Ss+ ttyin 0xfffff800213ebcb0 getty 2733 1 2733 0 Ss nanslp 0xffffffff81ebc0a0 cron 2729 1 2729 0 Ss select 0xfffff80003be09c0 sshd 2710 1 2710 0 Ss select 0xfffff8002c86cc40 inetd 2684 1 2684 123 Ss select 0xfffff800044f9740 ntpd 2658 1 2658 0 Ss select 0xfffff8002c86cdc0 powerd 2653 1 2653 0 Ss rpcsvc 0xfffff8002c968e60 NLM: master 2650 1 2650 0 Ss select 0xfffff8002c86ce40 rpc.statd 2625 1 2625 0 Ss select 0xfffff800044f97c0 rpcbind 2603 1 2603 0 Ss nanslp 0xffffffff81ebc0a8 watchdogd 2595 1 2595 0 Ss select 0xfffff8002c584540 syslogd 2406 1 2406 0 Ss select 0xfffff800060c1dc0 devd 2401 1 2401 65 Ss select 0xfffff80003be0940 dhclient 2342 1 2342 0 Ss select 0xfffff8002c86cf40 dhclient 2339 1 2339 0 Ss select 0xfffff8002c5845c0 dhclient 34 0 0 0 DL syncer 0xffffffff81fab480 [syncer] 33 0 0 0 DL vlruwt 0xfffff8002c7d3a70 [vnlru] 32 0 0 0 DL (threaded) [bufdaemon] 100213 D qsleep 0xffffffff81faa520 [bufdaemon] 100214 D - 0xffffffff81a0af40 [bufspacedaemon-0] 100215 D - 0xffffffff81a13200 [bufspacedaemon-1] 100216 D - 0xffffffff81a1b4c0 [bufspacedaemon-2] 100217 D - 0xffffffff81a23780 [bufspacedaemon-3] 100218 D - 0xffffffff81a2ba40 [bufspacedaemon-4] 100219 D - 0xffffffff81a33d00 [bufspacedaemon-5] 100220 D - 0xffffffff81a3bfc0 [bufspacedaemon-6] 100237 D sdflush 0xfffff80003df5ce8 [/ worker] 100243 D sdflush 0xfffff80024632ce8 [/tmp worker] 100346 D sdflush 0xfffff802b43edce8 [/mnt worker] 31 0 0 0 DL psleep 0xffffffff81fd0208 [vmdaemon] 30 0 0 0 DL (threaded) [pagedaemon] 100211 D psleep 0xffffffff81fc4678 [dom0] 100221 D launds 0xffffffff81fc4684 [laundry: dom0] 100222 D umarcl 0xffffffff80f708b0 [uma] 29 0 0 0 DL idle 0xfffff80003e05538 [enc_daemon1] 28 0 0 0 DL idle 0xfffff80003e05a70 [enc_daemon0] 27 0 0 0 DL - 0xffffffff81cf03d8 [rand_harvestq] 26 0 0 0 DL - 0xffffffff81fa7bdc [soaiod4] 25 0 0 0 DL - 0xffffffff81fa7bdc [soaiod3] 24 0 0 0 DL - 0xffffffff81fa7bdc [soaiod2] 23 0 0 0 DL - 0xffffffff81fa7bdc [soaiod1] 22 0 0 0 DL (threaded) [usb] 100140 D - 0xfffffe010a188440 [usbus0] 100141 D - 0xfffffe010a188498 [usbus0] 100142 D - 0xfffffe010a1884f0 [usbus0] 100143 D - 0xfffffe010a188548 [usbus0] 100144 D - 0xfffffe010a1885a0 [usbus0] 100146 D - 0xfffffe00e4d66cf0 [usbus1] 100147 D - 0xfffffe00e4d66d48 [usbus1] 100148 D - 0xfffffe00e4d66da0 [usbus1] 100149 D - 0xfffffe00e4d66df8 [usbus1] 100150 D - 0xfffffe00e4d66e50 [usbus1] 100151 D - 0xfffffe010a548cf0 [usbus2] 100152 D - 0xfffffe010a548d48 [usbus2] 100153 D - 0xfffffe010a548da0 [usbus2] 100154 D - 0xfffffe010a548df8 [usbus2] 100155 D - 0xfffffe010a548e50 [usbus2] 21 0 0 0 RL (threaded) [cam] 100133 D - 0xffffffff81bc7ac0 [doneq0] 100134 RunQ [doneq1] 100135 D - 0xffffffff81bc7bc0 [doneq2] 100136 D - 0xffffffff81bc7a40 [async] 100168 D - 0xffffffff81bc7910 [scanner] 20 0 0 0 DL seqstat 0xfffff80003eba488 [sequencer 00] 19 0 0 0 DL crypto_ 0xfffff80003e99fa0 [crypto returns 11] 18 0 0 0 DL crypto_ 0xfffff80003e99f50 [crypto returns 10] 17 0 0 0 DL crypto_ 0xfffff80003e99f00 [crypto returns 9] 16 0 0 0 DL crypto_ 0xfffff80003e99eb0 [crypto returns 8] 15 0 0 0 DL crypto_ 0xfffff80003e99e60 [crypto returns 7] 14 0 0 0 DL crypto_ 0xfffff80003e99e10 [crypto returns 6] 9 0 0 0 DL crypto_ 0xfffff80003e99dc0 [crypto returns 5] 8 0 0 0 DL crypto_ 0xfffff80003e99d70 [crypto returns 4] 7 0 0 0 DL crypto_ 0xfffff80003e99d20 [crypto returns 3] 6 0 0 0 DL crypto_ 0xfffff80003e99cd0 [crypto returns 2] 5 0 0 0 DL crypto_ 0xfffff80003e99c80 [crypto returns 1] 4 0 0 0 DL crypto_ 0xfffff80003e99c30 [crypto returns 0] 3 0 0 0 DL crypto_ 0xffffffff81fc1ba0 [crypto] 13 0 0 0 DL (threaded) [geom] 100104 D - 0xffffffff81e9b920 [g_event] 100105 D - 0xffffffff81e9b928 [g_up] 100106 D - 0xffffffff81e9b930 [g_down] 2 0 0 0 DL (threaded) [KTLS] 100077 D - 0xfffff80003d77800 [thr_0] 100078 D - 0xfffff80003d77880 [thr_1] 100079 D - 0xfffff80003d77900 [thr_2] 100080 D - 0xfffff80003d77980 [thr_3] 100081 D - 0xfffff80003d77a00 [thr_4] 100082 D - 0xfffff80003d77a80 [thr_5] 100083 D - 0xfffff80003d77b00 [thr_6] 100084 D - 0xfffff80003d77b80 [thr_7] 100085 D - 0xfffff80003d77c00 [thr_8] 100086 D - 0xfffff80003d77c80 [thr_9] 100087 D - 0xfffff80003d77d00 [thr_10] 100088 D - 0xfffff80003d77d80 [thr_11] 12 0 0 0 WL (threaded) [intr] 100046 I [swi6: task queue] 100047 I [swi6: Giant taskq] 100049 I [swi5: fast taskq] 100089 I [swi4: clock (0)] 100090 I [swi4: clock (1)] 100091 I [swi4: clock (2)] 100092 I [swi4: clock (3)] 100093 I [swi4: clock (4)] 100094 I [swi4: clock (5)] 100095 I [swi4: clock (6)] 100096 I [swi4: clock (7)] 100097 I [swi4: clock (8)] 100098 I [swi4: clock (9)] 100099 I [swi4: clock (10)] 100100 I [swi4: clock (11)] 100101 I [swi1: netisr 0] 100102 I [swi3: vm] 100137 I [swi4: apei] 100138 I [irq56: ahci0] 100139 I [irq19: xhci0] 100145 I [irq18: ehci0 ehci1+] 100156 I [irq71: ahci1] 100157 I [swi0: uart uart] 100175 I [irq73: mlx5_core0] 100176 I [irq74: mlx5_core0] 100177 I [irq72: mlx5_core0] 100178 I [irq75: mlx5_core0] 100179 I [irq76: mlx5_core0] 100180 I [irq77: mlx5_core0] 100181 I [irq78: mlx5_core0] 100182 I [irq79: mlx5_core0] 100183 I [irq80: mlx5_core0] 100184 I [irq81: mlx5_core0] 100185 I [irq82: mlx5_core0] 100186 I [irq83: mlx5_core0] 100187 I [irq84: mlx5_core0] 100188 I [irq85: mlx5_core0] 100189 I [irq86: mlx5_core0] 100195 I [irq88: mlx5_core1] 100196 I [irq89: mlx5_core1] 100197 I [irq87: mlx5_core1] 100198 I [irq90: mlx5_core1] 100199 I [irq91: mlx5_core1] 100200 I [irq92: mlx5_core1] 100201 I [irq93: mlx5_core1] 100202 I [irq94: mlx5_core1] 100203 I [irq95: mlx5_core1] 100204 I [irq96: mlx5_core1] 100205 I [irq97: mlx5_core1] 100206 I [irq98: mlx5_core1] 100207 I [irq99: mlx5_core1] 100208 I [irq100: mlx5_core1] 100209 I [irq101: mlx5_core1] 100272 I [irq102: ioat0] 100273 I [irq103: ioat1] 100274 I [irq104: ioat2] 100275 I [irq105: ioat3] 100276 I [irq106: ioat4] 100277 I [irq107: ioat5] 100278 I [irq108: ioat6] 100279 I [irq109: ioat7] 11 0 0 0 RL (threaded) [idle] 100003 Run CPU 0 [idle: cpu0] 100004 CanRun [idle: cpu1] 100005 Run CPU 2 [idle: cpu2] 100006 Run CPU 3 [idle: cpu3] 100007 Run CPU 4 [idle: cpu4] 100008 Run CPU 5 [idle: cpu5] 100009 CanRun [idle: cpu6] 100010 Run CPU 7 [idle: cpu7] 100011 Run CPU 8 [idle: cpu8] 100012 Run CPU 9 [idle: cpu9] 100013 Run CPU 10 [idle: cpu10] 100014 Run CPU 11 [idle: cpu11] 1 0 1 0 SLs wait 0xfffff80003b43538 [init] 10 0 0 0 DL audit_w 0xffffffff81fc20b0 [audit] 0 0 0 0 DLs (threaded) [kernel] 100000 D swapin 0xffffffff81e9beb0 [swapper] 100015 D - 0xfffff80003965c00 [softirq_0] 100016 D - 0xfffff80003965b00 [softirq_1] 100017 D - 0xfffff80003965a00 [softirq_2] 100018 D - 0xfffff80003965900 [softirq_3] 100019 D - 0xfffff80003965800 [softirq_4] 100020 D - 0xfffff80003965700 [softirq_5] 100021 D - 0xfffff80003965600 [softirq_6] 100022 D - 0xfffff80003965500 [softirq_7] 100023 D - 0xfffff80003965400 [softirq_8] 100024 D - 0xfffff80003965300 [softirq_9] 100025 D - 0xfffff80003965200 [softirq_10] 100026 D - 0xfffff80003965100 [softirq_11] 100027 D - 0xfffff80003965000 [if_io_tqg_0] 100028 D - 0xfffff80003b1ce00 [if_io_tqg_1] 100029 D - 0xfffff80003b1cd00 [if_io_tqg_2] 100030 D - 0xfffff80003b1cc00 [if_io_tqg_3] 100031 D - 0xfffff80003b1cb00 [if_io_tqg_4] 100032 D - 0xfffff80003b1ca00 [if_io_tqg_5] 100033 D - 0xfffff80003b1c900 [if_io_tqg_6] 100034 D - 0xfffff80003b1c800 [if_io_tqg_7] 100035 D - 0xfffff80003b1c700 [if_io_tqg_8] 100036 D - 0xfffff80003b1c600 [if_io_tqg_9] 100037 D - 0xfffff80003b1c500 [if_io_tqg_10] 100038 D - 0xfffff80003b1c400 [if_io_tqg_11] 100039 D - 0xfffff80003b1c300 [if_config_tqg_0] 100040 D - 0xfffff80003b1fb00 [pci_hp taskq] 100041 D - 0xfffff80003b1fa00 [aiod_kick taskq] 100042 D - 0xfffff80003b1f900 [kqueue_ctx taskq] 100043 D - 0xfffff80003b1f800 [inm_free taskq] 100044 D - 0xfffff80003b1f700 [deferred_unmount ta] 100045 D - 0xfffff80003b1f600 [linuxkpi_irq_wq] 100048 D - 0xfffff80003b1f100 [thread taskq] 100050 D - 0xfffff80003b12d00 [in6m_free taskq] 100051 D - 0xfffff80003b12c00 [linuxkpi_short_wq_0] 100052 D - 0xfffff80003b12c00 [linuxkpi_short_wq_1] 100053 D - 0xfffff80003b12c00 [linuxkpi_short_wq_2] 100054 D - 0xfffff80003b12c00 [linuxkpi_short_wq_3] 100055 D - 0xfffff80003b12c00 [linuxkpi_short_wq_4] 100056 D - 0xfffff80003b12c00 [linuxkpi_short_wq_5] 100057 D - 0xfffff80003b12c00 [linuxkpi_short_wq_6] 100058 D - 0xfffff80003b12c00 [linuxkpi_short_wq_7] 100059 D - 0xfffff80003b12c00 [linuxkpi_short_wq_8] 100060 D - 0xfffff80003b12c00 [linuxkpi_short_wq_9] 100061 D - 0xfffff80003b12c00 [linuxkpi_short_wq_1] 100062 D - 0xfffff80003b12c00 [linuxkpi_short_wq_1] 100063 D - 0xfffff80003b12c00 [linuxkpi_short_wq_1] 100064 D - 0xfffff80003b12b00 [linuxkpi_long_wq_0] 100065 D - 0xfffff80003b12b00 [linuxkpi_long_wq_1] 100066 D - 0xfffff80003b12b00 [linuxkpi_long_wq_2] 100067 D - 0xfffff80003b12b00 [linuxkpi_long_wq_3] 100068 D - 0xfffff80003b12b00 [linuxkpi_long_wq_4] 100069 D - 0xfffff80003b12b00 [linuxkpi_long_wq_5] 100070 D - 0xfffff80003b12b00 [linuxkpi_long_wq_6] 100071 D - 0xfffff80003b12b00 [linuxkpi_long_wq_7] 100072 D - 0xfffff80003b12b00 [linuxkpi_long_wq_8] 100073 D - 0xfffff80003b12b00 [linuxkpi_long_wq_9] 100074 D - 0xfffff80003b12b00 [linuxkpi_long_wq_10] 100075 D - 0xfffff80003b12b00 [linuxkpi_long_wq_11] 100076 D - 0xfffff80003b12b00 [linuxkpi_long_wq_12] 100103 D - 0xfffff80003d20e00 [firmware taskq] 100107 D - 0xfffff80003d20d00 [crypto_0] 100108 D - 0xfffff80003d20d00 [crypto_1] 100109 D - 0xfffff80003d20d00 [crypto_2] 100110 D - 0xfffff80003d20d00 [crypto_3] 100111 D - 0xfffff80003d20d00 [crypto_4] 100112 D - 0xfffff80003d20d00 [crypto_5] 100113 D - 0xfffff80003d20d00 [crypto_6] 100114 D - 0xfffff80003d20d00 [crypto_7] 100115 D - 0xfffff80003d20d00 [crypto_8] 100116 D - 0xfffff80003d20d00 [crypto_9] 100117 D - 0xfffff80003d20d00 [crypto_10] 100118 D - 0xfffff80003d20d00 [crypto_11] 100158 D - 0xfffff800045d7c00 [mca taskq] 100164 D - 0xfffff800213eee00 [acpi_task_0] 100165 D - 0xfffff800213eee00 [acpi_task_1] 100166 D - 0xfffff800213eee00 [acpi_task_2] 100167 D - 0xfffff80003d20c00 [CAM taskq] 100171 D - 0xfffff800213eed00 [mlx5_core0-rec] 100172 D - 0xfffff800213eec00 [mlx5_core0-wdg] 100173 D - 0xfffff800213eeb00 [mlx5_core0-cmd] 100174 D - 0xfffff800213eea00 [mlx5_page_allocator] 100190 D - 0xfffff80027ba5900 [mlx5_esw_wq] 100191 D - 0xfffff80027ba5800 [mlx5_core1-rec] 100192 D - 0xfffff80027ba5700 [mlx5_core1-wdg] 100193 D - 0xfffff80027ba5600 [mlx5_core1-cmd] 100194 D - 0xfffff80027ba5500 [mlx5_page_allocator] 100210 D - 0xfffff80003c01e00 [mlx5_esw_wq] db:0:pho> allt Tracing command kernel pid 0 tid 100000 td 0xffffffff81e9c400 sched_switch() at sched_switch+0x5af/frame 0xffffffff8254dac0 mi_switch() at mi_switch+0x155/frame 0xffffffff8254dae0 sleepq_switch() at sleepq_switch+0x119/frame 0xffffffff8254db20 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xffffffff8254db60 _sleep() at _sleep+0x298/frame 0xffffffff8254dc00 swapper() at swapper+0x75/frame 0xffffffff8254dc60 mi_startup() at mi_startup+0x2f3/frame 0xffffffff8254dcb0 btext() at btext+0x22 Tracing command kernel pid 0 tid 100015 td 0xfffffe00e4c5fc80 sched_switch() at sched_switch+0x5af/frame 0xfffffe00377ccab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00377ccad0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00377ccb10 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00377ccb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377ccbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377ccbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377ccbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100016 td 0xfffffe00e4c5f560 sched_switch() at sched_switch+0x5af/frame 0xfffffe00377c7ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00377c7ad0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00377c7b10 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00377c7b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377c7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377c7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377c7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100017 td 0xfffffe00e4c5ee40 sched_switch() at sched_switch+0x5af/frame 0xfffffe00377d6ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00377d6ad0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00377d6b10 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00377d6b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377d6bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377d6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377d6bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100018 td 0xfffffe00e4c5e720 sched_switch() at sched_switch+0x5af/frame 0xfffffe00377d1ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00377d1ad0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00377d1b10 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00377d1b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377d1bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377d1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377d1bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100019 td 0xfffffe00e4c5e000 sched_switch() at sched_switch+0x5af/frame 0xfffffe00377e0ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00377e0ad0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00377e0b10 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00377e0b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377e0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377e0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377e0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xfffffe00e4c62740 sched_switch() at sched_switch+0x5af/frame 0xfffffe00377dbab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00377dbad0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00377dbb10 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00377dbb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377dbbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377dbbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377dbbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xfffffe00e4c62020 sched_switch() at sched_switch+0x5af/frame 0xfffffe00377eaab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00377eaad0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00377eab10 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00377eab80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377eabb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377eabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377eabf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xfffffe00e4c61900 sched_switch() at sched_switch+0x5af/frame 0xfffffe00377e5ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00377e5ad0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00377e5b10 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00377e5b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377e5bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377e5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377e5bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xfffffe00e4cde1e0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00377f4ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00377f4ad0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00377f4b10 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00377f4b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377f4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377f4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377f4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xfffffe00e4cddac0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00377efab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00377efad0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00377efb10 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00377efb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377efbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377efbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377efbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xfffffe00e4cdd3a0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00377feab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00377fead0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00377feb10 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00377feb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377febb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377febf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377febf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100026 td 0xfffffe00e4cdcc80 sched_switch() at sched_switch+0x5af/frame 0xfffffe00377f9ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00377f9ad0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00377f9b10 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00377f9b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377f9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377f9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377f9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100027 td 0xfffffe00e4cdc560 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4835ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4835ad0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4835b10 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00e4835b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4835bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4835bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4835bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100028 td 0xfffffe00e4cdbe40 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4830ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4830ad0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4830b10 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00e4830b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4830bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4830bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4830bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100029 td 0xfffffe00e4cdb720 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e483fab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e483fad0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e483fb10 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00e483fb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e483fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e483fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e483fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100030 td 0xfffffe00e4cdb000 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e483aab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e483aad0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e483ab10 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00e483ab80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e483abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e483abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e483abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100031 td 0xfffffe00e4cdf740 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4849ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4849ad0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4849b10 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00e4849b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4849bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4849bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4849bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100032 td 0xfffffe00e4cdf020 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4844ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4844ad0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4844b10 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00e4844b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4844bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4844bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4844bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100033 td 0xfffffe00e4cde900 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4853ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4853ad0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4853b10 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00e4853b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4853bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4853bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4853bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100034 td 0xfffffe00e4ce51e0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e484eab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e484ead0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e484eb10 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00e484eb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e484ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e484ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e484ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100035 td 0xfffffe00e4ce4ac0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e485dab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e485dad0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e485db10 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00e485db80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e485dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e485dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e485dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100036 td 0xfffffe00e4ce43a0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4858ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4858ad0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4858b10 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00e4858b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4858bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4858bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4858bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100037 td 0xfffffe00e4ce3c80 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4867ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4867ad0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4867b10 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00e4867b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4867bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4867bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4867bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100038 td 0xfffffe00e4ce3560 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4862ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4862ad0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4862b10 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00e4862b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4862bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4862bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4862bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100039 td 0xfffffe00e4ce2e40 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4871ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4871ad0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4871b10 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00e4871b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4871bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4871bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4871bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100040 td 0xfffffe00e4ce2720 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e486ca80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e486caa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e486cae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e486cb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e486cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e486cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e486cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100041 td 0xfffffe00e4ce2000 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e487ba80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e487baa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e487bae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e487bb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e487bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e487bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e487bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100042 td 0xfffffe00e4ce6740 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4876a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4876aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4876ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4876b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4876bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4876bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4876bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100043 td 0xfffffe00e4ce6020 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4885a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4885aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4885ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4885b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4885bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4885bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4885bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100044 td 0xfffffe00e4ce5900 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4880a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4880aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4880ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4880b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4880bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4880bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4880bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100045 td 0xfffffe00e4cec1e0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e488fab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e488fad0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e488fb10 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00e488fb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe00e488fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e488fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e488fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100048 td 0xfffffe00e4ceac80 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4894a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4894aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4894ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4894b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4894bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4894bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4894bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100050 td 0xfffffe00e4ce9e40 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e489ea80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e489eaa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e489eae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e489eb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e489ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e489ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e489ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100051 td 0xfffffe00e4ce9720 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e48ada80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e48adaa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e48adae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e48adb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48adbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48adbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48adbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100052 td 0xfffffe00e4ce9000 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e48a8a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e48a8aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e48a8ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e48a8b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48a8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48a8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48a8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100053 td 0xfffffe00e4ced740 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e48b7a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e48b7aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e48b7ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e48b7b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48b7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48b7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48b7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100054 td 0xfffffe00e4ced020 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e48b2a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e48b2aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e48b2ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e48b2b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48b2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48b2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48b2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100055 td 0xfffffe00e4cec900 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e48c1a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e48c1aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e48c1ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e48c1b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48c1bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48c1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48c1bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100056 td 0xfffffe00e4cf11e0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e48bca80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e48bcaa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e48bcae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e48bcb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48bcbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48bcbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48bcbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100057 td 0xfffffe00e4cf0ac0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e48cba80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e48cbaa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e48cbae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e48cbb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48cbbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48cbbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48cbbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100058 td 0xfffffe00e4cf03a0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e48c6a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e48c6aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e48c6ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e48c6b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48c6bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48c6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48c6bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100059 td 0xfffffe00e4cefc80 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e48d5a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e48d5aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e48d5ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e48d5b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48d5bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48d5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48d5bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100060 td 0xfffffe00e4cef560 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e48d0a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e48d0aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e48d0ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e48d0b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48d0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48d0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48d0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100061 td 0xfffffe00e4ceee40 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e48dfa80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e48dfaa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e48dfae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e48dfb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48dfbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48dfbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48dfbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100062 td 0xfffffe00e4cee720 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e48daa80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e48daaa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e48daae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e48dab80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48dabb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48dabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48dabf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100063 td 0xfffffe00e4cee000 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e48e9a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e48e9aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e48e9ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e48e9b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48e9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48e9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48e9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100064 td 0xfffffe00e4cf2740 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e48e4a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e48e4aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e48e4ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e48e4b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48e4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48e4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48e4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100065 td 0xfffffe00e4cf2020 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e48f3a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e48f3aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e48f3ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e48f3b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48f3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48f3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48f3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100066 td 0xfffffe00e4cf1900 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e48eea80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e48eeaa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e48eeae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e48eeb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48eebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48eebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48eebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100067 td 0xfffffe00e4cf61e0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e48fda80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e48fdaa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e48fdae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e48fdb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48fdbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48fdbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48fdbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100068 td 0xfffffe00e4cf5ac0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e48f8a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e48f8aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e48f8ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e48f8b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48f8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48f8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48f8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100069 td 0xfffffe00e4cf53a0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4907a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4907aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4907ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4907b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4907bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4907bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4907bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100070 td 0xfffffe00e4cf4c80 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4902a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4902aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4902ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4902b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4902bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4902bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4902bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100071 td 0xfffffe00e4cf4560 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4911a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4911aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4911ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4911b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4911bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4911bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4911bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100072 td 0xfffffe00e4cf3e40 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e490ca80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e490caa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e490cae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e490cb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e490cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e490cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e490cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100073 td 0xfffffe00e4cf3720 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e491ba80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e491baa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e491bae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e491bb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e491bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e491bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e491bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100074 td 0xfffffe00e4cf3000 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4916a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4916aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4916ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4916b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4916bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4916bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4916bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100075 td 0xfffffe00e4cf7740 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4925a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4925aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4925ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4925b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4925bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4925bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4925bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100076 td 0xfffffe00e4cf7020 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4920a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4920aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4920ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4920b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4920bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4920bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4920bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100103 td 0xfffffe00e4d08560 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e49eda80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e49edaa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e49edae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e49edb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e49edbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49edbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49edbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100107 td 0xfffffe00e4d0b740 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4e04a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e04aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e04ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4e04b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e04bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e04bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e04bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100108 td 0xfffffe00e4d0b020 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e49fca80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e49fcaa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e49fcae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e49fcb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e49fcbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49fcbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49fcbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100109 td 0xfffffe00e4d0a900 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4e0ea80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e0eaa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e0eae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4e0eb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e0ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e0ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e0ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100110 td 0xfffffe00e4d241e0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4e09a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e09aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e09ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4e09b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e09bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e09bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e09bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100111 td 0xfffffe00e4d23ac0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4e18a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e18aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e18ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4e18b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e18bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e18bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e18bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100112 td 0xfffffe00e4d233a0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4e13a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e13aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e13ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4e13b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e13bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e13bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e13bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100113 td 0xfffffe00e4d22c80 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4e22a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e22aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e22ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4e22b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e22bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e22bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e22bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100114 td 0xfffffe00e4d22560 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4e1da80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e1daa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e1dae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4e1db80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e1dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e1dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e1dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100115 td 0xfffffe00e4d21e40 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4e2ca80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e2caa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e2cae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4e2cb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e2cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e2cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e2cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100116 td 0xfffffe00e4d21720 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4e27a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e27aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e27ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4e27b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e27bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e27bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e27bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100117 td 0xfffffe00e4d21000 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4e36a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e36aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e36ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4e36b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e36bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e36bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e36bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100118 td 0xfffffe00e4d25740 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4e31a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e31aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e31ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4e31b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e31bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e31bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e31bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100158 td 0xfffffe010a6d7000 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4f05ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4f05ad0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4f05b10 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00e4f05b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe00e4f05bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f05bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f05bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100164 td 0xfffffe010d6743a0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4f53ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4f53ad0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4f53b10 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00e4f53b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe00e4f53bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f53bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f53bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100165 td 0xfffffe010d673c80 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4f62ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4f62ad0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4f62b10 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00e4f62b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe00e4f62bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f62bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f62bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100166 td 0xfffffe010d673560 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4f5dab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4f5dad0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4f5db10 msleep_spin_sbt() at msleep_spin_sbt+0x151/frame 0xfffffe00e4f5db80 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe00e4f5dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f5dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f5dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100167 td 0xfffffe010d672e40 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4f6ca80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4f6caa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4f6cae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4f6cb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4f6cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f6cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f6cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100171 td 0xfffffe010d672000 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4f80a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4f80aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4f80ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4f80b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4f80bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f80bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f80bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100172 td 0xfffffe010deaf1e0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4f7ba80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4f7baa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4f7bae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4f7bb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4f7bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f7bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f7bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100173 td 0xfffffe010deaeac0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4f8aa80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4f8aaa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4f8aae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4f8ab80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4f8abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f8abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f8abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100174 td 0xfffffe010deae3a0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4f85a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4f85aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4f85ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4f85b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4f85bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f85bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f85bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100190 td 0xfffffe010e046000 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4fd5a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4fd5aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4fd5ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4fd5b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4fd5bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4fd5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4fd5bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100191 td 0xfffffe010e04a740 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4fe4a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4fe4aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4fe4ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4fe4b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4fe4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4fe4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4fe4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100192 td 0xfffffe010e04a020 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4fdfa80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4fdfaa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4fdfae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4fdfb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4fdfbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4fdfbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4fdfbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100193 td 0xfffffe010e049900 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4feea80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4feeaa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4feeae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4feeb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4feebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4feebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4feebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100194 td 0xfffffe010dce91e0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4fe9a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4fe9aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4fe9ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4fe9b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4fe9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4fe9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4fe9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100210 td 0xfffffe010de891e0 sched_switch() at sched_switch+0x5af/frame 0xfffffe010e64aa80 mi_switch() at mi_switch+0x155/frame 0xfffffe010e64aaa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe010e64aae0 _sleep() at _sleep+0x32f/frame 0xfffffe010e64ab80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010e64abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe010e64abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010e64abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command init pid 1 tid 100002 td 0xfffffe00e4c5bac0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00377816d0 mi_switch() at mi_switch+0x155/frame 0xfffffe00377816f0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0037781730 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0037781780 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0037781790 _sleep() at _sleep+0x325/frame 0xfffffe0037781830 kern_wait6() at kern_wait6+0x474/frame 0xfffffe00377818c0 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0037781ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0037781bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0037781bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x28e2aa, rsp = 0x7fffffffe718, rbp = 0x7fffffffe780 --- Tracing command KTLS pid 2 tid 100077 td 0xfffffe00e4d001e0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e49479b0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e49479d0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4947a10 _sleep() at _sleep+0x32f/frame 0xfffffe00e4947ab0 ktls_work_thread() at ktls_work_thread+0xdc/frame 0xfffffe00e4947bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4947bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4947bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command KTLS pid 2 tid 100078 td 0xfffffe00e4cffac0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e49429b0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e49429d0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4942a10 _sleep() at _sleep+0x32f/frame 0xfffffe00e4942ab0 ktls_work_thread() at ktls_work_thread+0xdc/frame 0xfffffe00e4942bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4942bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4942bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command KTLS pid 2 tid 100079 td 0xfffffe00e4cff3a0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e49519b0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e49519d0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4951a10 _sleep() at _sleep+0x32f/frame 0xfffffe00e4951ab0 ktls_work_thread() at ktls_work_thread+0xdc/frame 0xfffffe00e4951bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4951bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4951bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command KTLS pid 2 tid 100080 td 0xfffffe00e4cfec80 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e494c9b0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e494c9d0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e494ca10 _sleep() at _sleep+0x32f/frame 0xfffffe00e494cab0 ktls_work_thread() at ktls_work_thread+0xdc/frame 0xfffffe00e494cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e494cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e494cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command KTLS pid 2 tid 100081 td 0xfffffe00e4cfe560 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e495b9b0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e495b9d0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e495ba10 _sleep() at _sleep+0x32f/frame 0xfffffe00e495bab0 ktls_work_thread() at ktls_work_thread+0xdc/frame 0xfffffe00e495bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e495bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e495bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command KTLS pid 2 tid 100082 td 0xfffffe00e4cfde40 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e49569b0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e49569d0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4956a10 _sleep() at _sleep+0x32f/frame 0xfffffe00e4956ab0 ktls_work_thread() at ktls_work_thread+0xdc/frame 0xfffffe00e4956bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4956bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4956bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command KTLS pid 2 tid 100083 td 0xfffffe00e4cfd720 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e49659b0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e49659d0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4965a10 _sleep() at _sleep+0x32f/frame 0xfffffe00e4965ab0 ktls_work_thread() at ktls_work_thread+0xdc/frame 0xfffffe00e4965bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4965bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4965bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command KTLS pid 2 tid 100084 td 0xfffffe00e4cfd000 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e49609b0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e49609d0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4960a10 _sleep() at _sleep+0x32f/frame 0xfffffe00e4960ab0 ktls_work_thread() at ktls_work_thread+0xdc/frame 0xfffffe00e4960bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4960bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4960bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command KTLS pid 2 tid 100085 td 0xfffffe00e4d01740 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e496f9b0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e496f9d0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e496fa10 _sleep() at _sleep+0x32f/frame 0xfffffe00e496fab0 ktls_work_thread() at ktls_work_thread+0xdc/frame 0xfffffe00e496fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e496fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e496fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command KTLS pid 2 tid 100086 td 0xfffffe00e4d01020 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e496a9b0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e496a9d0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e496aa10 _sleep() at _sleep+0x32f/frame 0xfffffe00e496aab0 ktls_work_thread() at ktls_work_thread+0xdc/frame 0xfffffe00e496abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e496abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e496abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command KTLS pid 2 tid 100087 td 0xfffffe00e4d00900 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e49799b0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e49799d0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4979a10 _sleep() at _sleep+0x32f/frame 0xfffffe00e4979ab0 ktls_work_thread() at ktls_work_thread+0xdc/frame 0xfffffe00e4979bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4979bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4979bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command KTLS pid 2 tid 100088 td 0xfffffe00e4d051e0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e49749b0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e49749d0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4974a10 _sleep() at _sleep+0x32f/frame 0xfffffe00e4974ab0 ktls_work_thread() at ktls_work_thread+0xdc/frame 0xfffffe00e4974bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4974bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4974bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100119 td 0xfffffe00e4d25020 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4e40a70 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e40a90 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e40ad0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4e40b70 crypto_proc() at crypto_proc+0xbf/frame 0xfffffe00e4e40bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e40bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e40bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 0 pid 4 tid 100120 td 0xfffffe00e4d24900 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4e3ba70 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e3ba90 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e3bad0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4e3bb70 crypto_ret_proc() at crypto_ret_proc+0x144/frame 0xfffffe00e4e3bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e3bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e3bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 1 pid 5 tid 100121 td 0xfffffe00e4d291e0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4e4aa70 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e4aa90 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e4aad0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4e4ab70 crypto_ret_proc() at crypto_ret_proc+0x144/frame 0xfffffe00e4e4abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e4abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e4abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 2 pid 6 tid 100122 td 0xfffffe00e4d28ac0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4e45a70 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e45a90 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e45ad0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4e45b70 crypto_ret_proc() at crypto_ret_proc+0x144/frame 0xfffffe00e4e45bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e45bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e45bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 3 pid 7 tid 100123 td 0xfffffe00e4d283a0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4e54a70 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e54a90 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e54ad0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4e54b70 crypto_ret_proc() at crypto_ret_proc+0x144/frame 0xfffffe00e4e54bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e54bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e54bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 4 pid 8 tid 100124 td 0xfffffe00e4d27c80 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4e4fa70 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e4fa90 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e4fad0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4e4fb70 crypto_ret_proc() at crypto_ret_proc+0x144/frame 0xfffffe00e4e4fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e4fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e4fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 5 pid 9 tid 100125 td 0xfffffe00e4d27560 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4e5ea70 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e5ea90 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e5ead0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4e5eb70 crypto_ret_proc() at crypto_ret_proc+0x144/frame 0xfffffe00e4e5ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e5ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e5ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command audit pid 10 tid 100001 td 0xfffffe00e4c5c1e0 sched_switch() at sched_switch+0x5af/frame 0xfffffe0037786a90 mi_switch() at mi_switch+0x155/frame 0xfffffe0037786ab0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0037786af0 _cv_wait() at _cv_wait+0x166/frame 0xfffffe0037786b50 audit_worker() at audit_worker+0x9f/frame 0xfffffe0037786bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037786bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037786bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100003 td 0xfffffe00e4c5b3a0 (CPU 0) cpustop_handler() at cpustop_handler+0x28/frame 0xffffffff81ff9220 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xffffffff81ff9230 trap() at trap+0x56/frame 0xffffffff81ff9340 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81ff9340 --- trap 0x13, rip = 0xffffffff810a50d6, rsp = 0xfffffe0037790a60, rbp = 0xfffffe0037790a60 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0037790a60 acpi_cpu_idle() at acpi_cpu_idle+0x288/frame 0xfffffe0037790aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe0037790ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe0037790ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe0037790bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037790bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037790bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffffe00e4c5ac80 sched_switch() at sched_switch+0x5af/frame 0xfffffe003778bac0 mi_switch() at mi_switch+0x155/frame 0xfffffe003778bae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe003778bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003778bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003778bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffffe00e4c5a560 (CPU 2) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce2de00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce2de10 trap() at trap+0x56/frame 0xfffffe003ce2df20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce2df20 --- trap 0x13, rip = 0xffffffff810a50d6, rsp = 0xfffffe003779aa60, rbp = 0xfffffe003779aa60 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe003779aa60 acpi_cpu_idle() at acpi_cpu_idle+0x288/frame 0xfffffe003779aaa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe003779aac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe003779aae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe003779abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003779abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003779abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffffe00e4c59e40 (CPU 3) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce3ae00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce3ae10 trap() at trap+0x56/frame 0xfffffe003ce3af20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce3af20 --- trap 0x13, rip = 0xffffffff810a50d6, rsp = 0xfffffe0037795a60, rbp = 0xfffffe0037795a60 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0037795a60 acpi_cpu_idle() at acpi_cpu_idle+0x288/frame 0xfffffe0037795aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe0037795ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe0037795ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe0037795bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037795bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037795bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffffe00e4c59720 (CPU 4) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce47e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce47e10 trap() at trap+0x56/frame 0xfffffe003ce47f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce47f20 --- trap 0x13, rip = 0xffffffff810a50d6, rsp = 0xfffffe00377a4a60, rbp = 0xfffffe00377a4a60 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00377a4a60 acpi_cpu_idle() at acpi_cpu_idle+0x288/frame 0xfffffe00377a4aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00377a4ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00377a4ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00377a4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377a4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377a4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffffe00e4c59000 (CPU 5) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce54e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce54e10 trap() at trap+0x56/frame 0xfffffe003ce54f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce54f20 --- trap 0x13, rip = 0xffffffff810a50d6, rsp = 0xfffffe003779fa60, rbp = 0xfffffe003779fa60 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe003779fa60 acpi_cpu_idle() at acpi_cpu_idle+0x288/frame 0xfffffe003779faa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe003779fac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe003779fae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe003779fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003779fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003779fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffffe00e4c5d740 sched_switch() at sched_switch+0x5af/frame 0xfffffe00377aeac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00377aeae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00377aebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377aebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377aebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffffe00e4c5d020 (CPU 7) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce6ee00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce6ee10 trap() at trap+0x56/frame 0xfffffe003ce6ef20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce6ef20 --- trap 0x13, rip = 0xffffffff810a50d6, rsp = 0xfffffe00377a9a60, rbp = 0xfffffe00377a9a60 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00377a9a60 acpi_cpu_idle() at acpi_cpu_idle+0x288/frame 0xfffffe00377a9aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00377a9ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00377a9ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00377a9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377a9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377a9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffffe00e4c5c900 (CPU 8) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce7be00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce7be10 trap() at trap+0x56/frame 0xfffffe003ce7bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce7bf20 --- trap 0x13, rip = 0xffffffff810a50d6, rsp = 0xfffffe00377b8a60, rbp = 0xfffffe00377b8a60 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00377b8a60 acpi_cpu_idle() at acpi_cpu_idle+0x288/frame 0xfffffe00377b8aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00377b8ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00377b8ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00377b8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377b8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377b8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffffe00e4c611e0 (CPU 9) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce88e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce88e10 trap() at trap+0x56/frame 0xfffffe003ce88f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce88f20 --- trap 0x13, rip = 0xffffffff810a50d6, rsp = 0xfffffe00377b3a60, rbp = 0xfffffe00377b3a60 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00377b3a60 acpi_cpu_idle() at acpi_cpu_idle+0x288/frame 0xfffffe00377b3aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00377b3ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00377b3ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00377b3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377b3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377b3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffffe00e4c60ac0 (CPU 10) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce95e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce95e10 trap() at trap+0x56/frame 0xfffffe003ce95f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce95f20 --- trap 0x13, rip = 0xffffffff810a50d6, rsp = 0xfffffe00377c2a60, rbp = 0xfffffe00377c2a60 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00377c2a60 acpi_cpu_idle() at acpi_cpu_idle+0x288/frame 0xfffffe00377c2aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00377c2ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00377c2ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00377c2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377c2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377c2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffffe00e4c603a0 (CPU 11) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003cea2e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003cea2e10 trap() at trap+0x56/frame 0xfffffe003cea2f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003cea2f20 --- trap 0x13, rip = 0xffffffff810a50d6, rsp = 0xfffffe00377bda60, rbp = 0xfffffe00377bda60 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00377bda60 acpi_cpu_idle() at acpi_cpu_idle+0x288/frame 0xfffffe00377bdaa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00377bdac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00377bdae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00377bdbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377bdbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377bdbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100046 td 0xfffffe00e4cebac0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e488ab00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e488ab20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e488abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e488abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e488abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100047 td 0xfffffe00e4ceb3a0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4899b00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4899b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4899bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4899bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4899bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100049 td 0xfffffe00e4cea560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100089 td 0xfffffe00e4d04ac0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4983b00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4983b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4983bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4983bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4983bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100090 td 0xfffffe00e4d043a0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e497eb00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e497eb20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e497ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e497ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e497ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100091 td 0xfffffe00e4d03c80 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e498db00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e498db20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e498dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e498dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e498dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100092 td 0xfffffe00e4d03560 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4988b00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4988b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4988bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4988bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4988bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100093 td 0xfffffe00e4d02e40 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4997b00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4997b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4997bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4997bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4997bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100094 td 0xfffffe00e4d02720 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4992b00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4992b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4992bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4992bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4992bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100095 td 0xfffffe00e4d02000 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e49a1b00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e49a1b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e49a1bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49a1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49a1bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100096 td 0xfffffe00e4d06740 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e499cb00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e499cb20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e499cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e499cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e499cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100097 td 0xfffffe00e4d06020 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e49abb00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e49abb20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e49abbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49abbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49abbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100098 td 0xfffffe00e4d05900 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e49a6b00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e49a6b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e49a6bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49a6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49a6bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100099 td 0xfffffe00e4d0a1e0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e49b5b00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e49b5b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e49b5bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49b5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49b5bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100100 td 0xfffffe00e4d09ac0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e49b0b00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e49b0b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e49b0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49b0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49b0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100101 td 0xfffffe00e4d093a0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e49bfb00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e49bfb20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e49bfbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49bfbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49bfbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100102 td 0xfffffe00e4d08c80 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100137 td 0xfffffe00e4d3f740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100138 td 0xfffffe00e4d3f020 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4e95b00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e95b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4e95bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e95bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e95bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100139 td 0xfffffe00e4d3e900 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4ea4b00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4ea4b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4ea4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ea4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ea4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100145 td 0xfffffe010a18ae40 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4ec2b00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4ec2b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4ec2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ec2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ec2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100156 td 0xfffffe010a6d7e40 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100157 td 0xfffffe010a6d7720 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4f0ab00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4f0ab20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4f0abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f0abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f0abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100175 td 0xfffffe010deadc80 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4f94b00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4f94b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4f94bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f94bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f94bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100176 td 0xfffffe010dead560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100177 td 0xfffffe010deace40 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100178 td 0xfffffe010deac720 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100179 td 0xfffffe010deac000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100180 td 0xfffffe010deb0740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100181 td 0xfffffe010deb0020 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100182 td 0xfffffe010deaf900 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100183 td 0xfffffe010e0491e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100184 td 0xfffffe010e048ac0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100185 td 0xfffffe010e0483a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100186 td 0xfffffe010e047c80 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100187 td 0xfffffe010e047560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100188 td 0xfffffe010e046e40 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100189 td 0xfffffe010e046720 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100195 td 0xfffffe010dce8ac0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4ff8b00 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4ff8b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4ff8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ff8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ff8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100196 td 0xfffffe010dcea740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100197 td 0xfffffe010dcea020 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100198 td 0xfffffe010dce9900 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100199 td 0xfffffe010dd401e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100200 td 0xfffffe010dd3fac0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100201 td 0xfffffe010dd3f3a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100202 td 0xfffffe010dd3ec80 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100203 td 0xfffffe010dd3e560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100204 td 0xfffffe010dd3de40 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100205 td 0xfffffe010dd3d720 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100206 td 0xfffffe010dd3d000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100207 td 0xfffffe010dd41740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100208 td 0xfffffe010dd41020 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100209 td 0xfffffe010dd40900 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100272 td 0xfffffe010de86000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100273 td 0xfffffe01436461e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100274 td 0xfffffe0143645ac0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100275 td 0xfffffe01436453a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100276 td 0xfffffe0143644c80 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100277 td 0xfffffe0143644560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100278 td 0xfffffe0143643e40 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100279 td 0xfffffe0143643720 fork_trampoline() at fork_trampoline Tracing command geom pid 13 tid 100104 td 0xfffffe00e4d07e40 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e49e8a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e49e8aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e49e8ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e49e8b80 g_run_events() at g_run_events+0x474/frame 0xfffffe00e49e8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49e8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49e8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100105 td 0xfffffe00e4d07720 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e49f7a70 mi_switch() at mi_switch+0x155/frame 0xfffffe00e49f7a90 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e49f7ad0 _sleep() at _sleep+0x32f/frame 0xfffffe00e49f7b70 g_io_schedule_up() at g_io_schedule_up+0x3c/frame 0xfffffe00e49f7ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe00e49f7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49f7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49f7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100106 td 0xfffffe00e4d07000 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e49f2a70 mi_switch() at mi_switch+0x155/frame 0xfffffe00e49f2a90 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e49f2ad0 _sleep() at _sleep+0x32f/frame 0xfffffe00e49f2b70 g_io_schedule_down() at g_io_schedule_down+0x4c/frame 0xfffffe00e49f2ba0 g_down_procbody() at g_down_procbody+0x5c/frame 0xfffffe00e49f2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49f2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49f2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 6 pid 14 tid 100126 td 0xfffffe00e4d26e40 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4e59a70 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e59a90 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e59ad0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4e59b70 crypto_ret_proc() at crypto_ret_proc+0x144/frame 0xfffffe00e4e59bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e59bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e59bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 7 pid 15 tid 100127 td 0xfffffe00e4d26720 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4e68a70 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e68a90 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e68ad0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4e68b70 crypto_ret_proc() at crypto_ret_proc+0x144/frame 0xfffffe00e4e68bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e68bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e68bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 8 pid 16 tid 100128 td 0xfffffe00e4d26000 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4e63a70 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e63a90 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e63ad0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4e63b70 crypto_ret_proc() at crypto_ret_proc+0x144/frame 0xfffffe00e4e63bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e63bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e63bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 9 pid 17 tid 100129 td 0xfffffe00e4d2a740 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4e72a70 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e72a90 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e72ad0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4e72b70 crypto_ret_proc() at crypto_ret_proc+0x144/frame 0xfffffe00e4e72bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e72bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e72bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 10 pid 18 tid 100130 td 0xfffffe00e4d2a020 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4e6da70 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e6da90 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e6dad0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4e6db70 crypto_ret_proc() at crypto_ret_proc+0x144/frame 0xfffffe00e4e6dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e6dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e6dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 11 pid 19 tid 100131 td 0xfffffe00e4d29900 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4e7ca70 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e7ca90 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e7cad0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4e7cb70 crypto_ret_proc() at crypto_ret_proc+0x144/frame 0xfffffe00e4e7cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e7cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e7cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sequencer 00 pid 20 tid 100132 td 0xfffffe00e4d3e1e0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4e77a70 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e77a90 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e77ad0 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4e77b30 seq_eventthread() at seq_eventthread+0x8c/frame 0xfffffe00e4e77bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e77bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e77bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 21 tid 100133 td 0xfffffe00e4d3dac0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4e86a60 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e86a80 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e86ac0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4e86b60 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe00e4e86bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e86bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e86bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 21 tid 100134 td 0xfffffe00e4d3d3a0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4e81a60 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e81a80 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e81ac0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4e81b60 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe00e4e81bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e81bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e81bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 21 tid 100135 td 0xfffffe00e4d3cc80 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4e90a60 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e90a80 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e90ac0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4e90b60 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe00e4e90bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e90bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e90bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 21 tid 100136 td 0xfffffe00e4d3c560 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4e8ba60 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e8ba80 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e8bac0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4e8bb60 xpt_async_td() at xpt_async_td+0x74/frame 0xfffffe00e4e8bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e8bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e8bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 21 tid 100168 td 0xfffffe010d672720 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4f67a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4f67aa0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4f67ae0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4f67b80 xpt_scanner_thread() at xpt_scanner_thread+0x158/frame 0xfffffe00e4f67bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f67bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f67bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 22 tid 100140 td 0xfffffe010a18d1e0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4e9fac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4e9fae0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4e9fb20 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4e9fb80 usb_process() at usb_process+0xb3/frame 0xfffffe00e4e9fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e9fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e9fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 22 tid 100141 td 0xfffffe010a18cac0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4eaeac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4eaeae0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4eaeb20 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4eaeb80 usb_process() at usb_process+0xb3/frame 0xfffffe00e4eaebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4eaebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4eaebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 22 tid 100142 td 0xfffffe010a18c3a0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4ea9ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4ea9ae0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4ea9b20 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4ea9b80 usb_process() at usb_process+0xb3/frame 0xfffffe00e4ea9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ea9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ea9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 22 tid 100143 td 0xfffffe010a18bc80 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4eb8ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4eb8ae0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4eb8b20 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4eb8b80 usb_process() at usb_process+0xb3/frame 0xfffffe00e4eb8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4eb8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4eb8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 22 tid 100144 td 0xfffffe010a18b560 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4eb3ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4eb3ae0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4eb3b20 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4eb3b80 usb_process() at usb_process+0xb3/frame 0xfffffe00e4eb3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4eb3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4eb3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 22 tid 100146 td 0xfffffe010a18a720 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4ebdac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4ebdae0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4ebdb20 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4ebdb80 usb_process() at usb_process+0xb3/frame 0xfffffe00e4ebdbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ebdbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ebdbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 22 tid 100147 td 0xfffffe010a18a000 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4eccac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4eccae0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4eccb20 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4eccb80 usb_process() at usb_process+0xb3/frame 0xfffffe00e4eccbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4eccbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4eccbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 22 tid 100148 td 0xfffffe010a18e740 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4ec7ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4ec7ae0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4ec7b20 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4ec7b80 usb_process() at usb_process+0xb3/frame 0xfffffe00e4ec7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ec7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ec7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 22 tid 100149 td 0xfffffe010a18e020 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4ed6ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4ed6ae0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4ed6b20 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4ed6b80 usb_process() at usb_process+0xb3/frame 0xfffffe00e4ed6bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ed6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ed6bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 22 tid 100150 td 0xfffffe010a18d900 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4ed1ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4ed1ae0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4ed1b20 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4ed1b80 usb_process() at usb_process+0xb3/frame 0xfffffe00e4ed1bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ed1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ed1bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 22 tid 100151 td 0xfffffe010a6da1e0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4eecac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4eecae0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4eecb20 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4eecb80 usb_process() at usb_process+0xb3/frame 0xfffffe00e4eecbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4eecbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4eecbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 22 tid 100152 td 0xfffffe010a6d9ac0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4ee7ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4ee7ae0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4ee7b20 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4ee7b80 usb_process() at usb_process+0xb3/frame 0xfffffe00e4ee7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ee7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ee7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 22 tid 100153 td 0xfffffe010a6d93a0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4ef6ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4ef6ae0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4ef6b20 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4ef6b80 usb_process() at usb_process+0xb3/frame 0xfffffe00e4ef6bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ef6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ef6bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 22 tid 100154 td 0xfffffe010a6d8c80 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4ef1ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4ef1ae0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4ef1b20 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4ef1b80 usb_process() at usb_process+0xb3/frame 0xfffffe00e4ef1bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ef1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ef1bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 22 tid 100155 td 0xfffffe010a6d8560 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4f00ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4f00ae0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4f00b20 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4f00b80 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f00bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f00bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f00bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod1 pid 23 tid 100159 td 0xfffffe010a6db740 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4f2ca30 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4f2ca50 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4f2ca90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e4f2cad0 _sleep() at _sleep+0x298/frame 0xfffffe00e4f2cb70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe00e4f2cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f2cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f2cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod2 pid 24 tid 100160 td 0xfffffe010a6db020 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4f27a30 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4f27a50 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4f27a90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e4f27ad0 _sleep() at _sleep+0x298/frame 0xfffffe00e4f27b70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe00e4f27bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f27bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f27bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod3 pid 25 tid 100161 td 0xfffffe010a6da900 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4f36a30 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4f36a50 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4f36a90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e4f36ad0 _sleep() at _sleep+0x298/frame 0xfffffe00e4f36b70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe00e4f36bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f36bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f36bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod4 pid 26 tid 100162 td 0xfffffe010d6751e0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4f31a30 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4f31a50 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4f31a90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e4f31ad0 _sleep() at _sleep+0x298/frame 0xfffffe00e4f31b70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe00e4f31bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f31bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f31bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command rand_harvestq pid 27 tid 100163 td 0xfffffe010d674ac0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4f589e0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4f58a00 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4f58a40 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e4f58a80 _sleep() at _sleep+0x298/frame 0xfffffe00e4f58b20 random_kthread() at random_kthread+0x87/frame 0xfffffe00e4f58bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f58bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f58bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon0 pid 28 tid 100169 td 0xfffffe010d676740 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4f76a40 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4f76a60 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4f76aa0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4f76b40 enc_daemon() at enc_daemon+0xf6/frame 0xfffffe00e4f76bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f76bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f76bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon1 pid 29 tid 100170 td 0xfffffe010d676020 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4f71a40 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4f71a60 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4f71aa0 _sleep() at _sleep+0x32f/frame 0xfffffe00e4f71b40 enc_daemon() at enc_daemon+0xf6/frame 0xfffffe00e4f71bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f71bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f71bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100211 td 0xfffffe010de88ac0 sched_switch() at sched_switch+0x5af/frame 0xfffffe010e645770 mi_switch() at mi_switch+0x155/frame 0xfffffe010e645790 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe010e6457d0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010e645810 _sleep() at _sleep+0x298/frame 0xfffffe010e6458b0 vm_pageout_worker() at vm_pageout_worker+0x29c/frame 0xfffffe010e645b70 vm_pageout() at vm_pageout+0x1d7/frame 0xfffffe010e645bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe010e645bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010e645bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100221 td 0xfffffe010e1b21e0 sched_switch() at sched_switch+0x5af/frame 0xfffffe0116916830 mi_switch() at mi_switch+0x155/frame 0xfffffe0116916850 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0116916890 _sleep() at _sleep+0x32f/frame 0xfffffe0116916930 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0xb9c/frame 0xfffffe0116916bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0116916bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0116916bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100222 td 0xfffffe010e1b1ac0 sched_switch() at sched_switch+0x5af/frame 0xfffffe011670fa40 mi_switch() at mi_switch+0x155/frame 0xfffffe011670fa60 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe011670faa0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe011670fae0 _sleep() at _sleep+0x298/frame 0xfffffe011670fb80 uma_reclaim_worker() at uma_reclaim_worker+0xc8/frame 0xfffffe011670fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe011670fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe011670fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vmdaemon pid 31 tid 100212 td 0xfffffe010de883a0 sched_switch() at sched_switch+0x5af/frame 0xfffffe010e660a40 mi_switch() at mi_switch+0x155/frame 0xfffffe010e660a60 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe010e660aa0 _sleep() at _sleep+0x32f/frame 0xfffffe010e660b40 vm_daemon() at vm_daemon+0x82/frame 0xfffffe010e660bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe010e660bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010e660bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100213 td 0xfffffe010de87c80 sched_switch() at sched_switch+0x5af/frame 0xfffffe010e65ba20 mi_switch() at mi_switch+0x155/frame 0xfffffe010e65ba40 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe010e65ba80 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010e65bac0 _sleep() at _sleep+0x298/frame 0xfffffe010e65bb60 buf_daemon() at buf_daemon+0x116/frame 0xfffffe010e65bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe010e65bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010e65bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100214 td 0xfffffe010dce83a0 sched_switch() at sched_switch+0x5af/frame 0xfffffe00e4ff3a10 mi_switch() at mi_switch+0x155/frame 0xfffffe00e4ff3a30 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe00e4ff3a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e4ff3ab0 _sleep() at _sleep+0x298/frame 0xfffffe00e4ff3b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00e4ff3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ff3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ff3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100215 td 0xfffffe010dce7c80 sched_switch() at sched_switch+0x5af/frame 0xfffffe010f67aa10 mi_switch() at mi_switch+0x155/frame 0xfffffe010f67aa30 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe010f67aa70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010f67aab0 _sleep() at _sleep+0x298/frame 0xfffffe010f67ab50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe010f67abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe010f67abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010f67abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100216 td 0xfffffe010dce7560 sched_switch() at sched_switch+0x5af/frame 0xfffffe010f170a10 mi_switch() at mi_switch+0x155/frame 0xfffffe010f170a30 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe010f170a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010f170ab0 _sleep() at _sleep+0x298/frame 0xfffffe010f170b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe010f170bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe010f170bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010f170bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100217 td 0xfffffe010dce6e40 sched_switch() at sched_switch+0x5af/frame 0xfffffe010fc8aa10 mi_switch() at mi_switch+0x155/frame 0xfffffe010fc8aa30 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe010fc8aa70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010fc8aab0 _sleep() at _sleep+0x298/frame 0xfffffe010fc8ab50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe010fc8abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe010fc8abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010fc8abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100218 td 0xfffffe010dce6720 sched_switch() at sched_switch+0x5af/frame 0xfffffe010fb84a10 mi_switch() at mi_switch+0x155/frame 0xfffffe010fb84a30 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe010fb84a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010fb84ab0 _sleep() at _sleep+0x298/frame 0xfffffe010fb84b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe010fb84bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe010fb84bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010fb84bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100219 td 0xfffffe010dce6000 sched_switch() at sched_switch+0x5af/frame 0xfffffe011029aa10 mi_switch() at mi_switch+0x155/frame 0xfffffe011029aa30 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe011029aa70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe011029aab0 _sleep() at _sleep+0x298/frame 0xfffffe011029ab50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe011029abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe011029abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe011029abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100220 td 0xfffffe010de8a740 sched_switch() at sched_switch+0x5af/frame 0xfffffe0110295a10 mi_switch() at mi_switch+0x155/frame 0xfffffe0110295a30 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0110295a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0110295ab0 _sleep() at _sleep+0x298/frame 0xfffffe0110295b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe0110295bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0110295bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0110295bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100237 td 0xfffffe010e5a4020 sched_switch() at sched_switch+0x5af/frame 0xfffffe014162ea30 mi_switch() at mi_switch+0x155/frame 0xfffffe014162ea50 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe014162ea90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe014162ead0 _sleep() at _sleep+0x298/frame 0xfffffe014162eb70 softdep_flush() at softdep_flush+0x188/frame 0xfffffe014162ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe014162ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe014162ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100243 td 0xfffffe010e5a23a0 sched_switch() at sched_switch+0x5af/frame 0xfffffe0141658a30 mi_switch() at mi_switch+0x155/frame 0xfffffe0141658a50 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0141658a90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0141658ad0 _sleep() at _sleep+0x298/frame 0xfffffe0141658b70 softdep_flush() at softdep_flush+0x188/frame 0xfffffe0141658bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0141658bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0141658bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100346 td 0xfffffe0144130740 sched_switch() at sched_switch+0x5af/frame 0xfffffe014441da30 mi_switch() at mi_switch+0x155/frame 0xfffffe014441da50 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe014441da90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe014441dad0 _sleep() at _sleep+0x298/frame 0xfffffe014441db70 softdep_flush() at softdep_flush+0x188/frame 0xfffffe014441dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe014441dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe014441dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vnlru pid 33 tid 100223 td 0xfffffe010de87560 sched_switch() at sched_switch+0x5af/frame 0xfffffe01415ca9d0 mi_switch() at mi_switch+0x155/frame 0xfffffe01415ca9f0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01415caa30 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe01415caa70 _sleep() at _sleep+0x298/frame 0xfffffe01415cab10 vnlru_proc() at vnlru_proc+0xa2c/frame 0xfffffe01415cabb0 fork_exit() at fork_exit+0x80/frame 0xfffffe01415cabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01415cabf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command syncer pid 34 tid 100224 td 0xfffffe010de86e40 sched_switch() at sched_switch+0x5af/frame 0xfffffe01415c5a00 mi_switch() at mi_switch+0x155/frame 0xfffffe01415c5a20 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01415c5a60 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe01415c5aa0 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x19b/frame 0xfffffe01415c5b20 sched_sync() at sched_sync+0x63d/frame 0xfffffe01415c5bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe01415c5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01415c5bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command dhclient pid 2339 tid 100286 td 0xfffffe0143646900 sched_switch() at sched_switch+0x5af/frame 0xfffffe0141758720 mi_switch() at mi_switch+0x155/frame 0xfffffe0141758740 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0141758780 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01417587d0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01417587e0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe0141758840 seltdwait() at seltdwait+0x8d/frame 0xfffffe0141758880 kern_select() at kern_select+0xa4e/frame 0xfffffe0141758a80 sys_select() at sys_select+0x56/frame 0xfffffe0141758ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0141758bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141758bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8011e525a, rsp = 0x7fffffffe938, rbp = 0x7fffffffe9f0 --- Tracing command dhclient pid 2342 tid 100285 td 0xfffffe0143647020 sched_switch() at sched_switch+0x5af/frame 0xfffffe0141733760 mi_switch() at mi_switch+0x155/frame 0xfffffe0141733780 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01417337c0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0141733810 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0141733820 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe0141733880 seltdwait() at seltdwait+0x8d/frame 0xfffffe01417338c0 kern_poll_kfds() at kern_poll_kfds+0x41b/frame 0xfffffe0141733950 kern_poll() at kern_poll+0x9f/frame 0xfffffe0141733aa0 sys_poll() at sys_poll+0x50/frame 0xfffffe0141733ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0141733bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141733bf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8011e515a, rsp = 0x7fffffffeb78, rbp = 0x7fffffffebb0 --- Tracing command dhclient pid 2401 tid 100291 td 0xfffffe0143ece1e0 sched_switch() at sched_switch+0x5af/frame 0xfffffe0141776710 mi_switch() at mi_switch+0x155/frame 0xfffffe0141776730 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0141776770 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01417767c0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe0141776800 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x19b/frame 0xfffffe0141776880 seltdwait() at seltdwait+0x7f/frame 0xfffffe01417768c0 kern_poll_kfds() at kern_poll_kfds+0x41b/frame 0xfffffe0141776950 kern_poll() at kern_poll+0x9f/frame 0xfffffe0141776aa0 sys_poll() at sys_poll+0x50/frame 0xfffffe0141776ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0141776bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141776bf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8011e515a, rsp = 0x7fffffffeb78, rbp = 0x7fffffffebb0 --- Tracing command devd pid 2406 tid 100227 td 0xfffffe010e3e6740 sched_switch() at sched_switch+0x5af/frame 0xfffffe01415e86d0 mi_switch() at mi_switch+0x155/frame 0xfffffe01415e86f0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01415e8730 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01415e8780 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe01415e87c0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x19b/frame 0xfffffe01415e8840 seltdwait() at seltdwait+0x7f/frame 0xfffffe01415e8880 kern_select() at kern_select+0xa4e/frame 0xfffffe01415e8a80 sys_select() at sys_select+0x56/frame 0xfffffe01415e8ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01415e8bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01415e8bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x28c62a, rsp = 0x7fffffffcab8, rbp = 0x7fffffffec50 --- Tracing command syslogd pid 2595 tid 100294 td 0xfffffe0143ecd3a0 sched_switch() at sched_switch+0x5af/frame 0xfffffe014178a720 mi_switch() at mi_switch+0x155/frame 0xfffffe014178a740 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe014178a780 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014178a7d0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe014178a7e0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe014178a840 seltdwait() at seltdwait+0x8d/frame 0xfffffe014178a880 kern_select() at kern_select+0xa4e/frame 0xfffffe014178aa80 sys_select() at sys_select+0x56/frame 0xfffffe014178aac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014178abf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014178abf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8011ca25a, rsp = 0x7fffffffe6b8, rbp = 0x7fffffffec20 --- Tracing command watchdogd pid 2603 tid 100266 td 0xfffffe01434f6020 sched_switch() at sched_switch+0x5af/frame 0xfffffe01416cb870 mi_switch() at mi_switch+0x155/frame 0xfffffe01416cb890 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01416cb8d0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01416cb920 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe01416cb960 _sleep() at _sleep+0x285/frame 0xfffffe01416cba00 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e1/frame 0xfffffe01416cba80 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe01416cbac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01416cbbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01416cbbf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8011c00fa, rsp = 0x7fffffffe9e8, rbp = 0x7fffffffea30 --- Tracing command rpcbind pid 2625 tid 100228 td 0xfffffe010e5a31e0 sched_switch() at sched_switch+0x5af/frame 0xfffffe01415f2710 mi_switch() at mi_switch+0x155/frame 0xfffffe01415f2730 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01415f2770 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01415f27c0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe01415f2800 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x19b/frame 0xfffffe01415f2880 seltdwait() at seltdwait+0x7f/frame 0xfffffe01415f28c0 kern_poll_kfds() at kern_poll_kfds+0x41b/frame 0xfffffe01415f2950 kern_poll() at kern_poll+0x9f/frame 0xfffffe01415f2aa0 sys_poll() at sys_poll+0x50/frame 0xfffffe01415f2ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01415f2bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01415f2bf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8011bb15a, rsp = 0x7fffffffc978, rbp = 0x7fffffffeba0 --- Tracing command rpc.statd pid 2650 tid 100232 td 0xfffffe00e4d3be40 sched_switch() at sched_switch+0x5af/frame 0xfffffe01416066d0 mi_switch() at mi_switch+0x155/frame 0xfffffe01416066f0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0141606730 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0141606780 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe01416067c0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x19b/frame 0xfffffe0141606840 seltdwait() at seltdwait+0x7f/frame 0xfffffe0141606880 kern_select() at kern_select+0xa4e/frame 0xfffffe0141606a80 sys_select() at sys_select+0x56/frame 0xfffffe0141606ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0141606bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141606bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8011b525a, rsp = 0x7fffffffe9f8, rbp = 0x7fffffffeb40 --- Tracing command rpc.lockd pid 2653 tid 100233 td 0xfffffe010e1b13a0 sched_switch() at sched_switch+0x5af/frame 0xfffffe0141610640 mi_switch() at mi_switch+0x155/frame 0xfffffe0141610660 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01416106a0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01416106f0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe0141610730 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x19b/frame 0xfffffe01416107b0 svc_run_internal() at svc_run_internal+0xac1/frame 0xfffffe01416108e0 svc_run() at svc_run+0x250/frame 0xfffffe0141610940 sys_nlm_syscall() at sys_nlm_syscall+0x74a/frame 0xfffffe0141610ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0141610bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141610bf0 --- syscall (154, FreeBSD ELF64, sys_nlm_syscall), rip = 0x8011bda3a, rsp = 0x7fffffffeb58, rbp = 0x7fffffffec20 --- Tracing command powerd pid 2658 tid 100267 td 0xfffffe01434ab020 sched_switch() at sched_switch+0x5af/frame 0xfffffe01416856d0 mi_switch() at mi_switch+0x155/frame 0xfffffe01416856f0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0141685730 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0141685780 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe01416857c0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x19b/frame 0xfffffe0141685840 seltdwait() at seltdwait+0x7f/frame 0xfffffe0141685880 kern_select() at kern_select+0xa4e/frame 0xfffffe0141685a80 sys_select() at sys_select+0x56/frame 0xfffffe0141685ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0141685bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141685bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8011c025a, rsp = 0x7fffffffeaf8, rbp = 0x7fffffffec30 --- Tracing command ntpd pid 2684 tid 100239 td 0xfffffe010e5ca1e0 sched_switch() at sched_switch+0x5af/frame 0xfffffe0141638720 mi_switch() at mi_switch+0x155/frame 0xfffffe0141638740 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0141638780 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01416387d0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01416387e0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe0141638840 seltdwait() at seltdwait+0x8d/frame 0xfffffe0141638880 kern_select() at kern_select+0xa4e/frame 0xfffffe0141638a80 sys_select() at sys_select+0x56/frame 0xfffffe0141638ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0141638bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141638bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8015da25a, rsp = 0x7fffffffde58, rbp = 0x7fffffffde90 --- Tracing command inetd pid 2710 tid 100295 td 0xfffffe0143eccc80 sched_switch() at sched_switch+0x5af/frame 0xfffffe0141785720 mi_switch() at mi_switch+0x155/frame 0xfffffe0141785740 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0141785780 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01417857d0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01417857e0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe0141785840 seltdwait() at seltdwait+0x8d/frame 0xfffffe0141785880 kern_select() at kern_select+0xa4e/frame 0xfffffe0141785a80 sys_select() at sys_select+0x56/frame 0xfffffe0141785ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0141785bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141785bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8011df25a, rsp = 0x7fffffffdd78, rbp = 0x7fffffffec10 --- Tracing command sshd pid 2729 tid 100303 td 0xfffffe010e5a0000 sched_switch() at sched_switch+0x5af/frame 0xfffffe01416df720 mi_switch() at mi_switch+0x155/frame 0xfffffe01416df740 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01416df780 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01416df7d0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01416df7e0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe01416df840 seltdwait() at seltdwait+0x8d/frame 0xfffffe01416df880 kern_select() at kern_select+0xa4e/frame 0xfffffe01416dfa80 sys_select() at sys_select+0x56/frame 0xfffffe01416dfac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01416dfbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01416dfbf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80169825a, rsp = 0x7fffffffe5c8, rbp = 0x7fffffffe600 --- Tracing command cron pid 2733 tid 100296 td 0xfffffe0143ecc560 sched_switch() at sched_switch+0x5af/frame 0xfffffe0141794870 mi_switch() at mi_switch+0x155/frame 0xfffffe0141794890 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01417948d0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0141794920 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe0141794960 _sleep() at _sleep+0x285/frame 0xfffffe0141794a00 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e1/frame 0xfffffe0141794a80 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe0141794ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0141794bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141794bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8011d70fa, rsp = 0x7fffffffea48, rbp = 0x7fffffffec20 --- Tracing command getty pid 2747 tid 100225 td 0xfffffe010e1b3740 sched_switch() at sched_switch+0x5af/frame 0xfffffe01415d47c0 mi_switch() at mi_switch+0x155/frame 0xfffffe01415d47e0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01415d4820 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01415d4870 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01415d4880 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe01415d48e0 tty_wait() at tty_wait+0x42/frame 0xfffffe01415d4910 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe01415d4970 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe01415d49a0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe01415d4a00 dofileread() at dofileread+0x81/frame 0xfffffe01415d4a50 sys_read() at sys_read+0xc0/frame 0xfffffe01415d4ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01415d4bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01415d4bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8011c41da, rsp = 0x7fffffffeb58, rbp = 0x7fffffffeba0 --- Tracing command getty pid 2748 tid 100252 td 0xfffffe01434a9ac0 sched_switch() at sched_switch+0x5af/frame 0xfffffe01416807c0 mi_switch() at mi_switch+0x155/frame 0xfffffe01416807e0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0141680820 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0141680870 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0141680880 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe01416808e0 tty_wait() at tty_wait+0x42/frame 0xfffffe0141680910 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe0141680970 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe01416809a0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe0141680a00 dofileread() at dofileread+0x81/frame 0xfffffe0141680a50 sys_read() at sys_read+0xc0/frame 0xfffffe0141680ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0141680bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141680bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8011c41da, rsp = 0x7fffffffeb58, rbp = 0x7fffffffeba0 --- Tracing command getty pid 2749 tid 100305 td 0xfffffe010e3e3c80 sched_switch() at sched_switch+0x5af/frame 0xfffffe014168f7c0 mi_switch() at mi_switch+0x155/frame 0xfffffe014168f7e0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe014168f820 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014168f870 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe014168f880 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe014168f8e0 tty_wait() at tty_wait+0x42/frame 0xfffffe014168f910 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe014168f970 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe014168f9a0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe014168fa00 dofileread() at dofileread+0x81/frame 0xfffffe014168fa50 sys_read() at sys_read+0xc0/frame 0xfffffe014168fac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014168fbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014168fbf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8011c41da, rsp = 0x7fffffffeb58, rbp = 0x7fffffffeba0 --- Tracing command getty pid 2750 tid 100306 td 0xfffffe010e3e3560 sched_switch() at sched_switch+0x5af/frame 0xfffffe01417b27c0 mi_switch() at mi_switch+0x155/frame 0xfffffe01417b27e0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01417b2820 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01417b2870 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01417b2880 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe01417b28e0 tty_wait() at tty_wait+0x42/frame 0xfffffe01417b2910 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe01417b2970 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe01417b29a0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe01417b2a00 dofileread() at dofileread+0x81/frame 0xfffffe01417b2a50 sys_read() at sys_read+0xc0/frame 0xfffffe01417b2ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01417b2bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01417b2bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8011c41da, rsp = 0x7fffffffeb58, rbp = 0x7fffffffeba0 --- Tracing command getty pid 2751 tid 100307 td 0xfffffe010e3e2e40 sched_switch() at sched_switch+0x5af/frame 0xfffffe01417ad7c0 mi_switch() at mi_switch+0x155/frame 0xfffffe01417ad7e0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01417ad820 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01417ad870 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01417ad880 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe01417ad8e0 tty_wait() at tty_wait+0x42/frame 0xfffffe01417ad910 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe01417ad970 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe01417ad9a0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe01417ada00 dofileread() at dofileread+0x81/frame 0xfffffe01417ada50 sys_read() at sys_read+0xc0/frame 0xfffffe01417adac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01417adbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01417adbf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8011c41da, rsp = 0x7fffffffeb58, rbp = 0x7fffffffeba0 --- Tracing command getty pid 2752 tid 100308 td 0xfffffe010e3e2720 sched_switch() at sched_switch+0x5af/frame 0xfffffe01417bc7c0 mi_switch() at mi_switch+0x155/frame 0xfffffe01417bc7e0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01417bc820 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01417bc870 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01417bc880 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe01417bc8e0 tty_wait() at tty_wait+0x42/frame 0xfffffe01417bc910 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe01417bc970 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe01417bc9a0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe01417bca00 dofileread() at dofileread+0x81/frame 0xfffffe01417bca50 sys_read() at sys_read+0xc0/frame 0xfffffe01417bcac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01417bcbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01417bcbf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8011c41da, rsp = 0x7fffffffeb58, rbp = 0x7fffffffeba0 --- Tracing command getty pid 2753 tid 100309 td 0xfffffe010e3e2000 sched_switch() at sched_switch+0x5af/frame 0xfffffe01417b77c0 mi_switch() at mi_switch+0x155/frame 0xfffffe01417b77e0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01417b7820 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01417b7870 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01417b7880 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe01417b78e0 tty_wait() at tty_wait+0x42/frame 0xfffffe01417b7910 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe01417b7970 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe01417b79a0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe01417b7a00 dofileread() at dofileread+0x81/frame 0xfffffe01417b7a50 sys_read() at sys_read+0xc0/frame 0xfffffe01417b7ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01417b7bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01417b7bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8011c41da, rsp = 0x7fffffffeb58, rbp = 0x7fffffffeba0 --- Tracing command getty pid 2754 tid 100310 td 0xfffffe01440111e0 sched_switch() at sched_switch+0x5af/frame 0xfffffe01417c67c0 mi_switch() at mi_switch+0x155/frame 0xfffffe01417c67e0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01417c6820 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01417c6870 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01417c6880 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe01417c68e0 tty_wait() at tty_wait+0x42/frame 0xfffffe01417c6910 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe01417c6970 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe01417c69a0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe01417c6a00 dofileread() at dofileread+0x81/frame 0xfffffe01417c6a50 sys_read() at sys_read+0xc0/frame 0xfffffe01417c6ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01417c6bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01417c6bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8011c41da, rsp = 0x7fffffffeb58, rbp = 0x7fffffffeba0 --- Tracing command getty pid 2755 tid 100311 td 0xfffffe0144010ac0 sched_switch() at sched_switch+0x5af/frame 0xfffffe01417c17c0 mi_switch() at mi_switch+0x155/frame 0xfffffe01417c17e0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01417c1820 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01417c1870 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01417c1880 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe01417c18e0 tty_wait() at tty_wait+0x42/frame 0xfffffe01417c1910 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe01417c1970 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe01417c19a0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe01417c1a00 dofileread() at dofileread+0x81/frame 0xfffffe01417c1a50 sys_read() at sys_read+0xc0/frame 0xfffffe01417c1ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01417c1bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01417c1bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8011c41da, rsp = 0x7fffffffeb58, rbp = 0x7fffffffeba0 --- Tracing command getty pid 2756 tid 100312 td 0xfffffe01440103a0 sched_switch() at sched_switch+0x5af/frame 0xfffffe01417d07c0 mi_switch() at mi_switch+0x155/frame 0xfffffe01417d07e0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01417d0820 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01417d0870 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01417d0880 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe01417d08e0 tty_wait() at tty_wait+0x42/frame 0xfffffe01417d0910 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe01417d0970 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe01417d09a0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe01417d0a00 dofileread() at dofileread+0x81/frame 0xfffffe01417d0a50 sys_read() at sys_read+0xc0/frame 0xfffffe01417d0ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01417d0bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01417d0bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8011c41da, rsp = 0x7fffffffeb58, rbp = 0x7fffffffeba0 --- Tracing command sshd pid 2761 tid 100236 td 0xfffffe010e3e4ac0 sched_switch() at sched_switch+0x5af/frame 0xfffffe01415d9760 mi_switch() at mi_switch+0x155/frame 0xfffffe01415d9780 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01415d97c0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01415d9810 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01415d9820 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe01415d9880 seltdwait() at seltdwait+0x8d/frame 0xfffffe01415d98c0 kern_poll_kfds() at kern_poll_kfds+0x41b/frame 0xfffffe01415d9950 kern_poll() at kern_poll+0x9f/frame 0xfffffe01415d9aa0 sys_poll() at sys_poll+0x50/frame 0xfffffe01415d9ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01415d9bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01415d9bf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x80169815a, rsp = 0x7fffffffe538, rbp = 0x7fffffffe570 --- Tracing command sshd pid 2765 tid 100313 td 0xfffffe0143ece900 sched_switch() at sched_switch+0x5af/frame 0xfffffe01417a3720 mi_switch() at mi_switch+0x155/frame 0xfffffe01417a3740 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01417a3780 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01417a37d0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01417a37e0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe01417a3840 seltdwait() at seltdwait+0x8d/frame 0xfffffe01417a3880 kern_select() at kern_select+0xa4e/frame 0xfffffe01417a3a80 sys_select() at sys_select+0x56/frame 0xfffffe01417a3ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01417a3bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01417a3bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80169825a, rsp = 0x7fffffffa4c8, rbp = 0x7fffffffa500 --- Tracing command bash pid 2766 tid 100304 td 0xfffffe01434f3c80 sched_switch() at sched_switch+0x5af/frame 0xfffffe01417296d0 mi_switch() at mi_switch+0x155/frame 0xfffffe01417296f0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0141729730 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0141729780 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0141729790 _sleep() at _sleep+0x325/frame 0xfffffe0141729830 kern_wait6() at kern_wait6+0x474/frame 0xfffffe01417298c0 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0141729ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0141729bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141729bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8005293ba, rsp = 0x7fffffffe738, rbp = 0x7fffffffe790 --- Tracing command su pid 2771 tid 100226 td 0xfffffe010e3e51e0 sched_switch() at sched_switch+0x5af/frame 0xfffffe01415de6d0 mi_switch() at mi_switch+0x155/frame 0xfffffe01415de6f0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01415de730 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01415de780 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01415de790 _sleep() at _sleep+0x325/frame 0xfffffe01415de830 kern_wait6() at kern_wait6+0x474/frame 0xfffffe01415de8c0 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe01415deac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01415debf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01415debf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8011ee3ba, rsp = 0x7fffffffe578, rbp = 0x7fffffffead0 --- Tracing command csh pid 2772 tid 100314 td 0xfffffe0144012740 sched_switch() at sched_switch+0x5af/frame 0xfffffe01417da860 mi_switch() at mi_switch+0x155/frame 0xfffffe01417da880 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01417da8c0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01417da910 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01417da920 _sleep() at _sleep+0x325/frame 0xfffffe01417da9c0 kern_sigsuspend() at kern_sigsuspend+0x1ec/frame 0xfffffe01417daa90 sys_sigsuspend() at sys_sigsuspend+0x31/frame 0xfffffe01417daac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01417dabf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01417dabf0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x80129231a, rsp = 0x7fffffffdf78, rbp = 0x7fffffffe000 --- Tracing command bash pid 2774 tid 100315 td 0xfffffe0144012020 sched_switch() at sched_switch+0x5af/frame 0xfffffe01417d56d0 mi_switch() at mi_switch+0x155/frame 0xfffffe01417d56f0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01417d5730 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01417d5780 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01417d5790 _sleep() at _sleep+0x325/frame 0xfffffe01417d5830 kern_wait6() at kern_wait6+0x474/frame 0xfffffe01417d58c0 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe01417d5ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01417d5bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01417d5bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8005293ba, rsp = 0x7fffffffe5f8, rbp = 0x7fffffffe650 --- Tracing command newnfs 0 pid 2790 tid 100316 td 0xfffffe0144011900 sched_switch() at sched_switch+0x5af/frame 0xfffffe01417e49e0 mi_switch() at mi_switch+0x155/frame 0xfffffe01417e4a00 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01417e4a40 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01417e4a90 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe01417e4ad0 _sleep() at _sleep+0x285/frame 0xfffffe01417e4b70 nfssvc_iod() at nfssvc_iod+0xfe/frame 0xfffffe01417e4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe01417e4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01417e4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sh pid 2798 tid 100269 td 0xfffffe01434aa900 sched_switch() at sched_switch+0x5af/frame 0xfffffe01416da6d0 mi_switch() at mi_switch+0x155/frame 0xfffffe01416da6f0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01416da730 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01416da780 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01416da790 _sleep() at _sleep+0x325/frame 0xfffffe01416da830 kern_wait6() at kern_wait6+0x474/frame 0xfffffe01416da8c0 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe01416daac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01416dabf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01416dabf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8012083ba, rsp = 0x7fffffffe4f8, rbp = 0x7fffffffe5a0 --- Tracing command sh pid 2883 tid 100323 td 0xfffffe014409a020 sched_switch() at sched_switch+0x5af/frame 0xfffffe01444096d0 mi_switch() at mi_switch+0x155/frame 0xfffffe01444096f0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0144409730 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0144409780 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0144409790 _sleep() at _sleep+0x325/frame 0xfffffe0144409830 kern_wait6() at kern_wait6+0x474/frame 0xfffffe01444098c0 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0144409ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0144409bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0144409bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8012083ba, rsp = 0x7fffffffe3d8, rbp = 0x7fffffffe480 --- Tracing command sh pid 2922 tid 100249 td 0xfffffe010de89900 sched_switch() at sched_switch+0x5af/frame 0xfffffe01416676d0 mi_switch() at mi_switch+0x155/frame 0xfffffe01416676f0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0141667730 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0141667780 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0141667790 _sleep() at _sleep+0x325/frame 0xfffffe0141667830 kern_wait6() at kern_wait6+0x474/frame 0xfffffe01416678c0 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0141667ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0141667bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141667bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8012083ba, rsp = 0x7fffffffe108, rbp = 0x7fffffffe1b0 --- Tracing command awk pid 2923 tid 100289 td 0xfffffe0143664020 sched_switch() at sched_switch+0x5af/frame 0xfffffe014176c840 mi_switch() at mi_switch+0x155/frame 0xfffffe014176c860 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe014176c8a0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014176c8f0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe014176c900 _sleep() at _sleep+0x325/frame 0xfffffe014176c9a0 pipe_read() at pipe_read+0x4c6/frame 0xfffffe014176ca00 dofileread() at dofileread+0x81/frame 0xfffffe014176ca50 sys_read() at sys_read+0xc0/frame 0xfffffe014176cac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014176cbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014176cbf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8012151da, rsp = 0x7fffffffe1f8, rbp = 0x7fffffffe210 --- Tracing command sh pid 2925 tid 100258 td 0xfffffe010e1af720 sched_switch() at sched_switch+0x5af/frame 0xfffffe01416b2840 mi_switch() at mi_switch+0x155/frame 0xfffffe01416b2860 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01416b28a0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01416b28f0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01416b2900 _sleep() at _sleep+0x325/frame 0xfffffe01416b29a0 pipe_read() at pipe_read+0x4c6/frame 0xfffffe01416b2a00 dofileread() at dofileread+0x81/frame 0xfffffe01416b2a50 sys_read() at sys_read+0xc0/frame 0xfffffe01416b2ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01416b2bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01416b2bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8012081da, rsp = 0x7fffffffdcc8, rbp = 0x7fffffffe1f0 --- Tracing command sleep pid 4074 tid 100345 td 0xfffffe014412eac0 sched_switch() at sched_switch+0x5af/frame 0xfffffe014448b870 mi_switch() at mi_switch+0x155/frame 0xfffffe014448b890 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe014448b8d0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014448b920 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe014448b960 _sleep() at _sleep+0x285/frame 0xfffffe014448ba00 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e1/frame 0xfffffe014448ba80 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe014448bac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014448bbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014448bbf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8011a60fa, rsp = 0x7fffffffe5b8, rbp = 0x7fffffffe610 --- Tracing command sh pid 4079 tid 100299 td 0xfffffe010e5c8c80 sched_switch() at sched_switch+0x5af/frame 0xfffffe014177b6d0 mi_switch() at mi_switch+0x155/frame 0xfffffe014177b6f0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe014177b730 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014177b780 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe014177b790 _sleep() at _sleep+0x325/frame 0xfffffe014177b830 kern_wait6() at kern_wait6+0x474/frame 0xfffffe014177b8c0 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe014177bac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014177bbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014177bbf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8012083ba, rsp = 0x7fffffffe198, rbp = 0x7fffffffe240 --- Tracing command sh pid 4080 tid 100344 td 0xfffffe014412f1e0 sched_switch() at sched_switch+0x5af/frame 0xfffffe01444906d0 mi_switch() at mi_switch+0x155/frame 0xfffffe01444906f0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0144490730 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0144490780 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0144490790 _sleep() at _sleep+0x325/frame 0xfffffe0144490830 kern_wait6() at kern_wait6+0x474/frame 0xfffffe01444908c0 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0144490ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0144490bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0144490bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8012083ba, rsp = 0x7fffffffe238, rbp = 0x7fffffffe2e0 --- Tracing command tee pid 4081 tid 100230 td 0xfffffe010d675900 sched_switch() at sched_switch+0x5af/frame 0xfffffe01415fc840 mi_switch() at mi_switch+0x155/frame 0xfffffe01415fc860 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01415fc8a0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01415fc8f0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01415fc900 _sleep() at _sleep+0x325/frame 0xfffffe01415fc9a0 pipe_read() at pipe_read+0x4c6/frame 0xfffffe01415fca00 dofileread() at dofileread+0x81/frame 0xfffffe01415fca50 sys_read() at sys_read+0xc0/frame 0xfffffe01415fcac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01415fcbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01415fcbf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8011a61da, rsp = 0x7fffffffe5c8, rbp = 0x7fffffffe620 --- Tracing command md10 pid 4092 tid 100301 td 0xfffffe0143ecf740 sched_switch() at sched_switch+0x5af/frame 0xfffffe01416d5a60 mi_switch() at mi_switch+0x155/frame 0xfffffe01416d5a80 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01416d5ac0 _sleep() at _sleep+0x32f/frame 0xfffffe01416d5b60 md_kthread() at md_kthread+0xd5/frame 0xfffffe01416d5bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe01416d5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01416d5bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command su pid 4100 tid 100336 td 0xfffffe014400f560 sched_switch() at sched_switch+0x5af/frame 0xfffffe01444546d0 mi_switch() at mi_switch+0x155/frame 0xfffffe01444546f0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0144454730 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0144454780 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0144454790 _sleep() at _sleep+0x325/frame 0xfffffe0144454830 kern_wait6() at kern_wait6+0x474/frame 0xfffffe01444548c0 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0144454ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0144454bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0144454bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8011ee3ba, rsp = 0x7fffffffe0a8, rbp = 0x7fffffffe600 --- Tracing command sleep pid 4102 tid 100281 td 0xfffffe0143643000 sched_switch() at sched_switch+0x5af/frame 0xfffffe014171f870 mi_switch() at mi_switch+0x155/frame 0xfffffe014171f890 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe014171f8d0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014171f920 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe014171f960 _sleep() at _sleep+0x285/frame 0xfffffe014171fa00 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e1/frame 0xfffffe014171fa80 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe014171fac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014171fbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014171fbf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8011a60fa, rsp = 0x7fffffffe5d8, rbp = 0x7fffffffe630 --- Tracing command run pid 4103 tid 100300 td 0xfffffe0143ecb000 sched_switch() at sched_switch+0x5af/frame 0xfffffe0141799870 mi_switch() at mi_switch+0x155/frame 0xfffffe0141799890 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01417998d0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0141799920 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe0141799960 _sleep() at _sleep+0x285/frame 0xfffffe0141799a00 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e1/frame 0xfffffe0141799a80 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe0141799ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0141799bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141799bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8011a80fa, rsp = 0x7fffffffe3f8, rbp = 0x7fffffffe440 --- Tracing command run pid 4104 tid 100280 td 0xfffffe01434f43a0 sched_switch() at sched_switch+0x5af/frame 0xfffffe014172e6d0 mi_switch() at mi_switch+0x155/frame 0xfffffe014172e6f0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe014172e730 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014172e780 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe014172e790 _sleep() at _sleep+0x325/frame 0xfffffe014172e830 kern_wait6() at kern_wait6+0x474/frame 0xfffffe014172e8c0 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe014172eac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014172ebf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014172ebf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8011a83ba, rsp = 0x7fffffffe408, rbp = 0x7fffffffe440 --- Tracing command run pid 4105 tid 100335 td 0xfffffe01440f3ac0 sched_switch() at sched_switch+0x5af/frame 0xfffffe01444276d0 mi_switch() at mi_switch+0x155/frame 0xfffffe01444276f0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe0144427730 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0144427780 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0144427790 _sleep() at _sleep+0x325/frame 0xfffffe0144427830 kern_wait6() at kern_wait6+0x474/frame 0xfffffe01444278c0 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0144427ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0144427bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0144427bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8011a83ba, rsp = 0x7fffffffde98, rbp = 0x7fffffffe3d0 --- Tracing command rename pid 4106 tid 100327 td 0xfffffe01440983a0 sched_switch() at sched_switch+0x5af/frame 0xfffffe01417ff870 mi_switch() at mi_switch+0x155/frame 0xfffffe01417ff890 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01417ff8d0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01417ff920 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe01417ff960 _sleep() at _sleep+0x285/frame 0xfffffe01417ffa00 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e1/frame 0xfffffe01417ffa80 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe01417ffac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01417ffbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01417ffbf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8011a90fa, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4d0 --- Tracing command swap pid 4107 tid 100318 td 0xfffffe010e5c8560 sched_switch() at sched_switch+0x5af/frame 0xfffffe01417fa870 mi_switch() at mi_switch+0x155/frame 0xfffffe01417fa890 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01417fa8d0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01417fa920 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe01417fa960 _sleep() at _sleep+0x285/frame 0xfffffe01417faa00 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e1/frame 0xfffffe01417faa80 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe01417faac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01417fabf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01417fabf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8011a90fa, rsp = 0x7fffffffe498, rbp = 0x7fffffffe4e0 --- Tracing command dirnprename pid 4108 tid 100265 td 0xfffffe01434f6740 sched_switch() at sched_switch+0x5af/frame 0xfffffe01416d0870 mi_switch() at mi_switch+0x155/frame 0xfffffe01416d0890 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01416d08d0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01416d0920 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe01416d0960 _sleep() at _sleep+0x285/frame 0xfffffe01416d0a00 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e1/frame 0xfffffe01416d0a80 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe01416d0ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01416d0bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01416d0bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8011a90fa, rsp = 0x7fffffffe478, rbp = 0x7fffffffe4c0 --- Tracing command dirrename pid 4109 tid 100292 td 0xfffffe010e5c93a0 sched_switch() at sched_switch+0x5af/frame 0xfffffe0141780870 mi_switch() at mi_switch+0x155/frame 0xfffffe0141780890 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01417808d0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0141780920 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe0141780960 _sleep() at _sleep+0x285/frame 0xfffffe0141780a00 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e1/frame 0xfffffe0141780a80 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe0141780ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0141780bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141780bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8011a90fa, rsp = 0x7fffffffe478, rbp = 0x7fffffffe4c0 --- Tracing command rename pid 4110 tid 100244 td 0xfffffe010e1b0c80 sched_switch() at sched_switch+0x5af/frame 0xfffffe014160b6d0 mi_switch() at mi_switch+0x155/frame 0xfffffe014160b6f0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe014160b730 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014160b780 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe014160b790 _sleep() at _sleep+0x325/frame 0xfffffe014160b830 kern_wait6() at kern_wait6+0x474/frame 0xfffffe014160b8c0 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe014160bac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014160bbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014160bbf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8011a93ba, rsp = 0x7fffffffe498, rbp = 0x7fffffffe4d0 --- Tracing command rename pid 4111 tid 100270 td 0xfffffe010e5a0e40 (CPU 6) kdb_enter() at kdb_enter+0x37/frame 0xfffffe01416c1410 vpanic() at vpanic+0x1b8/frame 0xfffffe01416c1470 panic() at panic+0x43/frame 0xfffffe01416c14d0 _refcount_update_saturated() at _refcount_update_saturated+0x15/frame 0xfffffe01416c14e0 vput() at vput+0x7f/frame 0xfffffe01416c1510 ffs_vput_pair() at ffs_vput_pair+0x6b/frame 0xfffffe01416c15a0 ufs_rename() at ufs_rename+0xcc2/frame 0xfffffe01416c17a0 VOP_RENAME_APV() at VOP_RENAME_APV+0x3c/frame 0xfffffe01416c17c0 null_rename() at null_rename+0x194/frame 0xfffffe01416c1850 VOP_RENAME_APV() at VOP_RENAME_APV+0x3c/frame 0xfffffe01416c1870 kern_renameat() at kern_renameat+0x3dd/frame 0xfffffe01416c1ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01416c1bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01416c1bf0 --- syscall (128, FreeBSD ELF64, sys_rename), rip = 0x8011a68da, rsp = 0x7fffffffe318, rbp = 0x7fffffffe460 --- Tracing command rename pid 4112 tid 100290 td 0xfffffe0143663900 sched_switch() at sched_switch+0x5af/frame 0xfffffe0141767870 mi_switch() at mi_switch+0x155/frame 0xfffffe0141767890 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01417678d0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0141767920 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe0141767960 _sleep() at _sleep+0x285/frame 0xfffffe0141767a00 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e1/frame 0xfffffe0141767a80 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe0141767ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0141767bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141767bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8011a90fa, rsp = 0x7fffffffe418, rbp = 0x7fffffffe460 --- Tracing command rename pid 4113 tid 100284 td 0xfffffe0143662ac0 sched_switch() at sched_switch+0x5af/frame 0xfffffe014174e870 mi_switch() at mi_switch+0x155/frame 0xfffffe014174e890 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe014174e8d0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014174e920 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe014174e960 _sleep() at _sleep+0x285/frame 0xfffffe014174ea00 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e1/frame 0xfffffe014174ea80 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe014174eac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014174ebf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014174ebf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8011a90fa, rsp = 0x7fffffffe338, rbp = 0x7fffffffe380 --- Tracing command rename pid 4114 tid 100283 td 0xfffffe01436631e0 sched_switch() at sched_switch+0x5af/frame 0xfffffe014165d870 mi_switch() at mi_switch+0x155/frame 0xfffffe014165d890 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe014165d8d0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014165d920 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe014165d960 _sleep() at _sleep+0x285/frame 0xfffffe014165da00 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e1/frame 0xfffffe014165da80 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe014165dac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014165dbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014165dbf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8011a90fa, rsp = 0x7fffffffe418, rbp = 0x7fffffffe460 --- Tracing command rename pid 4115 tid 100347 td 0xfffffe01436623a0 sched_switch() at sched_switch+0x5af/frame 0xfffffe0141749870 mi_switch() at mi_switch+0x155/frame 0xfffffe0141749890 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01417498d0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0141749920 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe0141749960 _sleep() at _sleep+0x285/frame 0xfffffe0141749a00 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e1/frame 0xfffffe0141749a80 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe0141749ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0141749bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141749bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8011a90fa, rsp = 0x7fffffffe418, rbp = 0x7fffffffe460 --- Tracing command rename pid 4116 tid 100348 td 0xfffffe0143661c80 sched_switch() at sched_switch+0x5af/frame 0xfffffe01444b2870 mi_switch() at mi_switch+0x155/frame 0xfffffe01444b2890 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01444b28d0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01444b2920 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe01444b2960 _sleep() at _sleep+0x285/frame 0xfffffe01444b2a00 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e1/frame 0xfffffe01444b2a80 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe01444b2ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01444b2bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01444b2bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8011a90fa, rsp = 0x7fffffffe418, rbp = 0x7fffffffe460 --- Tracing command rename pid 4117 tid 100349 td 0xfffffe0143661560 sched_switch() at sched_switch+0x5af/frame 0xfffffe01444ad870 mi_switch() at mi_switch+0x155/frame 0xfffffe01444ad890 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01444ad8d0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01444ad920 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe01444ad960 _sleep() at _sleep+0x285/frame 0xfffffe01444ada00 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e1/frame 0xfffffe01444ada80 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe01444adac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01444adbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01444adbf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8011a90fa, rsp = 0x7fffffffe418, rbp = 0x7fffffffe460 --- Tracing command rename pid 4118 tid 100350 td 0xfffffe0143660e40 sched_switch() at sched_switch+0x5af/frame 0xfffffe01444bc870 mi_switch() at mi_switch+0x155/frame 0xfffffe01444bc890 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01444bc8d0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01444bc920 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe01444bc960 _sleep() at _sleep+0x285/frame 0xfffffe01444bca00 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e1/frame 0xfffffe01444bca80 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe01444bcac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01444bcbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01444bcbf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8011a90fa, rsp = 0x7fffffffe418, rbp = 0x7fffffffe460 --- Tracing command dirnprename pid 4119 tid 100319 td 0xfffffe010e5c7e40 sched_switch() at sched_switch+0x5af/frame 0xfffffe01417f56d0 mi_switch() at mi_switch+0x155/frame 0xfffffe01417f56f0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01417f5730 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01417f5780 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01417f5790 _sleep() at _sleep+0x325/frame 0xfffffe01417f5830 kern_wait6() at kern_wait6+0x474/frame 0xfffffe01417f58c0 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe01417f5ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01417f5bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01417f5bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8011a93ba, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4c0 --- Tracing command dirnprename pid 4120 tid 100241 td 0xfffffe010e5cb740 sched_switch() at sched_switch+0x5af/frame 0xfffffe0141642870 mi_switch() at mi_switch+0x155/frame 0xfffffe0141642890 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01416428d0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0141642920 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe0141642960 _sleep() at _sleep+0x285/frame 0xfffffe0141642a00 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e1/frame 0xfffffe0141642a80 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe0141642ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0141642bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141642bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8011a90fa, rsp = 0x7fffffffe408, rbp = 0x7fffffffe450 --- Tracing command dirnprename pid 4121 tid 100343 td 0xfffffe010e5ca900 sched_switch() at sched_switch+0x5af/frame 0xfffffe0144486870 mi_switch() at mi_switch+0x155/frame 0xfffffe0144486890 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01444868d0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0144486920 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe0144486960 _sleep() at _sleep+0x285/frame 0xfffffe0144486a00 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e1/frame 0xfffffe0144486a80 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe0144486ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0144486bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0144486bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8011a90fa, rsp = 0x7fffffffe118, rbp = 0x7fffffffe160 --- Tracing command dirnprename pid 4122 tid 100334 td 0xfffffe010e5cb020 sched_switch() at sched_switch+0x5af/frame 0xfffffe014163d870 mi_switch() at mi_switch+0x155/frame 0xfffffe014163d890 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe014163d8d0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014163d920 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe014163d960 _sleep() at _sleep+0x285/frame 0xfffffe014163da00 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e1/frame 0xfffffe014163da80 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe014163dac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014163dbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014163dbf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8011a90fa, rsp = 0x7fffffffe408, rbp = 0x7fffffffe450 --- Tracing command dirnprename pid 4123 tid 100351 td 0xfffffe01441e21e0 sched_switch() at sched_switch+0x5af/frame 0xfffffe0144481870 mi_switch() at mi_switch+0x155/frame 0xfffffe0144481890 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01444818d0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0144481920 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe0144481960 _sleep() at _sleep+0x285/frame 0xfffffe0144481a00 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e1/frame 0xfffffe0144481a80 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe0144481ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0144481bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0144481bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8011a90fa, rsp = 0x7fffffffe408, rbp = 0x7fffffffe450 --- Tracing command dirnprename pid 4124 tid 100352 td 0xfffffe01441e1ac0 sched_switch() at sched_switch+0x5af/frame 0xfffffe01444c6870 mi_switch() at mi_switch+0x155/frame 0xfffffe01444c6890 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01444c68d0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01444c6920 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe01444c6960 _sleep() at _sleep+0x285/frame 0xfffffe01444c6a00 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e1/frame 0xfffffe01444c6a80 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe01444c6ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01444c6bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01444c6bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8011a90fa, rsp = 0x7fffffffe408, rbp = 0x7fffffffe450 --- Tracing command dirnprename pid 4125 tid 100353 td 0xfffffe01441e13a0 sched_switch() at sched_switch+0x5af/frame 0xfffffe01444c1870 mi_switch() at mi_switch+0x155/frame 0xfffffe01444c1890 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01444c18d0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01444c1920 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe01444c1960 _sleep() at _sleep+0x285/frame 0xfffffe01444c1a00 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e1/frame 0xfffffe01444c1a80 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe01444c1ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01444c1bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01444c1bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8011a90fa, rsp = 0x7fffffffe408, rbp = 0x7fffffffe450 --- Tracing command dirnprename pid 4126 tid 100354 td 0xfffffe01441e0c80 sched_switch() at sched_switch+0x5af/frame 0xfffffe01444d0870 mi_switch() at mi_switch+0x155/frame 0xfffffe01444d0890 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01444d08d0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01444d0920 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe01444d0960 _sleep() at _sleep+0x285/frame 0xfffffe01444d0a00 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e1/frame 0xfffffe01444d0a80 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe01444d0ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01444d0bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01444d0bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8011a90fa, rsp = 0x7fffffffe408, rbp = 0x7fffffffe450 --- Tracing command dirnprename pid 4127 tid 100355 td 0xfffffe01441e0560 sched_switch() at sched_switch+0x5af/frame 0xfffffe01444cb870 mi_switch() at mi_switch+0x155/frame 0xfffffe01444cb890 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01444cb8d0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01444cb920 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe01444cb960 _sleep() at _sleep+0x285/frame 0xfffffe01444cba00 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e1/frame 0xfffffe01444cba80 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe01444cbac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01444cbbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01444cbbf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8011a90fa, rsp = 0x7fffffffe408, rbp = 0x7fffffffe450 --- Tracing command dirnprename pid 4128 tid 100356 td 0xfffffe01441dfe40 sched_switch() at sched_switch+0x5af/frame 0xfffffe01444da870 mi_switch() at mi_switch+0x155/frame 0xfffffe01444da890 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01444da8d0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01444da920 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe01444da960 _sleep() at _sleep+0x285/frame 0xfffffe01444daa00 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e1/frame 0xfffffe01444daa80 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe01444daac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01444dabf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01444dabf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8011a90fa, rsp = 0x7fffffffe408, rbp = 0x7fffffffe450 --- Tracing command swap pid 4129 tid 100357 td 0xfffffe01441df720 sched_switch() at sched_switch+0x5af/frame 0xfffffe01444d56d0 mi_switch() at mi_switch+0x155/frame 0xfffffe01444d56f0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01444d5730 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01444d5780 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01444d5790 _sleep() at _sleep+0x325/frame 0xfffffe01444d5830 kern_wait6() at kern_wait6+0x474/frame 0xfffffe01444d58c0 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe01444d5ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01444d5bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01444d5bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8011a93ba, rsp = 0x7fffffffe4a8, rbp = 0x7fffffffe4e0 --- Tracing command swap pid 4130 tid 100358 td 0xfffffe0143660720 sched_switch() at sched_switch+0x5af/frame 0xfffffe01444b7870 mi_switch() at mi_switch+0x155/frame 0xfffffe01444b7890 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01444b78d0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01444b7920 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe01444b7960 _sleep() at _sleep+0x285/frame 0xfffffe01444b7a00 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e1/frame 0xfffffe01444b7a80 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe01444b7ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01444b7bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01444b7bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8011a90fa, rsp = 0x7fffffffe428, rbp = 0x7fffffffe470 --- Tracing command swap pid 4131 tid 100359 td 0xfffffe0143660000 sched_switch() at sched_switch+0x5af/frame 0xfffffe01444e4870 mi_switch() at mi_switch+0x155/frame 0xfffffe01444e4890 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01444e48d0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01444e4920 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe01444e4960 _sleep() at _sleep+0x285/frame 0xfffffe01444e4a00 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e1/frame 0xfffffe01444e4a80 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe01444e4ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01444e4bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01444e4bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8011a90fa, rsp = 0x7fffffffe428, rbp = 0x7fffffffe470 --- Tracing command swap pid 4132 tid 100360 td 0xfffffe01441e3740 sched_switch() at sched_switch+0x5af/frame 0xfffffe01444df870 mi_switch() at mi_switch+0x155/frame 0xfffffe01444df890 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01444df8d0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01444df920 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe01444df960 _sleep() at _sleep+0x285/frame 0xfffffe01444dfa00 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e1/frame 0xfffffe01444dfa80 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe01444dfac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01444dfbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01444dfbf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8011a90fa, rsp = 0x7fffffffe428, rbp = 0x7fffffffe470 --- Tracing command swap pid 4133 tid 100361 td 0xfffffe01441e3020 (CPU 1) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce20e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce20e10 trap() at trap+0x56/frame 0xfffffe003ce20f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce20f20 --- trap 0x13, rip = 0xffffffff810ba605, rsp = 0xffffffff826112d0, rbp = 0x7fffffffe100 --- Xpage_pti() at Xpage_pti+0x5/frame 0x7fffffffe100 Tracing command swap pid 4134 tid 100362 td 0xfffffe01441e2900 sched_switch() at sched_switch+0x5af/frame 0xfffffe01444e9870 mi_switch() at mi_switch+0x155/frame 0xfffffe01444e9890 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01444e98d0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01444e9920 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe01444e9960 _sleep() at _sleep+0x285/frame 0xfffffe01444e9a00 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e1/frame 0xfffffe01444e9a80 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe01444e9ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01444e9bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01444e9bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8011a90fa, rsp = 0x7fffffffe428, rbp = 0x7fffffffe470 --- Tracing command swap pid 4135 tid 100363 td 0xfffffe01442171e0 sched_switch() at sched_switch+0x5af/frame 0xfffffe01444f8870 mi_switch() at mi_switch+0x155/frame 0xfffffe01444f8890 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01444f88d0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01444f8920 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe01444f8960 _sleep() at _sleep+0x285/frame 0xfffffe01444f8a00 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e1/frame 0xfffffe01444f8a80 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe01444f8ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01444f8bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01444f8bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8011a90fa, rsp = 0x7fffffffe428, rbp = 0x7fffffffe470 --- Tracing command swap pid 4136 tid 100364 td 0xfffffe0144216ac0 sched_switch() at sched_switch+0x5af/frame 0xfffffe01444f3870 mi_switch() at mi_switch+0x155/frame 0xfffffe01444f3890 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01444f38d0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01444f3920 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe01444f3960 _sleep() at _sleep+0x285/frame 0xfffffe01444f3a00 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e1/frame 0xfffffe01444f3a80 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe01444f3ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01444f3bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01444f3bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8011a90fa, rsp = 0x7fffffffe428, rbp = 0x7fffffffe470 --- Tracing command swap pid 4137 tid 100365 td 0xfffffe01442163a0 sched_switch() at sched_switch+0x5af/frame 0xfffffe0144502870 mi_switch() at mi_switch+0x155/frame 0xfffffe0144502890 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01445028d0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0144502920 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe0144502960 _sleep() at _sleep+0x285/frame 0xfffffe0144502a00 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e1/frame 0xfffffe0144502a80 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe0144502ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe0144502bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0144502bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8011a90fa, rsp = 0x7fffffffe428, rbp = 0x7fffffffe470 --- Tracing command swap pid 4138 tid 100366 td 0xfffffe0144215c80 sched_switch() at sched_switch+0x5af/frame 0xfffffe01444fd870 mi_switch() at mi_switch+0x155/frame 0xfffffe01444fd890 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01444fd8d0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01444fd920 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe01444fd960 _sleep() at _sleep+0x285/frame 0xfffffe01444fda00 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e1/frame 0xfffffe01444fda80 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe01444fdac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01444fdbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01444fdbf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8011a90fa, rsp = 0x7fffffffe428, rbp = 0x7fffffffe470 --- Tracing command swap pid 4139 tid 100367 td 0xfffffe0144215560 sched_switch() at sched_switch+0x5af/frame 0xfffffe014450c870 mi_switch() at mi_switch+0x155/frame 0xfffffe014450c890 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe014450c8d0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014450c920 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe014450c960 _sleep() at _sleep+0x285/frame 0xfffffe014450ca00 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e1/frame 0xfffffe014450ca80 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe014450cac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe014450cbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014450cbf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8011a90fa, rsp = 0x7fffffffe428, rbp = 0x7fffffffe470 --- Tracing command dirrename pid 4140 tid 100302 td 0xfffffe0143ecf020 sched_switch() at sched_switch+0x5af/frame 0xfffffe01417a86d0 mi_switch() at mi_switch+0x155/frame 0xfffffe01417a86f0 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01417a8730 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01417a8780 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01417a8790 _sleep() at _sleep+0x325/frame 0xfffffe01417a8830 kern_wait6() at kern_wait6+0x474/frame 0xfffffe01417a88c0 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe01417a8ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01417a8bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01417a8bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8011a93ba, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4c0 --- Tracing command dirrename pid 4141 tid 100271 td 0xfffffe010e5a0720 sched_switch() at sched_switch+0x5af/frame 0xfffffe01416e4870 mi_switch() at mi_switch+0x155/frame 0xfffffe01416e4890 sleepq_switch() at sleepq_switch+0x119/frame 0xfffffe01416e48d0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01416e4920 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe01416e4960 _sleep() at _sleep+0x285/frame 0xfffffe01416e4a00 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e1/frame 0xfffffe01416e4a80 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe01416e4ac0 amd64_syscall() at amd64_syscall+0x147/frame 0xfffffe01416e4bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01416e4bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8011a90fa, rsp = 0x7fffffffe408, rbp = 0x7fffffffe450 --- db> (kgdb) bt #0 __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:55 #1 doadump (textdump=textdump@entry=0x0) at ../../../kern/kern_shutdown.c:399 #2 0xffffffff804ce7fa in db_dump (dummy=, dummy2=, dummy3=, dummy4=) at ../../../ddb/db_command.c:575 #3 0xffffffff804ce6b2 in db_command (last_cmdp=, cmd_table=, dopager=dopager@entry=0x0) at ../../../ddb/db_command.c:482 #4 0xffffffff804ce746 in db_command_script (command=command@entry=0xffffffff81bd27c0 "dump") at ../../../ddb/db_command.c:553 #5 0xffffffff804d3bb8 in db_script_exec (scriptname=0xffffffff81bd2130 "dump", warnifnotfound=) at ../../../ddb/db_script.c:304 #6 0xffffffff804ce6b2 in db_command (last_cmdp=, cmd_table=, dopager=dopager@entry=0x0) at ../../../ddb/db_command.c:482 #7 0xffffffff804ce746 in db_command_script (command=command@entry=0xffffffff81bd2752 "run pho1") at ../../../ddb/db_command.c:553 #8 0xffffffff804d3bb8 in db_script_exec (scriptname=0xffffffff81bd2130 "dump", warnifnotfound=) at ../../../ddb/db_script.c:304 #9 0xffffffff804ce6b2 in db_command (last_cmdp=, cmd_table=, dopager=dopager@entry=0x1) at ../../../ddb/db_command.c:482 #10 0xffffffff804ce32d in db_command_loop () at ../../../ddb/db_command.c:535 #11 0xffffffff804d1aa6 in db_trap (type=, code=) at ../../../ddb/db_main.c:270 #12 0xffffffff80c6f667 in kdb_trap (type=type@entry=0x3, code=code@entry=0x0, tf=tf@entry=0xfffffe01416c1340) at ../../../kern/subr_kdb.c:727 #13 0xffffffff810e9bd3 in trap (frame=0xfffffe01416c1340) at ../../../amd64/amd64/trap.c:607 #14 #15 kdb_enter (why=0xffffffff812e497a "panic", msg=) at ../../../kern/subr_kdb.c:506 #16 0xffffffff80c22b98 in vpanic (fmt=0xffffffff81226052 "refcount %p wraparound", ap=, ap@entry=0xfffffe01416c14b0) at ../../../kern/kern_shutdown.c:907 #17 0xffffffff80c22923 in panic (fmt=0xffffffff81e9d8e8 "\377\030*\201\377\377\377\377") at ../../../kern/kern_shutdown.c:843 #18 0xffffffff80d193f5 in _refcount_update_saturated (count=0x80) at ../../../sys/refcount.h:55 #19 0xffffffff80d10aef in refcount_releasen (count=0xfffffe014411849c, n=0x1) at ../../../sys/refcount.h:154 #20 refcount_release (count=0xfffffe014411849c) at ../../../sys/refcount.h:174 #21 vput (vp=) at ../../../kern/vfs_subr.c:3339 #22 0xffffffff80f4e7bb in ffs_vput_pair (ap=0xfffffe01416c15b8) at ../../../ufs/ffs/ffs_vnops.c:2005 #23 0xffffffff80f61be2 in VOP_VPUT_PAIR (dvp=0xfffffe0144118258, vpp=0xfffffe01416c1648, unlock_vp=0x1) at ./vnode_if.h:2434 #24 ufs_rename (ap=) at ../../../ufs/ufs/ufs_vnops.c:1704 #25 0xffffffff811b326c in VOP_RENAME_APV (vop=0xffffffff81b65678 , a=a@entry=0xfffffe01416c17d8) at vnode_if.c:1678 #26 0xffffffff8274b9d4 in VOP_RENAME (fdvp=0xfffffe0144118258, fvp=0xfffffe0144393960, fcnp=0x12, tdvp=0xfffffe0144118258, tvp=0x0, tcnp=0x1) at ./vnode_if.h:863 #27 null_rename (ap=) at /usr/src/sys/fs/nullfs/null_vnops.c:711 #28 0xffffffff811b326c in VOP_RENAME_APV (vop=0xffffffff8274e3d0 , a=a@entry=0xfffffe01416c1a38) at vnode_if.c:1678 #29 0xffffffff80d2413d in VOP_RENAME (fdvp=0x1, fvp=, fcnp=, tdvp=, tvp=0xfffffe01416c1300, tcnp=) at ./vnode_if.h:863 #30 kern_renameat (td=0xfffffe010e5a0e40, oldfd=0xffffff9c, old=0x7fffffffe3b0 , newfd=0xffffff9c, new=0x7fffffffe330 , pathseg=) at ../../../kern/vfs_syscalls.c:3743 #31 0xffffffff810ea9c7 in syscallenter (td=0xfffffe010e5a0e40) at ../../../amd64/amd64/../../kern/subr_syscall.c:189 #32 amd64_syscall (td=0xfffffe010e5a0e40, traced=0x0) at ../../../amd64/amd64/trap.c:1186 #33 #34 0x00000008011a68da in ?? () Backtrace stopped: Cannot access memory at address 0x7fffffffe318 (kgdb) f 18 #18 0xffffffff80d193f5 in _refcount_update_saturated (count=0x80) at ../../../sys/refcount.h:55 55 panic("refcount %p wraparound", count); (kgdb) l 50 */ 51 static __inline void 52 _refcount_update_saturated(volatile u_int *count) 53 { 54 #ifdef INVARIANTS 55 panic("refcount %p wraparound", count); 56 #else 57 atomic_store_int(count, REFCOUNT_SATURATION_VALUE); 58 #endif 59 } (kgdb) f 19 #19 0xffffffff80d10aef in refcount_releasen (count=0xfffffe014411849c, n=0x1) at ../../../sys/refcount.h:154 154 _refcount_update_saturated(count); (kgdb) p *count $1 = 0xffffffff (kgdb) f 22 #22 0xffffffff80f4e7bb in ffs_vput_pair (ap=0xfffffe01416c15b8) at ../../../ufs/ffs/ffs_vnops.c:2005 2005 vput(dvp); (kgdb) l 2000 dp = VTOI(dvp); 2001 vpp = ap->a_vpp; 2002 vp = vpp != NULL ? *vpp : NULL; 2003 2004 if ((dp->i_flag & (IN_NEEDSYNC | IN_ENDOFF)) == 0) { 2005 vput(dvp); 2006 if (vp != NULL && ap->a_unlock_vp) 2007 vput(vp); 2008 return (0); 2009 } (kgdb) info loc dvp = 0xfffffe0144118258 vpp = dp = 0xfffffe014411a000 vp = 0x0 mp = vp_locked = ip = ip_ino = ip_gen = old_size = error = vp1 = (kgdb) p *dvp $2 = {v_type = VDIR, v_irflag = 0x0, v_seqc = 0x7e4, v_nchash = 0x1ba66a15, v_hash = 0x8080, v_op = 0xffffffff81b65678 , v_data = 0xfffffe014411a000, v_mount = 0xfffffe0144154280, v_nmntvnodes = {tqe_next = 0xfffffe0143e32000, tqe_prev = 0xfffffe010e3d6280}, {v_mountedhere = 0x0, v_unpcb = 0x0, v_rdev = 0x0, v_fifoinfo = 0x0}, v_hashlist = {le_next = 0x0, le_prev = 0xfffffe010d207a28}, v_cache_src = {lh_first = 0xfffff802b41e0680}, v_cache_dst = {tqh_first = 0xfffff80158750208, tqh_last = 0xfffff80158750218}, v_cache_dd = 0xfffff80158750208, v_lock = {lock_object = { lo_name = 0xffffffff811e38e7 "ufs", lo_flags = 0x6fb0000, lo_data = 0x0, lo_witness = 0xfffff8087fd83e00}, lk_lock = 0xfffffe010e5a0e40, lk_exslpfail = 0x0, lk_pri = 0x60, lk_timo = 0x33, lk_stack = {depth = 0xb, pcs = {0xffffffff80bf21e7, 0xffffffff80f4e33d, 0xffffffff811b413c, 0xffffffff80d28414, 0xffffffff80f6102a, 0xffffffff811b326c, 0xffffffff8274b9d4, 0xffffffff811b326c, 0xffffffff80d2413d, 0xffffffff810ea9c7, 0xffffffff810badce, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0}}}, v_interlock = {lock_object = {lo_name = 0xffffffff81332525 "vnode interlock", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xfffff8087fd75580}, mtx_lock = 0x0}, v_vnlock = 0xfffffe01441182c8, v_vnodelist = {tqe_next = 0xfffffe014411e000, tqe_prev = 0xfffffe0144117d78}, v_lazylist = {tqe_next = 0xfffffe0143e32000, tqe_prev = 0xfffffe0143f263c0}, v_bufobj = { bo_lock = {lock_object = {lo_name = 0xffffffff812ea94f "bufobj interlock", lo_flags = 0x5230000, lo_data = 0x0, lo_witness = 0xfffff8087fd80900}, rw_lock = 0x1}, bo_ops = 0xffffffff81b25b90 , bo_object = 0xfffff800211f5420, bo_synclist = {le_next = 0xfffffe010ce69178, le_prev = 0xfffffe0143f26400}, bo_private = 0xfffffe0144118258, bo_clean = {bv_hd = {tqh_first = 0x0, tqh_last = 0xfffffe0144118418}, bv_root = {pt_root = 0x0}, bv_cnt = 0x0}, bo_dirty = {bv_hd = {tqh_first = 0xfffffe003799bb90, tqh_last = 0xfffffe003799bbf0}, bv_root = { pt_root = 0xfffffe003799bcf1}, bv_cnt = 0x1}, bo_numoutput = 0x0, bo_flag = 0x1, bo_domain = 0x6, bo_bsize = 0x8000}, v_pollinfo = 0x0, v_label = 0x0, v_lockf = 0x0, v_rl = {rl_waiters = {tqh_first = 0x0, tqh_last = 0xfffffe0144118480}, rl_currdep = 0x0}, v_holdcnt = 0x5, v_usecount = 0xffffffff, v_iflag = 0x0, v_vflag = 0x0, v_mflag = 0x1, v_dbatchcpu = 0xffff, v_writecount = 0x0, v_seqc_users = 0x0} (kgdb) diff --git a/sys/fs/fifofs/fifo_vnops.c b/sys/fs/fifofs/fifo_vnops.c index d2a51de84fba..861f1b40a744 100644 --- a/sys/fs/fifofs/fifo_vnops.c +++ b/sys/fs/fifofs/fifo_vnops.c @@ -282,9 +282,21 @@ fifo_close(ap) struct pipe *cpipe; vp = ap->a_vp; + ASSERT_VOP_ELOCKED(vp, "fifo_close"); fip = vp->v_fifoinfo; + + /* + * During open, it is possible that the fifo vnode is relocked + * after the vnode is instantiated but before VOP_OPEN() is + * done. For instance, vn_open_vnode() might need to upgrade + * vnode lock, or ffs_vput_pair() needs to unlock vp to sync + * dvp. In this case, reclaim can observe us with v_fifoinfo + * equal to NULL. + */ + if (fip == NULL) + return (0); + cpipe = fip->fi_pipe; - ASSERT_VOP_ELOCKED(vp, "fifo_close"); if (ap->a_fflag & FREAD) { fip->fi_readers--; if (fip->fi_readers == 0) { diff --git a/sys/fs/nullfs/null.h b/sys/fs/nullfs/null.h index 6fdac4b1006e..a41625536d65 100644 --- a/sys/fs/nullfs/null.h +++ b/sys/fs/nullfs/null.h @@ -45,6 +45,8 @@ struct null_mount { struct mount *nullm_vfs; struct vnode *nullm_lowerrootvp; /* Ref to lower root vnode */ uint64_t nullm_flags; + struct mount_upper_node upper_node; + struct mount_upper_node notify_node; }; #ifdef _KERNEL diff --git a/sys/fs/nullfs/null_vfsops.c b/sys/fs/nullfs/null_vfsops.c index 4914e5fc2dbf..73301c9275d2 100644 --- a/sys/fs/nullfs/null_vfsops.c +++ b/sys/fs/nullfs/null_vfsops.c @@ -163,7 +163,8 @@ nullfs_mount(struct mount *mp) * Save pointer to underlying FS and the reference to the * lower root vnode. */ - xmp->nullm_vfs = vfs_pin_from_vp(lowerrootvp); + xmp->nullm_vfs = vfs_register_upper_from_vp(lowerrootvp, mp, + &xmp->upper_node); if (xmp->nullm_vfs == NULL) { vput(lowerrootvp); free(xmp, M_NULLFSMNT); @@ -178,7 +179,7 @@ nullfs_mount(struct mount *mp) */ error = null_nodeget(mp, lowerrootvp, &nullm_rootvp); if (error != 0) { - vfs_unpin(xmp->nullm_vfs); + vfs_unregister_upper(xmp->nullm_vfs, &xmp->upper_node); vrele(lowerrootvp); free(xmp, M_NULLFSMNT); return (error); @@ -195,6 +196,11 @@ nullfs_mount(struct mount *mp) (xmp->nullm_vfs->mnt_kern_flag & MNTK_NULL_NOCACHE) != 0) xmp->nullm_flags &= ~NULLM_CACHE; + if ((xmp->nullm_flags & NULLM_CACHE) != 0) { + vfs_register_for_notification(xmp->nullm_vfs, mp, + &xmp->notify_node); + } + MNT_ILOCK(mp); if ((xmp->nullm_flags & NULLM_CACHE) != 0) { mp->mnt_kern_flag |= lowerrootvp->v_mount->mnt_kern_flag & @@ -206,13 +212,6 @@ nullfs_mount(struct mount *mp) (MNTK_USES_BCACHE | MNTK_NO_IOPF | MNTK_UNMAPPED_BUFS); MNT_IUNLOCK(mp); vfs_getnewfsid(mp); - if ((xmp->nullm_flags & NULLM_CACHE) != 0) { - MNT_ILOCK(xmp->nullm_vfs); - TAILQ_INSERT_TAIL(&xmp->nullm_vfs->mnt_uppers, mp, - mnt_upper_link); - MNT_IUNLOCK(xmp->nullm_vfs); - } - vfs_mountedfrom(mp, target); vput(nullm_rootvp); @@ -230,7 +229,6 @@ nullfs_unmount(mp, mntflags) int mntflags; { struct null_mount *mntdata; - struct mount *ump; int error, flags; NULLFSDEBUG("nullfs_unmount: mp = %p\n", (void *)mp); @@ -259,17 +257,11 @@ nullfs_unmount(mp, mntflags) * Finally, throw away the null_mount structure */ mntdata = mp->mnt_data; - ump = mntdata->nullm_vfs; if ((mntdata->nullm_flags & NULLM_CACHE) != 0) { - MNT_ILOCK(ump); - while ((ump->mnt_kern_flag & MNTK_VGONE_UPPER) != 0) { - ump->mnt_kern_flag |= MNTK_VGONE_WAITER; - msleep(&ump->mnt_uppers, &ump->mnt_mtx, 0, "vgnupw", 0); - } - TAILQ_REMOVE(&ump->mnt_uppers, mp, mnt_upper_link); - MNT_IUNLOCK(ump); + vfs_unregister_for_notification(mntdata->nullm_vfs, + &mntdata->notify_node); } - vfs_unpin(ump); + vfs_unregister_upper(mntdata->nullm_vfs, &mntdata->upper_node); vrele(mntdata->nullm_lowerrootvp); mp->mnt_data = NULL; free(mntdata, M_NULLFSMNT); diff --git a/sys/fs/nullfs/null_vnops.c b/sys/fs/nullfs/null_vnops.c index aeebce4ed086..acd0e7e166b6 100644 --- a/sys/fs/nullfs/null_vnops.c +++ b/sys/fs/nullfs/null_vnops.c @@ -223,13 +223,12 @@ int null_bypass(struct vop_generic_args *ap) { struct vnode **this_vp_p; - int error; struct vnode *old_vps[VDESC_MAX_VPS]; struct vnode **vps_p[VDESC_MAX_VPS]; struct vnode ***vppp; struct vnode *lvp; struct vnodeop_desc *descp = ap->a_desc; - int reles, i; + int error, i, reles; if (null_bug_bypass) printf ("null_bypass: %s\n", descp->vdesc_name); @@ -252,26 +251,39 @@ null_bypass(struct vop_generic_args *ap) for (i = 0; i < VDESC_MAX_VPS; reles >>= 1, i++) { if (descp->vdesc_vp_offsets[i] == VDESC_NO_OFFSET) break; /* bail out at end of list */ - vps_p[i] = this_vp_p = - VOPARG_OFFSETTO(struct vnode**,descp->vdesc_vp_offsets[i],ap); + vps_p[i] = this_vp_p = VOPARG_OFFSETTO(struct vnode **, + descp->vdesc_vp_offsets[i],ap); + /* * We're not guaranteed that any but the first vnode * are of our type. Check for and don't map any * that aren't. (We must always map first vp or vclean fails.) */ - if (i && (*this_vp_p == NULLVP || + if (i != 0 && (*this_vp_p == NULLVP || (*this_vp_p)->v_op != &null_vnodeops)) { old_vps[i] = NULLVP; } else { old_vps[i] = *this_vp_p; *(vps_p[i]) = NULLVPTOLOWERVP(*this_vp_p); + + /* + * The upper vnode reference to the lower + * vnode is the only reference that keeps our + * pointer to the lower vnode alive. If lower + * vnode is relocked during the VOP call, + * upper vnode might become unlocked and + * reclaimed, which invalidates our reference. + * Add a transient hold around VOP call. + */ + vhold(*this_vp_p); + /* * XXX - Several operations have the side effect * of vrele'ing their vp's. We must account for * that. (This should go away in the future.) */ if (reles & VDESC_VP0_WILLRELE) - VREF(*this_vp_p); + vref(*this_vp_p); } } @@ -279,9 +291,9 @@ null_bypass(struct vop_generic_args *ap) * Call the operation on the lower layer * with the modified argument structure. */ - if (vps_p[0] && *vps_p[0]) + if (vps_p[0] != NULL && *vps_p[0] != NULL) { error = VCALL(ap); - else { + } else { printf("null_bypass: no map for %s\n", descp->vdesc_name); error = EINVAL; } @@ -295,10 +307,11 @@ null_bypass(struct vop_generic_args *ap) for (i = 0; i < VDESC_MAX_VPS; reles >>= 1, i++) { if (descp->vdesc_vp_offsets[i] == VDESC_NO_OFFSET) break; /* bail out at end of list */ - if (old_vps[i]) { + if (old_vps[i] != NULL) { lvp = *(vps_p[i]); /* + * Get rid of the transient hold on lvp. * If lowervp was unlocked during VOP * operation, nullfs upper vnode could have * been reclaimed, which changes its v_vnlock @@ -306,11 +319,14 @@ null_bypass(struct vop_generic_args *ap) * must move lock ownership from lower to * upper (reclaimed) vnode. */ - if (lvp != NULLVP && - VOP_ISLOCKED(lvp) == LK_EXCLUSIVE && - old_vps[i]->v_vnlock != lvp->v_vnlock) { - VOP_UNLOCK(lvp); - VOP_LOCK(old_vps[i], LK_EXCLUSIVE | LK_RETRY); + if (lvp != NULLVP) { + if (VOP_ISLOCKED(lvp) == LK_EXCLUSIVE && + old_vps[i]->v_vnlock != lvp->v_vnlock) { + VOP_UNLOCK(lvp); + VOP_LOCK(old_vps[i], LK_EXCLUSIVE | + LK_RETRY); + } + vdrop(lvp); } *(vps_p[i]) = old_vps[i]; @@ -328,17 +344,18 @@ null_bypass(struct vop_generic_args *ap) * (Assumes that the lower layer always returns * a VREF'ed vpp unless it gets an error.) */ - if (descp->vdesc_vpp_offset != VDESC_NO_OFFSET && !error) { + if (descp->vdesc_vpp_offset != VDESC_NO_OFFSET && error == 0) { /* * XXX - even though some ops have vpp returned vp's, * several ops actually vrele this before returning. * We must avoid these ops. * (This should go away when these ops are regularized.) */ - vppp = VOPARG_OFFSETTO(struct vnode***, - descp->vdesc_vpp_offset,ap); - if (*vppp) - error = null_nodeget(old_vps[0]->v_mount, **vppp, *vppp); + vppp = VOPARG_OFFSETTO(struct vnode ***, + descp->vdesc_vpp_offset,ap); + if (*vppp != NULL) + error = null_nodeget(old_vps[0]->v_mount, **vppp, + *vppp); } return (error); @@ -419,11 +436,12 @@ null_lookup(struct vop_lookup_args *ap) * dvp to be reclaimed due to shared v_vnlock. Check for the * doomed state and return error. */ - if ((error == 0 || error == EJUSTRETURN) && - VN_IS_DOOMED(dvp)) { - error = ENOENT; - if (lvp != NULL) - vput(lvp); + if (VN_IS_DOOMED(dvp)) { + if (error == 0 || error == EJUSTRETURN) { + if (lvp != NULL) + vput(lvp); + error = ENOENT; + } /* * If vgone() did reclaimed dvp before curthread @@ -637,31 +655,79 @@ null_remove(struct vop_remove_args *ap) static int null_rename(struct vop_rename_args *ap) { - struct vnode *tdvp = ap->a_tdvp; - struct vnode *fvp = ap->a_fvp; - struct vnode *fdvp = ap->a_fdvp; - struct vnode *tvp = ap->a_tvp; - struct null_node *tnn; + struct vnode *fdvp, *fvp, *tdvp, *tvp; + struct vnode *lfdvp, *lfvp, *ltdvp, *ltvp; + struct null_node *fdnn, *fnn, *tdnn, *tnn; + int error; + + tdvp = ap->a_tdvp; + fvp = ap->a_fvp; + fdvp = ap->a_fdvp; + tvp = ap->a_tvp; /* Check for cross-device rename. */ if ((fvp->v_mount != tdvp->v_mount) || - (tvp && (fvp->v_mount != tvp->v_mount))) { - if (tdvp == tvp) - vrele(tdvp); - else - vput(tdvp); - if (tvp) - vput(tvp); - vrele(fdvp); - vrele(fvp); - return (EXDEV); + (tvp != NULL && fvp->v_mount != tvp->v_mount)) { + error = EXDEV; + goto upper_err; } + VI_LOCK(fdvp); + fdnn = VTONULL(fdvp); + if (fdnn == NULL) { /* fdvp is not locked, can be doomed */ + VI_UNLOCK(fdvp); + error = ENOENT; + goto upper_err; + } + lfdvp = fdnn->null_lowervp; + vhold(lfdvp); + VI_UNLOCK(fdvp); + + VI_LOCK(fvp); + fnn = VTONULL(fvp); + if (fnn == NULL) { + VI_UNLOCK(fvp); + vdrop(lfdvp); + error = ENOENT; + goto upper_err; + } + lfvp = fnn->null_lowervp; + vhold(lfvp); + VI_UNLOCK(fvp); + + tdnn = VTONULL(tdvp); + ltdvp = tdnn->null_lowervp; + vhold(ltdvp); + if (tvp != NULL) { tnn = VTONULL(tvp); + ltvp = tnn->null_lowervp; + vhold(ltvp); tnn->null_flags |= NULLV_DROP; + } else { + ltvp = NULL; } - return (null_bypass((struct vop_generic_args *)ap)); + + error = VOP_RENAME(lfdvp, lfvp, ap->a_fcnp, ltdvp, ltvp, ap->a_tcnp); + + if (ltvp != NULL) + vdrop(ltvp); + vdrop(ltdvp); + vdrop(lfvp); + vdrop(lfdvp); + + return (error); + +upper_err: + if (tdvp == tvp) + vrele(tdvp); + else + vput(tdvp); + if (tvp) + vput(tvp); + vrele(fdvp); + vrele(fvp); + return (error); } static int @@ -978,6 +1044,28 @@ null_read_pgcache(struct vop_read_pgcache_args *ap) return (error); } +static int +null_advlock(struct vop_advlock_args *ap) +{ + struct vnode *lvp, *vp; + struct null_node *xp; + int error; + + vp = ap->a_vp; + VI_LOCK(vp); + xp = VTONULL(vp); + if (xp == NULL) { + VI_UNLOCK(vp); + return (EBADF); + } + lvp = xp->null_lowervp; + vref(lvp); + VI_UNLOCK(vp); + error = VOP_ADVLOCK(lvp, ap->a_id, ap->a_op, ap->a_fl, ap->a_flags); + vrele(lvp); + return (error); +} + /* * Avoid standard bypass, since lower dvp and vp could be no longer * valid after vput(). @@ -1050,6 +1138,7 @@ struct vop_vector null_vnodeops = { .vop_bypass = null_bypass, .vop_access = null_access, .vop_accessx = null_accessx, + .vop_advlock = null_advlock, .vop_advlockpurge = vop_stdadvlockpurge, .vop_bmap = VOP_EOPNOTSUPP, .vop_stat = null_stat, diff --git a/sys/fs/unionfs/union.h b/sys/fs/unionfs/union.h index 64706b2b21a2..96180480dbec 100644 --- a/sys/fs/unionfs/union.h +++ b/sys/fs/unionfs/union.h @@ -57,6 +57,8 @@ struct unionfs_mount { struct vnode *um_lowervp; /* VREFed once */ struct vnode *um_uppervp; /* VREFed once */ struct vnode *um_rootvp; /* ROOT vnode */ + struct mount_upper_node um_lower_link; /* node in lower FS list of uppers */ + struct mount_upper_node um_upper_link; /* node in upper FS list of uppers */ unionfs_copymode um_copymode; unionfs_whitemode um_whitemode; uid_t um_uid; diff --git a/sys/fs/unionfs/union_vfsops.c b/sys/fs/unionfs/union_vfsops.c index 96a30f0ae8b5..c17650dedc63 100644 --- a/sys/fs/unionfs/union_vfsops.c +++ b/sys/fs/unionfs/union_vfsops.c @@ -292,14 +292,16 @@ unionfs_domount(struct mount *mp) return (error); } - lowermp = vfs_pin_from_vp(ump->um_lowervp); - uppermp = vfs_pin_from_vp(ump->um_uppervp); + lowermp = vfs_register_upper_from_vp(ump->um_lowervp, mp, + &ump->um_lower_link); + uppermp = vfs_register_upper_from_vp(ump->um_uppervp, mp, + &ump->um_upper_link); if (lowermp == NULL || uppermp == NULL) { if (lowermp != NULL) - vfs_unpin(lowermp); + vfs_unregister_upper(lowermp, &ump->um_lower_link); if (uppermp != NULL) - vfs_unpin(uppermp); + vfs_unregister_upper(uppermp, &ump->um_upper_link); free(ump, M_UNIONFSMNT); mp->mnt_data = NULL; return (ENOENT); @@ -357,8 +359,8 @@ unionfs_unmount(struct mount *mp, int mntflags) if (error) return (error); - vfs_unpin(ump->um_lowervp->v_mount); - vfs_unpin(ump->um_uppervp->v_mount); + vfs_unregister_upper(ump->um_lowervp->v_mount, &ump->um_lower_link); + vfs_unregister_upper(ump->um_uppervp->v_mount, &ump->um_upper_link); free(ump, M_UNIONFSMNT); mp->mnt_data = NULL; diff --git a/sys/kern/vfs_mount.c b/sys/kern/vfs_mount.c index 8b4426209818..6d7bc181d4b0 100644 --- a/sys/kern/vfs_mount.c +++ b/sys/kern/vfs_mount.c @@ -65,6 +65,7 @@ __FBSDID("$FreeBSD$"); #include #include #include +#include #include #include @@ -89,6 +90,11 @@ static bool default_autoro = false; SYSCTL_BOOL(_vfs, OID_AUTO, default_autoro, CTLFLAG_RW, &default_autoro, 0, "Retry failed r/w mount as r/o if no explicit ro/rw option is specified"); +static bool recursive_forced_unmount = false; +SYSCTL_BOOL(_vfs, OID_AUTO, recursive_forced_unmount, CTLFLAG_RW, + &recursive_forced_unmount, 0, "Recursively unmount stacked upper mounts" + " when a file system is forcibly unmounted"); + MALLOC_DEFINE(M_MOUNT, "mount", "vfs mount structure"); MALLOC_DEFINE(M_STATFS, "statfs", "statfs structure"); static uma_zone_t mount_zone; @@ -103,6 +109,16 @@ MTX_SYSINIT(mountlist, &mountlist_mtx, "mountlist", MTX_DEF); EVENTHANDLER_LIST_DEFINE(vfs_mounted); EVENTHANDLER_LIST_DEFINE(vfs_unmounted); +static void vfs_deferred_unmount(void *arg, int pending); +static struct task deferred_unmount_task = + TASK_INITIALIZER(0, vfs_deferred_unmount, NULL);; +static struct mtx deferred_unmount_lock; +MTX_SYSINIT(deferred_unmount, &deferred_unmount_lock, "deferred_unmount", + MTX_DEF); +static STAILQ_HEAD(, mount) deferred_unmount_list = + STAILQ_HEAD_INITIALIZER(deferred_unmount_list); +TASKQUEUE_DEFINE_THREAD(deferred_unmount); + static void mount_devctl_event(const char *type, struct mount *mp, bool donew); /* @@ -505,8 +521,21 @@ vfs_ref(struct mount *mp) MNT_IUNLOCK(mp); } +/* + * Register ump as an upper mount of the mount associated with + * vnode vp. This registration will be tracked through + * mount_upper_node upper, which should be allocated by the + * caller and stored in per-mount data associated with mp. + * + * If successful, this function will return the mount associated + * with vp, and will ensure that it cannot be unmounted until + * ump has been unregistered as one of its upper mounts. + * + * Upon failure this function will return NULL. + */ struct mount * -vfs_pin_from_vp(struct vnode *vp) +vfs_register_upper_from_vp(struct vnode *vp, struct mount *ump, + struct mount_upper_node *upper) { struct mount *mp; @@ -514,26 +543,81 @@ vfs_pin_from_vp(struct vnode *vp) if (mp == NULL) return (NULL); MNT_ILOCK(mp); - if (mp != vp->v_mount || (mp->mnt_kern_flag & MNTK_UNMOUNT) != 0) { + if (mp != vp->v_mount || + ((mp->mnt_kern_flag & (MNTK_UNMOUNT | MNTK_RECURSE)) != 0)) { MNT_IUNLOCK(mp); return (NULL); } + KASSERT(ump != mp, ("upper and lower mounts are identical")); + upper->mp = ump; MNT_REF(mp); - KASSERT(mp->mnt_pinned_count < INT_MAX, - ("mount pinned count overflow")); - ++mp->mnt_pinned_count; + TAILQ_INSERT_TAIL(&mp->mnt_uppers, upper, mnt_upper_link); MNT_IUNLOCK(mp); return (mp); } +/* + * Register upper mount ump to receive vnode unlink/reclaim + * notifications from lower mount mp. This registration will + * be tracked through mount_upper_node upper, which should be + * allocated by the caller and stored in per-mount data + * associated with mp. + * + * ump must already be registered as an upper mount of mp + * through a call to vfs_register_upper_from_vp(). + */ void -vfs_unpin(struct mount *mp) +vfs_register_for_notification(struct mount *mp, struct mount *ump, + struct mount_upper_node *upper) +{ + upper->mp = ump; + MNT_ILOCK(mp); + TAILQ_INSERT_TAIL(&mp->mnt_notify, upper, mnt_upper_link); + MNT_IUNLOCK(mp); +} + +static void +vfs_drain_upper_locked(struct mount *mp) +{ + mtx_assert(MNT_MTX(mp), MA_OWNED); + while (mp->mnt_upper_pending != 0) { + mp->mnt_kern_flag |= MNTK_UPPER_WAITER; + msleep(&mp->mnt_uppers, MNT_MTX(mp), 0, "mntupw", 0); + } +} + +/* + * Undo a previous call to vfs_register_for_notification(). + * The mount represented by upper must be currently registered + * as an upper mount for mp. + */ +void +vfs_unregister_for_notification(struct mount *mp, + struct mount_upper_node *upper) +{ + MNT_ILOCK(mp); + vfs_drain_upper_locked(mp); + TAILQ_REMOVE(&mp->mnt_notify, upper, mnt_upper_link); + MNT_IUNLOCK(mp); +} + +/* + * Undo a previous call to vfs_register_upper_from_vp(). + * This must be done before mp can be unmounted. + */ +void +vfs_unregister_upper(struct mount *mp, struct mount_upper_node *upper) { MNT_ILOCK(mp); - KASSERT(mp->mnt_pinned_count > 0, ("mount pinned count underflow")); KASSERT((mp->mnt_kern_flag & MNTK_UNMOUNT) == 0, - ("mount pinned with pending unmount")); - --mp->mnt_pinned_count; + ("registered upper with pending unmount")); + vfs_drain_upper_locked(mp); + TAILQ_REMOVE(&mp->mnt_uppers, upper, mnt_upper_link); + if ((mp->mnt_kern_flag & MNTK_TASKQUEUE_WAITER) != 0 && + TAILQ_EMPTY(&mp->mnt_uppers)) { + mp->mnt_kern_flag &= ~MNTK_TASKQUEUE_WAITER; + wakeup(&mp->mnt_taskqueue_link); + } MNT_REL(mp); MNT_IUNLOCK(mp); } @@ -600,8 +684,10 @@ vfs_mount_alloc(struct vnode *vp, struct vfsconf *vfsp, const char *fspath, mac_mount_create(cred, mp); #endif arc4rand(&mp->mnt_hashseed, sizeof mp->mnt_hashseed, 0); + mp->mnt_upper_pending = 0; TAILQ_INIT(&mp->mnt_uppers); - mp->mnt_pinned_count = 0; + TAILQ_INIT(&mp->mnt_notify); + mp->mnt_taskqueue_flags = 0; return (mp); } @@ -640,9 +726,9 @@ vfs_mount_destroy(struct mount *mp) vn_printf(vp, "dangling vnode "); panic("unmount: dangling vnode"); } - KASSERT(mp->mnt_pinned_count == 0, - ("mnt_pinned_count = %d", mp->mnt_pinned_count)); + KASSERT(mp->mnt_upper_pending == 0, ("mnt_upper_pending")); KASSERT(TAILQ_EMPTY(&mp->mnt_uppers), ("mnt_uppers")); + KASSERT(TAILQ_EMPTY(&mp->mnt_notify), ("mnt_notify")); if (mp->mnt_nvnodelistsize != 0) panic("vfs_mount_destroy: nonzero nvnodelistsize"); if (mp->mnt_lazyvnodelistsize != 0) @@ -1799,17 +1885,166 @@ vfs_mount_fetch_counter(struct mount *mp, enum mount_counter which) return (sum); } +static bool +deferred_unmount_enqueue(struct mount *mp, uint64_t flags, bool requeue) +{ + bool enqueued; + + enqueued = false; + mtx_lock(&deferred_unmount_lock); + if ((mp->mnt_taskqueue_flags & MNT_DEFERRED) == 0 || requeue) { + mp->mnt_taskqueue_flags = flags | MNT_DEFERRED; + STAILQ_INSERT_TAIL(&deferred_unmount_list, mp, + mnt_taskqueue_link); + enqueued = true; + } + mtx_unlock(&deferred_unmount_lock); + + if (enqueued) { + taskqueue_enqueue(taskqueue_deferred_unmount, + &deferred_unmount_task); + } + + return (enqueued); +} + +/* + * Taskqueue handler for processing async/recursive unmounts + */ +static void +vfs_deferred_unmount(void *argi __unused, int pending __unused) +{ + STAILQ_HEAD(, mount) local_unmounts; + uint64_t flags; + struct mount *mp, *tmp; + bool unmounted; + + STAILQ_INIT(&local_unmounts); + mtx_lock(&deferred_unmount_lock); + STAILQ_CONCAT(&local_unmounts, &deferred_unmount_list); + mtx_unlock(&deferred_unmount_lock); + + STAILQ_FOREACH_SAFE(mp, &local_unmounts, mnt_taskqueue_link, tmp) { + flags = mp->mnt_taskqueue_flags; + KASSERT((flags & MNT_DEFERRED) != 0, + ("taskqueue unmount without MNT_DEFERRED")); + if (dounmount(mp, flags, curthread) != 0) { + MNT_ILOCK(mp); + unmounted = ((mp->mnt_kern_flag & MNTK_REFEXPIRE) != 0); + MNT_IUNLOCK(mp); + if (!unmounted) + deferred_unmount_enqueue(mp, flags, true); + else + vfs_rel(mp); + } + } +} + /* * Do the actual filesystem unmount. */ int -dounmount(struct mount *mp, int flags, struct thread *td) +dounmount(struct mount *mp, uint64_t flags, struct thread *td) { + struct mount_upper_node *upper; struct vnode *coveredvp, *rootvp; int error; uint64_t async_flag; int mnt_gen_r; + KASSERT((flags & MNT_DEFERRED) == 0 || + (flags & (MNT_RECURSE | MNT_FORCE)) == (MNT_RECURSE | MNT_FORCE), + ("MNT_DEFERRED requires MNT_RECURSE | MNT_FORCE")); + + /* + * If the caller has explicitly requested the unmount to be handled by + * the taskqueue and we're not already in taskqueue context, queue + * up the unmount request and exit. This is done prior to any + * credential checks; MNT_DEFERRED should be used only for kernel- + * initiated unmounts and will therefore be processed with the + * (kernel) credentials of the taskqueue thread. Still, callers + * should be sure this is the behavior they want. + */ + if ((flags & MNT_DEFERRED) != 0 && + taskqueue_member(taskqueue_deferred_unmount, curthread) == 0) { + if (!deferred_unmount_enqueue(mp, flags, false)) + vfs_rel(mp); + return (EINPROGRESS); + } + + /* + * Only privileged root, or (if MNT_USER is set) the user that did the + * original mount is permitted to unmount this filesystem. + * This check should be made prior to queueing up any recursive + * unmounts of upper filesystems. Those unmounts will be executed + * with kernel thread credentials and are expected to succeed, so + * we must at least ensure the originating context has sufficient + * privilege to unmount the base filesystem before proceeding with + * the uppers. + */ + error = vfs_suser(mp, td); + if (error != 0) { + KASSERT((flags & MNT_DEFERRED) == 0, + ("taskqueue unmount with insufficient privilege")); + vfs_rel(mp); + return (error); + } + + if (recursive_forced_unmount && ((flags & MNT_FORCE) != 0)) + flags |= MNT_RECURSE; + + if ((flags & MNT_RECURSE) != 0) { + KASSERT((flags & MNT_FORCE) != 0, + ("MNT_RECURSE requires MNT_FORCE")); + + MNT_ILOCK(mp); + /* + * Set MNTK_RECURSE to prevent new upper mounts from being + * added, and note that an operation on the uppers list is in + * progress. This will ensure that unregistration from the + * uppers list, and therefore any pending unmount of the upper + * FS, can't complete until after we finish walking the list. + */ + mp->mnt_kern_flag |= MNTK_RECURSE; + mp->mnt_upper_pending++; + TAILQ_FOREACH(upper, &mp->mnt_uppers, mnt_upper_link) { + MNT_IUNLOCK(mp); + vfs_ref(upper->mp); + if (!deferred_unmount_enqueue(upper->mp, flags, false)) + vfs_rel(upper->mp); + MNT_ILOCK(mp); + } + mp->mnt_upper_pending--; + if ((mp->mnt_kern_flag & MNTK_UPPER_WAITER) != 0 && + mp->mnt_upper_pending == 0) { + mp->mnt_kern_flag &= ~MNTK_UPPER_WAITER; + wakeup(&mp->mnt_uppers); + } + /* + * If we're not on the taskqueue, wait until the uppers list + * is drained before proceeding with unmount. Otherwise, if + * we are on the taskqueue and there are still pending uppers, + * just re-enqueue on the end of the taskqueue. + */ + if ((flags & MNT_DEFERRED) == 0) { + while (!TAILQ_EMPTY(&mp->mnt_uppers)) { + mp->mnt_kern_flag |= MNTK_TASKQUEUE_WAITER; + msleep(&mp->mnt_taskqueue_link, MNT_MTX(mp), 0, + "umntqw", 0); + } + } else if (!TAILQ_EMPTY(&mp->mnt_uppers)) { + MNT_IUNLOCK(mp); + deferred_unmount_enqueue(mp, flags, true); + return (0); + } + MNT_IUNLOCK(mp); + KASSERT(TAILQ_EMPTY(&mp->mnt_uppers), ("mnt_uppers not empty")); + } + + /* Allow the taskqueue to safely re-enqueue on failure */ + if ((flags & MNT_DEFERRED) != 0) + vfs_ref(mp); + if ((coveredvp = mp->mnt_vnodecovered) != NULL) { mnt_gen_r = mp->mnt_gen; VI_LOCK(coveredvp); @@ -1828,27 +2063,13 @@ dounmount(struct mount *mp, int flags, struct thread *td) } } - /* - * Only privileged root, or (if MNT_USER is set) the user that did the - * original mount is permitted to unmount this filesystem. - */ - error = vfs_suser(mp, td); - if (error != 0) { - if (coveredvp != NULL) { - VOP_UNLOCK(coveredvp); - vdrop(coveredvp); - } - vfs_rel(mp); - return (error); - } - vfs_op_enter(mp); vn_start_write(NULL, &mp, V_WAIT | V_MNTREF); MNT_ILOCK(mp); if ((mp->mnt_kern_flag & MNTK_UNMOUNT) != 0 || (mp->mnt_flag & MNT_UPDATE) != 0 || - mp->mnt_pinned_count != 0) { + !TAILQ_EMPTY(&mp->mnt_uppers)) { dounmount_cleanup(mp, coveredvp, 0); return (EBUSY); } @@ -1952,6 +2173,7 @@ dounmount(struct mount *mp, int flags, struct thread *td) } return (error); } + mtx_lock(&mountlist_mtx); TAILQ_REMOVE(&mountlist, mp, mnt_list); mtx_unlock(&mountlist_mtx); @@ -1977,6 +2199,8 @@ dounmount(struct mount *mp, int flags, struct thread *td) } if (mp == rootdevmp) rootdevmp = NULL; + if ((flags & MNT_DEFERRED) != 0) + vfs_rel(mp); vfs_mount_destroy(mp); return (0); } diff --git a/sys/kern/vfs_subr.c b/sys/kern/vfs_subr.c index a2f25bf78495..23f6ec9cf3fd 100644 --- a/sys/kern/vfs_subr.c +++ b/sys/kern/vfs_subr.c @@ -831,9 +831,9 @@ vfs_busy(struct mount *mp, int flags) * valid. */ while (mp->mnt_kern_flag & MNTK_UNMOUNT) { - KASSERT(mp->mnt_pinned_count == 0, - ("%s: non-zero pinned count %d with pending unmount", - __func__, mp->mnt_pinned_count)); + KASSERT(TAILQ_EMPTY(&mp->mnt_uppers), + ("%s: non-empty upper mount list with pending unmount", + __func__)); if (flags & MBF_NOWAIT || mp->mnt_kern_flag & MNTK_REFEXPIRE) { MNT_REL(mp); MNT_IUNLOCK(mp); @@ -3891,61 +3891,44 @@ vgone(struct vnode *vp) VI_UNLOCK(vp); } -static void -notify_lowervp_vfs_dummy(struct mount *mp __unused, - struct vnode *lowervp __unused) -{ -} - /* * Notify upper mounts about reclaimed or unlinked vnode. */ void vfs_notify_upper(struct vnode *vp, int event) { - static struct vfsops vgonel_vfsops = { - .vfs_reclaim_lowervp = notify_lowervp_vfs_dummy, - .vfs_unlink_lowervp = notify_lowervp_vfs_dummy, - }; - struct mount *mp, *ump, *mmp; + struct mount *mp; + struct mount_upper_node *ump; - mp = vp->v_mount; + mp = atomic_load_ptr(&vp->v_mount); if (mp == NULL) return; - if (TAILQ_EMPTY(&mp->mnt_uppers)) + if (TAILQ_EMPTY(&mp->mnt_notify)) return; - mmp = malloc(sizeof(struct mount), M_TEMP, M_WAITOK | M_ZERO); - mmp->mnt_op = &vgonel_vfsops; - mmp->mnt_kern_flag |= MNTK_MARKER; MNT_ILOCK(mp); - mp->mnt_kern_flag |= MNTK_VGONE_UPPER; - for (ump = TAILQ_FIRST(&mp->mnt_uppers); ump != NULL;) { - if ((ump->mnt_kern_flag & MNTK_MARKER) != 0) { - ump = TAILQ_NEXT(ump, mnt_upper_link); - continue; - } - TAILQ_INSERT_AFTER(&mp->mnt_uppers, ump, mmp, mnt_upper_link); + mp->mnt_upper_pending++; + KASSERT(mp->mnt_upper_pending > 0, + ("%s: mnt_upper_pending %d", __func__, mp->mnt_upper_pending)); + TAILQ_FOREACH(ump, &mp->mnt_notify, mnt_upper_link) { MNT_IUNLOCK(mp); switch (event) { case VFS_NOTIFY_UPPER_RECLAIM: - VFS_RECLAIM_LOWERVP(ump, vp); + VFS_RECLAIM_LOWERVP(ump->mp, vp); break; case VFS_NOTIFY_UPPER_UNLINK: - VFS_UNLINK_LOWERVP(ump, vp); + VFS_UNLINK_LOWERVP(ump->mp, vp); break; default: KASSERT(0, ("invalid event %d", event)); break; } MNT_ILOCK(mp); - ump = TAILQ_NEXT(mmp, mnt_upper_link); - TAILQ_REMOVE(&mp->mnt_uppers, mmp, mnt_upper_link); } - free(mmp, M_TEMP); - mp->mnt_kern_flag &= ~MNTK_VGONE_UPPER; - if ((mp->mnt_kern_flag & MNTK_VGONE_WAITER) != 0) { - mp->mnt_kern_flag &= ~MNTK_VGONE_WAITER; + mp->mnt_upper_pending--; + if ((mp->mnt_kern_flag & MNTK_UPPER_WAITER) != 0 && + mp->mnt_upper_pending == 0) { + mp->mnt_kern_flag &= ~MNTK_UPPER_WAITER; wakeup(&mp->mnt_uppers); } MNT_IUNLOCK(mp); @@ -4376,12 +4359,12 @@ DB_SHOW_COMMAND(mount, db_show_mount) MNT_KERN_FLAG(MNTK_EXTENDED_SHARED); MNT_KERN_FLAG(MNTK_SHARED_WRITES); MNT_KERN_FLAG(MNTK_NO_IOPF); - MNT_KERN_FLAG(MNTK_VGONE_UPPER); - MNT_KERN_FLAG(MNTK_VGONE_WAITER); + MNT_KERN_FLAG(MNTK_RECURSE); + MNT_KERN_FLAG(MNTK_UPPER_WAITER); MNT_KERN_FLAG(MNTK_LOOKUP_EXCL_DOTDOT); - MNT_KERN_FLAG(MNTK_MARKER); MNT_KERN_FLAG(MNTK_USES_BCACHE); MNT_KERN_FLAG(MNTK_FPLOOKUP); + MNT_KERN_FLAG(MNTK_TASKQUEUE_WAITER); MNT_KERN_FLAG(MNTK_NOASYNC); MNT_KERN_FLAG(MNTK_UNMOUNT); MNT_KERN_FLAG(MNTK_MWAIT); diff --git a/sys/sys/mount.h b/sys/sys/mount.h index 693293b12370..016c7e9c188d 100644 --- a/sys/sys/mount.h +++ b/sys/sys/mount.h @@ -190,6 +190,19 @@ struct mount_pcpu { _Static_assert(sizeof(struct mount_pcpu) == 16, "the struct is allocated from pcpu 16 zone"); +/* + * Structure for tracking a stacked filesystem mounted above another + * filesystem. This is expected to be stored in the upper FS' per-mount data. + * + * Lock reference: + * i - lower mount interlock + * c - constant from node initialization + */ +struct mount_upper_node { + struct mount *mp; /* (c) mount object for upper FS */ + TAILQ_ENTRY(mount_upper_node) mnt_upper_link; /* (i) position in uppers list */ +}; + /* * Structure per mounted filesystem. Each mounted filesystem has an * array of operations and an instance record. The filesystems are @@ -199,8 +212,8 @@ _Static_assert(sizeof(struct mount_pcpu) == 16, * l - mnt_listmtx * m - mountlist_mtx * i - interlock - * i* - interlock of uppers' list head * v - vnode freelist mutex + * d - deferred unmount list mutex * * Unmarked fields are considered stable as long as a ref is held. * @@ -242,10 +255,12 @@ struct mount { struct mtx mnt_listmtx; struct vnodelst mnt_lazyvnodelist; /* (l) list of lazy vnodes */ int mnt_lazyvnodelistsize; /* (l) # of lazy vnodes */ - int mnt_pinned_count; /* (i) unmount prevented */ + int mnt_upper_pending; /* (i) # of pending ops on mnt_uppers */ struct lock mnt_explock; /* vfs_export walkers lock */ - TAILQ_ENTRY(mount) mnt_upper_link; /* (i*) we in the all uppers */ - TAILQ_HEAD(, mount) mnt_uppers; /* (i) upper mounts over us */ + TAILQ_HEAD(, mount_upper_node) mnt_uppers; /* (i) upper mounts over us */ + TAILQ_HEAD(, mount_upper_node) mnt_notify; /* (i) upper mounts for notification */ + STAILQ_ENTRY(mount) mnt_taskqueue_link; /* (d) our place in deferred unmount list */ + uint64_t mnt_taskqueue_flags; /* (d) unmount flags passed from taskqueue */ }; #endif /* _WANT_MOUNT || _KERNEL */ @@ -438,9 +453,13 @@ struct mntoptnames { #define MNT_BYFSID 0x0000000008000000ULL /* specify filesystem by ID. */ #define MNT_NOCOVER 0x0000001000000000ULL /* Do not cover a mount point */ #define MNT_EMPTYDIR 0x0000002000000000ULL /* Only mount on empty dir */ -#define MNT_CMDFLAGS (MNT_UPDATE | MNT_DELEXPORT | MNT_RELOAD | \ +#define MNT_RECURSE 0x0000100000000000ULL /* recursively unmount uppers */ +#define MNT_DEFERRED 0x0000200000000000ULL /* unmount in async context */ +#define MNT_CMDFLAGS (MNT_UPDATE | MNT_DELEXPORT | MNT_RELOAD | \ MNT_FORCE | MNT_SNAPSHOT | MNT_NONBUSY | \ - MNT_BYFSID | MNT_NOCOVER | MNT_EMPTYDIR) + MNT_BYFSID | MNT_NOCOVER | MNT_EMPTYDIR | \ + MNT_RECURSE | MNT_DEFERRED) + /* * Internal filesystem control flags stored in mnt_kern_flag. * @@ -466,10 +485,9 @@ struct mntoptnames { #define MNTK_NO_IOPF 0x00000100 /* Disallow page faults during reads and writes. Filesystem shall properly handle i/o state on EFAULT. */ -#define MNTK_VGONE_UPPER 0x00000200 -#define MNTK_VGONE_WAITER 0x00000400 +#define MNTK_RECURSE 0x00000200 /* pending recursive unmount */ +#define MNTK_UPPER_WAITER 0x00000400 /* waiting to drain MNTK_UPPER_PENDING */ #define MNTK_LOOKUP_EXCL_DOTDOT 0x00000800 -#define MNTK_MARKER 0x00001000 #define MNTK_UNMAPPED_BUFS 0x00002000 #define MNTK_USES_BCACHE 0x00004000 /* FS uses the buffer cache. */ #define MNTK_TEXT_REFS 0x00008000 /* Keep use ref for text */ @@ -477,8 +495,9 @@ struct mntoptnames { #define MNTK_UNIONFS 0x00020000 /* A hack for F_ISUNIONSTACK */ #define MNTK_FPLOOKUP 0x00040000 /* fast path lookup is supported */ #define MNTK_SUSPEND_ALL 0x00080000 /* Suspended by all-fs suspension */ -#define MNTK_NOASYNC 0x00800000 /* disable async */ -#define MNTK_UNMOUNT 0x01000000 /* unmount in progress */ +#define MNTK_TASKQUEUE_WAITER 0x00100000 /* Waiting on unmount taskqueue */ +#define MNTK_NOASYNC 0x00800000 /* disable async */ +#define MNTK_UNMOUNT 0x01000000 /* unmount in progress */ #define MNTK_MWAIT 0x02000000 /* waiting for unmount to finish */ #define MNTK_SUSPEND 0x08000000 /* request write suspension */ #define MNTK_SUSPEND2 0x04000000 /* block secondary writes */ @@ -952,7 +971,7 @@ vfs_statfs_t __vfs_statfs; * exported vnode operations */ -int dounmount(struct mount *, int, struct thread *); +int dounmount(struct mount *, uint64_t, struct thread *); int kernel_mount(struct mntarg *ma, uint64_t flags); int kernel_vmount(int flags, ...); @@ -1012,8 +1031,13 @@ struct mount *vfs_mount_alloc(struct vnode *, struct vfsconf *, const char *, int vfs_suser(struct mount *, struct thread *); void vfs_unbusy(struct mount *); void vfs_unmountall(void); -struct mount *vfs_pin_from_vp(struct vnode *); -void vfs_unpin(struct mount *); +struct mount *vfs_register_upper_from_vp(struct vnode *, + struct mount *ump, struct mount_upper_node *); +void vfs_register_for_notification(struct mount *, struct mount *, + struct mount_upper_node *); +void vfs_unregister_for_notification(struct mount *, + struct mount_upper_node *); +void vfs_unregister_upper(struct mount *, struct mount_upper_node *); extern TAILQ_HEAD(mntlist, mount) mountlist; /* mounted filesystem list */ extern struct mtx_padalign mountlist_mtx; extern struct nfs_public nfs_pub; diff --git a/sys/ufs/ffs/ffs_vfsops.c b/sys/ufs/ffs/ffs_vfsops.c index 6b7407eb88f9..2ff71cc3e4d1 100644 --- a/sys/ufs/ffs/ffs_vfsops.c +++ b/sys/ufs/ffs/ffs_vfsops.c @@ -281,28 +281,8 @@ ffs_check_blkno(struct mount *mp, ino_t inum, ufs2_daddr_t daddr, int blksize) } /* - * Initiate a forcible unmount. + * On first ENXIO error, initiate an asynchronous forcible unmount. * Used to unmount filesystems whose underlying media has gone away. - */ -static void -ffs_fsfail_unmount(void *v, int pending) -{ - struct fsfail_task *etp; - struct mount *mp; - - etp = v; - - /* - * Find our mount and get a ref on it, then try to unmount. - */ - mp = vfs_getvfs(&etp->fsid); - if (mp != NULL) - dounmount(mp, MNT_FORCE, curthread); - free(etp, M_UFSMNT); -} - -/* - * On first ENXIO error, start a task that forcibly unmounts the filesystem. * * Return true if a cleanup is in progress. */ @@ -320,25 +300,18 @@ ffs_fsfail_cleanup(struct ufsmount *ump, int error) int ffs_fsfail_cleanup_locked(struct ufsmount *ump, int error) { - struct fsfail_task *etp; - struct task *tp; - mtx_assert(UFS_MTX(ump), MA_OWNED); if (error == ENXIO && (ump->um_flags & UM_FSFAIL_CLEANUP) == 0) { ump->um_flags |= UM_FSFAIL_CLEANUP; /* * Queue an async forced unmount. */ - etp = ump->um_fsfail_task; - ump->um_fsfail_task = NULL; - if (etp != NULL) { - tp = &etp->task; - TASK_INIT(tp, 0, ffs_fsfail_unmount, etp); - taskqueue_enqueue(taskqueue_thread, tp); - printf("UFS: forcibly unmounting %s from %s\n", - ump->um_mountp->mnt_stat.f_mntfromname, - ump->um_mountp->mnt_stat.f_mntonname); - } + vfs_ref(ump->um_mountp); + dounmount(ump->um_mountp, + MNT_FORCE | MNT_RECURSE | MNT_DEFERRED, curthread); + printf("UFS: forcibly unmounting %s from %s\n", + ump->um_mountp->mnt_stat.f_mntfromname, + ump->um_mountp->mnt_stat.f_mntonname); } return ((ump->um_flags & UM_FSFAIL_CLEANUP) != 0); } @@ -1046,7 +1019,6 @@ ffs_mountfs(odevvp, mp, td) struct g_consumer *cp; struct mount *nmp; struct vnode *devvp; - struct fsfail_task *etp; int candelete, canspeedup; off_t loc; @@ -1334,9 +1306,6 @@ ffs_mountfs(odevvp, mp, td) (void) ufs_extattr_autostart(mp, td); #endif /* !UFS_EXTATTR_AUTOSTART */ #endif /* !UFS_EXTATTR */ - etp = malloc(sizeof *ump->um_fsfail_task, M_UFSMNT, M_WAITOK | M_ZERO); - etp->fsid = mp->mnt_stat.f_fsid; - ump->um_fsfail_task = etp; return (0); out: if (fs != NULL) { @@ -1583,8 +1552,6 @@ ffs_unmount(mp, mntflags) free(fs->fs_csp, M_UFSMNT); free(fs->fs_si, M_UFSMNT); free(fs, M_UFSMNT); - if (ump->um_fsfail_task != NULL) - free(ump->um_fsfail_task, M_UFSMNT); free(ump, M_UFSMNT); mp->mnt_data = NULL; MNT_ILOCK(mp); diff --git a/sys/ufs/ufs/ufsmount.h b/sys/ufs/ufs/ufsmount.h index 6071faec795c..f2951d74d44c 100644 --- a/sys/ufs/ufs/ufsmount.h +++ b/sys/ufs/ufs/ufsmount.h @@ -67,10 +67,6 @@ struct inodedep; TAILQ_HEAD(inodedeplst, inodedep); LIST_HEAD(bmsafemaphd, bmsafemap); LIST_HEAD(trimlist_hashhead, ffs_blkfree_trim_params); -struct fsfail_task { - struct task task; - fsid_t fsid; -}; #include #include @@ -123,7 +119,6 @@ struct ufsmount { struct taskqueue *um_trim_tq; /* (c) trim request queue */ struct trimlist_hashhead *um_trimhash; /* (i) trimlist hash table */ u_long um_trimlisthashsize; /* (i) trim hash table size-1 */ - struct fsfail_task *um_fsfail_task; /* (i) task for fsfail cleanup*/ /* (c) - below function ptrs */ int (*um_balloc)(struct vnode *, off_t, int, struct ucred *, int, struct buf **); diff --git a/tools/test/stress2/misc/all.exclude b/tools/test/stress2/misc/all.exclude index 9e9226c28574..d82abb3326c4 100644 --- a/tools/test/stress2/misc/all.exclude +++ b/tools/test/stress2/misc/all.exclude @@ -6,7 +6,7 @@ backingstore2.sh panic: 43 vncache entries remaining 20111220 backingstore3.sh g_vfs_done():md6a[WRITE(offset=...)]error = 28 20111230 dd.sh CAM stuck in vmwait 20200116 devfs4.sh Hang seen 20210210 -force4.sh https://people.freebsd.org/~pho/stress/log/log0082.txt 20210328 +Xforce4.sh https://people.freebsd.org/~pho/stress/log/log0082.txt 20210328 fsync.sh panic: Journal overflow 20190208 fuse.sh Memory corruption seen in log file kostik734.txt 20141114 fuse2.sh Deadlock seen 20121129 -- Test scenario: misc/f4.sh (WiP test)