Fatal trap 12: page fault while in kernel mode, vmcore.679 KDB: debugger backends: ddb KDB: current backend: ddb ---<>--- Copyright (c) 1992-2023 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 14.0-CURRENT #0 main-n261822-f858eb916fd26-dirty: Tue Mar 28 07:00:05 CEST 2023 pho@mercat1.netperf.freebsd.org:/usr/src/sys/amd64/compile/PHO amd64 FreeBSD clang version 15.0.7 (https://github.com/llvm/llvm-project.git llvmorg-15.0.7-0-g8dfdcc7b7bf6) WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. VT(vga): resolution 640x480 CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.08-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab Structured Extended Features3=0x9c000400 XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics real memory = 34359738368 (32768 MB) avail memory = 33167970304 (31631 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 12 CPUs FreeBSD/SMP: 1 package(s) x 6 core(s) x 2 hardware threads random: registering fast source Intel Secure Key RNG random: fast provider: "Intel Secure Key RNG" random: unblocking device. ioapic0 irqs 0-23 ioapic1 irqs 24-47 Launching APs: 1 5 8 4 6 10 9 2 11 7 3 random: entropy device external interface kbd1 at kbdmux0 vtvga0: smbios0: at iomem 0xf05e0-0xf05fe smbios0: Version: 3.0, BCD Revision: 3.0 aesni0: acpi0: <> acpi0: Power Button (fixed) cpu0: on acpi0 atrtc0: port 0x70-0x71,0x74-0x77 irq 8 on acpi0 atrtc0: registered as a time-of-day clock, resolution 1.000000s Event timer "RTC" frequency 32768 Hz quality 0 attimer0: port 0x40-0x43,0x50-0x53 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Event timer "HPET" frequency 14318180 Hz quality 350 Event timer "HPET1" frequency 14318180 Hz quality 340 Event timer "HPET2" frequency 14318180 Hz quality 340 Event timer "HPET3" frequency 14318180 Hz quality 340 Event timer "HPET4" frequency 14318180 Hz quality 340 Event timer "HPET5" frequency 14318180 Hz quality 340 Event timer "HPET6" frequency 14318180 Hz quality 340 Event timer "HPET7" frequency 14318180 Hz quality 340 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 pcib0: on acpi0 pci0: on pcib0 pci0: at device 11.1 (no driver attached) pci0: at device 11.2 (no driver attached) pci0: at device 16.1 (no driver attached) pci0: at device 16.6 (no driver attached) pci0: at device 18.1 (no driver attached) acpi_syscontainer0: on acpi0 pcib1: port 0xcf8-0xcff on acpi0 pci1: on pcib1 pcib2: irq 26 at device 1.0 on pci1 pci2: on pcib2 pcib3: irq 32 at device 2.0 on pci1 pci3: on pcib3 pci3: at device 0.0 (no driver attached) pci3: at device 0.1 (no driver attached) pcib4: irq 40 at device 3.0 on pci1 pci4: on pcib4 pci1: at device 17.0 (no driver attached) ahci0: port 0xf110-0xf117,0xf100-0xf103,0xf0f0-0xf0f7,0xf0e0-0xf0e3,0xf020-0xf03f mem 0xfb416000-0xfb4167ff irq 16 at device 17.4 on pci1 ahci0: AHCI v1.30 with 4 6Gbps ports, Port Multiplier not supported ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahcich2: at channel 2 on ahci0 ahcich3: at channel 3 on ahci0 ahciem0: on ahci0 xhci0: mem 0xfb400000-0xfb40ffff irq 19 at device 20.0 on pci1 xhci0: 32 bytes context size, 64-bit DMA usbus0 on xhci0 usbus0: 5.0Gbps Super Speed USB v3.0 pci1: at device 22.0 (no driver attached) pci1: at device 22.1 (no driver attached) ehci0: mem 0xfb412000-0xfb4123ff irq 18 at device 26.0 on pci1 usbus1: EHCI version 1.0 usbus1 on ehci0 usbus1: 480Mbps High Speed USB v2.0 pcib5: irq 16 at device 28.0 on pci1 pci5: on pcib5 pcib6: irq 18 at device 28.2 on pci1 pci6: on pcib6 pcib7: at device 0.0 on pci6 pci7: on pcib7 vgapci0: port 0xe000-0xe07f mem 0xfa000000-0xfaffffff,0xfb000000-0xfb01ffff irq 18 at device 0.0 on pci7 vgapci0: Boot video device pcib8: irq 16 at device 28.4 on pci1 pci8: on pcib8 igb0: port 0xd020-0xd03f mem 0xfb320000-0xfb33ffff,0xfb344000-0xfb347fff irq 16 at device 0.0 on pci8 igb0: EEPROM V1.63-0 eTrack 0x800009fa igb0: Using 1024 TX descriptors and 1024 RX descriptors igb0: queue equality override not set, capping rx_queues at 6 and tx_queues at 6 igb0: 5 Process (pid 1) got signal 5 Process (pid 1) got signal 5 Process (pid 1) got signal 5 Process (pid 1) got signal 5 Process (pid 1) got signal 5 Process (pid 1) got signal 5 Process (pid 1) got signal 5 uhub4: 8 ports with 8 removable, self powered Process (pid 1) got signal 5 Process (pid 1) got signal 5 : : Process (pid 1) got signal 5 Process (pid 1) got signal 5 Process (pid 1) got signal 5 igb0: link state changed to UP debugnet_any_ifnet_update: Bad dn_init result from igb0 (ifp 0xfffff80006041800), ignoring. Interface IP-Address Broadcast Setting hostuuid: 00000000-0000-0000-0000-002590c99976. Setting hostid: 0x90b83241. Starting file system checks: WARNING: / was not properly dismounted Mounting local filesystems:. fsck2+ fsck -fy /tmp ** /dev/gpt/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 558 files, 8210 used, 1257197 free (189 frags, 157126 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** + set +x Updating CPU Microcode... CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.00-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab Structured Extended Features3=0x9c000400 XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics Done. ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat/pkg /usr/local/lib/compat /usr/local/lib/compat/pkg /usr/local/lib/e2fsprogs /usr/local/lib/gcc10 /usr/local/lib/gcc8 /usr/local/lib/gcc9 /usr/local/lib/perl5/5.32/mach/CORE 32-bit compatibility ldconfig path: /usr/lib32 /usr/local/lib32/compat Setting hostname: mercat1.netperf.freebsd.org. Setting up harvesting: PURE_RDRAND,[CALLOUT],[UMA],[FS_ATIME],SWI,INTERRUPT,NET_NG,[NET_ETHER],NET_TUN,MOUSE,KEYBOARD,ATTACH,CACHED Feeding entropy: . Autoloading module: acpi_wmi.ko Autoloading module: ichsmb.ko Autoloading module: ioat.ko acpi_wmi0: on acpi0 acpi_wmi0: cannot find EC device ioat0: mem 0x383ffff1c000-0x383ffff1ffff irq 31 at device 4.0 on pci1 ioat0: Capabilities: 2f7 ioat1: mem 0x383ffff18000-0x383ffff1bfff irq 39 at device 4.1 on pci1 ioat1: Capabilities: 2f7 ioat2: mem 0x383ffff14000-0x383ffff17fff irq 31 at device 4.2 on pci1 ioat2: Capabilities: f7 ioat3: mem 0x383ffff10000-0x383ffff13fff irq 39 at device 4.3 on pci1 ioat3: Capabilities: f7 ioat4: mem 0x383ffff0c000-0x383ffff0ffff irq 31 at device 4.4 on pci1 ioat4: Capabilities: f7 ioat5: mem 0x383ffff08000-0x383ffff0bfff irq 39 at device 4.5 on pci1 ioat5: Capabilities: f7 ioat6: mem 0x383ffff04000-0x383ffff07fff irq 31 at device 4.6 on pci1 ioat6: Capabilities: f7 ioat7: mem 0x383ffff00000-0x383ffff03fff irq 39 at device 4.7 on pci1 ioat7: Capabilities: f7 ichsmb0: port 0x580-0x59f mem 0x383ffff21000-0x383ffff210ff irq 18 at device 31.3 on pci1 smbus0: on ichsmb0 lo0: link state changed to UP Autoloading module: mlx5.ko interface mlx5.1 already present in the KLD 'kernel'! linker_load_file: /boot/kernel/mlx5.ko - unsupported file type kldload: an error occurred while loading module mlx5.ko. Please check dmesg(8) for more details. Autoloading moduinterface mlx5.1 already present in the KLD 'kernel'! linker_load_file: /boot/kernel/mlx5.ko - unsupported file type le: mlx5.ko kldload: an error occurred while loading module mlx5.ko. Please check dmesg(8) for more details. Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Starting Network: igb1. igb1: flags=8822 metric 0 mtu 1500 options=4e507bb ether 0c:c4:7a:a8:cd:db media: Ethernet autoselect status: no carrier nd6 options=29 Autoloading module: ichsmb.ko Autoloading module: acpi_wmi.ko Starting Network: mce0. mce0: flags=8822 metric 0 mtu 1500 options RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWFILTER,VLAN_HWTSO,LINKSTATE,RXCSUM_IPV6,TXCSUM_IPV6,HWSTATS,HWRXTSTMP,MEXTPG,TXTLS4,TXTLS6,VXLAN_HWCSUM,VXLAN_HWTSO,RXTLS6 ether 7c:fe:90:30:ee:38 media: Ethernet autoselect status: no carrier nd6 options=29 Starting Network: mce1. mce1: flags=8822 metric 0 mtu 1500 options RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWFILTER,VLAN_HWTSO,LINKSTATE,RXCSUM_IPV6,TXCSUM_IPV6,HWSTATS,HWRXTSTMP,MEXTPG,TXTLS4,TXTLS6,VXLAN_HWCSUM,VXLAN_HWTSO,RXTLS6 ether 7c:fe:90:30:ee:39 media: Ethernet autoselect status: no carrier nd6 options=29 Autoloading module: uhid.ko Autoloading module: usbhid.ko Autoloading module: wmt.ko uhid0 on uhub1 uhid0: on usbus0 Autoloading module: uhid.ko Autoloading module: ums.ko Autoloading module: usbhid.ko ums0 on uhub5 ums0: on usbus0 ums0: 3 buttons and [Z] coordinates ID=0 Starting dhclient. DHCPREQUEST on igb0 to 255.255.255.255 port 67 DHCPACK from 192.168.5.1 bound to 192.168.5.171 -- renewal in 300 seconds. Autoloading module: uhid.ko Autoloading module: ums.ko Autoloading module: usbhid.ko add host 127.0.0.1: gateway lo0 fib 0: route already in table add host ::1: gateway lo0 fib 0: route already in table add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Creating and/or trimming log files. Updating motd:. Recovering vi editor sessions:. Starting syslogd. Clearing /tmp (X related). No core dumps found. Starting watchdogd. Setting date via ntp. 28 Mar 07:15:41 ntpdate[2911]: step time server 192.168.5.1 offset +0.267358 sec Mounting late filesystems:. Security policy loaded: MAC/ntpd (mac_ntpd) Starting ntpd. Starting powerd. Starting cron. Performing sanity check on sshd configuration. Starting sshd. Configuring vt: blanktime. Starting inetd. sysctl: unknown oid 'debug.fail_point.pmap_allocpte_page_alloc' at line 12 Tue Mar 28 07:15 FreeBSD/amd64 (mercat1.netperf.freebsd.org) (ttyu1) login: Mar 28 07:15:55 mercat1 su[3055]: pho to root on /dev/pts/0 20230328 07:16:24 all (1/1): unionfs9.sh 20230328 07:21:26 all (1/1): unionfs9.sh 20230328 07:26:31 all (1/1): unionfs9.sh stress2: pts leak: 1/2 20230328 07:31:33 all (1/1): unionfs9.sh Fatal trap 12: page fault while in kernel mode cpuid = 2; apic id = 02 fault virtual address = 0x10 fault code = supervisor read data, page not present instruction pointer = 0x20:0xffffffff82753417 stack pointer = 0x0:0xfffffe01438a8a80 frame pointer = 0x0:0xfffffe01438a8aa0 code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags = interrupt enabled, resume, IOPL = 0 current process = 2382 (find) rdi: fffffe015b22d700 rsi: 82000 rdx: fffffe01438a8ad8 rcx: 1 r8: 246 r9: 40000 rax: 0 rbx: fffffe015b22d700 rbp: fffffe01438a8aa0 r10: 1 r11: 0 r12: 80000 r13: fffffe01599802c0 r14: fffffe01438a8ad8 r15: 82000 trap number = 12 panic: page fault cpuid = 2 time = 1679981682 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe01438a8840 vpanic() at vpanic+0x152/frame 0xfffffe01438a8890 panic() at panic+0x43/frame 0xfffffe01438a88f0 trap_fatal() at trap_fatal+0x409/frame 0xfffffe01438a8950 trap_pfault() at trap_pfault+0xab/frame 0xfffffe01438a89b0 calltrap() at calltrap+0x8/frame 0xfffffe01438a89b0 --- trap 0xc, rip = 0xffffffff82753417, rsp = 0xfffffe01438a8a80, rbp = 0xfffffe01438a8aa0 --- unionfs_root() at unionfs_root+0x17/frame 0xfffffe01438a8aa0 vfs_lookup() at vfs_lookup+0x92a/frame 0xfffffe01438a8b40 namei() at namei+0x340/frame 0xfffffe01438a8bc0 kern_statat() at kern_statat+0x12f/frame 0xfffffe01438a8d00 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe01438a8e00 amd64_syscall() at amd64_syscall+0x15a/frame 0xfffffe01438a8f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01438a8f30 --- syscall (552, FreeBSD ELF64, fstatat), rip = 0x1e9fa9c98, rbp = 0x1e9fa1989db0 --- KDB: enter: panic [ thread pid 2382 tid 100297 ] Stopped at kdb_enter+0x32: movq $0,0x128fe83(%rip) db> run pho db:0:pho> set $lines 20000 db:0:pho> run pho1 db:1:pho1> dump Dumping 2100 out of 32617 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% Dump complete db:1:pho1> bt Tracing pid 2382 tid 100297 td 0xfffffe01437da740 kdb_enter() at kdb_enter+0x32/frame 0xfffffe01438a8840 vpanic() at vpanic+0x183/frame 0xfffffe01438a8890 panic() at panic+0x43/frame 0xfffffe01438a88f0 trap_fatal() at trap_fatal+0x409/frame 0xfffffe01438a8950 trap_pfault() at trap_pfault+0xab/frame 0xfffffe01438a89b0 calltrap() at calltrap+0x8/frame 0xfffffe01438a89b0 --- trap 0xc, rip = 0xffffffff82753417, rsp = 0xfffffe01438a8a80, rbp = 0xfffffe01438a8aa0 --- unionfs_root() at unionfs_root+0x17/frame 0xfffffe01438a8aa0 vfs_lookup() at vfs_lookup+0x92a/frame 0xfffffe01438a8b40 namei() at namei+0x340/frame 0xfffffe01438a8bc0 kern_statat() at kern_statat+0x12f/frame 0xfffffe01438a8d00 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe01438a8e00 amd64_syscall() at amd64_syscall+0x15a/frame 0xfffffe01438a8f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01438a8f30 --- syscall (552, FreeBSD ELF64, fstatat), rip = 0x1e9fa3f465fa, rsp = 0x1e9fa1989c98, rbp = 0x1e9fa1989db0 --- db:1:pho1> show allpcpu Current CPU: 2 cpuid = 0 dynamic pcpu = 0x9c8540 curthread = 0xfffffe010e7e2ac0: pid 57970 tid 100447 critnest 0 "swap" curpcb = 0xfffffe010e7e2fe0 fpcurthread = 0xfffffe010e7e2ac0: pid 57970 "swap" idlethread = 0xfffffe00e4c6a3a0: tid 100003 "idle: cpu0" self = 0xffffffff82610000 curpmap = 0xfffffe015b2ca530 tssp = 0xffffffff82610384 rsp0 = 0xfffffe015b572000 kcr3 = 0x80000006bf241002 ucr3 = 0x80000006d2624802 scr3 = 0x7f3d0a806 gs32p = 0xffffffff82610404 ldt = 0xffffffff82610444 tss = 0xffffffff82610434 curvnet = 0 spin locks held: cpuid = 1 dynamic pcpu = 0xfffffe00bb275540 curthread = 0xfffffe0145b6bac0: pid 57980 tid 100445 critnest 0 "swap" curpcb = 0xfffffe0145b6bfe0 fpcurthread = 0xfffffe0145b6bac0: pid 57980 "swap" idlethread = 0xfffffe00e4c69c80: tid 100004 "idle: cpu1" self = 0xffffffff82611000 curpmap = 0xfffffe014373b130 tssp = 0xffffffff82611384 rsp0 = 0xfffffe015b559000 kcr3 = 0x80000000593e75c3 ucr3 = 0x80000001fcc44dc3 scr3 = 0x1c4e3be0c gs32p = 0xffffffff82611404 ldt = 0xffffffff82611444 tss = 0xffffffff82611434 curvnet = 0 spin locks held: cpuid = 2 dynamic pcpu = 0xfffffe00bb284540 curthread = 0xfffffe01437da740: pid 2382 tid 100297 critnest 1 "find" curpcb = 0xfffffe01437dac60 fpcurthread = 0xfffffe01437da740: pid 2382 "find" idlethread = 0xfffffe00e4c69560: tid 100005 "idle: cpu2" self = 0xffffffff82612000 curpmap = 0xfffffe010e7fc530 tssp = 0xffffffff82612384 rsp0 = 0xfffffe01438a9000 kcr3 = 0x800000061844b555 ucr3 = 0x800000015350dd55 scr3 = 0x1ed291d54 gs32p = 0xffffffff82612404 ldt = 0xffffffff82612444 tss = 0xffffffff82612434 curvnet = 0 spin locks held: cpuid = 3 dynamic pcpu = 0xfffffe00bb293540 curthread = 0xfffffe0150996c80: pid 57978 tid 100435 critnest 0 "swap" curpcb = 0xfffffe01509971a0 fpcurthread = 0xfffffe0150996c80: pid 57978 "swap" idlethread = 0xfffffe00e4c68e40: tid 100006 "idle: cpu3" self = 0xffffffff82613000 curpmap = 0xfffffe014373c530 tssp = 0xffffffff82613384 rsp0 = 0xfffffe015b52c000 kcr3 = 0x80000004ecc00228 ucr3 = 0x80000004b917ca28 scr3 = 0x4be5899fb gs32p = 0xffffffff82613404 ldt = 0xffffffff82613444 tss = 0xffffffff82613434 curvnet = 0 spin locks held: cpuid = 4 dynamic pcpu = 0xfffffe00bb2a2540 curthread = 0xfffffe010e3fa000: pid 9 tid 100195 critnest 0 "dom0" curpcb = 0xfffffe010e3fa520 fpcurthread = none idlethread = 0xfffffe00e4c68720: tid 100007 "idle: cpu4" self = 0xffffffff82614000 curpmap = 0xffffffff81e846f0 tssp = 0xffffffff82614384 rsp0 = 0xfffffe010db47000 kcr3 = 0x800000000257e002 ucr3 = 0xffffffffffffffff scr3 = 0x2d12df8f4 gs32p = 0xffffffff82614404 ldt = 0xffffffff82614444 tss = 0xffffffff82614434 curvnet = 0 spin locks held: cpuid = 5 dynamic pcpu = 0xfffffe00bb2b1540 curthread = 0xfffffe015b2b5900: pid 57983 tid 100451 critnest 0 "swap" curpcb = 0xfffffe015b2b5e20 fpcurthread = 0xfffffe015b2b5900: pid 57983 "swap" idlethread = 0xfffffe00e4c68000: tid 100008 "idle: cpu5" self = 0xffffffff82615000 curpmap = 0xfffffe010e7fb130 tssp = 0xffffffff82615384 rsp0 = 0xfffffe015b586000 kcr3 = 0x80000007785c9042 ucr3 = 0x8000000107ed9842 scr3 = 0x40536582e gs32p = 0xffffffff82615404 ldt = 0xffffffff82615444 tss = 0xffffffff82615434 curvnet = 0 spin locks held: cpuid = 6 dynamic pcpu = 0xfffffe00bb2c0540 curthread = 0xfffffe0145b6d020: pid 57975 tid 100444 critnest 0 "swap" curpcb = 0xfffffe0145b6d540 fpcurthread = 0xfffffe0145b6d020: pid 57975 "swap" idlethread = 0xfffffe00e4c72c80: tid 100009 "idle: cpu6" self = 0xffffffff82616000 curpmap = 0xfffffe015b2f7130 tssp = 0xffffffff82616384 rsp0 = 0xfffffe015b55e000 kcr3 = 0x80000004a6911057 ucr3 = 0x80000004a6910857 scr3 = 0x7788c88a7 gs32p = 0xffffffff82616404 ldt = 0xffffffff82616444 tss = 0xffffffff82616434 curvnet = 0 spin locks held: cpuid = 7 dynamic pcpu = 0xfffffe00bb2cf540 curthread = 0xfffffe0145b6ac80: pid 57985 tid 100446 critnest 0 "swap" curpcb = 0xfffffe0145b6b1a0 fpcurthread = 0xfffffe0145b6ac80: pid 57985 "swap" idlethread = 0xfffffe00e4c72560: tid 100010 "idle: cpu7" self = 0xffffffff82617000 curpmap = 0xfffffe014378f530 tssp = 0xffffffff82617384 rsp0 = 0xfffffe015b568000 kcr3 = 0x80000007ec9f0476 ucr3 = 0x80000007aa8ffc76 scr3 = 0x667b77c84 gs32p = 0xffffffff82617404 ldt = 0xffffffff82617444 tss = 0xffffffff82617434 curvnet = 0 spin locks held: cpuid = 8 dynamic pcpu = 0xfffffe00bb2de540 curthread = 0xfffffe010d9ca900: pid 57973 tid 100240 critnest 0 "swap" curpcb = 0xfffffe010d9cae20 fpcurthread = 0xfffffe010d9ca900: pid 57973 "swap" idlethread = 0xfffffe00e4c71e40: tid 100011 "idle: cpu8" self = 0xffffffff82618000 curpmap = 0xfffffe010e7e9b30 tssp = 0xffffffff82618384 rsp0 = 0xfffffe010dba1000 kcr3 = 0x800000056c357316 ucr3 = 0x80000002d968bb16 scr3 = 0x6d2659b15 gs32p = 0xffffffff82618404 ldt = 0xffffffff82618444 tss = 0xffffffff82618434 curvnet = 0 spin locks held: cpuid = 9 dynamic pcpu = 0xfffffe00bb2ed540 curthread = 0xfffffe0150997ac0: pid 57984 tid 100365 critnest 0 "swap" curpcb = 0xfffffe0150997fe0 fpcurthread = 0xfffffe0150997ac0: pid 57984 "swap" idlethread = 0xfffffe00e4c71720: tid 100012 "idle: cpu9" self = 0xffffffff82619000 curpmap = 0xfffffe010e68c530 tssp = 0xffffffff82619384 rsp0 = 0xfffffe0143973000 kcr3 = 0x80000004a69334e8 ucr3 = 0x80000004ac7e6ce8 scr3 = 0x405365d56 gs32p = 0xffffffff82619404 ldt = 0xffffffff82619444 tss = 0xffffffff82619434 curvnet = 0 spin locks held: cpuid = 10 dynamic pcpu = 0xfffffe00bb2fc540 curthread = 0xfffffe0143599900: pid 57971 tid 100448 critnest 0 "swap" curpcb = 0xfffffe0143599e20 fpcurthread = 0xfffffe0143599900: pid 57971 "swap" idlethread = 0xfffffe00e4c71000: tid 100013 "idle: cpu10" self = 0xffffffff8261a000 curpmap = 0xfffffe015b2df130 tssp = 0xffffffff8261a384 rsp0 = 0xfffffe015b53b000 kcr3 = 0x80000000270a3554 ucr3 = 0x80000002689ebd54 scr3 = 0x2d12dfd5b gs32p = 0xffffffff8261a404 ldt = 0xffffffff8261a444 tss = 0xffffffff8261a434 curvnet = 0 spin locks held: cpuid = 11 dynamic pcpu = 0xfffffe00bb30b540 curthread = 0xfffffe015b08b000: pid 57982 tid 100474 critnest 0 "swap" curpcb = 0xfffffe015b08b520 fpcurthread = 0xfffffe015b08b000: pid 57982 "swap" idlethread = 0xfffffe00e4c6c740: tid 100014 "idle: cpu11" self = 0xffffffff8261b000 curpmap = 0xfffffe015b2e5b30 tssp = 0xffffffff8261b384 rsp0 = 0xfffffe015b5ea000 kcr3 = 0x80000004d1162664 ucr3 = 0x80000004df0d6e64 scr3 = 0x69f0be63 gs32p = 0xffffffff8261b404 ldt = 0xffffffff8261b444 tss = 0xffffffff8261b434 curvnet = 0 spin locks held: db:1:pho1> show alllocks Process 2416 (find) thread 0xfffffe010e25e1e0 (100266) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe00387bfb20) locked @ kern/vfs_bio.c:1728 shared lockmgr ufs (ufs) r = 0 (0xfffffe015b26d070) locked @ /usr/src/sys/fs/unionfs/union_vnops.c:2031 shared lockmgr ufs (ufs) r = 0 (0xfffffe015b222330) locked @ /usr/src/sys/fs/unionfs/union_vnops.c:2000 Process 2382 (find) thread 0xfffffe01437da740 (100297) exclusive lockmgr ufs (ufs) r = 0 (0xfffffe0159980330) locked @ kern/vfs_lookup.c:1277 db:1:pho1> show lockedvnods Locked vnodes vnode 0xfffffe01599802c0: type VDIR state VSTATE_CONSTRUCTED usecount 2, writecount 0, refcount 1 seqc users 1 mountedhere 0 hold count flags () flags (VI_MOUNT) v_object 0xfffff8076d9e3a50 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe01437da740 (pid 2382, find, tid 100297) #0 0xffffffff80bc012e at lockmgr_xlock_hard+0x4be #1 0xffffffff80f5c54d at ffs_lock+0x9d #2 0xffffffff811c29bc at VOP_LOCK1_APV+0x3c #3 0xffffffff80cfffd4 at _vn_lock+0x54 #4 0xffffffff80cd783a at vfs_lookup+0x9da #5 0xffffffff80cd65d0 at namei+0x340 #6 0xffffffff80cf83af at kern_statat+0x12f #7 0xffffffff80cf8aff at sys_fstatat+0x2f #8 0xffffffff810ee59a at amd64_syscall+0x15a #9 0xffffffff810c182b at fast_syscall_common+0xf8 nlink=2, effnlink=2, size=512, extsize 0 generation=505fc10b, uid=0, gid=0, flags=0x0 ino 106820736, on dev gpt/work vnode 0xfffffe015b2222c0: type VDIR state VSTATE_CONSTRUCTED usecount 2, writecount 0, refcount 4 seqc users 0 mountedhere 0xfffffe015b22cb80 hold count flags () flags (VIRF_MOUNTPOINT|VV(0x8000)) v_object 0xfffff80778b45c60 ref 0 pages 1 cleanbuf 1 dirtybuf 0 lock type ufs: SHARED (count 1) with exclusive waiters pending #0 0xffffffff80bbf5ff at lockmgr_lock_flags+0x1df #1 0xffffffff80f5c54d at ffs_lock+0x9d #2 0xffffffff811c29bc at VOP_LOCK1_APV+0x3c #3 0xffffffff82756a53 at unionfs_lock+0x263 #4 0xffffffff811c29bc at VOP_LOCK1_APV+0x3c #5 0xffffffff80cfffd4 at _vn_lock+0x54 #6 0xffffffff80cfc9e7 at kern_getdirentries+0x147 #7 0xffffffff80cfcc89 at sys_getdirentries+0x29 #8 0xffffffff810ee59a at amd64_syscall+0x15a #9 0xffffffff810c182b at fast_syscall_common+0xf8 nlink=2, effnlink=2, size=512, extsize 0 generation=b7f1e3e0, uid=0, gid=0, flags=0x0 ino 23274240, on dev gpt/work vnode 0xfffffe015b26d000: type VDIR state VSTATE_CONSTRUCTED usecount 3, writecount 0, refcount 4 seqc users 0 mountedhere 0 hold count flags () flags (VV_ROOT|VMP_LAZYLIST) v_object 0xfffff80365074738 ref 0 pages 2 cleanbuf 1 dirtybuf 0 lock type ufs: SHARED (count 1) with exclusive waiters pending #0 0xffffffff80bbf5ff at lockmgr_lock_flags+0x1df #1 0xffffffff80f5c54d at ffs_lock+0x9d #2 0xffffffff811c29bc at VOP_LOCK1_APV+0x3c #3 0xffffffff80cfffd4 at _vn_lock+0x54 #4 0xffffffff80ce6a7a at vget_finish+0x7a #5 0xffffffff80ccbc09 at cache_fplookup_final_child+0x49 #6 0xffffffff80cc888e at cache_fplookup+0x7fe #7 0xffffffff80cd647b at namei+0x1eb #8 0xffffffff80cf83af at kern_statat+0x12f #9 0xffffffff80cf8aff at sys_fstatat+0x2f #10 0xffffffff810ee59a at amd64_syscall+0x15a #11 0xffffffff810c182b at fast_syscall_common+0xf8 nlink=2, effnlink=2, size=6144, extsize 0 generation=7fa3f2a2, uid=0, gid=0, flags=0x0 ino 2, on dev md10 vnode 0xfffffe0159873258: type VDIR state VSTATE_CONSTRUCTED usecount 3, writecount 0, refcount 1 seqc users 0 mountedhere 0 hold count flags () flags (VV_ROOT) v_object 0xfffff80365074738 ref 0 pages 2 cleanbuf 0 dirtybuf 0 lock type ufs: SHARED (count 1) with exclusive waiters pending #0 0xffffffff80bbf5ff at lockmgr_lock_flags+0x1df #1 0xffffffff80f5c54d at ffs_lock+0x9d #2 0xffffffff811c29bc at VOP_LOCK1_APV+0x3c #3 0xffffffff80cfffd4 at _vn_lock+0x54 #4 0xffffffff80ce6a7a at vget_finish+0x7a #5 0xffffffff80ccbc09 at cache_fplookup_final_child+0x49 #6 0xffffffff80cc888e at cache_fplookup+0x7fe #7 0xffffffff80cd647b at namei+0x1eb #8 0xffffffff80cf83af at kern_statat+0x12f #9 0xffffffff80cf8aff at sys_fstatat+0x2f #10 0xffffffff810ee59a at amd64_syscall+0x15a #11 0xffffffff810c182b at fast_syscall_common+0xf8 unionfs_vp=0xfffffe0159873258, uppervp=0xfffffe015b26d000, lowervp=0xfffffe015b2222c0 unionfs: upper 0xfffffe015b26d000: type VDIR state VSTATE_CONSTRUCTED usecount 3, writecount 0, refcount 4 seqc users 0 mountedhere 0 hold count flags () flags (VV_ROOT|VMP_LAZYLIST) v_object 0xfffff80365074738 ref 0 pages 2 cleanbuf 1 dirtybuf 0 lock type ufs: SHARED (count 1) with exclusive waiters pending #0 0xffffffff80bbf5ff at lockmgr_lock_flags+0x1df #1 0xffffffff80f5c54d at ffs_lock+0x9d #2 0xffffffff811c29bc at VOP_LOCK1_APV+0x3c #3 0xffffffff80cfffd4 at _vn_lock+0x54 #4 0xffffffff80ce6a7a at vget_finish+0x7a #5 0xffffffff80ccbc09 at cache_fplookup_final_child+0x49 #6 0xffffffff80cc888e at cache_fplookup+0x7fe #7 0xffffffff80cd647b at namei+0x1eb #8 0xffffffff80cf83af at kern_statat+0x12f #9 0xffffffff80cf8aff at sys_fstatat+0x2f #10 0xffffffff810ee59a at amd64_syscall+0x15a #11 0xffffffff810c182b at fast_syscall_common+0xf8 nlink=2, effnlink=2, size=6144, extsize 0 generation=7fa3f2a2, uid=0, gid=0, flags=0x0 ino 2, on dev md10 unionfs: lower 0xfffffe015b2222c0: type VDIR state VSTATE_CONSTRUCTED usecount 2, writecount 0, refcount 4 seqc users 0 mountedhere 0xfffffe015b22cb80 hold count flags () flags (VIRF_MOUNTPOINT|VV(0x8000)) v_object 0xfffff80778b45c60 ref 0 pages 1 cleanbuf 1 dirtybuf 0 lock type ufs: SHARED (count 1) with exclusive waiters pending #0 0xffffffff80bbf5ff at lockmgr_lock_flags+0x1df #1 0xffffffff80f5c54d at ffs_lock+0x9d #2 0xffffffff811c29bc at VOP_LOCK1_APV+0x3c #3 0xffffffff82756a53 at unionfs_lock+0x263 #4 0xffffffff811c29bc at VOP_LOCK1_APV+0x3c #5 0xffffffff80cfffd4 at _vn_lock+0x54 #6 0xffffffff80cfc9e7 at kern_getdirentries+0x147 #7 0xffffffff80cfcc89 at sys_getdirentries+0x29 #8 0xffffffff810ee59a at amd64_syscall+0x15a #9 0xffffffff810c182b at fast_syscall_common+0xf8 nlink=2, effnlink=2, size=512, extsize 0 generation=b7f1e3e0, uid=0, gid=0, flags=0x0 ino 23274240, on dev gpt/work db:1:pho1> show mount 0xfffffe010e3f4700 /dev/gpt/work on / (ufs) 0xfffffe010e3f5280 devfs on /dev (devfs) 0xfffffe014362a280 /dev/gpt/tmp on /tmp (ufs) 0xfffffe015b22c000 /dev/md10 on /mnt (ufs) 0xfffffe015b22cb80 :/mnt on /mnt13 (unionfs) More info: show mount db:1:pho1> show bufqueues bqempty: 87819 Buf domain 0 freebufs 11627 lofreebufs 219 hifreebufs 329 bufspace 66150400 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 3375 (65540096) dirtyq count 0 (0) wakeup 0 lim 25 CPU 2, 18, 9, 22, 0, 15, 15, 16, 5, 12, 12, 5, Locked buffers: 0 space 0 Total buffers: 3600 space 66150400 Buf domain 1 freebufs 13294 lofreebufs 219 hifreebufs 329 bufspace 10727424 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 1736 (9932800) dirtyq count 0 (0) wakeup 0 lim 25 CPU 12, 1, 4, 13, 17, 8, 4, 0, 4, 17, 1, 21, Locked buffers: 1 space 4096 Total buffers: 1926 space 10727424 Buf domain 2 freebufs 13100 lofreebufs 219 hifreebufs 329 bufspace 16314368 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 1922 (15699968) dirtyq count 0 (0) wakeup 0 lim 25 CPU 18, 5, 12, 20, 22, 6, 1, 1, 6, 18, 0, 2, Locked buffers: 0 space 0 Total buffers: 2156 space 16314368 Buf domain 3 freebufs 13030 lofreebufs 219 hifreebufs 329 bufspace 20291584 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 1970 (19378176) dirtyq count 0 (0) wakeup 0 lim 25 CPU 10, 18, 5, 18, 19, 0, 10, 10, 9, 22, 8, 4, Locked buffers: 0 space 0 Total buffers: 2233 space 20291584 Buf domain 4 freebufs 12415 lofreebufs 219 hifreebufs 329 bufspace 39776256 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 2596 (38916096) dirtyq count 0 (0) wakeup 0 lim 25 CPU 19, 8, 0, 2, 23, 6, 0, 4, 13, 20, 7, 20, Locked buffers: 0 space 0 Total buffers: 2801 space 39776256 Buf domain 5 freebufs 13234 lofreebufs 219 hifreebufs 329 bufspace 12308480 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 1775 (11776000) dirtyq count 0 (0) wakeup 0 lim 25 CPU 18, 4, 20, 10, 7, 21, 11, 21, 7, 0, 3, 2, Locked buffers: 0 space 0 Total buffers: 1933 space 12308480 Buf domain 6 freebufs 11119 lofreebufs 219 hifreebufs 329 bufspace 81170432 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 14 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 3952 (79220736) dirtyq count 14 (458752) wakeup 0 lim 25 CPU 7, 2, 9, 4, 1, 3, 6, 7, 3, 1, 2, 3, Locked buffers: 0 space 0 Total buffers: 4140 space 81170432 db:1:pho1> show page vm_cnt.v_free_count: 71219 vm_cnt.v_inactive_count: 73695 vm_cnt.v_active_count: 6658683 vm_cnt.v_laundry_count: 985859 vm_cnt.v_wire_count: 332318 vm_cnt.v_free_reserved: 10641 vm_cnt.v_free_min: 51252 vm_cnt.v_free_target: 173085 vm_cnt.v_inactive_target: 259627 db:1:pho1> show pageq pq_free 71219 dom 0 page_cnt 8122272 free 71219 pq_act 6658683 pq_inact 73695 pq_laund 985859 pq_unsw 0 db:0:pho> show freepages DOMAIN: 0 FREE LIST 0: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000000 | 000000 09 (002048K) | 000000 | 000000 08 (001024K) | 000092 | 000000 07 (000512K) | 000043 | 000001 06 (000256K) | 000180 | 000003 05 (000128K) | 000561 | 000005 04 (000064K) | 000494 | 000007 03 (000032K) | 000012 | 000011 02 (000016K) | 000012 | 000028 01 (000008K) | 000001 | 000196 00 (000004K) | 000001 | 000168 FREE LIST 1: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000000 | 000000 09 (002048K) | 000000 | 000000 08 (001024K) | 000000 | 000000 07 (000512K) | 000000 | 000000 06 (000256K) | 000000 | 000000 05 (000128K) | 000000 | 000000 04 (000064K) | 000000 | 000000 03 (000032K) | 000000 | 000000 02 (000016K) | 000000 | 000000 01 (000008K) | 000000 | 000000 00 (000004K) | 000000 | 000000 db:0:pho> show uma Zone Size Used Free Requests Sleeps Bucket Total Mem XFree FFS inode 1160 184251 115 185834 0 8 213864560 0 malloc-4096 4096 34163 0 34322 0 2 139931648 0 VNODE 600 184389 2629 35985838 0 16 112210800 0 RADIX NODE 144 529570 8867 40890985 0 62 77534928 0 FFS2 dinode 256 184251 234 185834 0 62 47228160 0 mbuf_cluster 2048 10508 1776 27550 0 8 25157632 0 S VFS Cache 104 185546 5125 54922407 0 126 19829784 0 BUF TRIE 144 1152 104800 2453 0 62 15257088 0 swblk 136 55874 25877 291959 0 62 11118136 0 UMA Slabs 0 112 41469 1653 52795 0 126 4829664 0 mbuf 256 14658 3104 426333 0 254 4547072 0 VM OBJECT 264 14109 711 27045755 0 30 3912480 0 vmem btag 56 67987 689 68150 0 254 3845856 0 malloc-128 128 26369 601 30435 0 126 3452160 0 malloc-128 128 18496 290 1672054 0 126 2404608 0 pbuf 2776 0 806 0 0 0 2237456 0 malloc-4096 4096 437 5 1533119 0 2 1810432 0 malloc-128 128 13230 596 1327444 0 126 1769728 0 swpctrie 144 3997 4431 24061 0 62 1213632 0 malloc-64 64 11779 1766 1423303 0 254 866880 0 THREAD 1824 410 52 484 0 8 842688 0 L VFS Cache 320 2269 107 2269 0 30 760320 0 malloc-64 64 9162 2304 1793416 0 254 733824 0 malloc-8192 8192 87 0 87 0 1 712704 0 MAP ENTRY 96 2853 2649 93168010 0 126 528192 0 VMSPACE 2560 70 122 1401549 0 4 491520 0 UMA Zones 2048 228 7 228 0 8 481280 0 FPU_save_area 832 412 83 1724 0 16 411840 0 malloc-256 256 1081 494 108685 0 62 403200 0 malloc-32768 32768 12 0 12 0 1 393216 0 malloc-32768 32768 12 0 12 0 1 393216 0 lkpimm 168 3 2325 3 0 62 391104 0 lkpicurr 168 13 2315 13 0 62 391104 0 malloc-64 64 4315 1544 2517480 0 254 374976 0 malloc-512 512 553 79 628 0 30 323584 0 malloc-2048 2048 145 5 166 0 8 307200 0 malloc-32 32 8168 1282 8441 0 254 302400 0 PROC 1368 92 117 1401582 0 8 285912 0 malloc-16 16 15950 1800 425525 0 254 284000 0 malloc-1024 1024 243 33 319 0 16 282624 0 malloc-65536 65536 4 0 3994 0 1 262144 0 malloc-32768 32768 8 0 132 0 1 262144 0 malloc-128 128 949 725 52017 0 126 214272 0 filedesc0 1072 93 103 1401583 0 8 210112 0 Mountpoints 2944 6 62 51045 0 4 200192 0 malloc-65536 65536 3 0 5 0 1 196608 0 malloc-65536 65536 3 0 24 0 1 196608 0 malloc-16384 16384 12 0 4775 0 1 196608 0 malloc-256 256 534 216 54817 0 62 192000 0 malloc-16384 16384 10 1 9774 0 1 180224 0 malloc-8192 8192 22 0 22 0 1 180224 0 Files 80 131 2019 9650143 0 126 172000 0 malloc-8192 8192 20 0 3035 0 1 163840 0 malloc-1024 1024 139 17 4977 0 16 159744 0 PWD 32 18 4392 1021024 0 254 141120 0 malloc-65536 65536 2 0 2 0 1 131072 0 malloc-32768 32768 4 0 3576 0 1 131072 0 malloc-384 384 284 46 10779 0 30 126720 0 PGRP 88 32 1394 148 0 126 125488 0 TURNSTILE 136 463 419 463 0 62 119952 0 malloc-128 128 458 410 35569514 0 126 111104 0 DEVCTL 1024 0 104 102958 0 0 106496 0 malloc-8192 8192 13 0 235 0 1 106496 0 malloc-64 64 112 1526 1452723 0 254 104832 0 malloc-128 128 440 366 2972 0 126 103168 0 udp_inpcb 448 11 214 203 0 30 100800 0 malloc-32 32 412 2738 1109413 0 254 100800 0 256 Bucket 2048 24 22 426064 0 8 94208 0 malloc-256 256 170 190 976 0 62 92160 0 ttyinq 160 345 230 555 0 62 92000 0 8 Bucket 80 231 919 130572 0 126 92000 0 socket 960 36 56 6341 0 16 88320 0 ttyoutq 256 181 164 290 0 62 88320 0 malloc-384 384 156 74 162 0 30 88320 0 ksiginfo 112 198 558 21312 0 126 84672 0 malloc-8192 8192 10 0 42 0 1 81920 0 UMA Kegs 384 198 5 198 0 30 77952 0 malloc-32 32 569 1825 966 0 254 76608 0 malloc-4096 4096 18 0 23 0 2 73728 0 malloc-2048 2048 19 15 1762 0 8 69632 0 malloc-32 32 1109 1033 557047 0 254 68544 0 malloc-128 128 223 304 321 0 126 67456 0 malloc-65536 65536 1 0 6 0 1 65536 0 malloc-65536 65536 1 0 79 0 1 65536 0 malloc-32768 32768 2 0 6 0 1 65536 0 malloc-32768 32768 2 0 2 0 1 65536 0 malloc-16384 16384 4 0 4 0 1 65536 0 SLEEPQUEUE 88 463 273 463 0 126 64768 0 rl_entry 40 191 1425 191 0 254 64640 0 malloc-64 64 265 680 4751583 0 254 60480 0 malloc-32 32 138 1752 525 0 254 60480 0 malloc-16 16 617 3133 2803262 0 254 60000 0 malloc-128 128 41 424 541 0 126 59520 0 malloc-1024 1024 36 20 423367 0 16 57344 0 64 Bucket 512 72 40 292320 0 30 57344 0 malloc-64 64 59 823 69 0 254 56448 0 malloc-32 32 73 1691 282 0 254 56448 0 pipe 728 8 69 479649 0 16 56056 0 malloc-256 256 50 160 862 0 62 53760 0 32 Bucket 256 13 182 1276120 0 62 49920 0 cpuset 104 27 438 27 0 126 48360 0 malloc-16 16 194 2806 410239 0 254 48000 0 pcpu-64 64 466 238 466 0 254 45056 0 pcpu-8 8 3520 2112 3522 0 254 45056 0 pcpu-16 16 68 2492 68 0 254 40960 0 malloc-64 64 269 361 272 0 254 40320 0 128 Bucket 1024 33 6 518220 0 16 39936 0 malloc-256 256 43 107 83 0 62 38400 0 malloc-32 32 63 1071 125 0 254 36288 0 malloc-16 16 30 2220 330 0 254 36000 0 malloc-16 16 250 2000 250 0 254 36000 0 unpcb 256 16 119 6094 0 62 34560 0 malloc-32768 32768 1 0 2 0 1 32768 0 malloc-8192 8192 4 0 20 0 1 32768 0 malloc-1024 1024 20 12 20 0 16 32768 0 tcp_inpcb 1296 6 18 11 0 8 31104 0 malloc-4096 4096 7 0 25 0 2 28672 0 malloc-4096 4096 7 0 108 0 2 28672 0 fakepg 104 0 273 16 0 126 28392 0 malloc-64 64 10 431 69 0 254 28224 0 malloc-256 256 27 78 52363 0 62 26880 0 malloc-1024 1024 10 14 10 0 16 24576 0 malloc-32 32 9 747 128 0 254 24192 0 malloc-16 16 29 1471 29 0 254 24000 0 malloc-16 16 617 883 37208570 0 254 24000 0 malloc-384 384 11 49 11 0 30 23040 0 malloc-384 384 22 38 22 0 30 23040 0 malloc-256 256 27 63 415836 0 62 23040 0 malloc-2048 2048 6 4 582 0 8 20480 0 malloc-1024 1024 11 9 1635 0 16 20480 0 malloc-512 512 28 12 28 0 30 20480 0 rtentry 168 12 108 14 0 62 20160 0 malloc-16 16 34 1216 66 0 254 20000 0 routing nhops 256 9 66 14 0 62 19200 0 malloc-256 256 6 69 160 0 62 19200 0 malloc-16384 16384 1 0 13 0 1 16384 0 malloc-16384 16384 1 0 2 0 1 16384 0 malloc-16384 16384 1 0 1 0 1 16384 0 malloc-16384 16384 1 0 1 0 1 16384 0 malloc-2048 2048 6 2 6 0 8 16384 0 malloc-512 512 13 19 13 0 30 16384 0 g_bio 408 24 16 1314675 0 30 16320 0 udp_inpcb ports 32 3 501 11 0 254 16128 0 16 Bucket 144 26 86 235955 0 62 16128 0 malloc-384 384 4 36 69 0 30 15360 0 malloc-2048 2048 3 3 7 0 8 12288 0 ertt 72 6 162 11 0 126 12096 0 swwbuf 2776 4 0 161437 0 1 11104 0 NAMEI 1024 3 5 57330780 0 16 8192 0 malloc-8192 8192 1 0 1 0 1 8192 0 malloc-4096 4096 1 1 51241 0 2 8192 0 malloc-2048 2048 3 1 3 0 8 8192 0 malloc-2048 2048 2 2 74894 0 8 8192 0 malloc-1024 1024 2 6 356 0 16 8192 0 malloc-1024 1024 2 6 3170440 0 16 8192 0 tcp_inpcb ports 32 2 250 2 0 254 8064 0 kenv 258 18 12 27381 0 30 7740 0 malloc-384 384 2 18 2203 0 30 7680 0 malloc-384 384 4 16 37 0 30 7680 0 ripcb 416 1 17 3 0 30 7488 0 swrbuf 2776 2 0 93475 0 2 5552 0 epoch_record pcpu 256 4 12 4 0 62 4096 0 malloc-4096 4096 1 0 2 0 2 4096 0 malloc-4096 4096 1 0 13 0 2 4096 0 malloc-2048 2048 1 1 99 0 8 4096 0 malloc-512 512 1 7 2 0 30 4096 0 malloc-512 512 1 7 1362 0 30 4096 0 SMR CPU 32 7 120 7 0 254 4064 0 ertt_txseginfo 40 0 101 244 0 254 4040 0 vtnet_tx_hdr 24 0 167 0 0 254 4008 0 UMA Slabs 1 176 10 12 10 0 62 3872 0 ada_ccb 272 0 14 327048 0 30 3808 0 KMAP ENTRY 96 39 0 41 0 0 3744 0 vmem 1856 1 1 1 0 8 3712 0 mbuf_packet 256 13 0 409397 0 254 3328 0 SMR SHARED 24 7 120 7 0 254 3048 0 FFS1 dinode 128 0 0 0 0 126 0 0 da_ccb 544 0 0 0 0 16 0 0 tfo_ccache_entries 80 0 0 0 0 126 0 0 tfo 4 0 0 0 0 254 0 0 sackhole 32 0 0 0 0 254 0 0 hostcache 64 0 0 0 0 254 0 0 syncache 168 0 0 2 0 62 0 0 ipq 56 0 0 0 0 254 0 0 tcp_log_id_node 120 0 0 0 0 126 0 0 tcp_log_id_bucket 176 0 0 0 0 62 0 0 tcp_log 416 0 0 0 0 30 0 0 tcpreass 48 0 0 0 0 254 0 0 ripcb ports 32 0 0 0 0 254 0 0 udplite_inpcb ports 32 0 0 0 0 254 0 0 udplite_inpcb 448 0 0 0 0 30 0 0 IPsec SA lft_c 16 0 0 0 0 254 0 0 KNOTE 160 0 0 0 0 62 0 0 itimer 352 0 0 0 0 30 0 0 AIOLIO 272 0 0 0 0 30 0 0 AIOCB 552 0 0 0 0 16 0 0 AIO 208 0 0 0 0 62 0 0 DIRHASH 1024 0 0 1873 0 16 0 0 TMPFS node 232 0 0 0 0 62 0 0 NCLNODE 760 0 0 0 0 16 0 0 LTS VFS Cache 360 0 0 0 0 30 0 0 STS VFS Cache 144 0 0 0 0 62 0 0 cryptop 280 0 0 0 0 30 0 0 linux_dma_object 32 0 0 0 0 254 0 0 linux_dma_pctrie 144 0 0 0 0 62 0 0 IOMMU_MAP_ENTRY 104 0 0 0 0 126 0 0 mbuf_jumbo_16k 16384 0 0 0 0 1 0 0 mbuf_jumbo_9k 9216 0 0 0 0 1 0 0 mbuf_jumbo_page 4096 0 0 6 0 2 0 0 audit_record 1280 0 0 0 0 8 0 0 domainset 40 0 0 0 0 254 0 0 MAC labels 40 0 0 0 0 254 0 0 clpbuf 2776 0 0 44 0 2 0 0 vnpbuf 2776 0 0 0 0 4 0 0 mdpbuf 2776 0 0 0 0 1 0 0 nfspbuf 2776 0 0 0 0 2 0 0 umtx_shm 88 0 0 0 0 126 0 0 umtx pi 96 0 0 0 0 126 0 0 rangeset pctrie nodes 144 0 0 0 0 62 0 0 malloc-65536 65536 0 0 0 0 1 0 0 malloc-65536 65536 0 0 0 0 1 0 0 malloc-32768 32768 0 0 0 0 1 0 0 malloc-16384 16384 0 0 0 0 1 0 0 malloc-8192 8192 0 0 0 0 1 0 0 malloc-512 512 0 0 1150 0 30 0 0 malloc-512 512 0 0 0 0 30 0 0 malloc-512 512 0 0 4 0 30 0 0 malloc-384 384 0 0 0 0 30 0 0 pcpu-32 32 0 0 0 0 254 0 0 pcpu-4 4 0 0 0 0 254 0 0 4 Bucket 48 0 0 23507 0 254 0 0 2 Bucket 32 0 0 156320 0 254 0 0 UMA Hash 256 0 0 0 0 62 0 0 db:0:pho> show umacache Zone Size Used Free Requests Bucket debugnet_mbuf_packet 2048 0 0 0 0 debugnet_mbuf_cluster 2048 -6144 0 0 0 debugnet_mbuf 256 -10240 0 0 0 vm pgcache 4096 118165 0 61112108 2 vm pgcache 4096 2072243 0 142900992 3 buf free cache 848 18112 0 68808 16 buffer arena-65 65536 0 0 0 1 buffer arena-61 61440 0 0 0 1 buffer arena-57 57344 0 0 0 1 buffer arena-53 53248 0 0 0 1 buffer arena-49 49152 0 0 0 1 buffer arena-45 45056 0 0 0 1 buffer arena-40 40960 0 0 0 1 buffer arena-36 36864 0 0 0 1 buffer arena-32 32768 15371 0 65956 1 buffer arena-28 28672 0 0 0 1 buffer arena-24 24576 0 0 0 1 buffer arena-20 20480 0 0 0 1 buffer arena-16 16384 6 0 82 1 buffer arena-12 12288 0 0 0 1 buffer arena-81 8192 0 0 0 1 buffer arena-40 4096 0 0 0 2 kstack_cache 16384 410 0 484 1 db:0:pho> acttrace Tracing command pagedaemon pid 9 tid 100195 td 0xfffffe010e3fa000 (CPU 4) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce4ddf0 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce4de00 trap() at trap+0x57/frame 0xfffffe003ce4df20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce4df20 --- trap 0x13, rip = 0xffffffff80fa9d54, rsp = 0xfffffe010db46b00, rbp = 0xfffffe010db46eb0 --- vm_pageout_worker() at vm_pageout_worker+0xb34/frame 0xfffffe010db46eb0 vm_pageout() at vm_pageout+0x1c7/frame 0xfffffe010db46ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db46f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db46f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command swap pid 57970 tid 100447 td 0xfffffe010e7e2ac0 (CPU 0) cpustop_handler() at cpustop_handler+0x28/frame 0xffffffff81fe6c00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xffffffff81fe6c10 trap() at trap+0x57/frame 0xffffffff81fe6d30 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81fe6d30 --- trap 0x13, rip = 0x2f5ff66764ec, rsp = 0x2f68171838e0, rbp = 0x2f6817183910 --- Tracing command swap pid 57971 tid 100448 td 0xfffffe0143599900 (CPU 10) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003cea7df0 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003cea7e00 trap() at trap+0x57/frame 0xfffffe003cea7f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003cea7f20 --- trap 0x13, rip = 0x2f5ff66764e0, rsp = 0x2f68171838e0, rbp = 0x2f6817183910 --- Tracing command swap pid 57973 tid 100240 td 0xfffffe010d9ca900 (CPU 8) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce89df0 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce89e00 trap() at trap+0x57/frame 0xfffffe003ce89f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce89f20 --- trap 0x13, rip = 0x2f5ff66764ec, rsp = 0x2f68171838e0, rbp = 0x2f6817183910 --- Tracing command swap pid 57975 tid 100444 td 0xfffffe0145b6d020 (CPU 6) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce6bdf0 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce6be00 trap() at trap+0x57/frame 0xfffffe003ce6bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce6bf20 --- trap 0x13, rip = 0x2f5ff66764e0, rsp = 0x2f68171838e0, rbp = 0x2f6817183910 --- Tracing command swap pid 57978 tid 100435 td 0xfffffe0150996c80 (CPU 3) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce3edf0 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce3ee00 trap() at trap+0x57/frame 0xfffffe003ce3ef20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce3ef20 --- trap 0x13, rip = 0x2f5ff66764e5, rsp = 0x2f68171838e0, rbp = 0x2f6817183910 --- Tracing command swap pid 57980 tid 100445 td 0xfffffe0145b6bac0 (CPU 1) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce20df0 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce20e00 trap() at trap+0x57/frame 0xfffffe003ce20f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce20f20 --- trap 0x13, rip = 0x2f5ff66764ec, rsp = 0x2f68171838e0, rbp = 0x2f6817183910 --- Tracing command swap pid 57982 tid 100474 td 0xfffffe015b08b000 (CPU 11) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ceb6df0 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ceb6e00 trap() at trap+0x57/frame 0xfffffe003ceb6f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ceb6f20 --- trap 0x13, rip = 0x2f5ff66764ec, rsp = 0x2f68171838e0, rbp = 0x2f6817183910 --- Tracing command swap pid 57983 tid 100451 td 0xfffffe015b2b5900 (CPU 5) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce5cdf0 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce5ce00 trap() at trap+0x57/frame 0xfffffe003ce5cf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce5cf20 --- trap 0x13, rip = 0x2f5ff66764ec, rsp = 0x2f68171838e0, rbp = 0x2f6817183910 --- Tracing command swap pid 57984 tid 100365 td 0xfffffe0150997ac0 (CPU 9) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce98df0 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce98e00 trap() at trap+0x57/frame 0xfffffe003ce98f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce98f20 --- trap 0x13, rip = 0x2f5ff66764ec, rsp = 0x2f68171838e0, rbp = 0x2f6817183910 --- Tracing command swap pid 57985 tid 100446 td 0xfffffe0145b6ac80 (CPU 7) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce7adf0 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce7ae00 trap() at trap+0x57/frame 0xfffffe003ce7af20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce7af20 --- trap 0x13, rip = 0x2f5ff66764e0, rsp = 0x2f68171838e0, rbp = 0x2f6817183910 --- Tracing command find pid 2382 tid 100297 td 0xfffffe01437da740 (CPU 2) kdb_enter() at kdb_enter+0x32/frame 0xfffffe01438a8840 vpanic() at vpanic+0x183/frame 0xfffffe01438a8890 panic() at panic+0x43/frame 0xfffffe01438a88f0 trap_fatal() at trap_fatal+0x409/frame 0xfffffe01438a8950 trap_pfault() at trap_pfault+0xab/frame 0xfffffe01438a89b0 calltrap() at calltrap+0x8/frame 0xfffffe01438a89b0 --- trap 0xc, rip = 0xffffffff82753417, rsp = 0xfffffe01438a8a80, rbp = 0xfffffe01438a8aa0 --- unionfs_root() at unionfs_root+0x17/frame 0xfffffe01438a8aa0 vfs_lookup() at vfs_lookup+0x92a/frame 0xfffffe01438a8b40 namei() at namei+0x340/frame 0xfffffe01438a8bc0 kern_statat() at kern_statat+0x12f/frame 0xfffffe01438a8d00 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe01438a8e00 amd64_syscall() at amd64_syscall+0x15a/frame 0xfffffe01438a8f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01438a8f30 --- syscall (552, FreeBSD ELF64, fstatat), rip = 0x1e9fa3f465fa, rsp = 0x1e9fa1989c98, rbp = 0x1e9fa1989db0 --- db:0:pho> ps pid ppid pgrp uid state wmesg wchan cmd 2435 57995 3125 0 R+ sh 2434 58003 3125 0 R+ sh 2432 57993 3125 0 D+ ufs 0xfffffe015b222330 umount 2430 1749 3210 0 R egrep 2428 57986 3125 0 D+ ufs 0xfffffe015b26d070 mount_unionfs 2416 57988 3125 0 R+ find 2382 57974 3125 0 R+ CPU 2 find 2317 57935 3125 0 S+ nanslp 0xffffffff81ea3da2 sleep 2127 49341 2127 2006 S+ nanslp 0xffffffff81ea3da5 sleep 1749 3259 3210 0 S wait 0xfffffe010e3f8568 sh 58003 57935 3125 0 S+ wait 0xfffffe01443c8ab8 sh 57995 57935 3125 0 S+ wait 0xfffffe01436b7558 sh 57993 57935 3125 0 S+ wait 0xfffffe010e3f9018 sh 57988 57935 3125 0 S+ wait 0xfffffe010e3f7ab8 sh 57986 57935 3125 0 S+ wait 0xfffffe010d9f7008 sh 57985 57969 3125 0 R+ CPU 7 swap 57984 57969 3125 0 R+ CPU 9 swap 57983 57969 3125 0 R+ CPU 5 swap 57982 57969 3125 0 R+ CPU 11 swap 57981 57969 3125 0 D+ swread 0xfffff807787a81d0 swap 57980 57969 3125 0 R+ CPU 1 swap 57978 57969 3125 0 R+ CPU 3 swap 57977 57969 3125 0 D+ swread 0xfffff8077879c6f8 swap 57975 57969 3125 0 R+ CPU 6 swap 57974 57935 3125 0 S+ wait 0xfffffe01436b7ab0 sh 57973 57969 3125 0 R+ CPU 8 swap 57972 57969 3125 0 R+ swap 57971 57969 3125 0 R+ CPU 10 swap 57970 57969 3125 0 R+ CPU 0 swap 57969 57966 3125 0 SW+ wait 0xfffffe01443d9ac0 swap 57966 57935 3125 0 S+ nanslp 0xffffffff81ea3da9 swap 57956 0 0 0 DL mdwait 0xfffff807ec263000 [md24] 57951 0 0 0 DL mdwait 0xfffff806bf56b000 [md23] 57946 0 0 0 DL mdwait 0xfffff804b3507000 [md22] 57941 0 0 0 DL mdwait 0xfffff80477908000 [md10] 57935 57933 3125 0 S+ wait 0xfffffe015b083018 sh 57934 3125 3125 0 S+ piperd 0xfffffe015b35d6c0 tee 57933 3125 3125 0 SW+ wait 0xfffffe0145b67568 sh 49341 49334 49341 2006 Ss+ wait 0xfffffe0143788558 bash 49334 49172 49172 2006 S select 0xfffff804c4988d40 sshd 49172 3015 49172 0 Ss select 0xfffff800596b3bc0 sshd 3262 3210 3210 0 S piperd 0xfffffe01436e5998 sh 3260 3210 3210 0 S piperd 0xfffffe01418d6e38 awk 3259 3210 3210 0 SW wait 0xfffffe01418b3560 sh 3210 1 3210 0 SWs wait 0xfffffe00e4c66ac0 sh 3125 3057 3125 0 SW+ wait 0xfffffe0141802568 sh 3057 3055 3057 0 SW+ wait 0xfffffe010e7d4ac0 bash 3055 3054 3055 0 SW+ pause 0xfffffe0141802b70 csh 3054 3048 3054 2006 SW+ wait 0xfffffe00e4c67018 su 3048 3047 3048 2006 SWs+ wait 0xfffffe01418b2ab0 bash 3047 3044 3044 2006 S select 0xfffff8005901aa40 sshd 3044 3015 3044 0 Ss select 0xfffff800049040c0 sshd 3043 1 3043 0 Ss+ ttyin 0xfffff800062508b0 getty 3042 1 3042 0 Ss+ ttyin 0xfffff80006250cb0 getty 3041 1 3041 0 Ss+ ttyin 0xfffff8000955f0b0 getty 3040 1 3040 0 Ss+ ttyin 0xfffff8000955f4b0 getty 3039 1 3039 0 Ss+ ttyin 0xfffff8000955f8b0 getty 3038 1 3038 0 Ss+ ttyin 0xfffff8000955fcb0 getty 3037 1 3037 0 Ss+ ttyin 0xfffff8000955e0b0 getty 3036 1 3036 0 Ss+ ttyin 0xfffff8000955e4b0 getty 3035 1 3035 0 Ss+ ttyin 0xfffff8000955e8b0 getty 3034 1 3034 0 Ss+ ttyin 0xfffff8000955ecb0 getty 3024 1 3024 0 Ss select 0xfffff8000923e640 inetd 3015 1 3015 0 Ss select 0xfffff800094f5440 sshd 2997 1 2997 0 SWs nanslp 0xffffffff81ea3da2 cron 2982 1 2982 0 Ss select 0xfffff80006186440 powerd 2979 1 2979 123 Ss select 0xfffff800094f4d40 ntpd 2909 1 2909 0 Ss nanslp 0xffffffff81ea3daa watchdogd 2889 1 2889 0 Ss select 0xfffff800094f54c0 syslogd 2708 1 2708 0 Ss select 0xfffff80006186540 devd 2683 1 2683 65 Ss select 0xfffff8005901aac0 dhclient 2624 1 2624 0 Ss select 0xfffff80009620440 dhclient 2621 1 2621 0 Ss select 0xfffff8000604aac0 dhclient 19 0 0 0 DL syncer 0xffffffff81f94a28 [syncer] 18 0 0 0 DL vlruwt 0xfffffe010e3f6000 [vnlru] 17 0 0 0 DL (threaded) [bufdaemon] 100197 D psleep 0xffffffff81f93a50 [bufdaemon] 100198 D - 0xffffffff81a0b140 [bufspacedaemon-0] 100199 D - 0xffffffff81a13400 [bufspacedaemon-1] 100200 D - 0xffffffff81a1b6c0 [bufspacedaemon-2] 100201 D - 0xffffffff81a23980 [bufspacedaemon-3] 100202 D - 0xffffffff81a2bc40 [bufspacedaemon-4] 100203 D - 0xffffffff81a33f00 [bufspacedaemon-5] 100204 D - 0xffffffff81a3c1c0 [bufspacedaemon-6] 100225 D sdflush 0xfffff800042dece8 [/ worker] 100229 D sdflush 0xfffff8000446bce8 [/tmp worker] 100481 D sdflush 0xfffff8082b0968e8 [/mnt worker] 16 0 0 0 DL psleep 0xffffffff81fbcc50 [vmdaemon] 9 0 0 0 RL (threaded) [pagedaemon] 100195 Run CPU 4 [dom0] 100205 D swbufa 0xffffffff81fb0370 [laundry: dom0] 100206 D umarcl 0xffffffff80f7e080 [uma] 8 0 0 0 DL idle 0xfffffe010d9f7ab8 [enc_daemon1] 7 0 0 0 DL idle 0xfffffe010d9f8010 [enc_daemon0] 6 0 0 0 DL - 0xffffffff81ce58c8 [rand_harvestq] 15 0 0 0 DL (threaded) [usb] 100127 D - 0xfffffe010a1ba440 [usbus0] 100128 D - 0xfffffe010a1ba498 [usbus0] 100129 D - 0xfffffe010a1ba4f0 [usbus0] 100130 D - 0xfffffe010a1ba548 [usbus0] 100131 D - 0xfffffe010a1ba5a0 [usbus0] 100133 D - 0xfffffe00e4d82cf0 [usbus1] 100134 D - 0xfffffe00e4d82d48 [usbus1] 100135 D - 0xfffffe00e4d82da0 [usbus1] 100136 D - 0xfffffe00e4d82df8 [usbus1] 100137 D - 0xfffffe00e4d82e50 [usbus1] 100138 D - 0xfffffe010a578cf0 [usbus2] 100139 D - 0xfffffe010a578d48 [usbus2] 100140 D - 0xfffffe010a578da0 [usbus2] 100141 D - 0xfffffe010a578df8 [usbus2] 100142 D - 0xfffffe010a578e50 [usbus2] 5 0 0 0 DL - 0xffffffff81fc68a8 [busdma] 4 0 0 0 DL (threaded) [cam] 100120 D - 0xffffffff81bcf2c0 [doneq0] 100121 D - 0xffffffff81bcf340 [doneq1] 100122 D - 0xffffffff81bcf3c0 [doneq2] 100123 D - 0xffffffff81bcf240 [async] 100152 D - 0xffffffff81bcf110 [scanner] 14 0 0 0 DL seqstat 0xfffff80003ef5888 [sequencer 00] 3 0 0 0 DL (threaded) [crypto] 100106 D crypto_ 0xffffffff81fae5b0 [crypto] 100107 D crypto_ 0xfffff80003d62c30 [crypto returns 0] 100108 D crypto_ 0xfffff80003d62c80 [crypto returns 1] 100109 D crypto_ 0xfffff80003d62cd0 [crypto returns 2] 100110 D crypto_ 0xfffff80003d62d20 [crypto returns 3] 100111 D crypto_ 0xfffff80003d62d70 [crypto returns 4] 100112 D crypto_ 0xfffff80003d62dc0 [crypto returns 5] 100113 D crypto_ 0xfffff80003d62e10 [crypto returns 6] 100114 D crypto_ 0xfffff80003d62e60 [crypto returns 7] 100115 D crypto_ 0xfffff80003d62eb0 [crypto returns 8] 100116 D crypto_ 0xfffff80003d62f00 [crypto returns 9] 100117 D crypto_ 0xfffff80003d62f50 [crypto returns 10] 100118 D crypto_ 0xfffff80003d62fa0 [crypto returns 11] 13 0 0 0 DL (threaded) [geom] 100091 D - 0xffffffff81e83390 [g_event] 100092 D - 0xffffffff81e83398 [g_up] 100093 D - 0xffffffff81e833a0 [g_down] 2 0 0 0 WL (threaded) [clock] 100077 I [clock (0)] 100078 I [clock (1)] 100079 I [clock (2)] 100080 I [clock (3)] 100081 I [clock (4)] 100082 I [clock (5)] 100083 I [clock (6)] 100084 I [clock (7)] 100085 I [clock (8)] 100086 I [clock (9)] 100087 I [clock (10)] 100088 I [clock (11)] 12 0 0 0 WL (threaded) [intr] 100040 I [swi6: Giant taskq] 100042 I [swi5: fast taskq] 100046 I [swi6: task queue] 100089 I [swi1: netisr 0] 100124 I [irq56: ahci0] 100126 I [irq19: xhci0] 100132 I [irq18: ehci0 ehci1+] 100143 I [irq71: ahci1] 100144 I [swi4: apei] 100145 I [swi0: uart uart] 100159 I [irq73: mlx5_core0] 100160 I [irq74: mlx5_core0] 100161 I [irq72: mlx5_core0] 100162 I [irq75: mlx5_core0] 100163 I [irq76: mlx5_core0] 100164 I [irq77: mlx5_core0] 100165 I [irq78: mlx5_core0] 100166 I [irq79: mlx5_core0] 100167 I [irq80: mlx5_core0] 100168 I [irq81: mlx5_core0] 100169 I [irq82: mlx5_core0] 100170 I [irq83: mlx5_core0] 100171 I [irq84: mlx5_core0] 100172 I [irq85: mlx5_core0] 100173 I [irq86: mlx5_core0] 100179 I [irq88: mlx5_core1] 100180 I [irq89: mlx5_core1] 100181 I [irq87: mlx5_core1] 100182 I [irq90: mlx5_core1] 100183 I [irq91: mlx5_core1] 100184 I [irq92: mlx5_core1] 100185 I [irq93: mlx5_core1] 100186 I [irq94: mlx5_core1] 100187 I [irq95: mlx5_core1] 100188 I [irq96: mlx5_core1] 100189 I [irq97: mlx5_core1] 100190 I [irq98: mlx5_core1] 100191 I [irq99: mlx5_core1] 100192 I [irq100: mlx5_core1] 100193 I [irq101: mlx5_core1] 100257 I [irq102: ioat0] 100258 I [irq103: ioat1] 100259 I [irq104: ioat2] 100260 I [irq105: ioat3] 100261 I [irq106: ioat4] 100262 I [irq107: ioat5] 100263 I [irq108: ioat6] 100264 I [irq109: ioat7] 11 0 0 0 RL (threaded) [idle] 100003 CanRun [idle: cpu0] 100004 CanRun [idle: cpu1] 100005 CanRun [idle: cpu2] 100006 CanRun [idle: cpu3] 100007 CanRun [idle: cpu4] 100008 CanRun [idle: cpu5] 100009 CanRun [idle: cpu6] 100010 CanRun [idle: cpu7] 100011 CanRun [idle: cpu8] 100012 CanRun [idle: cpu9] 100013 CanRun [idle: cpu10] 100014 CanRun [idle: cpu11] 1 0 1 0 SLs wait 0xfffffe00e4c66010 [init] 10 0 0 0 DL audit_w 0xffffffff81faeaa8 [audit] 0 0 0 0 DLs (threaded) [kernel] 100000 D swapin 0xffffffff81e83910 [swapper] 100015 D - 0xfffff80003a37e00 [if_io_tqg_0] 100016 D - 0xfffff80003a37c00 [if_io_tqg_1] 100017 D - 0xfffff80003a37a00 [if_io_tqg_2] 100018 D - 0xfffff80003a37800 [if_io_tqg_3] 100019 D - 0xfffff80003a37600 [if_io_tqg_4] 100020 D - 0xfffff80003a37400 [if_io_tqg_5] 100021 D - 0xfffff80003a37200 [if_io_tqg_6] 100022 D - 0xfffff80003a37000 [if_io_tqg_7] 100023 D - 0xfffff80003a36d00 [if_io_tqg_8] 100024 D - 0xfffff80003a36b00 [if_io_tqg_9] 100025 D - 0xfffff80003a36900 [if_io_tqg_10] 100026 D - 0xfffff80003a36700 [if_io_tqg_11] 100027 D - 0xfffff80003a36500 [if_config_tqg_0] 100028 D - 0xfffff80003a36300 [softirq_0] 100029 D - 0xfffff80003a36100 [softirq_1] 100030 D - 0xfffff80003a35e00 [softirq_2] 100031 D - 0xfffff80003a35c00 [softirq_3] 100032 D - 0xfffff80003a35a00 [softirq_4] 100033 D - 0xfffff80003a35800 [softirq_5] 100034 D - 0xfffff80003a35600 [softirq_6] 100035 D - 0xfffff80003a35400 [softirq_7] 100036 D - 0xfffff80003a35200 [softirq_8] 100037 D - 0xfffff80003a35000 [softirq_9] 100038 D - 0xfffff80003bf5200 [softirq_10] 100039 D - 0xfffff80003bf5000 [softirq_11] 100041 D - 0xfffff80003a18e00 [thread taskq] 100043 D - 0xfffff80003a18c00 [pci_hp taskq] 100044 D - 0xfffff80003a18b00 [in6m_free taskq] 100045 D - 0xfffff80003a18a00 [kqueue_ctx taskq] 100047 D - 0xfffff80003a18800 [inm_free taskq] 100048 D - 0xfffff80003a18700 [aiod_kick taskq] 100049 D - 0xfffff80003a18600 [linuxkpi_irq_wq] 100050 D - 0xfffff80003a18500 [deferred_unmount ta] 100051 D - 0xfffff80003a18400 [linuxkpi_short_wq_0] 100052 D - 0xfffff80003a18400 [linuxkpi_short_wq_1] 100053 D - 0xfffff80003a18400 [linuxkpi_short_wq_2] 100054 D - 0xfffff80003a18400 [linuxkpi_short_wq_3] 100055 D - 0xfffff80003a18400 [linuxkpi_short_wq_4] 100056 D - 0xfffff80003a18400 [linuxkpi_short_wq_5] 100057 D - 0xfffff80003a18400 [linuxkpi_short_wq_6] 100058 D - 0xfffff80003a18400 [linuxkpi_short_wq_7] 100059 D - 0xfffff80003a18400 [linuxkpi_short_wq_8] 100060 D - 0xfffff80003a18400 [linuxkpi_short_wq_9] 100061 D - 0xfffff80003a18400 [linuxkpi_short_wq_1] 100062 D - 0xfffff80003a18400 [linuxkpi_short_wq_1] 100063 D - 0xfffff80003a18400 [linuxkpi_short_wq_1] 100064 D - 0xfffff80003a18300 [linuxkpi_long_wq_0] 100065 D - 0xfffff80003a18300 [linuxkpi_long_wq_1] 100066 D - 0xfffff80003a18300 [linuxkpi_long_wq_2] 100067 D - 0xfffff80003a18300 [linuxkpi_long_wq_3] 100068 D - 0xfffff80003a18300 [linuxkpi_long_wq_4] 100069 D - 0xfffff80003a18300 [linuxkpi_long_wq_5] 100070 D - 0xfffff80003a18300 [linuxkpi_long_wq_6] 100071 D - 0xfffff80003a18300 [linuxkpi_long_wq_7] 100072 D - 0xfffff80003a18300 [linuxkpi_long_wq_8] 100073 D - 0xfffff80003a18300 [linuxkpi_long_wq_9] 100074 D - 0xfffff80003a18300 [linuxkpi_long_wq_10] 100075 D - 0xfffff80003a18300 [linuxkpi_long_wq_11] 100076 D - 0xfffff80003a18300 [linuxkpi_long_wq_12] 100090 D - 0xfffff80003a18200 [firmware taskq] 100094 D - 0xfffff80003a18000 [crypto_0] 100095 D - 0xfffff80003a18000 [crypto_1] 100096 D - 0xfffff80003a18000 [crypto_2] 100097 D - 0xfffff80003a18000 [crypto_3] 100098 D - 0xfffff80003a18000 [crypto_4] 100099 D - 0xfffff80003a18000 [crypto_5] 100100 D - 0xfffff80003a18000 [crypto_6] 100101 D - 0xfffff80003a18000 [crypto_7] 100102 D - 0xfffff80003a18000 [crypto_8] 100103 D - 0xfffff80003a18000 [crypto_9] 100104 D - 0xfffff80003a18000 [crypto_10] 100105 D - 0xfffff80003a18000 [crypto_11] 100146 D - 0xfffff800092b1800 [acpi_task_0] 100147 D - 0xfffff800092b1800 [acpi_task_1] 100148 D - 0xfffff800092b1800 [acpi_task_2] 100150 D - 0xfffff80003a19100 [mca taskq] 100151 D - 0xfffff80003a17e00 [CAM taskq] 100155 D - 0xfffff80009795500 [mlx5_core0-rec] 100156 D - 0xfffff80009795400 [mlx5_core0-wdg] 100157 D - 0xfffff80009795300 [mlx5_core0-cmd] 100158 D - 0xfffff80009795200 [mlx5_page_allocator] 100174 D - 0xfffff800093e3700 [mlx5_esw_wq] 100175 D - 0xfffff800093e3600 [mlx5_core1-rec] 100176 D - 0xfffff800093e3500 [mlx5_core1-wdg] 100177 D - 0xfffff800093e3400 [mlx5_core1-cmd] 100178 D - 0xfffff800093e3300 [mlx5_page_allocator] 100194 D - 0xfffff800093e3200 [mlx5_esw_wq] 100374 D - 0xfffff800093e3100 [unionfs_rele taskq] db:0:pho> allt Tracing command kernel pid 0 tid 100000 td 0xffffffff81e83e80 sched_switch() at sched_switch+0x5a8/frame 0xffffffff82574e10 mi_switch() at mi_switch+0x175/frame 0xffffffff82574e30 sleepq_switch() at sleepq_switch+0x107/frame 0xffffffff82574e70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xffffffff82574eb0 _sleep() at _sleep+0x2d6/frame 0xffffffff82574f40 swapper() at swapper+0x75/frame 0xffffffff82574fa0 mi_startup() at mi_startup+0x30e/frame 0xffffffff82574ff0 btext() at btext+0x23 Tracing command kernel pid 0 tid 100015 td 0xfffffe00e4c6c020 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4858de0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4858e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4858e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4858ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4858ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4858f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4858f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100016 td 0xfffffe00e4c6b900 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4853de0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4853e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4853e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4853ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4853ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4853f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4853f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100017 td 0xfffffe00e4cf2720 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4862de0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4862e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4862e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4862ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4862ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4862f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4862f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100018 td 0xfffffe00e4cf2000 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e485dde0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e485de00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e485de40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e485dec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e485def0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e485df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e485df30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100019 td 0xfffffe00e4c75740 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e486cde0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e486ce00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e486ce40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e486cec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e486cef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e486cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e486cf30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100020 td 0xfffffe00e4c75020 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4867de0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4867e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4867e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4867ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4867ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4867f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4867f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100021 td 0xfffffe00e4c74900 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4876de0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4876e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4876e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4876ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4876ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4876f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4876f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100022 td 0xfffffe00e4c741e0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4871de0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4871e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4871e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4871ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4871ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4871f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4871f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100023 td 0xfffffe00e4c73ac0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4880de0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4880e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4880e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4880ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4880ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4880f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4880f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100024 td 0xfffffe00e4c733a0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e487bde0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e487be00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e487be40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e487bec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e487bef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e487bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e487bf30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100025 td 0xfffffe00e4cf6020 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e488ade0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e488ae00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e488ae40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e488aec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e488aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e488af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e488af30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100026 td 0xfffffe00e4cf5900 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4885de0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4885e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4885e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4885ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4885ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4885f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4885f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100027 td 0xfffffe00e4cf51e0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4894de0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4894e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4894e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4894ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4894ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4894f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4894f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100028 td 0xfffffe00e4cf4ac0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e488fde0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e488fe00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e488fe40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e488fec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e488fef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e488ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e488ff30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100029 td 0xfffffe00e4cf43a0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e489ede0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e489ee00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e489ee40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e489eec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e489eef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e489ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e489ef30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100030 td 0xfffffe00e4cf3c80 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4899de0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4899e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4899e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4899ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4899ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4899f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4899f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100031 td 0xfffffe00e4cf3560 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e48a8de0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e48a8e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48a8e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e48a8ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48a8ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48a8f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48a8f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100032 td 0xfffffe00e4cf2e40 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e48a3de0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e48a3e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48a3e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e48a3ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48a3ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48a3f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48a3f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100033 td 0xfffffe00e4d01ac0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e48b2de0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e48b2e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48b2e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e48b2ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48b2ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48b2f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48b2f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100034 td 0xfffffe00e4d013a0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e48adde0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e48ade00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48ade40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e48adec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48adef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48adf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48adf30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100035 td 0xfffffe00e4d00c80 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e48bcde0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e48bce00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48bce40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e48bcec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48bcef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48bcf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48bcf30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100036 td 0xfffffe00e4d00560 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e48b7de0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e48b7e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48b7e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e48b7ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48b7ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48b7f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48b7f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100037 td 0xfffffe00e4cffe40 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e48c6de0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e48c6e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48c6e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e48c6ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48c6ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48c6f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48c6f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100038 td 0xfffffe00e4cff720 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e48c1de0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e48c1e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48c1e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e48c1ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48c1ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48c1f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48c1f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100039 td 0xfffffe00e4cff000 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e48d0de0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e48d0e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48d0e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e48d0ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48d0ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48d0f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48d0f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100041 td 0xfffffe00e4d05560 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e48dadd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e48dadf0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48dae30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e48daec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48daef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48daf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48daf30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100043 td 0xfffffe00e4d04720 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e48e4dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e48e4df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48e4e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e48e4ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48e4ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48e4f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48e4f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100044 td 0xfffffe00e4d04000 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e48dfdd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e48dfdf0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48dfe30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e48dfec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48dfef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48dff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48dff30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100045 td 0xfffffe00e4d03740 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e48eedd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e48eedf0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48eee30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e48eeec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48eeef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48eef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48eef30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100047 td 0xfffffe00e4d02900 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e48f8dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e48f8df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48f8e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e48f8ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48f8ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48f8f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48f8f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100048 td 0xfffffe00e4d021e0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e48f3dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e48f3df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48f3e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e48f3ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48f3ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48f3f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48f3f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100049 td 0xfffffe00e4d0d000 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4902de0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4902e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4902e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4902ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe00e4902ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4902f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4902f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100050 td 0xfffffe00e4d08740 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e48fddd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e48fddf0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48fde30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e48fdec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48fdef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48fdf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48fdf30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100051 td 0xfffffe00e4d08020 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e490cdd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e490cdf0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e490ce30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e490cec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e490cef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e490cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e490cf30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100052 td 0xfffffe00e4d07900 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4907dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4907df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4907e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4907ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4907ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4907f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4907f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100053 td 0xfffffe00e4d071e0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4916dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4916df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4916e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4916ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4916ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4916f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4916f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100054 td 0xfffffe00e4d06ac0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4911dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4911df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4911e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4911ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4911ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4911f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4911f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100055 td 0xfffffe00e4d063a0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4920dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4920df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4920e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4920ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4920ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4920f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4920f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100056 td 0xfffffe00e4d05c80 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e491bdd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e491bdf0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e491be30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e491bec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e491bef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e491bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e491bf30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100057 td 0xfffffe00e4d10900 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e492add0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e492adf0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e492ae30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e492aec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e492aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e492af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e492af30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100058 td 0xfffffe00e4d101e0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4925dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4925df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4925e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4925ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4925ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4925f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4925f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100059 td 0xfffffe00e4d0fac0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4934dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4934df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4934e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4934ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4934ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4934f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4934f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100060 td 0xfffffe00e4d0f3a0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e492fdd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e492fdf0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e492fe30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e492fec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e492fef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e492ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e492ff30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100061 td 0xfffffe00e4d0ec80 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e493edd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e493edf0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e493ee30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e493eec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e493eef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e493ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e493ef30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100062 td 0xfffffe00e4d0e560 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4939dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4939df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4939e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4939ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4939ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4939f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4939f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100063 td 0xfffffe00e4d0de40 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4948dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4948df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4948e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4948ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4948ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4948f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4948f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100064 td 0xfffffe00e4d0d720 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4943dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4943df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4943e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4943ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4943ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4943f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4943f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100065 td 0xfffffe00e4d163a0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4952dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4952df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4952e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4952ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4952ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4952f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4952f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100066 td 0xfffffe00e4d15c80 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e494ddd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e494ddf0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e494de30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e494dec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e494def0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e494df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e494df30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100067 td 0xfffffe00e4d15560 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e495cdd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e495cdf0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e495ce30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e495cec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e495cef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e495cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e495cf30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100068 td 0xfffffe00e4d14e40 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4957dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4957df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4957e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4957ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4957ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4957f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4957f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100069 td 0xfffffe00e4d14720 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4966dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4966df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4966e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4966ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4966ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4966f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4966f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100070 td 0xfffffe00e4d14000 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4961dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4961df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4961e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4961ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4961ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4961f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4961f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100071 td 0xfffffe00e4d11740 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4970dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4970df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4970e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4970ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4970ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4970f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4970f30 --- trap 0xc7206389, rip = 0x44c63f5a2444c6e5, rsp = 0x4da95f2444c60d5e, rbp = 0x1e3d402444c70000 --- Tracing command kernel pid 0 tid 100072 td 0xfffffe00e4d11020 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e496bdd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e496bdf0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e496be30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e496bec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e496bef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e496bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e496bf30 --- trap 0x6c0053, rip = 0, rsp = 0xd5058948f98b48da, rbp = 0x5c29 --- Tracing command kernel pid 0 tid 100073 td 0xfffffe00e4d19e40 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e497add0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e497adf0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e497ae30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e497aec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e497aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e497af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e497af30 --- trap 0x9010010, rip = 0x3f0070900000000, rsp = 0x1af0001009103dd, rbp = 0x407090002001010 --- Tracing command kernel pid 0 tid 100074 td 0xfffffe00e4d19720 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4975dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4975df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4975e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4975ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4975ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4975f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4975f30 --- trap 0x14f8, rip = 0xc48348c38b48001f, rsp = 0x302464834820ec, rbp = 0x7b850f3b3c0874c0 --- Tracing command kernel pid 0 tid 100075 td 0xfffffe00e4d19000 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4984dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4984df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4984e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4984ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4984ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4984f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4984f30 --- trap 0x41002f00, rip = 0x4e1400000034004e, rsp = 0x41002f004e140000, rbp = 0x65007000530020 --- Tracing command kernel pid 0 tid 100076 td 0xfffffe00e4d18740 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e497fdd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e497fdf0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e497fe30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e497fec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e497fef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e497ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e497ff30 --- trap 0x8090003, rip = 0x101005e08090007, rsp = 0x10100620809000a, rbp = 0x9405000500040003 --- Tracing command kernel pid 0 tid 100090 td 0xfffffe00e4d25ac0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e49f5dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e49f5df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e49f5e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e49f5ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e49f5ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49f5f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49f5f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100094 td 0xfffffe00e4d23e40 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4e39dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4e39df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e39e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4e39ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e39ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e39f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e39f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100095 td 0xfffffe00e4d23720 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4e48dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4e48df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e48e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4e48ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e48ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e48f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e48f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100096 td 0xfffffe00e4d23000 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4e43dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4e43df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e43e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4e43ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e43ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e43f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e43f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100097 td 0xfffffe00e4d3ec80 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4e52dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4e52df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e52e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4e52ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e52ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e52f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e52f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100098 td 0xfffffe00e4d3e560 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4e4ddd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4e4ddf0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e4de30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4e4dec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e4def0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e4df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e4df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100099 td 0xfffffe00e4d3de40 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4e5cdd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4e5cdf0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e5ce30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4e5cec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e5cef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e5cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e5cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100100 td 0xfffffe00e4d3d720 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4e57dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4e57df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e57e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4e57ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e57ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e57f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e57f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100101 td 0xfffffe00e4d3d000 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4e66dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4e66df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e66e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4e66ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e66ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e66f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e66f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100102 td 0xfffffe00e4d27740 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4e61dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4e61df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e61e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4e61ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e61ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e61f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e61f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100103 td 0xfffffe00e4d27020 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4e70dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4e70df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e70e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4e70ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e70ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e70f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e70f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100104 td 0xfffffe00e4d26900 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4e6bdd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4e6bdf0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e6be30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4e6bec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e6bef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e6bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e6bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100105 td 0xfffffe00e4d42720 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4e7add0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4e7adf0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e7ae30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4e7aec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e7aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e7af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e7af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100146 td 0xfffffe010d9c03a0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010da34de0 mi_switch() at mi_switch+0x175/frame 0xfffffe010da34e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da34e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe010da34ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe010da34ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da34f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da34f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100147 td 0xfffffe010d9c7e40 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4ffcde0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4ffce00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ffce40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4ffcec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe00e4ffcef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ffcf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ffcf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100148 td 0xfffffe010d9c7720 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010da3ede0 mi_switch() at mi_switch+0x175/frame 0xfffffe010da3ee00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da3ee40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe010da3eec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe010da3eef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da3ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da3ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100150 td 0xfffffe010d9c2740 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010da48de0 mi_switch() at mi_switch+0x175/frame 0xfffffe010da48e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da48e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe010da48ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe010da48ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da48f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da48f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100151 td 0xfffffe010d9c2020 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010da43dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe010da43df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da43e30 _sleep() at _sleep+0x2ef/frame 0xfffffe010da43ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010da43ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da43f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da43f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100155 td 0xfffffe010d9c11e0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010da4ddd0 mi_switch() at mi_switch+0x175/frame 0xfffffe010da4ddf0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da4de30 _sleep() at _sleep+0x2ef/frame 0xfffffe010da4dec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010da4def0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da4df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da4df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100156 td 0xfffffe010d9c0ac0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010da66dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe010da66df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da66e30 _sleep() at _sleep+0x2ef/frame 0xfffffe010da66ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010da66ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da66f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da66f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100157 td 0xfffffe010df111e0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010da61dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe010da61df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da61e30 _sleep() at _sleep+0x2ef/frame 0xfffffe010da61ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010da61ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da61f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da61f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100158 td 0xfffffe010df10ac0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010da70dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe010da70df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da70e30 _sleep() at _sleep+0x2ef/frame 0xfffffe010da70ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010da70ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da70f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da70f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100174 td 0xfffffe010df7dac0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010dac0dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe010dac0df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010dac0e30 _sleep() at _sleep+0x2ef/frame 0xfffffe010dac0ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010dac0ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010dac0f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010dac0f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100175 td 0xfffffe010df7d3a0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010dabbdd0 mi_switch() at mi_switch+0x175/frame 0xfffffe010dabbdf0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010dabbe30 _sleep() at _sleep+0x2ef/frame 0xfffffe010dabbec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010dabbef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010dabbf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010dabbf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100176 td 0xfffffe010e06c020 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010dacadd0 mi_switch() at mi_switch+0x175/frame 0xfffffe010dacadf0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010dacae30 _sleep() at _sleep+0x2ef/frame 0xfffffe010dacaec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010dacaef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010dacaf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010dacaf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100177 td 0xfffffe010e06b900 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010dac5dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe010dac5df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010dac5e30 _sleep() at _sleep+0x2ef/frame 0xfffffe010dac5ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010dac5ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010dac5f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010dac5f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100178 td 0xfffffe010e06b1e0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010dad4dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe010dad4df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010dad4e30 _sleep() at _sleep+0x2ef/frame 0xfffffe010dad4ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010dad4ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010dad4f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010dad4f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100194 td 0xfffffe010e360720 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010db24dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe010db24df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db24e30 _sleep() at _sleep+0x2ef/frame 0xfffffe010db24ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010db24ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db24f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db24f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100374 td 0xfffffe01437d8ac0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe01439aedd0 mi_switch() at mi_switch+0x175/frame 0xfffffe01439aedf0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01439aee30 _sleep() at _sleep+0x2ef/frame 0xfffffe01439aeec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe01439aeef0 fork_exit() at fork_exit+0x80/frame 0xfffffe01439aef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01439aef30 --- trap 0xc, rip = 0x82513c53a, rsp = 0x83ec51f48, rbp = 0x83ec51f60 --- Tracing command init pid 1 tid 100002 td 0xfffffe00e4c6aac0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00377e1a20 mi_switch() at mi_switch+0x175/frame 0xfffffe00377e1a40 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00377e1a80 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe00377e1ad0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00377e1ae0 _sleep() at _sleep+0x2e5/frame 0xfffffe00377e1b70 kern_wait6() at kern_wait6+0x484/frame 0xfffffe00377e1c00 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe00377e1e00 amd64_syscall() at amd64_syscall+0x15a/frame 0xfffffe00377e1f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00377e1f30 --- syscall (7, FreeBSD ELF64, wait4), rip = 0x2902ea, rsp = 0x820d6b9c8, rbp = 0x820d6ba30 --- Tracing command clock pid 2 tid 100077 td 0xfffffe00e4d18020 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e49beea0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e49beec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe00e49beef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49bef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49bef30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command clock pid 2 tid 100078 td 0xfffffe00e4d17900 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e49b9ea0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e49b9ec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe00e49b9ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49b9f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49b9f30 --- trap 0xfa803d72, rip = 0x7280000000f88141, rsp = 0x49a7ebd7470f4480, rbp = 0x330a89480a75c084 --- Tracing command clock pid 2 tid 100079 td 0xfffffe00e4d171e0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e49c8ea0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e49c8ec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe00e49c8ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49c8f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49c8f30 --- trap 0xc6b60f40, rip = 0x4b81804b70f44d3, rsp = 0xc6b60f40ffffeec0, rbp = 0xd9e800000478cf81 --- Tracing command clock pid 2 tid 100080 td 0xfffffe00e4d16ac0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e49c3ea0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e49c3ec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe00e49c3ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49c3f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49c3f30 --- trap 0xfff00000, rip = 0, rsp = 0x100000000, rbp = 0x30000016b --- Tracing command clock pid 2 tid 100081 td 0xfffffe00e4d1d740 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e49d2ea0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e49d2ec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe00e49d2ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49d2f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49d2f30 --- trap 0xce0c1c1, rip = 0x2444b60fc80b05e0, rsp = 0x69e800000188cc81, rbp = 0x30bed6beeb60f40 --- Tracing command clock pid 2 tid 100082 td 0xfffffe00e4d1d020 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e49cdea0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e49cdec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe00e49cdef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49cdf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49cdf30 --- trap 0xffff9ef8, rip = 0x8b44ce8b4818048b, rsp = 0x4824448944fef000, rbp = 0x1586c607eb000000 --- Tracing command clock pid 2 tid 100083 td 0xfffffe00e4d1c900 fork_trampoline() at fork_trampoline Tracing command clock pid 2 tid 100084 td 0xfffffe00e4d1c1e0 fork_trampoline() at fork_trampoline Tracing command clock pid 2 tid 100085 td 0xfffffe00e4d1bac0 fork_trampoline() at fork_trampoline Tracing command clock pid 2 tid 100086 td 0xfffffe00e4d1b3a0 fork_trampoline() at fork_trampoline Tracing command clock pid 2 tid 100087 td 0xfffffe00e4d1ac80 fork_trampoline() at fork_trampoline Tracing command clock pid 2 tid 100088 td 0xfffffe00e4d1a560 fork_trampoline() at fork_trampoline Tracing command crypto pid 3 tid 100106 td 0xfffffe00e4d42000 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4e75dc0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4e75de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e75e20 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4e75eb0 crypto_dispatch_thread() at crypto_dispatch_thread+0x193/frame 0xfffffe00e4e75ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e75f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e75f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100107 td 0xfffffe00e4d41740 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4e84dc0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4e84de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e84e20 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4e84eb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4e84ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e84f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e84f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100108 td 0xfffffe00e4d41020 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4e7fdc0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4e7fde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e7fe20 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4e7feb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4e7fef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e7ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e7ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100109 td 0xfffffe00e4d40900 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4e8edc0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4e8ede0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e8ee20 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4e8eeb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4e8eef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e8ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e8ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100110 td 0xfffffe00e4d401e0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4e89dc0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4e89de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e89e20 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4e89eb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4e89ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e89f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e89f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100111 td 0xfffffe00e4d3fac0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4e98dc0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4e98de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e98e20 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4e98eb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4e98ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e98f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e98f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100112 td 0xfffffe00e4d3f3a0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4e93dc0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4e93de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e93e20 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4e93eb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4e93ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e93f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e93f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100113 td 0xfffffe00e4d46020 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4ea2dc0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4ea2de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ea2e20 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4ea2eb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4ea2ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ea2f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ea2f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100114 td 0xfffffe00e4d45900 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4e9ddc0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4e9dde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e9de20 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4e9deb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4e9def0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e9df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e9df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100115 td 0xfffffe00e4d451e0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4eacdc0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4eacde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4eace20 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4eaceb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4eacef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4eacf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4eacf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100116 td 0xfffffe00e4d44ac0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4ea7dc0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4ea7de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ea7e20 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4ea7eb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4ea7ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ea7f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ea7f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100117 td 0xfffffe00e4d443a0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4eb6dc0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4eb6de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4eb6e20 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4eb6eb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4eb6ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4eb6f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4eb6f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100118 td 0xfffffe00e4d43c80 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4eb1dc0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4eb1de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4eb1e20 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4eb1eb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4eb1ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4eb1f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4eb1f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 4 tid 100120 td 0xfffffe00e4d42e40 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4ebbdb0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4ebbdd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ebbe10 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4ebbea0 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe00e4ebbef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ebbf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ebbf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 4 tid 100121 td 0xfffffe00e4d59ac0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4ecadb0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4ecadd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ecae10 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4ecaea0 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe00e4ecaef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ecaf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ecaf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 4 tid 100122 td 0xfffffe00e4d593a0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4ec5db0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4ec5dd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ec5e10 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4ec5ea0 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe00e4ec5ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ec5f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ec5f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 4 tid 100123 td 0xfffffe00e4d58c80 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4ed4db0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4ed4dd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ed4e10 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4ed4ea0 xpt_async_td() at xpt_async_td+0x74/frame 0xfffffe00e4ed4ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ed4f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ed4f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 4 tid 100152 td 0xfffffe010d9c1900 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010da52dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe010da52df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da52e30 _sleep() at _sleep+0x2ef/frame 0xfffffe010da52ec0 xpt_scanner_thread() at xpt_scanner_thread+0x154/frame 0xfffffe010da52ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da52f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da52f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command busdma pid 5 tid 100125 td 0xfffffe00e4d94e40 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4ed9dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4ed9df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ed9e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4ed9ec0 busdma_thread() at busdma_thread+0xb5/frame 0xfffffe00e4ed9ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ed9f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ed9f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command rand_harvestq pid 6 tid 100149 td 0xfffffe010d9c7000 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010da39d30 mi_switch() at mi_switch+0x175/frame 0xfffffe010da39d50 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da39d90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010da39dd0 _sleep() at _sleep+0x2d6/frame 0xfffffe010da39e60 random_kthread() at random_kthread+0xa7/frame 0xfffffe010da39ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da39f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da39f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon0 pid 7 tid 100153 td 0xfffffe010d9cb740 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010da5cd90 mi_switch() at mi_switch+0x175/frame 0xfffffe010da5cdb0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da5cdf0 _sleep() at _sleep+0x2ef/frame 0xfffffe010da5ce80 enc_daemon() at enc_daemon+0xde/frame 0xfffffe010da5cef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da5cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da5cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon1 pid 8 tid 100154 td 0xfffffe010d9cb020 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010da57d90 mi_switch() at mi_switch+0x175/frame 0xfffffe010da57db0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da57df0 _sleep() at _sleep+0x2ef/frame 0xfffffe010da57e80 enc_daemon() at enc_daemon+0xde/frame 0xfffffe010da57ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da57f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da57f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 9 tid 100195 td 0xfffffe010e3fa000 (CPU 4) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce4ddf0 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce4de00 trap() at trap+0x57/frame 0xfffffe003ce4df20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce4df20 --- trap 0x13, rip = 0xffffffff80fa9d54, rsp = 0xfffffe010db46b00, rbp = 0xfffffe010db46eb0 --- vm_pageout_worker() at vm_pageout_worker+0xb34/frame 0xfffffe010db46eb0 vm_pageout() at vm_pageout+0x1c7/frame 0xfffffe010db46ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db46f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db46f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 9 tid 100205 td 0xfffffe010e4783a0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010db64670 mi_switch() at mi_switch+0x175/frame 0xfffffe010db64690 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db646d0 _sleep() at _sleep+0x2ef/frame 0xfffffe010db64760 swap_pager_putpages() at swap_pager_putpages+0x176/frame 0xfffffe010db64800 vm_pageout_flush() at vm_pageout_flush+0xf5/frame 0xfffffe010db64900 vm_pageout_cluster() at vm_pageout_cluster+0x34b/frame 0xfffffe010db64b70 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x740/frame 0xfffffe010db64ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db64f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db64f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 9 tid 100206 td 0xfffffe010e477c80 sched_switch() at sched_switch+0x5a8/frame 0xfffffe01185bad90 mi_switch() at mi_switch+0x175/frame 0xfffffe01185badb0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01185badf0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe01185bae30 _sleep() at _sleep+0x2d6/frame 0xfffffe01185baec0 uma_reclaim_worker() at uma_reclaim_worker+0xc8/frame 0xfffffe01185baef0 fork_exit() at fork_exit+0x80/frame 0xfffffe01185baf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01185baf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command audit pid 10 tid 100001 td 0xfffffe00e4c6b1e0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00377e6dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00377e6df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00377e6e30 _cv_wait() at _cv_wait+0x165/frame 0xfffffe00377e6e90 audit_worker() at audit_worker+0x8f/frame 0xfffffe00377e6ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377e6f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377e6f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command idle pid 11 tid 100003 td 0xfffffe00e4c6a3a0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00377f0e30 mi_switch() at mi_switch+0x175/frame 0xfffffe00377f0e50 sched_idletd() at sched_idletd+0x4f7/frame 0xfffffe00377f0ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377f0f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377f0f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command idle pid 11 tid 100004 td 0xfffffe00e4c69c80 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00377ebe30 mi_switch() at mi_switch+0x175/frame 0xfffffe00377ebe50 sched_idletd() at sched_idletd+0xa1/frame 0xfffffe00377ebef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377ebf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377ebf30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command idle pid 11 tid 100005 td 0xfffffe00e4c69560 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00377fae30 mi_switch() at mi_switch+0x175/frame 0xfffffe00377fae50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00377faef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377faf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377faf30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command idle pid 11 tid 100006 td 0xfffffe00e4c68e40 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00377f5e30 mi_switch() at mi_switch+0x175/frame 0xfffffe00377f5e50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00377f5ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377f5f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377f5f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command idle pid 11 tid 100007 td 0xfffffe00e4c68720 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4830e30 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4830e50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00e4830ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4830f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4830f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command idle pid 11 tid 100008 td 0xfffffe00e4c68000 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00377ffe30 mi_switch() at mi_switch+0x175/frame 0xfffffe00377ffe50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00377ffef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377fff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377fff30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command idle pid 11 tid 100009 td 0xfffffe00e4c72c80 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e483ae30 mi_switch() at mi_switch+0x175/frame 0xfffffe00e483ae50 sched_idletd() at sched_idletd+0x4f7/frame 0xfffffe00e483aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e483af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e483af30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command idle pid 11 tid 100010 td 0xfffffe00e4c72560 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4835e30 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4835e50 sched_idletd() at sched_idletd+0x4f7/frame 0xfffffe00e4835ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4835f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4835f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command idle pid 11 tid 100011 td 0xfffffe00e4c71e40 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4844d50 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4844d70 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe00e4844d70 --- interrupt, rip = 0xffffffff810ab599, rsp = 0xfffffe00e4844e40, rbp = 0xfffffe00e4844e50 --- cpu_idle() at cpu_idle+0xf9/frame 0xfffffe00e4844e50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00e4844ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4844f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4844f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command idle pid 11 tid 100012 td 0xfffffe00e4c71720 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e483fe30 mi_switch() at mi_switch+0x175/frame 0xfffffe00e483fe50 sched_idletd() at sched_idletd+0x4f7/frame 0xfffffe00e483fef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e483ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e483ff30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command idle pid 11 tid 100013 td 0xfffffe00e4c71000 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e484ee30 mi_switch() at mi_switch+0x175/frame 0xfffffe00e484ee50 sched_idletd() at sched_idletd+0x4f7/frame 0xfffffe00e484eef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e484ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e484ef30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command idle pid 11 tid 100014 td 0xfffffe00e4c6c740 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4849e30 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4849e50 sched_idletd() at sched_idletd+0x4f7/frame 0xfffffe00e4849ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4849f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4849f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command intr pid 12 tid 100040 td 0xfffffe00e4cf6740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100042 td 0xfffffe00e4d04e40 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100046 td 0xfffffe00e4d03020 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e48e9e40 mi_switch() at mi_switch+0x175/frame 0xfffffe00e48e9e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e48e9ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48e9f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48e9f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command intr pid 12 tid 100089 td 0xfffffe00e4d261e0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e49fae40 mi_switch() at mi_switch+0x175/frame 0xfffffe00e49fae60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e49faef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49faf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49faf30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command intr pid 12 tid 100124 td 0xfffffe00e4d95560 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4edee40 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4edee60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4edeef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4edef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4edef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100126 td 0xfffffe00e4d94720 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4ee8e40 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4ee8e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4ee8ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ee8f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ee8f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100132 td 0xfffffe010a33f000 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4f06e40 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4f06e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4f06ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f06f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f06f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100143 td 0xfffffe010a340560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100144 td 0xfffffe010a33fe40 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100145 td 0xfffffe010a33f720 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4f55e40 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4f55e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4f55ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f55f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f55f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100159 td 0xfffffe010df103a0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010da6be40 mi_switch() at mi_switch+0x175/frame 0xfffffe010da6be60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe010da6bef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da6bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da6bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100160 td 0xfffffe010df7cc80 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010da7ae40 mi_switch() at mi_switch+0x175/frame 0xfffffe010da7ae60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe010da7aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da7af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da7af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100161 td 0xfffffe010df7c560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100162 td 0xfffffe010df7be40 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100163 td 0xfffffe010df7b720 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100164 td 0xfffffe010df7b000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100165 td 0xfffffe010df12740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100166 td 0xfffffe010df12020 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100167 td 0xfffffe010df11900 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100168 td 0xfffffe010e068720 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100169 td 0xfffffe010e068000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100170 td 0xfffffe010df7f740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100171 td 0xfffffe010df7f020 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100172 td 0xfffffe010df7e900 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100173 td 0xfffffe010df7e1e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100179 td 0xfffffe010e06aac0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010dacfe40 mi_switch() at mi_switch+0x175/frame 0xfffffe010dacfe60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe010dacfef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010dacff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010dacff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100180 td 0xfffffe010e06a3a0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010dadee40 mi_switch() at mi_switch+0x175/frame 0xfffffe010dadee60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe010dadeef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010dadef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010dadef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100181 td 0xfffffe010e069c80 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100182 td 0xfffffe010e069560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100183 td 0xfffffe010e068e40 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100184 td 0xfffffe010e25dac0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100185 td 0xfffffe010e25d3a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100186 td 0xfffffe010e25cc80 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100187 td 0xfffffe010e25c560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100188 td 0xfffffe010e25be40 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100189 td 0xfffffe010e25b720 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100190 td 0xfffffe010e25b000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100191 td 0xfffffe010e06c740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100192 td 0xfffffe010e361560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100193 td 0xfffffe010e360e40 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100257 td 0xfffffe010e362ac0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100258 td 0xfffffe0143769ac0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100259 td 0xfffffe01437693a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100260 td 0xfffffe0143768c80 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100261 td 0xfffffe0143768560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100262 td 0xfffffe0143767e40 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100263 td 0xfffffe0143767720 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100264 td 0xfffffe0143767000 fork_trampoline() at fork_trampoline Tracing command geom pid 13 tid 100091 td 0xfffffe00e4d253a0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4e34dd0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4e34df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e34e30 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4e34ec0 g_run_events() at g_run_events+0x444/frame 0xfffffe00e4e34ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e34f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e34f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100092 td 0xfffffe00e4d24c80 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e49ffdc0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e49ffde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e49ffe20 _sleep() at _sleep+0x2ef/frame 0xfffffe00e49ffeb0 g_io_schedule_up() at g_io_schedule_up+0x3c/frame 0xfffffe00e49ffee0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe00e49ffef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49fff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49fff30 --- trap 0x3b490001, rip = 0x90ffcf8b48d38b48, rsp = 0x8838e800009e, rbp = 0xaa2f1d89480001 --- Tracing command geom pid 13 tid 100093 td 0xfffffe00e4d24560 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4e3edc0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4e3ede0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e3ee20 _sleep() at _sleep+0x2ef/frame 0xfffffe00e4e3eeb0 g_io_schedule_down() at g_io_schedule_down+0x4c/frame 0xfffffe00e4e3eee0 g_down_procbody() at g_down_procbody+0x5c/frame 0xfffffe00e4e3eef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e3ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e3ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sequencer 00 pid 14 tid 100119 td 0xfffffe00e4d43560 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4ec0db0 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4ec0dd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ec0e10 _cv_wait() at _cv_wait+0x165/frame 0xfffffe00e4ec0e70 seq_eventthread() at seq_eventthread+0x8c/frame 0xfffffe00e4ec0ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ec0f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ec0f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100127 td 0xfffffe00e4d94000 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4ee3e00 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4ee3e20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ee3e60 _cv_wait() at _cv_wait+0x165/frame 0xfffffe00e4ee3ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4ee3ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ee3f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ee3f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100128 td 0xfffffe00e4d5b740 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4ef2e00 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4ef2e20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ef2e60 _cv_wait() at _cv_wait+0x165/frame 0xfffffe00e4ef2ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4ef2ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ef2f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ef2f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100129 td 0xfffffe00e4d5b020 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4eede00 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4eede20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4eede60 _cv_wait() at _cv_wait+0x165/frame 0xfffffe00e4eedec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4eedef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4eedf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4eedf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100130 td 0xfffffe00e4d5a900 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4efce00 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4efce20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4efce60 _cv_wait() at _cv_wait+0x165/frame 0xfffffe00e4efcec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4efcef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4efcf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4efcf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100131 td 0xfffffe00e4d5a1e0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4ef7e00 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4ef7e20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ef7e60 _cv_wait() at _cv_wait+0x165/frame 0xfffffe00e4ef7ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4ef7ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ef7f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ef7f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100133 td 0xfffffe00e4d98740 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4f01e00 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4f01e20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f01e60 _cv_wait() at _cv_wait+0x165/frame 0xfffffe00e4f01ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f01ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f01f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f01f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100134 td 0xfffffe00e4d98020 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4f10e00 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4f10e20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f10e60 _cv_wait() at _cv_wait+0x165/frame 0xfffffe00e4f10ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f10ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f10f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f10f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100135 td 0xfffffe00e4d97900 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4f0be00 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4f0be20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f0be60 _cv_wait() at _cv_wait+0x165/frame 0xfffffe00e4f0bec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f0bef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f0bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f0bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100136 td 0xfffffe00e4d971e0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4f1ae00 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4f1ae20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f1ae60 _cv_wait() at _cv_wait+0x165/frame 0xfffffe00e4f1aec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f1aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f1af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f1af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100137 td 0xfffffe00e4d96ac0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4f15e00 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4f15e20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f15e60 _cv_wait() at _cv_wait+0x165/frame 0xfffffe00e4f15ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f15ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f15f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f15f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100138 td 0xfffffe010a342900 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4f3ce00 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4f3ce20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f3ce60 _cv_wait() at _cv_wait+0x165/frame 0xfffffe00e4f3cec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f3cef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f3cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f3cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100139 td 0xfffffe010a3421e0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4f37e00 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4f37e20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f37e60 _cv_wait() at _cv_wait+0x165/frame 0xfffffe00e4f37ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f37ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f37f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f37f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100140 td 0xfffffe010a341ac0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4f46e00 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4f46e20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f46e60 _cv_wait() at _cv_wait+0x165/frame 0xfffffe00e4f46ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f46ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f46f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f46f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100141 td 0xfffffe010a3413a0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4f41e00 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4f41e20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f41e60 _cv_wait() at _cv_wait+0x165/frame 0xfffffe00e4f41ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f41ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f41f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f41f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100142 td 0xfffffe010a340c80 sched_switch() at sched_switch+0x5a8/frame 0xfffffe00e4f50e00 mi_switch() at mi_switch+0x175/frame 0xfffffe00e4f50e20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f50e60 _cv_wait() at _cv_wait+0x165/frame 0xfffffe00e4f50ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f50ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f50f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f50f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vmdaemon pid 16 tid 100196 td 0xfffffe010e364740 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010db41d90 mi_switch() at mi_switch+0x175/frame 0xfffffe010db41db0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db41df0 _sleep() at _sleep+0x2ef/frame 0xfffffe010db41e80 vm_daemon() at vm_daemon+0x82/frame 0xfffffe010db41ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db41f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db41f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100197 td 0xfffffe010e364020 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010db50d70 mi_switch() at mi_switch+0x175/frame 0xfffffe010db50d90 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db50dd0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db50e10 _sleep() at _sleep+0x2d6/frame 0xfffffe010db50ea0 buf_daemon() at buf_daemon+0x121/frame 0xfffffe010db50ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db50f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db50f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100198 td 0xfffffe010e3fd900 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010eb07d50 mi_switch() at mi_switch+0x175/frame 0xfffffe010eb07d70 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010eb07db0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010eb07df0 _sleep() at _sleep+0x2d6/frame 0xfffffe010eb07e80 bufspace_daemon() at bufspace_daemon+0x322/frame 0xfffffe010eb07ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010eb07f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010eb07f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100199 td 0xfffffe010e3fd1e0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010db55d50 mi_switch() at mi_switch+0x175/frame 0xfffffe010db55d70 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db55db0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db55df0 _sleep() at _sleep+0x2d6/frame 0xfffffe010db55e80 bufspace_daemon() at bufspace_daemon+0x322/frame 0xfffffe010db55ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db55f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db55f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100200 td 0xfffffe010e3fcac0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010f91ad50 mi_switch() at mi_switch+0x175/frame 0xfffffe010f91ad70 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010f91adb0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010f91adf0 _sleep() at _sleep+0x2d6/frame 0xfffffe010f91ae80 bufspace_daemon() at bufspace_daemon+0x322/frame 0xfffffe010f91aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010f91af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010f91af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100201 td 0xfffffe010e3fc3a0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010db5ad50 mi_switch() at mi_switch+0x175/frame 0xfffffe010db5ad70 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db5adb0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db5adf0 _sleep() at _sleep+0x2d6/frame 0xfffffe010db5ae80 bufspace_daemon() at bufspace_daemon+0x322/frame 0xfffffe010db5aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db5af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db5af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100202 td 0xfffffe010e3fbc80 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010fb26d50 mi_switch() at mi_switch+0x175/frame 0xfffffe010fb26d70 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010fb26db0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010fb26df0 _sleep() at _sleep+0x2d6/frame 0xfffffe010fb26e80 bufspace_daemon() at bufspace_daemon+0x322/frame 0xfffffe010fb26ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010fb26f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010fb26f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100203 td 0xfffffe010e3fb560 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010fb21d50 mi_switch() at mi_switch+0x175/frame 0xfffffe010fb21d70 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010fb21db0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010fb21df0 _sleep() at _sleep+0x2d6/frame 0xfffffe010fb21e80 bufspace_daemon() at bufspace_daemon+0x322/frame 0xfffffe010fb21ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010fb21f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010fb21f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100204 td 0xfffffe010e3fae40 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010db5fd50 mi_switch() at mi_switch+0x175/frame 0xfffffe010db5fd70 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db5fdb0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db5fdf0 _sleep() at _sleep+0x2d6/frame 0xfffffe010db5fe80 bufspace_daemon() at bufspace_daemon+0x322/frame 0xfffffe010db5fef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db5ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db5ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100225 td 0xfffffe00e4d57e40 sched_switch() at sched_switch+0x5a8/frame 0xfffffe01417a3d80 mi_switch() at mi_switch+0x175/frame 0xfffffe01417a3da0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01417a3de0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe01417a3e20 _sleep() at _sleep+0x2d6/frame 0xfffffe01417a3eb0 softdep_flush() at softdep_flush+0x188/frame 0xfffffe01417a3ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe01417a3f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01417a3f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100229 td 0xfffffe010e47a020 sched_switch() at sched_switch+0x5a8/frame 0xfffffe01417cfd80 mi_switch() at mi_switch+0x175/frame 0xfffffe01417cfda0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01417cfde0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe01417cfe20 _sleep() at _sleep+0x2d6/frame 0xfffffe01417cfeb0 softdep_flush() at softdep_flush+0x188/frame 0xfffffe01417cfef0 fork_exit() at fork_exit+0x80/frame 0xfffffe01417cff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01417cff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100481 td 0xfffffe015b084000 sched_switch() at sched_switch+0x5a8/frame 0xfffffe015b562d80 mi_switch() at mi_switch+0x175/frame 0xfffffe015b562da0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe015b562de0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe015b562e20 _sleep() at _sleep+0x2d6/frame 0xfffffe015b562eb0 softdep_flush() at softdep_flush+0x188/frame 0xfffffe015b562ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe015b562f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe015b562f30 --- trap 0x5a5a5a5a, rip = 0x5a5a5a5a5a5a5a5a, rsp = 0x5a5a5a5a5a5a5a5a, rbp = 0x5a5a5a5a5a5a5a5a --- Tracing command vnlru pid 18 tid 100207 td 0xfffffe010e363900 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010db4bd20 mi_switch() at mi_switch+0x175/frame 0xfffffe010db4bd40 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db4bd80 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db4bdc0 _sleep() at _sleep+0x2d6/frame 0xfffffe010db4be50 vnlru_proc() at vnlru_proc+0x91f/frame 0xfffffe010db4bef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db4bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db4bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command syncer pid 19 tid 100208 td 0xfffffe010e3631e0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe0141753d40 mi_switch() at mi_switch+0x175/frame 0xfffffe0141753d60 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0141753da0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0141753de0 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x199/frame 0xfffffe0141753e60 sched_sync() at sched_sync+0x66e/frame 0xfffffe0141753ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe0141753f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0141753f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sshd pid 49172 tid 100443 td 0xfffffe010a343740 sched_switch() at sched_switch+0x5a8/frame 0xfffffe015b54eae0 mi_switch() at mi_switch+0x175/frame 0xfffffe015b54eb00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe015b54eb40 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe015b54eb90 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe015b54eba0 _cv_wait_sig() at _cv_wait_sig+0x164/frame 0xfffffe015b54ec00 kern_poll_kfds() at kern_poll_kfds+0x4dc/frame 0xfffffe015b54ec90 kern_poll() at kern_poll+0x9f/frame 0xfffffe015b54ede0 sys_poll() at sys_poll+0x50/frame 0xfffffe015b54ee00 amd64_syscall() at amd64_syscall+0x15a/frame 0xfffffe015b54ef30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe015b54ef30 --- syscall (209, FreeBSD ELF64, poll), rip = 0x156d7d50289a, rsp = 0x156d76a838a8, rbp = 0x156d76a838e0 --- Tracing command sshd pid 49334 tid 100434 td 0xfffffe015b2b2e40 sched_switch() at sched_switch+0x5a8/frame 0xfffffe015b51cab0 mi_switch() at mi_switch+0x175/frame 0xfffffe015b51cad0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe015b51cb10 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe015b51cb60 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe015b51cb70 _cv_wait_sig() at _cv_wait_sig+0x164/frame 0xfffffe015b51cbd0 kern_poll_kfds() at kern_poll_kfds+0x4dc/frame 0xfffffe015b51cc60 kern_poll() at kern_poll+0x9f/frame 0xfffffe015b51cdb0 sys_ppoll() at sys_ppoll+0x6f/frame 0xfffffe015b51ce00 amd64_syscall() at amd64_syscall+0x15a/frame 0xfffffe015b51cf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe015b51cf30 --- syscall (545, FreeBSD ELF64, ppoll), rip = 0x156d7d5028ba, rsp = 0x156d76a83668, rbp = 0x156d76a836a0 --- Tracing command bash pid 49341 tid 100267 td 0xfffffe01436eaac0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe0143899a20 mi_switch() at mi_switch+0x175/frame 0xfffffe0143899a40 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0143899a80 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0143899ad0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0143899ae0 _sleep() at _sleep+0x2e5/frame 0xfffffe0143899b70 kern_wait6() at kern_wait6+0x484/frame 0xfffffe0143899c00 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0143899e00 amd64_syscall() at amd64_syscall+0x15a/frame 0xfffffe0143899f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0143899f30 --- syscall (7, FreeBSD ELF64, wait4), rip = 0x82449bafa, rsp = 0x820d3c938, rbp = 0x820d3c990 --- Tracing command sh pid 57933 tid 100391 td 0xfffffe015b2123a0 --- swapped out Tracing command tee pid 57934 tid 100442 td 0xfffffe010a343020 sched_switch() at sched_switch+0x5a8/frame 0xfffffe015b553b90 mi_switch() at mi_switch+0x175/frame 0xfffffe015b553bb0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe015b553bf0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe015b553c40 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe015b553c50 _sleep() at _sleep+0x2e5/frame 0xfffffe015b553ce0 pipe_read() at pipe_read+0x42a/frame 0xfffffe015b553d50 dofileread() at dofileread+0x83/frame 0xfffffe015b553d90 sys_read() at sys_read+0xc0/frame 0xfffffe015b553e00 amd64_syscall() at amd64_syscall+0x15a/frame 0xfffffe015b553f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe015b553f30 --- syscall (3, FreeBSD ELF64, read), rip = 0x150906de091a, rsp = 0x150905198618, rbp = 0x150905198670 --- Tracing command sh pid 57935 tid 100468 td 0xfffffe010d9be720 sched_switch() at sched_switch+0x5a8/frame 0xfffffe01439cca20 mi_switch() at mi_switch+0x175/frame 0xfffffe01439cca40 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01439cca80 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01439ccad0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01439ccae0 _sleep() at _sleep+0x2e5/frame 0xfffffe01439ccb70 kern_wait6() at kern_wait6+0x484/frame 0xfffffe01439ccc00 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe01439cce00 amd64_syscall() at amd64_syscall+0x15a/frame 0xfffffe01439ccf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01439ccf30 --- syscall (7, FreeBSD ELF64, wait4), rip = 0x1a7519e0dafa, rsp = 0x1a7517e35428, rbp = 0x1a7517e354d0 --- Tracing command md10 pid 57941 tid 100293 td 0xfffffe010e3fe020 sched_switch() at sched_switch+0x5a8/frame 0xfffffe01438fadb0 mi_switch() at mi_switch+0x175/frame 0xfffffe01438fadd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01438fae10 _sleep() at _sleep+0x2ef/frame 0xfffffe01438faea0 md_kthread() at md_kthread+0xd5/frame 0xfffffe01438faef0 fork_exit() at fork_exit+0x80/frame 0xfffffe01438faf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01438faf30 --- trap 0xc, rip = 0x288af161b53a, rsp = 0x288aecd80528, rbp = 0x288aecd80540 --- Tracing command md22 pid 57946 tid 100382 td 0xfffffe0145b08020 sched_switch() at sched_switch+0x5a8/frame 0xfffffe01439bddb0 mi_switch() at mi_switch+0x175/frame 0xfffffe01439bddd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01439bde10 _sleep() at _sleep+0x2ef/frame 0xfffffe01439bdea0 md_kthread() at md_kthread+0xd5/frame 0xfffffe01439bdef0 fork_exit() at fork_exit+0x80/frame 0xfffffe01439bdf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01439bdf30 --- trap 0xc, rip = 0x35b2ff76553a, rsp = 0x35b2fa285bb8, rbp = 0x35b2fa285bd0 --- Tracing command md23 pid 57951 tid 100254 td 0xfffffe01436eb1e0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010dbe1db0 mi_switch() at mi_switch+0x175/frame 0xfffffe010dbe1dd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010dbe1e10 _sleep() at _sleep+0x2ef/frame 0xfffffe010dbe1ea0 md_kthread() at md_kthread+0xd5/frame 0xfffffe010dbe1ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010dbe1f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010dbe1f30 --- trap 0xc, rip = 0x93444b853a, rsp = 0x934266dec8, rbp = 0x934266dee0 --- Tracing command md24 pid 57956 tid 100408 td 0xfffffe015b24f740 sched_switch() at sched_switch+0x5a8/frame 0xfffffe015b4aedb0 mi_switch() at mi_switch+0x175/frame 0xfffffe015b4aedd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe015b4aee10 _sleep() at _sleep+0x2ef/frame 0xfffffe015b4aeea0 md_kthread() at md_kthread+0xd5/frame 0xfffffe015b4aeef0 fork_exit() at fork_exit+0x80/frame 0xfffffe015b4aef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe015b4aef30 --- trap 0xc, rip = 0x3fb6cf8f553a, rsp = 0x3fb6cc506618, rbp = 0x3fb6cc506630 --- Tracing command swap pid 57966 tid 100291 td 0xfffffe010e476000 sched_switch() at sched_switch+0x5a8/frame 0xfffffe0141794bc0 mi_switch() at mi_switch+0x175/frame 0xfffffe0141794be0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0141794c20 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0141794c70 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe0141794cb0 _sleep() at _sleep+0x2c4/frame 0xfffffe0141794d40 kern_clock_nanosleep() at kern_clock_nanosleep+0x1c1/frame 0xfffffe0141794dc0 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe0141794e00 amd64_syscall() at amd64_syscall+0x15a/frame 0xfffffe0141794f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141794f30 --- syscall (240, FreeBSD ELF64, nanosleep), rip = 0x2f6818ef781a, rsp = 0x2f68171838c8, rbp = 0x2f6817183910 --- Tracing command swap pid 57969 tid 100375 td 0xfffffe01437ef000 --- swapped out Tracing command swap pid 57970 tid 100447 td 0xfffffe010e7e2ac0 (CPU 0) cpustop_handler() at cpustop_handler+0x28/frame 0xffffffff81fe6c00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xffffffff81fe6c10 trap() at trap+0x57/frame 0xffffffff81fe6d30 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81fe6d30 --- trap 0x13, rip = 0x2f5ff66764ec, rsp = 0x2f68171838e0, rbp = 0x2f6817183910 --- Tracing command swap pid 57971 tid 100448 td 0xfffffe0143599900 (CPU 10) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003cea7df0 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003cea7e00 trap() at trap+0x57/frame 0xfffffe003cea7f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003cea7f20 --- trap 0x13, rip = 0x2f5ff66764e0, rsp = 0x2f68171838e0, rbp = 0x2f6817183910 --- Tracing command swap pid 57972 tid 100426 td 0xfffffe0145b04720 sched_switch() at sched_switch+0x5a8/frame 0xfffffe015b503e90 mi_switch() at mi_switch+0x175/frame 0xfffffe015b503eb0 ast_scheduler() at ast_scheduler+0x45/frame 0xfffffe015b503ed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe015b503f10 ast() at ast+0x20/frame 0xfffffe015b503f30 doreti_ast() at doreti_ast+0x1c/frame 0x2f6817183910 Tracing command swap pid 57973 tid 100240 td 0xfffffe010d9ca900 (CPU 8) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce89df0 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce89e00 trap() at trap+0x57/frame 0xfffffe003ce89f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce89f20 --- trap 0x13, rip = 0x2f5ff66764ec, rsp = 0x2f68171838e0, rbp = 0x2f6817183910 --- Tracing command sh pid 57974 tid 100284 td 0xfffffe010e7e3900 sched_switch() at sched_switch+0x5a8/frame 0xfffffe01438e9a20 mi_switch() at mi_switch+0x175/frame 0xfffffe01438e9a40 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01438e9a80 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01438e9ad0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01438e9ae0 _sleep() at _sleep+0x2e5/frame 0xfffffe01438e9b70 kern_wait6() at kern_wait6+0x484/frame 0xfffffe01438e9c00 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe01438e9e00 amd64_syscall() at amd64_syscall+0x15a/frame 0xfffffe01438e9f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01438e9f30 --- syscall (7, FreeBSD ELF64, wait4), rip = 0x1a7519e0dafa, rsp = 0x1a7517e35278, rbp = 0x1a7517e35320 --- Tracing command swap pid 57975 tid 100444 td 0xfffffe0145b6d020 (CPU 6) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce6bdf0 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce6be00 trap() at trap+0x57/frame 0xfffffe003ce6bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce6bf20 --- trap 0x13, rip = 0x2f5ff66764e0, rsp = 0x2f68171838e0, rbp = 0x2f6817183910 --- Tracing command swap pid 57977 tid 100397 td 0xfffffe0145b79c80 sched_switch() at sched_switch+0x5a8/frame 0xfffffe015b475a40 mi_switch() at mi_switch+0x175/frame 0xfffffe015b475a60 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe015b475aa0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe015b475ae0 _sleep() at _sleep+0x2d6/frame 0xfffffe015b475b70 swap_pager_getpages_locked() at swap_pager_getpages_locked+0x581/frame 0xfffffe015b475bf0 vm_pager_get_pages() at vm_pager_get_pages+0x5f/frame 0xfffffe015b475c40 vm_fault() at vm_fault+0x6f6/frame 0xfffffe015b475d70 vm_fault_trap() at vm_fault_trap+0x71/frame 0xfffffe015b475db0 trap_pfault() at trap_pfault+0x22c/frame 0xfffffe015b475e10 trap() at trap+0x48c/frame 0xfffffe015b475f30 calltrap() at calltrap+0x8/frame 0xfffffe015b475f30 --- trap 0xc, rip = 0x2f5ff66764e7, rsp = 0x2f68171838e0, rbp = 0x2f6817183910 --- Tracing command swap pid 57978 tid 100435 td 0xfffffe0150996c80 (CPU 3) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce3edf0 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce3ee00 trap() at trap+0x57/frame 0xfffffe003ce3ef20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce3ef20 --- trap 0x13, rip = 0x2f5ff66764e5, rsp = 0x2f68171838e0, rbp = 0x2f6817183910 --- Tracing command swap pid 57980 tid 100445 td 0xfffffe0145b6bac0 (CPU 1) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce20df0 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce20e00 trap() at trap+0x57/frame 0xfffffe003ce20f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce20f20 --- trap 0x13, rip = 0x2f5ff66764ec, rsp = 0x2f68171838e0, rbp = 0x2f6817183910 --- Tracing command swap pid 57981 tid 100401 td 0xfffffe015b24c560 sched_switch() at sched_switch+0x5a8/frame 0xfffffe015b486a40 mi_switch() at mi_switch+0x175/frame 0xfffffe015b486a60 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe015b486aa0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe015b486ae0 _sleep() at _sleep+0x2d6/frame 0xfffffe015b486b70 swap_pager_getpages_locked() at swap_pager_getpages_locked+0x581/frame 0xfffffe015b486bf0 vm_pager_get_pages() at vm_pager_get_pages+0x5f/frame 0xfffffe015b486c40 vm_fault() at vm_fault+0x6f6/frame 0xfffffe015b486d70 vm_fault_trap() at vm_fault_trap+0x71/frame 0xfffffe015b486db0 trap_pfault() at trap_pfault+0x22c/frame 0xfffffe015b486e10 trap() at trap+0x48c/frame 0xfffffe015b486f30 calltrap() at calltrap+0x8/frame 0xfffffe015b486f30 --- trap 0xc, rip = 0x2f5ff66764e7, rsp = 0x2f68171838e0, rbp = 0x2f6817183910 --- Tracing command swap pid 57982 tid 100474 td 0xfffffe015b08b000 (CPU 11) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ceb6df0 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ceb6e00 trap() at trap+0x57/frame 0xfffffe003ceb6f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ceb6f20 --- trap 0x13, rip = 0x2f5ff66764ec, rsp = 0x2f68171838e0, rbp = 0x2f6817183910 --- Tracing command swap pid 57983 tid 100451 td 0xfffffe015b2b5900 (CPU 5) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce5cdf0 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce5ce00 trap() at trap+0x57/frame 0xfffffe003ce5cf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce5cf20 --- trap 0x13, rip = 0x2f5ff66764ec, rsp = 0x2f68171838e0, rbp = 0x2f6817183910 --- Tracing command swap pid 57984 tid 100365 td 0xfffffe0150997ac0 (CPU 9) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce98df0 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce98e00 trap() at trap+0x57/frame 0xfffffe003ce98f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce98f20 --- trap 0x13, rip = 0x2f5ff66764ec, rsp = 0x2f68171838e0, rbp = 0x2f6817183910 --- Tracing command swap pid 57985 tid 100446 td 0xfffffe0145b6ac80 (CPU 7) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce7adf0 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce7ae00 trap() at trap+0x57/frame 0xfffffe003ce7af20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce7af20 --- trap 0x13, rip = 0x2f5ff66764e0, rsp = 0x2f68171838e0, rbp = 0x2f6817183910 --- Tracing command sh pid 57986 tid 100242 td 0xfffffe010d9ca1e0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010db9ba20 mi_switch() at mi_switch+0x175/frame 0xfffffe010db9ba40 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db9ba80 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe010db9bad0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe010db9bae0 _sleep() at _sleep+0x2e5/frame 0xfffffe010db9bb70 kern_wait6() at kern_wait6+0x484/frame 0xfffffe010db9bc00 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe010db9be00 amd64_syscall() at amd64_syscall+0x15a/frame 0xfffffe010db9bf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010db9bf30 --- syscall (7, FreeBSD ELF64, wait4), rip = 0x1a7519e0dafa, rsp = 0x1a7517e35158, rbp = 0x1a7517e35200 --- Tracing command sh pid 57988 tid 100358 td 0xfffffe0150996560 sched_switch() at sched_switch+0x5a8/frame 0xfffffe0143981a20 mi_switch() at mi_switch+0x175/frame 0xfffffe0143981a40 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0143981a80 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0143981ad0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0143981ae0 _sleep() at _sleep+0x2e5/frame 0xfffffe0143981b70 kern_wait6() at kern_wait6+0x484/frame 0xfffffe0143981c00 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0143981e00 amd64_syscall() at amd64_syscall+0x15a/frame 0xfffffe0143981f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0143981f30 --- syscall (7, FreeBSD ELF64, wait4), rip = 0x1a7519e0dafa, rsp = 0x1a7517e35278, rbp = 0x1a7517e35320 --- Tracing command sh pid 57993 tid 100288 td 0xfffffe010e25f740 sched_switch() at sched_switch+0x5a8/frame 0xfffffe01417b9a20 mi_switch() at mi_switch+0x175/frame 0xfffffe01417b9a40 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01417b9a80 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01417b9ad0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01417b9ae0 _sleep() at _sleep+0x2e5/frame 0xfffffe01417b9b70 kern_wait6() at kern_wait6+0x484/frame 0xfffffe01417b9c00 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe01417b9e00 amd64_syscall() at amd64_syscall+0x15a/frame 0xfffffe01417b9f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01417b9f30 --- syscall (7, FreeBSD ELF64, wait4), rip = 0x1a7519e0dafa, rsp = 0x1a7517e35158, rbp = 0x1a7517e35200 --- Tracing command sh pid 57995 tid 100363 td 0xfffffe0150998900 sched_switch() at sched_switch+0x5a8/frame 0xfffffe014398ba20 mi_switch() at mi_switch+0x175/frame 0xfffffe014398ba40 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe014398ba80 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014398bad0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe014398bae0 _sleep() at _sleep+0x2e5/frame 0xfffffe014398bb70 kern_wait6() at kern_wait6+0x484/frame 0xfffffe014398bc00 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe014398be00 amd64_syscall() at amd64_syscall+0x15a/frame 0xfffffe014398bf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014398bf30 --- syscall (7, FreeBSD ELF64, wait4), rip = 0x1a7519e0dafa, rsp = 0x1a7517e35278, rbp = 0x1a7517e35320 --- Tracing command sh pid 58003 tid 100415 td 0xfffffe01437d91e0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe014399aa20 mi_switch() at mi_switch+0x175/frame 0xfffffe014399aa40 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe014399aa80 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014399aad0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe014399aae0 _sleep() at _sleep+0x2e5/frame 0xfffffe014399ab70 kern_wait6() at kern_wait6+0x484/frame 0xfffffe014399ac00 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe014399ae00 amd64_syscall() at amd64_syscall+0x15a/frame 0xfffffe014399af30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014399af30 --- syscall (7, FreeBSD ELF64, wait4), rip = 0x1a7519e0dafa, rsp = 0x1a7517e35158, rbp = 0x1a7517e35200 --- Tracing command sh pid 1749 tid 100292 td 0xfffffe010e3fe740 sched_switch() at sched_switch+0x5a8/frame 0xfffffe01438ffa20 mi_switch() at mi_switch+0x175/frame 0xfffffe01438ffa40 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01438ffa80 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01438ffad0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01438ffae0 _sleep() at _sleep+0x2e5/frame 0xfffffe01438ffb70 kern_wait6() at kern_wait6+0x484/frame 0xfffffe01438ffc00 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe01438ffe00 amd64_syscall() at amd64_syscall+0x15a/frame 0xfffffe01438fff30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01438fff30 --- syscall (7, FreeBSD ELF64, wait4), rip = 0x10e2ca021afa, rsp = 0x10e2c7c4b8d8, rbp = 0x10e2c7c4b980 --- Tracing command sleep pid 2127 tid 100219 td 0xfffffe010e47a740 sched_switch() at sched_switch+0x5a8/frame 0xfffffe0141780bc0 mi_switch() at mi_switch+0x175/frame 0xfffffe0141780be0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0141780c20 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0141780c70 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe0141780cb0 _sleep() at _sleep+0x2c4/frame 0xfffffe0141780d40 kern_clock_nanosleep() at kern_clock_nanosleep+0x1c1/frame 0xfffffe0141780dc0 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe0141780e00 amd64_syscall() at amd64_syscall+0x15a/frame 0xfffffe0141780f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141780f30 --- syscall (240, FreeBSD ELF64, nanosleep), rip = 0x3aaead07f81a, rsp = 0x3aaeabf6ddf8, rbp = 0x3aaeabf6de60 --- Tracing command sleep pid 2317 tid 100362 td 0xfffffe01437d9900 sched_switch() at sched_switch+0x5a8/frame 0xfffffe014390ebc0 mi_switch() at mi_switch+0x175/frame 0xfffffe014390ebe0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe014390ec20 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014390ec70 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe014390ecb0 _sleep() at _sleep+0x2c4/frame 0xfffffe014390ed40 kern_clock_nanosleep() at kern_clock_nanosleep+0x1c1/frame 0xfffffe014390edc0 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe014390ee00 amd64_syscall() at amd64_syscall+0x15a/frame 0xfffffe014390ef30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014390ef30 --- syscall (240, FreeBSD ELF64, nanosleep), rip = 0x14c90352781a, rsp = 0x14c8ffbdf088, rbp = 0x14c8ffbdf0f0 --- Tracing command find pid 2382 tid 100297 td 0xfffffe01437da740 (CPU 2) kdb_enter() at kdb_enter+0x32/frame 0xfffffe01438a8840 vpanic() at vpanic+0x183/frame 0xfffffe01438a8890 panic() at panic+0x43/frame 0xfffffe01438a88f0 trap_fatal() at trap_fatal+0x409/frame 0xfffffe01438a8950 trap_pfault() at trap_pfault+0xab/frame 0xfffffe01438a89b0 calltrap() at calltrap+0x8/frame 0xfffffe01438a89b0 --- trap 0xc, rip = 0xffffffff82753417, rsp = 0xfffffe01438a8a80, rbp = 0xfffffe01438a8aa0 --- unionfs_root() at unionfs_root+0x17/frame 0xfffffe01438a8aa0 vfs_lookup() at vfs_lookup+0x92a/frame 0xfffffe01438a8b40 namei() at namei+0x340/frame 0xfffffe01438a8bc0 kern_statat() at kern_statat+0x12f/frame 0xfffffe01438a8d00 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe01438a8e00 amd64_syscall() at amd64_syscall+0x15a/frame 0xfffffe01438a8f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01438a8f30 --- syscall (552, FreeBSD ELF64, fstatat), rip = 0x1e9fa3f465fa, rsp = 0x1e9fa1989c98, rbp = 0x1e9fa1989db0 --- Tracing command find pid 2416 tid 100266 td 0xfffffe010e25e1e0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010db91780 mi_switch() at mi_switch+0x175/frame 0xfffffe010db917a0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db917e0 _sleep() at _sleep+0x2ef/frame 0xfffffe010db91870 bufwait() at bufwait+0x84/frame 0xfffffe010db918b0 breadn_flags() at breadn_flags+0x1cb/frame 0xfffffe010db91920 ffs_blkatoff() at ffs_blkatoff+0x83/frame 0xfffffe010db91990 ufs_readdir() at ufs_readdir+0x18f/frame 0xfffffe010db91b30 VOP_READDIR_APV() at VOP_READDIR_APV+0x5f/frame 0xfffffe010db91b60 unionfs_readdir() at unionfs_readdir+0x3d4/frame 0xfffffe010db91cb0 VOP_READDIR_APV() at VOP_READDIR_APV+0x5f/frame 0xfffffe010db91ce0 kern_getdirentries() at kern_getdirentries+0x1d7/frame 0xfffffe010db91dd0 sys_getdirentries() at sys_getdirentries+0x29/frame 0xfffffe010db91e00 amd64_syscall() at amd64_syscall+0x15a/frame 0xfffffe010db91f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010db91f30 --- syscall (554, FreeBSD ELF64, getdirentries), rip = 0x15aa0423e67a, rsp = 0x15aa012820b8, rbp = 0x15aa01282100 --- Tracing command mount_unionfs pid 2428 tid 100223 td 0xfffffe010e476720 sched_switch() at sched_switch+0x5a8/frame 0xfffffe01417994b0 mi_switch() at mi_switch+0x175/frame 0xfffffe01417994d0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0141799510 sleeplk() at sleeplk+0xff/frame 0xfffffe0141799570 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x407/frame 0xfffffe0141799620 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe0141799660 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe0141799680 _vn_lock() at _vn_lock+0x54/frame 0xfffffe01417996e0 vget_finish() at vget_finish+0x7a/frame 0xfffffe0141799710 cache_fplookup_final_child() at cache_fplookup_final_child+0x49/frame 0xfffffe0141799740 cache_fplookup() at cache_fplookup+0x7fe/frame 0xfffffe0141799830 namei() at namei+0x1eb/frame 0xfffffe01417998b0 unionfs_domount() at unionfs_domount+0x367/frame 0xfffffe0141799ac0 vfs_domount_first() at vfs_domount_first+0x25a/frame 0xfffffe0141799c00 vfs_domount() at vfs_domount+0x312/frame 0xfffffe0141799d20 vfs_donmount() at vfs_donmount+0x967/frame 0xfffffe0141799dc0 sys_nmount() at sys_nmount+0x69/frame 0xfffffe0141799e00 amd64_syscall() at amd64_syscall+0x15a/frame 0xfffffe0141799f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141799f30 --- syscall (378, FreeBSD ELF64, nmount), rip = 0x10d10e94f05a, rsp = 0x10d10dc61168, rbp = 0x10d10dc61af0 --- Tracing command egrep pid 2430 tid 100438 td 0xfffffe014359a740 sched_switch() at sched_switch+0x5a8/frame 0xfffffe015b530e90 mi_switch() at mi_switch+0x175/frame 0xfffffe015b530eb0 ast_scheduler() at ast_scheduler+0x45/frame 0xfffffe015b530ed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe015b530f10 ast() at ast+0x20/frame 0xfffffe015b530f30 doreti_ast() at doreti_ast+0x1c/frame 0x9bbc9de7820 Tracing command umount pid 2432 tid 100439 td 0xfffffe0150995e40 sched_switch() at sched_switch+0x5a8/frame 0xfffffe015b53fa50 mi_switch() at mi_switch+0x175/frame 0xfffffe015b53fa70 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe015b53fab0 sleeplk() at sleeplk+0xff/frame 0xfffffe015b53fb10 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x407/frame 0xfffffe015b53fbc0 ffs_lock() at ffs_lock+0x9d/frame 0xfffffe015b53fc00 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x3c/frame 0xfffffe015b53fc20 _vn_lock() at _vn_lock+0x54/frame 0xfffffe015b53fc80 dounmount() at dounmount+0x4a9/frame 0xfffffe015b53fcf0 kern_unmount() at kern_unmount+0x2e7/frame 0xfffffe015b53fe00 amd64_syscall() at amd64_syscall+0x15a/frame 0xfffffe015b53ff30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe015b53ff30 --- syscall (22, FreeBSD ELF64, unmount), rip = 0x34b40bea287a, rsp = 0x34b40a38d7c8, rbp = 0x34b40a38dd00 --- Tracing command sh pid 2434 tid 100359 td 0xfffffe01436bb000 fork_trampoline() at fork_trampoline Tracing command sh pid 2435 tid 100290 td 0xfffffe01437f1ac0 fork_trampoline() at fork_trampoline Tracing command dhclient pid 2621 tid 100231 td 0xfffffe010e25f020 sched_switch() at sched_switch+0x5a8/frame 0xfffffe01417b4ab0 mi_switch() at mi_switch+0x175/frame 0xfffffe01417b4ad0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01417b4b10 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01417b4b60 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01417b4b70 _cv_wait_sig() at _cv_wait_sig+0x164/frame 0xfffffe01417b4bd0 kern_select() at kern_select+0xa96/frame 0xfffffe01417b4dc0 sys_select() at sys_select+0x56/frame 0xfffffe01417b4e00 amd64_syscall() at amd64_syscall+0x15a/frame 0xfffffe01417b4f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01417b4f30 --- syscall (93, FreeBSD ELF64, select), rip = 0x318fe9e6899a, rsp = 0x318fe538db28, rbp = 0x318fe538dbe0 --- Tracing command dhclient pid 2624 tid 100249 td 0xfffffe01436ec020 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010dbc3ae0 mi_switch() at mi_switch+0x175/frame 0xfffffe010dbc3b00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010dbc3b40 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe010dbc3b90 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe010dbc3ba0 _cv_wait_sig() at _cv_wait_sig+0x164/frame 0xfffffe010dbc3c00 kern_poll_kfds() at kern_poll_kfds+0x4dc/frame 0xfffffe010dbc3c90 kern_poll() at kern_poll+0x9f/frame 0xfffffe010dbc3de0 sys_poll() at sys_poll+0x50/frame 0xfffffe010dbc3e00 amd64_syscall() at amd64_syscall+0x15a/frame 0xfffffe010dbc3f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010dbc3f30 --- syscall (209, FreeBSD ELF64, poll), rip = 0x318fe9e6889a, rsp = 0x318fe538dd68, rbp = 0x318fe538dda0 --- Tracing command dhclient pid 2683 tid 100296 td 0xfffffe010e7e31e0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe01438e4a90 mi_switch() at mi_switch+0x175/frame 0xfffffe01438e4ab0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01438e4af0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01438e4b40 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe01438e4b80 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x199/frame 0xfffffe01438e4c00 kern_poll_kfds() at kern_poll_kfds+0x4a9/frame 0xfffffe01438e4c90 kern_poll() at kern_poll+0x9f/frame 0xfffffe01438e4de0 sys_poll() at sys_poll+0x50/frame 0xfffffe01438e4e00 amd64_syscall() at amd64_syscall+0x15a/frame 0xfffffe01438e4f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01438e4f30 --- syscall (209, FreeBSD ELF64, poll), rip = 0x318fe9e6889a, rsp = 0x318fe538dd68, rbp = 0x318fe538dda0 --- Tracing command devd pid 2708 tid 100251 td 0xfffffe010d9c93a0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010dbcda60 mi_switch() at mi_switch+0x175/frame 0xfffffe010dbcda80 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010dbcdac0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe010dbcdb10 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe010dbcdb50 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x199/frame 0xfffffe010dbcdbd0 kern_select() at kern_select+0xa70/frame 0xfffffe010dbcddc0 sys_select() at sys_select+0x56/frame 0xfffffe010dbcde00 amd64_syscall() at amd64_syscall+0x15a/frame 0xfffffe010dbcdf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010dbcdf30 --- syscall (93, FreeBSD ELF64, select), rip = 0x331af3eb399a, rsp = 0x331aef0101c8, rbp = 0x331aef012360 --- Tracing command syslogd pid 2889 tid 100281 td 0xfffffe01437d6000 sched_switch() at sched_switch+0x5a8/frame 0xfffffe01438b2ab0 mi_switch() at mi_switch+0x175/frame 0xfffffe01438b2ad0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01438b2b10 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01438b2b60 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01438b2b70 _cv_wait_sig() at _cv_wait_sig+0x164/frame 0xfffffe01438b2bd0 kern_select() at kern_select+0xa96/frame 0xfffffe01438b2dc0 sys_select() at sys_select+0x56/frame 0xfffffe01438b2e00 amd64_syscall() at amd64_syscall+0x15a/frame 0xfffffe01438b2f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01438b2f30 --- syscall (93, FreeBSD ELF64, select), rip = 0x310c0cc8f99a, rsp = 0x310c09e50d58, rbp = 0x310c09e512d0 --- Tracing command watchdogd pid 2909 tid 100289 td 0xfffffe01437f13a0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe01438dabc0 mi_switch() at mi_switch+0x175/frame 0xfffffe01438dabe0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01438dac20 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01438dac70 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe01438dacb0 _sleep() at _sleep+0x2c4/frame 0xfffffe01438dad40 kern_clock_nanosleep() at kern_clock_nanosleep+0x1c1/frame 0xfffffe01438dadc0 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe01438dae00 amd64_syscall() at amd64_syscall+0x15a/frame 0xfffffe01438daf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01438daf30 --- syscall (240, FreeBSD ELF64, nanosleep), rip = 0x23f89d79081a, rsp = 0x23f89bc20ce8, rbp = 0x23f89bc20d30 --- Tracing command ntpd pid 2979 tid 100303 td 0xfffffe0143597c80 sched_switch() at sched_switch+0x5a8/frame 0xfffffe0143922ab0 mi_switch() at mi_switch+0x175/frame 0xfffffe0143922ad0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0143922b10 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0143922b60 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0143922b70 _cv_wait_sig() at _cv_wait_sig+0x164/frame 0xfffffe0143922bd0 kern_select() at kern_select+0xa96/frame 0xfffffe0143922dc0 sys_select() at sys_select+0x56/frame 0xfffffe0143922e00 amd64_syscall() at amd64_syscall+0x15a/frame 0xfffffe0143922f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0143922f30 --- syscall (93, FreeBSD ELF64, select), rip = 0x37947a32c99a, rsp = 0x37947672e428, rbp = 0x37947672e460 --- Tracing command powerd pid 2982 tid 100232 td 0xfffffe010e7e0720 sched_switch() at sched_switch+0x5a8/frame 0xfffffe0141762a60 mi_switch() at mi_switch+0x175/frame 0xfffffe0141762a80 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0141762ac0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0141762b10 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe0141762b50 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x199/frame 0xfffffe0141762bd0 kern_select() at kern_select+0xa70/frame 0xfffffe0141762dc0 sys_select() at sys_select+0x56/frame 0xfffffe0141762e00 amd64_syscall() at amd64_syscall+0x15a/frame 0xfffffe0141762f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141762f30 --- syscall (93, FreeBSD ELF64, select), rip = 0x3f9644899a, rsp = 0x3f9360be28, rbp = 0x3f9360bf60 --- Tracing command cron pid 2997 tid 100224 td 0xfffffe00e4d58560 --- swapped out Tracing command sshd pid 3015 tid 100243 td 0xfffffe010df0e720 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010db87ab0 mi_switch() at mi_switch+0x175/frame 0xfffffe010db87ad0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db87b10 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe010db87b60 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe010db87b70 _cv_wait_sig() at _cv_wait_sig+0x164/frame 0xfffffe010db87bd0 kern_poll_kfds() at kern_poll_kfds+0x4dc/frame 0xfffffe010db87c60 kern_poll() at kern_poll+0x9f/frame 0xfffffe010db87db0 sys_ppoll() at sys_ppoll+0x6f/frame 0xfffffe010db87e00 amd64_syscall() at amd64_syscall+0x15a/frame 0xfffffe010db87f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010db87f30 --- syscall (545, FreeBSD ELF64, ppoll), rip = 0x216cc63668ba, rsp = 0x216cbaeb8538, rbp = 0x216cbaeb8570 --- Tracing command inetd pid 3024 tid 100226 td 0xfffffe010e7e4020 sched_switch() at sched_switch+0x5a8/frame 0xfffffe014174eab0 mi_switch() at mi_switch+0x175/frame 0xfffffe014174ead0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe014174eb10 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014174eb60 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe014174eb70 _cv_wait_sig() at _cv_wait_sig+0x164/frame 0xfffffe014174ebd0 kern_select() at kern_select+0xa96/frame 0xfffffe014174edc0 sys_select() at sys_select+0x56/frame 0xfffffe014174ee00 amd64_syscall() at amd64_syscall+0x15a/frame 0xfffffe014174ef30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014174ef30 --- syscall (93, FreeBSD ELF64, select), rip = 0x11142103299a, rsp = 0x11141d8e5518, rbp = 0x11141d8e63a0 --- Tracing command getty pid 3034 tid 100209 td 0xfffffe010e477560 sched_switch() at sched_switch+0x5a8/frame 0xfffffe014175db00 mi_switch() at mi_switch+0x175/frame 0xfffffe014175db20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe014175db60 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014175dbb0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe014175dbc0 _cv_wait_sig() at _cv_wait_sig+0x164/frame 0xfffffe014175dc20 tty_wait() at tty_wait+0x42/frame 0xfffffe014175dc50 ttydisc_read() at ttydisc_read+0x208/frame 0xfffffe014175dcc0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe014175dcf0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe014175dd50 dofileread() at dofileread+0x83/frame 0xfffffe014175dd90 sys_read() at sys_read+0xc0/frame 0xfffffe014175de00 amd64_syscall() at amd64_syscall+0x15a/frame 0xfffffe014175df30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014175df30 --- syscall (3, FreeBSD ELF64, read), rip = 0x367253b7c91a, rsp = 0x3672506f8ba8, rbp = 0x3672506f8bf0 --- Tracing command getty pid 3035 tid 100302 td 0xfffffe01435983a0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe0143927b00 mi_switch() at mi_switch+0x175/frame 0xfffffe0143927b20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0143927b60 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0143927bb0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0143927bc0 _cv_wait_sig() at _cv_wait_sig+0x164/frame 0xfffffe0143927c20 tty_wait() at tty_wait+0x42/frame 0xfffffe0143927c50 ttydisc_read() at ttydisc_read+0x208/frame 0xfffffe0143927cc0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe0143927cf0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe0143927d50 dofileread() at dofileread+0x83/frame 0xfffffe0143927d90 sys_read() at sys_read+0xc0/frame 0xfffffe0143927e00 amd64_syscall() at amd64_syscall+0x15a/frame 0xfffffe0143927f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0143927f30 --- syscall (3, FreeBSD ELF64, read), rip = 0x1a8915b7791a, rsp = 0x1a8911b423a8, rbp = 0x1a8911b423f0 --- Tracing command getty pid 3036 tid 100222 td 0xfffffe00e4d963a0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe014178fb00 mi_switch() at mi_switch+0x175/frame 0xfffffe014178fb20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe014178fb60 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014178fbb0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe014178fbc0 _cv_wait_sig() at _cv_wait_sig+0x164/frame 0xfffffe014178fc20 tty_wait() at tty_wait+0x42/frame 0xfffffe014178fc50 ttydisc_read() at ttydisc_read+0x208/frame 0xfffffe014178fcc0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe014178fcf0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe014178fd50 dofileread() at dofileread+0x83/frame 0xfffffe014178fd90 sys_read() at sys_read+0xc0/frame 0xfffffe014178fe00 amd64_syscall() at amd64_syscall+0x15a/frame 0xfffffe014178ff30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014178ff30 --- syscall (3, FreeBSD ELF64, read), rip = 0xf61be09891a, rsp = 0xf61bc1a2898, rbp = 0xf61bc1a28e0 --- Tracing command getty pid 3037 tid 100238 td 0xfffffe010e25e900 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010db96b00 mi_switch() at mi_switch+0x175/frame 0xfffffe010db96b20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db96b60 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe010db96bb0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe010db96bc0 _cv_wait_sig() at _cv_wait_sig+0x164/frame 0xfffffe010db96c20 tty_wait() at tty_wait+0x42/frame 0xfffffe010db96c50 ttydisc_read() at ttydisc_read+0x208/frame 0xfffffe010db96cc0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe010db96cf0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe010db96d50 dofileread() at dofileread+0x83/frame 0xfffffe010db96d90 sys_read() at sys_read+0xc0/frame 0xfffffe010db96e00 amd64_syscall() at amd64_syscall+0x15a/frame 0xfffffe010db96f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010db96f30 --- syscall (3, FreeBSD ELF64, read), rip = 0x38c6e70ec91a, rsp = 0x38c6e4052938, rbp = 0x38c6e4052980 --- Tracing command getty pid 3038 tid 100234 td 0xfffffe010e476e40 sched_switch() at sched_switch+0x5a8/frame 0xfffffe0141758b00 mi_switch() at mi_switch+0x175/frame 0xfffffe0141758b20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0141758b60 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0141758bb0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0141758bc0 _cv_wait_sig() at _cv_wait_sig+0x164/frame 0xfffffe0141758c20 tty_wait() at tty_wait+0x42/frame 0xfffffe0141758c50 ttydisc_read() at ttydisc_read+0x208/frame 0xfffffe0141758cc0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe0141758cf0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe0141758d50 dofileread() at dofileread+0x83/frame 0xfffffe0141758d90 sys_read() at sys_read+0xc0/frame 0xfffffe0141758e00 amd64_syscall() at amd64_syscall+0x15a/frame 0xfffffe0141758f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141758f30 --- syscall (3, FreeBSD ELF64, read), rip = 0x1efe5d4e791a, rsp = 0x1efe5b492ab8, rbp = 0x1efe5b492b00 --- Tracing command getty pid 3039 tid 100237 td 0xfffffe010df0ee40 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010db8cb00 mi_switch() at mi_switch+0x175/frame 0xfffffe010db8cb20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db8cb60 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe010db8cbb0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe010db8cbc0 _cv_wait_sig() at _cv_wait_sig+0x164/frame 0xfffffe010db8cc20 tty_wait() at tty_wait+0x42/frame 0xfffffe010db8cc50 ttydisc_read() at ttydisc_read+0x208/frame 0xfffffe010db8ccc0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe010db8ccf0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe010db8cd50 dofileread() at dofileread+0x83/frame 0xfffffe010db8cd90 sys_read() at sys_read+0xc0/frame 0xfffffe010db8ce00 amd64_syscall() at amd64_syscall+0x15a/frame 0xfffffe010db8cf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010db8cf30 --- syscall (3, FreeBSD ELF64, read), rip = 0x374776af291a, rsp = 0x374774637cf8, rbp = 0x374774637d40 --- Tracing command getty pid 3040 tid 100236 td 0xfffffe01436bcc80 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010db82b00 mi_switch() at mi_switch+0x175/frame 0xfffffe010db82b20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db82b60 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe010db82bb0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe010db82bc0 _cv_wait_sig() at _cv_wait_sig+0x164/frame 0xfffffe010db82c20 tty_wait() at tty_wait+0x42/frame 0xfffffe010db82c50 ttydisc_read() at ttydisc_read+0x208/frame 0xfffffe010db82cc0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe010db82cf0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe010db82d50 dofileread() at dofileread+0x83/frame 0xfffffe010db82d90 sys_read() at sys_read+0xc0/frame 0xfffffe010db82e00 amd64_syscall() at amd64_syscall+0x15a/frame 0xfffffe010db82f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010db82f30 --- syscall (3, FreeBSD ELF64, read), rip = 0x32a486f3f91a, rsp = 0x32a483cb7c08, rbp = 0x32a483cb7c50 --- Tracing command getty pid 3041 tid 100308 td 0xfffffe01436e9c80 sched_switch() at sched_switch+0x5a8/frame 0xfffffe01438d5b00 mi_switch() at mi_switch+0x175/frame 0xfffffe01438d5b20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01438d5b60 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01438d5bb0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01438d5bc0 _cv_wait_sig() at _cv_wait_sig+0x164/frame 0xfffffe01438d5c20 tty_wait() at tty_wait+0x42/frame 0xfffffe01438d5c50 ttydisc_read() at ttydisc_read+0x208/frame 0xfffffe01438d5cc0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe01438d5cf0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe01438d5d50 dofileread() at dofileread+0x83/frame 0xfffffe01438d5d90 sys_read() at sys_read+0xc0/frame 0xfffffe01438d5e00 amd64_syscall() at amd64_syscall+0x15a/frame 0xfffffe01438d5f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01438d5f30 --- syscall (3, FreeBSD ELF64, read), rip = 0xcc8afb491a, rsp = 0xcc880bf028, rbp = 0xcc880bf070 --- Tracing command getty pid 3042 tid 100309 td 0xfffffe00e4d57000 sched_switch() at sched_switch+0x5a8/frame 0xfffffe0143945b00 mi_switch() at mi_switch+0x175/frame 0xfffffe0143945b20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0143945b60 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0143945bb0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0143945bc0 _cv_wait_sig() at _cv_wait_sig+0x164/frame 0xfffffe0143945c20 tty_wait() at tty_wait+0x42/frame 0xfffffe0143945c50 ttydisc_read() at ttydisc_read+0x208/frame 0xfffffe0143945cc0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe0143945cf0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe0143945d50 dofileread() at dofileread+0x83/frame 0xfffffe0143945d90 sys_read() at sys_read+0xc0/frame 0xfffffe0143945e00 amd64_syscall() at amd64_syscall+0x15a/frame 0xfffffe0143945f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0143945f30 --- syscall (3, FreeBSD ELF64, read), rip = 0xf84bc3b91a, rsp = 0xf84976bc58, rbp = 0xf84976bca0 --- Tracing command getty pid 3043 tid 100310 td 0xfffffe00e4d46740 sched_switch() at sched_switch+0x5a8/frame 0xfffffe0143940b00 mi_switch() at mi_switch+0x175/frame 0xfffffe0143940b20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0143940b60 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0143940bb0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0143940bc0 _cv_wait_sig() at _cv_wait_sig+0x164/frame 0xfffffe0143940c20 tty_wait() at tty_wait+0x42/frame 0xfffffe0143940c50 ttydisc_read() at ttydisc_read+0x208/frame 0xfffffe0143940cc0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe0143940cf0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe0143940d50 dofileread() at dofileread+0x83/frame 0xfffffe0143940d90 sys_read() at sys_read+0xc0/frame 0xfffffe0143940e00 amd64_syscall() at amd64_syscall+0x15a/frame 0xfffffe0143940f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0143940f30 --- syscall (3, FreeBSD ELF64, read), rip = 0x23ab8c3b491a, rsp = 0x23ab88ddcfd8, rbp = 0x23ab88ddd020 --- Tracing command sshd pid 3044 tid 100227 td 0xfffffe00e4d57720 sched_switch() at sched_switch+0x5a8/frame 0xfffffe014179eae0 mi_switch() at mi_switch+0x175/frame 0xfffffe014179eb00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe014179eb40 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014179eb90 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe014179eba0 _cv_wait_sig() at _cv_wait_sig+0x164/frame 0xfffffe014179ec00 kern_poll_kfds() at kern_poll_kfds+0x4dc/frame 0xfffffe014179ec90 kern_poll() at kern_poll+0x9f/frame 0xfffffe014179ede0 sys_poll() at sys_poll+0x50/frame 0xfffffe014179ee00 amd64_syscall() at amd64_syscall+0x15a/frame 0xfffffe014179ef30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014179ef30 --- syscall (209, FreeBSD ELF64, poll), rip = 0x2ec669f7989a, rsp = 0x2ec662049be8, rbp = 0x2ec662049c20 --- Tracing command sshd pid 3047 tid 100220 td 0xfffffe010e360000 sched_switch() at sched_switch+0x5a8/frame 0xfffffe010db1fab0 mi_switch() at mi_switch+0x175/frame 0xfffffe010db1fad0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db1fb10 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe010db1fb60 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe010db1fb70 _cv_wait_sig() at _cv_wait_sig+0x164/frame 0xfffffe010db1fbd0 kern_poll_kfds() at kern_poll_kfds+0x4dc/frame 0xfffffe010db1fc60 kern_poll() at kern_poll+0x9f/frame 0xfffffe010db1fdb0 sys_ppoll() at sys_ppoll+0x6f/frame 0xfffffe010db1fe00 amd64_syscall() at amd64_syscall+0x15a/frame 0xfffffe010db1ff30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010db1ff30 --- syscall (545, FreeBSD ELF64, ppoll), rip = 0x2ec669f798ba, rsp = 0x2ec6620499a8, rbp = 0x2ec6620499e0 --- Tracing command bash pid 3048 tid 100217 td 0xfffffe010e7e4740 --- swapped out Tracing command su pid 3054 tid 100300 td 0xfffffe01436ea3a0 --- swapped out Tracing command csh pid 3055 tid 100305 td 0xfffffe0143596e40 --- swapped out Tracing command bash pid 3057 tid 100210 td 0xfffffe010e7e0e40 --- swapped out Tracing command sh pid 3125 tid 100311 td 0xfffffe0143596720 --- swapped out Tracing command sh pid 3210 tid 100301 td 0xfffffe01436ec740 --- swapped out Tracing command sh pid 3259 tid 100298 td 0xfffffe01437da020 --- swapped out Tracing command awk pid 3260 tid 100307 td 0xfffffe01436be1e0 sched_switch() at sched_switch+0x5a8/frame 0xfffffe0143936b90 mi_switch() at mi_switch+0x175/frame 0xfffffe0143936bb0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0143936bf0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0143936c40 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0143936c50 _sleep() at _sleep+0x2e5/frame 0xfffffe0143936ce0 pipe_read() at pipe_read+0x42a/frame 0xfffffe0143936d50 dofileread() at dofileread+0x83/frame 0xfffffe0143936d90 sys_read() at sys_read+0xc0/frame 0xfffffe0143936e00 amd64_syscall() at amd64_syscall+0x15a/frame 0xfffffe0143936f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0143936f30 --- syscall (3, FreeBSD ELF64, read), rip = 0x1aab7cb4b91a, rsp = 0x1aab78e86d58, rbp = 0x1aab78e86d70 --- Tracing command sh pid 3262 tid 100360 td 0xfffffe015099a720 sched_switch() at sched_switch+0x5a8/frame 0xfffffe01439c7b90 mi_switch() at mi_switch+0x175/frame 0xfffffe01439c7bb0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01439c7bf0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01439c7c40 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01439c7c50 _sleep() at _sleep+0x2e5/frame 0xfffffe01439c7ce0 pipe_read() at pipe_read+0x42a/frame 0xfffffe01439c7d50 dofileread() at dofileread+0x83/frame 0xfffffe01439c7d90 sys_read() at sys_read+0xc0/frame 0xfffffe01439c7e00 amd64_syscall() at amd64_syscall+0x15a/frame 0xfffffe01439c7f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01439c7f30 --- syscall (3, FreeBSD ELF64, read), rip = 0x10e2ca02191a, rsp = 0x10e2c7c4b5a8, rbp = 0x10e2c7c4bad0 --- db> (kgdb) bt #0 __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:59 #1 doadump (textdump=textdump@entry=0x0) at ../../../kern/kern_shutdown.c:407 #2 0xffffffff804b476a in db_dump (dummy=, dummy2=, dummy3=, dummy4=) at ../../../ddb/db_command.c:593 #3 0xffffffff804b456d in db_command (last_cmdp=, cmd_table=, dopager=0x0) at ../../../ddb/db_command.c:506 #4 0xffffffff804b46b6 in db_command_script (command=command@entry=0xffffffff81bda7d0 "dump") at ../../../ddb/db_command.c:571 #5 0xffffffff804b9a28 in db_script_exec (scriptname=0xffffffff81bda140 "dump", warnifnotfound=) at ../../../ddb/db_script.c:304 #6 0xffffffff804b456d in db_command (last_cmdp=, cmd_table=, dopager=0x0) at ../../../ddb/db_command.c:506 #7 0xffffffff804b46b6 in db_command_script (command=command@entry=0xffffffff81bda762 "run pho1") at ../../../ddb/db_command.c:571 #8 0xffffffff804b9a28 in db_script_exec (scriptname=0xffffffff81bda140 "dump", warnifnotfound=) at ../../../ddb/db_script.c:304 #9 0xffffffff804b456d in db_command (last_cmdp=, cmd_table=, dopager=0x1) at ../../../ddb/db_command.c:506 #10 0xffffffff804b423d in db_command_loop () at ../../../ddb/db_command.c:553 #11 0xffffffff804b78f6 in db_trap (type=, code=) at ../../../ddb/db_main.c:270 #12 0xffffffff80c410ce in kdb_trap (type=type@entry=0x3, code=code@entry=0x0, tf=tf@entry=0xfffffe01438a8780) at ../../../kern/subr_kdb.c:745 #13 0xffffffff810ed726 in trap (frame=0xfffffe01438a8780) at ../../../amd64/amd64/trap.c:610 #14 #15 kdb_enter (why=, msg=) at ../../../kern/subr_kdb.c:509 #16 0xffffffff80bf2143 in vpanic (fmt=, ap=ap@entry=0xfffffe01438a88d0) at ../../../kern/kern_shutdown.c:960 #17 0xffffffff80bf1f03 in panic (fmt=0xffffffff81e853f0 "\365s\036\201\377\377\377\377") at ../../../kern/kern_shutdown.c:896 #18 0xffffffff810edbb9 in trap_fatal (frame=0xfffffe01438a89c0, eva=0x10) at ../../../amd64/amd64/trap.c:954 #19 0xffffffff810edc6b in trap_pfault (frame=0xfffffe01438a89c0, usermode=0x0, signo=, ucode=) at ../../../amd64/amd64/trap.c:762 #20 #21 unionfs_root (mp=0xfffffe015b22d700, flags=0x82000, vpp=0xfffffe01438a8ad8) at /usr/src/sys/fs/unionfs/union_vfsops.c:407 #22 0xffffffff80cd778a in vfs_lookup (ndp=ndp@entry=0xfffffe01438a8bd8) at ../../../kern/vfs_lookup.c:1295 #23 0xffffffff80cd65d0 in namei (ndp=ndp@entry=0xfffffe01438a8bd8) at ../../../kern/vfs_lookup.c:667 #24 0xffffffff80cf83af in kern_statat (td=0xfffffe01437da740, flag=, fd=0xffffff9c, path=0x1e9fa4e3a2f8 , pathseg=pathseg@entry=UIO_USERSPACE, sbp=sbp@entry=0xfffffe01438a8d18, hook=0x0) at ../../../kern/vfs_syscalls.c:2444 #25 0xffffffff80cf8aff in sys_fstatat (td=0xfffffe015b22d700, uap=0xfffffe01437dab38) at ../../../kern/vfs_syscalls.c:2421 #26 0xffffffff810ee59a in syscallenter (td=0xfffffe01437da740) at ../../../amd64/amd64/../../kern/subr_syscall.c:190 #27 amd64_syscall (td=0xfffffe01437da740, traced=0x0) at ../../../amd64/amd64/trap.c:1199 #28 #29 0x00001e9fa3f465fa in ?? () Backtrace stopped: Cannot access memory at address 0x1e9fa1989c98 (kgdb) f 21 #21 unionfs_root (mp=0xfffffe015b22d700, flags=0x82000, vpp=0xfffffe01438a8ad8) at /usr/src/sys/fs/unionfs/union_vfsops.c:407 407 vp = ump->um_rootvp; (kgdb) l 402 { 403 struct unionfs_mount *ump; 404 struct vnode *vp; 405 406 ump = MOUNTTOUNIONFSMOUNT(mp); 407 vp = ump->um_rootvp; 408 409 UNIONFSDEBUG("unionfs_root: rootvp=%p locked=%x\n", 410 vp, VOP_ISLOCKED(vp)); 411 (kgdb) inf loc ump = 0x0 vp = (kgdb) f 22 #22 0xffffffff80cd778a in vfs_lookup (ndp=ndp@entry=0xfffffe01438a8bd8) at ../../../kern/vfs_lookup.c:1295 1295 error = VFS_ROOT(mp, crosslkflags, &tdp); (kgdb) l 1290 vput(ndp->ni_dvp); 1291 else 1292 vrele(ndp->ni_dvp); 1293 vrefact(vp_crossmp); 1294 ndp->ni_dvp = vp_crossmp; 1295 error = VFS_ROOT(mp, crosslkflags, &tdp); 1296 vfs_unbusy(mp); 1297 if (__predict_false(crosslock)) 1298 vput(dp); 1299 if (vn_lock(vp_crossmp, LK_SHARED | LK_NOWAIT)) (kgdb) info loc _rc = dp = 0xfffffe01599802c0 error = dpunlocked = 0x0 relookup = 0x0 cnp = 0xfffffe01438a8c58 ni_dvp_unlocked = 0x0 wantparent = 0x0 docache = 0x1 lastchar = nulchar = cp = prev_ni_pathlen = 0x6 prev_ni_next = 0xfffff8070f1b6406 "" lkflags_save = tdp = 0xfffff8070f1b6401 pr = mp = 0xfffffe015b22d700 crosslkflags = rdonly = crosslock = (kgdb) p *mp $1 = {mnt_vfs_ops = 0x1, mnt_kern_flag = 0x0, mnt_flag = 0x0, mnt_pcpu = 0xfffffe018b521f70, mnt_rootvnode = 0x0, mnt_vnodecovered = 0xfffffe01599802c0, mnt_op = 0xffffffff8275a3e8 , mnt_vfc = 0xffffffff8275a398 , mnt_mtx = { lock_object = {lo_name = 0xffffffff811cf9eb "struct mount mtx", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xfffff8087fd75b00}, mtx_lock = 0x0}, mnt_gen = 0x3e1, mnt_list = {tqe_next = 0x0, tqe_prev = 0x0}, mnt_syncer = 0x0, mnt_ref = 0x2, mnt_nvnodelist = { tqh_first = 0x0, tqh_last = 0xfffffe015b22d788}, mnt_nvnodelistsize = 0x0, mnt_writeopcount = 0x0, mnt_opt = 0x0, mnt_optnew = 0xfffff800043ca150, mnt_stat = {f_version = 0x0, f_type = 0x41, f_flags = 0x0, f_bsize = 0x0, f_iosize = 0x0, f_blocks = 0x0, f_bfree = 0x0, f_bavail = 0x0, f_files = 0x0, f_ffree = 0x0, f_syncwrites = 0x0, f_asyncwrites = 0x0, f_syncreads = 0x0, f_asyncreads = 0x0, f_nvnodelistsize = 0x0, f_spare0 = 0x0, f_spare = {0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0}, f_namemax = 0x0, f_owner = 0x0, f_fsid = {val = { 0x0, 0x0}}, f_charspare = '\000' , f_fstypename = "unionfs\000\000\000\000\000\000\000\000", f_mntfromname = '\000' , f_mntonname = "/mnt12", '\000' }, mnt_cred = 0xfffff800060c2c00, mnt_data = 0x0, mnt_time = 0x0, mnt_iosize_max = 0x10000, mnt_export = 0x0, mnt_label = 0x0, mnt_hashseed = 0xd553c550, mnt_lockref = 0x2, mnt_secondary_writes = 0x0, mnt_secondary_accwrites = 0x0, mnt_susp_owner = 0x0, mnt_exjail = 0x0, mnt_gjprovider = 0x0, mnt_listmtx = { lock_object = {lo_name = 0xffffffff81271ce3 "struct mount vlist mtx", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xfffff8087fd83f00}, mtx_lock = 0x0}, mnt_lazyvnodelist = {tqh_first = 0x0, tqh_last = 0xfffffe015b22e150}, mnt_lazyvnodelistsize = 0x0, mnt_upper_pending = 0x0, mnt_explock = {lock_object = {lo_name = 0xffffffff813050a4 "explock", lo_flags = 0x6730000, lo_data = 0x0, lo_witness = 0xfffff8087fd83d00}, lk_lock = 0x1, lk_exslpfail = 0x0, lk_pri = 0x40, lk_timo = 0x0, lk_stack = {depth = 0x0, pcs = {0x0 }}}, mnt_uppers = { tqh_first = 0x0, tqh_last = 0xfffffe015b22e228}, mnt_notify = {tqh_first = 0x0, tqh_last = 0xfffffe015b22e238}, mnt_taskqueue_link = { stqe_next = 0x0}, mnt_taskqueue_flags = 0x0, mnt_unmount_retries = 0x0} (kgdb) p *tdp $2 = {v_type = 109, v_state = 110, v_irflag = 0x3174, v_seqc = 0xdede0032, v_nchash = 0xdedeadc0, v_hash = 0xdedeadc0, v_op = 0xdedeadc0dedeadc0, v_data = 0xdedeadc0dedeadc0, v_mount = 0xdedeadc0dedeadc0, v_nmntvnodes = {tqe_next = 0xdedeadc0dedeadc0, tqe_prev = 0xdedeadc0dedeadc0}, { v_mountedhere = 0xdedeadc0dedeadc0, v_unpcb = 0xdedeadc0dedeadc0, v_rdev = 0xdedeadc0dedeadc0, v_fifoinfo = 0xdedeadc0dedeadc0}, v_hashlist = { le_next = 0xdedeadc0dedeadc0, le_prev = 0xdedeadc0dedeadc0}, v_cache_src = {lh_first = 0xdedeadc0dedeadc0}, v_cache_dst = { tqh_first = 0xdedeadc0dedeadc0, tqh_last = 0xdedeadc0dedeadc0}, v_cache_dd = 0xdedeadc0dedeadc0, v_lock = {lock_object = { lo_name = 0xdedeadc0dedeadc0 , lo_flags = 0xdedeadc0, lo_data = 0xdedeadc0, lo_witness = 0xdedeadc0dedeadc0}, lk_lock = 0xdedeadc0dedeadc0, lk_exslpfail = 0xadc0, lk_pri = 0xdede, lk_timo = 0xdedeadc0, lk_stack = { depth = 0xdedeadc0, pcs = {0xdedeadc0dedeadc0 }}}, v_interlock = {lock_object = { lo_name = 0xdedeadc0dedeadc0 , lo_flags = 0xdedeadc0, lo_data = 0xdedeadc0, lo_witness = 0xdedeadc0dedeadc0}, mtx_lock = 0xdedeadc0dedeadc0}, v_vnlock = 0xdedeadc0dedeadc0, v_vnodelist = {tqe_next = 0xdedeadc0dedeadc0, tqe_prev = 0xdedeadc0dedeadc0}, v_lazylist = {tqe_next = 0xdedeadc0dedeadc0, tqe_prev = 0xdedeadc0dedeadc0}, v_bufobj = {bo_lock = { lock_object = {lo_name = 0xdedeadc0dedeadc0 , lo_flags = 0xdedeadc0, lo_data = 0xdedeadc0, lo_witness = 0xdedeadc0dedeadc0}, rw_lock = 0xdedeadc0dedeadc0}, bo_ops = 0xdedeadc0dedeadc0, bo_object = 0xdedeadc0dedeadc0, bo_synclist = {le_next = 0xdedeadc0dedeadc0, le_prev = 0xdedeadc0dedeadc0}, bo_private = 0xdedeadc0dedeadc0, bo_clean = {bv_hd = {tqh_first = 0xdedeadc0dedeadc0, tqh_last = 0xdedeadc0dedeadc0}, bv_root = {pt_root = 0xdedeadc0dedeadc0}, bv_cnt = 0xdedeadc0}, bo_dirty = {bv_hd = {tqh_first = 0xdedeadc0dedeadc0, tqh_last = 0xdedeadc0dedeadc0}, bv_root = { pt_root = 0xdedeadc0dedeadc0}, bv_cnt = 0xdedeadc0}, bo_numoutput = 0xdedeadc0, bo_flag = 0xdedeadc0, bo_domain = 0xdedeadc0, bo_bsize = 0xdedeadc0}, v_pollinfo = 0xdedeadc0dedeadc0, v_label = 0xdedeadc0dedeadc0, v_lockf = 0xdedeadc0dedeadc0, v_rl = {rl_waiters = { tqh_first = 0xdedeadc0dedeadc0, tqh_last = 0xdedeadc0dedeadc0}, rl_currdep = 0xdedeadc0dedeadc0}, v_holdcnt = 0xdedeadc0, v_usecount = 0xdedeadc0, v_iflag = 0xadc0, v_vflag = 0xdede, v_mflag = 0xadc0, v_dbatchcpu = 0xdede, v_writecount = 0xdedeadc0, v_seqc_users = 0xdedeadc0} (kgdb) diff --git a/sys/fs/unionfs/union_vnops.c b/sys/fs/unionfs/union_vnops.c index 04d7889598927..2f45a5bb0e52e 100644 --- a/sys/fs/unionfs/union_vnops.c +++ b/sys/fs/unionfs/union_vnops.c @@ -628,7 +628,7 @@ unionfs_close(struct vop_close_args *ap) if (unsp->uns_lower_opencnt <= 0 && unsp->uns_upper_opencnt <= 0) { #ifdef DIAGNOSTIC - printf("unionfs_close: warning: open count is 0\n"); +// printf("unionfs_close: warning: open count is 0\n"); #endif if (unp->un_uppervp != NULLVP) ovp = unp->un_uppervp; @@ -1389,6 +1389,7 @@ unionfs_mkdir(struct vop_mkdir_args *ap) { struct unionfs_node *dunp; struct componentname *cnp; + struct vnode *dvp; struct vnode *udvp; struct vnode *uvp; struct vattr va; @@ -1400,17 +1401,19 @@ unionfs_mkdir(struct vop_mkdir_args *ap) KASSERT_UNIONFS_VNODE(ap->a_dvp); error = EROFS; - dunp = VTOUNIONFS(ap->a_dvp); + dvp = ap->a_dvp; + dunp = VTOUNIONFS(dvp); cnp = ap->a_cnp; lkflags = cnp->cn_lkflags; udvp = dunp->un_uppervp; if (udvp != NULLVP) { + vref(udvp); /* check opaque */ if (!(cnp->cn_flags & ISWHITEOUT)) { error = VOP_GETATTR(udvp, &va, cnp->cn_cred); if (error != 0) - return (error); + goto unionfs_mkdir_cleanup; if ((va.va_flags & OPAQUE) != 0) cnp->cn_flags |= ISWHITEOUT; } @@ -1418,13 +1421,35 @@ unionfs_mkdir(struct vop_mkdir_args *ap) if ((error = VOP_MKDIR(udvp, &uvp, cnp, ap->a_vap)) == 0) { VOP_UNLOCK(uvp); cnp->cn_lkflags = LK_EXCLUSIVE; - error = unionfs_nodeget(ap->a_dvp->v_mount, uvp, NULLVP, - ap->a_dvp, ap->a_vpp, cnp); + /* + * The underlying VOP_MKDIR() implementation may have + * temporarily dropped the parent directory vnode lock. + * Because the unionfs vnode ordinarily shares that + * lock, this may allow the unionfs vnode to be reclaimed + * and its lock field reset. In that case, the unionfs + * vnode is effectively no longer locked, and we must + * explicitly lock it before returning in order to meet + * the locking requirements of VOP_MKDIR(). + */ + if (__predict_false(VTOUNIONFS(dvp) == NULL)) { + error = ENOENT; + goto unionfs_mkdir_cleanup; + } + error = unionfs_nodeget(dvp->v_mount, uvp, NULLVP, + dvp, ap->a_vpp, cnp); cnp->cn_lkflags = lkflags; vrele(uvp); } } +unionfs_mkdir_cleanup: + + if (__predict_false(VTOUNIONFS(dvp) == NULL)) { + vput(udvp); + vn_lock(dvp, LK_EXCLUSIVE | LK_RETRY); + } else if (udvp != NULLVP) + vrele(udvp); + UNIONFS_INTERNAL_DEBUG("unionfs_mkdir: leave (%d)\n", error); return (error); @@ -1852,24 +1877,6 @@ unionfs_print(struct vop_print_args *ap) return (0); } -static int -unionfs_islocked(struct vop_islocked_args *ap) -{ - struct unionfs_node *unp; - - KASSERT_UNIONFS_VNODE(ap->a_vp); - - unp = VTOUNIONFS(ap->a_vp); - if (unp == NULL) - return (vop_stdislocked(ap)); - - if (unp->un_uppervp != NULLVP) - return (VOP_ISLOCKED(unp->un_uppervp)); - if (unp->un_lowervp != NULLVP) - return (VOP_ISLOCKED(unp->un_lowervp)); - return (vop_stdislocked(ap)); -} - static int unionfs_get_llt_revlock(struct vnode *vp, int flags) { @@ -1982,14 +1989,6 @@ unionfs_lock(struct vop_lock1_args *ap) vholdnz(uvp); uhold = 1; VOP_UNLOCK(uvp); - unp = VTOUNIONFS(vp); - if (unp == NULL) { - /* vnode is released. */ - VI_UNLOCK(vp); - VOP_UNLOCK(lvp); - vdrop(uvp); - return (EBUSY); - } } VI_LOCK_FLAGS(lvp, MTX_DUPOK); flags |= LK_INTERLOCK; @@ -2010,7 +2009,7 @@ unionfs_lock(struct vop_lock1_args *ap) vdrop(lvp); if (uhold != 0) vdrop(uvp); - return (vop_stdlock(ap)); + goto unionfs_lock_fallback; } } @@ -2043,7 +2042,7 @@ unionfs_lock(struct vop_lock1_args *ap) VOP_UNLOCK(lvp); vdrop(lvp); } - return (vop_stdlock(ap)); + goto unionfs_lock_fallback; } if (error != 0 && lvp != NULLVP) { /* rollback */ @@ -2065,6 +2064,22 @@ unionfs_lock(struct vop_lock1_args *ap) unionfs_lock_null_vnode: ap->a_flags |= LK_INTERLOCK; return (vop_stdlock(ap)); + +unionfs_lock_fallback: + /* + * If we reach this point, we've discovered the unionfs vnode + * has been reclaimed while the upper/lower vnode locks were + * temporarily dropped. Such temporary droppage may happen + * during the course of an LK_UPGRADE operation itself, and in + * that case LK_UPGRADE must be cleared as the unionfs vnode's + * lock has been reset to point to the standard v_lock field, + * which has not previously been held. + */ + if (flags & LK_UPGRADE) { + ap->a_flags &= ~LK_TYPE_MASK; + ap->a_flags |= LK_EXCLUSIVE; + } + return (vop_stdlock(ap)); } static int @@ -2782,7 +2797,7 @@ struct vop_vector unionfs_vnodeops = { .vop_getwritemount = unionfs_getwritemount, .vop_inactive = unionfs_inactive, .vop_need_inactive = vop_stdneed_inactive, - .vop_islocked = unionfs_islocked, + .vop_islocked = vop_stdislocked, .vop_ioctl = unionfs_ioctl, .vop_link = unionfs_link, .vop_listextattr = unionfs_listextattr, diff --git a/tools/test/stress2/misc/all.exclude b/tools/test/stress2/misc/all.exclude index 022075e63cb48..9ddeffc200a23 100644 --- a/tools/test/stress2/misc/all.exclude +++ b/tools/test/stress2/misc/all.exclude @@ -75,7 +75,7 @@ syzkaller55.sh panic: Counter goes negative 20220525 syzkaller59.sh Page fault 20220625 syzkaller65.sh Waiting for fix 20230318 truss3.sh WiP 20200915 -unionfs9.sh https://people.freebsd.org/~pho/stress/log/log0404.txt 20230110 +Xunionfs9.sh https://people.freebsd.org/~pho/stress/log/log0404.txt 20230110 # Test not to run for other reasons: -- Test scenario: misc/unionfs9.sh