panic: swap_pager_swapoff_object: read from swap failed: 4, vmcore.561 KDB: debugger backends: ddb KDB: current backend: ddb ---<>--- Copyright (c) 1992-2022 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 14.0-CURRENT #0 main-n255396-356155fe02379-dirty: Mon May 9 19:56:33 CEST 2022 pho@mercat1.netperf.freebsd.org:/usr/src/sys/amd64/compile/PHO amd64 FreeBSD clang version 13.0.0 (git@github.com:llvm/llvm-project.git llvmorg-13.0.0-0-gd7b669b3a303) WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. VT(vga): resolution 640x480 CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.18-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics real memory = 34359738368 (32768 MB) avail memory = 33176526848 (31639 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 12 CPUs FreeBSD/SMP: 1 package(s) x 6 core(s) x 2 hardware threads random: registering fast source Intel Secure Key RNG random: fast provider: "Intel Secure Key RNG" random: unblocking device. ioapic0 irqs 0-23 ioapic1 irqs 24-47 Launching APs: 1 6 8 4 3 2 7 11 10 5 9 random: entropy device external interface kbd1 at kbdmux0 vtvga0: smbios0: at iomem 0xf0560-0xf057e smbios0: Version: 2.8, BCD Revision: 2.7 aesni0: acpi0: acpi0: Power Button (fixed) cpu0: on acpi0 atrtc0: port 0x70-0x71,0x74-0x77 irq 8 on acpi0 atrtc0: registered as a time-of-day clock, resolution 1.000000s Event timer "RTC" frequency 32768 Hz quality 0 attimer0: port 0x40-0x43,0x50-0x53 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Event timer "HPET" frequency 14318180 Hz quality 350 Event timer "HPET1" frequency 14318180 Hz quality 340 Event timer "HPET2" frequency 14318180 Hz quality 340 Event timer "HPET3" frequency 14318180 Hz quality 340 Event timer "HPET4" frequency 14318180 Hz quality 340 Event timer "HPET5" frequency 14318180 Hz quality 340 Event timer "HPET6" frequency 14318180 Hz quality 340 Event timer "HPET7" frequency 14318180 Hz quality 340 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 pcib0: on acpi0 pci0: on pcib0 pci0: at device 11.1 (no driver attached) pci0: at device 11.2 (no driver attached) pci0: at device 16.1 (no driver attached) pci0: at device 16.6 (no driver attached) pci0: at device 18.1 (no driver attached) acpi_syscontainer0: on acpi0 acpi_syscontainer1: on acpi0 acpi_syscontainer2: on acpi0 acpi_syscontainer3: on acpi0 apei0: on acpi0 pcib1: port 0xcf8-0xcff on acpi0 pci1: on pcib1 pcib2: irq 26 at device 1.0 on pci1 pci2: on pcib2 pcib3: irq 32 at device 2.0 on pci1 pci3: on pcib3 pci3: at device 0.0 (no driver attached) pci3: at device 0.1 (no driver attached) pcib4: irq 40 at device 3.0 on pci1 pci4: on pcib4 pci1: at device 17.0 (no driver attached) ahci0: port 0xf110-0xf117,0xf100-0xf103,0xf0f0-0xf0f7,0xf0e0-0xf0e3,0xf020-0xf03f mem 0xfb438000-0xfb4387ff irq 16 at device 17.4 on pci1 ahci0: AHCI v1.30 with 4 6Gbps ports, Port Multiplier not supported ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahcich2: at channel 2 on ahci0 ahcich3: at channel 3 on ahci0 ahciem0: on ahci0 xhci0: mem 0xfb400000-0xfb40ffff irq 19 at device 20.0 on pci1 xhci0: 32 bytes context size, 64-bit DMA usbus0 on xhci0 usbus0: 5.0Gbps Super Speed USB v3.0 pci1: at device 22.0 (no driver attached) pci1: at device 22.1 (no driver attached) ehci0: mem 0xfb434000-0xfb4343ff irq 18 at device 26.0 on pci1 usbus1: EHCI version 1.0 usbus1 on ehci0 usbus1: 480Mbps High Speed USB v2.0 pcib5: irq 16 at device 28.0 on pci1 pci5: on pcib5 pcib6: irq 18 at device 28.2 on pci1 pci6: on pcib6 pcib7: at device 0.0 on pci6 pci7: on pcib7 vgapci0: port 0xe000-0xe07f mem 0xfa000000-0xfaffffff,0xfb000000-0xfb01ffff irq 18 at device 0.0 on pci7 vgapci0: Boot video device pcib8: irq 16 at device 28.4 on pci1 pci8: on pcib8 igb0: port 0xd020-0xd03f mem 0xfb320000-0xfb33ffff,0xfb344000-0xfb347fff irq 16 at device 0.0 on pci8 igb0: EEPROM V1.63-0 eTrack 0x800009fa igb0: Using 1024 TX descriptors and 1024 RX descriptors igb0: queue equality override not set, capping rx_queues at 6 and tx_queues at 6 igb0: Using 6 RX queues 6 TX queues igb0: Using MSI-X interrupts with 7 vectors igb0: Ethernet address: 0c:c4:7a:a8:cd:da igb0: netmap queues/slots: TX 6/1024, RX 6/1024 igb1: port 0xd000-0xd01f mem 0xfb300000-0xfb31ffff,0xfb340000-0xfb343fff irq 17 at device 0.1 on pci8 igb1: EEPROM V1.63-0 eTrack 0x800009fa igb1: Using 1024 TX descriptors and 1024 RX descriptors igb1: queue equality override not set, capping rx_queues at 6 and tx_queues at 6 igb1: Using 6 RX queues 6 TX queues igb1: Using MSI-X interrupts with 7 vectors igb1: Ethernet address: 0c:c4:7a:a8:cd:db igb1: netmap queues/slots: TX 6/1024, RX 6/1024 ehci1: mem 0xfb433000-0xfb4333ff irq 18 at device 29.0 on pci1 usbus2: EHCI version 1.0 usbus2 on ehci1 usbus2: 480Mbps High Speed USB v2.0 isab0: at device 31.0 on pci1 isa0: on isab0 ahci1: port 0xf070-0xf077,0xf060-0xf063,0xf050-0xf057,0xf040-0xf043,0xf000-0xf01f mem 0xfb432000-0xfb4327ff irq 16 at device 31.2 on pci1 ahci1: AHCI v1.30 with 6 6Gbps ports, Port Multiplier not supported ahcich4: at channel 0 on ahci1 ahcich5: at channel 1 on ahci1 ahcich6: at channel 2 on ahci1 ahcich7: at channel 3 on ahci1 ahcich8: at channel 4 on ahci1 ahcich9: at channel 5 on ahci1 ahciem1: on ahci1 acpi_button0: on acpi0 uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0 uart1: console (115200,n,8,1) orm0: at iomem 0xc0000-0xc7fff,0xcb000-0xcbfff pnpid ORM0000 on isa0 est0: on cpu0 NULL mp in getnewvnode(9), tag crossmp Timecounter "TSC-low" frequency 1749998391 Hz quality 1000 Timecounters tick every 1.000 msec Expensive timeout(9) function: 0xffffffff8050bcc0(0xfffffe0109fa6000) 0.010101144 s ses0 at ahciem0 bus 0 scbus4 target 0 lun 0 ses0: SEMB S-E-S 2.00 device ses0: SEMB SES Device ses1 at ahciem1 bus 0 scbus11 target 0 lun 0 ses1: SEMB S-E-S 2.00 device ses1: SEMB SES Device ses0: (none) in 'Slot 01', SATA Slot: scbus1 target 0 ada0 at ahcich1 bus 0 scbus1 target 0 lun 0 ada0: ACS-2 ATA SATA 3.x device ada0: Serial Number WD-WCC3F3KDDP98 ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes) ada0: Command Queueing enabled ada0: 953869MB (1953525168 512 byte sectors) ada0: quirks=0x1<4K> mlx5_core0: mem 0xf8000000-0xf9ffffff irq 32 at device 0.0 on pci3 mlx5: Mellanox Core driver 3.7.1 (November 2021)ugen2.1: at usbus2 ugen1.1: at usbus1 uhub0 on usbus2 ugen0.1: at usbus0 uhub0: on usbus2 uhub1 on usbus1 uhub1: on usbus1 uhub2 on usbus0 uhub2: on usbus0 mlx5_core0: WARN: mlx5_vsc_set_space:127:(pid 0): Space 0x7 is not supported. mlx5_core0: WARN: mlx5_fwdump_prep:102:(pid 0): VSC scan space is not supported mlx5_core0: INFO: init_one:1658:(pid 0): cannot find SR-IOV PCIe cap mlx5_core: INFO: (mlx5_core0): E-Switch: Total vports 1, l2 table size(65536), per vport: max uc(1024) max mc(16384) mlx5_core0: Failed to initialize SR-IOV support, err** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 122 files, 45810 usSTEM IS CLEAN ***** + set +x Updating CPU Microcode... CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.00-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab Structured Extended Features3=0x9c000400 XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics Done. ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat/pkg /usr/local/lib/compat /usr/local/lib/compat/pkg /usr/local/lib/e2fsprogs /usr/local/lib/gcc10 /usr/local/lib/gcc8 /usr/local/lib/gcc9 /usr/local/lib/perl5/5.32/mach/CORE 32-bit compatibility ldconfig path: /usr/lib32 /usr/local/lib32/compat Setting hostname: mercat1.netperf.freebsd.org. Setting up harvesting: PURE_RDRAND,[CALLOUT],[UMA],[FS_ATIME],SWI,INTERRUPT,NET_NG,[NET_ETHER],NET_TUN,MOUSE,KEYBOARD,ATTACH,CACHED Feeding entropy: . Autoloading module: acpi_wmi.ko Autoloading module: ichsmb.ko Autoloading module: ioat.ko ioat0: mem 0xfb42c000-0xfb42ffff irq 31 at device 4.0 on pci1 ioat0: Capabilities: 2f7 ioat1: mem 0xfb428000-0xfb42bfff irq 39 at device 4.1 on pci1 ioat1: Capabilities: 2f7 ioat2: mem 0xfb424000-0xfb427fff irq 31 at device 4.2 on pci1 ioat2: Capabilities: f7 ioat3: mem 0xfb420000-0xfb423fff irq 39 at device 4.3 on pci1 ioat3: Capabilities: f7 ioat4: mem 0xfb41c000-0xfb41ffff irq 31 at device 4.4 on pci1 ioat4: Capabilities: f7 ioat5: mem 0xfb418000-0xfb41bfff irq 39 at device 4.5 on pci1 ioat5: Capabilities: f7 ioat6: mem 0xfb414000-0xfb417fff irq 31 at device 4.6 on pci1 ioat6: Capabilities: f7 ioat7: mem 0xfb410000-0xfb413fff irq 39 at device 4.7 on pci1 ioat7: Capabilities: f7 ichsmb0: port 0x580-0x59f mem 0xfb431000-0xfb4310ff irq 18 at device 31.3 on pci1 smbus0: on ichsmb0 acpi_wmi0: on acpi0 acpi_wmi0: cannot find EC device lo0: link state changed to UP Autoloading module: acpi_wmi.ko Autoloading module: mlx5.ko interface mlx5.1 already present in the KLD 'kernel'! linker_load_file: /boot/kernel/mlx5.ko - unsupported file type kldload: an error occurred while loading module mlx5.ko. Please check dmesg(8) for more details. Autoloading moduinterface mlx5.1 already present in the KLD 'kernel'! linker_load_file: /boot/kernel/mlx5.ko - unsupported file type le: mlx5.ko kldload: an error occurred while loading module mlx5.ko. Please check dmesg(8) for more details. Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Starting Network: igb1. igb1: flags=8822 metric 0 mtu 1500 options=4e507bb ether 0c:c4:7a:a8:cd:db media: Ethernet autoselect status: no carrier nd6 options=29 Autoloading module: ichsmb.ko Starting Network: mce0. mce0: flags=8822 metric 0 mtu 1500 options=7eed07bb ether 7c:fe:90:30:ee:38 media: Ethernet autoselect status: no carrier nd6 options=29 Starting Network: mce1. mce1: flags=8822 metric 0 mtu 1500 options=7eed07bb ether 7c:fe:90:30:ee:39 media: Ethernet autoselect status: no carrier nd6 options=29 Autoloading module: uhid.ko Autoloading module: ums.ko Autoloading module: usbhid.ko ums0 on uhub3 ums0: on usbus0 ums0: 3 buttons and [Z] coordinates ID=0 Starting dhclient. DHCPREQUEST on igb0 to 255.255.255.255 port 67 DHCPACK from 192if_delmulti_locked: detaching ifnet instance 0xfffff800048ff000 .168.5.1 bound to 192.168.5.171 -- renewal in 300 seconds. add host 127.0.0.1: gateway lo0 fib 0: route already in table add host ::1: gateway lo0 fib 0: route already in table add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Creating and/or trimming log files. Recovering vi editor sessions:. Updating motd:. Clearing /tmp (X related). Starting syslogd. Starting watchdogd. No core dumps found. Setting date via ntp. 10 May 10:35:53 ntpdate[2600]: step time server 192.168.5.1 offset -1.639691 sec Starting rpcbind. NFS access cache time=60 Starting statd. Starting lockd. Starting powerd. Security policy loaded: MAC/ntpd (mac_ntpd) Starting ntpd. Mounting late filesystems:. Starting inetd. Configuring vt: blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting cron. sysctl: unknown oid 'debug.fail_point.pmap_allocpte_page_alloc' at line 12 Tue May 10 10:35 FreeBSD/amd64 (mercat1.netperf.freebsd.org) (ttyu1) login: May 10 10:36:02 mercat1 su[2754]: pho to root on /dev/pts/0 20220510 10:36:52 all (1/3): mlockall2.sh May 10 10:38:16 mercat1 kernel: pid 4448 (mlockall2), jid 0, uid 0, was killed: a thread waited too long to allocate a page May 10 10:39:31 mercat1 kernel: pid 4449 (mlockall2), jid 0, uid 0, was killed: a thread waited too long to allocate a page 20220510 10:48:22 all (2/3): swapoff2.sh swp_pager_getswapspace(2): failed May 10 10:48:59 mercat1 kernel: pid 22757 (swap), jid 0, uid 2007, was killed: failed to reclaim memory May 10 10:49:01 mercat1 kernel: pid 22776 (swap), jid 0, uid 2007, was killed: failed to reclaim memory swap_pager: I/O error - pagein failed; blkno 405,size 8192, error 5 vm_fault: pager read error, pid 2393 (devd) swap_pager: I/O error - pagein failed; blkno 29,size 16384, error 5 panic: swap_pager_swapoff_object: read from swap failed: 4 cpuid = 7 time = 1652172541 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe010dba2bb0 vpanic() at vpanic+0x17f/frame 0xfffffe010dba2c00 panic() at panic+0x43/frame 0xfffffe010dba2c60 swapoff_one() at swapoff_one+0x71b/frame 0xfffffe010dba2d00 kern_swapoff() at kern_swapoff+0x1ac/frame 0xfffffe010dba2e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe010dba2f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010dba2f30 --- syscall (582, FreeBSD ELF64, sys_swapoff), rip = 0x1ef06e4435da, rsp = 0x1ef06b2ec608, rbp = 0x1ef06b2ec740 --- KDB: enter: panic [ thread pid 22861 tid 100238 ] Stopped at kdb_enter+0x32: movq $0,0x12794f3(%rip) db> run pho db:0:pho> set $lines 20000 db:0:pho> run pho1 db:1:pho1> dump Dumping 1998 out of 32626 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% Dump complete db:1:pho1> bt Tracing pid 22861 tid 100238 td 0xfffffe010e6753a0 kdb_enter() at kdb_enter+0x32/frame 0xfffffe010dba2bb0 vpanic() at vpanic+0x1b0/frame 0xfffffe010dba2c00 panic() at panic+0x43/frame 0xfffffe010dba2c60 swapoff_one() at swapoff_one+0x71b/frame 0xfffffe010dba2d00 kern_swapoff() at kern_swapoff+0x1ac/frame 0xfffffe010dba2e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe010dba2f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010dba2f30 --- syscall (582, FreeBSD ELF64, sys_swapoff), rip = 0x1ef06e4435da, rsp = 0x1ef06b2ec608, rbp = 0x1ef06b2ec740 --- db:1:pho1> show allpcpu Current CPU: 7 cpuid = 0 dynamic pcpu = 0x7c8140 curthread = 0xfffffe0157638ac0: pid 22762 tid 100430 critnest 0 "swap" curpcb = 0xfffffe0157638fd0 fpcurthread = 0xfffffe0157638ac0: pid 22762 "swap" idlethread = 0xfffffe00e4c603a0: tid 100003 "idle: cpu0" self = 0xffffffff82410000 curpmap = 0xfffffe010dda2518 tssp = 0xffffffff82410384 rsp0 = 0xfffffe01439ed000 kcr3 = 0x8000000291aa548b ucr3 = 0x800000043182cc8b scr3 = 0x493f02c6f gs32p = 0xffffffff82410404 ldt = 0xffffffff82410444 tss = 0xffffffff82410434 curvnet = 0 spin locks held: cpuid = 1 dynamic pcpu = 0xfffffe00bb285140 curthread = 0xfffffe015758c1e0: pid 22776 tid 100416 critnest 0 "swap" curpcb = 0xfffffe015758c6f0 fpcurthread = 0xfffffe015758c1e0: pid 22776 "swap" idlethread = 0xfffffe00e4c5fc80: tid 100004 "idle: cpu1" self = 0xffffffff82411000 curpmap = 0xffffffff81e8e178 tssp = 0xffffffff82411384 rsp0 = 0xfffffe01439b1000 kcr3 = 0x800000000236c002 ucr3 = 0xffffffffffffffff scr3 = 0x308105fac gs32p = 0xffffffff82411404 ldt = 0xffffffff82411444 tss = 0xffffffff82411434 curvnet = 0 spin locks held: cpuid = 2 dynamic pcpu = 0xfffffe00bb292140 curthread = 0xfffffe010e6c4000: pid 9 tid 100205 critnest 0 "laundry: dom0" curpcb = 0xfffffe010e6c4510 fpcurthread = none idlethread = 0xfffffe00e4c5f560: tid 100005 "idle: cpu2" self = 0xffffffff82412000 curpmap = 0xffffffff81e8e178 tssp = 0xffffffff82412384 rsp0 = 0xfffffe0115d8e000 kcr3 = 0x800000000236c002 ucr3 = 0xffffffffffffffff scr3 = 0x31e701f6d gs32p = 0xffffffff82412404 ldt = 0xffffffff82412444 tss = 0xffffffff82412434 curvnet = 0 spin locks held: cpuid = 3 dynamic pcpu = 0xfffffe00bb29f140 curthread = 0xfffffe01576391e0: pid 22763 tid 100429 critnest 1 "swap" curpcb = 0xfffffe01576396f0 fpcurthread = 0xfffffe01576391e0: pid 22763 "swap" idlethread = 0xfffffe00e4c5ee40: tid 100006 "idle: cpu3" self = 0xffffffff82413000 curpmap = 0xfffffe0157598b20 tssp = 0xffffffff82413384 rsp0 = 0xfffffe01439f2000 kcr3 = 0x80000006d2c2b57d ucr3 = 0x8000000592b2ad7d scr3 = 0x396301d6a gs32p = 0xffffffff82413404 ldt = 0xffffffff82413444 tss = 0xffffffff82413434 curvnet = 0 spin locks held: cpuid = 4 dynamic pcpu = 0xfffffe00bb2ac140 curthread = 0xfffffe0157639900: pid 22764 tid 100428 critnest 0 "swap" curpcb = 0xfffffe0157639e10 fpcurthread = 0xfffffe0157639900: pid 22764 "swap" idlethread = 0xfffffe00e4c5e720: tid 100007 "idle: cpu4" self = 0xffffffff82414000 curpmap = 0xfffffe015765ab20 tssp = 0xffffffff82414384 rsp0 = 0xfffffe01439e3000 kcr3 = 0x8000000365501263 ucr3 = 0x8000000365703a63 scr3 = 0x365703a63 gs32p = 0xffffffff82414404 ldt = 0xffffffff82414444 tss = 0xffffffff82414434 curvnet = 0 spin locks held: cpuid = 5 dynamic pcpu = 0xfffffe00bb2b9140 curthread = 0xfffffe01445823a0: pid 22772 tid 100420 critnest 0 "swap" curpcb = 0xfffffe01445828b0 fpcurthread = 0xfffffe01445823a0: pid 22772 "swap" idlethread = 0xfffffe00e4c5e000: tid 100008 "idle: cpu5" self = 0xffffffff82415000 curpmap = 0xfffffe010df80128 tssp = 0xffffffff82415384 rsp0 = 0xfffffe01439ac000 kcr3 = 0x80000003091091e4 ucr3 = 0x80000003081059e4 scr3 = 0x3081059e4 gs32p = 0xffffffff82415404 ldt = 0xffffffff82415444 tss = 0xffffffff82415434 curvnet = 0 spin locks held: cpuid = 6 dynamic pcpu = 0xfffffe00bb2c6140 curthread = 0xfffffe015765c720: pid 22758 tid 100445 critnest 0 "swap" curpcb = 0xfffffe015765cc30 fpcurthread = 0xfffffe015765c720: pid 22758 "swap" idlethread = 0xfffffe00e4c66c80: tid 100009 "idle: cpu6" self = 0xffffffff82416000 curpmap = 0xfffffe010e146128 tssp = 0xffffffff82416384 rsp0 = 0xfffffe0157846000 kcr3 = 0x80000003b070333c ucr3 = 0x8000000493f02b3c scr3 = 0x493f02b3c gs32p = 0xffffffff82416404 ldt = 0xffffffff82416444 tss = 0xffffffff82416434 curvnet = 0 spin locks held: cpuid = 7 dynamic pcpu = 0xfffffe00bb2d3140 curthread = 0xfffffe010e6753a0: pid 22861 tid 100238 critnest 1 "swapoff" curpcb = 0xfffffe010e6758b0 fpcurthread = 0xfffffe010e6753a0: pid 22861 "swapoff" idlethread = 0xfffffe00e4c66560: tid 100010 "idle: cpu7" self = 0xffffffff82417000 curpmap = 0xfffffe010e0ba518 tssp = 0xffffffff82417384 rsp0 = 0xfffffe010dba3000 kcr3 = 0x80000003b151906a ucr3 = 0x80000003b151a86a scr3 = 0x3b151a86a gs32p = 0xffffffff82417404 ldt = 0xffffffff82417444 tss = 0xffffffff82417434 curvnet = 0 spin locks held: cpuid = 8 dynamic pcpu = 0xfffffe00bb2e0140 curthread = 0xfffffe0144582ac0: pid 22774 tid 100418 critnest 0 "swap" curpcb = 0xfffffe0144582fd0 fpcurthread = 0xfffffe0144582ac0: pid 22774 "swap" idlethread = 0xfffffe00e4c65e40: tid 100011 "idle: cpu8" self = 0xffffffff82418000 curpmap = 0xfffffe0157592128 tssp = 0xffffffff82418384 rsp0 = 0xfffffe014397a000 kcr3 = 0x80000002ec7026a7 ucr3 = 0x80000002eb907ea7 scr3 = 0x2eb907ea7 gs32p = 0xffffffff82418404 ldt = 0xffffffff82418444 tss = 0xffffffff82418434 curvnet = 0 spin locks held: cpuid = 9 dynamic pcpu = 0xfffffe00bb2ed140 curthread = 0xfffffe0157636000: pid 22759 tid 100453 critnest 0 "swap" curpcb = 0xfffffe0157636510 fpcurthread = 0xfffffe0157636000: pid 22759 "swap" idlethread = 0xfffffe00e4c65720: tid 100012 "idle: cpu9" self = 0xffffffff82419000 curpmap = 0xfffffe0157666518 tssp = 0xffffffff82419384 rsp0 = 0xfffffe01439ca000 kcr3 = 0x80000003a49215aa ucr3 = 0x80000003a3f81daa scr3 = 0x3a3f81daa gs32p = 0xffffffff82419404 ldt = 0xffffffff82419444 tss = 0xffffffff82419434 curvnet = 0 spin locks held: cpuid = 10 dynamic pcpu = 0xfffffe00bb2fa140 curthread = 0xfffffe01576383a0: pid 22761 tid 100431 critnest 0 "swap" curpcb = 0xfffffe01576388b0 fpcurthread = 0xfffffe01576383a0: pid 22761 "swap" idlethread = 0xfffffe00e4c65000: tid 100013 "idle: cpu10" self = 0xffffffff8241a000 curpmap = 0xfffffe010e3fc518 tssp = 0xffffffff8241a384 rsp0 = 0xfffffe01439fc000 kcr3 = 0x80000002df10334e ucr3 = 0x8000000459300b4e scr3 = 0x7ef843b50 gs32p = 0xffffffff8241a404 ldt = 0xffffffff8241a444 tss = 0xffffffff8241a434 curvnet = 0 spin locks held: cpuid = 11 dynamic pcpu = 0xfffffe00bb307140 curthread = 0xfffffe0157647000: pid 22767 tid 100425 critnest 0 "swap" curpcb = 0xfffffe0157647510 fpcurthread = 0xfffffe0157647000: pid 22767 "swap" idlethread = 0xfffffe00e4c62740: tid 100014 "idle: cpu11" self = 0xffffffff8241b000 curpmap = 0xfffffe010e41cb20 tssp = 0xffffffff8241b384 rsp0 = 0xfffffe01439de000 kcr3 = 0x8000000343901034 ucr3 = 0x8000000342d08834 scr3 = 0x342d08834 gs32p = 0xffffffff8241b404 ldt = 0xffffffff8241b444 tss = 0xffffffff8241b434 curvnet = 0 spin locks held: db:1:pho1> show alllocks Process 22861 (swapoff) thread 0xfffffe010e6753a0 (100238) exclusive sx swsysc (swsysc) r = 0 (0xffffffff81fb6f98) locked @ vm/swap_pager.c:2494 Process 22776 (swap) thread 0xfffffe015758c1e0 (100416) exclusive sleep mutex vm reserv (vm reserv) r = 0 (0xfffff80848704200) locked @ vm/vm_reserv.c:970 exclusive rw vm object (vm object) r = 0 (0xfffff80291854210) locked @ vm/vm_object.c:654 Process 22772 (swap) thread 0xfffffe01445823a0 (100420) shared sx vm map (user) (vm map (user)) r = 0 (0xfffffe010df80060) locked @ vm/vm_map.c:4934 Process 22767 (swap) thread 0xfffffe0157647000 (100425) exclusive rw vm object (vm object) r = 0 (0xfffff80291854e70) locked @ vm/vm_fault.c:1495 shared sx vm map (user) (vm map (user)) r = 0 (0xfffffe010e41ca58) locked @ vm/vm_map.c:4934 Process 22764 (swap) thread 0xfffffe0157639900 (100428) shared sx vm map (user) (vm map (user)) r = 0 (0xfffffe015765aa58) locked @ vm/vm_map.c:4934 Process 22759 (swap) thread 0xfffffe0157636000 (100453) shared sx vm map (user) (vm map (user)) r = 0 (0xfffffe0157666450) locked @ vm/vm_map.c:4934 Process 22758 (swap) thread 0xfffffe015765c720 (100445) shared sx vm map (user) (vm map (user)) r = 0 (0xfffffe010e146060) locked @ vm/vm_map.c:4934 Process 2393 (devd) thread 0xfffffe014362d000 (100241) exclusive lockmgr ufs (ufs) r = 0 (0xfffffe015760ec28) locked @ kern/vfs_vnops.c:663 Process 9 (pagedaemon) thread 0xfffffe010e677740 (100206) shared rw UMA lock (UMA lock) r = 0 (0xffffffff81a44600) locked @ vm/uma_core.c:3068 shared sx umareclaim (umareclaim) r = 0 (0xffffffff81fb7010) locked @ vm/uma_core.c:5254 db:1:pho1> show lockedvnods Locked vnodes vnode 0xfffffe015760ebb8: type VREG usecount 1, writecount 1, refcount 3 seqc users 1 hold count flags () flags (VIRF_PGREAD|VMP_LAZYLIST) v_object 0xfffff8027e2a4000 ref 0 pages 3 cleanbuf 1 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe014362d000 (pid 2393, devd, tid 100241) #0 0xffffffff80be055f at lockmgr_lock_flags+0x1cf #1 0xffffffff80f65fad at ffs_lock+0x9d #2 0xffffffff811cfbec at VOP_LOCK1_APV+0x3c #3 0xffffffff80d1d3b4 at _vn_lock+0x54 #4 0xffffffff80d1d999 at vn_rdwr+0x1b9 #5 0xffffffff80d1e040 at vn_rdwr_inchunks+0x90 #6 0xffffffff80bc2e91 at core_output+0x171 #7 0xffffffff80b8ee47 at elf64_coredump+0x5a7 #8 0xffffffff80c17c17 at sigexit+0xd57 #9 0xffffffff80c1841a at postsig+0x1aa #10 0xffffffff80c79adb at ast+0x4fb #11 0xffffffff810d0a69 at doreti_ast+0x1f nlink=1, effnlink=1, size=12288, extsize 0 generation=e0c1a886, uid=0, gid=0, flags=0x0 ino 36, on dev gpt/work db:1:pho1> show mount 0xfffffe010e65d700 /dev/gpt/work on / (ufs) 0xfffffe010e65e280 devfs on /dev (devfs) 0xfffffe010e65cb80 /dev/gpt/tmp on /tmp (ufs) More info: show mount db:1:pho1> show bufqueues bqempty: 86020 Buf domain 0 freebufs 12207 lofreebufs 219 hifreebufs 329 bufspace 45293568 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 2798 (43560960) dirtyq count 0 (0) wakeup 0 lim 25 CPU 13, 3, 10, 15, 8, 4, 3, 18, 23, 21, 6, 4, Locked buffers: 0 space 0 Total buffers: 2958 space 45293568 Buf domain 1 freebufs 11715 lofreebufs 219 hifreebufs 329 bufspace 61853696 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 3299 (58302464) dirtyq count 0 (0) wakeup 0 lim 25 CPU 8, 10, 6, 3, 23, 2, 12, 4, 4, 16, 15, 16, Locked buffers: 0 space 0 Total buffers: 3419 space 61853696 Buf domain 2 freebufs 12608 lofreebufs 219 hifreebufs 329 bufspace 32632832 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 1 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 2410 (30511104) dirtyq count 1 (4096) wakeup 0 lim 25 CPU 22, 2, 10, 2, 3, 10, 22, 1, 13, 8, 7, 14, Locked buffers: 0 space 0 Total buffers: 2592 space 32632832 Buf domain 3 freebufs 13101 lofreebufs 219 hifreebufs 329 bufspace 14938112 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 5 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 1897 (13164544) dirtyq count 5 (135168) wakeup 0 lim 25 CPU 15, 21, 7, 5, 11, 15, 6, 2, 15, 21, 12, 0, Locked buffers: 0 space 0 Total buffers: 2035 space 14938112 Buf domain 4 freebufs 13249 lofreebufs 219 hifreebufs 329 bufspace 11014144 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 1 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 1800 (9998336) dirtyq count 1 (4096) wakeup 0 lim 25 CPU 4, 20, 4, 4, 8, 1, 4, 4, 13, 5, 9, 7, Locked buffers: 0 space 0 Total buffers: 1885 space 11014144 Buf domain 5 freebufs 12880 lofreebufs 219 hifreebufs 329 bufspace 23900160 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 2 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 2096 (22245376) dirtyq count 2 (8192) wakeup 0 lim 25 CPU 1, 23, 13, 10, 16, 22, 23, 4, 11, 22, 6, 4, Locked buffers: 0 space 0 Total buffers: 2253 space 23900160 Buf domain 6 freebufs 10395 lofreebufs 219 hifreebufs 329 bufspace 105623552 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 13 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 4627 (102760448) dirtyq count 13 (425984) wakeup 0 lim 25 CPU 6, 18, 8, 15, 0, 3, 2, 4, 8, 5, 6, 23, Locked buffers: 0 space 0 Total buffers: 4739 space 105623552 db:1:pho1> show lockedbufs db:1:pho1> show page vm_cnt.v_free_count: 48019 vm_cnt.v_inactive_count: 1 vm_cnt.v_active_count: 6363539 vm_cnt.v_laundry_count: 1221069 vm_cnt.v_wire_count: 329213 vm_cnt.v_free_reserved: 10644 vm_cnt.v_free_min: 51265 vm_cnt.v_free_target: 173128 vm_cnt.v_inactive_target: 259692 db:1:pho1> show pageq pq_free 48019 dom 0 page_cnt 8124374 free 48019 pq_act 6363539 pq_inact 1 pq_laund 1221069 pq_unsw 161848 db:0:pho> show freepages DOMAIN: 0 FREE LIST 0: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000000 | 000000 09 (002048K) | 000031 | 000000 08 (001024K) | 000001 | 000000 07 (000512K) | 000001 | 000000 06 (000256K) | 000001 | 000001 05 (000128K) | 000000 | 000000 04 (000064K) | 000001 | 000001 03 (000032K) | 000001 | 000000 02 (000016K) | 000001 | 000006 01 (000008K) | 000001 | 000161 00 (000004K) | 000000 | 001740 FREE LIST 1: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000000 | 000000 09 (002048K) | 000000 | 000000 08 (001024K) | 000000 | 000000 07 (000512K) | 000000 | 000000 06 (000256K) | 000000 | 000000 05 (000128K) | 000000 | 000000 04 (000064K) | 000000 | 000000 03 (000032K) | 000000 | 000000 02 (000016K) | 000000 | 000000 01 (000008K) | 000000 | 000000 00 (000004K) | 000000 | 000000 db:0:pho> show uma Zone Size Used Free Requests Sleeps Bucket Total Mem XFree FFS inode 1160 178546 94 178626 0 8 207222400 0 malloc-4096 4096 34134 0 34290 0 2 139812864 0 VNODE 600 178674 193 178759 0 16 107320200 0 RADIX NODE 144 534858 555 18332353 0 62 77099472 0 FFS2 dinode 256 178546 179 178624 0 62 45753600 0 swblk 136 113 309607 520847 0 62 42121920 0 mbuf_cluster 2048 11395 513 14458 0 8 24387584 0 S VFS Cache 104 179982 627 180070 0 126 18783336 0 BUF TRIE 144 1421 104531 2385 0 62 15257088 0 UMA Slabs 0 112 41238 1308 52909 0 126 4765152 0 swpctrie 144 27 28505 35562 0 62 4108608 0 mbuf 256 15532 379 17614 0 254 4073216 0 VM OBJECT 264 13893 762 27276257 0 30 3868920 0 vmem btag 56 64274 946 64521 0 254 3652320 0 malloc-128 128 27301 444 27953 0 126 3551360 0 pbuf 2776 0 812 0 0 0 2254112 0 malloc-128 128 14699 274 1140605 0 126 1916544 0 malloc-4096 4096 430 0 5514515 0 2 1761280 0 malloc-128 128 12925 374 29095 0 126 1702272 0 THREAD 1808 415 25 509 0 8 795520 0 malloc-8192 8192 86 0 86 0 1 704512 0 malloc-64 64 9413 730 124978 0 254 649152 0 malloc-64 64 9021 870 9621 0 254 633024 0 VMSPACE 2552 64 155 5417087 0 4 558888 0 MAP ENTRY 96 2353 2813 114327392 0 126 495936 0 L VFS Cache 320 1449 87 1449 0 30 491520 0 UMA Zones 2048 232 3 232 0 8 481280 0 malloc-32768 32768 13 0 17 0 1 425984 0 FPU_save_area 832 417 78 1369 0 16 411840 0 malloc-32768 32768 12 0 12 0 1 393216 0 lkpimm 168 4 2324 4 0 62 391104 0 lkpicurr 168 15 2313 15 0 62 391104 0 malloc-1024 1024 344 32 472 0 16 385024 0 malloc-256 256 1098 312 4230 0 62 360960 0 malloc-64 64 4302 990 5421497 0 254 338688 0 malloc-32 32 8213 1363 8530 0 254 306432 0 malloc-8192 8192 37 0 79 0 1 303104 0 malloc-32768 32768 9 0 91 0 1 294912 0 PROC 1352 84 132 5417106 0 8 292032 0 malloc-16 16 16007 1993 16415 0 254 288000 0 malloc-65536 65536 4 0 6 0 1 262144 0 32 Bucket 256 15 975 1286228 0 62 253440 0 filedesc0 1072 84 133 5417107 0 8 232624 0 malloc-2048 2048 102 6 104 0 8 221184 0 256 Bucket 2048 61 47 89453 0 8 221184 0 malloc-65536 65536 3 0 3928 0 1 196608 0 malloc-65536 65536 3 0 3 0 1 196608 0 malloc-16384 16384 12 0 4830 0 1 196608 0 malloc-512 512 328 56 362 0 30 196608 0 64 Bucket 512 64 320 751161 0 30 196608 0 malloc-64 64 436 2588 10834729 0 254 193536 0 Files 80 130 2170 168882 0 126 184000 0 4 Bucket 48 0 3780 275897 0 254 181440 0 malloc-128 128 694 422 10262 0 126 142848 0 8 Bucket 80 12 1688 905594 0 126 136000 0 malloc-256 256 409 116 3664 0 62 134400 0 16 Bucket 144 23 901 74101 0 62 133056 0 malloc-65536 65536 2 0 2 0 1 131072 0 malloc-4096 4096 29 0 82 0 2 118784 0 PGRP 88 33 1255 64 0 126 113344 0 TURNSTILE 136 441 378 441 0 62 111384 0 DEVCTL 1024 6 102 616 0 0 110592 0 udp_inpcb 424 22 221 199 0 30 103032 0 128 Bucket 1024 35 64 172724 0 16 101376 0 malloc-384 384 220 40 10133 0 30 99840 0 malloc-8192 8192 12 0 3024 0 1 98304 0 ksiginfo 112 205 659 1130 0 126 96768 0 malloc-2048 2048 27 19 559 0 8 94208 0 2 Bucket 32 10 2888 159006 0 254 92736 0 malloc-8192 8192 11 0 17 0 1 90112 0 rl_entry 40 173 2049 173 0 254 88880 0 malloc-32 32 1128 1644 26027 0 254 88704 0 ttyoutq 256 173 172 282 0 62 88320 0 malloc-384 384 184 46 639 0 30 88320 0 malloc-256 256 148 197 1083 0 62 88320 0 ttyinq 160 330 220 540 0 62 88000 0 socket 960 52 36 5807 0 16 84480 0 malloc-128 128 328 323 1926 0 126 83328 0 malloc-16384 16384 5 0 13 0 1 81920 0 malloc-16384 16384 5 0 5 0 1 81920 0 UMA Kegs 384 202 1 202 0 30 77952 0 PWD 32 18 2376 23631 0 254 76608 0 malloc-32 32 168 1974 3873 0 254 68544 0 malloc-128 128 129 398 982 0 126 67456 0 malloc-65536 65536 1 0 20 0 1 65536 0 malloc-16384 16384 3 1 12788 0 1 65536 0 malloc-256 256 67 188 1070 0 62 65280 0 SLEEPQUEUE 88 441 295 441 0 126 64768 0 malloc-64 64 205 803 3892 0 254 64512 0 malloc-32 32 194 1822 1063 0 254 64512 0 malloc-256 256 60 165 300 0 62 57600 0 malloc-64 64 98 784 11628 0 254 56448 0 malloc-32 32 120 1644 524 0 254 56448 0 malloc-64 64 101 718 219 0 254 52416 0 malloc-16 16 375 2625 1284 0 254 48000 0 malloc-16 16 421 2579 520 0 254 48000 0 pcpu-8 8 3533 2099 3540 0 254 45056 0 malloc-16 16 76 2674 5426396 0 254 44000 0 malloc-256 256 46 119 1720 0 62 42240 0 malloc-1024 1024 22 18 331 0 16 40960 0 pcpu-64 64 458 182 458 0 254 40960 0 cpuset 104 27 345 27 0 126 38688 0 unpcb 256 16 134 5578 0 62 38400 0 malloc-1024 1024 32 4 4411 0 16 36864 0 malloc-384 384 23 67 38 0 30 34560 0 malloc-32768 32768 1 0 1 0 1 32768 0 malloc-32768 32768 1 0 4 0 1 32768 0 malloc-32768 32768 1 0 3618 0 1 32768 0 malloc-32768 32768 1 0 1 0 1 32768 0 malloc-16384 16384 2 0 2 0 1 32768 0 malloc-32 32 109 899 112 0 254 32256 0 malloc-32 32 120 888 19601 0 254 32256 0 malloc-128 128 37 211 224 0 126 31744 0 malloc-128 128 25 223 38 0 126 31744 0 tcpcb 1104 11 17 16 0 8 30912 0 pipe 744 9 31 9407 0 16 29760 0 malloc-1024 1024 13 15 16 0 16 28672 0 malloc-512 512 27 29 79 0 30 28672 0 fakepg 104 0 273 16 0 126 28392 0 rtentry 176 12 149 15 0 62 28336 0 malloc-16 16 54 1696 110 0 254 28000 0 malloc-16 16 294 1456 82992 0 254 28000 0 malloc-384 384 25 45 40 0 30 26880 0 tcp_inpcb 424 11 52 16 0 30 26712 0 malloc-1024 1024 16 8 160 0 16 24576 0 udpcb 32 22 734 199 0 254 24192 0 udp_inpcb ports 32 10 746 17 0 254 24192 0 malloc-16 16 34 1466 119 0 254 24000 0 malloc-16 16 473 1027 1097212 0 254 24000 0 Mountpoints 2944 3 5 5 0 4 23552 0 malloc-4096 4096 5 0 5 0 2 20480 0 routing nhops 256 9 66 15 0 62 19200 0 malloc-384 384 6 44 154 0 30 19200 0 malloc-256 256 6 69 189 0 62 19200 0 malloc-8192 8192 2 0 2 0 1 16384 0 malloc-1024 1024 11 5 17542 0 16 16384 0 malloc-64 64 6 246 24 0 254 16128 0 malloc-4096 4096 3 0 11 0 2 12288 0 malloc-2048 2048 3 3 1509 0 8 12288 0 malloc-2048 2048 3 3 5685 0 8 12288 0 malloc-512 512 12 12 14 0 30 12288 0 tcp_inpcb ports 32 6 372 6 0 254 12096 0 ertt 72 11 157 16 0 126 12096 0 malloc-32 32 9 369 57 0 254 12096 0 DIRHASH 1024 5 3 1180 0 16 8192 0 malloc-8192 8192 1 0 93 0 1 8192 0 malloc-8192 8192 1 0 1 0 1 8192 0 malloc-8192 8192 1 0 1 0 1 8192 0 malloc-4096 4096 2 0 18 0 2 8192 0 malloc-4096 4096 2 0 14 0 2 8192 0 malloc-2048 2048 3 1 3 0 8 8192 0 malloc-1024 1024 6 2 6 0 16 8192 0 malloc-512 512 7 9 1256 0 30 8192 0 pcpu-16 16 8 504 8 0 254 8192 0 kenv 258 18 12 21848 0 30 7740 0 malloc-384 384 11 9 11 0 30 7680 0 malloc-384 384 3 17 71 0 30 7680 0 malloc-384 384 20 0 20 0 30 7680 0 malloc-256 256 4 26 2944 0 62 7680 0 ripcb 424 1 17 3 0 30 7632 0 NAMEI 1024 0 4 679946 0 16 4096 0 epoch_record pcpu 256 4 12 4 0 62 4096 0 malloc-2048 2048 2 0 34 0 8 4096 0 malloc-2048 2048 1 1 1 0 8 4096 0 malloc-1024 1024 2 2 92 0 16 4096 0 g_bio 408 0 10 1797580 0 30 4080 0 SMR CPU 32 7 120 7 0 254 4064 0 vtnet_tx_hdr 24 0 167 0 0 254 4008 0 UMA Slabs 1 176 10 12 10 0 62 3872 0 ada_ccb 272 0 14 448338 0 30 3808 0 KMAP ENTRY 96 33 6 35 0 0 3744 0 vmem 1856 1 1 1 0 8 3712 0 SMR SHARED 24 7 120 7 0 254 3048 0 mbuf_packet 256 4 0 97 0 254 1024 0 FFS1 dinode 128 0 0 0 0 126 0 0 da_ccb 544 0 0 0 0 16 0 0 ipq 56 0 0 0 0 254 0 0 tfo_ccache_entries 80 0 0 0 0 126 0 0 tfo 4 0 0 0 0 254 0 0 sackhole 32 0 0 0 0 254 0 0 hostcache 64 0 0 0 0 254 0 0 syncache 168 0 0 1 0 62 0 0 tcptw 72 0 0 0 0 126 0 0 tcp_log_id_node 120 0 0 0 0 126 0 0 tcp_log_id_bucket 176 0 0 0 0 62 0 0 tcp_log 416 0 0 0 0 30 0 0 tcpreass 48 0 0 0 0 254 0 0 ripcb ports 32 0 0 0 0 254 0 0 udplite_inpcb ports 32 0 0 0 0 254 0 0 udplite_inpcb 424 0 0 0 0 30 0 0 IPsec SA lft_c 16 0 0 0 0 254 0 0 KNOTE 160 0 0 0 0 62 0 0 itimer 352 0 0 0 0 30 0 0 AIOLIO 272 0 0 0 0 30 0 0 AIOCB 552 0 0 0 0 16 0 0 AIOP 32 0 0 0 0 254 0 0 AIO 208 0 0 0 0 62 0 0 TMPFS node 224 0 0 0 0 62 0 0 NCLNODE 760 0 0 0 0 16 0 0 LTS VFS Cache 360 0 0 0 0 30 0 0 STS VFS Cache 144 0 0 0 0 62 0 0 cryptop 280 0 0 0 0 30 0 0 linux_dma_object 32 0 0 0 0 254 0 0 linux_dma_pctrie 144 0 0 0 0 62 0 0 IOMMU_MAP_ENTRY 120 0 0 0 0 126 0 0 mbuf_jumbo_16k 16384 0 0 0 0 1 0 0 mbuf_jumbo_9k 9216 0 0 0 0 1 0 0 mbuf_jumbo_page 4096 0 0 3 0 2 0 0 audit_record 1280 0 0 0 0 8 0 0 domainset 40 0 0 0 0 254 0 0 MAC labels 40 0 0 0 0 254 0 0 clpbuf 2776 0 0 101 0 2 0 0 vnpbuf 2776 0 0 0 0 4 0 0 mdpbuf 2776 0 0 137 0 1 0 0 nfspbuf 2776 0 0 0 0 2 0 0 swwbuf 2776 0 0 298126 0 1 0 0 swrbuf 2776 0 0 128391 0 2 0 0 ertt_txseginfo 40 0 0 106 0 254 0 0 umtx_shm 88 0 0 0 0 126 0 0 umtx pi 96 0 0 0 0 126 0 0 rangeset pctrie nodes 144 0 0 0 0 62 0 0 malloc-65536 65536 0 0 0 0 1 0 0 malloc-65536 65536 0 0 101 0 1 0 0 malloc-65536 65536 0 0 0 0 1 0 0 malloc-32768 32768 0 0 8 0 1 0 0 malloc-16384 16384 0 0 12 0 1 0 0 malloc-16384 16384 0 0 0 0 1 0 0 malloc-16384 16384 0 0 0 0 1 0 0 malloc-4096 4096 0 0 0 0 2 0 0 malloc-2048 2048 0 0 0 0 8 0 0 malloc-512 512 0 0 317 0 30 0 0 malloc-512 512 0 0 0 0 30 0 0 malloc-512 512 0 0 2 0 30 0 0 malloc-512 512 0 0 0 0 30 0 0 pcpu-32 32 0 0 0 0 254 0 0 pcpu-4 4 0 0 0 0 254 0 0 UMA Hash 256 0 0 0 0 62 0 0 db:0:pho> show umacache Zone Size Used Free Requests Bucket debugnet_mbuf_packet 2048 0 0 0 0 debugnet_mbuf_cluster 2048 -6144 0 0 0 debugnet_mbuf 256 -10240 0 0 0 vm pgcache 4096 100648 38 227727847 39 vm pgcache 4096 1900387 166 39302013 167 buf free cache 848 19776 135 20097 16 buffer arena-65 65536 0 0 0 1 buffer arena-61 61440 0 0 0 1 buffer arena-57 57344 0 0 0 1 buffer arena-53 53248 0 0 0 1 buffer arena-49 49152 0 0 0 1 buffer arena-45 45056 0 0 0 1 buffer arena-40 40960 0 0 0 1 buffer arena-36 36864 0 0 0 1 buffer arena-32 32768 13350 6 13435 1 buffer arena-28 28672 0 0 0 1 buffer arena-24 24576 0 0 0 1 buffer arena-20 20480 0 0 0 1 buffer arena-16 16384 3 0 14 1 buffer arena-12 12288 0 0 0 1 buffer arena-81 8192 0 0 0 1 buffer arena-40 4096 0 0 0 2 kstack_cache 16384 415 0 509 1 db:0:pho> acttrace Tracing command pagedaemon pid 9 tid 100205 td 0xfffffe010e6c4000 (CPU 2) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce2de00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce2de10 trap() at trap+0x56/frame 0xfffffe003ce2df20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce2df20 --- trap 0x13, rip = 0xffffffff80c621a2, rsp = 0xfffffe0115d8db80, rbp = 0xfffffe0115d8db90 --- lock_delay() at lock_delay+0x22/frame 0xfffffe0115d8db90 __rw_wlock_hard() at __rw_wlock_hard+0x188/frame 0xfffffe0115d8dc30 _rw_wlock_cookie() at _rw_wlock_cookie+0xb7/frame 0xfffffe0115d8dc70 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x425/frame 0xfffffe0115d8def0 fork_exit() at fork_exit+0x80/frame 0xfffffe0115d8df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0115d8df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command swap pid 22758 tid 100445 td 0xfffffe015765c720 (CPU 6) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce61e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce61e10 trap() at trap+0x56/frame 0xfffffe003ce61f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce61f20 --- trap 0x13, rip = 0xffffffff80f90a81, rsp = 0xfffffe0157845c60, rbp = 0xfffffe0157845d80 --- vm_fault_dirty() at vm_fault_dirty+0x1/frame 0xfffffe0157845d80 vm_fault_trap() at vm_fault_trap+0x71/frame 0xfffffe0157845dc0 trap_pfault() at trap_pfault+0x22d/frame 0xfffffe0157845e20 trap() at trap+0x442/frame 0xfffffe0157845f30 calltrap() at calltrap+0x8/frame 0xfffffe0157845f30 --- trap 0xc, rip = 0x18b4b8df2f65, rsp = 0x18b4b7324748, rbp = 0x18b4b7324790 --- Tracing command swap pid 22759 tid 100453 td 0xfffffe0157636000 (CPU 9) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce88e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce88e10 trap() at trap+0x56/frame 0xfffffe003ce88f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce88f20 --- trap 0x13, rip = 0xffffffff810f841d, rsp = 0xfffffe01439c9c60, rbp = 0xfffffe01439c9c60 --- pagezero_erms() at pagezero_erms+0xd/frame 0xfffffe01439c9c60 vm_fault() at vm_fault+0xd61/frame 0xfffffe01439c9d80 vm_fault_trap() at vm_fault_trap+0x71/frame 0xfffffe01439c9dc0 trap_pfault() at trap_pfault+0x22d/frame 0xfffffe01439c9e20 trap() at trap+0x442/frame 0xfffffe01439c9f30 calltrap() at calltrap+0x8/frame 0xfffffe01439c9f30 --- trap 0xc, rip = 0x18b4b8df2f65, rsp = 0x18b4b7324748, rbp = 0x18b4b7324790 --- Tracing command swap pid 22761 tid 100431 td 0xfffffe01576383a0 (CPU 10) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce95e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce95e10 trap() at trap+0x56/frame 0xfffffe003ce95f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce95f20 --- trap 0x13, rip = 0x18ac9728e760, rsp = 0x18b4b7324ad0, rbp = 0x18b4b7324b00 --- Tracing command swap pid 22762 tid 100430 td 0xfffffe0157638ac0 (CPU 0) cpustop_handler() at cpustop_handler+0x28/frame 0xffffffff81fec510 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xffffffff81fec520 trap() at trap+0x56/frame 0xffffffff81fec630 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81fec630 --- trap 0x13, rip = 0x18ac9728e760, rsp = 0x18b4b7324ad0, rbp = 0x18b4b7324b00 --- Tracing command swap pid 22763 tid 100429 td 0xfffffe01576391e0 (CPU -1) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce3ae00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce3ae10 trap() at trap+0x56/frame 0xfffffe003ce3af20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce3af20 --- trap 0x13, rip = 0xffffffff810d2e86, rsp = 0xfffffe01439f1e18, rbp = 0xfffffe01439f1e18 --- fpurestore_xrstor64() at fpurestore_xrstor64+0x16/frame 0xfffffe01439f1e18 restore_fpu_curthread() at restore_fpu_curthread+0x85/frame 0xfffffe01439f1e38 done_load_dr() at done_load_dr+0x31/frame 0xfffffe01439f1ee0 mi_switch() at mi_switch+0x157/frame 0xfffffe01439f1f00 ipi_bitmap_handler() at ipi_bitmap_handler+0x87/frame 0xfffffe01439f1f30 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0xb3/frame 0xfffffe01439f1f30 --- interrupt, rip = 0x18ac9728e760, rsp = 0x18b4b7324ad0, rbp = 0x18b4b7324b00 --- Tracing command swap pid 22764 tid 100428 td 0xfffffe0157639900 (CPU 4) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce47e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce47e10 trap() at trap+0x56/frame 0xfffffe003ce47f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce47f20 --- trap 0x13, rip = 0xffffffff810f841b, rsp = 0xfffffe01439e2c60, rbp = 0xfffffe01439e2c60 --- pagezero_erms() at pagezero_erms+0xb/frame 0xfffffe01439e2c60 vm_fault() at vm_fault+0xd61/frame 0xfffffe01439e2d80 vm_fault_trap() at vm_fault_trap+0x71/frame 0xfffffe01439e2dc0 trap_pfault() at trap_pfault+0x22d/frame 0xfffffe01439e2e20 trap() at trap+0x442/frame 0xfffffe01439e2f30 calltrap() at calltrap+0x8/frame 0xfffffe01439e2f30 --- trap 0xc, rip = 0x18b4b8df2f65, rsp = 0x18b4b7324748, rbp = 0x18b4b7324790 --- Tracing command swap pid 22767 tid 100425 td 0xfffffe0157647000 (CPU 11) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003cea2e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003cea2e10 trap() at trap+0x56/frame 0xfffffe003cea2f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003cea2f20 --- trap 0x13, rip = 0xffffffff80faa3fa, rsp = 0xfffffe01439ddb20, rbp = 0xfffffe01439ddb90 --- vm_page_alloc_domain_after() at vm_page_alloc_domain_after+0x22a/frame 0xfffffe01439ddb90 vm_page_alloc() at vm_page_alloc+0x64/frame 0xfffffe01439ddbf0 vm_fault_allocate() at vm_fault_allocate+0x1f0/frame 0xfffffe01439ddc60 vm_fault() at vm_fault+0x366/frame 0xfffffe01439ddd80 vm_fault_trap() at vm_fault_trap+0x71/frame 0xfffffe01439dddc0 trap_pfault() at trap_pfault+0x22d/frame 0xfffffe01439dde20 trap() at trap+0x442/frame 0xfffffe01439ddf30 calltrap() at calltrap+0x8/frame 0xfffffe01439ddf30 --- trap 0xc, rip = 0x18b4b8df2f65, rsp = 0x18b4b7324748, rbp = 0x18b4b7324790 --- Tracing command swap pid 22772 tid 100420 td 0xfffffe01445823a0 (CPU 5) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce54e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce54e10 trap() at trap+0x56/frame 0xfffffe003ce54f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce54f20 --- trap 0x13, rip = 0xffffffff80fb6b9d, rsp = 0xfffffe01439abc30, rbp = 0xfffffe01439abc30 --- vm_object_set_writeable_dirty() at vm_object_set_writeable_dirty+0x1d/frame 0xfffffe01439abc30 vm_fault_dirty() at vm_fault_dirty+0x46/frame 0xfffffe01439abc60 vm_fault() at vm_fault+0x1140/frame 0xfffffe01439abd80 vm_fault_trap() at vm_fault_trap+0x71/frame 0xfffffe01439abdc0 trap_pfault() at trap_pfault+0x22d/frame 0xfffffe01439abe20 trap() at trap+0x442/frame 0xfffffe01439abf30 calltrap() at calltrap+0x8/frame 0xfffffe01439abf30 --- trap 0xc, rip = 0x18b4b8df2f65, rsp = 0x18b4b7324748, rbp = 0x18b4b7324790 --- Tracing command swap pid 22774 tid 100418 td 0xfffffe0144582ac0 (CPU 8) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce7be00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce7be10 trap() at trap+0x56/frame 0xfffffe003ce7bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce7bf20 --- trap 0x13, rip = 0xffffffff810d0a4b, rsp = 0xfffffe0143979f40, rbp = 0x18b4b7324790 --- doreti_ast() at doreti_ast+0x1/frame 0x18b4b7324790 Tracing command swap pid 22776 tid 100416 td 0xfffffe015758c1e0 (CPU 1) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce20e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce20e10 trap() at trap+0x56/frame 0xfffffe003ce20f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce20f20 --- trap 0x13, rip = 0xffffffff80fbd6ee, rsp = 0xfffffe01439b0970, rbp = 0xfffffe01439b09b0 --- vm_reserv_free_page() at vm_reserv_free_page+0x31e/frame 0xfffffe01439b09b0 vm_page_free_prep() at vm_page_free_prep+0x1eb/frame 0xfffffe01439b09d0 vm_page_free_toq() at vm_page_free_toq+0x12/frame 0xfffffe01439b0a00 vm_object_terminate() at vm_object_terminate+0x10d/frame 0xfffffe01439b0a30 vm_object_deallocate() at vm_object_deallocate+0x2bb/frame 0xfffffe01439b0a60 vm_map_process_deferred() at vm_map_process_deferred+0xa9/frame 0xfffffe01439b0a80 vm_map_remove() at vm_map_remove+0xee/frame 0xfffffe01439b0ab0 vmspace_exit() at vmspace_exit+0xa9/frame 0xfffffe01439b0ae0 exit1() at exit1+0x528/frame 0xfffffe01439b0b50 sigexit() at sigexit+0x157/frame 0xfffffe01439b0e20 postsig() at postsig+0x1aa/frame 0xfffffe01439b0ef0 ast() at ast+0x4fb/frame 0xfffffe01439b0f30 doreti_ast() at doreti_ast+0x1f/frame 0x18b4b7324b00 Tracing command swapoff pid 22861 tid 100238 td 0xfffffe010e6753a0 (CPU 7) kdb_enter() at kdb_enter+0x32/frame 0xfffffe010dba2bb0 vpanic() at vpanic+0x1b0/frame 0xfffffe010dba2c00 panic() at panic+0x43/frame 0xfffffe010dba2c60 swapoff_one() at swapoff_one+0x71b/frame 0xfffffe010dba2d00 kern_swapoff() at kern_swapoff+0x1ac/frame 0xfffffe010dba2e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe010dba2f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010dba2f30 --- syscall (582, FreeBSD ELF64, sys_swapoff), rip = 0x1ef06e4435da, rsp = 0x1ef06b2ec608, rbp = 0x1ef06b2ec740 --- db:0:pho> ps pid ppid pgrp uid state wmesg wchan cmd 22862 22785 3190 0 R sh 22861 22725 3113 0 R+ CPU 7 swapoff 22785 3235 3190 0 S piperd 0xfffff800274e5000 sh 22776 22756 22754 2007 RE+ CPU 1 swap 22775 22756 22754 2007 R+ swap 22774 22756 22754 2007 R+ CPU 8 swap 22773 22756 22754 2007 R+ swap 22772 22756 22754 2007 R+ CPU 5 swap 22771 22756 22754 2007 R+ swap 22770 22756 22754 2007 R+ swap 22769 22756 22754 2007 R+ swap 22768 22756 22754 2007 R+ swap 22767 22756 22754 2007 R+ CPU 11 swap 22766 22756 22754 2007 R+ swap 22765 22756 22754 2007 R+ swap 22764 22756 22754 2007 R+ CPU 4 swap 22763 22756 22754 2007 R+ CPU -1 swap 22762 22756 22754 2007 R+ CPU 0 swap 22761 22756 22754 2007 R+ CPU 10 swap 22760 22756 22754 2007 R+ swap 22759 22756 22754 2007 R+ CPU 9 swap 22758 22756 22754 2007 R+ CPU 6 swap 22756 22754 22754 2007 S+ wait 0xfffff80027d8b000 swap 22754 22748 22754 2007 S+ nanslp 0xffffffff81ead762 swap 22748 22725 3113 0 SW+ wait 0xfffff80003eda548 su 22746 0 0 0 DL mdwait 0xfffff8043123d000 [md11] 22736 0 0 0 DL mdwait 0xfffff80035052000 [md10] 22725 22723 3113 0 S+ wait 0xfffff8068b84f548 sh 22724 3113 3113 0 S+ piperd 0xfffff808407095d0 tee 22723 3113 3113 0 SW+ wait 0xfffff80003f35548 sh 3238 3190 3190 0 S piperd 0xfffff800276c5ba0 sh 3236 3190 3190 0 R awk 3235 3190 3190 0 SW wait 0xfffff80027580000 sh 3190 1 3190 0 SWs wait 0xfffff8010fcd7a90 sh 3113 2756 3113 0 SW+ wait 0xfffff80006176548 sh 2756 2754 2756 0 SW+ wait 0xfffff8001c52ea90 bash 2754 2753 2754 0 SW+ pause 0xfffff8001c5320b0 csh 2753 2748 2753 2006 SW+ wait 0xfffff80003eda000 su 2748 2747 2748 2006 SWs+ wait 0xfffff80035d44548 bash 2747 2744 2744 2006 S select 0xfffff80022caeec0 sshd 2744 2716 2744 0 Ss select 0xfffff80006019140 sshd 2743 1 2743 0 Ss+ ttyin 0xfffff8000642f0b0 getty 2742 1 2742 0 Ss+ ttyin 0xfffff8000642ecb0 getty 2741 1 2741 0 Ss+ ttyin 0xfffff8001c5184b0 getty 2740 1 2740 0 Ss+ ttyin 0xfffff8001c518cb0 getty 2739 1 2739 0 Ss+ ttyin 0xfffff800040964b0 getty 2738 1 2738 0 Ss+ ttyin 0xfffff80004096cb0 getty 2737 1 2737 0 Ss+ ttyin 0xfffff800040954b0 getty 2736 1 2736 0 Ss+ ttyin 0xfffff80004095cb0 getty 2735 1 2735 0 Ss+ ttyin 0xfffff800040944b0 getty 2734 1 2734 0 Ss+ ttyin 0xfffff80004094cb0 getty 2720 1 2720 0 ?Ws cron 2716 1 2716 0 Ss select 0xfffff8001c3f93c0 sshd 2697 1 2697 0 Ss select 0xfffff8001c3f9440 inetd 2671 1 2671 123 Ss select 0xfffff80003f78b40 ntpd 2645 1 2645 0 Ss select 0xfffff800359ac2c0 powerd 2640 1 2640 0 Ss rpcsvc 0xfffff80003ddd160 NLM: master 2637 1 2637 0 Ss select 0xfffff80003fea1c0 rpc.statd 2612 1 2612 0 Ss select 0xfffff8001c3f9dc0 rpcbind 2590 1 2590 0 Ss nanslp 0xffffffff81ead768 watchdogd 2582 1 2582 0 Ss select 0xfffff80027f8c140 syslogd 2393 1 2393 0 Rs devd 2388 1 2388 65 Ss select 0xfffff800042925c0 dhclient 2329 1 2329 0 Ss select 0xfffff8000422dac0 dhclient 2326 1 2326 0 Ss select 0xfffff8000422ddc0 dhclient 19 0 0 0 DL syncer 0xffffffff81f9e5a8 [syncer] 18 0 0 0 DL vlruwt 0xfffff8000427da90 [vnlru] 17 0 0 0 DL (threaded) [bufdaemon] 100197 D psleep 0xffffffff81f9d5e0 [bufdaemon] 100198 D - 0xffffffff81a0af40 [bufspacedaemon-0] 100199 D - 0xffffffff81a13200 [bufspacedaemon-1] 100200 D - 0xffffffff81a1b4c0 [bufspacedaemon-2] 100201 D - 0xffffffff81a23780 [bufspacedaemon-3] 100202 D - 0xffffffff81a2ba40 [bufspacedaemon-4] 100203 D - 0xffffffff81a33d00 [bufspacedaemon-5] 100204 D - 0xffffffff81a3bfc0 [bufspacedaemon-6] 100219 D sdflush 0xfffff80027b77ce8 [/ worker] 100227 D sdflush 0xfffff80027c19ce8 [/tmp worker] 16 0 0 0 DL psleep 0xffffffff81fc3750 [vmdaemon] 9 0 0 0 RL (threaded) [pagedaemon] 100195 D pwait 0xffffffff816a17a0 [dom0] 100205 Run CPU 2 [laundry: dom0] 100206 RunQ [uma] 8 0 0 0 DL idle 0xfffff80003e29a90 [enc_daemon1] 7 0 0 0 DL idle 0xfffff80003e28000 [enc_daemon0] 6 0 0 0 DL - 0xffffffff81ce1298 [rand_harvestq] 15 0 0 0 DL (threaded) [usb] 100128 D - 0xfffffe010a1a4440 [usbus0] 100129 D - 0xfffffe010a1a4498 [usbus0] 100130 D - 0xfffffe010a1a44f0 [usbus0] 100131 D - 0xfffffe010a1a4548 [usbus0] 100132 D - 0xfffffe010a1a45a0 [usbus0] 100134 D - 0xfffffe00e4d76cf0 [usbus1] 100135 D - 0xfffffe00e4d76d48 [usbus1] 100136 D - 0xfffffe00e4d76da0 [usbus1] 100137 D - 0xfffffe00e4d76df8 [usbus1] 100138 D - 0xfffffe00e4d76e50 [usbus1] 100139 D - 0xfffffe00e4d56cf0 [usbus2] 100140 D - 0xfffffe00e4d56d48 [usbus2] 100141 D - 0xfffffe00e4d56da0 [usbus2] 100142 D - 0xfffffe00e4d56df8 [usbus2] 100143 D - 0xfffffe00e4d56e50 [usbus2] 5 0 0 0 DL - 0xffffffff81fcc148 [busdma] 4 0 0 0 DL (threaded) [cam] 100120 D - 0xffffffff81bcb4c0 [doneq0] 100121 D - 0xffffffff81bcb540 [doneq1] 100122 D - 0xffffffff81bcb5c0 [doneq2] 100123 D - 0xffffffff81bcb440 [async] 100152 D - 0xffffffff81bcb310 [scanner] 14 0 0 0 DL seqstat 0xfffff800044a2888 [sequencer 00] 3 0 0 0 DL (threaded) [crypto] 100106 D crypto_ 0xffffffff81fb50b0 [crypto] 100107 D crypto_ 0xfffff80004408830 [crypto returns 0] 100108 D crypto_ 0xfffff80004408880 [crypto returns 1] 100109 D crypto_ 0xfffff800044088d0 [crypto returns 2] 100110 D crypto_ 0xfffff80004408920 [crypto returns 3] 100111 D crypto_ 0xfffff80004408970 [crypto returns 4] 100112 D crypto_ 0xfffff800044089c0 [crypto returns 5] 100113 D crypto_ 0xfffff80004408a10 [crypto returns 6] 100114 D crypto_ 0xfffff80004408a60 [crypto returns 7] 100115 D crypto_ 0xfffff80004408ab0 [crypto returns 8] 100116 D crypto_ 0xfffff80004408b00 [crypto returns 9] 100117 D crypto_ 0xfffff80004408b50 [crypto returns 10] 100118 D crypto_ 0xfffff80004408ba0 [crypto returns 11] 13 0 0 0 DL (threaded) [geom] 100091 D - 0xffffffff81e8ce50 [g_event] 100092 D - 0xffffffff81e8ce58 [g_up] 100093 D - 0xffffffff81e8ce60 [g_down] 2 0 0 0 WL (threaded) [clock] 100077 I [clock (0)] 100078 I [clock (1)] 100079 I [clock (2)] 100080 I [clock (3)] 100081 I [clock (4)] 100082 I [clock (5)] 100083 I [clock (6)] 100084 I [clock (7)] 100085 I [clock (8)] 100086 I [clock (9)] 100087 I [clock (10)] 100088 I [clock (11)] 12 0 0 0 WL (threaded) [intr] 100042 I [swi6: task queue] 100043 I [swi6: Giant taskq] 100048 I [swi5: fast taskq] 100089 I [swi1: netisr 0] 100124 I [swi4: apei] 100125 I [irq56: ahci0] 100127 I [irq19: xhci0] 100133 I [irq18: ehci0 ehci1+] 100144 I [irq71: ahci1] 100145 I [swi0: uart uart] 100159 I [irq73: mlx5_core0] 100160 I [irq74: mlx5_core0] 100161 I [irq72: mlx5_core0] 100162 I [irq75: mlx5_core0] 100163 I [irq76: mlx5_core0] 100164 I [irq77: mlx5_core0] 100165 I [irq78: mlx5_core0] 100166 I [irq79: mlx5_core0] 100167 I [irq80: mlx5_core0] 100168 I [irq81: mlx5_core0] 100169 I [irq82: mlx5_core0] 100170 I [irq83: mlx5_core0] 100171 I [irq84: mlx5_core0] 100172 I [irq85: mlx5_core0] 100173 I [irq86: mlx5_core0] 100179 I [irq88: mlx5_core1] 100180 I [irq89: mlx5_core1] 100181 I [irq87: mlx5_core1] 100182 I [irq90: mlx5_core1] 100183 I [irq91: mlx5_core1] 100184 I [irq92: mlx5_core1] 100185 I [irq93: mlx5_core1] 100186 I [irq94: mlx5_core1] 100187 I [irq95: mlx5_core1] 100188 I [irq96: mlx5_core1] 100189 I [irq97: mlx5_core1] 100190 I [irq98: mlx5_core1] 100191 I [irq99: mlx5_core1] 100192 I [irq100: mlx5_core1] 100193 I [irq101: mlx5_core1] 100253 I [irq102: ioat0] 100254 I [irq103: ioat1] 100255 I [irq104: ioat2] 100256 I [irq105: ioat3] 100257 I [irq106: ioat4] 100258 I [irq107: ioat5] 100259 I [irq108: ioat6] 100260 I [irq109: ioat7] 11 0 0 0 RL (threaded) [idle] 100003 CanRun [idle: cpu0] 100004 CanRun [idle: cpu1] 100005 CanRun [idle: cpu2] 100006 CanRun [idle: cpu3] 100007 CanRun [idle: cpu4] 100008 CanRun [idle: cpu5] 100009 CanRun [idle: cpu6] 100010 CanRun [idle: cpu7] 100011 CanRun [idle: cpu8] 100012 CanRun [idle: cpu9] 100013 CanRun [idle: cpu10] 100014 CanRun [idle: cpu11] 1 0 1 0 SLs wait 0xfffff80003c24000 [init] 10 0 0 0 DL audit_w 0xffffffff81fb55c0 [audit] 0 0 0 0 DLs (threaded) [kernel] 100000 D swapin 0xffffffff81e8d3d0 [swapper] 100015 D - 0xfffff80003a3ee00 [softirq_0] 100016 D - 0xfffff80003a3ed00 [softirq_1] 100017 D - 0xfffff80003a3ec00 [softirq_2] 100018 D - 0xfffff80003a3eb00 [softirq_3] 100019 D - 0xfffff80003a3ea00 [softirq_4] 100020 D - 0xfffff80003a3e900 [softirq_5] 100021 D - 0xfffff80003a3e800 [softirq_6] 100022 D - 0xfffff80003a3e700 [softirq_7] 100023 D - 0xfffff80003a3e600 [softirq_8] 100024 D - 0xfffff80003a3e500 [softirq_9] 100025 D - 0xfffff80003a3e400 [softirq_10] 100026 D - 0xfffff80003a3e300 [softirq_11] 100027 D - 0xfffff80003a3e200 [if_io_tqg_0] 100028 D - 0xfffff80003a3e100 [if_io_tqg_1] 100029 D - 0xfffff80003a3e000 [if_io_tqg_2] 100030 D - 0xfffff80003a3de00 [if_io_tqg_3] 100031 D - 0xfffff80003a3dd00 [if_io_tqg_4] 100032 D - 0xfffff80003a3dc00 [if_io_tqg_5] 100033 D - 0xfffff80003a3db00 [if_io_tqg_6] 100034 D - 0xfffff80003a3da00 [if_io_tqg_7] 100035 D - 0xfffff80003a3d900 [if_io_tqg_8] 100036 D - 0xfffff80003a3d800 [if_io_tqg_9] 100037 D - 0xfffff80003a3d700 [if_io_tqg_10] 100038 D - 0xfffff80003a3d600 [if_io_tqg_11] 100039 D - 0xfffff80003a3d500 [if_config_tqg_0] 100040 D - 0xfffff80003a1d500 [linuxkpi_irq_wq] 100041 D - 0xfffff80003a1d300 [in6m_free taskq] 100044 D - 0xfffff80003a1cc00 [aiod_kick taskq] 100045 D - 0xfffff80003a1ca00 [inm_free taskq] 100046 D - 0xfffff80003a1c800 [deferred_unmount ta] 100047 D - 0xfffff80003a1c600 [thread taskq] 100049 D - 0xfffff80003a1c200 [pci_hp taskq] 100050 D - 0xfffff80003a1c000 [kqueue_ctx taskq] 100051 D - 0xfffff80003be2200 [linuxkpi_short_wq_0] 100052 D - 0xfffff80003be2200 [linuxkpi_short_wq_1] 100053 D - 0xfffff80003be2200 [linuxkpi_short_wq_2] 100054 D - 0xfffff80003be2200 [linuxkpi_short_wq_3] 100055 D - 0xfffff80003be2200 [linuxkpi_short_wq_4] 100056 D - 0xfffff80003be2200 [linuxkpi_short_wq_5] 100057 D - 0xfffff80003be2200 [linuxkpi_short_wq_6] 100058 D - 0xfffff80003be2200 [linuxkpi_short_wq_7] 100059 D - 0xfffff80003be2200 [linuxkpi_short_wq_8] 100060 D - 0xfffff80003be2200 [linuxkpi_short_wq_9] 100061 D - 0xfffff80003be2200 [linuxkpi_short_wq_1] 100062 D - 0xfffff80003be2200 [linuxkpi_short_wq_1] 100063 D - 0xfffff80003be2200 [linuxkpi_short_wq_1] 100064 D - 0xfffff80003be3300 [linuxkpi_long_wq_0] 100065 D - 0xfffff80003be3300 [linuxkpi_long_wq_1] 100066 D - 0xfffff80003be3300 [linuxkpi_long_wq_2] 100067 D - 0xfffff80003be3300 [linuxkpi_long_wq_3] 100068 D - 0xfffff80003be3300 [linuxkpi_long_wq_4] 100069 D - 0xfffff80003be3300 [linuxkpi_long_wq_5] 100070 D - 0xfffff80003be3300 [linuxkpi_long_wq_6] 100071 D - 0xfffff80003be3300 [linuxkpi_long_wq_7] 100072 D - 0xfffff80003be3300 [linuxkpi_long_wq_8] 100073 D - 0xfffff80003be3300 [linuxkpi_long_wq_9] 100074 D - 0xfffff80003be3300 [linuxkpi_long_wq_10] 100075 D - 0xfffff80003be3300 [linuxkpi_long_wq_11] 100076 D - 0xfffff80003be3300 [linuxkpi_long_wq_12] 100090 D - 0xfffff8000419b700 [firmware taskq] 100094 D - 0xfffff8000419b200 [crypto_0] 100095 D - 0xfffff8000419b200 [crypto_1] 100096 D - 0xfffff8000419b200 [crypto_2] 100097 D - 0xfffff8000419b200 [crypto_3] 100098 D - 0xfffff8000419b200 [crypto_4] 100099 D - 0xfffff8000419b200 [crypto_5] 100100 D - 0xfffff8000419b200 [crypto_6] 100101 D - 0xfffff8000419b200 [crypto_7] 100102 D - 0xfffff8000419b200 [crypto_8] 100103 D - 0xfffff8000419b200 [crypto_9] 100104 D - 0xfffff8000419b200 [crypto_10] 100105 D - 0xfffff8000419b200 [crypto_11] 100146 D - 0xfffff8001c54c300 [acpi_task_0] 100147 D - 0xfffff8001c54c300 [acpi_task_1] 100148 D - 0xfffff8001c54c300 [acpi_task_2] 100150 D - 0xfffff80003a20100 [mca taskq] 100151 D - 0xfffff8000419d500 [CAM taskq] 100155 D - 0xfffff8001c54d800 [mlx5_core0-rec] 100156 D - 0xfffff8001c54d600 [mlx5_core0-wdg] 100157 D - 0xfffff8001c54d400 [mlx5_core0-cmd] 100158 D - 0xfffff8001c54d100 [mlx5_page_allocator] 100174 D - 0xfffff80022cbb800 [mlx5_esw_wq] 100175 D - 0xfffff80022cbb400 [mlx5_core1-rec] 100176 D - 0xfffff80022cbb200 [mlx5_core1-wdg] 100177 D - 0xfffff80022cbb000 [mlx5_core1-cmd] 100178 D - 0xfffff80003e19c00 [mlx5_page_allocator] 100194 D - 0xfffff8001c3ef900 [mlx5_esw_wq] db:0:pho> allt Tracing command kernel pid 0 tid 100000 td 0xffffffff81e8d920 sched_switch() at sched_switch+0x559/frame 0xffffffff82364e00 mi_switch() at mi_switch+0x157/frame 0xffffffff82364e20 sleepq_switch() at sleepq_switch+0x107/frame 0xffffffff82364e60 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xffffffff82364ea0 _sleep() at _sleep+0x2ce/frame 0xffffffff82364f40 swapper() at swapper+0x75/frame 0xffffffff82364fa0 mi_startup() at mi_startup+0x32a/frame 0xffffffff82364ff0 btext() at btext+0x22 Tracing command kernel pid 0 tid 100015 td 0xfffffe00e4c62020 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4858de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4858e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4858e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4858ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4858ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4858f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4858f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100016 td 0xfffffe00e4c61900 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4853de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4853e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4853e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4853ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4853ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4853f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4853f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100017 td 0xfffffe00e4ce6720 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4862de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4862e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4862e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4862ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4862ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4862f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4862f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100018 td 0xfffffe00e4ce6000 sched_switch() at sched_switch+0x559/frame 0xfffffe00e485dde0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e485de00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e485de40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e485dec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e485def0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e485df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e485df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100019 td 0xfffffe00e4c69740 sched_switch() at sched_switch+0x559/frame 0xfffffe00e486cde0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e486ce00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e486ce40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e486cec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e486cef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e486cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e486cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xfffffe00e4c69020 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4867de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4867e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4867e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4867ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4867ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4867f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4867f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xfffffe00e4c68900 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4876de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4876e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4876e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4876ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4876ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4876f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4876f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xfffffe00e4c681e0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4871de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4871e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4871e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4871ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4871ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4871f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4871f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xfffffe00e4c67ac0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4880de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4880e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4880e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4880ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4880ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4880f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4880f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xfffffe00e4c673a0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e487bde0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e487be00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e487be40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e487bec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e487bef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e487bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e487bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xfffffe00e4cea020 sched_switch() at sched_switch+0x559/frame 0xfffffe00e488ade0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e488ae00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e488ae40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e488aec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e488aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e488af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e488af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100026 td 0xfffffe00e4ce9900 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4885de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4885e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4885e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4885ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4885ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4885f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4885f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100027 td 0xfffffe00e4ce91e0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4894de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4894e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4894e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4894ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4894ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4894f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4894f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100028 td 0xfffffe00e4ce8ac0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e488fde0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e488fe00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e488fe40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e488fec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e488fef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e488ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e488ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100029 td 0xfffffe00e4ce83a0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e489ede0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e489ee00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e489ee40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e489eec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e489eef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e489ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e489ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100030 td 0xfffffe00e4ce7c80 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4899de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4899e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4899e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4899ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e4899ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4899f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4899f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100031 td 0xfffffe00e4ce7560 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48a8de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48a8e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48a8e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e48a8ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48a8ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48a8f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48a8f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100032 td 0xfffffe00e4ce6e40 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48a3de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48a3e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48a3e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e48a3ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48a3ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48a3f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48a3f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100033 td 0xfffffe00e4cf3ac0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48b2de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48b2e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48b2e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e48b2ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48b2ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48b2f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48b2f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100034 td 0xfffffe00e4cf33a0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48adde0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48ade00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48ade40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e48adec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48adef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48adf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48adf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100035 td 0xfffffe00e4cf2c80 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48bcde0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48bce00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48bce40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e48bcec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48bcef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48bcf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48bcf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100036 td 0xfffffe00e4cf2560 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48b7de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48b7e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48b7e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e48b7ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48b7ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48b7f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48b7f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100037 td 0xfffffe00e4cf1e40 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48c6de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48c6e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48c6e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e48c6ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48c6ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48c6f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48c6f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100038 td 0xfffffe00e4cf1720 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48c1de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48c1e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48c1e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e48c1ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48c1ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48c1f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48c1f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100039 td 0xfffffe00e4cf1000 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48d0de0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48d0e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48d0e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e48d0ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00e48d0ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48d0f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48d0f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100040 td 0xfffffe00e4cea740 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48cbde0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48cbe00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48cbe40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e48cbec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe00e48cbef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48cbf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48cbf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100041 td 0xfffffe00e4cf9560 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48dadc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48dade0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48dae20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e48daec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48daef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48daf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48daf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100044 td 0xfffffe00e4cf8000 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48dfdc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48dfde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48dfe20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e48dfec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48dfef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48dff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48dff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100045 td 0xfffffe00e4cf5740 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48eedc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48eede0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48eee20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e48eeec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48eeef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48eef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48eef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100046 td 0xfffffe00e4cf5020 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48e9dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48e9de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48e9e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e48e9ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48e9ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48e9f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48e9f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100047 td 0xfffffe00e4cf4900 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48f8dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48f8de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48f8e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e48f8ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48f8ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48f8f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48f8f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100049 td 0xfffffe00e4d01000 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4902dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4902de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4902e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4902ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4902ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4902f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4902f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100050 td 0xfffffe00e4cfc740 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48fddc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48fdde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e48fde20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e48fdec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e48fdef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48fdf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48fdf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100051 td 0xfffffe00e4cfc020 sched_switch() at sched_switch+0x559/frame 0xfffffe00e490cdc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e490cde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e490ce20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e490cec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e490cef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e490cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e490cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100052 td 0xfffffe00e4cfb900 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4907dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4907de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4907e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4907ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4907ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4907f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4907f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100053 td 0xfffffe00e4cfb1e0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4916dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4916de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4916e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4916ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4916ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4916f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4916f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100054 td 0xfffffe00e4cfaac0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4911dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4911de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4911e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4911ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4911ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4911f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4911f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100055 td 0xfffffe00e4cfa3a0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4920dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4920de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4920e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4920ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4920ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4920f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4920f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100056 td 0xfffffe00e4cf9c80 sched_switch() at sched_switch+0x559/frame 0xfffffe00e491bdc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e491bde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e491be20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e491bec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e491bef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e491bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e491bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100057 td 0xfffffe00e4d04900 sched_switch() at sched_switch+0x559/frame 0xfffffe00e492adc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e492ade0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e492ae20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e492aec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e492aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e492af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e492af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100058 td 0xfffffe00e4d041e0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4925dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4925de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4925e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4925ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4925ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4925f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4925f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100059 td 0xfffffe00e4d03ac0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4934dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4934de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4934e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4934ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4934ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4934f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4934f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100060 td 0xfffffe00e4d033a0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e492fdc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e492fde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e492fe20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e492fec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e492fef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e492ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e492ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100061 td 0xfffffe00e4d02c80 sched_switch() at sched_switch+0x559/frame 0xfffffe00e493edc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e493ede0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e493ee20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e493eec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e493eef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e493ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e493ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100062 td 0xfffffe00e4d02560 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4939dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4939de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4939e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4939ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4939ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4939f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4939f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100063 td 0xfffffe00e4d01e40 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4948dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4948de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4948e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4948ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4948ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4948f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4948f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100064 td 0xfffffe00e4d01720 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4943dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4943de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4943e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4943ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4943ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4943f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4943f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100065 td 0xfffffe00e4d0a3a0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4952dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4952de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4952e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4952ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4952ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4952f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4952f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100066 td 0xfffffe00e4d09c80 sched_switch() at sched_switch+0x559/frame 0xfffffe00e494ddc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e494dde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e494de20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e494dec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e494def0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e494df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e494df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100067 td 0xfffffe00e4d09560 sched_switch() at sched_switch+0x559/frame 0xfffffe00e495cdc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e495cde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e495ce20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e495cec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e495cef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e495cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e495cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100068 td 0xfffffe00e4d08e40 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4957dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4957de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4957e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4957ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4957ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4957f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4957f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100069 td 0xfffffe00e4d08720 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4966dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4966de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4966e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4966ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4966ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4966f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4966f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100070 td 0xfffffe00e4d08000 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4961dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4961de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4961e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4961ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4961ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4961f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4961f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100071 td 0xfffffe00e4d05740 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4970dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4970de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4970e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4970ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4970ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4970f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4970f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100072 td 0xfffffe00e4d05020 sched_switch() at sched_switch+0x559/frame 0xfffffe00e496bdc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e496bde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e496be20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e496bec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e496bef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e496bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e496bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100073 td 0xfffffe00e4d0de40 sched_switch() at sched_switch+0x559/frame 0xfffffe00e497adc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e497ade0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e497ae20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e497aec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e497aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e497af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e497af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100074 td 0xfffffe00e4d0d720 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4975dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4975de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4975e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4975ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4975ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4975f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4975f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100075 td 0xfffffe00e4d0d000 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4984dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4984de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4984e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4984ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4984ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4984f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4984f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100076 td 0xfffffe00e4d0c740 sched_switch() at sched_switch+0x559/frame 0xfffffe00e497fdc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e497fde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e497fe20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e497fec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e497fef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e497ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e497ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100090 td 0xfffffe00e4d17e40 sched_switch() at sched_switch+0x559/frame 0xfffffe00e49f5dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e49f5de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e49f5e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e49f5ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e49f5ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49f5f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49f5f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100094 td 0xfffffe00e4d2d560 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e39dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e39de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e39e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e39ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e39ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e39f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e39f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100095 td 0xfffffe00e4d2ce40 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e48dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e48de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e48e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e48ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e48ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e48f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e48f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100096 td 0xfffffe00e4d2c720 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e43dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e43de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e43e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e43ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e43ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e43f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e43f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100097 td 0xfffffe00e4d2c000 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e52dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e52de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e52e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e52ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e52ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e52f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e52f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100098 td 0xfffffe00e4d1b740 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e4ddc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e4dde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e4de20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e4dec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e4def0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e4df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e4df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100099 td 0xfffffe00e4d1b020 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e5cdc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e5cde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e5ce20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e5cec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e5cef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e5cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e5cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100100 td 0xfffffe00e4d1a900 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e57dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e57de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e57e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e57ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e57ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e57f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e57f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100101 td 0xfffffe00e4d36720 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e66dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e66de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e66e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e66ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e66ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e66f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e66f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100102 td 0xfffffe00e4d36000 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e61dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e61de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e61e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e61ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e61ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e61f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e61f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100103 td 0xfffffe00e4d30740 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e70dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e70de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e70e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e70ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e70ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e70f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e70f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100104 td 0xfffffe00e4d30020 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e6bdc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e6bde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e6be20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e6bec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e6bef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e6bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e6bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100105 td 0xfffffe00e4d2f900 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e7adc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e7ade0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e7ae20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e7aec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e4e7aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e7af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e7af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100146 td 0xfffffe010dc023a0 sched_switch() at sched_switch+0x559/frame 0xfffffe010da34de0 mi_switch() at mi_switch+0x157/frame 0xfffffe010da34e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da34e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe010da34ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe010da34ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da34f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da34f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100147 td 0xfffffe010dc01c80 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4ffcde0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4ffce00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ffce40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00e4ffcec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe00e4ffcef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ffcf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ffcf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100148 td 0xfffffe010dc01560 sched_switch() at sched_switch+0x559/frame 0xfffffe010da3ede0 mi_switch() at mi_switch+0x157/frame 0xfffffe010da3ee00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da3ee40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe010da3eec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe010da3eef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da3ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da3ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100150 td 0xfffffe010dc00720 sched_switch() at sched_switch+0x559/frame 0xfffffe010da48de0 mi_switch() at mi_switch+0x157/frame 0xfffffe010da48e00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da48e40 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe010da48ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe010da48ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da48f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da48f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100151 td 0xfffffe010dc00000 sched_switch() at sched_switch+0x559/frame 0xfffffe010da43dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe010da43de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da43e20 _sleep() at _sleep+0x2e7/frame 0xfffffe010da43ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010da43ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da43f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da43f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100155 td 0xfffffe010a1aa020 sched_switch() at sched_switch+0x559/frame 0xfffffe010da4ddc0 mi_switch() at mi_switch+0x157/frame 0xfffffe010da4dde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da4de20 _sleep() at _sleep+0x2e7/frame 0xfffffe010da4dec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010da4def0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da4df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da4df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100156 td 0xfffffe010dda7740 sched_switch() at sched_switch+0x559/frame 0xfffffe010da66dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe010da66de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da66e20 _sleep() at _sleep+0x2e7/frame 0xfffffe010da66ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010da66ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da66f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da66f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100157 td 0xfffffe010dda7020 sched_switch() at sched_switch+0x559/frame 0xfffffe010da61dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe010da61de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da61e20 _sleep() at _sleep+0x2e7/frame 0xfffffe010da61ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010da61ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da61f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da61f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100158 td 0xfffffe010dda6900 sched_switch() at sched_switch+0x559/frame 0xfffffe010da70dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe010da70de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da70e20 _sleep() at _sleep+0x2e7/frame 0xfffffe010da70ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010da70ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da70f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da70f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100174 td 0xfffffe010e377e40 sched_switch() at sched_switch+0x559/frame 0xfffffe010dac0dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe010dac0de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010dac0e20 _sleep() at _sleep+0x2e7/frame 0xfffffe010dac0ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010dac0ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010dac0f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010dac0f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100175 td 0xfffffe010e377720 sched_switch() at sched_switch+0x559/frame 0xfffffe010dabbdc0 mi_switch() at mi_switch+0x157/frame 0xfffffe010dabbde0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010dabbe20 _sleep() at _sleep+0x2e7/frame 0xfffffe010dabbec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010dabbef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010dabbf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010dabbf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100176 td 0xfffffe010e377000 sched_switch() at sched_switch+0x559/frame 0xfffffe010dacadc0 mi_switch() at mi_switch+0x157/frame 0xfffffe010dacade0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010dacae20 _sleep() at _sleep+0x2e7/frame 0xfffffe010dacaec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010dacaef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010dacaf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010dacaf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100177 td 0xfffffe010e272740 sched_switch() at sched_switch+0x559/frame 0xfffffe010dac5dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe010dac5de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010dac5e20 _sleep() at _sleep+0x2e7/frame 0xfffffe010dac5ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010dac5ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010dac5f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010dac5f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100178 td 0xfffffe010e272020 sched_switch() at sched_switch+0x559/frame 0xfffffe010dad4dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe010dad4de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010dad4e20 _sleep() at _sleep+0x2e7/frame 0xfffffe010dad4ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010dad4ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010dad4f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010dad4f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100194 td 0xfffffe010e40f3a0 sched_switch() at sched_switch+0x559/frame 0xfffffe010db24dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe010db24de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db24e20 _sleep() at _sleep+0x2e7/frame 0xfffffe010db24ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe010db24ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db24f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db24f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command init pid 1 tid 100002 td 0xfffffe00e4c60ac0 sched_switch() at sched_switch+0x559/frame 0xfffffe00377e1a10 mi_switch() at mi_switch+0x157/frame 0xfffffe00377e1a30 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00377e1a70 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe00377e1ac0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00377e1ad0 _sleep() at _sleep+0x2dd/frame 0xfffffe00377e1b70 kern_wait6() at kern_wait6+0x474/frame 0xfffffe00377e1c00 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe00377e1e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe00377e1f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00377e1f30 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x28f0da, rsp = 0x820c253c8, rbp = 0x820c25430 --- Tracing command clock pid 2 tid 100077 td 0xfffffe00e4d11740 sched_switch() at sched_switch+0x559/frame 0xfffffe00e49beea0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e49beec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe00e49beef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49bef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49bef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command clock pid 2 tid 100078 td 0xfffffe00e4d11020 sched_switch() at sched_switch+0x559/frame 0xfffffe00e49b9ea0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e49b9ec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe00e49b9ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49b9f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49b9f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command clock pid 2 tid 100079 td 0xfffffe00e4d10900 sched_switch() at sched_switch+0x559/frame 0xfffffe00e49c8ea0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e49c8ec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe00e49c8ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49c8f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49c8f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command clock pid 2 tid 100080 td 0xfffffe00e4d101e0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e49c3ea0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e49c3ec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe00e49c3ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49c3f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49c3f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command clock pid 2 tid 100081 td 0xfffffe00e4d0fac0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e49d2ea0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e49d2ec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe00e49d2ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49d2f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49d2f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command clock pid 2 tid 100082 td 0xfffffe00e4d0f3a0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e49cdea0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e49cdec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe00e49cdef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49cdf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49cdf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command clock pid 2 tid 100083 td 0xfffffe00e4d0ec80 fork_trampoline() at fork_trampoline Tracing command clock pid 2 tid 100084 td 0xfffffe00e4d0e560 fork_trampoline() at fork_trampoline Tracing command clock pid 2 tid 100085 td 0xfffffe00e4d1a1e0 fork_trampoline() at fork_trampoline Tracing command clock pid 2 tid 100086 td 0xfffffe00e4d19ac0 fork_trampoline() at fork_trampoline Tracing command clock pid 2 tid 100087 td 0xfffffe00e4d193a0 fork_trampoline() at fork_trampoline Tracing command clock pid 2 tid 100088 td 0xfffffe00e4d18c80 fork_trampoline() at fork_trampoline Tracing command crypto pid 3 tid 100106 td 0xfffffe00e4d2f1e0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e75db0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e75dd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e75e10 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e75eb0 crypto_dispatch_thread() at crypto_dispatch_thread+0xbf/frame 0xfffffe00e4e75ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e75f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e75f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100107 td 0xfffffe00e4d2eac0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e84db0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e84dd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e84e10 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e84eb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4e84ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e84f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e84f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100108 td 0xfffffe00e4d2e3a0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e7fdb0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e7fdd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e7fe10 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e7feb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4e7fef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e7ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e7ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100109 td 0xfffffe00e4d3a020 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e8edb0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e8edd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e8ee10 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e8eeb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4e8eef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e8ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e8ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100110 td 0xfffffe00e4d39900 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e89db0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e89dd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e89e10 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e89eb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4e89ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e89f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e89f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100111 td 0xfffffe00e4d391e0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e98db0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e98dd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e98e10 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e98eb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4e98ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e98f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e98f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100112 td 0xfffffe00e4d38ac0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e93db0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e93dd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e93e10 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e93eb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4e93ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e93f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e93f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100113 td 0xfffffe00e4d383a0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4ea2db0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4ea2dd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ea2e10 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4ea2eb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4ea2ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ea2f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ea2f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100114 td 0xfffffe00e4d37c80 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e9ddb0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e9ddd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e9de10 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e9deb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4e9def0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e9df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e9df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100115 td 0xfffffe00e4d37560 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4eacdb0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4eacdd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4eace10 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4eaceb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4eacef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4eacf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4eacf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100116 td 0xfffffe00e4d36e40 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4ea7db0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4ea7dd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ea7e10 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4ea7eb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4ea7ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ea7f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ea7f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100117 td 0xfffffe00e4d3dac0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4eb6db0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4eb6dd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4eb6e10 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4eb6eb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4eb6ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4eb6f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4eb6f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100118 td 0xfffffe00e4d3d3a0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4eb1db0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4eb1dd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4eb1e10 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4eb1eb0 crypto_ret_thread() at crypto_ret_thread+0x134/frame 0xfffffe00e4eb1ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4eb1f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4eb1f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 4 tid 100120 td 0xfffffe00e4d3c560 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4ebbda0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4ebbdc0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ebbe00 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4ebbea0 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe00e4ebbef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ebbf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ebbf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 4 tid 100121 td 0xfffffe00e4d3be40 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4ecada0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4ecadc0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ecae00 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4ecaea0 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe00e4ecaef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ecaf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ecaf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 4 tid 100122 td 0xfffffe00e4d3b720 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4ec5da0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4ec5dc0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ec5e00 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4ec5ea0 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe00e4ec5ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ec5f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ec5f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 4 tid 100123 td 0xfffffe00e4d3b000 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4ed4da0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4ed4dc0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ed4e00 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4ed4ea0 xpt_async_td() at xpt_async_td+0x74/frame 0xfffffe00e4ed4ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ed4f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ed4f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 4 tid 100152 td 0xfffffe010a1aa740 sched_switch() at sched_switch+0x559/frame 0xfffffe010da52dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe010da52de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da52e20 _sleep() at _sleep+0x2e7/frame 0xfffffe010da52ec0 xpt_scanner_thread() at xpt_scanner_thread+0x154/frame 0xfffffe010da52ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da52f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da52f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command busdma pid 5 tid 100126 td 0xfffffe00e4d88720 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4ee8dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4ee8de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ee8e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4ee8ec0 busdma_thread() at busdma_thread+0xa5/frame 0xfffffe00e4ee8ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ee8f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ee8f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command rand_harvestq pid 6 tid 100149 td 0xfffffe010dc00e40 sched_switch() at sched_switch+0x559/frame 0xfffffe010da39d20 mi_switch() at mi_switch+0x157/frame 0xfffffe010da39d40 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da39d80 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010da39dc0 _sleep() at _sleep+0x2ce/frame 0xfffffe010da39e60 random_kthread() at random_kthread+0xa7/frame 0xfffffe010da39ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da39f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da39f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon0 pid 7 tid 100153 td 0xfffffe010dda3e40 sched_switch() at sched_switch+0x559/frame 0xfffffe010da5cd80 mi_switch() at mi_switch+0x157/frame 0xfffffe010da5cda0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da5cde0 _sleep() at _sleep+0x2e7/frame 0xfffffe010da5ce80 enc_daemon() at enc_daemon+0xeb/frame 0xfffffe010da5cef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da5cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da5cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon1 pid 8 tid 100154 td 0xfffffe010dda3720 sched_switch() at sched_switch+0x559/frame 0xfffffe010da57d80 mi_switch() at mi_switch+0x157/frame 0xfffffe010da57da0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010da57de0 _sleep() at _sleep+0x2e7/frame 0xfffffe010da57e80 enc_daemon() at enc_daemon+0xeb/frame 0xfffffe010da57ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da57f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da57f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 9 tid 100195 td 0xfffffe010e659ac0 sched_switch() at sched_switch+0x559/frame 0xfffffe010db3aa80 mi_switch() at mi_switch+0x157/frame 0xfffffe010db3aaa0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db3aae0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db3ab20 _sleep() at _sleep+0x2ce/frame 0xfffffe010db3abc0 pause_sbt() at pause_sbt+0x110/frame 0xfffffe010db3abf0 vm_pageout_worker() at vm_pageout_worker+0x238/frame 0xfffffe010db3aeb0 vm_pageout() at vm_pageout+0x1d7/frame 0xfffffe010db3aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db3af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db3af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 9 tid 100205 td 0xfffffe010e6c4000 (CPU 2) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce2de00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce2de10 trap() at trap+0x56/frame 0xfffffe003ce2df20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce2df20 --- trap 0x13, rip = 0xffffffff80c621a2, rsp = 0xfffffe0115d8db80, rbp = 0xfffffe0115d8db90 --- lock_delay() at lock_delay+0x22/frame 0xfffffe0115d8db90 __rw_wlock_hard() at __rw_wlock_hard+0x188/frame 0xfffffe0115d8dc30 _rw_wlock_cookie() at _rw_wlock_cookie+0xb7/frame 0xfffffe0115d8dc70 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x425/frame 0xfffffe0115d8def0 fork_exit() at fork_exit+0x80/frame 0xfffffe0115d8df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0115d8df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 9 tid 100206 td 0xfffffe010e677740 sched_switch() at sched_switch+0x559/frame 0xfffffe0115b86e20 mi_switch() at mi_switch+0x157/frame 0xfffffe0115b86e40 sched_bind() at sched_bind+0xbd/frame 0xfffffe0115b86e60 pcpu_cache_drain_safe() at pcpu_cache_drain_safe+0x26b/frame 0xfffffe0115b86e90 uma_reclaim_domain() at uma_reclaim_domain+0x1a9/frame 0xfffffe0115b86ec0 uma_reclaim_worker() at uma_reclaim_worker+0x35/frame 0xfffffe0115b86ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe0115b86f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0115b86f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command audit pid 10 tid 100001 td 0xfffffe00e4c611e0 sched_switch() at sched_switch+0x559/frame 0xfffffe00377e6dd0 mi_switch() at mi_switch+0x157/frame 0xfffffe00377e6df0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00377e6e30 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00377e6e90 audit_worker() at audit_worker+0x9f/frame 0xfffffe00377e6ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377e6f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377e6f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100003 td 0xfffffe00e4c603a0 sched_switch() at sched_switch+0x559/frame 0xfffffe00377f0d50 mi_switch() at mi_switch+0x157/frame 0xfffffe00377f0d70 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe00377f0d70 --- interrupt, rip = 0xffffffff810b845e, rsp = 0xfffffe00377f0e40, rbp = 0xfffffe00377f0e50 --- cpu_idle() at cpu_idle+0xee/frame 0xfffffe00377f0e50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00377f0ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377f0f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377f0f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffffe00e4c5fc80 sched_switch() at sched_switch+0x559/frame 0xfffffe00377ebe30 mi_switch() at mi_switch+0x157/frame 0xfffffe00377ebe50 sched_idletd() at sched_idletd+0x4f9/frame 0xfffffe00377ebef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377ebf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377ebf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffffe00e4c5f560 sched_switch() at sched_switch+0x559/frame 0xfffffe00377fae30 mi_switch() at mi_switch+0x157/frame 0xfffffe00377fae50 sched_idletd() at sched_idletd+0xa1/frame 0xfffffe00377faef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377faf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377faf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffffe00e4c5ee40 sched_switch() at sched_switch+0x559/frame 0xfffffe00377f5e30 mi_switch() at mi_switch+0x157/frame 0xfffffe00377f5e50 sched_idletd() at sched_idletd+0x4f9/frame 0xfffffe00377f5ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377f5f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377f5f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffffe00e4c5e720 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4830e30 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4830e50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00e4830ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4830f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4830f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffffe00e4c5e000 sched_switch() at sched_switch+0x559/frame 0xfffffe00377ffe30 mi_switch() at mi_switch+0x157/frame 0xfffffe00377ffe50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00377ffef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377fff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377fff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffffe00e4c66c80 sched_switch() at sched_switch+0x559/frame 0xfffffe00e483ae30 mi_switch() at mi_switch+0x157/frame 0xfffffe00e483ae50 sched_idletd() at sched_idletd+0x4f9/frame 0xfffffe00e483aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e483af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e483af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffffe00e4c66560 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4835e30 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4835e50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00e4835ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4835f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4835f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffffe00e4c65e40 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4844e30 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4844e50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00e4844ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4844f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4844f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffffe00e4c65720 sched_switch() at sched_switch+0x559/frame 0xfffffe00e483fe30 mi_switch() at mi_switch+0x157/frame 0xfffffe00e483fe50 sched_idletd() at sched_idletd+0x4b1/frame 0xfffffe00e483fef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e483ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e483ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffffe00e4c65000 sched_switch() at sched_switch+0x559/frame 0xfffffe00e484ee30 mi_switch() at mi_switch+0x157/frame 0xfffffe00e484ee50 sched_idletd() at sched_idletd+0x4f9/frame 0xfffffe00e484eef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e484ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e484ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffffe00e4c62740 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4849e30 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4849e50 sched_idletd() at sched_idletd+0x4f9/frame 0xfffffe00e4849ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4849f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4849f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100042 td 0xfffffe00e4cf8e40 sched_switch() at sched_switch+0x559/frame 0xfffffe00e48d5e40 mi_switch() at mi_switch+0x157/frame 0xfffffe00e48d5e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e48d5ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e48d5f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48d5f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100043 td 0xfffffe00e4cf8720 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100048 td 0xfffffe00e4cf41e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100089 td 0xfffffe00e4d18560 sched_switch() at sched_switch+0x559/frame 0xfffffe00e49fae40 mi_switch() at mi_switch+0x157/frame 0xfffffe00e49fae60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e49faef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49faf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49faf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100124 td 0xfffffe00e4d89560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100125 td 0xfffffe00e4d88e40 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4ed9e40 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4ed9e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4ed9ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ed9f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ed9f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100127 td 0xfffffe00e4d88000 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4ee3e40 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4ee3e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4ee3ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ee3f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ee3f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100133 td 0xfffffe00e4d8c740 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4f01e40 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f01e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4f01ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f01f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f01f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100144 td 0xfffffe010a1a7c80 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100145 td 0xfffffe010a1a7560 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4f49e40 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f49e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4f49ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f49f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f49f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100159 td 0xfffffe010dda61e0 sched_switch() at sched_switch+0x559/frame 0xfffffe010da6be40 mi_switch() at mi_switch+0x157/frame 0xfffffe010da6be60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe010da6bef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da6bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da6bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100160 td 0xfffffe010dda5ac0 sched_switch() at sched_switch+0x559/frame 0xfffffe010da7ae40 mi_switch() at mi_switch+0x157/frame 0xfffffe010da7ae60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe010da7aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010da7af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da7af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100161 td 0xfffffe010dda53a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100162 td 0xfffffe010dda4c80 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100163 td 0xfffffe010dda4560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100164 td 0xfffffe010e2711e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100165 td 0xfffffe010e270ac0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100166 td 0xfffffe010e2703a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100167 td 0xfffffe010e26fc80 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100168 td 0xfffffe010e26f560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100169 td 0xfffffe010e26ee40 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100170 td 0xfffffe010e26e720 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100171 td 0xfffffe010e26e000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100172 td 0xfffffe010e378c80 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100173 td 0xfffffe010e378560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100179 td 0xfffffe010e271900 sched_switch() at sched_switch+0x559/frame 0xfffffe010dacfe40 mi_switch() at mi_switch+0x157/frame 0xfffffe010dacfe60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe010dacfef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010dacff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010dacff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100180 td 0xfffffe010a1a6e40 sched_switch() at sched_switch+0x559/frame 0xfffffe010dadee40 mi_switch() at mi_switch+0x157/frame 0xfffffe010dadee60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe010dadeef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010dadef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010dadef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100181 td 0xfffffe010a1a6720 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100182 td 0xfffffe010e40d720 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100183 td 0xfffffe010e40d000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100184 td 0xfffffe010e37b740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100185 td 0xfffffe010e37b020 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100186 td 0xfffffe010e37a900 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100187 td 0xfffffe010e37a1e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100188 td 0xfffffe010e379ac0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100189 td 0xfffffe010e3793a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100190 td 0xfffffe010e411020 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100191 td 0xfffffe010e410900 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100192 td 0xfffffe010e4101e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100193 td 0xfffffe010e40fac0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100253 td 0xfffffe010dc03900 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100254 td 0xfffffe010dc031e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100255 td 0xfffffe010dc02ac0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100256 td 0xfffffe01437ac560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100257 td 0xfffffe01437abe40 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100258 td 0xfffffe01437ab720 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100259 td 0xfffffe01437ab000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100260 td 0xfffffe014367c740 fork_trampoline() at fork_trampoline Tracing command geom pid 13 tid 100091 td 0xfffffe00e4d17720 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e34dc0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e34de0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e34e20 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e34ec0 g_run_events() at g_run_events+0x444/frame 0xfffffe00e4e34ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e34f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e34f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100092 td 0xfffffe00e4d17000 sched_switch() at sched_switch+0x559/frame 0xfffffe00e49ffdb0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e49ffdd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e49ffe10 _sleep() at _sleep+0x2e7/frame 0xfffffe00e49ffeb0 g_io_schedule_up() at g_io_schedule_up+0x3c/frame 0xfffffe00e49ffee0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe00e49ffef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e49fff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49fff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100093 td 0xfffffe00e4d2dc80 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4e3edb0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4e3edd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4e3ee10 _sleep() at _sleep+0x2e7/frame 0xfffffe00e4e3eeb0 g_io_schedule_down() at g_io_schedule_down+0x4c/frame 0xfffffe00e4e3eee0 g_down_procbody() at g_down_procbody+0x5c/frame 0xfffffe00e4e3eef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4e3ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e3ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sequencer 00 pid 14 tid 100119 td 0xfffffe00e4d3cc80 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4ec0db0 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4ec0dd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ec0e10 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4ec0e70 seq_eventthread() at seq_eventthread+0x8c/frame 0xfffffe00e4ec0ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ec0f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ec0f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100128 td 0xfffffe00e4d3f740 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4ef2e00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4ef2e20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ef2e60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4ef2ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4ef2ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ef2f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ef2f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100129 td 0xfffffe00e4d3f020 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4eede00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4eede20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4eede60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4eedec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4eedef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4eedf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4eedf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100130 td 0xfffffe00e4d3e900 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4efce00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4efce20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4efce60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4efcec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4efcef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4efcf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4efcf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100131 td 0xfffffe00e4d3e1e0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4ef7e00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4ef7e20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ef7e60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4ef7ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4ef7ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ef7f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ef7f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100132 td 0xfffffe010a1a6000 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4f06e00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f06e20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f06e60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4f06ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f06ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f06f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f06f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100134 td 0xfffffe00e4d8c020 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4f10e00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f10e20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f10e60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4f10ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f10ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f10f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f10f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100135 td 0xfffffe00e4d8b900 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4f0be00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f0be20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f0be60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4f0bec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f0bef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f0bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f0bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100136 td 0xfffffe00e4d8b1e0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4f1ae00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f1ae20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f1ae60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4f1aec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f1aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f1af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f1af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100137 td 0xfffffe00e4d8aac0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4f15e00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f15e20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f15e60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4f15ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f15ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f15f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f15f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100138 td 0xfffffe00e4d8a3a0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4f24e00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f24e20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f24e60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4f24ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f24ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f24f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f24f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100139 td 0xfffffe00e4d3a740 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4ecfe00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4ecfe20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4ecfe60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4ecfec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4ecfef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4ecff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ecff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100140 td 0xfffffe010a1a9900 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4f3ae00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f3ae20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f3ae60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4f3aec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f3aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f3af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f3af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100141 td 0xfffffe010a1a91e0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4f35e00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f35e20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f35e60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4f35ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f35ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f35f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f35f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100142 td 0xfffffe010a1a8ac0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4f44e00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f44e20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f44e60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4f44ec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f44ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f44f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f44f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100143 td 0xfffffe010a1a83a0 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4f3fe00 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f3fe20 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f3fe60 _cv_wait() at _cv_wait+0x166/frame 0xfffffe00e4f3fec0 usb_process() at usb_process+0xb3/frame 0xfffffe00e4f3fef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e4f3ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f3ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vmdaemon pid 16 tid 100196 td 0xfffffe010e6593a0 sched_switch() at sched_switch+0x559/frame 0xfffffe010db35d80 mi_switch() at mi_switch+0x157/frame 0xfffffe010db35da0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db35de0 _sleep() at _sleep+0x2e7/frame 0xfffffe010db35e80 vm_daemon() at vm_daemon+0x92/frame 0xfffffe010db35ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db35f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db35f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100197 td 0xfffffe010e658c80 sched_switch() at sched_switch+0x559/frame 0xfffffe010db44d60 mi_switch() at mi_switch+0x157/frame 0xfffffe010db44d80 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db44dc0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db44e00 _sleep() at _sleep+0x2ce/frame 0xfffffe010db44ea0 buf_daemon() at buf_daemon+0x121/frame 0xfffffe010db44ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db44f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db44f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100198 td 0xfffffe010e674560 sched_switch() at sched_switch+0x559/frame 0xfffffe010db5ad40 mi_switch() at mi_switch+0x157/frame 0xfffffe010db5ad60 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db5ada0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db5ade0 _sleep() at _sleep+0x2ce/frame 0xfffffe010db5ae80 bufspace_daemon() at bufspace_daemon+0x312/frame 0xfffffe010db5aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db5af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db5af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100199 td 0xfffffe010e673e40 sched_switch() at sched_switch+0x559/frame 0xfffffe010db55d40 mi_switch() at mi_switch+0x157/frame 0xfffffe010db55d60 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db55da0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db55de0 _sleep() at _sleep+0x2ce/frame 0xfffffe010db55e80 bufspace_daemon() at bufspace_daemon+0x312/frame 0xfffffe010db55ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db55f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db55f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100200 td 0xfffffe010e673720 sched_switch() at sched_switch+0x559/frame 0xfffffe011112dd40 mi_switch() at mi_switch+0x157/frame 0xfffffe011112dd60 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe011112dda0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe011112dde0 _sleep() at _sleep+0x2ce/frame 0xfffffe011112de80 bufspace_daemon() at bufspace_daemon+0x312/frame 0xfffffe011112def0 fork_exit() at fork_exit+0x80/frame 0xfffffe011112df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe011112df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100201 td 0xfffffe010e673000 sched_switch() at sched_switch+0x559/frame 0xfffffe010db5fd40 mi_switch() at mi_switch+0x157/frame 0xfffffe010db5fd60 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db5fda0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db5fde0 _sleep() at _sleep+0x2ce/frame 0xfffffe010db5fe80 bufspace_daemon() at bufspace_daemon+0x312/frame 0xfffffe010db5fef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db5ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db5ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100202 td 0xfffffe010e65b740 sched_switch() at sched_switch+0x559/frame 0xfffffe011193ad40 mi_switch() at mi_switch+0x157/frame 0xfffffe011193ad60 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe011193ada0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe011193ade0 _sleep() at _sleep+0x2ce/frame 0xfffffe011193ae80 bufspace_daemon() at bufspace_daemon+0x312/frame 0xfffffe011193aef0 fork_exit() at fork_exit+0x80/frame 0xfffffe011193af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe011193af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100203 td 0xfffffe010e65b020 sched_switch() at sched_switch+0x559/frame 0xfffffe010db64d40 mi_switch() at mi_switch+0x157/frame 0xfffffe010db64d60 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db64da0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db64de0 _sleep() at _sleep+0x2ce/frame 0xfffffe010db64e80 bufspace_daemon() at bufspace_daemon+0x312/frame 0xfffffe010db64ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db64f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db64f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100204 td 0xfffffe010e65a900 sched_switch() at sched_switch+0x559/frame 0xfffffe0112147d40 mi_switch() at mi_switch+0x157/frame 0xfffffe0112147d60 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0112147da0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0112147de0 _sleep() at _sleep+0x2ce/frame 0xfffffe0112147e80 bufspace_daemon() at bufspace_daemon+0x312/frame 0xfffffe0112147ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe0112147f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0112147f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100219 td 0xfffffe010dda3000 sched_switch() at sched_switch+0x559/frame 0xfffffe0141794d70 mi_switch() at mi_switch+0x157/frame 0xfffffe0141794d90 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0141794dd0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0141794e10 _sleep() at _sleep+0x2ce/frame 0xfffffe0141794eb0 softdep_flush() at softdep_flush+0x188/frame 0xfffffe0141794ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe0141794f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0141794f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100227 td 0xfffffe01428d2ac0 sched_switch() at sched_switch+0x559/frame 0xfffffe01417add70 mi_switch() at mi_switch+0x157/frame 0xfffffe01417add90 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01417addd0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe01417ade10 _sleep() at _sleep+0x2ce/frame 0xfffffe01417adeb0 softdep_flush() at softdep_flush+0x188/frame 0xfffffe01417adef0 fork_exit() at fork_exit+0x80/frame 0xfffffe01417adf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01417adf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vnlru pid 18 tid 100207 td 0xfffffe010e658560 sched_switch() at sched_switch+0x559/frame 0xfffffe010db3fd10 mi_switch() at mi_switch+0x157/frame 0xfffffe010db3fd30 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db3fd70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db3fdb0 _sleep() at _sleep+0x2ce/frame 0xfffffe010db3fe50 vnlru_proc() at vnlru_proc+0x99c/frame 0xfffffe010db3fef0 fork_exit() at fork_exit+0x80/frame 0xfffffe010db3ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db3ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command syncer pid 19 tid 100208 td 0xfffffe010e657e40 sched_switch() at sched_switch+0x559/frame 0xfffffe014174ed40 mi_switch() at mi_switch+0x157/frame 0xfffffe014174ed60 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe014174eda0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe014174ede0 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x19a/frame 0xfffffe014174ee60 sched_sync() at sched_sync+0x63d/frame 0xfffffe014174eef0 fork_exit() at fork_exit+0x80/frame 0xfffffe014174ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe014174ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command dhclient pid 2326 tid 100271 td 0xfffffe0141807c80 sched_switch() at sched_switch+0x559/frame 0xfffffe0143869ab0 mi_switch() at mi_switch+0x157/frame 0xfffffe0143869ad0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0143869b10 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0143869b60 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0143869b70 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe0143869bd0 kern_select() at kern_select+0xa15/frame 0xfffffe0143869dc0 sys_select() at sys_select+0x56/frame 0xfffffe0143869e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0143869f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0143869f30 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x1eeccc2dba5a, rsp = 0x1eecc9006608, rbp = 0x1eecc90066c0 --- Tracing command dhclient pid 2329 tid 100250 td 0xfffffe010e13c560 sched_switch() at sched_switch+0x559/frame 0xfffffe010dbdeae0 mi_switch() at mi_switch+0x157/frame 0xfffffe010dbdeb00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010dbdeb40 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe010dbdeb90 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe010dbdeba0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe010dbdec00 kern_poll_kfds() at kern_poll_kfds+0x4bc/frame 0xfffffe010dbdec90 kern_poll() at kern_poll+0x9f/frame 0xfffffe010dbdede0 sys_poll() at sys_poll+0x50/frame 0xfffffe010dbdee00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe010dbdef30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010dbdef30 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x1eeccc2db95a, rsp = 0x1eecc9006848, rbp = 0x1eecc9006880 --- Tracing command dhclient pid 2388 tid 100273 td 0xfffffe010e6c4720 sched_switch() at sched_switch+0x559/frame 0xfffffe014386ea90 mi_switch() at mi_switch+0x157/frame 0xfffffe014386eab0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe014386eaf0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014386eb40 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe014386eb80 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x19a/frame 0xfffffe014386ec00 kern_poll_kfds() at kern_poll_kfds+0x487/frame 0xfffffe014386ec90 kern_poll() at kern_poll+0x9f/frame 0xfffffe014386ede0 sys_poll() at sys_poll+0x50/frame 0xfffffe014386ee00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe014386ef30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014386ef30 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x1eeccc2db95a, rsp = 0x1eecc9006848, rbp = 0x1eecc9006880 --- Tracing command devd pid 2393 tid 100241 td 0xfffffe014362d000 sched_switch() at sched_switch+0x559/frame 0xfffffe010db88ee0 mi_switch() at mi_switch+0x157/frame 0xfffffe010db88f00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db88f40 sleeplk() at sleeplk+0x107/frame 0xfffffe010db88fa0 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x3ef/frame 0xfffffe010db89040 __lockmgr_args() at __lockmgr_args+0x1f9/frame 0xfffffe010db890e0 getblkx() at getblkx+0x1d1/frame 0xfffffe010db891a0 breadn_flags() at breadn_flags+0x44/frame 0xfffffe010db89210 ffs_realloccg() at ffs_realloccg+0x25d/frame 0xfffffe010db89350 ffs_balloc_ufs2() at ffs_balloc_ufs2+0x517/frame 0xfffffe010db89520 ffs_write() at ffs_write+0x262/frame 0xfffffe010db895d0 VOP_WRITE_APV() at VOP_WRITE_APV+0xcf/frame 0xfffffe010db896e0 vn_io_fault_doio() at vn_io_fault_doio+0xb5/frame 0xfffffe010db89740 vn_io_fault1() at vn_io_fault1+0x163/frame 0xfffffe010db89880 vn_rdwr() at vn_rdwr+0x279/frame 0xfffffe010db89950 vn_rdwr_inchunks() at vn_rdwr_inchunks+0x90/frame 0xfffffe010db899d0 core_output() at core_output+0x171/frame 0xfffffe010db89a80 elf64_coredump() at elf64_coredump+0x5a7/frame 0xfffffe010db89b50 sigexit() at sigexit+0xd57/frame 0xfffffe010db89e20 postsig() at postsig+0x1aa/frame 0xfffffe010db89ef0 ast() at ast+0x4fb/frame 0xfffffe010db89f30 doreti_ast() at doreti_ast+0x1f/frame 0x82042c050 Tracing command syslogd pid 2582 tid 100249 td 0xfffffe010e6c5c80 sched_switch() at sched_switch+0x559/frame 0xfffffe010dbd4ab0 mi_switch() at mi_switch+0x157/frame 0xfffffe010dbd4ad0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010dbd4b10 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe010dbd4b60 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe010dbd4b70 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe010dbd4bd0 kern_select() at kern_select+0xa15/frame 0xfffffe010dbd4dc0 sys_select() at sys_select+0x56/frame 0xfffffe010dbd4e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe010dbd4f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010dbd4f30 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x943664eea5a, rsp = 0x94363b31938, rbp = 0x94363b31ec0 --- Tracing command watchdogd pid 2590 tid 100251 td 0xfffffe0143566ac0 sched_switch() at sched_switch+0x559/frame 0xfffffe010dbe8bb0 mi_switch() at mi_switch+0x157/frame 0xfffffe010dbe8bd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010dbe8c10 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe010dbe8c60 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe010dbe8ca0 _sleep() at _sleep+0x2bf/frame 0xfffffe010dbe8d40 kern_clock_nanosleep() at kern_clock_nanosleep+0x1d1/frame 0xfffffe010dbe8dc0 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe010dbe8e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe010dbe8f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010dbe8f30 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x4b3ed9798da, rsp = 0x4b3ec0c9d38, rbp = 0x4b3ec0c9d80 --- Tracing command rpcbind pid 2612 tid 100280 td 0xfffffe014416b1e0 sched_switch() at sched_switch+0x559/frame 0xfffffe01438a2a90 mi_switch() at mi_switch+0x157/frame 0xfffffe01438a2ab0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01438a2af0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01438a2b40 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe01438a2b80 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x19a/frame 0xfffffe01438a2c00 kern_poll_kfds() at kern_poll_kfds+0x487/frame 0xfffffe01438a2c90 kern_poll() at kern_poll+0x9f/frame 0xfffffe01438a2de0 sys_poll() at sys_poll+0x50/frame 0xfffffe01438a2e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe01438a2f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01438a2f30 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x3753f018c95a, rsp = 0x3753ee9f40a8, rbp = 0x3753ee9f62d0 --- Tracing command rpc.statd pid 2637 tid 100228 td 0xfffffe010dc04740 sched_switch() at sched_switch+0x559/frame 0xfffffe014178fa60 mi_switch() at mi_switch+0x157/frame 0xfffffe014178fa80 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe014178fac0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014178fb10 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe014178fb50 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x19a/frame 0xfffffe014178fbd0 kern_select() at kern_select+0x9ef/frame 0xfffffe014178fdc0 sys_select() at sys_select+0x56/frame 0xfffffe014178fe00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe014178ff30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014178ff30 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x1b7a46230a5a, rsp = 0x1b7a43f74178, rbp = 0x1b7a43f742c0 --- Tracing command rpc.lockd pid 2640 tid 100281 td 0xfffffe010e657000 sched_switch() at sched_switch+0x559/frame 0xfffffe01438b1990 mi_switch() at mi_switch+0x157/frame 0xfffffe01438b19b0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01438b19f0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01438b1a40 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe01438b1a80 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x19a/frame 0xfffffe01438b1b00 svc_run_internal() at svc_run_internal+0xada/frame 0xfffffe01438b1c30 svc_run() at svc_run+0x230/frame 0xfffffe01438b1c90 sys_nlm_syscall() at sys_nlm_syscall+0x6fa/frame 0xfffffe01438b1e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe01438b1f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01438b1f30 --- syscall (154, FreeBSD ELF64, sys_nlm_syscall), rip = 0x24de38e6e19a, rsp = 0x24de385eff88, rbp = 0x24de385f0050 --- Tracing command powerd pid 2645 tid 100242 td 0xfffffe0143631020 sched_switch() at sched_switch+0x559/frame 0xfffffe010dbaca60 mi_switch() at mi_switch+0x157/frame 0xfffffe010dbaca80 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010dbacac0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe010dbacb10 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe010dbacb50 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x19a/frame 0xfffffe010dbacbd0 kern_select() at kern_select+0x9ef/frame 0xfffffe010dbacdc0 sys_select() at sys_select+0x56/frame 0xfffffe010dbace00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe010dbacf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010dbacf30 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x201143cca5a, rsp = 0x20112bcefd8, rbp = 0x20112bcf110 --- Tracing command ntpd pid 2671 tid 100212 td 0xfffffe010e13d3a0 sched_switch() at sched_switch+0x559/frame 0xfffffe014176cab0 mi_switch() at mi_switch+0x157/frame 0xfffffe014176cad0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe014176cb10 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014176cb60 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe014176cb70 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe014176cbd0 kern_select() at kern_select+0xa15/frame 0xfffffe014176cdc0 sys_select() at sys_select+0x56/frame 0xfffffe014176ce00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe014176cf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014176cf30 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x2750c7162a5a, rsp = 0x2750c283a388, rbp = 0x2750c283a3c0 --- Tracing command inetd pid 2697 tid 100285 td 0xfffffe01437af740 sched_switch() at sched_switch+0x559/frame 0xfffffe014388cab0 mi_switch() at mi_switch+0x157/frame 0xfffffe014388cad0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe014388cb10 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014388cb60 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe014388cb70 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe014388cbd0 kern_select() at kern_select+0xa15/frame 0xfffffe014388cdc0 sys_select() at sys_select+0x56/frame 0xfffffe014388ce00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe014388cf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014388cf30 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x1441dde59a5a, rsp = 0x1441db32ccd8, rbp = 0x1441db32db70 --- Tracing command sshd pid 2716 tid 100270 td 0xfffffe014367c020 sched_switch() at sched_switch+0x559/frame 0xfffffe014383cab0 mi_switch() at mi_switch+0x157/frame 0xfffffe014383cad0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe014383cb10 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014383cb60 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe014383cb70 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe014383cbd0 kern_poll_kfds() at kern_poll_kfds+0x4bc/frame 0xfffffe014383cc60 kern_poll() at kern_poll+0x9f/frame 0xfffffe014383cdb0 sys_ppoll() at sys_ppoll+0x6f/frame 0xfffffe014383ce00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe014383cf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014383cf30 --- syscall (545, FreeBSD ELF64, sys_ppoll), rip = 0x2d80974e997a, rsp = 0x2d808f48f948, rbp = 0x2d808f48f980 --- Tracing command cron pid 2720 tid 100217 td 0xfffffe00e4d0c020 --- swapped out Tracing command getty pid 2734 tid 100209 td 0xfffffe010e6c7900 sched_switch() at sched_switch+0x559/frame 0xfffffe0141758af0 mi_switch() at mi_switch+0x157/frame 0xfffffe0141758b10 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0141758b50 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0141758ba0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0141758bb0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe0141758c10 tty_wait() at tty_wait+0x42/frame 0xfffffe0141758c40 ttydisc_read() at ttydisc_read+0x21e/frame 0xfffffe0141758cb0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe0141758ce0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe0141758d40 dofileread() at dofileread+0x81/frame 0xfffffe0141758d90 sys_read() at sys_read+0xc0/frame 0xfffffe0141758e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0141758f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141758f30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x3de130989da, rsp = 0x3de11bcdef8, rbp = 0x3de11bcdf40 --- Tracing command getty pid 2735 tid 100243 td 0xfffffe0143630900 sched_switch() at sched_switch+0x559/frame 0xfffffe010dba7af0 mi_switch() at mi_switch+0x157/frame 0xfffffe010dba7b10 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010dba7b50 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe010dba7ba0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe010dba7bb0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe010dba7c10 tty_wait() at tty_wait+0x42/frame 0xfffffe010dba7c40 ttydisc_read() at ttydisc_read+0x21e/frame 0xfffffe010dba7cb0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe010dba7ce0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe010dba7d40 dofileread() at dofileread+0x81/frame 0xfffffe010dba7d90 sys_read() at sys_read+0xc0/frame 0xfffffe010dba7e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe010dba7f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010dba7f30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x23e0f54a19da, rsp = 0x23e0f2609d38, rbp = 0x23e0f2609d80 --- Tracing command getty pid 2736 tid 100233 td 0xfffffe01418091e0 sched_switch() at sched_switch+0x559/frame 0xfffffe01417cdaf0 mi_switch() at mi_switch+0x157/frame 0xfffffe01417cdb10 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01417cdb50 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01417cdba0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01417cdbb0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe01417cdc10 tty_wait() at tty_wait+0x42/frame 0xfffffe01417cdc40 ttydisc_read() at ttydisc_read+0x21e/frame 0xfffffe01417cdcb0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe01417cdce0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe01417cdd40 dofileread() at dofileread+0x81/frame 0xfffffe01417cdd90 sys_read() at sys_read+0xc0/frame 0xfffffe01417cde00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe01417cdf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01417cdf30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x3296c4e8f9da, rsp = 0x3296c34ca888, rbp = 0x3296c34ca8d0 --- Tracing command getty pid 2737 tid 100232 td 0xfffffe014362d720 sched_switch() at sched_switch+0x559/frame 0xfffffe010db8eaf0 mi_switch() at mi_switch+0x157/frame 0xfffffe010db8eb10 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010db8eb50 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe010db8eba0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe010db8ebb0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe010db8ec10 tty_wait() at tty_wait+0x42/frame 0xfffffe010db8ec40 ttydisc_read() at ttydisc_read+0x21e/frame 0xfffffe010db8ecb0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe010db8ece0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe010db8ed40 dofileread() at dofileread+0x81/frame 0xfffffe010db8ed90 sys_read() at sys_read+0xc0/frame 0xfffffe010db8ee00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe010db8ef30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010db8ef30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x1b720d9029da, rsp = 0x1b720b0522f8, rbp = 0x1b720b052340 --- Tracing command getty pid 2738 tid 100262 td 0xfffffe010e6c5560 sched_switch() at sched_switch+0x559/frame 0xfffffe010dbcfaf0 mi_switch() at mi_switch+0x157/frame 0xfffffe010dbcfb10 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010dbcfb50 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe010dbcfba0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe010dbcfbb0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe010dbcfc10 tty_wait() at tty_wait+0x42/frame 0xfffffe010dbcfc40 ttydisc_read() at ttydisc_read+0x21e/frame 0xfffffe010dbcfcb0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe010dbcfce0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe010dbcfd40 dofileread() at dofileread+0x81/frame 0xfffffe010dbcfd90 sys_read() at sys_read+0xc0/frame 0xfffffe010dbcfe00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe010dbcff30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010dbcff30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x3453f96b99da, rsp = 0x3453f78dabe8, rbp = 0x3453f78dac30 --- Tracing command getty pid 2739 tid 100247 td 0xfffffe0143567900 sched_switch() at sched_switch+0x559/frame 0xfffffe010dbcaaf0 mi_switch() at mi_switch+0x157/frame 0xfffffe010dbcab10 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010dbcab50 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe010dbcaba0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe010dbcabb0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe010dbcac10 tty_wait() at tty_wait+0x42/frame 0xfffffe010dbcac40 ttydisc_read() at ttydisc_read+0x21e/frame 0xfffffe010dbcacb0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe010dbcace0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe010dbcad40 dofileread() at dofileread+0x81/frame 0xfffffe010dbcad90 sys_read() at sys_read+0xc0/frame 0xfffffe010dbcae00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe010dbcaf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010dbcaf30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x11b34dd4e9da, rsp = 0x11b34bf0eb88, rbp = 0x11b34bf0ebd0 --- Tracing command getty pid 2740 tid 100269 td 0xfffffe01418083a0 sched_switch() at sched_switch+0x559/frame 0xfffffe014385aaf0 mi_switch() at mi_switch+0x157/frame 0xfffffe014385ab10 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe014385ab50 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014385aba0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe014385abb0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe014385ac10 tty_wait() at tty_wait+0x42/frame 0xfffffe014385ac40 ttydisc_read() at ttydisc_read+0x21e/frame 0xfffffe014385acb0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe014385ace0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe014385ad40 dofileread() at dofileread+0x81/frame 0xfffffe014385ad90 sys_read() at sys_read+0xc0/frame 0xfffffe014385ae00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe014385af30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014385af30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x264a479e09da, rsp = 0x264a45495f68, rbp = 0x264a45495fb0 --- Tracing command getty pid 2741 tid 100267 td 0xfffffe0143565560 sched_switch() at sched_switch+0x559/frame 0xfffffe01417c3af0 mi_switch() at mi_switch+0x157/frame 0xfffffe01417c3b10 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01417c3b50 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01417c3ba0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01417c3bb0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe01417c3c10 tty_wait() at tty_wait+0x42/frame 0xfffffe01417c3c40 ttydisc_read() at ttydisc_read+0x21e/frame 0xfffffe01417c3cb0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe01417c3ce0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe01417c3d40 dofileread() at dofileread+0x81/frame 0xfffffe01417c3d90 sys_read() at sys_read+0xc0/frame 0xfffffe01417c3e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe01417c3f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01417c3f30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x1a561a2259da, rsp = 0x1a561871a3c8, rbp = 0x1a561871a410 --- Tracing command getty pid 2742 tid 100264 td 0xfffffe010e13b720 sched_switch() at sched_switch+0x559/frame 0xfffffe014384baf0 mi_switch() at mi_switch+0x157/frame 0xfffffe014384bb10 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe014384bb50 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014384bba0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe014384bbb0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe014384bc10 tty_wait() at tty_wait+0x42/frame 0xfffffe014384bc40 ttydisc_read() at ttydisc_read+0x21e/frame 0xfffffe014384bcb0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe014384bce0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe014384bd40 dofileread() at dofileread+0x81/frame 0xfffffe014384bd90 sys_read() at sys_read+0xc0/frame 0xfffffe014384be00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe014384bf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014384bf30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x3cb2d8cc49da, rsp = 0x3cb2d7adfb18, rbp = 0x3cb2d7adfb60 --- Tracing command getty pid 2743 tid 100263 td 0xfffffe010e13be40 sched_switch() at sched_switch+0x559/frame 0xfffffe010dbd9af0 mi_switch() at mi_switch+0x157/frame 0xfffffe010dbd9b10 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010dbd9b50 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe010dbd9ba0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe010dbd9bb0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe010dbd9c10 tty_wait() at tty_wait+0x42/frame 0xfffffe010dbd9c40 ttydisc_read() at ttydisc_read+0x21e/frame 0xfffffe010dbd9cb0 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe010dbd9ce0 devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe010dbd9d40 dofileread() at dofileread+0x81/frame 0xfffffe010dbd9d90 sys_read() at sys_read+0xc0/frame 0xfffffe010dbd9e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe010dbd9f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010dbd9f30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x2dd3210be9da, rsp = 0x2dd31fe290b8, rbp = 0x2dd31fe29100 --- Tracing command sshd pid 2744 tid 100222 td 0xfffffe010e6761e0 sched_switch() at sched_switch+0x559/frame 0xfffffe01417a8ae0 mi_switch() at mi_switch+0x157/frame 0xfffffe01417a8b00 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01417a8b40 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01417a8b90 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01417a8ba0 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe01417a8c00 kern_poll_kfds() at kern_poll_kfds+0x4bc/frame 0xfffffe01417a8c90 kern_poll() at kern_poll+0x9f/frame 0xfffffe01417a8de0 sys_poll() at sys_poll+0x50/frame 0xfffffe01417a8e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe01417a8f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01417a8f30 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x157f8597f95a, rsp = 0x157f7e969ae8, rbp = 0x157f7e969b20 --- Tracing command sshd pid 2747 tid 100211 td 0xfffffe010e657720 sched_switch() at sched_switch+0x559/frame 0xfffffe0141749ab0 mi_switch() at mi_switch+0x157/frame 0xfffffe0141749ad0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0141749b10 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0141749b60 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0141749b70 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe0141749bd0 kern_poll_kfds() at kern_poll_kfds+0x4bc/frame 0xfffffe0141749c60 kern_poll() at kern_poll+0x9f/frame 0xfffffe0141749db0 sys_ppoll() at sys_ppoll+0x6f/frame 0xfffffe0141749e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0141749f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0141749f30 --- syscall (545, FreeBSD ELF64, sys_ppoll), rip = 0x157f8597f97a, rsp = 0x157f7e969898, rbp = 0x157f7e9698d0 --- Tracing command bash pid 2748 tid 100279 td 0xfffffe014416b900 --- swapped out Tracing command su pid 2753 tid 100225 td 0xfffffe014180a020 --- swapped out Tracing command csh pid 2754 tid 100272 td 0xfffffe010e6c4e40 --- swapped out Tracing command bash pid 2756 tid 100229 td 0xfffffe010e6c71e0 --- swapped out Tracing command sh pid 3113 tid 100266 td 0xfffffe0143565c80 --- swapped out Tracing command sh pid 3190 tid 100287 td 0xfffffe01443d4c80 --- swapped out Tracing command sh pid 3235 tid 100382 td 0xfffffe015758ac80 --- swapped out Tracing command awk pid 3236 tid 100320 td 0xfffffe0143678e40 sched_switch() at sched_switch+0x559/frame 0xfffffe014395bb80 mi_switch() at mi_switch+0x157/frame 0xfffffe014395bba0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe014395bbe0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe014395bc30 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe014395bc40 _sleep() at _sleep+0x2dd/frame 0xfffffe014395bce0 pipe_read() at pipe_read+0x4b6/frame 0xfffffe014395bd40 dofileread() at dofileread+0x81/frame 0xfffffe014395bd90 sys_read() at sys_read+0xc0/frame 0xfffffe014395be00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe014395bf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe014395bf30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x2cd09b0b49da, rsp = 0x2cd09887e668, rbp = 0x2cd09887e680 --- Tracing command sh pid 3238 tid 100319 td 0xfffffe0143679560 sched_switch() at sched_switch+0x559/frame 0xfffffe0143850b80 mi_switch() at mi_switch+0x157/frame 0xfffffe0143850ba0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0143850be0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0143850c30 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0143850c40 _sleep() at _sleep+0x2dd/frame 0xfffffe0143850ce0 pipe_read() at pipe_read+0x4b6/frame 0xfffffe0143850d40 dofileread() at dofileread+0x81/frame 0xfffffe0143850d90 sys_read() at sys_read+0xc0/frame 0xfffffe0143850e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0143850f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0143850f30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x168bfc5659da, rsp = 0x168bf9077ad8, rbp = 0x168bf9078000 --- Tracing command sh pid 22723 tid 100246 td 0xfffffe014367aac0 --- swapped out Tracing command tee pid 22724 tid 100214 td 0xfffffe00e4d89c80 sched_switch() at sched_switch+0x559/frame 0xfffffe00e4f1fb80 mi_switch() at mi_switch+0x157/frame 0xfffffe00e4f1fba0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00e4f1fbe0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe00e4f1fc30 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e4f1fc40 _sleep() at _sleep+0x2dd/frame 0xfffffe00e4f1fce0 pipe_read() at pipe_read+0x4b6/frame 0xfffffe00e4f1fd40 dofileread() at dofileread+0x81/frame 0xfffffe00e4f1fd90 sys_read() at sys_read+0xc0/frame 0xfffffe00e4f1fe00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe00e4f1ff30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00e4f1ff30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x2560afa8d9da, rsp = 0x2560ae1fbbf8, rbp = 0x2560ae1fbc50 --- Tracing command sh pid 22725 tid 100478 td 0xfffffe010e13f740 sched_switch() at sched_switch+0x559/frame 0xfffffe01417f0a10 mi_switch() at mi_switch+0x157/frame 0xfffffe01417f0a30 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01417f0a70 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01417f0ac0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01417f0ad0 _sleep() at _sleep+0x2dd/frame 0xfffffe01417f0b70 kern_wait6() at kern_wait6+0x474/frame 0xfffffe01417f0c00 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe01417f0e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe01417f0f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01417f0f30 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x311141b3bbba, rsp = 0x31113ee2cb38, rbp = 0x31113ee2cbf0 --- Tracing command md10 pid 22736 tid 100462 td 0xfffffe014416a3a0 sched_switch() at sched_switch+0x559/frame 0xfffffe014394cda0 mi_switch() at mi_switch+0x157/frame 0xfffffe014394cdc0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe014394ce00 _sleep() at _sleep+0x2e7/frame 0xfffffe014394cea0 md_kthread() at md_kthread+0xd5/frame 0xfffffe014394cef0 fork_exit() at fork_exit+0x80/frame 0xfffffe014394cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe014394cf30 --- trap 0xc, rip = 0x168bfc5655fa, rsp = 0x168bf90782b8, rbp = 0x168bf90783b0 --- Tracing command md11 pid 22746 tid 100284 td 0xfffffe01436301e0 sched_switch() at sched_switch+0x559/frame 0xfffffe01438c5da0 mi_switch() at mi_switch+0x157/frame 0xfffffe01438c5dc0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01438c5e00 _sleep() at _sleep+0x2e7/frame 0xfffffe01438c5ea0 md_kthread() at md_kthread+0xd5/frame 0xfffffe01438c5ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe01438c5f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01438c5f30 --- trap 0xc, rip = 0x3cbbc65955fa, rsp = 0x3cbbc126e8b8, rbp = 0x3cbbc126e8d0 --- Tracing command su pid 22748 tid 100216 td 0xfffffe014180a740 --- swapped out Tracing command swap pid 22754 tid 100294 td 0xfffffe010e6c8740 sched_switch() at sched_switch+0x559/frame 0xfffffe01438edbb0 mi_switch() at mi_switch+0x157/frame 0xfffffe01438edbd0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01438edc10 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe01438edc60 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe01438edca0 _sleep() at _sleep+0x2bf/frame 0xfffffe01438edd40 kern_clock_nanosleep() at kern_clock_nanosleep+0x1d1/frame 0xfffffe01438eddc0 sys_nanosleep() at sys_nanosleep+0x3b/frame 0xfffffe01438ede00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe01438edf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01438edf30 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x18b4b8dd38da, rsp = 0x18b4b7324ab8, rbp = 0x18b4b7324b00 --- Tracing command swap pid 22756 tid 100248 td 0xfffffe01435671e0 sched_switch() at sched_switch+0x559/frame 0xfffffe010dbc5a10 mi_switch() at mi_switch+0x157/frame 0xfffffe010dbc5a30 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe010dbc5a70 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe010dbc5ac0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe010dbc5ad0 _sleep() at _sleep+0x2dd/frame 0xfffffe010dbc5b70 kern_wait6() at kern_wait6+0x474/frame 0xfffffe010dbc5c00 sys_wait4() at sys_wait4+0x7d/frame 0xfffffe010dbc5e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe010dbc5f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010dbc5f30 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x18b4b8dd3bba, rsp = 0x18b4b7324b08, rbp = 0x18b4b7324c30 --- Tracing command swap pid 22758 tid 100445 td 0xfffffe015765c720 (CPU 6) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce61e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce61e10 trap() at trap+0x56/frame 0xfffffe003ce61f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce61f20 --- trap 0x13, rip = 0xffffffff80f90a81, rsp = 0xfffffe0157845c60, rbp = 0xfffffe0157845d80 --- vm_fault_dirty() at vm_fault_dirty+0x1/frame 0xfffffe0157845d80 vm_fault_trap() at vm_fault_trap+0x71/frame 0xfffffe0157845dc0 trap_pfault() at trap_pfault+0x22d/frame 0xfffffe0157845e20 trap() at trap+0x442/frame 0xfffffe0157845f30 calltrap() at calltrap+0x8/frame 0xfffffe0157845f30 --- trap 0xc, rip = 0x18b4b8df2f65, rsp = 0x18b4b7324748, rbp = 0x18b4b7324790 --- Tracing command swap pid 22759 tid 100453 td 0xfffffe0157636000 (CPU 9) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce88e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce88e10 trap() at trap+0x56/frame 0xfffffe003ce88f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce88f20 --- trap 0x13, rip = 0xffffffff810f841d, rsp = 0xfffffe01439c9c60, rbp = 0xfffffe01439c9c60 --- pagezero_erms() at pagezero_erms+0xd/frame 0xfffffe01439c9c60 vm_fault() at vm_fault+0xd61/frame 0xfffffe01439c9d80 vm_fault_trap() at vm_fault_trap+0x71/frame 0xfffffe01439c9dc0 trap_pfault() at trap_pfault+0x22d/frame 0xfffffe01439c9e20 trap() at trap+0x442/frame 0xfffffe01439c9f30 calltrap() at calltrap+0x8/frame 0xfffffe01439c9f30 --- trap 0xc, rip = 0x18b4b8df2f65, rsp = 0x18b4b7324748, rbp = 0x18b4b7324790 --- Tracing command swap pid 22760 tid 100471 td 0xfffffe014ecb8740 sched_switch() at sched_switch+0x559/frame 0xfffffe014380eee0 mi_switch() at mi_switch+0x157/frame 0xfffffe014380ef00 ipi_bitmap_handler() at ipi_bitmap_handler+0x87/frame 0xfffffe014380ef30 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0xb3/frame 0xfffffe014380ef30 --- interrupt, rip = 0x18ac9728e76c, rsp = 0x18b4b7324ad0, rbp = 0x18b4b7324b00 --- Tracing command swap pid 22761 tid 100431 td 0xfffffe01576383a0 (CPU 10) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce95e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce95e10 trap() at trap+0x56/frame 0xfffffe003ce95f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce95f20 --- trap 0x13, rip = 0x18ac9728e760, rsp = 0x18b4b7324ad0, rbp = 0x18b4b7324b00 --- Tracing command swap pid 22762 tid 100430 td 0xfffffe0157638ac0 (CPU 0) cpustop_handler() at cpustop_handler+0x28/frame 0xffffffff81fec510 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xffffffff81fec520 trap() at trap+0x56/frame 0xffffffff81fec630 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81fec630 --- trap 0x13, rip = 0x18ac9728e760, rsp = 0x18b4b7324ad0, rbp = 0x18b4b7324b00 --- Tracing command swap pid 22763 tid 100429 td 0xfffffe01576391e0 (CPU -1) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce3ae00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce3ae10 trap() at trap+0x56/frame 0xfffffe003ce3af20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce3af20 --- trap 0x13, rip = 0xffffffff810d2e86, rsp = 0xfffffe01439f1e18, rbp = 0xfffffe01439f1e18 --- fpurestore_xrstor64() at fpurestore_xrstor64+0x16/frame 0xfffffe01439f1e18 restore_fpu_curthread() at restore_fpu_curthread+0x85/frame 0xfffffe01439f1e38 done_load_dr() at done_load_dr+0x31/frame 0xfffffe01439f1ee0 mi_switch() at mi_switch+0x157/frame 0xfffffe01439f1f00 ipi_bitmap_handler() at ipi_bitmap_handler+0x87/frame 0xfffffe01439f1f30 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0xb3/frame 0xfffffe01439f1f30 --- interrupt, rip = 0x18ac9728e760, rsp = 0x18b4b7324ad0, rbp = 0x18b4b7324b00 --- Tracing command swap pid 22764 tid 100428 td 0xfffffe0157639900 (CPU 4) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce47e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce47e10 trap() at trap+0x56/frame 0xfffffe003ce47f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce47f20 --- trap 0x13, rip = 0xffffffff810f841b, rsp = 0xfffffe01439e2c60, rbp = 0xfffffe01439e2c60 --- pagezero_erms() at pagezero_erms+0xb/frame 0xfffffe01439e2c60 vm_fault() at vm_fault+0xd61/frame 0xfffffe01439e2d80 vm_fault_trap() at vm_fault_trap+0x71/frame 0xfffffe01439e2dc0 trap_pfault() at trap_pfault+0x22d/frame 0xfffffe01439e2e20 trap() at trap+0x442/frame 0xfffffe01439e2f30 calltrap() at calltrap+0x8/frame 0xfffffe01439e2f30 --- trap 0xc, rip = 0x18b4b8df2f65, rsp = 0x18b4b7324748, rbp = 0x18b4b7324790 --- Tracing command swap pid 22765 tid 100427 td 0xfffffe015763a020 sched_switch() at sched_switch+0x559/frame 0xfffffe01439e7ee0 mi_switch() at mi_switch+0x157/frame 0xfffffe01439e7f00 ipi_bitmap_handler() at ipi_bitmap_handler+0x87/frame 0xfffffe01439e7f30 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0xb3/frame 0xfffffe01439e7f30 --- interrupt, rip = 0x18ac9728e76f, rsp = 0x18b4b7324ad0, rbp = 0x18b4b7324b00 --- Tracing command swap pid 22766 tid 100426 td 0xfffffe015763a740 sched_switch() at sched_switch+0x559/frame 0xfffffe01439d8ee0 mi_switch() at mi_switch+0x157/frame 0xfffffe01439d8f00 ipi_bitmap_handler() at ipi_bitmap_handler+0x87/frame 0xfffffe01439d8f30 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0xb3/frame 0xfffffe01439d8f30 --- interrupt, rip = 0x18ac9728e760, rsp = 0x18b4b7324ad0, rbp = 0x18b4b7324b00 --- Tracing command swap pid 22767 tid 100425 td 0xfffffe0157647000 (CPU 11) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003cea2e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003cea2e10 trap() at trap+0x56/frame 0xfffffe003cea2f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003cea2f20 --- trap 0x13, rip = 0xffffffff80faa3fa, rsp = 0xfffffe01439ddb20, rbp = 0xfffffe01439ddb90 --- vm_page_alloc_domain_after() at vm_page_alloc_domain_after+0x22a/frame 0xfffffe01439ddb90 vm_page_alloc() at vm_page_alloc+0x64/frame 0xfffffe01439ddbf0 vm_fault_allocate() at vm_fault_allocate+0x1f0/frame 0xfffffe01439ddc60 vm_fault() at vm_fault+0x366/frame 0xfffffe01439ddd80 vm_fault_trap() at vm_fault_trap+0x71/frame 0xfffffe01439dddc0 trap_pfault() at trap_pfault+0x22d/frame 0xfffffe01439dde20 trap() at trap+0x442/frame 0xfffffe01439ddf30 calltrap() at calltrap+0x8/frame 0xfffffe01439ddf30 --- trap 0xc, rip = 0x18b4b8df2f65, rsp = 0x18b4b7324748, rbp = 0x18b4b7324790 --- Tracing command swap pid 22768 tid 100424 td 0xfffffe014362de40 sched_switch() at sched_switch+0x559/frame 0xfffffe01439ceee0 mi_switch() at mi_switch+0x157/frame 0xfffffe01439cef00 ipi_bitmap_handler() at ipi_bitmap_handler+0x87/frame 0xfffffe01439cef30 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0xb3/frame 0xfffffe01439cef30 --- interrupt, rip = 0x18ac9728e760, rsp = 0x18b4b7324ad0, rbp = 0x18b4b7324b00 --- Tracing command swap pid 22769 tid 100423 td 0xfffffe014362e560 sched_switch() at sched_switch+0x559/frame 0xfffffe01439d3ee0 mi_switch() at mi_switch+0x157/frame 0xfffffe01439d3f00 ipi_bitmap_handler() at ipi_bitmap_handler+0x87/frame 0xfffffe01439d3f30 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0xb3/frame 0xfffffe01439d3f30 --- interrupt, rip = 0x18ac9728e765, rsp = 0x18b4b7324ad0, rbp = 0x18b4b7324b00 --- Tracing command swap pid 22770 tid 100422 td 0xfffffe010e13dac0 sched_switch() at sched_switch+0x559/frame 0xfffffe014397ea80 mi_switch() at mi_switch+0x157/frame 0xfffffe014397eaa0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe014397eae0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe014397eb20 _sleep() at _sleep+0x2ce/frame 0xfffffe014397ebc0 vm_waitpfault() at vm_waitpfault+0x76/frame 0xfffffe014397ebf0 vm_fault_allocate() at vm_fault_allocate+0x22f/frame 0xfffffe014397ec60 vm_fault() at vm_fault+0x366/frame 0xfffffe014397ed80 vm_fault_trap() at vm_fault_trap+0x71/frame 0xfffffe014397edc0 trap_pfault() at trap_pfault+0x22d/frame 0xfffffe014397ee20 trap() at trap+0x442/frame 0xfffffe014397ef30 calltrap() at calltrap+0x8/frame 0xfffffe014397ef30 --- trap 0xc, rip = 0x18b4b8df2f65, rsp = 0x18b4b7324748, rbp = 0x18b4b7324790 --- Tracing command swap pid 22771 tid 100421 td 0xfffffe01445831e0 sched_switch() at sched_switch+0x559/frame 0xfffffe0141785ee0 mi_switch() at mi_switch+0x157/frame 0xfffffe0141785f00 ipi_bitmap_handler() at ipi_bitmap_handler+0x87/frame 0xfffffe0141785f30 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0xb3/frame 0xfffffe0141785f30 --- interrupt, rip = 0x18ac9728e765, rsp = 0x18b4b7324ad0, rbp = 0x18b4b7324b00 --- Tracing command swap pid 22772 tid 100420 td 0xfffffe01445823a0 (CPU 5) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce54e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce54e10 trap() at trap+0x56/frame 0xfffffe003ce54f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce54f20 --- trap 0x13, rip = 0xffffffff80fb6b9d, rsp = 0xfffffe01439abc30, rbp = 0xfffffe01439abc30 --- vm_object_set_writeable_dirty() at vm_object_set_writeable_dirty+0x1d/frame 0xfffffe01439abc30 vm_fault_dirty() at vm_fault_dirty+0x46/frame 0xfffffe01439abc60 vm_fault() at vm_fault+0x1140/frame 0xfffffe01439abd80 vm_fault_trap() at vm_fault_trap+0x71/frame 0xfffffe01439abdc0 trap_pfault() at trap_pfault+0x22d/frame 0xfffffe01439abe20 trap() at trap+0x442/frame 0xfffffe01439abf30 calltrap() at calltrap+0x8/frame 0xfffffe01439abf30 --- trap 0xc, rip = 0x18b4b8df2f65, rsp = 0x18b4b7324748, rbp = 0x18b4b7324790 --- Tracing command swap pid 22773 tid 100419 td 0xfffffe010e13e1e0 sched_switch() at sched_switch+0x559/frame 0xfffffe01439b5ee0 mi_switch() at mi_switch+0x157/frame 0xfffffe01439b5f00 ipi_bitmap_handler() at ipi_bitmap_handler+0x87/frame 0xfffffe01439b5f30 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0xb3/frame 0xfffffe01439b5f30 --- interrupt, rip = 0x18ac9728e760, rsp = 0x18b4b7324ad0, rbp = 0x18b4b7324b00 --- Tracing command swap pid 22774 tid 100418 td 0xfffffe0144582ac0 (CPU 8) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce7be00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce7be10 trap() at trap+0x56/frame 0xfffffe003ce7bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce7bf20 --- trap 0x13, rip = 0xffffffff810d0a4b, rsp = 0xfffffe0143979f40, rbp = 0x18b4b7324790 --- doreti_ast() at doreti_ast+0x1/frame 0x18b4b7324790 Tracing command swap pid 22775 tid 100417 td 0xfffffe010e13f020 sched_switch() at sched_switch+0x559/frame 0xfffffe01439bfa80 mi_switch() at mi_switch+0x157/frame 0xfffffe01439bfaa0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe01439bfae0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe01439bfb20 _sleep() at _sleep+0x2ce/frame 0xfffffe01439bfbc0 vm_waitpfault() at vm_waitpfault+0x76/frame 0xfffffe01439bfbf0 vm_fault_allocate() at vm_fault_allocate+0x22f/frame 0xfffffe01439bfc60 vm_fault() at vm_fault+0x366/frame 0xfffffe01439bfd80 vm_fault_trap() at vm_fault_trap+0x71/frame 0xfffffe01439bfdc0 trap_pfault() at trap_pfault+0x22d/frame 0xfffffe01439bfe20 trap() at trap+0x442/frame 0xfffffe01439bff30 calltrap() at calltrap+0x8/frame 0xfffffe01439bff30 --- trap 0xc, rip = 0x18b4b8df2f65, rsp = 0x18b4b7324748, rbp = 0x18b4b7324790 --- Tracing command swap pid 22776 tid 100416 td 0xfffffe015758c1e0 (CPU 1) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe003ce20e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003ce20e10 trap() at trap+0x56/frame 0xfffffe003ce20f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce20f20 --- trap 0x13, rip = 0xffffffff80fbd6ee, rsp = 0xfffffe01439b0970, rbp = 0xfffffe01439b09b0 --- vm_reserv_free_page() at vm_reserv_free_page+0x31e/frame 0xfffffe01439b09b0 vm_page_free_prep() at vm_page_free_prep+0x1eb/frame 0xfffffe01439b09d0 vm_page_free_toq() at vm_page_free_toq+0x12/frame 0xfffffe01439b0a00 vm_object_terminate() at vm_object_terminate+0x10d/frame 0xfffffe01439b0a30 vm_object_deallocate() at vm_object_deallocate+0x2bb/frame 0xfffffe01439b0a60 vm_map_process_deferred() at vm_map_process_deferred+0xa9/frame 0xfffffe01439b0a80 vm_map_remove() at vm_map_remove+0xee/frame 0xfffffe01439b0ab0 vmspace_exit() at vmspace_exit+0xa9/frame 0xfffffe01439b0ae0 exit1() at exit1+0x528/frame 0xfffffe01439b0b50 sigexit() at sigexit+0x157/frame 0xfffffe01439b0e20 postsig() at postsig+0x1aa/frame 0xfffffe01439b0ef0 ast() at ast+0x4fb/frame 0xfffffe01439b0f30 doreti_ast() at doreti_ast+0x1f/frame 0x18b4b7324b00 Tracing command sh pid 22785 tid 100464 td 0xfffffe01428d1c80 sched_switch() at sched_switch+0x559/frame 0xfffffe0143956b80 mi_switch() at mi_switch+0x157/frame 0xfffffe0143956ba0 sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0143956be0 sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0143956c30 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0143956c40 _sleep() at _sleep+0x2dd/frame 0xfffffe0143956ce0 pipe_read() at pipe_read+0x4b6/frame 0xfffffe0143956d40 dofileread() at dofileread+0x81/frame 0xfffffe0143956d90 sys_read() at sys_read+0xc0/frame 0xfffffe0143956e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe0143956f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0143956f30 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x168bfc5659da, rsp = 0x168bf9077bd8, rbp = 0x168bf9077d60 --- Tracing command swapoff pid 22861 tid 100238 td 0xfffffe010e6753a0 (CPU 7) kdb_enter() at kdb_enter+0x32/frame 0xfffffe010dba2bb0 vpanic() at vpanic+0x1b0/frame 0xfffffe010dba2c00 panic() at panic+0x43/frame 0xfffffe010dba2c60 swapoff_one() at swapoff_one+0x71b/frame 0xfffffe010dba2d00 kern_swapoff() at kern_swapoff+0x1ac/frame 0xfffffe010dba2e00 amd64_syscall() at amd64_syscall+0x145/frame 0xfffffe010dba2f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010dba2f30 --- syscall (582, FreeBSD ELF64, sys_swapoff), rip = 0x1ef06e4435da, rsp = 0x1ef06b2ec608, rbp = 0x1ef06b2ec740 --- Tracing command sh pid 22862 tid 100451 td 0xfffffe01443d3720 fork_trampoline() at fork_trampoline db> (kgdb) bt #0 __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:55 #1 dump_savectx () at ../../../kern/kern_shutdown.c:401 #2 0xffffffff80c12ab8 in dumpsys (di=0x0) at /usr/src/sys/x86/include/dump.h:87 #3 doadump (textdump=textdump@entry=0x0) at ../../../kern/kern_shutdown.c:430 #4 0xffffffff804c98ba in db_dump (dummy=, dummy2=, dummy3=, dummy4=) at ../../../ddb/db_command.c:575 #5 0xffffffff804c9772 in db_command (last_cmdp=, cmd_table=, dopager=dopager@entry=0x0) at ../../../ddb/db_command.c:482 #6 0xffffffff804c9806 in db_command_script (command=command@entry=0xffffffff81bd61c0 "dump") at ../../../ddb/db_command.c:553 #7 0xffffffff804ceb38 in db_script_exec (scriptname=0xffffffff81bd5b30 "dump", warnifnotfound=) at ../../../ddb/db_script.c:304 #8 0xffffffff804c9772 in db_command (last_cmdp=, cmd_table=, dopager=dopager@entry=0x0) at ../../../ddb/db_command.c:482 #9 0xffffffff804c9806 in db_command_script (command=command@entry=0xffffffff81bd6152 "run pho1") at ../../../ddb/db_command.c:553 #10 0xffffffff804ceb38 in db_script_exec (scriptname=0xffffffff81bd5b30 "dump", warnifnotfound=) at ../../../ddb/db_script.c:304 #11 0xffffffff804c9772 in db_command (last_cmdp=, cmd_table=, dopager=dopager@entry=0x1) at ../../../ddb/db_command.c:482 #12 0xffffffff804c93cd in db_command_loop () at ../../../ddb/db_command.c:535 #13 0xffffffff804cca06 in db_trap (type=, code=) at ../../../ddb/db_main.c:270 #14 0xffffffff80c6141b in kdb_trap (type=type@entry=0x3, code=code@entry=0x0, tf=tf@entry=0xfffffe010dba2af0) at ../../../kern/subr_kdb.c:734 #15 0xffffffff810fc85a in trap (frame=0xfffffe010dba2af0) at ../../../amd64/amd64/trap.c:609 #16 #17 kdb_enter (why=, msg=) at ../../../kern/subr_kdb.c:507 #18 0xffffffff80c12c90 in vpanic (fmt=0xffffffff81234bf1 "%s: read from swap failed: %d", ap=ap@entry=0xfffffe010dba2c40) at ../../../kern/kern_shutdown.c:963 #19 0xffffffff80c12a03 in panic (fmt=0xffffffff81e8ee80 "\177\026,\201\377\377\377\377") at ../../../kern/kern_shutdown.c:899 #20 0xffffffff80f8049b in swap_pager_swapoff_object (sp=0xfffff80452503d80, object=) at ../../../vm/swap_pager.c:1895 #21 swap_pager_swapoff (sp=0xfffff80452503d80) at ../../../vm/swap_pager.c:1957 #22 swapoff_one (sp=sp@entry=0xfffff80452503d80, cred=, flags=flags@entry=0x0) at ../../../vm/swap_pager.c:2581 #23 0xffffffff80f7fbdc in kern_swapoff (td=0xfffffe010e6753a0, name=, name_seg=UIO_USERSPACE, flags=0x0) at ../../../vm/swap_pager.c:2513 #24 0xffffffff810fd635 in syscallenter (td=0xfffffe010e6753a0) at ../../../amd64/amd64/../../kern/subr_syscall.c:189 #25 amd64_syscall (td=0xfffffe010e6753a0, traced=0x0) at ../../../amd64/amd64/trap.c:1191 #26 #27 0x00001ef06e4435da in ?? () Backtrace stopped: Cannot access memory at address 0x1ef06b2ec608 (kgdb) f 20 #20 0xffffffff80f8049b in swap_pager_swapoff_object (sp=0xfffff80452503d80, object=) at ../../../vm/swap_pager.c:1895 1895 panic("%s: read from swap failed: %d", (kgdb) l 1890 vm_object_pip_add(object, 1); 1891 rahead = SWAP_META_PAGES; 1892 rv = swap_pager_getpages_locked(object, &m, 1, NULL, 1893 &rahead); 1894 if (rv != VM_PAGER_OK) 1895 panic("%s: read from swap failed: %d", 1896 __func__, rv); 1897 vm_object_pip_wakeupn(object, 1); 1898 VM_OBJECT_WLOCK(object); 1899 vm_page_xunbusy(m); (kgdb) info loc pi = 0x0 sb = i = 0xc nv = blk = m = 0xfffffe0000fec020 rahead = 0x3 rv = (kgdb) diff --git a/sys/vm/vm_pageout.c b/sys/vm/vm_pageout.c index 36d5f32758002..fbb2cd4128f00 100644 --- a/sys/vm/vm_pageout.c +++ b/sys/vm/vm_pageout.c @@ -1061,15 +1061,13 @@ vm_pageout_laundry_worker(void *arg) * clean pages freed by the page daemon since the last * background laundering. Thus, as the ratio of dirty to * clean inactive pages grows, the amount of memory pressure - * required to trigger laundering decreases. We ensure - * that the threshold is non-zero after an inactive queue - * scan, even if that scan failed to free a single clean page. + * required to trigger laundering decreases. */ trybackground: nclean = vmd->vmd_free_count + vmd->vmd_pagequeues[PQ_INACTIVE].pq_cnt; ndirty = vmd->vmd_pagequeues[PQ_LAUNDRY].pq_cnt; - if (target == 0 && ndirty * isqrt(howmany(nfreed + 1, + if (target == 0 && ndirty * isqrt(howmany(nfreed, vmd->vmd_free_target - vmd->vmd_free_min)) >= nclean) { target = vmd->vmd_background_launder_target; } -- Test scenario: misc/swapoff2.sh