KDB: enter: watchdog timeout (with a one hour timeout), vmcore.383 KDB: debugger backends: ddb KDB: current backend: ddb ---<>--- Copyright (c) 1992-2024 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 15.0-CURRENT #3 main-n271204-7773023b72de1-dirty: Mon Jul 15 19:29:19 CEST 2024 pho@mercat1.netperf.freebsd.org:/usr/src/sys/amd64/compile/PHO amd64 FreeBSD clang version 18.1.6 (https://github.com/llvm/llvm-project.git llvmorg-18.1.6-0-g1118c2e05e67) WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. VT(vga): resolution 640x480 CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.06-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab Structured Extended Features3=0x9c000400 XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics real memory = 34359738368 (32768 MB) avail memory = 33171079168 (31634 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 12 CPUs FreeBSD/SMP: 1 package(s) x 6 core(s) x 2 hardware threads random: registering fast source Intel Secure Key RNG random: fast provider: "Intel Secure Key RNG" random: unblocking device. ioapic0 irqs 0-23 ioapic1 irqs 24-47 Launching APs: 1 2 9 11 5 4 7 10 8 6 3 random: entropy device external interface kbd1 at kbdmux0 vtvga0: smbios0: at iomem 0xf05e0-0xf05fe smbios0: Version: 3.0, BCD Revision: 3.0 aesni0: acpi0: <> acpi0: Power Button (fixed) cpu0: on acpi0 atrtc0: port 0x70-0x71,0x74-0x77 irq 8 on acpi0 atrtc0: registered as a time-of-day clock, resolution 1.000000s Event timer "RTC" frequency 32768 Hz quality 0 attimer0: port 0x40-0x43,0x50-0x53 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Event timer "HPET" frequency 14318180 Hz quality 350 Event timer "HPET1" frequency 14318180 Hz quality 340 Event timer "HPET2" frequency 14318180 Hz quality 340 Event timer "HPET3" frequency 14318180 Hz quality 340 Event timer "HPET4" frequency 14318180 Hz quality 340 Event timer "HPET5" frequency 14318180 Hz quality 340 Event timer "HPET6" frequency 14318180 Hz quality 340 Event timer "HPET7" frequency 14318180 Hz quality 340 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 pcib0: on acpi0 pci0: on pcib0 pci0: at device 11.1 (no driver attached) pci0: at device 11.2 (no driver attached) pci0: at device 16.1 (no driver attached) pci0: at device 16.6 (no driver attached) pci0: at device 18.1 (no driver attached) acpi_syscontainer0: on acpi0 pcib1: port 0xcf8-0xcff on acpi0 pci1: on pcib1 pcib2: irq 26 at device 1.0 on pci1 pci2: on pcib2 pcib3: irq 32 at device 2.0 on pci1 pci3: on pcib3 pci3: at device 0.0 (no driver attached) pci3: at device 0.1 (no driver attached) pcib4: irq 40 at device 3.0 on pci1 pci4: on pcib4 pci1: at device 17.0 (no driver attached) ahci0: port 0xf110-0xf117,0xf100-0xf103,0xf0f0-0xf0f7,0xf0e0-0xf0e3,0xf020-0xf03f mem 0xfb416000-0xfb4167ff irq 16 at device 17.4 on pci1 ahci0: AHCI v1.30 with 4 6Gbps ports, Port Multiplier not supported ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahcich2: at channel 2 on ahci0 ahcich3: at channel 3 on ahci0 ahciem0: on ahci0 xhci0: mem 0xfb400000-0xfb40ffff irq 19 at device 20.0 on pci1 xhci0: 32 bytes context size, 64-bit DMA usbus0 on xhci0 usbus0: 5.0Gbps Super Speed USB v3.0 pci1: at device 22.0 (no driver attached) pci1: at device 22.1 (no driver attached) ehci0: mem 0xfb412000-0xfb4123ff irq 18 at device 26.0 on pci1 usbus1: EHCI version 1.0 usbus1 on ehci0 usbus1: 480Mbps High Speed USB v2.0 pcib5: irq 16 at device 28.0 on pci1 pci5: on pcib5 pcib6: irq 18 at device 28.2 on pci1 pci6: on pcib6 pcib7: at device 0.0 on pci6 pci7: on pcib7 vgapci0: port 0xe000-0xe07f mem 0xfa000000-0xfaffffff,0xfb000000-0xfb01ffff irq 18 at device 0.0 on pci7 vgapci0: Boot video device pcib8: irq 16 at device 28.4 on pci1 pci8: on pcib8 igb0: port 0xd020-0xd03f mem 0xfb320000-0xfb33ffff,0xfb344000-0xfb347fff irq 16 at device 0.0 on pci8 igb0: EEPROM V1.63-0 eTrack 0x800009fa igb0: Using 1024 TX descriptors and 1024 RX descriptors igb0: queue equality override not set, capping rx_queues at 6 and tx_queues at 6 igb0: Using 6 RX queues 6 TX queues igb0: Using MSI-X interrupts with 7 vectors igb0: Ethernet address: 0c:c4:7a:a8:cd:da igb0: netmap queues/slots: TX 6/1024, RX 6/1024 igb1: port 0xd000-0xd01f mem 0xfb300000-0xfb31ffff,0xfb340000-0xfb343fff irq 17 at device 0.1 on pci8 igb1: EEPROM V1.63-0 eTrack 0x800009fa igb1: Using 1024 TX descriptors and 1024 RX descriptors igb1: queue equality override not set, capping rx_queues at 6 and tx_queues at 6 igb1: Using 6 RX queues 6 TX queues igb1: Using MSI-X interrupts with 7 vectors igb1: Ethernet address: 0c:c4:7a:a8:cd:db igb1: netmap queues/slots: TX 6/1024, RX 6/1024 ehci1: mem 0xfb411000-0xfb4113ff irq 18 at device 29.0 on pci1 usbus2: EHCI version 1.0 usbus2 on ehci1 usbus2: 480Mbps High Speed USB v2.0 isab0: at device 31.0 on pci1 isa0: on isab0 ahci1: port 0xf070-0xf077,0xf060-0xf063,0xf050-0xf057,0xf040-0xf043,0xf000-0xf01f mem 0xfb410000-0xfb4107ff irq 16 at device 31.2 on pci1 ahci1: AHCI v1.30 with 6 6Gbps ports, Port Multiplier not supported ahcich4: at channel 0 on ahci1 ahcich5: at channel 1 on ahci1 ahcich6: at channel 2 on ahci1 ahcich7: at channel 3 on ahci1 ahcich8: at channel 4 on ahci1 ahcich9: at channel 5 on ahci1 ahciem1: on ahci1 acpi_button0: on acpi0 apei0: on acpi0 uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0 uart1: console (115200,n,8,1) orm0: at iomem 0xc0000-0xc7fff,0xcb000-0xcbfff pnpid ORM0000 on isa0 est0: on cpu0 NULL mp in getnewvnode(9), tag crossmp Timecounter "TSC-low" frequency 1749998545 Hz quality 1000 Timecounters tick every 1.000 msec Expensive callout(9) function: 0xffffffff804e07a0(0xfffffe010a7d1000) 0.009177689 s ada0 at ahcich1 bus 0 scbus1 target 0 lun 0 ada0: ACS-2 ATA SATA 3.x device ada0: Serial Number WD-WCC3F3KDDP98 ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes) ada0: Command Queueing enabled ada0: 953869MB (1953525168 512 byte sectors) ada0: quirks=0x1<4K> ses0 at ahciem0 bus 0 scbus4 target 0 lun 0 ses0: SEMB S-E-S 2.00 device ses0: SEMB SES Device ses1 at ahciem1 bus 0 scbus11 target 0 lun 0 ses1: SEMB S-E-S 2.00 device ses1: SEMB SES Device ses0: ada0,pass0 in 'Slot 01', SATA Slot: scbus1 target 0 mlx5_core0: mem 0xf8000000-0xf9ffffff irq 32 at device 0.0 on pci3 mlx5: Mellanox Core driver 3.7.1 (November 2021)ugen2.1: at usbus2 ugen1.1: at usbus1 uhub0 on usbus2 uhub0: on usbus2 uhub1 on usbus1 uhub1: on usbus1 ugen0.1: at usbus0 uhub2 on usbus0 uhub2: on usbus0 mlx5_core0: WARN: mlx5_vsc_set_space:125:(pid 0): Space 0x7 is not supported. mlx5_core0: WARN: mlx5_fwdump_prep:99:(pid 0): VSC scan space is not supported mlx5_core0: INFO: init_one:1713:(pid 0): cannot find SR-IOV PCIe cap mlx5_core: INFO: (mlx5_core0): E-Switch: Total vports 1, l2 table size(65536), per vport: max uc(1024) max mc(16384) mlx5_core0: Failed to initialize SR-IOV support, erroSetting hostuuid: 00000000-0000-0000-0000-002590c99976. Setting hostid: 0x90b83241. Starting file system checks: WARNING: / was not properly dismounted Mounting local filesystems:. Autoloading module: acpi_wmi Autoloading module: ichsmb Autoloading module: ioat ioat0: mem 0x383ffff1c000-0x383ffff1ffff irq 31 at device 4.0 on pci1 ioat0: Capabilities: 2f7 ioat1: mem 0x383ffff18000-0x383ffff1bfff irq 39 at device 4.1 on pci1 ioat1: Capabilities: 2f7 ioat2: mem 0x383ffff14000-0x383ffff17fff irq 31 at device 4.2 on pci1 ioat2: Capabilities: f7 ioat3: mem 0x383ffff10000-0x383ffff13fff irq 39 at device 4.3 on pci1 ioat3: Capabilities: f7 ioat4: mem 0x383ffff0c000-0x383ffff0ffff irq 31 at device 4.4 on pci1 ioat4: Capabilities: f7 ioat5: mem 0x383ffff08000-0x383ffff0bfff irq 39 at device 4.5 on pci1 ioat5: Capabilities: f7 ioat6: mem 0x383ffff04000-0x383ffff07fff irq 31 at device 4.6 on pci1 ioat6: Capabilities: f7 ioat7: mem 0x383ffff00000-0x383ffff03fff irq 39 at device 4.7 on pci1 ioat7: Capabilities: f7 ichsmb0: port 0x580-0x59f mem 0x383ffff21000-0x383ffff210ff irq 18 at device 31.3 on pci1 smbus0: on ichsmb0 acpi_wmi0: on acpi0 acpi_wmi0: cannot find EC device fsck2+ fsck -fy /tmp ** /dev/gpt/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 1168 files, 65032 used, 1200375 free (127 frags, 150031 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** + set +x Updating CPU Microcode... CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.00-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab Structured Extended Features3=0x9c000400 XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics Done. ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/e2fsprogs /usr/local/lib/perl5/5.36/mach/CORE 32-bit compatibility ldconfig path: /usr/lib32 /usr/local/lib32/compat Setting hostname: mercat1.netperf.freebsd.org. Setting up harvesting: PURE_RDRAND,[CALLOUT],[UMA],[FS_ATIME],SWI,INTERRUPT,NET_NG,[NET_ETHER],NET_TUN,MOUSE,KEYBOARD,ATTACH,CACHED Feeding entropy: . igb0: link state changed to UP debugnet_any_ifnet_update: Bad dn_init result from igb0 (ifp 0xfffff8015e765000)Starting Network: igb1. igb1: flags=8802 metric 0 mtu 1500 options=4e507bb ether 0c:c4:7a:a8:cd:db media: Ethernet autoselect status: no carrier nd6 options=29 Starting Network: mce0. mce0: flags=8802 metric 0 mtu 1500 options=7eef07bb ether 7c:fe:90:30:ee:38 media: Ethernet autoselect status: no carrier nd6 options=29 Starting Network: mce1. mce1: flags=8802 metric 0 mtu 1500 options=7eef07bb ether 7c:fe:90:30:ee:39 media: Ethernet autoselect status: no carrier nd6 options=29 Autoloading module: uhid Autoloading module: ums Autoloading module: usbhid ums0 on uhub3 ums0: on usbus0 ums0: 3 buttons and [Z] coordinates ID=0 Starting dhclient. DHCPREQUEST on igb0 to 255.255.255.255 port 67 DHCPACK from 192.168.5.1 bound to 192.168.5.171 -- renewal in 300 seconds. route: message indicates error: File exists add host 127.0.0.1: gateway lo0 fib 0: route already in table route: message indicates error: File exists add host ::1: gateway lo0 fib 0: route already in table add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Creating and/or trimming log files. Starting syslogd. No core dumps found. Starting watchdogd. Setting date via ntp. 15 Jul 19:33:59 ntpdate[3475]: step time server 192.168.5.1 offset -0.422342 sec Clearing /tmp (X related). Recovering vi editor sessions:. Updating motd:. Updating /var/run/os-release done. Security policy loaded: MAC/ntpd (mac_ntpd) Starting ntpd. Mounting late filesystems:. Starting powerd. Starting inetd. Starting cron. Performing sanity check on sshd configuration. Starting sshd. Mon Jul 15 19:34 FreeBSD/amd64 (mercat1.netperf.freebsd.org) (ttyu1) login: Jul 15 19:46:24 mercat1 su[3720]: pho to root on /dev/pts/0 20240715 19:47:30 all (1/958): 1st.sh 20240715 19:47:33 all (2/958): 256m.sh 20240715 19:47:36 all (3/958): audit.sh 20240715 19:47:39 all (4/958): buildworld.sh 20240715 19:47:42 all (5/958): buildworld2.sh 20240715 19:47:44 all (6/958): cpuset.sh 20240715 19:47:47 all (7/958): crossmp2.sh 20240715 19:47:50 all (8/958): crossmp6.sh 20240715 19:47:53 all (9/958): datamove.sh 20240715 19:48:00 all (10/958): datamove3.sh 20240715 19:48:04 all (11/958): devfs2.sh 20240715 19:48:07 all (12/958): devfs5.sh 20240715 19:48:10 all (13/958): dtrace_fault.sh 20240715 19:48:13 all (14/958): dumpfs.sh stress2: newblk leak: 305/312. 20240715 19:48:16 all (15/958): dup2.sh 20240715 19:48:19 all (16/958): execi386.sh 20240715 19:48:23 all (17/958): extattr_set_fd.sh 20240715 19:48:26 all (18/958): extattrctl.sh lock order reversal: 1st 0xfffff80003e6ae40 ufs_extattr_sx (ufs_extattr_sx, sx) @ ufs/ufs/ufs_extattr.c:117 2nd 0xfffffe017a6097e0 ufs (ufs, lockmgr) @ kern/vfs_subr.c:3605 lock order ufs -> ufs_extattr_sx established at: #0 0xffffffff80bc4ad6 at witness_checkorder+0x336 #1 0xffffffff80b5a86d at _sx_xlock+0x5d #2 0xffffffff80ed5713 at ufs_extattr_vnode_inactive+0x43 #3 0xffffffff80ed602f at ufs_inactive+0x20f #4 0xffffffff8113bd2d at VOP_INACTIVE_APV+0x5d #5 0xffffffff80c4a73e at vinactivef+0x8e #6 0xffffffff80c49f9c at vput_final+0x29c #7 0xffffffff80c5ed31 at kern_frmdirat+0x2f1 #8 0xffffffff81072918 at amd64_syscall+0x158 #9 0xffffffff8104481b at fast_syscall_common+0xf8 lock order ufs_extattr_sx -> ufs attempted at: #0 0xffffffff80bc535d at witness_checkorder+0xbbd #1 0xffffffff80b1c997 at lockmgr_lock_flags+0x157 #2 0xffffffff80eccb4d at ffs_lock+0x9d #3 0xffffffff8113c18a at VOP_LOCK1_APV+0x3a #4 0xffffffff80c62bd3 at _vn_lock+0x53 #5 0xffffffff80c49f69 at vput_final+0x269 #6 0xffffffff80ed4321 at ufs_extattr_autostart+0xb1 #7 0xffffffff80ecb237 at ffs_mountfs+0xb97 #8 0xffffffff80ec8e43 at ffs_mount+0x463 #9 0xffffffff80c419c1 at vfs_domount_first+0x271 #10 0xffffffff80c3ddf5 at vfs_domount+0x315 #11 0xffffffff80c3c48c at vfs_donmount+0x8fc #12 0xffffffff80c3bb5f at sys_nmount+0x5f #13 0xffffffff81072918 at amd64_syscall+0x158 #14 0xffffffff8104481b at fast_syscall_common+0xf8 20240715 19:48:29 all (19/958): fcntl3.sh 20240715 19:48:32 all (20/958): fexecve.sh 20240715 19:48:35 all (21/958): fifo.sh 20240715 19:48:38 all (22/958): fsck2.sh 20240715 19:48:41 all (23/958): geomleak.sh 20240715 19:48:44 all (24/958): gnop3.sh 20240715 19:48:47 all (25/958): gnop5.sh GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. 20240715 19:48:51 all (26/958): gpt.sh g_dev_taste: g_dev_taste(gptid/8019ac9c-42d2-11ef-a55a-0cc47aa8cdda) failed to g_attach, error=6 g_dev_taste: g_dev_taste(gpt/tst0) failed to g_attach, error=6 20240715 19:48:54 all (27/958): holdcnt0.sh 20240715 19:48:57 all (28/958): holdcnt02.sh 20240715 19:48:59 all (29/958): holdcnt03.sh 20240715 19:49:02 all (30/958): holdcnt04.sh 20240715 19:49:05 all (31/958): holdcnt05.sh 20240715 19:49:08 all (32/958): isofs2.sh 20240715 19:49:11 all (33/958): jail.sh 20240715 19:49:14 all (34/958): jail2.sh 20240715 19:49:17 all (35/958): jail3.sh 20240715 19:49:20 all (36/958): jail4.sh 20240715 19:49:23 all (37/958): jexec.sh 20240715 19:49:26 all (38/958): kern_umtx_inf_loop.sh 20240715 19:49:29 all (39/958): kevent10.sh 20240715 19:49:32 all (40/958): kevent3.sh 20240715 19:49:36 all (41/958): ldt.sh 20240715 19:49:38 all (42/958): ldt2.sh 20240715 19:49:41 all (43/958): libMicro.sh 20240715 19:49:44 all (44/958): lockd.sh 20240715 19:49:47 all (45/958): lockf.sh 20240715 19:49:50 all (46/958): lookup_shared.sh 20240715 19:49:53 all (47/958): mac.sh 20240715 19:49:56 all (48/958): mac_chkexec.sh 20240715 19:49:59 all (49/958): machipc.sh 20240715 19:50:02 all (50/958): machipc2.sh 20240715 19:50:05 all (51/958): maxmemdom.sh 20240715 19:50:08 all (52/958): maxproc.sh 20240715 19:50:11 all (53/958): md5.sh stress2: newblk leak: 145/152. 20240715 19:50:14 all (54/958): md6.sh 20240715 19:50:17 all (55/958): mdconfig.sh 20240715 19:50:20 all (56/958): mdconfig3.sh stress2: newblk leak: 146/152. 20240715 19:50:23 all (57/958): memguard4.sh 20240715 19:50:26 all (58/958): mkfifo5.sh 20240715 19:50:29 all (59/958): mkfifo7.sh 20240715 19:50:32 all (60/958): mlockall5.sh 20240715 19:50:35 all (61/958): mmap.sh 20240715 19:50:38 all (62/958): mmap12.sh 20240715 19:50:41 all (63/958): mmap16.sh 20240715 19:50:43 all (64/958): mmap17.sh 20240715 19:50:47 all (65/958): mmap20.sh 20240715 19:50:50 all (66/958): mmap24.sh 20240715 19:50:53 all (67/958): mmap28.sh 20240715 19:50:56 all (68/958): mmap30.sh 20240715 19:50:59 all (69/958): mmap33.sh 20240715 19:51:02 all (70/958): mmap35.sh 20240715 19:51:05 all (71/958): mmap36.sh 20240715 19:51:08 all (72/958): mount.sh 20240715 19:51:11 all (73/958): mountro2.sh 20240715 19:51:14 all (74/958): mountro3.sh stress2: newblk leak: 2048/2052. 20240715 19:51:18 all (75/958): mprotect.sh 20240715 19:51:21 all (76/958): msdos2.sh 20240715 19:51:24 all (77/958): msdos3.sh 20240715 19:51:26 all (78/958): msdos7.sh 20240715 19:51:29 all (79/958): nanosleep.sh 20240715 19:51:32 all (80/958): nfs.sh 20240715 19:51:35 all (81/958): nfs12.sh 20240715 19:51:38 all (82/958): nfs14.sh 20240715 19:51:41 all (83/958): nfs15.sh 20240715 19:51:44 all (84/958): nfs15lockd3.sh 20240715 19:51:47 all (85/958): nfs17.sh 20240715 19:51:50 all (86/958): nfs3.sh 20240715 19:51:53 all (87/958): nfs4.sh 20240715 19:51:56 all (88/958): nfs7.sh 20240715 19:51:59 all (89/958): nfs8.sh 20240715 19:52:02 all (90/958): nfs9.sh 20240715 19:52:05 all (91/958): nfs_halfpage.sh 20240715 19:52:08 all (92/958): nfs_halfpage2.sh 20240715 19:52:10 all (93/958): nfsdelegation.sh 20240715 19:52:13 all (94/958): nfsdepth.sh 20240715 19:52:16 all (95/958): nfsrename.sh 20240715 19:52:19 all (96/958): nfssillyrename.sh 20240715 19:52:22 all (97/958): nullfs13.sh 20240715 19:52:25 all (98/958): nullfs14.sh 20240715 19:52:28 all (99/958): nullfs15.sh 20240715 19:52:31 all (100/958): nullfs21.sh 20240715 19:52:34 all (101/958): nullfs23.sh 20240715 19:52:37 all (102/958): nullfs4.sh stress2: mount leak: 13/44 20240715 19:52:40 all (103/958): nullfs6.sh 20240715 19:52:43 all (104/958): nullfs7.sh 20240715 19:52:46 all (105/958): nullfs9.sh 20240715 19:52:49 all (106/958): numa.sh 20240715 19:52:52 all (107/958): oom.sh 20240715 19:52:55 all (108/958): open.sh 20240715 19:52:58 all (109/958): parallelmount2.sh 20240715 19:53:01 all (110/958): pathconf.sh 20240715 19:53:04 all (111/958): pathconf2.sh 20240715 19:53:07 all (112/958): pcatch.sh 20240715 19:53:10 all (113/958): pcatch2.sh 20240715 19:53:13 all (114/958): ping.sh 20240715 19:53:16 all (115/958): pkru.sh 20240715 19:53:19 all (116/958): pkru2.sh 20240715 19:53:21 all (117/958): poll.sh 20240715 19:53:24 all (118/958): posix_fadvise.sh 20240715 19:53:28 all (119/958): posix_fadvise2.sh 20240715 19:53:31 all (120/958): procfs5.sh 20240715 19:53:34 all (121/958): procfs6.sh 20240715 19:53:37 all (122/958): procstat.sh 20240715 19:53:40 all (123/958): pthread9.sh 20240715 19:53:43 all (124/958): ptrace.sh 20240715 19:53:46 all (125/958): ptrace3.sh 20240715 19:53:49 all (126/958): pts2.sh 20240715 19:53:52 all (127/958): quota5.sh 20240715 19:53:55 all (128/958): rename13.sh 20240715 19:53:58 all (129/958): rename4.sh 20240715 19:54:01 all (130/958): revoke.sh 20240715 19:54:04 all (131/958): routetbl.sh 20240715 19:54:07 all (132/958): ruby.sh 20240715 19:54:10 all (133/958): rwlock_ronly.sh 20240715 19:54:13 all (134/958): schedfuzz.sh 20240715 19:54:16 all (135/958): segnp.sh 20240715 19:54:19 all (136/958): segregs.sh 20240715 19:54:22 all (137/958): select3.sh 20240715 19:54:25 all (138/958): sendfile19.sh 20240715 19:54:28 all (139/958): sendfile2.sh 20240715 19:54:31 all (140/958): sendfile20.sh 20240715 19:54:34 all (141/958): sendfile4.sh 20240715 19:54:37 all (142/958): sendfile6.sh 20240715 19:54:40 all (143/958): setuid.sh 20240715 19:54:43 all (144/958): shm_super.sh 20240715 19:54:47 all (145/958): sigaltstack.sh 20240715 19:54:50 all (146/958): sigreturn.sh 20240715 19:54:53 all (147/958): snap12.sh 20240715 19:54:56 all (148/958): snap2-1.sh lock order reversal: 1st 0xfffffe0038679420 bufwait (bufwait, lockmgr) @ ufs/ffs/ffs_vnops.c:328 2nd 0xfffff8015ea97d30 snaplk (snaplk, lockmgr) @ ufs/ffs/ffs_snapshot.c:2330 lock order snaplk -> bufwait established at: #0 0xffffffff80bc4ad6 at witness_checkorder+0x336 #1 0xffffffff80b1d06b at lockmgr_xlock_hard+0x6b #2 0xffffffff80b1d8f3 at __lockmgr_args+0x1e3 #3 0xffffffff80c47d50 at bnoreuselist+0xc0 #4 0xffffffff80c33dc4 at vop_stdadvise+0x154 #5 0xffffffff8113ec4d at VOP_ADVISE_APV+0x5d #6 0xffffffff806dba5a at mdstart_vnode+0x52a #7 0xffffffff806d9bdc at md_kthread+0x20c #8 0xffffffff80b05032 at fork_exit+0x82 #9 0xffffffff81044f6e at fork_trampoline+0xe lock order bufwait -> snaplk attempted at: #0 0xffffffff80bc535d at witness_checkorder+0xbbd #1 0xffffffff80b1d06b at lockmgr_xlock_hard+0x6b #2 0xffffffff80b1d8f3 at __lockmgr_args+0x1e3 #3 0xffffffff80ea44f3 at ffs_copyonwrite+0x1a3 #4 0xffffffff80ecb9f0 at ffs_geom_strategy+0xd0 #5 0xffffffff80ee0c33 at ufs_strategy+0x83 #6 0xffffffff8113c5d5 at VOP_STRATEGY_APV+0x65 #7 0xffffffff80c1a42f at bufstrategy+0x3f #8 0xffffffff80c1a2c2 at bufwrite+0x242 #9 0xffffffff80ecdfe1 at ffs_syncvnode+0x391 #10 0xffffffff80ecc9ee at ffs_fsync+0x1e #11 0xffffffff8113ad9a at VOP_FSYNC_APV+0x3a #12 0xffffffff80ede797 at ufs_remove+0x107 #13 0xffffffff8113af36 at VOP_REMOVE_APV+0x86 #14 0xffffffff80c5a593 at kern_funlinkat+0x473 #15 0xffffffff80c5a118 at sys_unlink+0x28 #16 0xffffffff81072918 at amd64_syscall+0x158 #17 0xffffffff8104481b at fast_syscall_common+0xf8 20240715 19:54:59 all (149/958): snap2.sh 20240715 19:55:02 all (150/958): socketpair2.sh 20240715 19:55:05 all (151/958): suj2.sh 20240715 19:55:08 all (152/958): suj24.sh 20240715 19:55:11 all (153/958): suj32.sh 20240715 19:55:14 all (154/958): suj35.sh Jul 15 19:55:16 mercat1 kernel: pid 23949 (mkdir), uid 0 inumber 249 on /mnt: out of inodes 20240715 19:55:17 all (155/958): suj7.sh Failed to find journal. Use tunefs to create one Failed to start journal: 2 20240715 19:55:20 all (156/958): syzkaller2.sh 20240715 19:55:23 all (157/958): syzkaller22.sh 20240715 19:55:26 all (158/958): syzkaller3.sh 20240715 19:55:29 all (159/958): syzkaller5.sh 20240715 19:55:32 all (160/958): syzkaller6.sh 20240715 19:55:35 all (161/958): temp.sh 20240715 19:55:38 all (162/958): tmpfs15.sh 20240715 19:55:41 all (163/958): tmpfs4.sh 20240715 19:55:45 all (164/958): tmpfs6.sh 20240715 19:55:48 all (165/958): trim5.sh 20240715 19:55:51 all (166/958): trim6.sh 20240715 19:55:54 all (167/958): trim7.sh 20240715 19:55:57 all (168/958): trim8.sh 20240715 19:56:00 all (169/958): truncate4.sh 20240715 19:56:03 all (170/958): truncate6.sh 20240715 19:56:06 all (171/958): tvnlru.sh 20240715 19:56:09 all (172/958): ufssuspend.sh 20240715 19:56:13 all (173/958): uma_zalloc_arg.sh 20240715 19:56:16 all (174/958): unlink.sh 20240715 19:56:19 all (175/958): vfork.sh 20240715 19:56:22 all (176/958): vmio.sh 20240715 19:56:25 all (177/958): watchman.sh 20240715 19:56:28 all (178/958): beneath2.sh 20240715 19:56:31 all (179/958): beneath3.sh 20240715 19:56:34 all (180/958): beneath4.sh 20240715 19:56:37 all (181/958): datagram.sh 20240715 19:56:42 all (182/958): datagram2.sh 20240715 19:56:45 all (183/958): datagram3.sh 20240715 19:56:48 all (184/958): ext2fs3.sh 20240715 19:56:52 all (185/958): extattr.sh 20240715 19:56:56 all (186/958): fcntl.sh 20240715 19:57:00 all (187/958): fsck3.sh 20240715 19:57:03 all (188/958): isofs.sh 20240715 19:57:07 all (189/958): killpg.sh 20240715 19:57:11 all (190/958): linux.sh 20240715 19:57:14 all (191/958): md9.sh 20240715 19:57:18 all (192/958): mmap25.sh 20240715 19:57:22 all (193/958): mmap26.sh 20240715 19:57:26 all (194/958): mmap8.sh 20240715 19:57:30 all (195/958): mmap9.sh 20240715 19:57:35 all (196/958): msdos9.sh 20240715 19:57:38 all (197/958): newfs5.sh 20240715 19:57:43 all (198/958): nullfs10.sh 20240715 19:57:46 all (199/958): nullfs12.sh 20240715 19:57:50 all (200/958): nullfs16.sh 20240715 19:57:54 all (201/958): openlock.sh 20240715 19:57:58 all (202/958): pdfork.sh 20240715 19:58:02 all (203/958): pipe_enomem.sh kern.ipc.maxpipekva exceeded; see tuning(7) 20240715 19:58:06 all (204/958): procfs2.sh 20240715 19:58:10 all (205/958): ptrace11.sh 20240715 19:58:14 all (206/958): ptrace8.sh 20240715 19:58:19 all (207/958): quota9.sh lock order reversal: 1st 0xfffff80003e6aea0 FFS (FFS Lock, sleep mutex) @ ufs/ufs/ufs_quota.c:750 2nd 0xfffffe017aaca2c0 struct mount mtx (struct mount mtx, sleep mutex) @ ufs/ufs/ufs_quota.c:756 lock order struct mount mtx -> FFS Lock established at: #0 0xffffffff80bc4ad6 at witness_checkorder+0x336 #1 0xffffffff80b2a03d at __mtx_lock_flags+0x8d #2 0xffffffff80ea5924 at softdep_flushfiles+0x394 #3 0xffffffff80ec97e6 at ffs_unmount+0xa6 #4 0xffffffff80c3edfc at dounmount+0x7dc #5 0xffffffff80c3e5bc at kern_unmount+0x2dc #6 0xffffffff81072918 at amd64_syscall+0x158 #7 0xffffffff8104481b at fast_syscall_common+0xf8 lock order FFS Lock -> struct mount mtx attempted at: #0 0xffffffff80bc535d at witness_checkorder+0xbbd #1 0xffffffff80b2a03d at __mtx_lock_flags+0x8d #2 0xffffffff80edb67b at quotaoff_inchange+0xbb #3 0xffffffff80ec7e08 at ffs_flushfiles+0x168 #4 0xffffffff80ea563f at softdep_flushfiles+0xaf #5 0xffffffff80ec97e6 at ffs_unmount+0xa6 #6 0xffffffff80c3edfc at dounmount+0x7dc #7 0xffffffff80c3e5bc at kern_unmount+0x2dc #8 0xffffffff81072918 at amd64_syscall+0x158 #9 0xffffffff8104481b at fast_syscall_common+0xf8 stress2: newblk leak: 1585/1592. 20240715 19:58:22 all (208/958): random.sh 20240715 19:58:26 all (209/958): recursiveflushes.sh 20240715 19:58:30 all (210/958): rename6.sh 20240715 19:58:34 all (211/958): seekdir.sh 20240715 19:58:37 all (212/958): sendfile.sh 20240715 19:58:41 all (213/958): sigstop.sh 20240715 19:58:44 all (214/958): snap.sh 20240715 19:58:48 all (215/958): snap10.sh 20240715 19:58:52 all (216/958): sndstat.sh 20240715 19:58:55 all (217/958): socketpair.sh 20240715 19:58:58 all (218/958): suj8.sh Jul 15 19:59:00 mercat1 kernel: pid 30639 (dd), uid 0 inumber 4 on /mnt: filesystem full Jul 15 19:59:00 mercat1 kernel: pid 30655 (dd), uid 0 inumber 5 on /mnt: filesystem full 20240715 19:59:01 all (219/958): syzkaller1.sh 20240715 19:59:05 all (220/958): tmpfs7.sh 20240715 19:59:08 all (221/958): trim2.sh 20240715 19:59:12 all (222/958): truncate5.sh 20240715 19:59:16 all (223/958): umtx_suspend.sh 20240715 19:59:20 all (224/958): vm_fault_dontneed.sh 20240715 19:59:24 all (225/958): chroot.sh 20240715 19:59:29 all (226/958): datamove4.sh 20240715 19:59:34 all (227/958): devfd.sh 20240715 19:59:39 all (228/958): extattr3.sh 20240715 19:59:44 all (229/958): fpclone2.sh 20240715 19:59:53 all (230/958): kevent8.sh 20240715 19:59:59 all (231/958): mmap23.sh 20240715 20:00:04 all (232/958): mmap4.sh vnode_pager_putpages: zero-length write at 39976960 resid 131072 0xfffffe017afca770: type VREG state VSTATE_CONSTRUCTED op 0xffffffff81943058 usecount 0, writecount 0, refcount 3203 seqc users 0 hold count flags () flags (VIRF_PGREAD|VI_DOINGINACT|VMP_LAZYLIST) v_object 0xfffff8052191ca50 ref 0 pages 25608 cleanbuf 3200 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff800139ef000 (pid 64852, mmap4, tid 100257) #0 0xffffffff80b1c9f8 at lockmgr_lock_flags+0x1b8 #1 0xffffffff80eccb4d at ffs_lock+0x9d #2 0xffffffff8113c18a at VOP_LOCK1_APV+0x3a #3 0xffffffff80c62bd3 at _vn_lock+0x53 #4 0xffffffff80c49f69 at vput_final+0x269 #5 0xffffffff80efc489 at vm_map_process_deferred+0xa9 #6 0xffffffff80f0308d at vm_map_remove+0xed #7 0xffffffff80efbd58 at vmspace_exit+0xa8 #8 0xffffffff80aff9c3 at exit1+0x533 #9 0xffffffff80aff48d at sys_exit+0xd #10 0xffffffff81072918 at amd64_syscall+0x158 #11 0xffffffff8104481b at fast_syscall_common+0xf8 nlink=1, effnlink=1, size=104857600, extsize 0 generation=ff508bd, uid=0, gid=0, flags=0x0 ino 4, on dev md10 Jul 15 20:00:06 mercat1 kernel: pid 64852 (mmap4), uid 0 inumber 4 on /mnt: filesystem full vnode_pager_putpages: zero-length write at 39976960 resid 131072 0xfffffe017afca770: type VREG state VSTATE_CONSTRUCTED op 0xffffffff81943058 usecount 1, writecount 0, refcount 3203 seqc users 0 hold count flags () flags (VIRF_PGREAD|VMP_LAZYLIST) v_object 0xfffff8052191ca50 ref 0 pages 25608 cleanbuf 3201 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff80012cbe740 (pid 64860, umount, tid 100334) #0 0xffffffff80b1c9f8 at lockmgr_lock_flags+0x1b8 #1 0xffffffff80eccb4d at ffs_lock+0x9d #2 0xffffffff8113c18a at VOP_LOCK1_APV+0x3a #3 0xffffffff80c62bd3 at _vn_lock+0x53 #4 0xffffffff80c496c5 at vget_finish+0x75 #5 0xffffffff80c4c43b at vfs_periodic_msync_inactive+0x14b #6 0xffffffff80c3ed97 at dounmount+0x777 #7 0xffffffff80c3e5bc at kern_unmount+0x2dc #8 0xffffffff81072918 at amd64_syscall+0x158 #9 0xffffffff8104481b at fast_syscall_common+0xf8 nlink=1, effnlink=1, size=104857600, extsize 0 Jul 15 20:00:08 generation=ff508bd, uid=0, gid=0, flags=0x0 ino 4, on dev md10 mercat1 kernel: pid 64860 (umount), uid 0 inumber 4 on /mnt: filesystem full 20240715 20:00:09 all (233/958): nullfs3.sh 20240715 20:00:13 all (234/958): procfs3.sh 20240715 20:00:20 all (235/958): pthread.sh 20240715 20:00:25 all (236/958): spin.sh 20240715 20:00:29 all (237/958): udp.sh 20240715 20:00:34 all (238/958): udp2.sh 20240715 20:00:39 all (239/958): unix_socket.sh 20240715 20:00:44 all (240/958): contigmalloc2.sh 20240715 20:00:48 all (241/958): contigmalloc3.sh 20240715 20:00:52 all (242/958): dup.sh 20240715 20:00:57 all (243/958): kevent2.sh 20240715 20:01:03 all (244/958): mkfifo6.sh 20240715 20:01:10 all (245/958): mmap13.sh 20240715 20:01:15 all (246/958): mountro4.sh 20240715 20:01:22 all (247/958): sendfile26.sh ZFS filesystem version: 5 ZFS storage pool version: features support (5000) 20240715 20:01:28 all (248/958): symlink4.sh 20240715 20:01:35 all (249/958): tmpfs10.sh 20240715 20:01:41 all (250/958): tmpfs23.sh 20240715 20:01:46 all (251/958): tmpfs5.sh 20240715 20:01:51 all (252/958): truncate7.sh 20240715 20:01:58 all (253/958): beneath.sh 20240715 20:02:01 all (254/958): datamove5.sh 20240715 20:02:08 all (255/958): ptrace2.sh 20240715 20:02:15 all (256/958): sparse.sh 20240715 20:02:25 all (257/958): truncate3.sh 20240715 20:02:32 all (258/958): growfs.sh g_dev_taste: g_dev_taste(ufsid/6695643a42cc77b0) failed to g_attach, error=6 g_dev_taste: g_dev_taste(gptid/697443e0-42d4-11ef-a55a-0cc47aa8cdda) failed to g_attach, error=6 20240715 20:02:40 all (259/958): mlockall4.sh 20240715 20:02:49 all (260/958): ptrace9.sh 20240715 20:02:57 all (261/958): quota11.sh 20240715 20:03:05 all (262/958): sendfile18.sh GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. 20240715 20:03:13 all (263/958): suj25.sh 20240715 20:03:20 all (264/958): credleak.sh 20240715 20:03:27 all (265/958): fork.sh 20240715 20:03:36 all (266/958): symlink2.sh stress2: newblk leak: 307/314. 20240715 20:03:45 all (267/958): sigfastblock.sh 20240715 20:03:54 all (268/958): tmpfs8.sh 20240715 20:04:04 all (269/958): compare.sh 20240715 20:04:15 all (270/958): core2.sh 20240715 20:04:27 all (271/958): force6.sh UFS: forcibly unmounting /dev/md10 from /mnt stress2: newblk leak: 32761/32768. 20240715 20:04:38 all (272/958): fsck4.sh 20240715 20:04:53 all (273/958): ffs_blkfree.sh stress2: newblk leak: 26505/32769. 20240715 20:05:05 all (274/958): fsck5.sh 20240715 20:05:17 all (275/958): symlink5.sh 20240715 20:05:28 all (276/958): thr.sh 20240715 20:05:40 all (277/958): f_offset.sh 20240715 20:05:51 all (278/958): nfs15lockd2.sh 20240715 20:06:04 all (279/958): pmc7.sh hwpmc: SOFT/16/64/0x67 TSC/1/64/0x20 IAP/4/48/0x3ff IAF/3/48/0x67 lock order reversal: 1st 0xffffffff81b99220 kernel linker (kernel linker, sx) @ kern/kern_linker.c:1154 2nd 0xffffffff81b9d260 pmc-sx (pmc-sx, sx) @ /usr/src/sys/dev/hwpmc/hwpmc_mod.c:5693 lock order pmc-sx -> kernel linker established at: lock order kernel linker -> pmc-sx attempted at: 20240715 20:06:18 all (280/958): pread.sh lock order reversal: 1st 0xfffffe016512c0d8 devfs (devfs, lockmgr) @ kern/vfs_mount.c:2260 2nd 0xfffffe01d052f588 fdescfs (fdescfs, lockmgr) @ kern/vfs_subr.c:3367 lock order devfs -> fdescfs attempted at: #0 0xffffffff80bc535d at witness_checkorder+0xbbd #1 0xffffffff80b1c997 at lockmgr_lock_flags+0x157 #2 0xffffffff8113c18a at VOP_LOCK1_APV+0x3a #3 0xffffffff80c62bd3 at _vn_lock+0x53 #4 0xffffffff80c496c5 at vget_finish+0x75 #5 0xffffffff82972262 at fdesc_root+0x22 #6 0xffffffff80c4a86b at vflush+0x4b #7 0xffffffff8297220e at fdesc_unmount+0x6e #8 0xffffffff80c3edfc at dounmount+0x7dc #9 0xffffffff80c3e5bc at kern_unmount+0x2dc #10 0xffffffff81072918 at amd64_syscall+0x158 #11 0xffffffff8104481b at fast_syscall_common+0xf8 20240715 20:06:30 all (281/958): proccontrol.sh 20240715 20:06:43 all (282/958): rdgsbase.sh 20240715 20:06:56 all (283/958): sendfile24.sh GEOM_NOP: Device md10.nop created. g_vfs_done():md10.nop[READ(offset=16977920, length=4096)]error = 5 g_vfs_done():md10.nop[READ(offset=16977920, length=4096)]error = 5 g_vfs_done():md10.nop[READ(offset=16977920, length=4096)]error = 5 g_vfs_done():md10.nop[READ(offset=16977920, length=4096)]error = 5 g_vfs_done():md10.nop[READ(offset=16977920, length=4096)]error = 5 g_vfs_done():md10.nop[READ(offset=16977920, length=4096)]error = 5 g_vfs_done():md10.nop[READ(offset=16977920, length=4096)]error = 5 g_vfs_done():md10.nop[READ(offset=16977920, length=4096)]error = 5 g_vfs_done():md10.nop[READ(offset=16977920, length=4096)]error = 5 g_vfs_done():md10.nop[READ(offset=16977920, length=4096)]error = 5 g_vfs_done():md10.nop[READ(offset=16977920, length=4096)]error = 5 g_vfs_done():md10.nop[READ(offset=16977920, length=4096)]error = 5 g_vfs_done():md10.nop[READ(offset=16977920, length=4096)]error = 5 g_vfs_done():md10.nop[READ(offset=16977920, length=4096)]error = 5 g_vfs_done():md10.nop[READ(offset=16977920, length=4096)]error = 5 g_vfs_done():md10.nop[READ(offset=16977920, length=4096)]error = 5 g_vfs_done():md10.nop[READ(offset=16977920, length=4096)]error = 5 g_vfs_done():md10.nop[READ(offset=16977920, length=4096)]error = 5 g_vfs_done():md10.nop[READ(offset=16977920, length=4096)]error = 5 g_vfs_done():md10.nop[READ(offset=16977920, length=4096)]error = 5 g_vfs_done():md10.nop[READ(offset=16977920, length=4096)]error = 5 g_vfs_done():md10.nop[READ(offset=16977920, length=4096)]error = 5 g_vfs_done():md10.nop[READ(offset=16977920, length=4096)]error = 5 g_vfs_done():md10.nop[READ(offset=16977920, length=4096)]error = 5 g_vfs_done():md10.nop[READ(offset=16977920, length=4096)]error = 5 g_vfs_done():md10.nop[READ(offset=16977920, length=4096)]error = 5 g_vfs_done():md10.nop[READ(offset=16977920, length=4096)]error = 5 g_vfs_done():md10.nop[READ(offset=16977920, length=4096)]error = 5 g_vfs_done():md10.nop[READ(offset=16977920, length=4096)]error = 5 g_vfs_done():md10.nop[READ(offset=16977920, length=4096)]error = 5 GEOM_NOP: Device md10.nop removed. 20240715 20:07:09 all (284/958): smrstress.sh Completed 10000000 loops with 0 failures 20240715 20:07:19 all (285/958): tmpfs14.sh 20240715 20:07:33 all (286/958): mprotect2.sh 20240715 20:07:47 all (287/958): posix_fadvise3.sh 20240715 20:08:01 all (288/958): shm_open.sh 20240715 20:08:15 all (289/958): sysctl.sh lock order reversal: 1st 0xffffffff81801c00 allproc (allproc, sx) @ kern/kern_descrip.c:4400 2nd 0xfffffe017e37c020 filedesc structure (filedesc structure, sx) @ kern/kern_descrip.c:4417 lock order allproc -> filedesc structure attempted at: #0 0xffffffff80bc535d at witness_checkorder+0xbbd #1 0xffffffff80b5b981 at _sx_slock_int+0x61 #2 0xffffffff80af1a1e at sysctl_kern_file+0x1fe #3 0xffffffff80b61c0c at sysctl_root_handler_locked+0x9c #4 0xffffffff80b60fae at sysctl_root+0x21e #5 0xffffffff80b6166a at userland_sysctl+0x17a #6 0xffffffff80b614b0 at sys___sysctl+0x60 #7 0xffffffff81072918 at amd64_syscall+0x158 #8 0xffffffff8104481b at fast_syscall_common+0xf8 20240715 20:08:34 all (290/958): umountf11.sh 20240715 20:08:50 all (291/958): umountf12.sh 20240715 20:09:05 all (292/958): zfs11.sh ZFS filesystem version: 5 ZFS storage pool version: features support (5000) 20240715 20:09:20 all (293/958): rename11.sh 20240715 20:09:36 all (294/958): rdwr.sh 20240715 20:09:52 all (295/958): execve.sh 20240715 20:10:04 all (296/958): mountu.sh 20240715 20:10:23 all (297/958): linger2.sh Jul 15 20:10:27 mercat1 kernel: pid 68615 (linger2), uid 2007 inumber 889 on /mnt: filesystem full 20240715 20:10:31 all (298/958): sem.sh 20240715 20:10:51 all (299/958): tmpfs19.sh 20240715 20:11:08 all (300/958): pipe2.sh 20240715 20:11:25 all (301/958): kevent6.sh 20240715 20:11:47 all (302/958): msdos10.sh 20240715 20:12:11 all (303/958): multicast.sh 20240715 20:12:34 all (304/958): suj10.sh 20240715 20:12:57 all (305/958): suj20.sh 20240715 20:13:20 all (306/958): mkfifo3.sh 20240715 20:13:44 all (307/958): mountro6.sh 20240715 20:14:07 all (308/958): nullfs22.sh 20240715 20:14:31 all (309/958): suj21.sh 20240715 20:14:53 all (310/958): suj33.sh 20240715 20:15:17 all (311/958): core4.sh Jul 15 20:15:20 mercat1 kernel: Failed to write core file for process core4 (error 9) Jul 15 20:15:35 mercat1 syslogd: last message repeated 8 times Jul 15 20:15:35 mercat1 kernel: Failed to write core file for process core4 (error 5) Jul 15 20:15:36 mercat1 kernel: Failed to write core file for process core4 (error 9) 20240715 20:15:42 all (312/958): sendmsg2.sh 20240715 20:16:08 all (313/958): sendfile5.sh Jul 15 20:15:41 mercat1 syslogd: last message repeated 1 times 20240715 20:16:34 all (314/958): swap4.sh swp_pager_getswapspace(15): failed Jul 15 20:16:53 mercat1 kernel: pid 55206 (swap4), jid 0, uid 0, was killed: failed to reclaim memory Jul 15 20:16:53 mercat1 kernel: pid 55208 (swap4), jid 0, uid 0, was killed: failed to reclaim memory Jul 15 20:16:53 mercat1 kernel: pid 55205 (swap4), jid 0, uid 0, was killed: failed to reclaim memory 20240715 20:17:00 all (315/958): sendfile_shm.sh stress2: freework leak: 126/133. stress2: newblk leak: 9006/9013. 20240715 20:17:47 all (316/958): md8.sh stress2: newblk leak: 3929/3933. 20240715 20:18:19 all (317/958): msdos5.sh stress2: GEOM leak: 19/93 20240715 20:18:51 all (318/958): suj14.sh Jul 15 20:19:12 mercat1 kernel: pid 22168 (cp), uid 0 inumber 180044 on /mnt: filesystem full Jul 15 20:19:13 mercat1 kernel: pid 22168 (cp), uid 0 inumber 180075 on /mnt: filesystem full Jul 15 20:19:14 mercat1 kernel: pid 22168 (cp), uid 0 inumber 180108 on /mnt: filesystem full Jul 15 20:19:15 mercat1 kernel: pid 22168 (cp), uid 0 inumber 180141 on /mnt: filesystem full Jul 15 20:19:16 mercat1 kernel: pid 22168 (cp), uid 0 inumber 179991 on /mnt: filesystem full Jul 15 20:19:17 mercat1 syslogd: last message repeated 1 times Jul 15 20:19:18 mercat1 kernel: pid 22168 (cp), uid 0 inumber 114887 on /mnt: filesystem full Jul 15 20:19:19 mercat1 kernel: pid 22168 (cp), uid 0 inumber 180146 on /mnt: filesystem full Jul 15 20:19:20 mercat1 kernel: pid 22168 (cp), uid 0 inumber 180147 on /mnt: filesystem full Jul 15 20:19:21 mercat1 kernel: pid 22168 (cp), uid 0 inumber 246789 on /mnt: filesystem full Jul 15 20:19:22 mercat1 kernel: pid 22168 (cp), uid 0 inumber 246816 on /mnt: filesystem full Jul 15 20:19:23 mercat1 kernel: pid 22168 (cp), uid 0 inumber 246850 on /mnt: filesystem full Jul 15 20:19:24 mercat1 kernel: pid 27681 (mkdir), uid 0 inumber 180146 on /mnt: filesystem full Jul 15 20:19:25 mercat1 kernel: pid 27713 (mkdir), uid 0 inumber 180146 on /mnt: filesystem full Jul 15 20:19:26 mercat1 kernel: pid 27745 (mkdir), uid 0 inumber 180146 on /mnt: filesystem full 20240715 20:19:28 all (319/958): timeout.sh 20240715 20:20:02 all (320/958): mmap37.sh 20240715 20:20:35 all (321/958): largepage.sh 20240715 20:20:59 all (322/958): multicast2.sh 20240715 20:21:02 all (323/958): mmap7.sh 20240715 20:21:25 all (324/958): umountf7.sh 20240715 20:22:00 all (325/958): pthread5.sh witness_lock_list_get: witness exhausted 20240715 20:22:35 all (326/958): fsck6.sh GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop is still open, so it can't be definitely removed. UFS: forcibly unmounting /dev/md10.nop from /mnt 20240715 20:23:13 all (327/958): vnodes.sh 20240715 20:23:52 all (328/958): namecache2.sh 20240715 20:24:31 all (329/958): sendfile3.sh stress2: freework leak: 271/276. stress2: newblk leak: 67219/67223. 20240715 20:25:17 all (330/958): force5.sh UFS: forcibly unmounting /dev/md10 from /mnt 20240715 20:26:25 all (331/958): rename9.sh 20240715 20:27:27 all (332/958): bench.sh 20240715 20:28:16 all (333/958): exlock.sh 20240715 20:29:05 all (334/958): force.sh g_vfs_done(): md10 converting all errors to ENXIO g_vfs_done():md10[WRITE(offset=810483712, length=32768)]error = 6 supressing further ENXIO UFS: forcibly unmounting /dev/md10 from /mnt 20240715 20:30:02 all (335/958): force3.sh UFS: forcibly unmounting /dev/md10 from /mnt 20240715 20:30:51 all (336/958): perf.sh 20240715 20:31:40 all (337/958): pfl3.sh 20240715 20:32:14 all (338/958): fifo3.sh 20240715 20:33:40 all (339/958): force2.sh UFS: forcibly unmounting /dev/md10 from /mnt stress2: newblk leak: 32766/32770. 20240715 20:34:10 all (340/958): rename7.sh 20240715 20:35:13 all (341/958): fpu.sh 20240715 20:36:06 all (342/958): rename3.sh 20240715 20:37:08 all (343/958): jumbo.sh 20240715 20:38:01 all (344/958): nullfs11.sh 20240715 20:38:54 all (345/958): fsck.sh 20240715 20:39:57 all (346/958): msdos8.sh 20240715 20:40:59 all (347/958): posix_openpt.sh 20240715 20:42:00 all (348/958): umountf5.sh stress2: newblk leak: 309/313. 20240715 20:42:34 all (349/958): mapwrite.sh 20240715 20:43:36 all (350/958): flock.sh 20240715 20:44:42 all (351/958): fsync2.sh 20240715 20:45:45 all (352/958): geomleak2.sh 20240715 20:46:48 all (353/958): mdconfig2.sh 20240715 20:47:50 all (354/958): midi2.sh 20240715 20:48:52 all (355/958): mkfifo8.sh 20240715 20:49:54 all (356/958): sem_wait.sh 20240715 20:50:57 all (357/958): sigstop2.sh 20240715 20:51:59 all (358/958): socketpair3.sh 20240715 20:53:01 all (359/958): syzkaller14.sh 20240715 20:54:04 all (360/958): syzkaller7.sh 20240715 20:55:07 all (361/958): advlock.sh 20240715 20:56:09 all (362/958): fsgs.sh 20240715 20:57:11 all (363/958): fullpath.sh 20240715 20:58:14 all (364/958): mmap29.sh 20240715 20:59:18 all (365/958): pts3.sh 20240715 21:00:20 all (366/958): sendfile8.sh 20240715 21:01:24 all (367/958): sendfile9.sh 20240715 21:02:27 all (368/958): shm.sh 20240715 21:03:30 all (369/958): syzkaller10.sh stress2: pts leak: 1/2 20240715 21:04:33 all (370/958): syzkaller12.sh 20240715 21:05:36 all (371/958): syzkaller8.sh 20240715 21:06:39 all (372/958): syzkaller9.sh 20240715 21:07:42 all (373/958): fts2.sh fsync: giving up on dirty (error = 35) 0xfffffe017a612e10: type VCHR state VSTATE_CONSTRUCTED op 0xffffffff818ae7f0 usecount 1, writecount 0, refcount 463 seqc users 0 rdev 0xfffff80407dfe000 hold count flags () flags () v_object 0xfffff80325e5e210 ref 0 pages 3659 cleanbuf 444 dirtybuf 17 lock type mntfs: EXCL by thread 0xfffff802e64c3740 (pid 31686, fts2, tid 380649) with exclusive waiters pending #0 0xffffffff80b1c9f8 at lockmgr_lock_flags+0x1b8 #1 0xffffffff8113c18a at VOP_LOCK1_APV+0x3a #2 0xffffffff80c62bd3 at _vn_lock+0x53 #3 0xffffffff80ea538d at softdep_flushworklist+0x5d #4 0xffffffff80eca236 at ffs_sync+0x426 #5 0xffffffff80ee1ded at ufs_sync_nlink+0xad #6 0xffffffff80edffe0 at ufs_mkdir+0x40 #7 0xffffffff8113b44a at VOP_MKDIR_APV+0x6a #8 0xffffffff80c5e90b at kern_mkdirat+0x20b #9 0xffffffff81072918 at amd64_syscall+0x158 #10 0xffffffff8104481b at fast_syscall_common+0xf8 fsync: giving up on dirty (error = 35) 0xfffffe017a612e10: type VCHR state VSTATE_CONSTRUCTED op 0xffffffff818ae7f0 usecount 1, writecount 0, refcount 463 seqc users 0 rdev 0xfffff80407dfe000 hold count flags () flags () v_object 0xfffff80325e5e210 ref 0 pages 3659 cleanbuf 453 dirtybuf 8 lock type mntfs: EXCL by thread 0xfffff802e64c3740 (pid 31686, fts2, tid 380649) with exclusive waiters pending #0 0xffffffff80b1c9f8 at lockmgr_lock_flags+0x1b8 #1 0xffffffff8113c18a at VOP_LOCK1_APV+0x3a #2 0xffffffff80c62bd3 at _vn_lock+0x53 #3 0xffffffff80eca0cf at ffs_sync+0x2bf #4 0xffffffff80ee1ded at ufs_sync_nlink+0xad #5 0xffffffff80edffe0 at ufs_mkdir+0x40 #6 0xffffffff8113b44a at VOP_MKDIR_APV+0x6a #7 0xffffffff80c5e90b at kern_mkdirat+0x20b #8 0xffffffff81072918 at amd64_syscall+0x158 #9 0xffffffff8104481b at fast_syscall_common+0xf8 fsync: giving up on dirty (error = 35) 0xfffffe017a612e10: type VCHR state VSTATE_CONSTRUCTED op 0xffffffff818ae7f0 usecount 1, writecount 0, refcount 463 seqc users 0 rdev 0xfffff80407dfe000 hold count flags () flags () v_object 0xfffff80325e5e210 ref 0 pages 3659 cleanbuf 460 dirtybuf 1 lock type mntfs: EXCL by thread 0xfffff800132df000 (pid 31704, fts2, tid 372970) with exclusive waiters pending #0 0xffffffff80b1c9f8 at lockmgr_lock_flags+0x1b8 #1 0xffffffff8113c18a at VOP_LOCK1_APV+0x3a #2 0xffffffff80c62bd3 at _vn_lock+0x53 #3 0xffffffff80eca0cf at ffs_sync+0x2bf #4 0xffffffff80ee1ded at ufs_sync_nlink+0xad #5 0xffffffff80edffe0 at ufs_mkdir+0x40 #6 0xffffffff8113b44a at VOP_MKDIR_APV+0x6a #7 0xffffffff80c5e90b at kern_mkdirat+0x20b #8 0xffffffff81072918 at amd64_syscall+0x158 #9 0xffffffff8104481b at fast_syscall_common+0xf8 20240715 21:08:47 all (374/958): mknod.sh 20240715 21:09:53 all (375/958): quota8.sh stress2: newblk leak: 28669/28673. 20240715 21:10:51 all (376/958): suj6.sh 20240715 21:11:13 all (377/958): tmpfs21.sh 20240715 21:12:18 all (378/958): vmstat.sh 20240715 21:13:30 all (379/958): rename10.sh 20240715 21:14:40 all (380/958): stack_guard_page.sh Jul 15 21:15:40 mercat1 kernel: pid 99720 (mkdir), uid 2007 inumber 67504 on /mnt: out of inodes 20240715 21:15:51 all (381/958): syzkaller13.sh 20240715 21:17:01 all (382/958): syzkaller20.sh 20240715 21:18:03 all (383/958): umountf.sh Jul 15 21:18:13 mercat1 kernel: pid 46498 (creat), uid 0 inumber 7170 on /mnt: out of inodes Jul 15 21:18:14 mercat1 kernel: pid 46497 (creat), uid 0 inumber 7169 on /mnt: out of inodes Jul 15 21:18:17 mercat1 kernel: pid 46506 (creat), uid 0 inumber 3584 on /mnt: out of inodes Jul 15 21:18:19 mercat1 kernel: pid 46502 (creat), uid 0 inumber 5 on /mnt: out of inodes Jul 15 21:18:20 mercat1 kernel: pid 46505 (creat), uid 0 inumber 6 on /mnt: out of inodes Jul 15 21:18:22 mercat1 syslogd: last message repeated 1 times Jul 15 21:18:24 mercat1 kernel: pid 46497 (creat), uid 0 inumber 7169 on /mnt: out of inodes Jul 15 21:18:25 mercat1 kernel: pid 46505 (creat), uid 0 inumber 6 on /mnt: out of inodes Jul 15 21:18:26 mercat1 kernel: pid 46499 (creat), uid 0 inumber 10755 on /mnt: out of inodes Jul 15 21:18:28 mercat1 kernel: pid 46502 (creat), uid 0 inumber 5 on /mnt: out of inodes Jul 15 21:18:29 mercat1 kernel: pid 46500 (creat), uid 0 inumber 4 on /mnt: out of inodes Jul 15 21:18:30 mercat1 kernel: pid 46495 (creat), uid 0 inumber 10754 on /mnt: out of inodes Jul 15 21:18:32 mercat1 kernel: pid 46500 (creat), uid 0 inumber 4 on /mnt: out of inodes Jul 15 21:18:34 mercat1 kernel: pid 46508 (creat), uid 0 inumber 7 on /mnt: out of inodes stress2: newblk leak: 3508/3513. 20240715 21:18:38 all (384/958): crossmp8.sh Jul 15 21:18:36 mercat1 syslogd: last message repeated 1 times 20240715 21:19:46 all (385/958): syzkaller21.sh 20240715 21:20:56 all (386/958): pthread6.sh stress2: newblk leak: 290/296. 20240715 21:21:21 all (387/958): quota4.sh stress2: newblk leak: 3791/4088. 20240715 21:22:36 all (388/958): rename12.sh 20240715 21:23:34 all (389/958): suj5.sh 20240715 21:25:04 all (390/958): ufsbench.sh 20240715 21:26:32 all (391/958): mountro5.sh 20240715 21:26:46 all.sh done, elapsed 0 day(s), 01:39.19 20240715 21:27:06 all (1/38): crossmp4.sh 20240715 21:35:21 all (2/38): crossmp5.sh stress2: freework leak: 103/119. stress2: newblk leak: 1141/1145. 20240715 21:40:24 all (3/38): crossmp8.sh 20240715 21:41:35 all (4/38): holdcnt0.sh 20240715 21:41:38 all (5/38): holdcnt02.sh 20240715 21:41:41 all (6/38): holdcnt03.sh 20240715 21:41:44 all (7/38): holdcnt05.sh 20240715 21:41:46 all (8/38): mapwrite.sh 20240715 21:42:44 all (9/38): marcus5.sh 20240715 22:00:07 all (10/38): marcus6.sh 20240715 22:02:41 all (11/38): marcus7.sh Jul 15 22:11:45 mercat1 kernel: pid 12870 (link), uid 2007 inumber 401075 on /mnt: out of inodes fsync: giving up on dirty (error = 35) 0xfffffe01fa1414b0: type VCHR state VSTATE_CONSTRUCTED op 0xffffffff818ae7f0 usecount 1, writecount 0, refcount 2830 seqc users 0 rdev 0xfffff80328032800 hold count flags () flags () v_object 0xfffff803ad483e70 ref 0 pages 49931 cleanbuf 2827 dirtybuf 1 lock type mntfs: EXCL by thread 0xfffff802dd79c000 (pid 12589, dirnprename, tid 379684) #0 0xffffffff80b1c9f8 at lockmgr_lock_flags+0x1b8 #1 0xffffffff8113c18a at VOP_LOCK1_APV+0x3a #2 0xffffffff80c62bd3 at _vn_lock+0x53 #3 0xffffffff80eca0cf at ffs_sync+0x2bf #4 0xffffffff80ee1ded at ufs_sync_nlink+0xad #5 0xffffffff80edffe0 at ufs_mkdir+0x40 #6 0xffffffff8113b44a at VOP_MKDIR_APV+0x6a #7 0xffffffff80c5e90b at kern_mkdirat+0x20b #8 0xffffffff81072918 at amd64_syscall+0x158 #9 0xffffffff8104481b at fast_syscall_common+0xf8 20240715 22:15:50 all (12/38): md7.sh Jul 15 22:18:06 mercat1 kernel: pid 81132 (rw), uid 0 inumber 100218 on /mnt: filesystem full Jul 15 22:18:15 mercat1 kernel: pid 81138 (rw), uid 0 inumber 166412 on /mnt: filesystem full Jul 15 22:20:46 mercat1 kernel: pid 98822 (rw), uid 0 inumber 103417 on /mnt: filesystem full 20240715 22:26:20 all (13/38): mincore.sh 20240715 22:32:03 all (14/38): mmap40.sh Jul 15 22:33:03 mercat1 kernel: pid 3083 (swap), jid 0, uid 0, was killed: a thread waited too long to allocate a page 20240715 22:38:05 all (15/38): oom.sh 20240715 22:38:08 all (16/38): oovm.sh 20240715 22:49:07 all (17/38): oovm2.sh 20240715 22:59:39 all (18/38): pfl.sh 20240715 23:02:14 all (19/38): pfl2.sh Jul 15 23:02:30 mercat1 kernel: pid 13660 (rw), uid 2007 inumber 6150 on /mnt10: filesystem full Jul 15 23:03:12 mercat1 kernel: pid 13654 (rw), uid 2007 inumber 229809 on /mnt10: filesystem full Jul 15 23:04:33 mercat1 kernel: pid 21235 (rw), uid 2007 inumber 201001 on /mnt11: filesystem full Jul 15 23:06:33 mercat1 kernel: pid 23078 (rw), uid 2007 inumber 232559 on /mnt10: filesystem full Jul 15 23:06:38 mercat1 kernel: pid 28281 (rw), uid 2007 inumber 197058 on /mnt11: filesystem full Jul 15 23:07:49 mercat1 kernel: pid 28312 (rw), uid 2007 inumber 134525 on /mnt11: filesystem full Jul 15 23:08:08 mercat1 kernel: pid 28251 (rw), uid 2007 inumber 131380 on /mnt11: filesystem full Jul 15 23:08:38 mercat1 kernel: pid 30102 (rw), uid 2007 inumber 55727 on /mnt10: filesystem full Jul 15 23:10:41 mercat1 kernel: pid 38225 (rw), uid 2007 inumber 239142 on /mnt10: filesystem full Jul 15 23:10:46 mercat1 kernel: pid 38205 (rw), uid 2007 inumber 212111 on /mnt10: filesystem full Jul 15 23:10:49 mercat1 kernel: pid 42702 (rw), uid 2007 inumber 145926 on /mnt11: filesystem full Jul 15 23:12:25 mercat1 kernel: pid 42697 (mkdir), uid 2007 inumber 43438 on /mnt11: filesystem full 20240715 23:12:46 all (20/38): pthread5.sh 20240715 23:13:25 all (21/38): sort.sh 20240715 23:16:32 all (22/38): sort2.sh 20240715 23:25:13 all (23/38): stealer.sh swap_pager: out of swap space swp_pager_getswapspace(11): failed swap_pager: out of swap space swp_pager_getswapspace(9): failed swap_pager: out of swap space swp_pager_getswapspace(26): failed swap_pager: out of swap space swp_pager_getswapspace(24): failed swap_pager: out of swap space swp_pager_getswapspace(23): failed swp_pager_getswapspace(21): failed swp_pager_getswapspace(25): failed swp_pager_getswapspace(29): failed swp_pager_getswapspace(31): failed swp_pager_getswapspace(3): failed swp_pager_getswapspace(18): failed swp_pager_getswapspace(27): failed swp_pager_getswapspace(11): failed swp_pager_getswapspace(17): failed swp_pager_getswapspace(2): failed swp_pager_getswapspace(1): failed swap_pager: out of swap space swp_pager_getswapspace(22): failed swp_pager_getswapspace(26): failed swp_pager_getswapspace(29): failed swp_pager_getswapspace(2): failed swp_pager_getswapspace(4): failed swp_pager_getswapspace(21): failed Jul 15 23:27:29 mercat1 kernel: pid 68132 (stealer), jid 0, uid 2007, was killed: failed to reclaim memory Jul 15 23:27:29 mercat1 kernel: pid 68224 (stealer), jid 0, uid 2007, was killed: failed to reclaim memory Jul 15 23:27:29 mercat1 kernel: pid 68204 (stealer), jid 0, uid 2007, was killed: failed to reclaim memory Jul 15 23:27:29 mercat1 kernel: pid 68222 (stealer), jid 0, uid 2007, was killed: failed to reclaim memory Jul 15 23:27:29 mercat1 kernel: pid 68210 (stealer), jid 0, uid 2007, was killed: failed to reclaim memory Jul 15 23:27:29 mercat1 kernel: pid 68199 (stealer), jid 0, uid 2007, was killed: failed to reclaim memory Jul 15 23:27:29 mercat1 kernel: pid 68198 (stealer), jid 0, uid 2007, was killed: failed to reclaim memory swap_pager: out of swap space swp_pager_getswapspace(17): failed swp_pager_getswapspace(15): failed swap_pager: out of swap space swp_pager_getswapspace(29): failed Jul 15 23:27:52 mercat1 kernel: pid 68184 (stealer), jid 0, uid 2007, was killed: failed to reclaim memory Jul 15 23:27:52 mercat1 kernel: pid 68312 (stealer), jid 0, uid 2007, was killed: failed to reclaim memory Jul 15 23:27:52 mercat1 kernel: pid 68175 (stealer), jid 0, uid 2007, was killed: failed to reclaim memory swp_pager_getswapspace(32): failed 20240715 23:30:57 all (24/38): swap3.sh Jul 15 23:35:15 mercat1 kernel: pid 85274 (swap2), jid 0, uid 0, was killed: a thread waited too long to allocate a page 20240715 23:36:04 all (25/38): swap4.sh Jul 15 23:36:20 mercat1 kernel: pid 2133 (swap4), jid 0, uid 0, was killed: failed to reclaim memory Jul 15 23:36:22 mercat1 kernel: pid 2135 (swap4), jid 0, uid 0, was killed: failed to reclaim memory Jul 15 23:36:25 mercat1 kernel: pid 2138 (swap4), jid 0, uid 0, was killed: failed to reclaim memory 20240715 23:36:27 all (26/38): swap5.sh 20240715 23:45:52 all (27/38): swap6.sh 20240715 23:46:46 all (28/38): swap7.sh 20240715 23:59:28 all (29/38): swapoff.sh Jul 15 23:59:39 mercat1 kernel: pid 82675 (rw), uid 2007 inumber 60387 on /mnt: filesystem full swp_pager_getswapspace(32): failed Jul 16 00:01:43 mercat1 kernel: pid 88875 (rw), uid 2007 inumber 115242 on /mnt: filesystem full Jul 16 00:02:55 mercat1 kernel: pid 88864 (swap), jid 0, uid 2007, was killed: a thread waited too long to allocate a page 20240716 00:03:03 all (30/38): swapoff4.sh Jul 16 00:06:38 mercat1 kernel: pid 94936 (swap), jid 0, uid 0, was killed: failed to reclaim memory Jul 16 00:06:38 mercat1 kernel: pid 94948 (swap), jid 0, uid 0, was killed: failed to reclaim memory 20240716 00:07:11 all (31/38): swapoff6.sh swp_pager_getswapspace(4): failed swp_pager_getswapspace(14): failed swp_pager_getswapspace(4): failed swp_pager_getswapspace(29): failed 20240716 00:14:04 all (32/38): swappedout.sh 20240716 00:16:13 all (33/38): tmpfs.sh Jul 16 00:26:12 mercat1 kernel: pid 66421 (swap), jid 0, uid 0, was killed: a thread waited too long to allocate a page 20240716 00:26:48 all (34/38): tmpfs13.sh 20240716 00:28:54 all (35/38): tmpfs19.sh 20240716 00:29:11 all (36/38): umount2.sh Jul 16 00:31:09 mercat1 kernel: pid 89158 (openat), uid 2007 inumber 560911 on /mnt: out of inodes Jul 16 00:31:13 mercat1 kernel: pid 89616 (openat), uid 2007 inumber 560950 on /mnt: out of inodes 20240716 00:35:42 all (37/38): vmio.sh 20240716 00:35:45 all (38/38): vmp.sh 20240716 00:37:51 all (1/38): crossmp4.sh swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio swap_pager: cannot allocate bio 20240716 00:46:10 all (2/38): crossmp5.sh stress2: newblk leak: 256/260. 20240716 00:51:13 all (3/38): crossmp8.sh 20240716 00:52:25 all (4/38): holdcnt0.sh 20240716 00:52:28 all (5/38): holdcnt02.sh 20240716 00:52:31 all (6/38): holdcnt03.sh 20240716 00:52:33 all (7/38): holdcnt05.sh 20240716 00:52:36 all (8/38): mapwrite.sh 20240716 00:53:36 all (9/38): marcus5.sh Jul 16 00:54:03 mercat1 kernel: pid 15641 (symlink), uid 2007 inumber 561164 on /mnt: out of inodes 20240716 01:10:39 all (10/38): marcus6.sh Jul 16 01:12:37 mercat1 kernel: pid 16268 (link), uid 2007 inumber 641798 on /mnt: out of inodes Jul 16 01:12:38 mercat1 kernel: pid 7973 (openat), uid 2007 inumber 400866 on /mnt: out of inodes 20240716 01:14:08 all (11/38): marcus7.sh 20240716 01:25:12 all (12/38): md7.sh Jul 16 01:25:31 mercat1 kernel: pid 11479 (creat), uid 0 inumber 44934 on /mnt: out of inodes Jul 16 01:27:45 mercat1 kernel: pid 28889 (rw), uid 0 inumber 154644 on /mnt: filesystem full Jul 16 01:28:11 mercat1 kernel: pid 28844 (rw), uid 0 inumber 35846 on /mnt: filesystem full Jul 16 01:31:31 mercat1 kernel: pid 41848 (rw), uid 0 inumber 178724 on /mnt: filesystem full Jul 16 01:31:56 mercat1 kernel: pid 41922 (creat), uid 0 inumber 134806 on /mnt: out of inodes Jul 16 01:32:44 mercat1 kernel: pid 41896 (creat), uid 0 inumber 134800 on /mnt: out of inodes Jul 16 01:34:26 mercat1 kernel: pid 48335 (rw), uid 0 inumber 143885 on /mnt: filesystem full Jul 16 01:34:43 mercat1 kernel: pid 48333 (rw), uid 0 inumber 141610 on /mnt: filesystem full Jul 16 01:35:28 mercat1 kernel: pid 48329 (rw), uid 0 inumber 136663 on /mnt: filesystem full 20240716 01:35:38 all (13/38): mincore.sh 20240716 01:41:14 all (14/38): mmap40.sh Jul 16 01:43:23 mercat1 kernel: pid 73817 (swap), jid 0, uid 0, was killed: a thread waited too long to allocate a page 20240716 01:48:27 all (15/38): oom.sh 20240716 01:48:29 all (16/38): oovm.sh 20240716 01:59:26 all (17/38): oovm2.sh 20240716 02:10:03 all (18/38): pfl.sh 20240716 02:12:38 all (19/38): pfl2.sh 20240716 02:22:58 all (20/38): pthread5.sh 20240716 02:23:36 all (21/38): sort.sh 20240716 02:26:48 all (22/38): sort2.sh Jul 16 02:30:06 mercat1 kernel: pid 2332 (sort), jid 0, uid 0, was killed: a thread waited too long to allocate a page 20240716 02:33:00 all (23/38): stealer.sh swap_pager: out of swap space swp_pager_getswapspace(26): failed swap_pager: out of swap space swp_pager_getswapspace(29): failed swap_pager: out of swap space swp_pager_getswapspace(7): failed swap_pager: out of swap space swp_pager_getswapspace(28): failed swap_pager: out of swap space swp_pager_getswapspace(30): failed swp_pager_getswapspace(21): failed swap_pager: out of swap space swp_pager_getswapspace(6): failed swap_pager: out of swap space swp_pager_getswapspace(14): failed swap_pager: out of swap space swp_pager_getswapspace(28): failed swap_pager: out of swap space swp_pager_getswapspace(14): failed swap_pager: out of swap space swp_pager_getswapspace(7): failed swp_pager_getswapspace(14): failed swap_pager: out of swap space swp_pager_getswapspace(32): failed swap_pager: out of swap space swp_pager_getswapspace(12): failed swap_pager: out of swap space swp_pager_getswapspace(31): failed swp_pager_getswapspace(22): failed swp_pager_getswapspace(30): failed swp_pager_getswapspace(15): failed swp_pager_getswapspace(25): failed swp_pager_getswapspace(26): failed swp_pager_getswapspace(30): failed swp_pager_getswapspace(5): failed swp_pager_getswapspace(10): failed swp_pager_getswapspace(6): failed swp_pager_getswapspace(31): failed swap_pager: out of swap space swp_pager_getswapspace(16): failed swp_pager_getswapspace(11): failed swp_pager_getswapspace(26): failed swp_pager_getswapspace(1): failed swp_pager_getswapspace(10): failed swp_pager_getswapspace(1): failed swp_pager_getswapspace(1): failed swp_pager_getswapspace(19): failed swp_pager_getswapspace(32): failed Jul 16 02:36:16 mercat1 kernel: pid 15517 (stealer), jid 0, uid 2007, was killed: failed to reclaim memory Jul 16 02:36:16 mercat1 kernel: pid 15660 (stealer), jid 0, uid 2007, was killed: failed to reclaim memory Jul 16 02:36:16 mercat1 kernel: pid 15666 (stealer), jid 0, uid 2007, was killed: failed to reclaim memory Jul 16 02:36:16 mercat1 kernel: pid 15533 (stealer), jid 0, uid 2007, was killed: failed to reclaim memory 20240716 02:39:17 all (24/38): swap3.sh Jul 16 02:42:25 mercat1 kernel: pid 19658 (swap2), jid 0, uid 0, was killed: failed to reclaim memory Jul 16 02:44:32 mercat1 kernel: pid 19657 (swap2), jid 0, uid 0, was killed: failed to reclaim memory 20240716 02:44:35 all (25/38): swap4.sh Jul 16 02:44:53 mercat1 kernel: pid 30974 (swap4), jid 0, uid 0, was killed: failed to reclaim memory Jul 16 02:44:54 mercat1 kernel: pid 30978 (swap4), jid 0, uid 0, was killed: failed to reclaim memory Jul 16 02:44:56 mercat1 kernel: pid 30979 (swap4), jid 0, uid 0, was killed: failed to reclaim memory 20240716 02:44:59 all (26/38): swap5.sh 20240716 02:54:26 all (27/38): swap6.sh 20240716 02:56:15 all (28/38): swap7.sh 20240716 03:12:32 all (29/38): swapoff.sh Jul 16 03:12:44 mercat1 kernel: pid 57856 (rw), uid 2007 inumber 17460 on /mnt: filesystem full Jul 16 03:14:53 mercat1 kernel: pid 65563 (rw), uid 2007 inumber 25672 on /mnt: filesystem full 20240716 03:15:14 all (30/38): swapoff4.sh 20240716 03:19:34 all (31/38): swapoff6.sh swp_pager_getswapspace(3): failed swp_pager_getswapspace(29): failed swp_pager_getswapspace(5): failed swp_pager_getswapspace(17): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(9): failed swp_pager_getswapspace(32): failed Jul 16 03:22:09 mercat1 kernel: pid 14833 (sort), jid 0, uid 0, was killed: failed to reclaim memory swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(5): failed swp_pager_getswapspace(1): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(31): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(31): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(1): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed Jul 16 03:22:13 mercat1 kernel: pid 14837 (sort), jid 0, uid 0, was killed: failed to reclaim memory swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(1): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(1): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(1): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(1): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(1): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(31): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed Jul 16 03:22:20 mercat1 kernel: pid 14841 (sort), jid 0, uid 0, was killed: failed to reclaim memory swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed Jul 16 03:22:21 mercat1 kernel: pid 14845 (sort), jid 0, uid 0, was killed: failed to reclaim memory swp_pager_getswapspace(21): failed swp_pager_getswapspace(25): failed swp_pager_getswapspace(15): failed Jul 16 03:22:52 mercat1 kernel: pid 28916 (sort), jid 0, uid 0, was killed: failed to reclaim memory swp_pager_getswapspace(32): failed swp_pager_getswapspace(2): failed swp_pager_getswapspace(32): failed Jul 16 03:23:05 mercat1 kernel: pid 29993 (sort), jid 0, uid 0, was killed: failed to reclaim memory swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed Jul 16 03:23:20 mercat1 kernel: pid 29997 (sort), jid 0, uid 0, was killed: failed to reclaim memory Jul 16 03:23:20 mercat1 kernel: pid 30001 (sort), jid 0, uid 0, was killed: failed to reclaim memory Jul 16 03:23:20 mercat1 kernel: pid 34629 (sort), jid 0, uid 0, was killed: failed to reclaim memory Jul 16 03:23:20 mercat1 kernel: pid 36960 (sort), jid 0, uid 0, was killed: failed to reclaim memory swp_pager_getswapspace(21): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe01083f25c0 hardclock() at hardclock+0x103/frame 0xfffffe01083f2600 handleevents() at handleevents+0xaf/frame 0xfffffe01083f2640 timercb() at timercb+0x18e/frame 0xfffffe01083f2690 lapic_handle_timer() at lapic_handle_timer+0xab/frame 0xfffffe01083f26b0 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe01083f26b0 --- interrupt, rip = 0xffffffff80b2a650, rsp = 0xfffffe01083f2780, rbp = 0xfffffe01083f2790 --- __mtx_unlock_flags() at __mtx_unlock_flags+0x90/frame 0xfffffe01083f2790 vm_page_pqstate_commit_dequeue() at vm_page_pqstate_commit_dequeue+0xb6/frame 0xfffffe01083f27d0 vm_page_unswappable() at vm_page_unswappable+0x68/frame 0xfffffe01083f2800 vm_pageout_flush() at vm_pageout_flush+0x1a7/frame 0xfffffe01083f2900 vm_pageout_cluster() at vm_pageout_cluster+0x33b/frame 0xfffffe01083f2b70 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x70e/frame 0xfffffe01083f2ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01083f2f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01083f2f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- KDB: enter: watchdog timeout [ thread pid 9 tid 100199 ] Stopped at kdb_enter+0x33: movq $0,0x10551f2(%rip) db> run pho db:0:pho> set $lines 20000 db:0:pho> run pho1 db:1:pho1> dump Dumping 3914 out of 32620 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% Dump complete db:1:pho1> bt Tracing pid 9 tid 100199 td 0xfffff80003e85740 kdb_enter() at kdb_enter+0x33/frame 0xfffffe01083f2600 handleevents() at handleevents+0xaf/frame 0xfffffe01083f2640 timercb() at timercb+0x18e/frame 0xfffffe01083f2690 lapic_handle_timer() at lapic_handle_timer+0xab/frame 0xfffffe01083f26b0 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe01083f26b0 --- interrupt, rip = 0xffffffff80b2a650, rsp = 0xfffffe01083f2780, rbp = 0xfffffe01083f2790 --- __mtx_unlock_flags() at __mtx_unlock_flags+0x90/frame 0xfffffe01083f2790 vm_page_pqstate_commit_dequeue() at vm_page_pqstate_commit_dequeue+0xb6/frame 0xfffffe01083f27d0 vm_page_unswappable() at vm_page_unswappable+0x68/frame 0xfffffe01083f2800 vm_pageout_flush() at vm_pageout_flush+0x1a7/frame 0xfffffe01083f2900 vm_pageout_cluster() at vm_pageout_cluster+0x33b/frame 0xfffffe01083f2b70 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x70e/frame 0xfffffe01083f2ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01083f2f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01083f2f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:1:pho1> show allpcpu Current CPU: 3 cpuid = 0 dynamic pcpu = 0x9f8e40 curthread = 0xfffff80003bee740: pid 11 tid 100003 critnest 1 "idle: cpu0" curpcb = 0xfffff80003beec60 fpcurthread = none idlethread = 0xfffff80003bee740: tid 100003 "idle: cpu0" self = 0xffffffff82410000 curpmap = 0xffffffff81b97df0 tssp = 0xffffffff82410384 rsp0 = 0xfffffe0108015000 kcr3 = 0x800000000238a002 ucr3 = 0xffffffffffffffff scr3 = 0x23ba5db46 gs32p = 0xffffffff82410404 ldt = 0xffffffff82410444 tss = 0xffffffff82410434 curvnet = 0 spin locks held: cpuid = 1 dynamic pcpu = 0xfffffe00bb4b5e40 curthread = 0xfffff80003bee000: pid 11 tid 100004 critnest 1 "idle: cpu1" curpcb = 0xfffff80003bee520 fpcurthread = none idlethread = 0xfffff80003bee000: tid 100004 "idle: cpu1" self = 0xffffffff82411000 curpmap = 0xffffffff81b97df0 tssp = 0xffffffff82411384 rsp0 = 0xfffffe0108010000 kcr3 = 0x800000000238a002 ucr3 = 0xffffffffffffffff scr3 = 0x658b76801 gs32p = 0xffffffff82411404 ldt = 0xffffffff82411444 tss = 0xffffffff82411434 curvnet = 0 spin locks held: cpuid = 2 dynamic pcpu = 0xfffffe00bb4c4e40 curthread = 0xfffff80003bef740: pid 11 tid 100005 critnest 1 "idle: cpu2" curpcb = 0xfffff80003befc60 fpcurthread = none idlethread = 0xfffff80003bef740: tid 100005 "idle: cpu2" self = 0xffffffff82412000 curpmap = 0xffffffff81b97df0 tssp = 0xffffffff82412384 rsp0 = 0xfffffe010801f000 kcr3 = 0x800000000238a002 ucr3 = 0xffffffffffffffff scr3 = 0x1311fce1 gs32p = 0xffffffff82412404 ldt = 0xffffffff82412444 tss = 0xffffffff82412434 curvnet = 0 spin locks held: cpuid = 3 dynamic pcpu = 0xfffffe00bb4d3e40 curthread = 0xfffff80003e85740: pid 9 tid 100199 critnest 1 "laundry: dom0" curpcb = 0xfffff80003e85c60 fpcurthread = none idlethread = 0xfffff80003bef000: tid 100006 "idle: cpu3" self = 0xffffffff82413000 curpmap = 0xffffffff81b97df0 tssp = 0xffffffff82413384 rsp0 = 0xfffffe01083f3000 kcr3 = 0x800000000238a002 ucr3 = 0xffffffffffffffff scr3 = 0x144cadfdb gs32p = 0xffffffff82413404 ldt = 0xffffffff82413444 tss = 0xffffffff82413434 curvnet = 0 spin locks held: cpuid = 4 dynamic pcpu = 0xfffffe00bb4e2e40 curthread = 0xfffff80003bf0740: pid 11 tid 100007 critnest 1 "idle: cpu4" curpcb = 0xfffff80003bf0c60 fpcurthread = none idlethread = 0xfffff80003bf0740: tid 100007 "idle: cpu4" self = 0xffffffff82414000 curpmap = 0xffffffff81b97df0 tssp = 0xffffffff82414384 rsp0 = 0xfffffe0108029000 kcr3 = 0x800000000238a002 ucr3 = 0xffffffffffffffff scr3 = 0x68b8f5c34 gs32p = 0xffffffff82414404 ldt = 0xffffffff82414444 tss = 0xffffffff82414434 curvnet = 0 spin locks held: cpuid = 5 dynamic pcpu = 0xfffffe00bb4f1e40 curthread = 0xfffff80003bf0000: pid 11 tid 100008 critnest 1 "idle: cpu5" curpcb = 0xfffff80003bf0520 fpcurthread = none idlethread = 0xfffff80003bf0000: tid 100008 "idle: cpu5" self = 0xffffffff82415000 curpmap = 0xffffffff81b97df0 tssp = 0xffffffff82415384 rsp0 = 0xfffffe0108024000 kcr3 = 0x800000000238a002 ucr3 = 0xffffffffffffffff scr3 = 0x4078fd4d gs32p = 0xffffffff82415404 ldt = 0xffffffff82415444 tss = 0xffffffff82415434 curvnet = 0 spin locks held: cpuid = 6 dynamic pcpu = 0xfffffe00bb500e40 curthread = 0xfffff80003bd9740: pid 11 tid 100009 critnest 1 "idle: cpu6" curpcb = 0xfffff80003bd9c60 fpcurthread = none idlethread = 0xfffff80003bd9740: tid 100009 "idle: cpu6" self = 0xffffffff82416000 curpmap = 0xffffffff81b97df0 tssp = 0xffffffff82416384 rsp0 = 0xfffffe0108033000 kcr3 = 0x800000000238a002 ucr3 = 0xffffffffffffffff scr3 = 0x180a62da0 gs32p = 0xffffffff82416404 ldt = 0xffffffff82416444 tss = 0xffffffff82416434 curvnet = 0 spin locks held: cpuid = 7 dynamic pcpu = 0xfffffe00bb50fe40 curthread = 0xfffff80003bd9000: pid 11 tid 100010 critnest 1 "idle: cpu7" curpcb = 0xfffff80003bd9520 fpcurthread = none idlethread = 0xfffff80003bd9000: tid 100010 "idle: cpu7" self = 0xffffffff82417000 curpmap = 0xffffffff81b97df0 tssp = 0xffffffff82417384 rsp0 = 0xfffffe010802e000 kcr3 = 0x800000000238a002 ucr3 = 0xffffffffffffffff scr3 = 0x2ad32b919 gs32p = 0xffffffff82417404 ldt = 0xffffffff82417444 tss = 0xffffffff82417434 curvnet = 0 spin locks held: cpuid = 8 dynamic pcpu = 0xfffffe00bb51ee40 curthread = 0xfffff80003bda740: pid 11 tid 100011 critnest 1 "idle: cpu8" curpcb = 0xfffff80003bdac60 fpcurthread = none idlethread = 0xfffff80003bda740: tid 100011 "idle: cpu8" self = 0xffffffff82418000 curpmap = 0xffffffff81b97df0 tssp = 0xffffffff82418384 rsp0 = 0xfffffe010803d000 kcr3 = 0x800000000238a002 ucr3 = 0xffffffffffffffff scr3 = 0x7fa78bc36 gs32p = 0xffffffff82418404 ldt = 0xffffffff82418444 tss = 0xffffffff82418434 curvnet = 0 spin locks held: cpuid = 9 dynamic pcpu = 0xfffffe00bb52de40 curthread = 0xfffff80003bda000: pid 11 tid 100012 critnest 1 "idle: cpu9" curpcb = 0xfffff80003bda520 fpcurthread = none idlethread = 0xfffff80003bda000: tid 100012 "idle: cpu9" self = 0xffffffff82419000 curpmap = 0xffffffff81b97df0 tssp = 0xffffffff82419384 rsp0 = 0xfffffe0108038000 kcr3 = 0x800000000238a002 ucr3 = 0xffffffffffffffff scr3 = 0x82d394f6e gs32p = 0xffffffff82419404 ldt = 0xffffffff82419444 tss = 0xffffffff82419434 curvnet = 0 spin locks held: cpuid = 10 dynamic pcpu = 0xfffffe00bb53ce40 curthread = 0xfffff80003bdb740: pid 11 tid 100013 critnest 1 "idle: cpu10" curpcb = 0xfffff80003bdbc60 fpcurthread = none idlethread = 0xfffff80003bdb740: tid 100013 "idle: cpu10" self = 0xffffffff8241a000 curpmap = 0xffffffff81b97df0 tssp = 0xffffffff8241a384 rsp0 = 0xfffffe0108047000 kcr3 = 0x800000000238a002 ucr3 = 0xffffffffffffffff scr3 = 0x2ad32bf8d gs32p = 0xffffffff8241a404 ldt = 0xffffffff8241a444 tss = 0xffffffff8241a434 curvnet = 0 spin locks held: cpuid = 11 dynamic pcpu = 0xfffffe00bb54be40 curthread = 0xfffff80003bdb000: pid 11 tid 100014 critnest 1 "idle: cpu11" curpcb = 0xfffff80003bdb520 fpcurthread = none idlethread = 0xfffff80003bdb000: tid 100014 "idle: cpu11" self = 0xffffffff8241b000 curpmap = 0xffffffff81b97df0 tssp = 0xffffffff8241b384 rsp0 = 0xfffffe0108042000 kcr3 = 0x800000000238a002 ucr3 = 0xffffffffffffffff scr3 = 0x180a62be9 gs32p = 0xffffffff8241b404 ldt = 0xffffffff8241b444 tss = 0xffffffff8241b434 curvnet = 0 spin locks held: db:1:pho1> show alllocks db:1:pho1> show lockedvnods Locked vnodes vnode 0xfffffe01651e4258: type VREG state VSTATE_CONSTRUCTED op 0xffffffff81943058 usecount 5, writecount -12, refcount 3 seqc users 0 hold count flags () flags (VIRF_PGREAD|VMP_LAZYLIST) v_object 0xfffff8004030e420 ref 9 pages 8 cleanbuf 1 dirtybuf 0 lock type ufs: SHARED (count 1) #0 0xffffffff80b1c9f8 at lockmgr_lock_flags+0x1b8 #1 0xffffffff80eccb4d at ffs_lock+0x9d #2 0xffffffff8113c18a at VOP_LOCK1_APV+0x3a #3 0xffffffff80c62bd3 at _vn_lock+0x53 #4 0xffffffff80c496c5 at vget_finish+0x75 #5 0xffffffff80ef8583 at vm_fault_lock_vnode+0x93 #6 0xffffffff80ef5815 at vm_fault+0x605 #7 0xffffffff80ef50ad at vm_fault_trap+0x5d #8 0xffffffff8107218d at trap_pfault+0x21d #9 0xffffffff8107175d at trap+0x51d #10 0xffffffff81043f08 at calltrap+0x8 nlink=1, effnlink=1, size=118760, extsize 0 generation=6504c049, uid=0, gid=0, flags=0x0 ino 4815432, on dev gpt/work vnode 0xfffffe016d60a258: type VREG state VSTATE_CONSTRUCTED op 0xffffffff81943058 usecount 1, writecount 0, refcount 12 seqc users 0 hold count flags () flags (VIRF_PGREAD) v_object 0xfffff803d861f948 ref 0 pages 77 cleanbuf 10 dirtybuf 0 lock type ufs: SHARED (count 1) #0 0xffffffff80b1c9f8 at lockmgr_lock_flags+0x1b8 #1 0xffffffff80eccb4d at ffs_lock+0x9d #2 0xffffffff8113c18a at VOP_LOCK1_APV+0x3a #3 0xffffffff80c62bd3 at _vn_lock+0x53 #4 0xffffffff80c6822c at vn_read+0x13c #5 0xffffffff80c68045 at vn_io_fault_doio+0x45 #6 0xffffffff80c635ce at vn_io_fault1+0x15e #7 0xffffffff80c60e08 at vn_io_fault+0x158 #8 0xffffffff80bca490 at dofileread+0x80 #9 0xffffffff80bca017 at sys_read+0xb7 #10 0xffffffff81072918 at amd64_syscall+0x158 #11 0xffffffff8104481b at fast_syscall_common+0xf8 nlink=1, effnlink=1, size=1593408, extsize 0 generation=c6e4c169, uid=0, gid=0, flags=0x0 ino 3290788, on dev gpt/work db:1:pho1> show mount 0xfffffe010ebdc700 /dev/gpt/work on / (ufs) 0xfffffe010ebdd280 devfs on /dev (devfs) 0xfffffe01651da700 /dev/gpt/tmp on /tmp (ufs) 0xfffffe017b061700 procfs on /proc (procfs) More info: show mount db:1:pho1> show bufqueues bqempty: 13501 Buf domain 0 freebufs 329 lofreebufs 219 hifreebufs 329 bufspace 215355392 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 14660 (210866176) dirtyq count 0 (0) wakeup 0 lim 25 CPU 19, 20, 3, 1, 22, 18, 16, 15, 2, 20, 7, 1, Locked buffers: 0 space 0 Total buffers: 18667 space 215355392 Buf domain 1 freebufs 419 lofreebufs 219 hifreebufs 329 bufspace 235450368 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 14605 (233009152) dirtyq count 0 (0) wakeup 0 lim 25 CPU 0, 2, 11, 20, 8, 1, 15, 5, 5, 20, 9, 13, Locked buffers: 0 space 0 Total buffers: 15827 space 235450368 Buf domain 2 freebufs 5332 lofreebufs 219 hifreebufs 329 bufspace 168050688 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 9643 (164687872) dirtyq count 0 (0) wakeup 0 lim 25 CPU 11, 20, 21, 19, 5, 9, 1, 13, 0, 24, 15, 20, Locked buffers: 0 space 0 Total buffers: 9801 space 168050688 Buf domain 3 freebufs 3291 lofreebufs 219 hifreebufs 329 bufspace 235368448 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 11692 (232312832) dirtyq count 0 (0) wakeup 0 lim 25 CPU 17, 19, 1, 24, 24, 3, 7, 8, 6, 9, 14, 18, Locked buffers: 0 space 0 Total buffers: 12825 space 235368448 Buf domain 4 freebufs 329 lofreebufs 219 hifreebufs 329 bufspace 214401024 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 14631 (209375232) dirtyq count 0 (0) wakeup 0 lim 25 CPU 20, 7, 20, 19, 14, 21, 11, 4, 23, 6, 4, 14, Locked buffers: 10 space 294912 Total buffers: 18237 space 214368256 Buf domain 5 freebufs 329 lofreebufs 219 hifreebufs 329 bufspace 230948864 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 14643 (226422784) dirtyq count 0 (0) wakeup 0 lim 25 CPU 10, 24, 6, 4, 6, 15, 20, 22, 19, 12, 1, 22, Locked buffers: 0 space 0 Total buffers: 17545 space 230948864 Buf domain 6 freebufs 3472 lofreebufs 219 hifreebufs 329 bufspace 235433984 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 11530 (232108032) dirtyq count 0 (0) wakeup 0 lim 25 CPU 13, 5, 0, 8, 14, 13, 0, 21, 15, 14, 19, 9, Locked buffers: 0 space 0 Total buffers: 13029 space 235433984 db:1:pho1> show page vm_cnt.v_free_count: 4332 vm_cnt.v_inactive_count: 2 vm_cnt.v_active_count: 50008 vm_cnt.v_laundry_count: 6786948 vm_cnt.v_wire_count: 1087452 vm_cnt.v_free_reserved: 10642 vm_cnt.v_free_min: 51257 vm_cnt.v_free_target: 173102 vm_cnt.v_inactive_target: 259653 db:1:pho1> show pageq pq_free 4332 dom 0 page_cnt 8123039 free 4332 pq_act 50008 pq_inact 2 pq_laund 6786948 pq_unsw 193988 db:0:pho> show freepages DOMAIN: 0 FREE LIST 0: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 | POOL 2 -- -- -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 | 000000 11 (008192K) | 000000 | 000000 | 000000 10 (004096K) | 000000 | 000000 | 000000 09 (002048K) | 000000 | 000000 | 000000 08 (001024K) | 000000 | 000000 | 000000 07 (000512K) | 000000 | 000000 | 000000 06 (000256K) | 000000 | 000000 | 000000 05 (000128K) | 000000 | 000001 | 000000 04 (000064K) | 000000 | 000002 | 000000 03 (000032K) | 000000 | 000010 | 000000 02 (000016K) | 000000 | 000063 | 000001 01 (000008K) | 000000 | 000168 | 000018 00 (000004K) | 000000 | 002912 | 000235 FREE LIST 1: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 | POOL 2 -- -- -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 | 000000 11 (008192K) | 000000 | 000000 | 000000 10 (004096K) | 000000 | 000000 | 000000 09 (002048K) | 000000 | 000000 | 000000 08 (001024K) | 000000 | 000000 | 000000 07 (000512K) | 000000 | 000000 | 000000 06 (000256K) | 000000 | 000000 | 000000 05 (000128K) | 000000 | 000000 | 000000 04 (000064K) | 000000 | 000000 | 000000 03 (000032K) | 000000 | 000000 | 000000 02 (000016K) | 000000 | 000000 | 000000 01 (000008K) | 000000 | 000000 | 000000 00 (000004K) | 000000 | 000000 | 000000 db:0:pho> show uma Zone Size Used Free Requests Sleeps Bucket Total Mem XFree FFS inode 1168 619283 1120 246272523 0 8 724630704 0 VNODE 600 619420 1044 445666653 0 16 372278400 0 FFS2 dinode 256 619283 1747 246260869 0 62 158983680 0 malloc-4096 4096 34169 0 40444 0 2 139956224 0 VM OBJECT 264 125955 394200 411562729 0 30 137320920 0 swblk 136 871 719866 7809337 0 62 98020232 0 L VFS Cache 320 252021 351 542661 0 30 80759040 0 RADIX NODE 144 530901 1040 382133346 0 62 76599504 0 Files 80 132 940968 1459109520 0 126 75288000 0 THREAD 1824 17407 17841 19648811 0 8 64292352 0 S VFS Cache 104 367883 141925 231012588 0 126 53020032 0 mbuf_cluster 2048 12295 343 168369 0 8 25882624 0 PROC 1376 80 17113 14457693 0 8 23657568 0 BUF TRIE 144 5950 100002 67976425 0 62 15257088 0 UMA Slabs 0 112 130531 4571 3738637 0 126 15131424 0 FPU_save_area 832 17409 114 21149214 0 16 14579136 0 vmem btag 56 212603 10657 2836230 0 254 12502560 0 malloc-128 128 96524 258 51097951 0 126 12388096 0 malloc-128 128 86061 1235 3124051372 0 126 11173888 0 VMSPACE 616 50 17080 14443863 0 16 10552080 0 malloc-128 128 73886 2250 358468643 0 126 9745408 0 swpctrie 144 89 48631 607662 0 62 7015680 0 malloc-384 384 17204 76 826206 0 30 6635520 0 mbuf 256 16472 6152 52498107 0 254 5791744 0 TURNSTILE 136 35249 325 35249 0 62 4838064 0 malloc-256 256 17469 261 20106937 0 62 4538880 0 pbuf 2776 0 1455 0 0 0 4039080 0 TMPFS node 232 0 16932 176368469 0 62 3928224 0 SLEEPQUEUE 88 35249 399 35249 0 126 3137024 0 malloc-16 16 176974 2026 1065805 0 254 2864000 0 malloc-32 32 79272 1242 2113058 0 254 2576448 0 malloc-128 128 18519 236 1611317 0 126 2400640 0 ksiginfo 112 17182 3050 2764065 0 126 2265984 0 malloc-4096 4096 339 0 1057442 0 2 1388544 0 malloc-512 512 1777 255 1132626 0 30 1040384 0 malloc-256 256 3327 183 158049235 0 62 898560 0 malloc-64 64 11693 340 30327 0 254 770112 0 MAP ENTRY 96 2347 5381 588837484 0 126 741888 0 malloc-65536 65536 11 0 46 0 1 720896 0 malloc-8192 8192 88 0 164 0 1 720896 0 malloc-64 64 9054 1908 35076199 0 254 701568 0 rl_entry 40 12425 2119 463254 0 254 581760 0 lkpicurr 168 13 3083 13 0 62 520128 0 UMA Zones 2048 243 1 374 0 8 499712 0 malloc-32768 32768 15 0 25 0 1 491520 0 malloc-32768 32768 15 0 3355 0 1 491520 0 malloc-32768 32768 12 0 19 0 1 393216 0 malloc-4096 4096 96 0 14458648 0 2 393216 0 malloc-64 64 4736 871 1630254542 0 254 358848 0 Mountpoints 2944 4 116 40670 0 4 353280 0 malloc-32 32 8614 1340 29962181 0 254 318528 0 malloc-16 16 16652 3098 234192903 0 254 316000 0 malloc-2048 2048 134 8 401 0 8 290816 0 malloc-1024 1024 236 44 2237410 0 16 286720 0 malloc-32768 32768 8 0 3252 0 1 262144 0 malloc-64 64 3434 472 210647190 0 254 249984 0 malloc-8192 8192 30 0 55 0 1 245760 0 malloc-2048 2048 108 2 50705 0 8 225280 0 malloc-256 256 549 306 3197640 0 62 218880 0 malloc-16384 16384 13 0 52 0 1 212992 0 filedesc0 1072 75 121 14457694 0 8 210112 0 256 Bucket 2048 51 47 127000050 0 8 200704 0 malloc-65536 65536 3 0 10 0 1 196608 0 malloc-65536 65536 3 0 3200 0 1 196608 0 malloc-16384 16384 12 0 6018 0 1 196608 0 malloc-64 64 210 2751 29079314 0 254 189504 0 malloc-128 128 702 755 259854128 0 126 186496 0 PGRP 120 30 1521 6277 0 126 186120 0 PWD 40 17 4528 147944747 0 254 181800 0 pcpu-8 8 20718 1810 21773 0 254 180224 0 tcp_inpcb 1304 6 129 215462 0 8 176040 0 lkpimm 56 3 3093 3 0 254 173376 0 malloc-1024 1024 135 25 373894 0 16 163840 0 fakepg 104 0 1521 3108 0 126 158184 0 udplite_inpcb 416 0 378 6461 0 30 157248 0 tcp_inpcb ports 32 2 4912 212143 0 254 157248 0 malloc-256 256 295 305 2276937 0 62 153600 0 udp_inpcb 416 4 347 1204 0 30 146016 0 malloc-65536 65536 2 0 3269 0 1 131072 0 malloc-256 256 302 163 8167311 0 62 119040 0 malloc-256 256 59 406 406934632 0 62 119040 0 malloc-64 64 143 1621 14808243 0 254 112896 0 malloc-384 384 185 95 434726 0 30 107520 0 malloc-128 128 381 456 29884655 0 126 107136 0 malloc-8192 8192 13 0 216120 0 1 106496 0 pipe 728 16 127 4667241 0 16 104104 0 DEVCTL 1024 0 100 1676122 0 0 102400 0 malloc-32768 32768 3 0 3616 0 1 98304 0 malloc-16384 16384 6 0 299850 0 1 98304 0 malloc-8192 8192 12 0 10680 0 1 98304 0 ttyinq 160 330 270 5626 0 62 96000 0 malloc-32 32 1139 1759 776664 0 254 92736 0 32 Bucket 256 41 289 91845917 0 62 84480 0 malloc-16384 16384 5 0 24 0 1 81920 0 UMA Kegs 384 213 0 344 0 30 81792 0 socket 960 27 53 5810757 0 16 76800 0 malloc-32 32 319 2075 2853263 0 254 76608 0 udp_inpcb ports 32 2 2266 228 0 254 72576 0 8 Bucket 80 24 876 31140316 0 126 72000 0 malloc-128 128 146 412 192130 0 126 71424 0 malloc-65536 65536 1 0 6 0 1 65536 0 malloc-32768 32768 2 0 2 0 1 65536 0 ttyoutq 256 173 82 2992 0 62 65280 0 malloc-32 32 287 1729 6228069 0 254 64512 0 malloc-64 64 257 688 2110961242 0 254 60480 0 malloc-32 32 152 1738 7963 0 254 60480 0 malloc-32 32 156 1608 205766 0 254 56448 0 malloc-16 16 337 3163 18301069 0 254 56000 0 malloc-2048 2048 18 8 10758 0 8 53248 0 pcpu-64 64 479 353 496 0 254 53248 0 malloc-128 128 48 355 2636270 0 126 51584 0 malloc-8192 8192 6 0 49 0 1 49152 0 malloc-8192 8192 6 0 83746 0 1 49152 0 pcpu-16 16 120 2952 120 0 254 49152 0 malloc-32 32 50 1462 336753 0 254 48384 0 malloc-16 16 367 2633 9938253 0 254 48000 0 128 Bucket 1024 14 29 30965042 0 16 44032 0 malloc-384 384 58 52 146738 0 30 42240 0 malloc-4096 4096 10 0 585256 0 2 40960 0 malloc-1024 1024 30 10 1006010 0 16 40960 0 malloc-16 16 264 2236 1192543 0 254 40000 0 malloc-16 16 263 1987 523204 0 254 36000 0 malloc-16 16 620 1630 1685916 0 254 36000 0 unpcb 256 15 120 5538582 0 62 34560 0 malloc-32768 32768 1 0 489819 0 1 32768 0 malloc-16384 16384 2 0 1299 0 1 32768 0 malloc-1024 1024 19 13 1287853 0 16 32768 0 malloc-512 512 33 31 5348 0 30 32768 0 malloc-16 16 42 1958 531911 0 254 32000 0 malloc-256 256 26 94 234472779 0 62 30720 0 malloc-64 64 18 423 1105943 0 254 28224 0 malloc-384 384 22 48 14513 0 30 26880 0 malloc-8192 8192 3 0 40325 0 1 24576 0 64 Bucket 512 21 27 61148444 0 30 24576 0 malloc-2048 2048 8 2 102504 0 8 20480 0 malloc-2048 2048 5 5 4006661 0 8 20480 0 malloc-2048 2048 8 2 1323 0 8 20480 0 malloc-1024 1024 13 7 31225 0 16 20480 0 16 Bucket 144 12 128 61110967 0 62 20160 0 malloc-16384 16384 1 0 17 0 1 16384 0 malloc-8192 8192 2 0 153 0 1 16384 0 malloc-1024 1024 8 8 14508 0 16 16384 0 ertt 72 6 218 215462 0 126 16128 0 cpuset 200 27 53 27 0 62 16000 0 routing nhops 256 9 51 14 0 62 15360 0 ripcb 384 1 39 11 0 30 15360 0 malloc-4096 4096 3 0 33365 0 2 12288 0 malloc-2048 2048 3 3 332213 0 8 12288 0 malloc-2048 2048 4 2 74193 0 8 12288 0 malloc-512 512 3 21 836 0 30 12288 0 rtentry 168 12 60 14 0 62 12096 0 KMAP ENTRY 96 84 39 5821 0 0 11808 0 malloc-384 384 10 20 563 0 30 11520 0 malloc-256 256 3 42 268825796 0 62 11520 0 malloc-4096 4096 2 0 14 0 2 8192 0 malloc-1024 1024 2 6 411851 0 16 8192 0 malloc-1024 1024 3 5 7440346 0 16 8192 0 malloc-512 512 2 14 571097 0 30 8192 0 malloc-512 512 3 13 471325 0 30 8192 0 hostcache 64 0 126 2 0 254 8064 0 KNOTE 160 11 39 15073920 0 62 8000 0 UMA Slabs 1 176 43 2 44 0 62 7920 0 kenv 258 18 12 27428 0 30 7740 0 SMR CPU 32 8 151 8 0 254 5088 0 epoch_record pcpu 256 4 12 4 0 62 4096 0 malloc-4096 4096 1 0 57918 0 2 4096 0 malloc-4096 4096 1 0 42366 0 2 4096 0 malloc-512 512 1 7 5812 0 30 4096 0 udplite_inpcb ports 32 0 126 1 0 254 4032 0 vtnet_tx_hdr 24 0 167 0 0 254 4008 0 malloc-384 384 1 9 292718688 0 30 3840 0 SMR SHARED 24 8 151 8 0 254 3816 0 mqnode 416 3 6 3 0 30 3744 0 vmem 1856 2 0 2 0 8 3712 0 mbuf_packet 256 11 0 7020707 0 254 2816 0 clpbuf 2776 1 0 2069853 0 4 2776 0 taskq_zone 160 0 0 0 0 62 0 0 dtrace_state_cache 65536 0 0 1 0 1 0 0 mqnotifier 216 0 0 0 0 62 0 0 mvdata 64 0 0 0 0 254 0 0 mqueue 248 0 0 0 0 62 0 0 sctp_asconf_ack 48 0 0 0 0 254 0 0 sctp_asconf 40 0 0 0 0 254 0 0 sctp_stream_msg_out 112 0 0 0 0 126 0 0 sctp_readq 152 0 0 0 0 62 0 0 sctp_chunk 152 0 0 48881 0 62 0 0 sctp_raddr 736 0 0 48881 0 16 0 0 sctp_laddr 48 0 0 0 0 254 0 0 sctp_asoc 2256 0 0 48881 0 4 0 0 sctp_ep 1152 0 0 48883 0 8 0 0 FFS1 dinode 128 0 0 11 0 126 0 0 da_ccb 544 0 0 0 0 16 0 0 ada_ccb 272 0 0 11249062 0 30 0 0 tfo_ccache_entries 80 0 0 0 0 126 0 0 tfo 4 0 0 0 0 254 0 0 sackhole 32 0 0 6999 0 254 0 0 syncache 168 0 0 3311 0 62 0 0 ipq 56 0 0 0 0 254 0 0 tcp_log_id_node 120 0 0 0 0 126 0 0 tcp_log_id_bucket 176 0 0 0 0 62 0 0 tcp_log 416 0 0 0 0 30 0 0 tcpreass 48 0 0 6671 0 254 0 0 ripcb ports 32 0 0 0 0 254 0 0 IPsec SA lft_c 16 0 0 0 0 254 0 0 itimer 352 0 0 3 0 30 0 0 AIOLIO 272 0 0 8 0 30 0 0 AIOCB 552 0 0 32 0 16 0 0 AIO 208 0 0 2 0 62 0 0 DIRHASH 1024 0 0 5044779 0 16 0 0 NCLNODE 760 0 0 0 0 16 0 0 NAMEI 1024 0 0 3186383894 0 16 0 0 LTS VFS Cache 360 0 0 0 0 30 0 0 STS VFS Cache 144 0 0 0 0 62 0 0 cryptop 280 0 0 0 0 30 0 0 linux_dma_object 32 0 0 0 0 254 0 0 linux_dma_pctrie 144 0 0 0 0 62 0 0 g_bio 408 0 0 181029927 0 30 0 0 IOMMU_MAP_ENTRY 104 0 0 0 0 126 0 0 mbuf_jumbo_16k 16384 0 0 0 0 1 0 0 mbuf_jumbo_9k 9216 0 0 0 0 1 0 0 mbuf_jumbo_page 4096 0 0 10491799 0 2 0 0 audit_record 1280 0 0 0 0 8 0 0 domainset 40 0 0 0 0 254 0 0 MAC labels 40 0 0 0 0 254 0 0 vnpbuf 2776 0 0 5441 0 4 0 0 nfspbuf 2776 0 0 0 0 4 0 0 swwbuf 2776 0 0 4058544 0 2 0 0 swrbuf 2776 0 0 2775918 0 4 0 0 ertt_txseginfo 40 0 0 4340804 0 254 0 0 umtx_shm 88 0 0 0 0 126 0 0 umtx pi 96 0 0 2 0 126 0 0 rangeset pctrie nodes 144 0 0 0 0 62 0 0 malloc-65536 65536 0 0 27 0 1 0 0 malloc-65536 65536 0 0 108 0 1 0 0 malloc-65536 65536 0 0 48 0 1 0 0 malloc-32768 32768 0 0 123597 0 1 0 0 malloc-16384 16384 0 0 148 0 1 0 0 malloc-16384 16384 0 0 3 0 1 0 0 malloc-512 512 0 0 2157502 0 30 0 0 malloc-512 512 0 0 16 0 30 0 0 malloc-384 384 0 0 171 0 30 0 0 malloc-384 384 0 0 47657 0 30 0 0 pcpu-32 32 0 0 0 0 254 0 0 pcpu-4 4 0 0 0 0 254 0 0 4 Bucket 48 0 0 3744232 0 254 0 0 2 Bucket 32 0 0 12844365 0 254 0 0 UMA Hash 256 0 0 0 0 62 0 0 db:0:pho> show umacache Zone Size Used Free Requests Bucket debugnet_mbuf_packet 2048 0 0 0 0 debugnet_mbuf_cluster 2048 -6144 0 0 0 debugnet_mbuf 256 -10240 0 0 0 vm pgcache 4096 257326 0 517879524 2 vm pgcache 4096 7240910 0 1849966219 2 vm pgcache 4096 0 0 0 2 buf free cache 848 92430 0 118463145 16 buffer arena-65 65536 0 0 64 1 buffer arena-61 61440 0 0 0 1 buffer arena-57 57344 0 0 0 1 buffer arena-53 53248 0 0 0 1 buffer arena-49 49152 0 0 0 1 buffer arena-45 45056 0 0 0 1 buffer arena-40 40960 0 0 0 1 buffer arena-36 36864 0 0 0 1 buffer arena-32 32768 30577 0 30346266 1 buffer arena-28 28672 0 0 0 1 buffer arena-24 24576 0 0 0 1 buffer arena-20 20480 0 0 0 1 buffer arena-16 16384 3 0 4265907 1 buffer arena-12 12288 0 0 0 1 buffer arena-81 8192 0 0 0 1 buffer arena-40 4096 0 0 29 2 kstack_cache 16384 17407 0 19648811 1 db:0:pho> acttrace Tracing command pagedaemon pid 9 tid 100199 td 0xfffff80003e85740 (CPU 3) kdb_enter() at kdb_enter+0x33/frame 0xfffffe01083f2600 handleevents() at handleevents+0xaf/frame 0xfffffe01083f2640 timercb() at timercb+0x18e/frame 0xfffffe01083f2690 lapic_handle_timer() at lapic_handle_timer+0xab/frame 0xfffffe01083f26b0 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe01083f26b0 --- interrupt, rip = 0xffffffff80b2a650, rsp = 0xfffffe01083f2780, rbp = 0xfffffe01083f2790 --- __mtx_unlock_flags() at __mtx_unlock_flags+0x90/frame 0xfffffe01083f2790 vm_page_pqstate_commit_dequeue() at vm_page_pqstate_commit_dequeue+0xb6/frame 0xfffffe01083f27d0 vm_page_unswappable() at vm_page_unswappable+0x68/frame 0xfffffe01083f2800 vm_pageout_flush() at vm_pageout_flush+0x1a7/frame 0xfffffe01083f2900 vm_pageout_cluster() at vm_pageout_cluster+0x33b/frame 0xfffffe01083f2b70 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x70e/frame 0xfffffe01083f2ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01083f2f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01083f2f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100003 td 0xfffff80003bee740 (CPU 0) cpustop_handler() at cpustop_handler+0x27/frame 0xffffffff81d09f80 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xffffffff81d09f90 trap() at trap+0x56/frame 0xffffffff81d0a0b0 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81d0a0b0 --- trap 0x13, rip = 0xffffffff8102e59e, rsp = 0xfffffe0108014d78, rbp = 0xfffffe0108014db0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe0108014db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe0108014dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0108014df0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe0108014ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108014f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108014f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffff80003bee000 (CPU 1) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ce3cdf0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003ce3ce00 trap() at trap+0x56/frame 0xfffffe003ce3cf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce3cf20 --- trap 0x13, rip = 0xffffffff8102e59e, rsp = 0xfffffe010800fd78, rbp = 0xfffffe010800fdb0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe010800fdb0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe010800fdd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe010800fdf0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe010800fef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010800ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010800ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffff80003bef740 (CPU 2) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ce4bdf0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003ce4be00 trap() at trap+0x56/frame 0xfffffe003ce4bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce4bf20 --- trap 0x13, rip = 0xffffffff8102e59e, rsp = 0xfffffe010801ed78, rbp = 0xfffffe010801edb0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe010801edb0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe010801edd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe010801edf0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe010801eef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010801ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010801ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffff80003bf0740 (CPU 4) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ce69df0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003ce69e00 trap() at trap+0x56/frame 0xfffffe003ce69f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce69f20 --- trap 0x13, rip = 0xffffffff8102e59e, rsp = 0xfffffe0108028d78, rbp = 0xfffffe0108028db0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe0108028db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe0108028dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0108028df0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe0108028ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108028f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108028f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffff80003bf0000 (CPU 5) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ce78df0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003ce78e00 trap() at trap+0x56/frame 0xfffffe003ce78f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce78f20 --- trap 0x13, rip = 0xffffffff8102e59e, rsp = 0xfffffe0108023d78, rbp = 0xfffffe0108023db0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe0108023db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe0108023dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0108023df0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe0108023ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108023f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108023f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffff80003bd9740 (CPU 6) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ce87df0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003ce87e00 trap() at trap+0x56/frame 0xfffffe003ce87f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce87f20 --- trap 0x13, rip = 0xffffffff8102e59e, rsp = 0xfffffe0108032d78, rbp = 0xfffffe0108032db0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe0108032db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe0108032dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0108032df0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe0108032ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108032f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108032f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffff80003bd9000 (CPU 7) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ce96df0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003ce96e00 trap() at trap+0x56/frame 0xfffffe003ce96f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce96f20 --- trap 0x13, rip = 0xffffffff8102e59e, rsp = 0xfffffe010802dd78, rbp = 0xfffffe010802ddb0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe010802ddb0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe010802ddd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe010802ddf0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe010802def0 fork_exit() at fork_exit+0x82/frame 0xfffffe010802df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010802df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffff80003bda740 (CPU 8) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003cea5df0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003cea5e00 trap() at trap+0x56/frame 0xfffffe003cea5f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003cea5f20 --- trap 0x13, rip = 0xffffffff8102e59e, rsp = 0xfffffe010803cd78, rbp = 0xfffffe010803cdb0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe010803cdb0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe010803cdd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe010803cdf0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe010803cef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010803cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010803cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffff80003bda000 (CPU 9) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ceb4df0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003ceb4e00 trap() at trap+0x56/frame 0xfffffe003ceb4f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ceb4f20 --- trap 0x13, rip = 0xffffffff8102e59e, rsp = 0xfffffe0108037d78, rbp = 0xfffffe0108037db0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe0108037db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe0108037dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0108037df0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe0108037ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108037f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108037f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffff80003bdb740 (CPU 10) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003cec3df0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003cec3e00 trap() at trap+0x56/frame 0xfffffe003cec3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003cec3f20 --- trap 0x13, rip = 0xffffffff8102e59e, rsp = 0xfffffe0108046d78, rbp = 0xfffffe0108046db0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe0108046db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe0108046dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0108046df0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe0108046ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108046f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108046f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffff80003bdb000 (CPU 11) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ced2df0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003ced2e00 trap() at trap+0x56/frame 0xfffffe003ced2f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ced2f20 --- trap 0x13, rip = 0xffffffff8102e59e, rsp = 0xfffffe0108041d78, rbp = 0xfffffe0108041db0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe0108041db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe0108041dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0108041df0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe0108041ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108041f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108041f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:pho> ps pid ppid pgrp uid state wmesg wchan cmd 67746 3453 3453 0 NV watchdogd 67745 92569 46737 0 D+ vmwait 0xffffffff818076c0 swapoff 67715 14923 14865 0 D vmwait 0xffffffff818076c0 sh 67713 14923 14865 0 D vmwait 0xffffffff818076c0 vmstat 66484 66481 46737 0 D+ vmwait 0xffffffff818076c0 sort 65515 65510 46737 0 D+ vmwait 0xffffffff818076c0 sort 64260 64257 46737 0 D+ vmwait 0xffffffff818076c0 sort 63817 63811 46737 0 D+ vmwait 0xffffffff818076c0 sort 27720 27710 32414 0 D vmwait 0xffffffff818076c0 pkg 27714 27709 32414 0 D vmwait 0xffffffff818076c0 tee 27710 27709 32414 0 D vmwait 0xffffffff818076c0 pkg 27709 27685 32414 0 D vmwait 0xffffffff818076c0 sh 27685 82342 32414 0 DE vmocol 0xfffffe0021df2698 sh 92569 92567 46737 0 D+ vmwait 0xffffffff818076c0 sh 92567 46737 46737 0 D+ vmwait 0xffffffff818076c0 sh 82342 82333 32414 0 D vmwait 0xffffffff818076c0 sh 82333 1 32414 0 D vmwait 0xffffffff818076c0 sh 46737 3721 46737 0 D+ vmwait 0xffffffff818076c0 sh 82700 82699 82700 2006 Ds+ vmwait 0xffffffff818076c0 sh 82699 82696 82696 2006 D vmwait 0xffffffff818076c0 sshd 82696 3611 82696 0 Ds vmwait 0xffffffff818076c0 sshd 7930 0 0 0 DL aiordy 0xfffffe0208923060 [aiod4] 7929 0 0 0 DL aiordy 0xfffffe020c06e000 [aiod3] 7928 0 0 0 DL aiordy 0xfffffe0209b95060 [aiod2] 7927 0 0 0 DL aiordy 0xfffffe010ebd9b00 [aiod1] 42293 0 0 0 DL ftcl 0xffffffff829555cc [ftcleanup] 25872 0 0 0 DL waiting 0xffffffff828c5d50 [sctp_iterator] 14926 14865 14865 0 D vmwait 0xffffffff818076c0 sh 14924 14865 14865 0 D vmwait 0xffffffff818076c0 awk 14923 14865 14865 0 D vmwait 0xffffffff818076c0 sh 14865 1 14865 0 Ds vmwait 0xffffffff818076c0 sh 3721 3720 3721 0 D+ vmwait 0xffffffff818076c0 bash 3720 3719 3720 0 D+ vmwait 0xffffffff818076c0 sh 3719 3697 3719 2006 D+ vmwait 0xffffffff818076c0 su 3697 3696 3697 2006 Ds+ vmwait 0xffffffff818076c0 sh 3696 3693 3693 2006 D vmwait 0xffffffff818076c0 sshd 3693 3611 3693 0 Ds vmwait 0xffffffff818076c0 sshd 3633 1 3633 0 Ds+ vmwait 0xffffffff818076c0 getty 3632 1 3632 0 Ds+ vmwait 0xffffffff818076c0 getty 3631 1 3631 0 Ds+ vmwait 0xffffffff818076c0 getty 3630 1 3630 0 Ds+ vmwait 0xffffffff818076c0 getty 3629 1 3629 0 Ds+ vmwait 0xffffffff818076c0 getty 3628 1 3628 0 Ds+ vmwait 0xffffffff818076c0 getty 3627 1 3627 0 Ds+ vmwait 0xffffffff818076c0 getty 3626 1 3626 0 Ds+ vmwait 0xffffffff818076c0 getty 3625 1 3625 0 Ds+ vmwait 0xffffffff818076c0 getty 3611 1 3611 0 Ss select 0xfffff80003d55740 sshd 3594 1 3594 0 ?Ws cron 3589 1 3589 0 Ss select 0xfffff80013a67ac0 inetd 3568 1 3568 0 Ds vmwait 0xffffffff818076c0 powerd 3453 1 3453 0 DLs vmwait 0xffffffff818076c0 watchdogd 3436 1 3436 0 ?Ws syslogd 3288 1 3288 0 Ds vmwait 0xffffffff818076c0 devd 3273 1 3273 65 Ds vmwait 0xffffffff818076c0 dhclient 3214 1 3214 0 Ds vmwait 0xffffffff818076c0 dhclient 3211 1 3211 0 Ds vmwait 0xffffffff818076c0 dhclient 19 0 0 0 DL syncer 0xffffffff81cc18a8 [syncer] 18 0 0 0 DL vlruwt 0xfffffe010ebd7000 [vnlru] 17 0 0 0 DL (threaded) [bufdaemon] 100202 D psleep 0xffffffff81cc08c0 [bufdaemon] 100203 D - 0xffffffff81802100 [bufspacedaemon-0] 100204 D - 0xffffffff81802380 [bufspacedaemon-1] 100205 D - 0xffffffff81802600 [bufspacedaemon-2] 100206 D - 0xffffffff81802880 [bufspacedaemon-3] 100207 D - 0xffffffff81802b00 [bufspacedaemon-4] 100208 D - 0xffffffff81802d80 [bufspacedaemon-5] 100209 D - 0xffffffff81803000 [bufspacedaemon-6] 100235 D sdflush 0xfffff80003fe98e8 [/ worker] 100251 D sdflush 0xfffff8015e716ce8 [/tmp worker] 16 0 0 0 DL psleep 0xffffffff81cf6390 [vmdaemon] 9 0 0 0 RL (threaded) [pagedaemon] 100198 D pwait 0xffffffff813d21e5 [dom0] 100199 Run CPU 3 [laundry: dom0] 100200 D umarcls 0xffffffff813d21eb [uma] 8 0 0 0 DL idle 0xfffffe010e664ae0 [enc_daemon1] 7 0 0 0 DL idle 0xfffffe010e665040 [enc_daemon0] 6 0 0 0 DL - 0xffffffff819dc8a0 [rand_harvestq] 15 0 0 0 DL (threaded) [usb] 100128 D - 0xfffffe010a9cf440 [usbus0] 100129 D - 0xfffffe010a9cf498 [usbus0] 100130 D - 0xfffffe010a9cf4f0 [usbus0] 100131 D - 0xfffffe010a9cf548 [usbus0] 100132 D - 0xfffffe010a9cf5a0 [usbus0] 100134 D - 0xfffffe00e4d9ccf0 [usbus1] 100135 D - 0xfffffe00e4d9cd48 [usbus1] 100136 D - 0xfffffe00e4d9cda0 [usbus1] 100137 D - 0xfffffe00e4d9cdf8 [usbus1] 100138 D - 0xfffffe00e4d9ce50 [usbus1] 100139 D - 0xfffffe010ad7ccf0 [usbus2] 100140 D - 0xfffffe010ad7cd48 [usbus2] 100141 D - 0xfffffe010ad7cda0 [usbus2] 100142 D - 0xfffffe010ad7cdf8 [usbus2] 100143 D - 0xfffffe010ad7ce50 [usbus2] 5 0 0 0 DL - 0xffffffff81d00928 [busdma] 4 0 0 0 DL (threaded) [cam] 100121 D - 0xffffffff819ae240 [doneq0] 100122 D - 0xffffffff819ae2c0 [doneq1] 100123 D - 0xffffffff819ae340 [doneq2] 100124 D - 0xffffffff819ae1c0 [async] 100153 D - 0xffffffff819ae090 [scanner] 3 0 0 0 DL (threaded) [crypto] 100108 D crypto_ 0xffffffff81cd9cf0 [crypto] 100109 D crypto_ 0xfffff8015e06cc30 [crypto returns 0] 100110 D crypto_ 0xfffff8015e06cc80 [crypto returns 1] 100111 D crypto_ 0xfffff8015e06ccd0 [crypto returns 2] 100112 D crypto_ 0xfffff8015e06cd20 [crypto returns 3] 100113 D crypto_ 0xfffff8015e06cd70 [crypto returns 4] 100114 D crypto_ 0xfffff8015e06cdc0 [crypto returns 5] 100115 D crypto_ 0xfffff8015e06ce10 [crypto returns 6] 100116 D crypto_ 0xfffff8015e06ce60 [crypto returns 7] 100117 D crypto_ 0xfffff8015e06ceb0 [crypto returns 8] 100118 D crypto_ 0xfffff8015e06cf00 [crypto returns 9] 100119 D crypto_ 0xfffff8015e06cf50 [crypto returns 10] 100120 D crypto_ 0xfffff8015e06cfa0 [crypto returns 11] 14 0 0 0 DL seqstat 0xfffff80003fdb088 [sequencer 00] 13 0 0 0 DL (threaded) [geom] 100092 D - 0xffffffff81b96ab0 [g_event] 100093 D - 0xffffffff81b96ab8 [g_up] 100094 D - 0xffffffff81b96ac0 [g_down] 2 0 0 0 WL (threaded) [clock] 100078 I [clock (0)] 100079 I [clock (1)] 100080 I [clock (2)] 100081 I [clock (3)] 100082 I [clock (4)] 100083 I [clock (5)] 100084 I [clock (6)] 100085 I [clock (7)] 100086 I [clock (8)] 100087 I [clock (9)] 100088 I [clock (10)] 100089 I [clock (11)] 12 0 0 0 WL (threaded) [intr] 100042 I [swi6: task queue] 100043 I [swi6: Giant taskq] 100045 I [swi5: fast taskq] 100090 I [swi1: netisr 0] 100125 I [irq56: ahci0] 100127 I [irq19: xhci0] 100133 I [irq18: ehci0 ehci1+] 100144 I [irq71: ahci1] 100145 I [swi4: apei] 100146 I [swi0: uart uart] 100160 I [irq73: mlx5_core0] 100161 I [irq74: mlx5_core0] 100162 I [irq72: mlx5_core0] 100163 I [irq75: mlx5_core0] 100164 I [irq76: mlx5_core0] 100165 I [irq77: mlx5_core0] 100166 I [irq78: mlx5_core0] 100167 I [irq79: mlx5_core0] 100168 I [irq80: mlx5_core0] 100169 I [irq81: mlx5_core0] 100170 I [irq82: mlx5_core0] 100171 I [irq83: mlx5_core0] 100172 I [irq84: mlx5_core0] 100173 I [irq85: mlx5_core0] 100174 I [irq86: mlx5_core0] 100181 I [irq88: mlx5_core1] 100182 I [irq89: mlx5_core1] 100183 I [irq87: mlx5_core1] 100184 I [irq90: mlx5_core1] 100185 I [irq91: mlx5_core1] 100186 I [irq92: mlx5_core1] 100187 I [irq93: mlx5_core1] 100188 I [irq94: mlx5_core1] 100189 I [irq95: mlx5_core1] 100190 I [irq96: mlx5_core1] 100191 I [irq97: mlx5_core1] 100192 I [irq98: mlx5_core1] 100193 I [irq99: mlx5_core1] 100194 I [irq100: mlx5_core1] 100195 I [irq101: mlx5_core1] 100243 I [irq102: ioat0] 100244 I [irq103: ioat1] 100245 I [irq104: ioat2] 100246 I [irq105: ioat3] 100247 I [irq106: ioat4] 100248 I [irq107: ioat5] 100249 I [irq108: ioat6] 100250 I [irq109: ioat7] 11 0 0 0 RL (threaded) [idle] 100003 Run CPU 0 [idle: cpu0] 100004 Run CPU 1 [idle: cpu1] 100005 Run CPU 2 [idle: cpu2] 100006 CanRun [idle: cpu3] 100007 Run CPU 4 [idle: cpu4] 100008 Run CPU 5 [idle: cpu5] 100009 Run CPU 6 [idle: cpu6] 100010 Run CPU 7 [idle: cpu7] 100011 Run CPU 8 [idle: cpu8] 100012 Run CPU 9 [idle: cpu9] 100013 Run CPU 10 [idle: cpu10] 100014 Run CPU 11 [idle: cpu11] 1 0 1 0 DLs pfault 0xffffffff818076c0 [init] 10 0 0 0 DL audit_w 0xffffffff81cda1f0 [audit] 0 0 0 0 DLs (threaded) [kernel] 100000 D swapin 0xffffffff81b97020 [swapper] 100015 D - 0xfffff80003ba5100 [softirq_0] 100016 D - 0xfffff80003ba5000 [softirq_1] 100017 D - 0xfffff80003ba6e00 [softirq_2] 100018 D - 0xfffff80003ba6d00 [softirq_3] 100019 D - 0xfffff80003ba6c00 [softirq_4] 100020 D - 0xfffff80003ba6b00 [softirq_5] 100021 D - 0xfffff80003ba6a00 [softirq_6] 100022 D - 0xfffff80003ba6900 [softirq_7] 100023 D - 0xfffff80003ba6800 [softirq_8] 100024 D - 0xfffff80003ba6700 [softirq_9] 100025 D - 0xfffff80003ba6600 [softirq_10] 100026 D - 0xfffff80003ba6500 [softirq_11] 100027 D - 0xfffff80003ba6400 [if_io_tqg_0] 100028 D - 0xfffff80003ba6300 [if_io_tqg_1] 100029 D - 0xfffff80003ba6200 [if_io_tqg_2] 100030 D - 0xfffff80003ba6100 [if_io_tqg_3] 100031 D - 0xfffff80003ba6000 [if_io_tqg_4] 100032 D - 0xfffff80003ba7e00 [if_io_tqg_5] 100033 D - 0xfffff80003ba7d00 [if_io_tqg_6] 100034 D - 0xfffff80003ba7c00 [if_io_tqg_7] 100035 D - 0xfffff80003ba7b00 [if_io_tqg_8] 100036 D - 0xfffff80003ba7a00 [if_io_tqg_9] 100037 D - 0xfffff80003ba7900 [if_io_tqg_10] 100038 D - 0xfffff80003ba7800 [if_io_tqg_11] 100039 D - 0xfffff80003ba7700 [if_config_tqg_0] 100040 D - 0xfffff80003a0fd00 [pci_hp taskq] 100041 D - 0xfffff80003a0fc00 [kqueue_ctx taskq] 100044 D - 0xfffff80003a0f700 [thread taskq] 100046 D - 0xfffff80003a0f400 [aiod_kick taskq] 100047 D - 0xfffff80003a0f300 [deferred_unmount ta] 100048 D - 0xfffff80003a0f200 [inm_free taskq] 100049 D - 0xfffff80003a0f100 [in6m_free taskq] 100050 D - 0xfffff80003a0f000 [linuxkpi_irq_wq] 100051 D - 0xfffff80003b86300 [linuxkpi_short_wq_0] 100052 D - 0xfffff80003b86300 [linuxkpi_short_wq_1] 100053 D - 0xfffff80003b86300 [linuxkpi_short_wq_2] 100054 D - 0xfffff80003b86300 [linuxkpi_short_wq_3] 100055 D - 0xfffff80003b86300 [linuxkpi_short_wq_4] 100056 D - 0xfffff80003b86300 [linuxkpi_short_wq_5] 100057 D - 0xfffff80003b86300 [linuxkpi_short_wq_6] 100058 D - 0xfffff80003b86300 [linuxkpi_short_wq_7] 100059 D - 0xfffff80003b86300 [linuxkpi_short_wq_8] 100060 D - 0xfffff80003b86300 [linuxkpi_short_wq_9] 100061 D - 0xfffff80003b86300 [linuxkpi_short_wq_1] 100062 D - 0xfffff80003b86300 [linuxkpi_short_wq_1] 100063 D - 0xfffff80003b86300 [linuxkpi_short_wq_1] 100064 D - 0xfffff80003b86200 [linuxkpi_long_wq_0] 100065 D - 0xfffff80003b86200 [linuxkpi_long_wq_1] 100066 D - 0xfffff80003b86200 [linuxkpi_long_wq_2] 100067 D - 0xfffff80003b86200 [linuxkpi_long_wq_3] 100068 D - 0xfffff80003b86200 [linuxkpi_long_wq_4] 100069 D - 0xfffff80003b86200 [linuxkpi_long_wq_5] 100070 D - 0xfffff80003b86200 [linuxkpi_long_wq_6] 100071 D - 0xfffff80003b86200 [linuxkpi_long_wq_7] 100072 D - 0xfffff80003b86200 [linuxkpi_long_wq_8] 100073 D - 0xfffff80003b86200 [linuxkpi_long_wq_9] 100074 D - 0xfffff80003b86200 [linuxkpi_long_wq_10] 100075 D - 0xfffff80003b86200 [linuxkpi_long_wq_11] 100076 D - 0xfffff80003b86200 [linuxkpi_long_wq_12] 100091 D - 0xfffff80003b87e00 [firmware taskq] 100096 D - 0xfffff80003b87d00 [crypto_0] 100097 D - 0xfffff80003b87d00 [crypto_1] 100098 D - 0xfffff80003b87d00 [crypto_2] 100099 D - 0xfffff80003b87d00 [crypto_3] 100100 D - 0xfffff80003b87d00 [crypto_4] 100101 D - 0xfffff80003b87d00 [crypto_5] 100102 D - 0xfffff80003b87d00 [crypto_6] 100103 D - 0xfffff80003b87d00 [crypto_7] 100104 D - 0xfffff80003b87d00 [crypto_8] 100105 D - 0xfffff80003b87d00 [crypto_9] 100106 D - 0xfffff80003b87d00 [crypto_10] 100107 D - 0xfffff80003b87d00 [crypto_11] 100147 D - 0xfffff80007cba800 [acpi_task_0] 100148 D - 0xfffff80007cba800 [acpi_task_1] 100149 D - 0xfffff80007cba800 [acpi_task_2] 100151 D - 0xfffff80003a13100 [mca taskq] 100152 D - 0xfffff80003b87c00 [CAM taskq] 100156 D - 0xfffff80007cba700 [mlx5_core0-rec] 100157 D - 0xfffff80007cba600 [mlx5_core0-wdg] 100158 D - 0xfffff80007cba500 [mlx5_core0-cmd] 100159 D - 0xfffff80007cba400 [mlx5_page_allocator] 100175 D - 0xfffff8000e559b00 [mlx5_fc] 100176 D - 0xfffff8000e559a00 [mlx5_esw_wq] 100177 D - 0xfffff8000e559900 [mlx5_core1-rec] 100178 D - 0xfffff8000e559800 [mlx5_core1-wdg] 100179 D - 0xfffff8000e559700 [mlx5_core1-cmd] 100180 D - 0xfffff8000e559600 [mlx5_page_allocator] 100196 D - 0xfffff8015e63eb00 [mlx5_fc] 100197 D - 0xfffff8015e63ea00 [mlx5_esw_wq] 101672 D - 0xfffff800133fd000 [dtrace_taskq] 101673 D - 0xfffff800134ab300 [system_taskq_0] 101674 D - 0xfffff800134ab300 [system_taskq_1] 101675 D - 0xfffff800134ab300 [system_taskq_2] 101676 D - 0xfffff800134ab300 [system_taskq_3] 101677 D - 0xfffff800134ab300 [system_taskq_4] 101678 D - 0xfffff800134ab300 [system_taskq_5] 101679 D - 0xfffff800134ab300 [system_taskq_6] 101680 D - 0xfffff800134ab300 [system_taskq_7] 101681 D - 0xfffff800134ab300 [system_taskq_8] 101682 D - 0xfffff800134ab300 [system_taskq_9] 101683 D - 0xfffff800134ab300 [system_taskq_10] 101684 D - 0xfffff800134ab300 [system_taskq_11] 66481 92569 46737 0 Z+ timeout 27712 27709 32414 0 Z sed 63811 92569 46737 0 Z+ timeout 64257 92569 46737 0 Z+ timeout 65510 92569 46737 0 Z+ timeout db:0:pho> allt Tracing command kernel pid 0 tid 100000 td 0xffffffff81b97580 sched_switch() at sched_switch+0x5c6/frame 0xffffffff82380e10 mi_switch() at mi_switch+0x170/frame 0xffffffff82380e30 sleepq_switch() at sleepq_switch+0x101/frame 0xffffffff82380e70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xffffffff82380eb0 _sleep() at _sleep+0x27e/frame 0xffffffff82380f50 swapper() at swapper+0x75/frame 0xffffffff82380fa0 mi_startup() at mi_startup+0x226/frame 0xffffffff82380ff0 Tracing command kernel pid 0 tid 100015 td 0xfffff80003bdc740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108050df0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108050e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108050e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe0108050ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe0108050ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108050f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108050f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100016 td 0xfffff80003bdc000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010804bdf0 mi_switch() at mi_switch+0x170/frame 0xfffffe010804be10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010804be50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe010804bec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe010804bef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010804bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010804bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100017 td 0xfffff80003b9f740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010805adf0 mi_switch() at mi_switch+0x170/frame 0xfffffe010805ae10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010805ae50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe010805aec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe010805aef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010805af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010805af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100018 td 0xfffff80003b9f000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108055df0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108055e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108055e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe0108055ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe0108055ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108055f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108055f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100019 td 0xfffff80003ba0740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108064df0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108064e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108064e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe0108064ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe0108064ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108064f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108064f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xfffff80003ba0000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010805fdf0 mi_switch() at mi_switch+0x170/frame 0xfffffe010805fe10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010805fe50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe010805fec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe010805fef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010805ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010805ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xfffff80003ba1740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010806edf0 mi_switch() at mi_switch+0x170/frame 0xfffffe010806ee10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010806ee50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe010806eec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe010806eef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010806ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010806ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xfffff80003ba1000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108069df0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108069e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108069e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe0108069ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe0108069ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108069f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108069f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xfffff80003ba2740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108078df0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108078e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108078e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe0108078ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe0108078ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108078f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108078f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xfffff80003ba2000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108073df0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108073e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108073e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe0108073ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe0108073ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108073f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108073f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xfffff80003b9b740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108082df0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108082e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108082e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe0108082ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe0108082ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108082f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108082f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100026 td 0xfffff80003b9b000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010807ddf0 mi_switch() at mi_switch+0x170/frame 0xfffffe010807de10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010807de50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe010807dec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe010807def0 fork_exit() at fork_exit+0x82/frame 0xfffffe010807df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010807df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100027 td 0xfffff80003b9c740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010808cdf0 mi_switch() at mi_switch+0x170/frame 0xfffffe010808ce10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010808ce50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe010808cec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe010808cef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010808cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010808cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100028 td 0xfffff80003b9c000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108087df0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108087e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108087e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe0108087ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe0108087ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108087f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108087f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100029 td 0xfffff80003b9d740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108096df0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108096e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108096e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe0108096ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe0108096ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108096f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108096f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100030 td 0xfffff80003b9d000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108091df0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108091e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108091e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe0108091ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe0108091ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108091f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108091f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100031 td 0xfffff80003b9e740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01080a0df0 mi_switch() at mi_switch+0x170/frame 0xfffffe01080a0e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01080a0e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe01080a0ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe01080a0ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01080a0f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01080a0f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100032 td 0xfffff80003b9e000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010809bdf0 mi_switch() at mi_switch+0x170/frame 0xfffffe010809be10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010809be50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe010809bec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe010809bef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010809bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010809bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100033 td 0xfffff80003b97740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01080aadf0 mi_switch() at mi_switch+0x170/frame 0xfffffe01080aae10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01080aae50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe01080aaec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe01080aaef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01080aaf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01080aaf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100034 td 0xfffff80003b97000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01080a5df0 mi_switch() at mi_switch+0x170/frame 0xfffffe01080a5e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01080a5e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe01080a5ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe01080a5ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01080a5f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01080a5f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100035 td 0xfffff80003b98740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01080b4df0 mi_switch() at mi_switch+0x170/frame 0xfffffe01080b4e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01080b4e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe01080b4ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe01080b4ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01080b4f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01080b4f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100036 td 0xfffff80003b98000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01080afdf0 mi_switch() at mi_switch+0x170/frame 0xfffffe01080afe10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01080afe50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe01080afec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe01080afef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01080aff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01080aff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100037 td 0xfffff80003b99740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01080bedf0 mi_switch() at mi_switch+0x170/frame 0xfffffe01080bee10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01080bee50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe01080beec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe01080beef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01080bef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01080bef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100038 td 0xfffff80003b99000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01080b9df0 mi_switch() at mi_switch+0x170/frame 0xfffffe01080b9e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01080b9e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe01080b9ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe01080b9ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01080b9f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01080b9f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100039 td 0xfffff80003b9a740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01080c8df0 mi_switch() at mi_switch+0x170/frame 0xfffffe01080c8e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01080c8e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe01080c8ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe01080c8ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01080c8f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01080c8f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100040 td 0xfffff80003b9a000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01080c3dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01080c3de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01080c3e20 _sleep() at _sleep+0x2d8/frame 0xfffffe01080c3ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01080c3ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01080c3f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01080c3f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100041 td 0xfffff80003b90740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01080d2dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01080d2de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01080d2e20 _sleep() at _sleep+0x2d8/frame 0xfffffe01080d2ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01080d2ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01080d2f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01080d2f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100044 td 0xfffff80003b91000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01080d7dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01080d7de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01080d7e20 _sleep() at _sleep+0x2d8/frame 0xfffffe01080d7ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01080d7ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01080d7f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01080d7f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100046 td 0xfffff80003b92000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01080e1dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01080e1de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01080e1e20 _sleep() at _sleep+0x2d8/frame 0xfffffe01080e1ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01080e1ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01080e1f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01080e1f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100047 td 0xfffff80003b93740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01080f0dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01080f0de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01080f0e20 _sleep() at _sleep+0x2d8/frame 0xfffffe01080f0ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01080f0ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01080f0f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01080f0f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100048 td 0xfffff80003b93000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01080ebdc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01080ebde0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01080ebe20 _sleep() at _sleep+0x2d8/frame 0xfffffe01080ebec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01080ebef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01080ebf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01080ebf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100049 td 0xfffff80003b8a740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01080fadc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01080fade0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01080fae20 _sleep() at _sleep+0x2d8/frame 0xfffffe01080faec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01080faef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01080faf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01080faf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100050 td 0xfffff80003b8a000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01080f5df0 mi_switch() at mi_switch+0x170/frame 0xfffffe01080f5e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01080f5e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe01080f5ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0x104/frame 0xfffffe01080f5ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01080f5f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01080f5f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100051 td 0xfffff80003b8b740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108104dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108104de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108104e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108104ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108104ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108104f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108104f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100052 td 0xfffff80003b8b000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01080ffdc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01080ffde0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01080ffe20 _sleep() at _sleep+0x2d8/frame 0xfffffe01080ffec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01080ffef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01080fff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01080fff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100053 td 0xfffff80003b8c740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010810edc0 mi_switch() at mi_switch+0x170/frame 0xfffffe010810ede0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010810ee20 _sleep() at _sleep+0x2d8/frame 0xfffffe010810eec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe010810eef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010810ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010810ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100054 td 0xfffff80003b8c000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108109dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108109de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108109e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108109ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108109ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108109f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108109f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100055 td 0xfffff80003b8d740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108118dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108118de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108118e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108118ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108118ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108118f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108118f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100056 td 0xfffff80003b8d000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108113dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108113de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108113e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108113ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108113ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108113f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108113f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100057 td 0xfffff80003ccd740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108122dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108122de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108122e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108122ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108122ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108122f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108122f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100058 td 0xfffff80003ccd000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010811ddc0 mi_switch() at mi_switch+0x170/frame 0xfffffe010811dde0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010811de20 _sleep() at _sleep+0x2d8/frame 0xfffffe010811dec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe010811def0 fork_exit() at fork_exit+0x82/frame 0xfffffe010811df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010811df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100059 td 0xfffff80003cd5740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010812cdc0 mi_switch() at mi_switch+0x170/frame 0xfffffe010812cde0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010812ce20 _sleep() at _sleep+0x2d8/frame 0xfffffe010812cec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe010812cef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010812cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010812cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100060 td 0xfffff80003cd5000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108127dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108127de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108127e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108127ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108127ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108127f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108127f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100061 td 0xfffff80003b84740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108136dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108136de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108136e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108136ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108136ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108136f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108136f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100062 td 0xfffff80003b84000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108131dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108131de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108131e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108131ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108131ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108131f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108131f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100063 td 0xfffff80003b85740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108140dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108140de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108140e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108140ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108140ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108140f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108140f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100064 td 0xfffff80003b85000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010813bdc0 mi_switch() at mi_switch+0x170/frame 0xfffffe010813bde0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010813be20 _sleep() at _sleep+0x2d8/frame 0xfffffe010813bec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe010813bef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010813bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010813bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100065 td 0xfffff80003cc5740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010814adc0 mi_switch() at mi_switch+0x170/frame 0xfffffe010814ade0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010814ae20 _sleep() at _sleep+0x2d8/frame 0xfffffe010814aec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe010814aef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010814af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010814af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100066 td 0xfffff80003cc5000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108145dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108145de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108145e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108145ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108145ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108145f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108145f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100067 td 0xfffff80003cc6740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108154dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108154de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108154e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108154ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108154ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108154f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108154f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100068 td 0xfffff80003cc6000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010814fdc0 mi_switch() at mi_switch+0x170/frame 0xfffffe010814fde0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010814fe20 _sleep() at _sleep+0x2d8/frame 0xfffffe010814fec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe010814fef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010814ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010814ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100069 td 0xfffff80003cc7740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010815edc0 mi_switch() at mi_switch+0x170/frame 0xfffffe010815ede0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010815ee20 _sleep() at _sleep+0x2d8/frame 0xfffffe010815eec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe010815eef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010815ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010815ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100070 td 0xfffff80003cc7000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108159dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108159de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108159e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108159ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108159ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108159f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108159f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100071 td 0xfffff80003cc8740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108168dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108168de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108168e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108168ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108168ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108168f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108168f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100072 td 0xfffff80003cc8000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108163dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108163de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108163e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108163ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108163ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108163f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108163f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100073 td 0xfffff80003cc1740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108172dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108172de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108172e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108172ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108172ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108172f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108172f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100074 td 0xfffff80003cc1000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010816ddc0 mi_switch() at mi_switch+0x170/frame 0xfffffe010816dde0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010816de20 _sleep() at _sleep+0x2d8/frame 0xfffffe010816dec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe010816def0 fork_exit() at fork_exit+0x82/frame 0xfffffe010816df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010816df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100075 td 0xfffff80003cc2740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010817cdc0 mi_switch() at mi_switch+0x170/frame 0xfffffe010817cde0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010817ce20 _sleep() at _sleep+0x2d8/frame 0xfffffe010817cec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe010817cef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010817cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010817cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100076 td 0xfffff80003cc2000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108177dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108177de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108177e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108177ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108177ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108177f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108177f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100091 td 0xfffff80003c85740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01081ccdc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01081ccde0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01081cce20 _sleep() at _sleep+0x2d8/frame 0xfffffe01081ccec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01081ccef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01081ccf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01081ccf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100096 td 0xfffff80003c87000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01081dbdc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01081dbde0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01081dbe20 _sleep() at _sleep+0x2d8/frame 0xfffffe01081dbec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01081dbef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01081dbf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01081dbf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100097 td 0xfffff8015e076740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01081eadc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01081eade0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01081eae20 _sleep() at _sleep+0x2d8/frame 0xfffffe01081eaec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01081eaef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01081eaf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01081eaf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100098 td 0xfffff8015e076000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01081e5dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01081e5de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01081e5e20 _sleep() at _sleep+0x2d8/frame 0xfffffe01081e5ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01081e5ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01081e5f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01081e5f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100099 td 0xfffff8015e077740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01081f4dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01081f4de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01081f4e20 _sleep() at _sleep+0x2d8/frame 0xfffffe01081f4ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01081f4ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01081f4f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01081f4f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100100 td 0xfffff8015e077000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01081efdc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01081efde0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01081efe20 _sleep() at _sleep+0x2d8/frame 0xfffffe01081efec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01081efef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01081eff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01081eff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100101 td 0xfffff8015e078740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01081fedc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01081fede0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01081fee20 _sleep() at _sleep+0x2d8/frame 0xfffffe01081feec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01081feef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01081fef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01081fef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100102 td 0xfffff8015e078000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01081f9dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01081f9de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01081f9e20 _sleep() at _sleep+0x2d8/frame 0xfffffe01081f9ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01081f9ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01081f9f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01081f9f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100103 td 0xfffff8015e079740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108208dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108208de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108208e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108208ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108208ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108208f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108208f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100104 td 0xfffff8015e079000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108203dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108203de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108203e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108203ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108203ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108203f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108203f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100105 td 0xfffff8015e072740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108212dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108212de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108212e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108212ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108212ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108212f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108212f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100106 td 0xfffff8015e072000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010820ddc0 mi_switch() at mi_switch+0x170/frame 0xfffffe010820dde0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010820de20 _sleep() at _sleep+0x2d8/frame 0xfffffe010820dec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe010820def0 fork_exit() at fork_exit+0x82/frame 0xfffffe010820df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010820df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100107 td 0xfffff8015e073740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010821cdc0 mi_switch() at mi_switch+0x170/frame 0xfffffe010821cde0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010821ce20 _sleep() at _sleep+0x2d8/frame 0xfffffe010821cec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe010821cef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010821cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010821cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100147 td 0xfffff80007c7a740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01082e4df0 mi_switch() at mi_switch+0x170/frame 0xfffffe01082e4e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01082e4e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe01082e4ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0x104/frame 0xfffffe01082e4ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01082e4f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01082e4f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100148 td 0xfffff80007c7a000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01082dfdf0 mi_switch() at mi_switch+0x170/frame 0xfffffe01082dfe10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01082dfe50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe01082dfec0 taskqueue_thread_loop() at taskqueue_thread_loop+0x104/frame 0xfffffe01082dfef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01082dff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01082dff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100149 td 0xfffff80007c7b740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01082eedf0 mi_switch() at mi_switch+0x170/frame 0xfffffe01082eee10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01082eee50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe01082eeec0 taskqueue_thread_loop() at taskqueue_thread_loop+0x104/frame 0xfffffe01082eeef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01082eef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01082eef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100151 td 0xfffff80007c7c740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01082f8df0 mi_switch() at mi_switch+0x170/frame 0xfffffe01082f8e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01082f8e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe01082f8ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0x104/frame 0xfffffe01082f8ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01082f8f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01082f8f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100152 td 0xfffff80007c7c000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01082f3dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01082f3de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01082f3e20 _sleep() at _sleep+0x2d8/frame 0xfffffe01082f3ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01082f3ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01082f3f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01082f3f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100156 td 0xfffff80007c84000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01082fddc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01082fdde0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01082fde20 _sleep() at _sleep+0x2d8/frame 0xfffffe01082fdec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01082fdef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01082fdf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01082fdf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100157 td 0xfffff80007c3b740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108316dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108316de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108316e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108316ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108316ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108316f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108316f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100158 td 0xfffff80007c3b000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108311dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108311de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108311e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108311ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108311ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108311f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108311f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100159 td 0xfffff80007c3c740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108320dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108320de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108320e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108320ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108320ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108320f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108320f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100175 td 0xfffff8000e40c740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108370dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108370de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108370e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108370ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108370ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108370f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108370f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100176 td 0xfffff8000e40c000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010836bdc0 mi_switch() at mi_switch+0x170/frame 0xfffffe010836bde0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010836be20 _sleep() at _sleep+0x2d8/frame 0xfffffe010836bec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe010836bef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010836bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010836bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100177 td 0xfffff8000e40d740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010837adc0 mi_switch() at mi_switch+0x170/frame 0xfffffe010837ade0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010837ae20 _sleep() at _sleep+0x2d8/frame 0xfffffe010837aec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe010837aef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010837af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010837af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100178 td 0xfffff8000e40d000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108375dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108375de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108375e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108375ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108375ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108375f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108375f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100179 td 0xfffff8000e40e740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108384dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108384de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108384e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108384ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108384ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108384f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108384f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100180 td 0xfffff8000e40e000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010837fdc0 mi_switch() at mi_switch+0x170/frame 0xfffffe010837fde0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010837fe20 _sleep() at _sleep+0x2d8/frame 0xfffffe010837fec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe010837fef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010837ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010837ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100196 td 0xfffff80007a80000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01083cfdc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01083cfde0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01083cfe20 _sleep() at _sleep+0x2d8/frame 0xfffffe01083cfec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01083cfef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01083cff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01083cff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100197 td 0xfffff80007a79740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01083dedc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01083dede0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01083dee20 _sleep() at _sleep+0x2d8/frame 0xfffffe01083deec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01083deef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01083def30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01083def30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 101672 td 0xfffff805215cd000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108749dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108749de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108749e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108749ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108749ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108749f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108749f30 --- trap 0xc, rip = 0x82a350a5a, rsp = 0x83066c858, rbp = 0x83066c860 --- Tracing command kernel pid 0 tid 101673 td 0xfffff80521533740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108497dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108497de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108497e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108497ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108497ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108497f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108497f30 --- trap 0xc, rip = 0x82ad90c11, rsp = 0x832c063d0, rbp = 0x832c06400 --- Tracing command kernel pid 0 tid 101674 td 0xfffff80325ba4740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108537dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108537de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108537e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108537ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108537ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108537f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108537f30 --- trap 0xc, rip = 0x82b05bc01, rsp = 0x83108f3d0, rbp = 0x83108f400 --- Tracing command kernel pid 0 tid 101675 td 0xfffff8032e37b740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108721dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108721de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108721e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108721ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108721ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108721f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108721f30 --- trap 0xc, rip = 0x8284ef556, rsp = 0x832aee6c0, rbp = 0x832aee6e0 --- Tracing command kernel pid 0 tid 101676 td 0xfffff80521a2e740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010880cdc0 mi_switch() at mi_switch+0x170/frame 0xfffffe010880cde0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010880ce20 _sleep() at _sleep+0x2d8/frame 0xfffffe010880cec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe010880cef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010880cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010880cf30 --- trap 0xc, rip = 0x82b0597dd, rsp = 0x8312b46a0, rbp = 0x8312b46c0 --- Tracing command kernel pid 0 tid 101677 td 0xfffff80847124740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01088c0dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01088c0de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01088c0e20 _sleep() at _sleep+0x2d8/frame 0xfffffe01088c0ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01088c0ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01088c0f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01088c0f30 --- trap 0, rip = 0xa5a5a5a5a5a5a5a5, rsp = 0xa5a5a5a5a5a5a5a5, rbp = 0xa5a5a5a5a5a5a5a5 --- Tracing command kernel pid 0 tid 101678 td 0xfffff80847124000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01088bbdc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01088bbde0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01088bbe20 _sleep() at _sleep+0x2d8/frame 0xfffffe01088bbec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01088bbef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01088bbf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01088bbf30 --- trap 0xa5a5a5a5, rip = 0xa5a5a5a5a5a5a5a5, rsp = 0xa5a5a5a5a5a5a5a5, rbp = 0xa5a5a5a5a5a5a5a5 --- Tracing command kernel pid 0 tid 101679 td 0xfffff8001ce29740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01088cadc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01088cade0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01088cae20 _sleep() at _sleep+0x2d8/frame 0xfffffe01088caec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01088caef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01088caf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01088caf30 --- trap 0xa5a5a5a5, rip = 0xa5a5a5a5a5a5a5a5, rsp = 0, rbp = 0xa5a5a5a5a5a5a5a5 --- Tracing command kernel pid 0 tid 101680 td 0xfffff8001ce29000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01088c5dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01088c5de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01088c5e20 _sleep() at _sleep+0x2d8/frame 0xfffffe01088c5ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01088c5ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01088c5f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01088c5f30 --- trap 0xa5a5a5a5, rip = 0xa5a5a5a5a5a5a5a5, rsp = 0xa5a5a5a5a5a5a5a5, rbp = 0xa5a5a5a5a5a5a5a5 --- Tracing command kernel pid 0 tid 101681 td 0xfffff804332a7740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01088d4dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01088d4de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01088d4e20 _sleep() at _sleep+0x2d8/frame 0xfffffe01088d4ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01088d4ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01088d4f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01088d4f30 --- trap 0xa5a5a5a5, rip = 0xa5a5a5a5a5a5a5a5, rsp = 0xa5a5a5a5a5a5a5a5, rbp = 0xa5a5a5a5a5a5a5a5 --- Tracing command kernel pid 0 tid 101682 td 0xfffff804332a7000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01088cfdc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01088cfde0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01088cfe20 _sleep() at _sleep+0x2d8/frame 0xfffffe01088cfec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01088cfef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01088cff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01088cff30 --- trap 0xa5a5a5a5, rip = 0xa5a5a5a5a5a5a5a5, rsp = 0xa5a5a5a5a5a5a5a5, rbp = 0xa5a5a5a5a5a5a5a5 --- Tracing command kernel pid 0 tid 101683 td 0xfffff8001ce9d740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01088dedc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01088dede0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01088dee20 _sleep() at _sleep+0x2d8/frame 0xfffffe01088deec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01088deef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01088def30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01088def30 --- trap 0xa5a5a5a5, rip = 0xa5a5a5a5a5a5a5a5, rsp = 0xa5a5a5a5a5a5a5a5, rbp = 0xa5a5a5a5a5a5a5a5 --- Tracing command kernel pid 0 tid 101684 td 0xfffff8001ce9d000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01088d9dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01088d9de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01088d9e20 _sleep() at _sleep+0x2d8/frame 0xfffffe01088d9ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01088d9ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01088d9f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01088d9f30 --- trap 0xa5a5a5a5, rip = 0xa5a5a5a5a5a5a5a5, rsp = 0, rbp = 0xa5a5a5a5a5a5a5a5 --- Tracing command init pid 1 tid 100002 td 0xfffff80003bed000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108005a50 mi_switch() at mi_switch+0x170/frame 0xfffffe0108005a70 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108005ab0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0108005af0 _sleep() at _sleep+0x27e/frame 0xfffffe0108005b90 vm_waitpfault() at vm_waitpfault+0x74/frame 0xfffffe0108005bc0 vm_fault_allocate() at vm_fault_allocate+0x41e/frame 0xfffffe0108005c30 vm_fault() at vm_fault+0x43d/frame 0xfffffe0108005d60 vm_fault_trap() at vm_fault_trap+0x5d/frame 0xfffffe0108005da0 trap_pfault() at trap_pfault+0x21d/frame 0xfffffe0108005e10 trap() at trap+0x51d/frame 0xfffffe0108005f30 calltrap() at calltrap+0x8/frame 0xfffffe0108005f30 --- trap 0xc, rip = 0x2dd08a, rsp = 0x8203dc8f8, rbp = 0x8203dc960 --- Tracing command clock pid 2 tid 100078 td 0xfffff80003cc3000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108181ea0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108181ec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe0108181ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108181f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108181f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command clock pid 2 tid 100079 td 0xfffff80003cc4740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108190ea0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108190ec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe0108190ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108190f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108190f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command clock pid 2 tid 100080 td 0xfffff80003cc4000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010818bea0 mi_switch() at mi_switch+0x170/frame 0xfffffe010818bec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe010818bef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010818bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010818bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command clock pid 2 tid 100081 td 0xfffff80003c88740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010819aea0 mi_switch() at mi_switch+0x170/frame 0xfffffe010819aec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe010819aef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010819af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010819af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command clock pid 2 tid 100082 td 0xfffff80003c88000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108195ea0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108195ec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe0108195ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108195f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108195f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command clock pid 2 tid 100083 td 0xfffff80003c89740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01081a4ea0 mi_switch() at mi_switch+0x170/frame 0xfffffe01081a4ec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe01081a4ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01081a4f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01081a4f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command clock pid 2 tid 100084 td 0xfffff80003c89000 fork_trampoline() at fork_trampoline Tracing command clock pid 2 tid 100085 td 0xfffff80003c8a740 fork_trampoline() at fork_trampoline Tracing command clock pid 2 tid 100086 td 0xfffff80003c8a000 fork_trampoline() at fork_trampoline Tracing command clock pid 2 tid 100087 td 0xfffff80003c8b740 fork_trampoline() at fork_trampoline Tracing command clock pid 2 tid 100088 td 0xfffff80003c8b000 fork_trampoline() at fork_trampoline Tracing command clock pid 2 tid 100089 td 0xfffff80003c84740 fork_trampoline() at fork_trampoline Tracing command crypto pid 3 tid 100108 td 0xfffff8015e073000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108217dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108217de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108217e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108217ec0 crypto_dispatch_thread() at crypto_dispatch_thread+0x193/frame 0xfffffe0108217ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108217f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108217f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100109 td 0xfffff8015e074740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108226db0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108226dd0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108226e10 _sleep() at _sleep+0x2d8/frame 0xfffffe0108226eb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe0108226ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108226f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108226f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100110 td 0xfffff8015e074000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108221db0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108221dd0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108221e10 _sleep() at _sleep+0x2d8/frame 0xfffffe0108221eb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe0108221ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108221f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108221f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100111 td 0xfffff8015e075740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108230db0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108230dd0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108230e10 _sleep() at _sleep+0x2d8/frame 0xfffffe0108230eb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe0108230ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108230f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108230f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100112 td 0xfffff8015e075000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010822bdb0 mi_switch() at mi_switch+0x170/frame 0xfffffe010822bdd0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010822be10 _sleep() at _sleep+0x2d8/frame 0xfffffe010822beb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe010822bef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010822bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010822bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100113 td 0xfffff8015e068740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010823adb0 mi_switch() at mi_switch+0x170/frame 0xfffffe010823add0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010823ae10 _sleep() at _sleep+0x2d8/frame 0xfffffe010823aeb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe010823aef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010823af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010823af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100114 td 0xfffff8015e068000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108235db0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108235dd0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108235e10 _sleep() at _sleep+0x2d8/frame 0xfffffe0108235eb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe0108235ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108235f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108235f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100115 td 0xfffff8015e069740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108244db0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108244dd0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108244e10 _sleep() at _sleep+0x2d8/frame 0xfffffe0108244eb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe0108244ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108244f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108244f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100116 td 0xfffff8015e069000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010823fdb0 mi_switch() at mi_switch+0x170/frame 0xfffffe010823fdd0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010823fe10 _sleep() at _sleep+0x2d8/frame 0xfffffe010823feb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe010823fef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010823ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010823ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100117 td 0xfffff8015e06a740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010824edb0 mi_switch() at mi_switch+0x170/frame 0xfffffe010824edd0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010824ee10 _sleep() at _sleep+0x2d8/frame 0xfffffe010824eeb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe010824eef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010824ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010824ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100118 td 0xfffff8015e06a000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108249db0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108249dd0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108249e10 _sleep() at _sleep+0x2d8/frame 0xfffffe0108249eb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe0108249ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108249f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108249f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100119 td 0xfffff8015e06b740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108258db0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108258dd0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108258e10 _sleep() at _sleep+0x2d8/frame 0xfffffe0108258eb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe0108258ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108258f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108258f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100120 td 0xfffff8015e06b000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108253db0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108253dd0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108253e10 _sleep() at _sleep+0x2d8/frame 0xfffffe0108253eb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe0108253ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108253f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108253f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 4 tid 100121 td 0xfffff8015e15b740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108262da0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108262dc0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108262e00 _sleep() at _sleep+0x2d8/frame 0xfffffe0108262ea0 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe0108262ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108262f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108262f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 4 tid 100122 td 0xfffff8015e15b000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010825dda0 mi_switch() at mi_switch+0x170/frame 0xfffffe010825ddc0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010825de00 _sleep() at _sleep+0x2d8/frame 0xfffffe010825dea0 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe010825def0 fork_exit() at fork_exit+0x82/frame 0xfffffe010825df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010825df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 4 tid 100123 td 0xfffff8015e160740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010826cda0 mi_switch() at mi_switch+0x170/frame 0xfffffe010826cdc0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010826ce00 _sleep() at _sleep+0x2d8/frame 0xfffffe010826cea0 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe010826cef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010826cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010826cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 4 tid 100124 td 0xfffff8015e160000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108267da0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108267dc0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108267e00 _sleep() at _sleep+0x2d8/frame 0xfffffe0108267ea0 xpt_async_td() at xpt_async_td+0x74/frame 0xfffffe0108267ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108267f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108267f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 4 tid 100153 td 0xfffff80007c84740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108302dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108302de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108302e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108302ec0 xpt_scanner_thread() at xpt_scanner_thread+0x138/frame 0xfffffe0108302ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108302f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108302f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command busdma pid 5 tid 100126 td 0xfffff8015e625740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108276da0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108276dc0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108276e00 _sleep() at _sleep+0x2d8/frame 0xfffffe0108276ea0 busdma_thread() at busdma_thread+0xc5/frame 0xfffffe0108276ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108276f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108276f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command rand_harvestq pid 6 tid 100150 td 0xfffff80007c7b000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01082e9d20 mi_switch() at mi_switch+0x170/frame 0xfffffe01082e9d40 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01082e9d80 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe01082e9dc0 _sleep() at _sleep+0x27e/frame 0xfffffe01082e9e60 random_kthread() at random_kthread+0xb7/frame 0xfffffe01082e9ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01082e9f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01082e9f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon0 pid 7 tid 100154 td 0xfffff80003e84740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010830cd80 mi_switch() at mi_switch+0x170/frame 0xfffffe010830cda0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010830cde0 _sleep() at _sleep+0x2d8/frame 0xfffffe010830ce80 enc_daemon() at enc_daemon+0xdd/frame 0xfffffe010830cef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010830cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010830cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon1 pid 8 tid 100155 td 0xfffff80003e84000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108307d80 mi_switch() at mi_switch+0x170/frame 0xfffffe0108307da0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108307de0 _sleep() at _sleep+0x2d8/frame 0xfffffe0108307e80 enc_daemon() at enc_daemon+0xdd/frame 0xfffffe0108307ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108307f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108307f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 9 tid 100198 td 0xfffff80007e86740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01083e8980 mi_switch() at mi_switch+0x170/frame 0xfffffe01083e89a0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01083e89e0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe01083e8a20 _sleep() at _sleep+0x27e/frame 0xfffffe01083e8ac0 pause_sbt() at pause_sbt+0x7d/frame 0xfffffe01083e8af0 vm_pageout_worker() at vm_pageout_worker+0x230/frame 0xfffffe01083e8eb0 vm_pageout() at vm_pageout+0x1d7/frame 0xfffffe01083e8ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01083e8f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01083e8f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 9 tid 100199 td 0xfffff80003e85740 (CPU 3) kdb_enter() at kdb_enter+0x33/frame 0xfffffe01083f2600 handleevents() at handleevents+0xaf/frame 0xfffffe01083f2640 timercb() at timercb+0x18e/frame 0xfffffe01083f2690 lapic_handle_timer() at lapic_handle_timer+0xab/frame 0xfffffe01083f26b0 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe01083f26b0 --- interrupt, rip = 0xffffffff80b2a650, rsp = 0xfffffe01083f2780, rbp = 0xfffffe01083f2790 --- __mtx_unlock_flags() at __mtx_unlock_flags+0x90/frame 0xfffffe01083f2790 vm_page_pqstate_commit_dequeue() at vm_page_pqstate_commit_dequeue+0xb6/frame 0xfffffe01083f27d0 vm_page_unswappable() at vm_page_unswappable+0x68/frame 0xfffffe01083f2800 vm_pageout_flush() at vm_pageout_flush+0x1a7/frame 0xfffffe01083f2900 vm_pageout_cluster() at vm_pageout_cluster+0x33b/frame 0xfffffe01083f2b70 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x70e/frame 0xfffffe01083f2ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01083f2f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01083f2f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 9 tid 100200 td 0xfffff80003e85000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01083edd50 mi_switch() at mi_switch+0x170/frame 0xfffffe01083edd70 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01083eddb0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe01083eddf0 _sleep() at _sleep+0x27e/frame 0xfffffe01083ede90 pause_sbt() at pause_sbt+0x7d/frame 0xfffffe01083edec0 uma_reclaim_worker() at uma_reclaim_worker+0x61/frame 0xfffffe01083edef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01083edf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01083edf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command audit pid 10 tid 100001 td 0xfffff80003bed740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010800adc0 mi_switch() at mi_switch+0x170/frame 0xfffffe010800ade0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010800ae20 _cv_wait() at _cv_wait+0x160/frame 0xfffffe010800ae90 audit_worker() at audit_worker+0x8f/frame 0xfffffe010800aef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010800af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010800af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100003 td 0xfffff80003bee740 (CPU 0) cpustop_handler() at cpustop_handler+0x27/frame 0xffffffff81d09f80 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xffffffff81d09f90 trap() at trap+0x56/frame 0xffffffff81d0a0b0 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81d0a0b0 --- trap 0x13, rip = 0xffffffff8102e59e, rsp = 0xfffffe0108014d78, rbp = 0xfffffe0108014db0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe0108014db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe0108014dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0108014df0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe0108014ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108014f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108014f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffff80003bee000 (CPU 1) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ce3cdf0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003ce3ce00 trap() at trap+0x56/frame 0xfffffe003ce3cf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce3cf20 --- trap 0x13, rip = 0xffffffff8102e59e, rsp = 0xfffffe010800fd78, rbp = 0xfffffe010800fdb0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe010800fdb0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe010800fdd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe010800fdf0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe010800fef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010800ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010800ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffff80003bef740 (CPU 2) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ce4bdf0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003ce4be00 trap() at trap+0x56/frame 0xfffffe003ce4bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce4bf20 --- trap 0x13, rip = 0xffffffff8102e59e, rsp = 0xfffffe010801ed78, rbp = 0xfffffe010801edb0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe010801edb0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe010801edd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe010801edf0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe010801eef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010801ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010801ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffff80003bef000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108019dd0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108019df0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe0108019ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108019f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108019f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffff80003bf0740 (CPU 4) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ce69df0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003ce69e00 trap() at trap+0x56/frame 0xfffffe003ce69f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce69f20 --- trap 0x13, rip = 0xffffffff8102e59e, rsp = 0xfffffe0108028d78, rbp = 0xfffffe0108028db0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe0108028db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe0108028dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0108028df0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe0108028ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108028f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108028f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffff80003bf0000 (CPU 5) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ce78df0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003ce78e00 trap() at trap+0x56/frame 0xfffffe003ce78f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce78f20 --- trap 0x13, rip = 0xffffffff8102e59e, rsp = 0xfffffe0108023d78, rbp = 0xfffffe0108023db0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe0108023db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe0108023dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0108023df0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe0108023ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108023f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108023f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffff80003bd9740 (CPU 6) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ce87df0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003ce87e00 trap() at trap+0x56/frame 0xfffffe003ce87f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce87f20 --- trap 0x13, rip = 0xffffffff8102e59e, rsp = 0xfffffe0108032d78, rbp = 0xfffffe0108032db0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe0108032db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe0108032dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0108032df0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe0108032ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108032f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108032f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffff80003bd9000 (CPU 7) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ce96df0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003ce96e00 trap() at trap+0x56/frame 0xfffffe003ce96f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce96f20 --- trap 0x13, rip = 0xffffffff8102e59e, rsp = 0xfffffe010802dd78, rbp = 0xfffffe010802ddb0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe010802ddb0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe010802ddd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe010802ddf0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe010802def0 fork_exit() at fork_exit+0x82/frame 0xfffffe010802df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010802df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffff80003bda740 (CPU 8) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003cea5df0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003cea5e00 trap() at trap+0x56/frame 0xfffffe003cea5f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003cea5f20 --- trap 0x13, rip = 0xffffffff8102e59e, rsp = 0xfffffe010803cd78, rbp = 0xfffffe010803cdb0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe010803cdb0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe010803cdd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe010803cdf0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe010803cef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010803cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010803cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffff80003bda000 (CPU 9) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ceb4df0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003ceb4e00 trap() at trap+0x56/frame 0xfffffe003ceb4f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ceb4f20 --- trap 0x13, rip = 0xffffffff8102e59e, rsp = 0xfffffe0108037d78, rbp = 0xfffffe0108037db0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe0108037db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe0108037dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0108037df0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe0108037ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108037f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108037f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffff80003bdb740 (CPU 10) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003cec3df0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003cec3e00 trap() at trap+0x56/frame 0xfffffe003cec3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003cec3f20 --- trap 0x13, rip = 0xffffffff8102e59e, rsp = 0xfffffe0108046d78, rbp = 0xfffffe0108046db0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe0108046db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe0108046dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0108046df0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe0108046ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108046f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108046f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffff80003bdb000 (CPU 11) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ced2df0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003ced2e00 trap() at trap+0x56/frame 0xfffffe003ced2f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ced2f20 --- trap 0x13, rip = 0xffffffff8102e59e, rsp = 0xfffffe0108041d78, rbp = 0xfffffe0108041db0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe0108041db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe0108041dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0108041df0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe0108041ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108041f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108041f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100042 td 0xfffff80003b90000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01080cde40 mi_switch() at mi_switch+0x170/frame 0xfffffe01080cde60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe01080cdef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01080cdf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01080cdf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100043 td 0xfffff80003b91740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100045 td 0xfffff80003b92740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100090 td 0xfffff80003c84000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01081bde40 mi_switch() at mi_switch+0x170/frame 0xfffffe01081bde60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe01081bdef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01081bdf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01081bdf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100125 td 0xfffff80003cc3740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108186e40 mi_switch() at mi_switch+0x170/frame 0xfffffe0108186e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0108186ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108186f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108186f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100127 td 0xfffff8015e625000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108271e40 mi_switch() at mi_switch+0x170/frame 0xfffffe0108271e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0108271ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108271f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108271f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100133 td 0xfffff8015e62f000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010828fe40 mi_switch() at mi_switch+0x170/frame 0xfffffe010828fe60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe010828fef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010828ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010828ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100144 td 0xfffff80003dc2000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100145 td 0xfffff80003dca740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100146 td 0xfffff80003dca000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01082d5e40 mi_switch() at mi_switch+0x170/frame 0xfffffe01082d5e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe01082d5ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01082d5f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01082d5f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100160 td 0xfffff80007c3c000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010831be40 mi_switch() at mi_switch+0x170/frame 0xfffffe010831be60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe010831bef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010831bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010831bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100161 td 0xfffff80007c3d740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010832ae40 mi_switch() at mi_switch+0x170/frame 0xfffffe010832ae60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe010832aef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010832af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010832af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100162 td 0xfffff80007c3d000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100163 td 0xfffff80007c3e740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100164 td 0xfffff80007c3e000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100165 td 0xfffff8000e40f740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100166 td 0xfffff8000e40f000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100167 td 0xfffff8000e410740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100168 td 0xfffff8000e410000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100169 td 0xfffff8000e411740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100170 td 0xfffff8000e411000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100171 td 0xfffff8000e412740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100172 td 0xfffff8000e412000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100173 td 0xfffff8000e40b740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100174 td 0xfffff8000e40b000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100181 td 0xfffff80007a85740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010838ee40 mi_switch() at mi_switch+0x170/frame 0xfffffe010838ee60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe010838eef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010838ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010838ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100182 td 0xfffff80007a85000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108389e40 mi_switch() at mi_switch+0x170/frame 0xfffffe0108389e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0108389ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108389f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108389f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100183 td 0xfffff80007a86740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100184 td 0xfffff80007a86000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100185 td 0xfffff80007a87740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100186 td 0xfffff80007a87000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100187 td 0xfffff80007a88740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100188 td 0xfffff80007a88000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100189 td 0xfffff80007a7d740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100190 td 0xfffff80007a7d000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100191 td 0xfffff80007a7e740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100192 td 0xfffff80007a7e000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100193 td 0xfffff80007a7f740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100194 td 0xfffff80007a7f000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100195 td 0xfffff80007a80740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100243 td 0xfffff800132eb000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100244 td 0xfffff800137c9740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100245 td 0xfffff800137c9000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100246 td 0xfffff800137ca740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100247 td 0xfffff800137ca000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100248 td 0xfffff80012d9c740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100249 td 0xfffff80012d9c000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100250 td 0xfffff80012da2740 fork_trampoline() at fork_trampoline Tracing command geom pid 13 tid 100092 td 0xfffff80003c85000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01081c7dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01081c7de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01081c7e20 _sleep() at _sleep+0x2d8/frame 0xfffffe01081c7ec0 g_run_events() at g_run_events+0x434/frame 0xfffffe01081c7ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01081c7f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01081c7f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100093 td 0xfffff80003c86740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01081d6db0 mi_switch() at mi_switch+0x170/frame 0xfffffe01081d6dd0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01081d6e10 _sleep() at _sleep+0x2d8/frame 0xfffffe01081d6eb0 g_io_schedule_up() at g_io_schedule_up+0x3c/frame 0xfffffe01081d6ee0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe01081d6ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01081d6f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01081d6f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100094 td 0xfffff80003c86000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01081d1db0 mi_switch() at mi_switch+0x170/frame 0xfffffe01081d1dd0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01081d1e10 _sleep() at _sleep+0x2d8/frame 0xfffffe01081d1eb0 g_io_schedule_down() at g_io_schedule_down+0x3c/frame 0xfffffe01081d1ee0 g_down_procbody() at g_down_procbody+0x5c/frame 0xfffffe01081d1ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01081d1f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01081d1f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sequencer 00 pid 14 tid 100095 td 0xfffff80003c87740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01081e0da0 mi_switch() at mi_switch+0x170/frame 0xfffffe01081e0dc0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01081e0e00 _cv_wait() at _cv_wait+0x160/frame 0xfffffe01081e0e70 seq_eventthread() at seq_eventthread+0x8c/frame 0xfffffe01081e0ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01081e0f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01081e0f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100128 td 0xfffff8015e626740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108280df0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108280e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108280e50 _cv_wait() at _cv_wait+0x160/frame 0xfffffe0108280ec0 usb_process() at usb_process+0xb0/frame 0xfffffe0108280ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108280f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108280f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100129 td 0xfffff8015e626000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010827bdf0 mi_switch() at mi_switch+0x170/frame 0xfffffe010827be10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010827be50 _cv_wait() at _cv_wait+0x160/frame 0xfffffe010827bec0 usb_process() at usb_process+0xb0/frame 0xfffffe010827bef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010827bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010827bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100130 td 0xfffff8015e627740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010828adf0 mi_switch() at mi_switch+0x170/frame 0xfffffe010828ae10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010828ae50 _cv_wait() at _cv_wait+0x160/frame 0xfffffe010828aec0 usb_process() at usb_process+0xb0/frame 0xfffffe010828aef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010828af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010828af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100131 td 0xfffff8015e627000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108285df0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108285e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108285e50 _cv_wait() at _cv_wait+0x160/frame 0xfffffe0108285ec0 usb_process() at usb_process+0xb0/frame 0xfffffe0108285ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108285f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108285f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100132 td 0xfffff8015e62f740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108294df0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108294e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108294e50 _cv_wait() at _cv_wait+0x160/frame 0xfffffe0108294ec0 usb_process() at usb_process+0xb0/frame 0xfffffe0108294ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108294f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108294f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100134 td 0xfffff8015e775740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010829edf0 mi_switch() at mi_switch+0x170/frame 0xfffffe010829ee10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010829ee50 _cv_wait() at _cv_wait+0x160/frame 0xfffffe010829eec0 usb_process() at usb_process+0xb0/frame 0xfffffe010829eef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010829ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010829ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100135 td 0xfffff8015e775000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108299df0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108299e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108299e50 _cv_wait() at _cv_wait+0x160/frame 0xfffffe0108299ec0 usb_process() at usb_process+0xb0/frame 0xfffffe0108299ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108299f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108299f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100136 td 0xfffff8015e776740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01082a8df0 mi_switch() at mi_switch+0x170/frame 0xfffffe01082a8e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01082a8e50 _cv_wait() at _cv_wait+0x160/frame 0xfffffe01082a8ec0 usb_process() at usb_process+0xb0/frame 0xfffffe01082a8ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01082a8f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01082a8f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100137 td 0xfffff8015e776000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01082a3df0 mi_switch() at mi_switch+0x170/frame 0xfffffe01082a3e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01082a3e50 _cv_wait() at _cv_wait+0x160/frame 0xfffffe01082a3ec0 usb_process() at usb_process+0xb0/frame 0xfffffe01082a3ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01082a3f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01082a3f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100138 td 0xfffff8015e777740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01082b2df0 mi_switch() at mi_switch+0x170/frame 0xfffffe01082b2e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01082b2e50 _cv_wait() at _cv_wait+0x160/frame 0xfffffe01082b2ec0 usb_process() at usb_process+0xb0/frame 0xfffffe01082b2ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01082b2f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01082b2f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100139 td 0xfffff80003dc0740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01082bcdf0 mi_switch() at mi_switch+0x170/frame 0xfffffe01082bce10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01082bce50 _cv_wait() at _cv_wait+0x160/frame 0xfffffe01082bcec0 usb_process() at usb_process+0xb0/frame 0xfffffe01082bcef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01082bcf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01082bcf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100140 td 0xfffff80003dc0000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01082b7df0 mi_switch() at mi_switch+0x170/frame 0xfffffe01082b7e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01082b7e50 _cv_wait() at _cv_wait+0x160/frame 0xfffffe01082b7ec0 usb_process() at usb_process+0xb0/frame 0xfffffe01082b7ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01082b7f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01082b7f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100141 td 0xfffff80003dc1740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01082c6df0 mi_switch() at mi_switch+0x170/frame 0xfffffe01082c6e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01082c6e50 _cv_wait() at _cv_wait+0x160/frame 0xfffffe01082c6ec0 usb_process() at usb_process+0xb0/frame 0xfffffe01082c6ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01082c6f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01082c6f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100142 td 0xfffff80003dc1000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01082c1df0 mi_switch() at mi_switch+0x170/frame 0xfffffe01082c1e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01082c1e50 _cv_wait() at _cv_wait+0x160/frame 0xfffffe01082c1ec0 usb_process() at usb_process+0xb0/frame 0xfffffe01082c1ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01082c1f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01082c1f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100143 td 0xfffff80003dc2740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01082d0df0 mi_switch() at mi_switch+0x170/frame 0xfffffe01082d0e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01082d0e50 _cv_wait() at _cv_wait+0x160/frame 0xfffffe01082d0ec0 usb_process() at usb_process+0xb0/frame 0xfffffe01082d0ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01082d0f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01082d0f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vmdaemon pid 16 tid 100201 td 0xfffff80007e86000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01083e3d80 mi_switch() at mi_switch+0x170/frame 0xfffffe01083e3da0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01083e3de0 _sleep() at _sleep+0x2d8/frame 0xfffffe01083e3e80 vm_daemon() at vm_daemon+0x82/frame 0xfffffe01083e3ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01083e3f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01083e3f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100202 td 0xfffff80007e87740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01083fcd60 mi_switch() at mi_switch+0x170/frame 0xfffffe01083fcd80 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01083fcdc0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe01083fce00 _sleep() at _sleep+0x27e/frame 0xfffffe01083fcea0 buf_daemon() at buf_daemon+0x121/frame 0xfffffe01083fcef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01083fcf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01083fcf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100203 td 0xfffff8015e8b8740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108406d40 mi_switch() at mi_switch+0x170/frame 0xfffffe0108406d60 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108406da0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0108406de0 _sleep() at _sleep+0x27e/frame 0xfffffe0108406e80 bufspace_daemon() at bufspace_daemon+0x322/frame 0xfffffe0108406ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108406f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108406f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100204 td 0xfffff8015e8b8000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108401d40 mi_switch() at mi_switch+0x170/frame 0xfffffe0108401d60 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108401da0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0108401de0 _sleep() at _sleep+0x27e/frame 0xfffffe0108401e80 bufspace_daemon() at bufspace_daemon+0x322/frame 0xfffffe0108401ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108401f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108401f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100205 td 0xfffff8015e8b9740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108410d40 mi_switch() at mi_switch+0x170/frame 0xfffffe0108410d60 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108410da0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0108410de0 _sleep() at _sleep+0x27e/frame 0xfffffe0108410e80 bufspace_daemon() at bufspace_daemon+0x322/frame 0xfffffe0108410ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108410f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108410f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100206 td 0xfffff8015e8b9000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010840bd40 mi_switch() at mi_switch+0x170/frame 0xfffffe010840bd60 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010840bda0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010840bde0 _sleep() at _sleep+0x27e/frame 0xfffffe010840be80 bufspace_daemon() at bufspace_daemon+0x322/frame 0xfffffe010840bef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010840bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010840bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100207 td 0xfffff8015e8ba740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010841ad40 mi_switch() at mi_switch+0x170/frame 0xfffffe010841ad60 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010841ada0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010841ade0 _sleep() at _sleep+0x27e/frame 0xfffffe010841ae80 bufspace_daemon() at bufspace_daemon+0x322/frame 0xfffffe010841aef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010841af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010841af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100208 td 0xfffff8015e8ba000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108415d40 mi_switch() at mi_switch+0x170/frame 0xfffffe0108415d60 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108415da0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0108415de0 _sleep() at _sleep+0x27e/frame 0xfffffe0108415e80 bufspace_daemon() at bufspace_daemon+0x322/frame 0xfffffe0108415ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108415f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108415f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100209 td 0xfffff8015e8c2740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108424d40 mi_switch() at mi_switch+0x170/frame 0xfffffe0108424d60 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108424da0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0108424de0 _sleep() at _sleep+0x27e/frame 0xfffffe0108424e80 bufspace_daemon() at bufspace_daemon+0x322/frame 0xfffffe0108424ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108424f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108424f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100235 td 0xfffff8015e777000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01082add70 mi_switch() at mi_switch+0x170/frame 0xfffffe01082add90 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01082addd0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe01082ade10 _sleep() at _sleep+0x27e/frame 0xfffffe01082adeb0 softdep_flush() at softdep_flush+0x188/frame 0xfffffe01082adef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01082adf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01082adf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100251 td 0xfffff800139ef740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01084d8d70 mi_switch() at mi_switch+0x170/frame 0xfffffe01084d8d90 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01084d8dd0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe01084d8e10 _sleep() at _sleep+0x27e/frame 0xfffffe01084d8eb0 softdep_flush() at softdep_flush+0x188/frame 0xfffffe01084d8ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01084d8f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01084d8f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vnlru pid 18 tid 100210 td 0xfffff80007e87000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01083f7d10 mi_switch() at mi_switch+0x170/frame 0xfffffe01083f7d30 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01083f7d70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe01083f7db0 _sleep() at _sleep+0x27e/frame 0xfffffe01083f7e50 vnlru_proc() at vnlru_proc+0x18b/frame 0xfffffe01083f7ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01083f7f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01083f7f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command syncer pid 19 tid 100211 td 0xfffff80007e88740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010842ed30 mi_switch() at mi_switch+0x170/frame 0xfffffe010842ed50 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010842ed90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010842edd0 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x187/frame 0xfffffe010842ee60 sched_sync() at sched_sync+0x6ae/frame 0xfffffe010842eef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010842ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010842ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sh pid 82333 tid 377775 td 0xfffff802fbdfa740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010849c740 mi_switch() at mi_switch+0x170/frame 0xfffffe010849c760 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010849c7a0 _sleep() at _sleep+0x2d8/frame 0xfffffe010849c840 vm_wait_doms() at vm_wait_doms+0xe3/frame 0xfffffe010849c870 pmap_allocpte_alloc() at pmap_allocpte_alloc+0x73/frame 0xfffffe010849c8a0 pmap_enter() at pmap_enter+0x782/frame 0xfffffe010849c960 vm_fault() at vm_fault+0x14cb/frame 0xfffffe010849ca90 vm_fault_trap() at vm_fault_trap+0x5d/frame 0xfffffe010849cad0 trap_pfault() at trap_pfault+0x21d/frame 0xfffffe010849cb40 calltrap() at calltrap+0x8/frame 0xfffffe010849cb40 --- trap 0xc, rip = 0xffffffff8106e77c, rsp = 0xfffffe010849cc10, rbp = 0xfffffe010849cc10 --- copyout_nosmap_erms() at copyout_nosmap_erms+0xfc/frame 0xfffffe010849cc10 sys_wait4() at sys_wait4+0xb3/frame 0xfffffe010849ce00 amd64_syscall() at amd64_syscall+0x158/frame 0xfffffe010849cf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010849cf30 --- syscall (7, FreeBSD ELF64, wait4), rip = 0x2fe264da999a, rsp = 0x2fe2604b8b58, rbp = 0x2fe2604b8c00 --- Tracing command sh pid 82342 tid 377551 td 0xfffff802efdd6740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01dbe55950 mi_switch() at mi_switch+0x170/frame 0xfffffe01dbe55970 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01dbe559b0 _sleep() at _sleep+0x2d8/frame 0xfffffe01dbe55a50 vm_wait_doms() at vm_wait_doms+0xe3/frame 0xfffffe01dbe55a80 pmap_allocpte_alloc() at pmap_allocpte_alloc+0x73/frame 0xfffffe01dbe55ab0 pmap_enter() at pmap_enter+0x782/frame 0xfffffe01dbe55b70 vm_fault() at vm_fault+0x14cb/frame 0xfffffe01dbe55ca0 vm_fault_trap() at vm_fault_trap+0x5d/frame 0xfffffe01dbe55ce0 trap_pfault() at trap_pfault+0x21d/frame 0xfffffe01dbe55d50 calltrap() at calltrap+0x8/frame 0xfffffe01dbe55d50 --- trap 0xc, rip = 0xffffffff8106f37d, rsp = 0xfffffe01dbe55e20, rbp = 0xfffffe01dbe55e20 --- fueword32_nosmap() at fueword32_nosmap+0x2d/frame 0xfffffe01dbe55e20 ast_sig() at ast_sig+0x1ef/frame 0xfffffe01dbe55ed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe01dbe55f10 ast() at ast+0x20/frame 0xfffffe01dbe55f30 doreti_ast() at doreti_ast+0x1c/frame 0x2fe2604b8790 Tracing command sshd pid 82696 tid 380534 td 0xfffff80396b63740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01d23c3950 mi_switch() at mi_switch+0x170/frame 0xfffffe01d23c3970 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01d23c39b0 _sleep() at _sleep+0x2d8/frame 0xfffffe01d23c3a50 vm_wait_doms() at vm_wait_doms+0xe3/frame 0xfffffe01d23c3a80 pmap_allocpte_alloc() at pmap_allocpte_alloc+0x73/frame 0xfffffe01d23c3ab0 pmap_enter() at pmap_enter+0x782/frame 0xfffffe01d23c3b70 vm_fault() at vm_fault+0x14cb/frame 0xfffffe01d23c3ca0 vm_fault_trap() at vm_fault_trap+0x5d/frame 0xfffffe01d23c3ce0 trap_pfault() at trap_pfault+0x21d/frame 0xfffffe01d23c3d50 calltrap() at calltrap+0x8/frame 0xfffffe01d23c3d50 --- trap 0xc, rip = 0xffffffff8106f37d, rsp = 0xfffffe01d23c3e20, rbp = 0xfffffe01d23c3e20 --- fueword32_nosmap() at fueword32_nosmap+0x2d/frame 0xfffffe01d23c3e20 ast_sig() at ast_sig+0x1ef/frame 0xfffffe01d23c3ed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe01d23c3f10 ast() at ast+0x20/frame 0xfffffe01d23c3f30 doreti_ast() at doreti_ast+0x1c/frame 0x1be2274d2c80 Tracing command sshd pid 82699 tid 380859 td 0xfffff802dfd06740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01fc222950 mi_switch() at mi_switch+0x170/frame 0xfffffe01fc222970 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01fc2229b0 _sleep() at _sleep+0x2d8/frame 0xfffffe01fc222a50 vm_wait_doms() at vm_wait_doms+0xe3/frame 0xfffffe01fc222a80 pmap_allocpte_alloc() at pmap_allocpte_alloc+0x73/frame 0xfffffe01fc222ab0 pmap_enter() at pmap_enter+0x782/frame 0xfffffe01fc222b70 vm_fault() at vm_fault+0x14cb/frame 0xfffffe01fc222ca0 vm_fault_trap() at vm_fault_trap+0x5d/frame 0xfffffe01fc222ce0 trap_pfault() at trap_pfault+0x21d/frame 0xfffffe01fc222d50 calltrap() at calltrap+0x8/frame 0xfffffe01fc222d50 --- trap 0xc, rip = 0xffffffff8106f37d, rsp = 0xfffffe01fc222e20, rbp = 0xfffffe01fc222e20 --- fueword32_nosmap() at fueword32_nosmap+0x2d/frame 0xfffffe01fc222e20 ast_sig() at ast_sig+0x1ef/frame 0xfffffe01fc222ed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe01fc222f10 ast() at ast+0x20/frame 0xfffffe01fc222f30 doreti_ast() at doreti_ast+0x1c/frame 0x1be2274d2a40 Tracing command sh pid 82700 tid 381111 td 0xfffff80396a23740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01fc70e950 mi_switch() at mi_switch+0x170/frame 0xfffffe01fc70e970 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01fc70e9b0 _sleep() at _sleep+0x2d8/frame 0xfffffe01fc70ea50 vm_wait_doms() at vm_wait_doms+0xe3/frame 0xfffffe01fc70ea80 pmap_allocpte_alloc() at pmap_allocpte_alloc+0x73/frame 0xfffffe01fc70eab0 pmap_enter() at pmap_enter+0x782/frame 0xfffffe01fc70eb70 vm_fault() at vm_fault+0x14cb/frame 0xfffffe01fc70eca0 vm_fault_trap() at vm_fault_trap+0x5d/frame 0xfffffe01fc70ece0 trap_pfault() at trap_pfault+0x21d/frame 0xfffffe01fc70ed50 calltrap() at calltrap+0x8/frame 0xfffffe01fc70ed50 --- trap 0xc, rip = 0xffffffff8106f37d, rsp = 0xfffffe01fc70ee20, rbp = 0xfffffe01fc70ee20 --- fueword32_nosmap() at fueword32_nosmap+0x2d/frame 0xfffffe01fc70ee20 ast_sig() at ast_sig+0x1ef/frame 0xfffffe01fc70eed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe01fc70ef10 ast() at ast+0x20/frame 0xfffffe01fc70ef30 doreti_ast() at doreti_ast+0x1c/frame 0x24775db60120 Tracing command timeout pid 66481 tid 370743 td 0xfffff80521eb1740 thread_exit() at thread_exit+0x1ea/frame 0xfffffe01dc017740 exit1() at exit1+0xe0f/frame 0xfffffe01dc0177b0 sigexit() at sigexit+0x171/frame 0xfffffe01dc017c30 postsig() at postsig+0x1a5/frame 0xfffffe01dc017d00 kern_sigsuspend() at kern_sigsuspend+0x24b/frame 0xfffffe01dc017dd0 sys_sigsuspend() at sys_sigsuspend+0x31/frame 0xfffffe01dc017e00 amd64_syscall() at amd64_syscall+0x158/frame 0xfffffe01dc017f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01dc017f30 --- syscall (4, FreeBSD ELF64, write), rip = 0x3e849f39d8fa, rsp = 0x3e849c2adbb8, rbp = 0x3e849c2addd0 --- Tracing command sort pid 66484 tid 373722 td 0xfffff802e66cb000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01dbd97a10 mi_switch() at mi_switch+0x170/frame 0xfffffe01dbd97a30 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01dbd97a70 _sleep() at _sleep+0x2d8/frame 0xfffffe01dbd97b10 vm_wait_doms() at vm_wait_doms+0xe3/frame 0xfffffe01dbd97b40 pmap_allocpte_alloc() at pmap_allocpte_alloc+0x73/frame 0xfffffe01dbd97b70 pmap_enter() at pmap_enter+0x782/frame 0xfffffe01dbd97c30 vm_fault() at vm_fault+0x14cb/frame 0xfffffe01dbd97d60 vm_fault_trap() at vm_fault_trap+0x5d/frame 0xfffffe01dbd97da0 trap_pfault() at trap_pfault+0x21d/frame 0xfffffe01dbd97e10 trap() at trap+0x51d/frame 0xfffffe01dbd97f30 calltrap() at calltrap+0x8/frame 0xfffffe01dbd97f30 --- trap 0xc, rip = 0x1ce84cc94325, rsp = 0x1ce84a403938, rbp = 0x1ce84a403980 --- Tracing command sctp_iterator pid 25872 tid 100997 td 0xfffff80325dbb000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01085ebdd0 mi_switch() at mi_switch+0x170/frame 0xfffffe01085ebdf0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01085ebe30 _sleep() at _sleep+0x2d8/frame 0xfffffe01085ebed0 sctp_iterator_thread() at sctp_iterator_thread+0x59/frame 0xfffffe01085ebef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01085ebf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01085ebf30 --- trap 0xc, rip = 0x3891b0c284ba, rsp = 0x3891af453cd8, rbp = 0x3891af453cf0 --- Tracing command ftcleanup pid 42293 tid 101501 td 0xfffff8032eeb5000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108893da0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108893dc0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108893e00 _sleep() at _sleep+0x2d8/frame 0xfffffe0108893ea0 fasttrap_pid_cleanup_cb() at fasttrap_pid_cleanup_cb+0x26d/frame 0xfffffe0108893ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108893f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108893f30 --- trap 0xc, rip = 0x1d7fc95564ba, rsp = 0x1d7fc64a2ee8, rbp = 0x1d7fc64a2f00 --- Tracing command vmstat pid 67713 tid 377397 td 0xfffff80734f07740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108474a10 mi_switch() at mi_switch+0x170/frame 0xfffffe0108474a30 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108474a70 _sleep() at _sleep+0x2d8/frame 0xfffffe0108474b10 vm_wait_doms() at vm_wait_doms+0xe3/frame 0xfffffe0108474b40 pmap_allocpte_alloc() at pmap_allocpte_alloc+0x73/frame 0xfffffe0108474b70 pmap_enter() at pmap_enter+0x782/frame 0xfffffe0108474c30 vm_fault() at vm_fault+0x14cb/frame 0xfffffe0108474d60 vm_fault_trap() at vm_fault_trap+0x5d/frame 0xfffffe0108474da0 trap_pfault() at trap_pfault+0x21d/frame 0xfffffe0108474e10 trap() at trap+0x51d/frame 0xfffffe0108474f30 calltrap() at calltrap+0x8/frame 0xfffffe0108474f30 --- trap 0xc, rip = 0x3f78c9b24b90, rsp = 0x3f78c52737a0, rbp = 0x3f78c52739c0 --- Tracing command sh pid 67715 tid 398165 td 0xfffff802ef7a3740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe017c4b9a10 mi_switch() at mi_switch+0x170/frame 0xfffffe017c4b9a30 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe017c4b9a70 _sleep() at _sleep+0x2d8/frame 0xfffffe017c4b9b10 vm_wait_doms() at vm_wait_doms+0xe3/frame 0xfffffe017c4b9b40 pmap_allocpte_alloc() at pmap_allocpte_alloc+0x73/frame 0xfffffe017c4b9b70 pmap_enter() at pmap_enter+0x782/frame 0xfffffe017c4b9c30 vm_fault() at vm_fault+0x14cb/frame 0xfffffe017c4b9d60 vm_fault_trap() at vm_fault_trap+0x5d/frame 0xfffffe017c4b9da0 trap_pfault() at trap_pfault+0x21d/frame 0xfffffe017c4b9e10 trap() at trap+0x51d/frame 0xfffffe017c4b9f30 calltrap() at calltrap+0x8/frame 0xfffffe017c4b9f30 --- trap 0xc, rip = 0x24b5476c62d5, rsp = 0x24b545693fe8, rbp = 0x24b5456941d0 --- Tracing command swapoff pid 67745 tid 377558 td 0xfffff802dfd06000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01085c8a80 mi_switch() at mi_switch+0x170/frame 0xfffffe01085c8aa0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01085c8ae0 _sleep() at _sleep+0x2d8/frame 0xfffffe01085c8b80 vm_wait_doms() at vm_wait_doms+0xe3/frame 0xfffffe01085c8bb0 vm_domainset_iter_page() at vm_domainset_iter_page+0xad/frame 0xfffffe01085c8be0 vm_page_alloc() at vm_page_alloc+0x7b/frame 0xfffffe01085c8c50 swapoff_one() at swapoff_one+0x3e5/frame 0xfffffe01085c8d00 kern_swapoff() at kern_swapoff+0x1ab/frame 0xfffffe01085c8e00 amd64_syscall() at amd64_syscall+0x158/frame 0xfffffe01085c8f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01085c8f30 --- syscall (582, FreeBSD ELF64, swapoff), rip = 0x2d6ebcca53ba, rsp = 0x2d6ebc523ac8, rbp = 0x2d6ebc523c00 --- Tracing command watchdogd pid 67746 tid 377986 td 0xfffff802fbd47740 thread_exit() at thread_exit+0x1ea/frame 0xfffffe010882ad80 exit1() at exit1+0xe0f/frame 0xfffffe010882adf0 sys_exit() at sys_exit+0xd/frame 0xfffffe010882ae00 amd64_syscall() at amd64_syscall+0x158/frame 0xfffffe010882af30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010882af30 --- syscall (1, FreeBSD ELF64, exit), rip = 0x24b549d464ba, rsp = 0x24b545694cf8, rbp = 0x24b545694df0 --- Tracing command sh pid 92567 tid 403159 td 0xfffff80288dc3000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0201c40950 mi_switch() at mi_switch+0x170/frame 0xfffffe0201c40970 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0201c409b0 _sleep() at _sleep+0x2d8/frame 0xfffffe0201c40a50 vm_wait_doms() at vm_wait_doms+0xe3/frame 0xfffffe0201c40a80 pmap_allocpte_alloc() at pmap_allocpte_alloc+0x73/frame 0xfffffe0201c40ab0 pmap_enter() at pmap_enter+0x782/frame 0xfffffe0201c40b70 vm_fault() at vm_fault+0x14cb/frame 0xfffffe0201c40ca0 vm_fault_trap() at vm_fault_trap+0x5d/frame 0xfffffe0201c40ce0 trap_pfault() at trap_pfault+0x21d/frame 0xfffffe0201c40d50 calltrap() at calltrap+0x8/frame 0xfffffe0201c40d50 --- trap 0xc, rip = 0xffffffff8106f37d, rsp = 0xfffffe0201c40e20, rbp = 0xfffffe0201c40e20 --- fueword32_nosmap() at fueword32_nosmap+0x2d/frame 0xfffffe0201c40e20 ast_sig() at ast_sig+0x1ef/frame 0xfffffe0201c40ed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe0201c40f10 ast() at ast+0x20/frame 0xfffffe0201c40f30 doreti_ast() at doreti_ast+0x1c/frame 0x3f1a155c98b0 Tracing command sh pid 92569 tid 399177 td 0xfffff8015750d740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0203081950 mi_switch() at mi_switch+0x170/frame 0xfffffe0203081970 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe02030819b0 _sleep() at _sleep+0x2d8/frame 0xfffffe0203081a50 vm_wait_doms() at vm_wait_doms+0xe3/frame 0xfffffe0203081a80 pmap_allocpte_alloc() at pmap_allocpte_alloc+0x73/frame 0xfffffe0203081ab0 pmap_enter() at pmap_enter+0x782/frame 0xfffffe0203081b70 vm_fault() at vm_fault+0x14cb/frame 0xfffffe0203081ca0 vm_fault_trap() at vm_fault_trap+0x5d/frame 0xfffffe0203081ce0 trap_pfault() at trap_pfault+0x21d/frame 0xfffffe0203081d50 calltrap() at calltrap+0x8/frame 0xfffffe0203081d50 --- trap 0xc, rip = 0xffffffff8106f37d, rsp = 0xfffffe0203081e20, rbp = 0xfffffe0203081e20 --- fueword32_nosmap() at fueword32_nosmap+0x2d/frame 0xfffffe0203081e20 ast_sig() at ast_sig+0x1ef/frame 0xfffffe0203081ed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe0203081f10 ast() at ast+0x20/frame 0xfffffe0203081f30 doreti_ast() at doreti_ast+0x1c/frame 0xc37d3878d0 Tracing command sh pid 27685 tid 366042 td 0xfffff802aa2f7000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01089ec640 mi_switch() at mi_switch+0x170/frame 0xfffffe01089ec660 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01089ec6a0 _vm_page_busy_sleep() at _vm_page_busy_sleep+0x10f/frame 0xfffffe01089ec6f0 vm_object_collapse_scan_wait() at vm_object_collapse_scan_wait+0x114/frame 0xfffffe01089ec730 vm_object_collapse() at vm_object_collapse+0x36b/frame 0xfffffe01089ec7b0 vm_object_deallocate() at vm_object_deallocate+0x333/frame 0xfffffe01089ec7e0 vm_map_process_deferred() at vm_map_process_deferred+0xa9/frame 0xfffffe01089ec800 vm_map_remove() at vm_map_remove+0xed/frame 0xfffffe01089ec830 vmspace_exit() at vmspace_exit+0xa8/frame 0xfffffe01089ec860 exit1() at exit1+0x533/frame 0xfffffe01089ec8d0 sigexit() at sigexit+0x171/frame 0xfffffe01089ecd50 postsig() at postsig+0x1a5/frame 0xfffffe01089ece20 ast_sig() at ast_sig+0x33b/frame 0xfffffe01089eced0 ast_handler() at ast_handler+0xe8/frame 0xfffffe01089ecf10 ast() at ast+0x20/frame 0xfffffe01089ecf30 doreti_ast() at doreti_ast+0x1c/frame 0xe2b85daf000 Tracing command sh pid 27709 tid 376905 td 0xfffff801597ee000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01ee393740 mi_switch() at mi_switch+0x170/frame 0xfffffe01ee393760 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01ee3937a0 _sleep() at _sleep+0x2d8/frame 0xfffffe01ee393840 vm_wait_doms() at vm_wait_doms+0xe3/frame 0xfffffe01ee393870 pmap_allocpte_alloc() at pmap_allocpte_alloc+0x73/frame 0xfffffe01ee3938a0 pmap_enter() at pmap_enter+0x782/frame 0xfffffe01ee393960 vm_fault() at vm_fault+0x14cb/frame 0xfffffe01ee393a90 vm_fault_trap() at vm_fault_trap+0x5d/frame 0xfffffe01ee393ad0 trap_pfault() at trap_pfault+0x21d/frame 0xfffffe01ee393b40 calltrap() at calltrap+0x8/frame 0xfffffe01ee393b40 --- trap 0xc, rip = 0xffffffff8106e77c, rsp = 0xfffffe01ee393c10, rbp = 0xfffffe01ee393c10 --- copyout_nosmap_erms() at copyout_nosmap_erms+0xfc/frame 0xfffffe01ee393c10 sys_wait4() at sys_wait4+0xb3/frame 0xfffffe01ee393e00 amd64_syscall() at amd64_syscall+0x158/frame 0xfffffe01ee393f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01ee393f30 --- syscall (7, FreeBSD ELF64, wait4), rip = 0xe2b88e3099a, rsp = 0xe2b85daec48, rbp = 0xe2b85daecf0 --- Tracing command pkg pid 27710 tid 100254 td 0xfffff80013222000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108447950 mi_switch() at mi_switch+0x170/frame 0xfffffe0108447970 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01084479b0 _sleep() at _sleep+0x2d8/frame 0xfffffe0108447a50 vm_wait_doms() at vm_wait_doms+0xe3/frame 0xfffffe0108447a80 pmap_allocpte_alloc() at pmap_allocpte_alloc+0x73/frame 0xfffffe0108447ab0 pmap_enter() at pmap_enter+0x782/frame 0xfffffe0108447b70 vm_fault() at vm_fault+0x14cb/frame 0xfffffe0108447ca0 vm_fault_trap() at vm_fault_trap+0x5d/frame 0xfffffe0108447ce0 trap_pfault() at trap_pfault+0x21d/frame 0xfffffe0108447d50 calltrap() at calltrap+0x8/frame 0xfffffe0108447d50 --- trap 0xc, rip = 0xffffffff8106f37d, rsp = 0xfffffe0108447e20, rbp = 0xfffffe0108447e20 --- fueword32_nosmap() at fueword32_nosmap+0x2d/frame 0xfffffe0108447e20 ast_sig() at ast_sig+0x1ef/frame 0xfffffe0108447ed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe0108447f10 ast() at ast+0x20/frame 0xfffffe0108447f30 doreti_ast() at doreti_ast+0x1c/frame 0x8213f5540 Tracing command sed pid 27712 tid 377871 td 0xfffff8081ef40740 thread_exit() at thread_exit+0x1ea/frame 0xfffffe010878a860 exit1() at exit1+0xe0f/frame 0xfffffe010878a8d0 sigexit() at sigexit+0x171/frame 0xfffffe010878ad50 postsig() at postsig+0x1a5/frame 0xfffffe010878ae20 ast_sig() at ast_sig+0x33b/frame 0xfffffe010878aed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe010878af10 ast() at ast+0x20/frame 0xfffffe010878af30 doreti_ast() at doreti_ast+0x1c/frame 0x39962138b380 Tracing command tee pid 27714 tid 398167 td 0xfffff802ef7a3000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe017c4c3a10 mi_switch() at mi_switch+0x170/frame 0xfffffe017c4c3a30 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe017c4c3a70 _sleep() at _sleep+0x2d8/frame 0xfffffe017c4c3b10 vm_wait_doms() at vm_wait_doms+0xe3/frame 0xfffffe017c4c3b40 pmap_allocpte_alloc() at pmap_allocpte_alloc+0x73/frame 0xfffffe017c4c3b70 pmap_enter() at pmap_enter+0x782/frame 0xfffffe017c4c3c30 vm_fault() at vm_fault+0x14cb/frame 0xfffffe017c4c3d60 vm_fault_trap() at vm_fault_trap+0x5d/frame 0xfffffe017c4c3da0 trap_pfault() at trap_pfault+0x21d/frame 0xfffffe017c4c3e10 trap() at trap+0x51d/frame 0xfffffe017c4c3f30 calltrap() at calltrap+0x8/frame 0xfffffe017c4c3f30 --- trap 0xc, rip = 0x1b02643807c0, rsp = 0x1b026319fd58, rbp = 0x1b026319fdb0 --- Tracing command pkg pid 27720 tid 376976 td 0xfffff80396625000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108654430 mi_switch() at mi_switch+0x170/frame 0xfffffe0108654450 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108654490 _sleep() at _sleep+0x2d8/frame 0xfffffe0108654530 vm_wait_doms() at vm_wait_doms+0xe3/frame 0xfffffe0108654560 vm_domainset_iter_page() at vm_domainset_iter_page+0xad/frame 0xfffffe0108654590 vm_page_grab_pages() at vm_page_grab_pages+0x21c/frame 0xfffffe0108654640 vm_page_grab_pages_unlocked() at vm_page_grab_pages_unlocked+0x1c9/frame 0xfffffe01086546b0 allocbuf() at allocbuf+0x32f/frame 0xfffffe0108654720 getblkx() at getblkx+0x779/frame 0xfffffe01086547d0 getblk() at getblk+0x22/frame 0xfffffe0108654800 cluster_rbuild() at cluster_rbuild+0x279/frame 0xfffffe01086548b0 cluster_read() at cluster_read+0x623/frame 0xfffffe01086549b0 ffs_read() at ffs_read+0x1df/frame 0xfffffe0108654a60 VOP_READ_APV() at VOP_READ_APV+0x5d/frame 0xfffffe0108654a90 vn_read() at vn_read+0x237/frame 0xfffffe0108654b10 vn_io_fault_doio() at vn_io_fault_doio+0x45/frame 0xfffffe0108654b70 vn_io_fault1() at vn_io_fault1+0x15e/frame 0xfffffe0108654cb0 vn_io_fault() at vn_io_fault+0x158/frame 0xfffffe0108654d40 dofileread() at dofileread+0x80/frame 0xfffffe0108654d90 sys_read() at sys_read+0xb7/frame 0xfffffe0108654e00 amd64_syscall() at amd64_syscall+0x158/frame 0xfffffe0108654f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0108654f30 --- syscall (3, FreeBSD ELF64, read), rip = 0x82c2f07ba, rsp = 0x8213f2be8, rbp = 0x8213f2c10 --- Tracing command dhclient pid 3211 tid 100234 td 0xfffff80007e95000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108433950 mi_switch() at mi_switch+0x170/frame 0xfffffe0108433970 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01084339b0 _sleep() at _sleep+0x2d8/frame 0xfffffe0108433a50 vm_wait_doms() at vm_wait_doms+0xe3/frame 0xfffffe0108433a80 pmap_allocpte_alloc() at pmap_allocpte_alloc+0x73/frame 0xfffffe0108433ab0 pmap_enter() at pmap_enter+0x782/frame 0xfffffe0108433b70 vm_fault() at vm_fault+0x14cb/frame 0xfffffe0108433ca0 vm_fault_trap() at vm_fault_trap+0x5d/frame 0xfffffe0108433ce0 trap_pfault() at trap_pfault+0x21d/frame 0xfffffe0108433d50 calltrap() at calltrap+0x8/frame 0xfffffe0108433d50 --- trap 0xc, rip = 0xffffffff8106f37d, rsp = 0xfffffe0108433e20, rbp = 0xfffffe0108433e20 --- fueword32_nosmap() at fueword32_nosmap+0x2d/frame 0xfffffe0108433e20 ast_sig() at ast_sig+0x1ef/frame 0xfffffe0108433ed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe0108433f10 ast() at ast+0x20/frame 0xfffffe0108433f30 doreti_ast() at doreti_ast+0x1c/frame 0xb6b229cf5b0 Tracing command dhclient pid 3214 tid 100229 td 0xfffff800132df740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010847e950 mi_switch() at mi_switch+0x170/frame 0xfffffe010847e970 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010847e9b0 _sleep() at _sleep+0x2d8/frame 0xfffffe010847ea50 vm_wait_doms() at vm_wait_doms+0xe3/frame 0xfffffe010847ea80 pmap_allocpte_alloc() at pmap_allocpte_alloc+0x73/frame 0xfffffe010847eab0 pmap_enter() at pmap_enter+0x782/frame 0xfffffe010847eb70 vm_fault() at vm_fault+0x14cb/frame 0xfffffe010847eca0 vm_fault_trap() at vm_fault_trap+0x5d/frame 0xfffffe010847ece0 trap_pfault() at trap_pfault+0x21d/frame 0xfffffe010847ed50 calltrap() at calltrap+0x8/frame 0xfffffe010847ed50 --- trap 0xc, rip = 0xffffffff8106f37d, rsp = 0xfffffe010847ee20, rbp = 0xfffffe010847ee20 --- fueword32_nosmap() at fueword32_nosmap+0x2d/frame 0xfffffe010847ee20 ast_sig() at ast_sig+0x1ef/frame 0xfffffe010847eed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe010847ef10 ast() at ast+0x20/frame 0xfffffe010847ef30 doreti_ast() at doreti_ast+0x1c/frame 0xb6b229cf770 Tracing command dhclient pid 3273 tid 100255 td 0xfffff80007a79000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01083d9a10 mi_switch() at mi_switch+0x170/frame 0xfffffe01083d9a30 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01083d9a70 _sleep() at _sleep+0x2d8/frame 0xfffffe01083d9b10 vm_wait_doms() at vm_wait_doms+0xe3/frame 0xfffffe01083d9b40 pmap_allocpte_alloc() at pmap_allocpte_alloc+0x73/frame 0xfffffe01083d9b70 pmap_enter() at pmap_enter+0x782/frame 0xfffffe01083d9c30 vm_fault() at vm_fault+0x14cb/frame 0xfffffe01083d9d60 vm_fault_trap() at vm_fault_trap+0x5d/frame 0xfffffe01083d9da0 trap_pfault() at trap_pfault+0x21d/frame 0xfffffe01083d9e10 trap() at trap+0x51d/frame 0xfffffe01083d9f30 calltrap() at calltrap+0x8/frame 0xfffffe01083d9f30 --- trap 0xc, rip = 0xb630284a395, rsp = 0xb6b229cf740, rbp = 0xb6b229cf770 --- Tracing command devd pid 3288 tid 100278 td 0xfffff80012cbf000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108465950 mi_switch() at mi_switch+0x170/frame 0xfffffe0108465970 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01084659b0 _sleep() at _sleep+0x2d8/frame 0xfffffe0108465a50 vm_wait_doms() at vm_wait_doms+0xe3/frame 0xfffffe0108465a80 pmap_allocpte_alloc() at pmap_allocpte_alloc+0x73/frame 0xfffffe0108465ab0 pmap_enter() at pmap_enter+0x782/frame 0xfffffe0108465b70 vm_fault() at vm_fault+0x14cb/frame 0xfffffe0108465ca0 vm_fault_trap() at vm_fault_trap+0x5d/frame 0xfffffe0108465ce0 trap_pfault() at trap_pfault+0x21d/frame 0xfffffe0108465d50 calltrap() at calltrap+0x8/frame 0xfffffe0108465d50 --- trap 0xc, rip = 0xffffffff8106f37d, rsp = 0xfffffe0108465e20, rbp = 0xfffffe0108465e20 --- fueword32_nosmap() at fueword32_nosmap+0x2d/frame 0xfffffe0108465e20 ast_sig() at ast_sig+0x1ef/frame 0xfffffe0108465ed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe0108465f10 ast() at ast+0x20/frame 0xfffffe0108465f30 doreti_ast() at doreti_ast+0x1c/frame 0x28fc45f7f930 Tracing command syslogd pid 3436 tid 100310 td 0xfffff80013c4b000 --- swapped out Tracing command watchdogd pid 3453 tid 100298 td 0xfffff80012d2f000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010855fb10 mi_switch() at mi_switch+0x170/frame 0xfffffe010855fb30 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010855fb70 _sleep() at _sleep+0x2d8/frame 0xfffffe010855fc10 vm_wait_doms() at vm_wait_doms+0xe3/frame 0xfffffe010855fc40 vm_forkproc() at vm_forkproc+0xaa/frame 0xfffffe010855fc90 do_fork() at do_fork+0xcf8/frame 0xfffffe010855fd30 fork1() at fork1+0x70a/frame 0xfffffe010855fda0 sys_vfork() at sys_vfork+0x54/frame 0xfffffe010855fe00 amd64_syscall() at amd64_syscall+0x158/frame 0xfffffe010855ff30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010855ff30 --- syscall (66, FreeBSD ELF64, vfork), rip = 0x3bb8d5914ab, rsp = 0x3bb8c520a10, rbp = 0x3bb8c520ad0 --- Tracing command powerd pid 3568 tid 100269 td 0xfffff80013223740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010851e950 mi_switch() at mi_switch+0x170/frame 0xfffffe010851e970 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010851e9b0 _sleep() at _sleep+0x2d8/frame 0xfffffe010851ea50 vm_wait_doms() at vm_wait_doms+0xe3/frame 0xfffffe010851ea80 pmap_allocpte_alloc() at pmap_allocpte_alloc+0x73/frame 0xfffffe010851eab0 pmap_enter() at pmap_enter+0x782/frame 0xfffffe010851eb70 vm_fault() at vm_fault+0x14cb/frame 0xfffffe010851eca0 vm_fault_trap() at vm_fault_trap+0x5d/frame 0xfffffe010851ece0 trap_pfault() at trap_pfault+0x21d/frame 0xfffffe010851ed50 calltrap() at calltrap+0x8/frame 0xfffffe010851ed50 --- trap 0xc, rip = 0xffffffff8106f37d, rsp = 0xfffffe010851ee20, rbp = 0xfffffe010851ee20 --- fueword32_nosmap() at fueword32_nosmap+0x2d/frame 0xfffffe010851ee20 ast_sig() at ast_sig+0x1ef/frame 0xfffffe010851eed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe010851ef10 ast() at ast+0x20/frame 0xfffffe010851ef30 doreti_ast() at doreti_ast+0x1c/frame 0x1f704b56dee0 Tracing command inetd pid 3589 tid 100264 td 0xfffff80013da1000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01084fba90 mi_switch() at mi_switch+0x170/frame 0xfffffe01084fbab0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01084fbaf0 sleepq_catch_signals() at sleepq_catch_signals+0x282/frame 0xfffffe01084fbb50 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01084fbb60 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe01084fbbd0 kern_select() at kern_select+0xa29/frame 0xfffffe01084fbdc0 sys_select() at sys_select+0x57/frame 0xfffffe01084fbe00 amd64_syscall() at amd64_syscall+0x158/frame 0xfffffe01084fbf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01084fbf30 --- syscall (93, FreeBSD ELF64, select), rip = 0x27093b17f83a, rsp = 0x270936e9acf8, rbp = 0x270936e9bb80 --- Tracing command cron pid 3594 tid 100343 td 0xfffff80007a7b740 --- swapped out Tracing command sshd pid 3611 tid 100274 td 0xfffff80040639740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108528a90 mi_switch() at mi_switch+0x170/frame 0xfffffe0108528ab0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108528af0 sleepq_catch_signals() at sleepq_catch_signals+0x282/frame 0xfffffe0108528b50 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0108528b60 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe0108528bd0 kern_poll_kfds() at kern_poll_kfds+0x4cc/frame 0xfffffe0108528c60 kern_poll() at kern_poll+0x9d/frame 0xfffffe0108528db0 sys_ppoll() at sys_ppoll+0x70/frame 0xfffffe0108528e00 amd64_syscall() at amd64_syscall+0x158/frame 0xfffffe0108528f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0108528f30 --- syscall (545, FreeBSD ELF64, ppoll), rip = 0x875556c675a, rsp = 0x875472bb938, rbp = 0x875472bb970 --- Tracing command getty pid 3625 tid 100212 td 0xfffff80003e86740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108438950 mi_switch() at mi_switch+0x170/frame 0xfffffe0108438970 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01084389b0 _sleep() at _sleep+0x2d8/frame 0xfffffe0108438a50 vm_wait_doms() at vm_wait_doms+0xe3/frame 0xfffffe0108438a80 pmap_allocpte_alloc() at pmap_allocpte_alloc+0x73/frame 0xfffffe0108438ab0 pmap_enter() at pmap_enter+0x782/frame 0xfffffe0108438b70 vm_fault() at vm_fault+0x14cb/frame 0xfffffe0108438ca0 vm_fault_trap() at vm_fault_trap+0x5d/frame 0xfffffe0108438ce0 trap_pfault() at trap_pfault+0x21d/frame 0xfffffe0108438d50 calltrap() at calltrap+0x8/frame 0xfffffe0108438d50 --- trap 0xc, rip = 0xffffffff8106f37d, rsp = 0xfffffe0108438e20, rbp = 0xfffffe0108438e20 --- fueword32_nosmap() at fueword32_nosmap+0x2d/frame 0xfffffe0108438e20 ast_sig() at ast_sig+0x1ef/frame 0xfffffe0108438ed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe0108438f10 ast() at ast+0x20/frame 0xfffffe0108438f30 doreti_ast() at doreti_ast+0x1c/frame 0x28d20622d5a0 Tracing command getty pid 3626 tid 100232 td 0xfffff8015e778740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010846a950 mi_switch() at mi_switch+0x170/frame 0xfffffe010846a970 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010846a9b0 _sleep() at _sleep+0x2d8/frame 0xfffffe010846aa50 vm_wait_doms() at vm_wait_doms+0xe3/frame 0xfffffe010846aa80 pmap_allocpte_alloc() at pmap_allocpte_alloc+0x73/frame 0xfffffe010846aab0 pmap_enter() at pmap_enter+0x782/frame 0xfffffe010846ab70 vm_fault() at vm_fault+0x14cb/frame 0xfffffe010846aca0 vm_fault_trap() at vm_fault_trap+0x5d/frame 0xfffffe010846ace0 trap_pfault() at trap_pfault+0x21d/frame 0xfffffe010846ad50 calltrap() at calltrap+0x8/frame 0xfffffe010846ad50 --- trap 0xc, rip = 0xffffffff8106f37d, rsp = 0xfffffe010846ae20, rbp = 0xfffffe010846ae20 --- fueword32_nosmap() at fueword32_nosmap+0x2d/frame 0xfffffe010846ae20 ast_sig() at ast_sig+0x1ef/frame 0xfffffe010846aed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe010846af10 ast() at ast+0x20/frame 0xfffffe010846af30 doreti_ast() at doreti_ast+0x1c/frame 0x26a6f75e9f30 Tracing command getty pid 3627 tid 100346 td 0xfffff8004000f000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01084f1950 mi_switch() at mi_switch+0x170/frame 0xfffffe01084f1970 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01084f19b0 _sleep() at _sleep+0x2d8/frame 0xfffffe01084f1a50 vm_wait_doms() at vm_wait_doms+0xe3/frame 0xfffffe01084f1a80 pmap_allocpte_alloc() at pmap_allocpte_alloc+0x73/frame 0xfffffe01084f1ab0 pmap_enter() at pmap_enter+0x782/frame 0xfffffe01084f1b70 vm_fault() at vm_fault+0x14cb/frame 0xfffffe01084f1ca0 vm_fault_trap() at vm_fault_trap+0x5d/frame 0xfffffe01084f1ce0 trap_pfault() at trap_pfault+0x21d/frame 0xfffffe01084f1d50 calltrap() at calltrap+0x8/frame 0xfffffe01084f1d50 --- trap 0xc, rip = 0xffffffff8106f37d, rsp = 0xfffffe01084f1e20, rbp = 0xfffffe01084f1e20 --- fueword32_nosmap() at fueword32_nosmap+0x2d/frame 0xfffffe01084f1e20 ast_sig() at ast_sig+0x1ef/frame 0xfffffe01084f1ed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe01084f1f10 ast() at ast+0x20/frame 0xfffffe01084f1f30 doreti_ast() at doreti_ast+0x1c/frame 0xe8f7a66ba30 Tracing command getty pid 3628 tid 100347 td 0xfffff8004084a000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108569950 mi_switch() at mi_switch+0x170/frame 0xfffffe0108569970 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01085699b0 _sleep() at _sleep+0x2d8/frame 0xfffffe0108569a50 vm_wait_doms() at vm_wait_doms+0xe3/frame 0xfffffe0108569a80 pmap_allocpte_alloc() at pmap_allocpte_alloc+0x73/frame 0xfffffe0108569ab0 pmap_enter() at pmap_enter+0x782/frame 0xfffffe0108569b70 vm_fault() at vm_fault+0x14cb/frame 0xfffffe0108569ca0 vm_fault_trap() at vm_fault_trap+0x5d/frame 0xfffffe0108569ce0 trap_pfault() at trap_pfault+0x21d/frame 0xfffffe0108569d50 calltrap() at calltrap+0x8/frame 0xfffffe0108569d50 --- trap 0xc, rip = 0xffffffff8106f37d, rsp = 0xfffffe0108569e20, rbp = 0xfffffe0108569e20 --- fueword32_nosmap() at fueword32_nosmap+0x2d/frame 0xfffffe0108569e20 ast_sig() at ast_sig+0x1ef/frame 0xfffffe0108569ed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe0108569f10 ast() at ast+0x20/frame 0xfffffe0108569f30 doreti_ast() at doreti_ast+0x1c/frame 0x54ea4a06810 Tracing command getty pid 3629 tid 100348 td 0xfffff80012cbe000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010859b950 mi_switch() at mi_switch+0x170/frame 0xfffffe010859b970 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010859b9b0 _sleep() at _sleep+0x2d8/frame 0xfffffe010859ba50 vm_wait_doms() at vm_wait_doms+0xe3/frame 0xfffffe010859ba80 pmap_allocpte_alloc() at pmap_allocpte_alloc+0x73/frame 0xfffffe010859bab0 pmap_enter() at pmap_enter+0x782/frame 0xfffffe010859bb70 vm_fault() at vm_fault+0x14cb/frame 0xfffffe010859bca0 vm_fault_trap() at vm_fault_trap+0x5d/frame 0xfffffe010859bce0 trap_pfault() at trap_pfault+0x21d/frame 0xfffffe010859bd50 calltrap() at calltrap+0x8/frame 0xfffffe010859bd50 --- trap 0xc, rip = 0xffffffff8106f37d, rsp = 0xfffffe010859be20, rbp = 0xfffffe010859be20 --- fueword32_nosmap() at fueword32_nosmap+0x2d/frame 0xfffffe010859be20 ast_sig() at ast_sig+0x1ef/frame 0xfffffe010859bed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe010859bf10 ast() at ast+0x20/frame 0xfffffe010859bf30 doreti_ast() at doreti_ast+0x1c/frame 0x21afbc21b180 Tracing command getty pid 3630 tid 100349 td 0xfffff80107c00740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01085b4950 mi_switch() at mi_switch+0x170/frame 0xfffffe01085b4970 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01085b49b0 _sleep() at _sleep+0x2d8/frame 0xfffffe01085b4a50 vm_wait_doms() at vm_wait_doms+0xe3/frame 0xfffffe01085b4a80 pmap_allocpte_alloc() at pmap_allocpte_alloc+0x73/frame 0xfffffe01085b4ab0 pmap_enter() at pmap_enter+0x782/frame 0xfffffe01085b4b70 vm_fault() at vm_fault+0x14cb/frame 0xfffffe01085b4ca0 vm_fault_trap() at vm_fault_trap+0x5d/frame 0xfffffe01085b4ce0 trap_pfault() at trap_pfault+0x21d/frame 0xfffffe01085b4d50 calltrap() at calltrap+0x8/frame 0xfffffe01085b4d50 --- trap 0xc, rip = 0xffffffff8106f37d, rsp = 0xfffffe01085b4e20, rbp = 0xfffffe01085b4e20 --- fueword32_nosmap() at fueword32_nosmap+0x2d/frame 0xfffffe01085b4e20 ast_sig() at ast_sig+0x1ef/frame 0xfffffe01085b4ed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe01085b4f10 ast() at ast+0x20/frame 0xfffffe01085b4f30 doreti_ast() at doreti_ast+0x1c/frame 0x3629f3015660 Tracing command getty pid 3631 tid 100350 td 0xfffff800135de000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01085e6950 mi_switch() at mi_switch+0x170/frame 0xfffffe01085e6970 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01085e69b0 _sleep() at _sleep+0x2d8/frame 0xfffffe01085e6a50 vm_wait_doms() at vm_wait_doms+0xe3/frame 0xfffffe01085e6a80 pmap_allocpte_alloc() at pmap_allocpte_alloc+0x73/frame 0xfffffe01085e6ab0 pmap_enter() at pmap_enter+0x782/frame 0xfffffe01085e6b70 vm_fault() at vm_fault+0x14cb/frame 0xfffffe01085e6ca0 vm_fault_trap() at vm_fault_trap+0x5d/frame 0xfffffe01085e6ce0 trap_pfault() at trap_pfault+0x21d/frame 0xfffffe01085e6d50 calltrap() at calltrap+0x8/frame 0xfffffe01085e6d50 --- trap 0xc, rip = 0xffffffff8106f37d, rsp = 0xfffffe01085e6e20, rbp = 0xfffffe01085e6e20 --- fueword32_nosmap() at fueword32_nosmap+0x2d/frame 0xfffffe01085e6e20 ast_sig() at ast_sig+0x1ef/frame 0xfffffe01085e6ed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe01085e6f10 ast() at ast+0x20/frame 0xfffffe01085e6f30 doreti_ast() at doreti_ast+0x1c/frame 0xde85be1d590 Tracing command getty pid 3632 tid 100351 td 0xfffff8004054f000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01085e1950 mi_switch() at mi_switch+0x170/frame 0xfffffe01085e1970 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01085e19b0 _sleep() at _sleep+0x2d8/frame 0xfffffe01085e1a50 vm_wait_doms() at vm_wait_doms+0xe3/frame 0xfffffe01085e1a80 pmap_allocpte_alloc() at pmap_allocpte_alloc+0x73/frame 0xfffffe01085e1ab0 pmap_enter() at pmap_enter+0x782/frame 0xfffffe01085e1b70 vm_fault() at vm_fault+0x14cb/frame 0xfffffe01085e1ca0 vm_fault_trap() at vm_fault_trap+0x5d/frame 0xfffffe01085e1ce0 trap_pfault() at trap_pfault+0x21d/frame 0xfffffe01085e1d50 calltrap() at calltrap+0x8/frame 0xfffffe01085e1d50 --- trap 0xc, rip = 0xffffffff8106f37d, rsp = 0xfffffe01085e1e20, rbp = 0xfffffe01085e1e20 --- fueword32_nosmap() at fueword32_nosmap+0x2d/frame 0xfffffe01085e1e20 ast_sig() at ast_sig+0x1ef/frame 0xfffffe01085e1ed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe01085e1f10 ast() at ast+0x20/frame 0xfffffe01085e1f30 doreti_ast() at doreti_ast+0x1c/frame 0x30156b7caee0 Tracing command getty pid 3633 tid 100352 td 0xfffff8004054f740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01085f0950 mi_switch() at mi_switch+0x170/frame 0xfffffe01085f0970 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01085f09b0 _sleep() at _sleep+0x2d8/frame 0xfffffe01085f0a50 vm_wait_doms() at vm_wait_doms+0xe3/frame 0xfffffe01085f0a80 pmap_allocpte_alloc() at pmap_allocpte_alloc+0x73/frame 0xfffffe01085f0ab0 pmap_enter() at pmap_enter+0x782/frame 0xfffffe01085f0b70 vm_fault() at vm_fault+0x14cb/frame 0xfffffe01085f0ca0 vm_fault_trap() at vm_fault_trap+0x5d/frame 0xfffffe01085f0ce0 trap_pfault() at trap_pfault+0x21d/frame 0xfffffe01085f0d50 calltrap() at calltrap+0x8/frame 0xfffffe01085f0d50 --- trap 0xc, rip = 0xffffffff8106f37d, rsp = 0xfffffe01085f0e20, rbp = 0xfffffe01085f0e20 --- fueword32_nosmap() at fueword32_nosmap+0x2d/frame 0xfffffe01085f0e20 ast_sig() at ast_sig+0x1ef/frame 0xfffffe01085f0ed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe01085f0f10 ast() at ast+0x20/frame 0xfffffe01085f0f30 doreti_ast() at doreti_ast+0x1c/frame 0x14e40adc1f40 Tracing command sshd pid 3693 tid 100252 td 0xfffff8004000e740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01084e2950 mi_switch() at mi_switch+0x170/frame 0xfffffe01084e2970 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01084e29b0 _sleep() at _sleep+0x2d8/frame 0xfffffe01084e2a50 vm_wait_doms() at vm_wait_doms+0xe3/frame 0xfffffe01084e2a80 pmap_allocpte_alloc() at pmap_allocpte_alloc+0x73/frame 0xfffffe01084e2ab0 pmap_enter() at pmap_enter+0x782/frame 0xfffffe01084e2b70 vm_fault() at vm_fault+0x14cb/frame 0xfffffe01084e2ca0 vm_fault_trap() at vm_fault_trap+0x5d/frame 0xfffffe01084e2ce0 trap_pfault() at trap_pfault+0x21d/frame 0xfffffe01084e2d50 calltrap() at calltrap+0x8/frame 0xfffffe01084e2d50 --- trap 0xc, rip = 0xffffffff8106f37d, rsp = 0xfffffe01084e2e20, rbp = 0xfffffe01084e2e20 --- fueword32_nosmap() at fueword32_nosmap+0x2d/frame 0xfffffe01084e2e20 ast_sig() at ast_sig+0x1ef/frame 0xfffffe01084e2ed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe01084e2f10 ast() at ast+0x20/frame 0xfffffe01084e2f30 doreti_ast() at doreti_ast+0x1c/frame 0x178c5c3e3fc0 Tracing command sshd pid 3696 tid 100296 td 0xfffff80013150740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108532950 mi_switch() at mi_switch+0x170/frame 0xfffffe0108532970 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01085329b0 _sleep() at _sleep+0x2d8/frame 0xfffffe0108532a50 vm_wait_doms() at vm_wait_doms+0xe3/frame 0xfffffe0108532a80 pmap_allocpte_alloc() at pmap_allocpte_alloc+0x73/frame 0xfffffe0108532ab0 pmap_enter() at pmap_enter+0x782/frame 0xfffffe0108532b70 vm_fault() at vm_fault+0x14cb/frame 0xfffffe0108532ca0 vm_fault_trap() at vm_fault_trap+0x5d/frame 0xfffffe0108532ce0 trap_pfault() at trap_pfault+0x21d/frame 0xfffffe0108532d50 calltrap() at calltrap+0x8/frame 0xfffffe0108532d50 --- trap 0xc, rip = 0xffffffff8106f37d, rsp = 0xfffffe0108532e20, rbp = 0xfffffe0108532e20 --- fueword32_nosmap() at fueword32_nosmap+0x2d/frame 0xfffffe0108532e20 ast_sig() at ast_sig+0x1ef/frame 0xfffffe0108532ed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe0108532f10 ast() at ast+0x20/frame 0xfffffe0108532f30 doreti_ast() at doreti_ast+0x1c/frame 0x178c5c3e3d80 Tracing command sh pid 3697 tid 100283 td 0xfffff800139f1000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108555950 mi_switch() at mi_switch+0x170/frame 0xfffffe0108555970 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01085559b0 _sleep() at _sleep+0x2d8/frame 0xfffffe0108555a50 vm_wait_doms() at vm_wait_doms+0xe3/frame 0xfffffe0108555a80 pmap_allocpte_alloc() at pmap_allocpte_alloc+0x73/frame 0xfffffe0108555ab0 pmap_enter() at pmap_enter+0x782/frame 0xfffffe0108555b70 vm_fault() at vm_fault+0x14cb/frame 0xfffffe0108555ca0 vm_fault_trap() at vm_fault_trap+0x5d/frame 0xfffffe0108555ce0 trap_pfault() at trap_pfault+0x21d/frame 0xfffffe0108555d50 calltrap() at calltrap+0x8/frame 0xfffffe0108555d50 --- trap 0xc, rip = 0xffffffff8106f37d, rsp = 0xfffffe0108555e20, rbp = 0xfffffe0108555e20 --- fueword32_nosmap() at fueword32_nosmap+0x2d/frame 0xfffffe0108555e20 ast_sig() at ast_sig+0x1ef/frame 0xfffffe0108555ed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe0108555f10 ast() at ast+0x20/frame 0xfffffe0108555f30 doreti_ast() at doreti_ast+0x1c/frame 0x23b0c3868e00 Tracing command su pid 3719 tid 100258 td 0xfffff800132dd740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108456950 mi_switch() at mi_switch+0x170/frame 0xfffffe0108456970 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01084569b0 _sleep() at _sleep+0x2d8/frame 0xfffffe0108456a50 vm_wait_doms() at vm_wait_doms+0xe3/frame 0xfffffe0108456a80 pmap_allocpte_alloc() at pmap_allocpte_alloc+0x73/frame 0xfffffe0108456ab0 pmap_enter() at pmap_enter+0x782/frame 0xfffffe0108456b70 vm_fault() at vm_fault+0x14cb/frame 0xfffffe0108456ca0 vm_fault_trap() at vm_fault_trap+0x5d/frame 0xfffffe0108456ce0 trap_pfault() at trap_pfault+0x21d/frame 0xfffffe0108456d50 calltrap() at calltrap+0x8/frame 0xfffffe0108456d50 --- trap 0xc, rip = 0xffffffff8106f37d, rsp = 0xfffffe0108456e20, rbp = 0xfffffe0108456e20 --- fueword32_nosmap() at fueword32_nosmap+0x2d/frame 0xfffffe0108456e20 ast_sig() at ast_sig+0x1ef/frame 0xfffffe0108456ed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe0108456f10 ast() at ast+0x20/frame 0xfffffe0108456f30 doreti_ast() at doreti_ast+0x1c/frame 0x12ad58d62e30 Tracing command sh pid 3720 tid 100359 td 0xfffff80007a7a000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01084e7950 mi_switch() at mi_switch+0x170/frame 0xfffffe01084e7970 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01084e79b0 _sleep() at _sleep+0x2d8/frame 0xfffffe01084e7a50 vm_wait_doms() at vm_wait_doms+0xe3/frame 0xfffffe01084e7a80 pmap_allocpte_alloc() at pmap_allocpte_alloc+0x73/frame 0xfffffe01084e7ab0 pmap_enter() at pmap_enter+0x782/frame 0xfffffe01084e7b70 vm_fault() at vm_fault+0x14cb/frame 0xfffffe01084e7ca0 vm_fault_trap() at vm_fault_trap+0x5d/frame 0xfffffe01084e7ce0 trap_pfault() at trap_pfault+0x21d/frame 0xfffffe01084e7d50 calltrap() at calltrap+0x8/frame 0xfffffe01084e7d50 --- trap 0xc, rip = 0xffffffff8106f37d, rsp = 0xfffffe01084e7e20, rbp = 0xfffffe01084e7e20 --- fueword32_nosmap() at fueword32_nosmap+0x2d/frame 0xfffffe01084e7e20 ast_sig() at ast_sig+0x1ef/frame 0xfffffe01084e7ed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe01084e7f10 ast() at ast+0x20/frame 0xfffffe01084e7f30 doreti_ast() at doreti_ast+0x1c/frame 0x3f442b8891c0 Tracing command bash pid 3721 tid 100213 td 0xfffff8015e8c2000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010841f950 mi_switch() at mi_switch+0x170/frame 0xfffffe010841f970 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010841f9b0 _sleep() at _sleep+0x2d8/frame 0xfffffe010841fa50 vm_wait_doms() at vm_wait_doms+0xe3/frame 0xfffffe010841fa80 pmap_allocpte_alloc() at pmap_allocpte_alloc+0x73/frame 0xfffffe010841fab0 pmap_enter() at pmap_enter+0x782/frame 0xfffffe010841fb70 vm_fault() at vm_fault+0x14cb/frame 0xfffffe010841fca0 vm_fault_trap() at vm_fault_trap+0x5d/frame 0xfffffe010841fce0 trap_pfault() at trap_pfault+0x21d/frame 0xfffffe010841fd50 calltrap() at calltrap+0x8/frame 0xfffffe010841fd50 --- trap 0xc, rip = 0xffffffff8106f37d, rsp = 0xfffffe010841fe20, rbp = 0xfffffe010841fe20 --- fueword32_nosmap() at fueword32_nosmap+0x2d/frame 0xfffffe010841fe20 ast_sig() at ast_sig+0x1ef/frame 0xfffffe010841fed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe010841ff10 ast() at ast+0x20/frame 0xfffffe010841ff30 doreti_ast() at doreti_ast+0x1c/frame 0x821139eb0 Tracing command sh pid 46737 tid 380570 td 0xfffff80303f3c000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01d2477740 mi_switch() at mi_switch+0x170/frame 0xfffffe01d2477760 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01d24777a0 _sleep() at _sleep+0x2d8/frame 0xfffffe01d2477840 vm_wait_doms() at vm_wait_doms+0xe3/frame 0xfffffe01d2477870 pmap_allocpte_alloc() at pmap_allocpte_alloc+0x73/frame 0xfffffe01d24778a0 pmap_enter() at pmap_enter+0x782/frame 0xfffffe01d2477960 vm_fault() at vm_fault+0x14cb/frame 0xfffffe01d2477a90 vm_fault_trap() at vm_fault_trap+0x5d/frame 0xfffffe01d2477ad0 trap_pfault() at trap_pfault+0x21d/frame 0xfffffe01d2477b40 calltrap() at calltrap+0x8/frame 0xfffffe01d2477b40 --- trap 0xc, rip = 0xffffffff8106e77c, rsp = 0xfffffe01d2477c10, rbp = 0xfffffe01d2477c10 --- copyout_nosmap_erms() at copyout_nosmap_erms+0xfc/frame 0xfffffe01d2477c10 sys_wait4() at sys_wait4+0xb3/frame 0xfffffe01d2477e00 amd64_syscall() at amd64_syscall+0x158/frame 0xfffffe01d2477f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01d2477f30 --- syscall (7, FreeBSD ELF64, wait4), rip = 0x3f1a18d2399a, rsp = 0x3f1a155c9b58, rbp = 0x3f1a155c9c00 --- Tracing command timeout pid 63811 tid 377189 td 0xfffff807a5fb3740 thread_exit() at thread_exit+0x1ea/frame 0xfffffe01ee30c740 exit1() at exit1+0xe0f/frame 0xfffffe01ee30c7b0 sigexit() at sigexit+0x171/frame 0xfffffe01ee30cc30 postsig() at postsig+0x1a5/frame 0xfffffe01ee30cd00 kern_sigsuspend() at kern_sigsuspend+0x24b/frame 0xfffffe01ee30cdd0 sys_sigsuspend() at sys_sigsuspend+0x31/frame 0xfffffe01ee30ce00 amd64_syscall() at amd64_syscall+0x158/frame 0xfffffe01ee30cf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01ee30cf30 --- syscall (4, FreeBSD ELF64, write), rip = 0x1e577696b8fa, rsp = 0x1e5774526bf8, rbp = 0x1e5774526e10 --- Tracing command sort pid 63817 tid 100991 td 0xfffff8032e040000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108622a10 mi_switch() at mi_switch+0x170/frame 0xfffffe0108622a30 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108622a70 _sleep() at _sleep+0x2d8/frame 0xfffffe0108622b10 vm_wait_doms() at vm_wait_doms+0xe3/frame 0xfffffe0108622b40 pmap_allocpte_alloc() at pmap_allocpte_alloc+0x73/frame 0xfffffe0108622b70 pmap_enter() at pmap_enter+0x782/frame 0xfffffe0108622c30 vm_fault() at vm_fault+0x14cb/frame 0xfffffe0108622d60 vm_fault_trap() at vm_fault_trap+0x5d/frame 0xfffffe0108622da0 trap_pfault() at trap_pfault+0x21d/frame 0xfffffe0108622e10 trap() at trap+0x51d/frame 0xfffffe0108622f30 calltrap() at calltrap+0x8/frame 0xfffffe0108622f30 --- trap 0xc, rip = 0x32f7d507f325, rsp = 0x32f7d27c10d8, rbp = 0x32f7d27c1120 --- Tracing command sh pid 14865 tid 100266 td 0xfffff8001314b740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010850a950 mi_switch() at mi_switch+0x170/frame 0xfffffe010850a970 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010850a9b0 _sleep() at _sleep+0x2d8/frame 0xfffffe010850aa50 vm_wait_doms() at vm_wait_doms+0xe3/frame 0xfffffe010850aa80 pmap_allocpte_alloc() at pmap_allocpte_alloc+0x73/frame 0xfffffe010850aab0 pmap_enter() at pmap_enter+0x782/frame 0xfffffe010850ab70 vm_fault() at vm_fault+0x14cb/frame 0xfffffe010850aca0 vm_fault_trap() at vm_fault_trap+0x5d/frame 0xfffffe010850ace0 trap_pfault() at trap_pfault+0x21d/frame 0xfffffe010850ad50 calltrap() at calltrap+0x8/frame 0xfffffe010850ad50 --- trap 0xc, rip = 0xffffffff8106f37d, rsp = 0xfffffe010850ae20, rbp = 0xfffffe010850ae20 --- fueword32_nosmap() at fueword32_nosmap+0x2d/frame 0xfffffe010850ae20 ast_sig() at ast_sig+0x1ef/frame 0xfffffe010850aed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe010850af10 ast() at ast+0x20/frame 0xfffffe010850af30 doreti_ast() at doreti_ast+0x1c/frame 0x24b545694cd0 Tracing command sh pid 14923 tid 100328 td 0xfffff800138ed000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010857d740 mi_switch() at mi_switch+0x170/frame 0xfffffe010857d760 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010857d7a0 _sleep() at _sleep+0x2d8/frame 0xfffffe010857d840 vm_wait_doms() at vm_wait_doms+0xe3/frame 0xfffffe010857d870 pmap_allocpte_alloc() at pmap_allocpte_alloc+0x73/frame 0xfffffe010857d8a0 pmap_enter() at pmap_enter+0x782/frame 0xfffffe010857d960 vm_fault() at vm_fault+0x14cb/frame 0xfffffe010857da90 vm_fault_trap() at vm_fault_trap+0x5d/frame 0xfffffe010857dad0 trap_pfault() at trap_pfault+0x21d/frame 0xfffffe010857db40 calltrap() at calltrap+0x8/frame 0xfffffe010857db40 --- trap 0xc, rip = 0xffffffff8106e77c, rsp = 0xfffffe010857dc10, rbp = 0xfffffe010857dc10 --- copyout_nosmap_erms() at copyout_nosmap_erms+0xfc/frame 0xfffffe010857dc10 sys_wait4() at sys_wait4+0xb3/frame 0xfffffe010857de00 amd64_syscall() at amd64_syscall+0x158/frame 0xfffffe010857df30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010857df30 --- syscall (7, FreeBSD ELF64, wait4), rip = 0x24b549d4699a, rsp = 0x24b545694a78, rbp = 0x24b545694b20 --- Tracing command awk pid 14924 tid 100387 td 0xfffff80301198000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010866d950 mi_switch() at mi_switch+0x170/frame 0xfffffe010866d970 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010866d9b0 _sleep() at _sleep+0x2d8/frame 0xfffffe010866da50 vm_wait_doms() at vm_wait_doms+0xe3/frame 0xfffffe010866da80 pmap_allocpte_alloc() at pmap_allocpte_alloc+0x73/frame 0xfffffe010866dab0 pmap_enter() at pmap_enter+0x782/frame 0xfffffe010866db70 vm_fault() at vm_fault+0x14cb/frame 0xfffffe010866dca0 vm_fault_trap() at vm_fault_trap+0x5d/frame 0xfffffe010866dce0 trap_pfault() at trap_pfault+0x21d/frame 0xfffffe010866dd50 calltrap() at calltrap+0x8/frame 0xfffffe010866dd50 --- trap 0xc, rip = 0xffffffff8106f37d, rsp = 0xfffffe010866de20, rbp = 0xfffffe010866de20 --- fueword32_nosmap() at fueword32_nosmap+0x2d/frame 0xfffffe010866de20 ast_sig() at ast_sig+0x1ef/frame 0xfffffe010866ded0 ast_handler() at ast_handler+0xe8/frame 0xfffffe010866df10 ast() at ast+0x20/frame 0xfffffe010866df30 doreti_ast() at doreti_ast+0x1c/frame 0xb353a72cd0 Tracing command sh pid 14926 tid 100386 td 0xfffff803011af740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010864a950 mi_switch() at mi_switch+0x170/frame 0xfffffe010864a970 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010864a9b0 _sleep() at _sleep+0x2d8/frame 0xfffffe010864aa50 vm_wait_doms() at vm_wait_doms+0xe3/frame 0xfffffe010864aa80 pmap_allocpte_alloc() at pmap_allocpte_alloc+0x73/frame 0xfffffe010864aab0 pmap_enter() at pmap_enter+0x782/frame 0xfffffe010864ab70 vm_fault() at vm_fault+0x14cb/frame 0xfffffe010864aca0 vm_fault_trap() at vm_fault_trap+0x5d/frame 0xfffffe010864ace0 trap_pfault() at trap_pfault+0x21d/frame 0xfffffe010864ad50 calltrap() at calltrap+0x8/frame 0xfffffe010864ad50 --- trap 0xc, rip = 0xffffffff8106f37d, rsp = 0xfffffe010864ae20, rbp = 0xfffffe010864ae20 --- fueword32_nosmap() at fueword32_nosmap+0x2d/frame 0xfffffe010864ae20 ast_sig() at ast_sig+0x1ef/frame 0xfffffe010864aed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe010864af10 ast() at ast+0x20/frame 0xfffffe010864af30 doreti_ast() at doreti_ast+0x1c/frame 0x24b545694a50 Tracing command timeout pid 64257 tid 377196 td 0xfffff80500226000 thread_exit() at thread_exit+0x1ea/frame 0xfffffe017fcae740 exit1() at exit1+0xe0f/frame 0xfffffe017fcae7b0 sigexit() at sigexit+0x171/frame 0xfffffe017fcaec30 postsig() at postsig+0x1a5/frame 0xfffffe017fcaed00 kern_sigsuspend() at kern_sigsuspend+0x24b/frame 0xfffffe017fcaedd0 sys_sigsuspend() at sys_sigsuspend+0x31/frame 0xfffffe017fcaee00 amd64_syscall() at amd64_syscall+0x158/frame 0xfffffe017fcaef30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe017fcaef30 --- syscall (4, FreeBSD ELF64, write), rip = 0x229954c48fa, rsp = 0x22992480ce8, rbp = 0x22992480f00 --- Tracing command sort pid 64260 tid 101479 td 0xfffff8032582e000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108825a10 mi_switch() at mi_switch+0x170/frame 0xfffffe0108825a30 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108825a70 _sleep() at _sleep+0x2d8/frame 0xfffffe0108825b10 vm_wait_doms() at vm_wait_doms+0xe3/frame 0xfffffe0108825b40 pmap_allocpte_alloc() at pmap_allocpte_alloc+0x73/frame 0xfffffe0108825b70 pmap_enter() at pmap_enter+0x782/frame 0xfffffe0108825c30 vm_fault() at vm_fault+0x14cb/frame 0xfffffe0108825d60 vm_fault_trap() at vm_fault_trap+0x5d/frame 0xfffffe0108825da0 trap_pfault() at trap_pfault+0x21d/frame 0xfffffe0108825e10 trap() at trap+0x51d/frame 0xfffffe0108825f30 calltrap() at calltrap+0x8/frame 0xfffffe0108825f30 --- trap 0xc, rip = 0x1d0973c1b325, rsp = 0x1d0971a11e18, rbp = 0x1d0971a11e60 --- Tracing command aiod1 pid 7927 tid 100260 td 0xfffff8004000f740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01084f6d60 mi_switch() at mi_switch+0x170/frame 0xfffffe01084f6d80 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01084f6dc0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe01084f6e00 _sleep() at _sleep+0x27e/frame 0xfffffe01084f6ea0 aio_daemon() at aio_daemon+0x31a/frame 0xfffffe01084f6ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01084f6f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01084f6f30 --- trap 0xc, rip = 0xd07423004ba, rsp = 0xd0741127ff8, rbp = 0xd0741128010 --- Tracing command aiod2 pid 7928 tid 106742 td 0xfffff802aa3f3000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01dc09ed60 mi_switch() at mi_switch+0x170/frame 0xfffffe01dc09ed80 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01dc09edc0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe01dc09ee00 _sleep() at _sleep+0x27e/frame 0xfffffe01dc09eea0 aio_daemon() at aio_daemon+0x31a/frame 0xfffffe01dc09eef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01dc09ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01dc09ef30 --- trap 0xc, rip = 0x1565c1eda4ba, rsp = 0x1565be2aedf8, rbp = 0x1565be2aee10 --- Tracing command aiod3 pid 7929 tid 106740 td 0xfffff802aa3f2000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01dc094d60 mi_switch() at mi_switch+0x170/frame 0xfffffe01dc094d80 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01dc094dc0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe01dc094e00 _sleep() at _sleep+0x27e/frame 0xfffffe01dc094ea0 aio_daemon() at aio_daemon+0x31a/frame 0xfffffe01dc094ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01dc094f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01dc094f30 --- trap 0xc, rip = 0x24b549d464ba, rsp = 0x24b545694cf8, rbp = 0x24b545694df0 --- Tracing command aiod4 pid 7930 tid 106721 td 0xfffff802aa2f7740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01dc03fd60 mi_switch() at mi_switch+0x170/frame 0xfffffe01dc03fd80 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01dc03fdc0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe01dc03fe00 _sleep() at _sleep+0x27e/frame 0xfffffe01dc03fea0 aio_daemon() at aio_daemon+0x31a/frame 0xfffffe01dc03fef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01dc03ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01dc03ff30 --- trap 0xc, rip = 0xb78ab1524ba, rsp = 0xb78a74ae938, rbp = 0xb78a74ae950 --- Tracing command timeout pid 65510 tid 377249 td 0xfffff8015953a740 thread_exit() at thread_exit+0x1ea/frame 0xfffffe01ee3b6740 exit1() at exit1+0xe0f/frame 0xfffffe01ee3b67b0 sigexit() at sigexit+0x171/frame 0xfffffe01ee3b6c30 postsig() at postsig+0x1a5/frame 0xfffffe01ee3b6d00 kern_sigsuspend() at kern_sigsuspend+0x24b/frame 0xfffffe01ee3b6dd0 sys_sigsuspend() at sys_sigsuspend+0x31/frame 0xfffffe01ee3b6e00 amd64_syscall() at amd64_syscall+0x158/frame 0xfffffe01ee3b6f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01ee3b6f30 --- syscall (4, FreeBSD ELF64, write), rip = 0x1123cecf08fa, rsp = 0x1123ccf46c08, rbp = 0x1123ccf46e20 --- Tracing command sort pid 65515 tid 377166 td 0xfffff801578da740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01d23dca10 mi_switch() at mi_switch+0x170/frame 0xfffffe01d23dca30 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01d23dca70 _sleep() at _sleep+0x2d8/frame 0xfffffe01d23dcb10 vm_wait_doms() at vm_wait_doms+0xe3/frame 0xfffffe01d23dcb40 pmap_allocpte_alloc() at pmap_allocpte_alloc+0x73/frame 0xfffffe01d23dcb70 pmap_enter() at pmap_enter+0x782/frame 0xfffffe01d23dcc30 vm_fault() at vm_fault+0x14cb/frame 0xfffffe01d23dcd60 vm_fault_trap() at vm_fault_trap+0x5d/frame 0xfffffe01d23dcda0 trap_pfault() at trap_pfault+0x21d/frame 0xfffffe01d23dce10 trap() at trap+0x51d/frame 0xfffffe01d23dcf30 calltrap() at calltrap+0x8/frame 0xfffffe01d23dcf30 --- trap 0xc, rip = 0x2d54ced25325, rsp = 0x2d54cc710598, rbp = 0x2d54cc7105e0 --- db> reset Uptime: 9h0m25s (kgdb) proc 67745 (kgdb) bt #0 sched_switch (td=td@entry=0xfffff802dfd06000, flags=flags@entry=0x103) at ../../../kern/sched_ule.c:2290 #1 0xffffffff80b5d1c0 in mi_switch (flags=flags@entry=0x103) at ../../../kern/kern_synch.c:546 #2 0xffffffff80bb10a1 in sleepq_switch (wchan=0xffffffff818076c0 , pri=0x34) at ../../../kern/subr_sleepqueue.c:607 #3 0xffffffff80bb0f7c in sleepq_wait (wchan=, pri=) at ../../../kern/subr_sleepqueue.c:658 #4 0xffffffff80b5c708 in _sleep (ident=0xffffffff818076c0 , lock=0xffffffff81803680 , priority=0x234, wmesg=0xffffffff8114bac6 "vmwait", sbt=0x0, pr=pr@entry=0x0, flags=0x100) at ../../../kern/kern_synch.c:221 #5 0xffffffff80f14f53 in vm_wait_doms (wdoms=wdoms@entry=0xfffffe01085c8c08, mflags=mflags@entry=0x0) at ../../../vm/vm_page.c:3399 #6 0xffffffff80ef4d7d in vm_domainset_iter_page (di=di@entry=0xfffffe01085c8bf8, obj=obj@entry=0xfffff803be0b9c60, domain=domain@entry=0xfffffe01085c8c20) at ../../../vm/vm_domainset.c:253 #7 0xffffffff80f11d6b in vm_page_alloc_after (object=0xfffff803be0b9c60, pindex=0xc, req=0x8000, mpred=0x0) at ../../../vm/vm_page.c:2016 #8 vm_page_alloc (object=object@entry=0xfffff803be0b9c60, pindex=pindex@entry=0xc, req=req@entry=0x10) at ../../../vm/vm_page.c:1983 #9 0xffffffff80ee7085 in swap_pager_swapoff_object (sp=0xfffff8024e525980, object=0xfffff803be0b9c60) at ../../../vm/swap_pager.c:1890 #10 swap_pager_swapoff (sp=0xfffff8024e525980) at ../../../vm/swap_pager.c:1960 #11 swapoff_one (sp=sp@entry=0xfffff8024e525980, cred=, flags=flags@entry=0x0) at ../../../vm/swap_pager.c:2604 #12 0xffffffff80ee6adb in kern_swapoff (td=0xfffff802dfd06000, name=, name_seg=UIO_USERSPACE, flags=0x0) at ../../../vm/swap_pager.c:2536 #13 0xffffffff81072918 in syscallenter (td=0xfffff802dfd06000) at ../../../amd64/amd64/../../kern/subr_syscall.c:189 #14 amd64_syscall (td=0xfffff802dfd06000, traced=0x0) at ../../../amd64/amd64/trap.c:1192 #15 #16 0x00002d6ebcca53ba in ?? () Backtrace stopped: Cannot access memory at address 0x2d6ebc523ac8 (kgdb) f 5 #5 0xffffffff80f14f53 in vm_wait_doms (wdoms=wdoms@entry=0xfffffe01085c8c08, mflags=mflags@entry=0x0) at ../../../vm/vm_page.c:3399 3399 error = msleep(&vm_pageproc_waiters, &vm_domainset_lock, (kgdb) l 3394 * race-free vm_wait_domain(). 3395 */ 3396 if (curproc == pageproc) { 3397 mtx_lock(&vm_domainset_lock); 3398 vm_pageproc_waiters++; 3399 error = msleep(&vm_pageproc_waiters, &vm_domainset_lock, 3400 PVM | PDROP | mflags, "pageprocwait", 1); 3401 } else { 3402 /* 3403 * XXX Ideally we would wait only until the allocation could (kgdb) info loc error = 0x0 (kgdb) p/d vm_pageproc_waiters $1 = 0 (kgdb) p vm_domainset_lock $2 = {lock_object = {lo_name = 0xffffffff812c6ccc "vm domainset lock", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xfffff8087fd76180}, mtx_lock = 0x0} (kgdb) diff --git a/sys/net/if.c b/sys/net/if.c index 604a93aa7cbaa..342c2fdb44114 100644 --- a/sys/net/if.c +++ b/sys/net/if.c @@ -3798,7 +3798,7 @@ if_delmulti_locked(struct ifnet *ifp, struct ifmultiaddr *ifma, int detaching) */ if (detaching) { #ifdef DIAGNOSTIC - printf("%s: detaching ifnet instance %p\n", __func__, ifp); +// printf("%s: detaching ifnet instance %p\n", __func__, ifp); #endif /* * ifp may already be nulled out if we are being reentered -- Test scenario: src/tools/test/stress2/misc/swapoff6.sh