kldunload hwpmc.ko hangs, vmcore.792 KDB: debugger backends: ddb KDB: current backend: ddb ---<>--- Copyright (c) 1992-2024 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 15.0-CURRENT #1 main-n267424-6f55a4e24c94-dirty: Sat Jan 6 16:09:47 CET 2024 pho@mercat1.netperf.freebsd.org:/usr/src/sys/amd64/compile/PHO amd64 FreeBSD clang version 17.0.6 (https://github.com/llvm/llvm-project.git llvmorg-17.0.6-0-g6009708b4367) WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. VT(vga): resolution 640x480 CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.18-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab Structured Extended Features3=0x9c000400 XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics real memory = 34359738368 (32768 MB) avail memory = 33172766720 (31636 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 12 CPUs FreeBSD/SMP: 1 package(s) x 6 core(s) x 2 hardware threads random: registering fast source Intel Secure Key RNG random: fast provider: "Intel Secure Key RNG" random: unblocking device. ioapic0 irqs 0-23 ioapic1 irqs 24-47 Launching APs: 1 3 11 9 8 2 5 6 10 4 7 random: entropy device external interface kbd1 at kbdmux0 vtvga0: smbios0: at iomem 0xf05e0-0xf05fe smbios0: Version: 3.0, BCD Revision: 3.0 aesni0: acpi0: <> acpi0: Power Button (fixed) cpu0: on acpi0 atrtc0: port 0x70-0x71,0x74-0x77 irq 8 on acpi0 atrtc0: registered as a time-of-day clock, resolution 1.000000s Event timer "RTC" frequency 32768 Hz quality 0 attimer0: port 0x40-0x43,0x50-0x53 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Event timer "HPET" frequency 14318180 Hz quality 350 Event timer "HPET1" frequency 14318180 Hz quality 340 Event timer "HPET2" frequency 14318180 Hz quality 340 Event timer "HPET3" frequency 14318180 Hz quality 340 Event timer "HPET4" frequency 14318180 Hz quality 340 Event timer "HPET5" frequency 14318180 Hz quality 340 Event timer "HPET6" frequency 14318180 Hz quality 340 Event timer "HPET7" frequency 14318180 Hz quality 340 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 pcib0: on acpi0 pci0: on pcib0 pci0: at device 11.1 (no driver attached) pci0: at device 11.2 (no driver attached) pci0: at device 16.1 (no driver attached) pci0: at device 16.6 (no driver attached) pci0: at device 18.1 (no driver attached) acpi_syscontainer0: on acpi0 pcib1: port 0xcf8-0xcff on acpi0 pci1: on pcib1 pcib2: irq 26 at device 1.0 on pci1 pci2: on pcib2 pcib3: irq 32 at device 2.0 on pci1 pci3: on pcib3 pci3: at device 0.0 (no driver attached) pci3: at device 0.1 (no driver attached) pcib4: irq 40 at device 3.0 on pci1 pci4: on pcib4 pci1: at device 17.0 (no driver attached) ahci0: port 0xf110-0xf117,0xf100-0xf103,0xf0f0-0xf0f7,0xf0e0-0xf0e3,0xf020-0xf03f mem 0xfb416000-0xfb4167ff irq 16 at device 17.4 on pci1 ahci0: AHCI v1.30 with 4 6Gbps ports, Port Multiplier not supported ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahcich2: at channel 2 on ahci0 ahcich3: at channel 3 on ahci0 ahciem0: on ahci0 xhci0: mem 0xfb400000-0xfb40ffff irq 19 at device 20.0 on pci1 xhci0: 32 bytes context size, 64-bit DMA usbus0 on xhci0 usbus0: 5.0Gbps Super Speed USB v3.0 pci1: at device 22.0 (no driver attached) pci1: at device 22.1 (no driver attached) ehci0: mem 0xfb412000-0xfb4123ff irq 18 at device 26.0 on pci1 usbus1: EHCI version 1.0 usbus1 on ehci0 usbus1: 480Mbps High Speed USB v2.0 pcib5: irq 16 at device 28.0 on pci1 pci5: on pcib5 pcib6: irq 18 at device 28.2 on pci1 pci6: on pcib6 pcib7: at device 0.0 on pci6 pci7: on pcib7 vgapci0: port 0xe000-0xe07f mem 0xfa000000-0xfaffffff,0xfb000000-0xfb01ffff irq 18 at device 0.0 on pci7 vgapci0: Boot video device pcib8: irq 16 at device 28.4 on pci1 pci8: on pcib8 igb0: port 0xd020-0xd03f mem 0xfb320000-0xfb33ffff,0xfb344000-0xfb347fff irq 16 at device 0.0 on pci8 igb0: EEPROM V1.63-0 eTrack 0x800009fa igb0: Using 1024 TX descriptors and 1024 RX descriptors igb0: queue equality override not set, capping rx_queues at 6 and tx_queues at 6 igb0: UsinSetting hostuuid: 00000000-0000-0000-0000-002590c99976. Setting hostid: 0x90b83241. Starting file system checks: WARNING: / was not properly dismounted Mounting local filesystems:WARNING: /tmp was not properly dismounted WARNING: /tmp: mount pending error: blocks 48 files 3 . Autoloading module: acpi_wmi Autoloading module: ichsmb Autoloading module: ioat ioat0: mem 0x383ffff1c000-0x383ffff1ffff irq 31 at device 4.0 on pci1 ioat0: Capabilities: 2f7 ioat1: mem 0x383ffff18000-0x383ffff1bfff irq 39 at device 4.1 on pci1 ioat1: Capabilities: 2f7 ioat2: mem 0x383ffff14000-0x383ffff17fff irq 31 at device 4.2 on pci1 ioat2: Capabilities: f7 ioat3: mem 0x383ffff10000-0x383ffff13fff irq 39 at device 4.3 on pci1 ioat3: Capabilities: f7 ioat4: mem 0x383ffff0c000-0x383ffff0ffff irq 31 at device 4.4 on pci1 ioat4: Capabilities: f7 ioat5: mem 0x383ffff08000-0x383ffff0bfff irq 39 at device 4.5 on pci1 ioat5: Capabilities: f7 ioat6: mem 0x383ffff04000-0x383ffff07fff irq 31 at device 4.6 on pci1 ioat6: Capabilities: f7 ioat7: mem 0x383ffff00000-0x383ffff03fff irq 39 at device 4.7 on pci1 ioat7: Capabilities: f7 ichsmb0: port 0x580-0x59f mem 0x383ffff21000-0x383ffff210ff irq 18 at device 31.3 on pci1 smbus0: on ichsmb0 acpi_wmi0: on acpi0 acpi_wmi0: cannot find EC device fsck2+ fsck -fy /tmp ** /dev/gpt/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts LINK COUNT DIR I=2 OWNER=root MODE=41777 SIZE=164352 MTIME=Jan 6 22:13 2024 COUNT 26 SHOULD BE 24 ADJUST? yes UNREF FILE I=752 OWNER=root MODE=100755 SIZE=18440 MTIME=Jan 6 21:50 2024 RECONNECT? yes NO lost+found DIRECTORY CREATE? yes ** Phase 5 - Check Cyl groups FREE BLK COUNT(S) WRONG IN SUPERBLK SALVAGE? yes SUMMARY INFORMATION BAD SALVAGE? yes BLK(S) MISSING IN BIT MAPS SALVAGE? yes 910 files, 16431 used, 1248976 free (216 frags, 156095 blocks, 0.0% fragmentation) ***** FILE SYSTEM MARKED CLEAN ***** ***** FILE SYSTEM WAS MODIFIED ***** + set +x Updating CPU Microcode... CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.00-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab Structured Extended Features3=0x9c000400 XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics Done. Setting up harvesting: PURE_RDRAND,[CALLOUT],[UMA],[FS_ATIME],SWI,INTERRUPT,NET_NG,[NET_ETHER],NET_TUN,MOUSE,KEYBOARD,ATTACH,CACHED Feeding entropy: . Setting hostname: mercat1.netperf.freebsd.org. ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/e2fsprogs /usr/local/lib/perl5/5.36/mach/CORE 32-bit compatibility ldconfig path: /usr/lib32 /usr/local/lib32/compat igb0: link state changed to UP debugnet_any_ifnet_update: Bad dn_init result from igb0 (ifp 0xfffff800047c5800), ignoring. lo0Starting Network: igb1. igb1: flags=8802 metric 0 mtu 1500 options=4e507bb ether 0c:c4:7a:a8:cd:db media: Ethernet autoselect status: no carrier nd6 options=29 Starting Network: mce0. mce0: flags=8802 metric 0 mtu 1500 options=7eef07bb ether 7c:fe:90:30:ee:38 media: Ethernet autoselect status: no carrier nd6 options=29 Starting Network: mce1. mce1: flags=8802 metric 0 mtu 1500 options=7eef07bb ether 7c:fe:90:30:ee:39 media: Ethernet autoselect status: no carrier nd6 options=29 Autoloading module: uhid Autoloading module: ums Autoloading module: usbhid ums0 on uhub3 ums0: on usbus0 ums0: 3 buttons and [Z] coordinates ID=0 Starting dhclient. DHCPDISCOVER on igb0 to 255.255.255.255 port 67 interval 5 DHCPOFFER from 192.168.5.1 DHCPREQUEST on igb0 to 255.255.255.255 port 67 DHCPACK from 192.168.5.1 bound to 192.168.5.171 -- renewal in 300 seconds. route: message indicates error: File exists add host 127.0.0.1: gateway lo0 fib 0: route already in table route: message indicates error: File exists add host ::1: gateway lo0 fib 0: route already in table add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Creating and/or trimming log files. Recovering vi editor sessions:. Updating motd:. Clearing /tmp (X related). Updating /var/run/os-release done. Starting syslogd. Setting date via ntp. 6 Jan 22:14:00 ntpdate[3519]: step time server 192.168.5.1 offset -0.790593 sec No core dumps found. Starting watchdogd. Starting rpcbind. NFS access cache time=60 Starting statd. Starting lockd. Mounting late filesystems:. Security policy loaded: MAC/ntpd (mac_ntpd) Starting ntpd. Starting powerd. Starting mountd. Jan 6 22:14:01 mercat1 mountd[3613]: can't change attributes for /var/tmp: netcred already exists for given addr/mask Jan 6 22:14:01 mercat1 mountd[3613]: bad exports list line '/var/tmp -alldirs -maproot' NFSv4 is disabled Starting nfsd. Starting inetd. Starting cron. Performing sanity check on sshd configuration. Starting sshd. Sat Jan 6 22:14 FreeBSD/amd64 (mercat1.netperf.freebsd.org) (ttyu1) login: FreeBSD/amd64 (mercat1.netperf.freebsd.org) (ttyu1) login: Jan 6 22:16:17 mercat1 su[3710]: pho to root on /dev/pts/0 Jan 6 22:16:38 mercat1 mountd[3614]: can't change attributes for /: netcred already exists for given addr/mask Jan 6 22:16:38 mercat1 mountd[3614]: can't change attributes for /var/tmp: netcred already exists for given addr/mask Jan 6 22:16:38 mercat1 mountd[3614]: bad exports list line '/var/tmp -alldirs -maproot' Jan 7 14:16:42 mercat1 mountd[3614]: can't change attributes for /: netcred already exists for given addr/mask Jan 7 14:16:42 mercat1 mountd[3614]: can't change attributes for /var/tmp: netcred already exists for given addr/mask Jan 7 14:16:42 mercat1 mountd[3614]: bad exports list line '/var/tmp -alldirs -maproot' 20240107 21:16:14 all (1/914): 1st.sh 20240107 21:16:18 all (2/914): 256m.sh 20240107 21:16:22 all (3/914): audit.sh 20240107 21:16:25 all (4/914): avx_sig.sh 20240107 21:16:29 all (5/914): beneath2.sh Jan 7 21:16:35 mercat1 mountd[3614]: can't change attributes for /mnt: netcred already exists for given addr/mask Jan 7 21:16:35 mercat1 mountd[3614]: can't change attributes for /var/tmp: netcred already exists for given addr/mask Jan 7 21:16:35 mercat1 mountd[3614]: bad exports list line '/var/tmp -alldirs -maproot' 20240107 21:16:37 all (6/914): buildworld.sh 20240107 21:16:40 all (7/914): buildworld2.sh 20240107 21:16:44 all (8/914): cpuset.sh 20240107 21:16:47 all (9/914): datagram3.sh 20240107 21:16:52 all (10/914): datamove.sh 20240107 21:16:55 all (11/914): datamove3.sh 20240107 21:16:59 all (12/914): datamove6.sh 20240107 21:17:03 all (13/914): devfs2.sh 20240107 21:17:07 all (14/914): devfs4.sh 20240107 21:17:10 all (15/914): devfs5.sh 20240107 21:17:14 all (16/914): dtrace_fault.sh 20240107 21:17:17 all (17/914): dumpfs.sh stress2: newblk leak: 305/312. 20240107 21:17:21 all (18/914): dup2.sh 20240107 21:17:25 all (19/914): execi386.sh 20240107 21:17:29 all (20/914): extattr_set_fd.sh 20240107 21:17:32 all (21/914): extattrctl.sh lock order reversal: 1st 0xfffff80195a6dc40 ufs_extattr_sx (ufs_extattr_sx, sx) @ ufs/ufs/ufs_extattr.c:117 2nd 0xfffffe019d1e6c28 ufs (ufs, lockmgr) @ kern/vfs_subr.c:3535 lock order ufs -> ufs_extattr_sx established at: #0 0xffffffff80bc99ea at witness_checkorder+0x2fa #1 0xffffffff80b607b0 at _sx_xlock+0x60 #2 0xffffffff80ed72d3 at ufs_extattr_vnode_inactive+0x43 #3 0xffffffff80ed7bff at ufs_inactive+0x20f #4 0xffffffff81144ef0 at VOP_INACTIVE_APV+0x60 #5 0xffffffff80c4f54a at vinactivef+0xda #6 0xffffffff80c4ebda at vput_final+0x2aa #7 0xffffffff80c63dc1 at kern_frmdirat+0x2f1 #8 0xffffffff8106c4e3 at amd64_syscall+0x153 #9 0xffffffff8103e18b at fast_syscall_common+0xf8 lock order ufs_extattr_sx -> ufs attempted at: #0 0xffffffff80bca253 at witness_checkorder+0xb63 #1 0xffffffff80b224d1 at lockmgr_lock_flags+0x181 #2 0xffffffff80ece5cd at ffs_lock+0x9d #3 0xffffffff8114539d at VOP_LOCK1_APV+0x3d #4 0xffffffff80c67c33 at _vn_lock+0x53 #5 0xffffffff80c4ea9b at vput_final+0x16b #6 0xffffffff80ed5ee1 at ufs_extattr_autostart+0xb1 #7 0xffffffff80ecccba at ffs_mountfs+0xb9a #8 0xffffffff80eca8c3 at ffs_mount+0x463 #9 0xffffffff80c467bc at vfs_domount_first+0x25c #10 0xffffffff80c42be8 at vfs_domount+0x318 #11 0xffffffff80c4128d at vfs_donmount+0x8dd #12 0xffffffff80c4097c at sys_nmount+0x6c #13 0xffffffff8106c4e3 at amd64_syscall+0x153 #14 0xffffffff8103e18b at fast_syscall_common+0xf8 20240107 21:17:36 all (22/914): fcntl3.sh 20240107 21:17:40 all (23/914): fdescfs3.sh 20240107 21:17:43 all (24/914): fexecve.sh 20240107 21:17:47 all (25/914): fifo.sh 20240107 21:17:51 all (26/914): force12.sh 20240107 21:17:54 all (27/914): fsck2.sh 20240107 21:17:58 all (28/914): fsck3.sh Jan 7 21:18:00 mercat1 mountd[3614]: can't change attributes for /: netcred already exists for given addr/mask Jan 7 21:18:00 mercat1 mountd[3614]: can't change attributes for /var/tmp: netcred already exists for given addr/mask Jan 7 21:18:00 mercat1 mountd[3614]: bad exports list line '/var/tmp -alldirs -maproot' Jan 7 21:18:01 mercat1 mountd[3614]: can't change attributes for /: netcred already exists for given addr/mask Jan 7 21:18:01 mercat1 mountd[3614]: can't change attributes for /var/tmp: netcred already exists for given addr/mask Jan 7 21:18:01 mercat1 mountd[3614]: bad exports list line '/var/tmp -alldirs -maproot' Jan 7 21:18:01 mercat1 mountd[3614]: can't change attributes for /: netcred already exists for given addr/mask Jan 7 21:18:01 mercat1 mountd[3614]: can't change attributes for /var/tmp: netcred already exists for given addr/mask Jan 7 21:18:01 mercat1 mountd[3614]: bad exports list line '/var/tmp -alldirs -maproot' Jan 7 21:18:01 mercat1 mountd[3614]: can't change attributes for /: netcred already exists for given addr/mask Jan 7 21:18:01 mercat1 mountd[3614]: can't change attributes for /var/tmp: netcred already exists for given addr/mask Jan 7 21:18:01 mercat1 mountd[3614]: bad exports list line '/var/tmp -alldirs -maproot' Jan 7 21:18:02 mercat1 mountd[3614]: can't change attributes for /: netcred already exists for given addr/mask Jan 7 21:18:02 mercat1 mountd[3614]: can't change attributes for /var/tmp: netcred already exists for given addr/mask Jan 7 21:18:02 mercat1 mountd[3614]: bad exports list line '/var/tmp -alldirs -maproot' Jan 7 21:18:02 mercat1 mountd[3614]: can't change attributes for /: netcred already exists for given addr/mask Jan 7 21:18:02 mercat1 mountd[3614]: can't change attributes for /var/tmp: netcred already exists for given addr/mask Jan 7 21:18:02 mercat1 mountd[3614]: bad exports list line '/var/tmp -alldirs -maproot' 20240107 21:18:03 all (29/914): fsck7.sh 20240107 21:18:07 all (30/914): fsx-rust.sh Jan 7 21:18:10 mercat1 mountd[3614]: can't change attributes folock order reversal: 1st 0xfffff800316d9c80 so_snd_sx (so_snd_sx, sx) @ kern/uipc_socket.c:4075 2nd 0xfffffe019c896e80 msdosfs (msdosfs, lockmgr) @ kern/kern_sendfile.c:860 r /: netcred alrlock order so_snd_sx -> msdosfs attempted at: #0 0xffffffff80bceady exists for a253 at witness_checkorder+0xb63 #1 0xffffffff80b223e3 at lockmgiven addr/maskgr_lock_flags+0x93 #2 0xffffffff8114539d at VOP_LOCK1_APV+0x3d Jan 7 21:18:10#3 0xffffffff80c67c33 at _vn_lock+0x53 #4 0xffffffff80b51e40 at vn_sendfile+0x760 #5 0xffffffff80b53d09 at sendfile+0x119 #6 0 mercat1 mountd[xffffffff8106c4e3 at amd64_syscall+0x153 #7 0xffffffff8103e18b at fast_syscall_common+0xf8 3614]: can't change attributes for /var/tmp: netcred already exists for given addr/mask Jan 7 21:18:10 mercat1 mountd[3614]: bad exports list line '/var/tmp -alldirs -maproot' 20240107 21:18:12 all (31/914): gnop3.sh 20240107 21:18:15 all (32/914): gnop5.sh GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. 20240107 21:18:20 all (33/914): gpt.sh g_dev_taste: g_dev_taste(gptid/e7d4115c-ad99-11ee-8af3-0cc47aa8cdda) failed to g_attach, error=6 g_dev_taste: g_dev_taste(gpt/tst0) failed to g_attach, error=6 20240107 21:18:23 all (34/914): holdcnt0.sh 20240107 21:18:27 all (35/914): holdcnt02.sh 20240107 21:18:30 all (36/914): holdcnt03.sh 20240107 21:18:34 all (37/914): holdcnt04.sh 20240107 21:18:37 all (38/914): holdcnt05.sh 20240107 21:18:41 all (39/914): isofs2.sh 20240107 21:18:45 all (40/914): jail.sh 20240107 21:18:48 all (41/914): jail2.sh 20240107 21:18:52 all (42/914): jail3.sh 20240107 21:18:56 all (43/914): jail4.sh 20240107 21:18:59 all (44/914): kern_umtx_inf_loop.sh 20240107 21:19:03 all (45/914): kevent10.sh 20240107 21:19:07 all (46/914): kevent3.sh 20240107 21:19:11 all (47/914): ldt.sh 20240107 21:19:14 all (48/914): ldt2.sh 20240107 21:19:18 all (49/914): libMicro.sh 20240107 21:19:21 all (50/914): linux.sh Jan 7 21:19:24 mercat1 mountd[3614]: can't change attributes for /: netcred already exists for given addr/mask Jan 7 21:19:24 mercat1 mountd[3614]: can't change attributes for /var/tmp: netcred already exists for given addr/mask Jan 7 21:19:24 mercat1 mountd[3614]: bad exports list line '/var/tmp -alldirs -maproot' Jan 7 21:19:24 mercat1 mountd[3614]: can't change attributes for /: netcred already exists for given addr/mask Jan 7 21:19:24 mercat1 mountd[3614]: can't change attributes for /var/tmp: netcred already exists for given addr/mask Jan 7 21:19:24 mercat1 mountd[3614]: bad exports list line '/var/tmp -alldirs -maproot' Jan 7 21:19:24 mercat1 mountd[3614]: can't change attributes for /: netcred already exists for given addr/mask Jan 7 21:19:24 mercat1 mountd[3614]: can't change attributes for /var/tmp: netcred already exists for given addr/mask Jan 7 21:19:24 mercat1 mountd[3614]: bad exports list line '/var/tmp -alldirs -maproot' 20240107 21:19:25 all (51/914): lockf.sh 20240107 21:19:29 all (52/914): lookup_shared.sh 20240107 21:19:32 all (53/914): mac.sh 20240107 21:19:36 all (54/914): mac_chkexec.sh 20240107 21:19:39 all (55/914): machipc.sh 20240107 21:19:43 all (56/914): machipc2.sh 20240107 21:19:47 all (57/914): maxmemdom.sh 20240107 21:19:50 all (58/914): maxproc.sh 20240107 21:19:54 all (59/914): md4.sh 20240107 21:19:57 all (60/914): md5.sh stress2: newblk leak: 159/164. 20240107 21:20:01 all (61/914): md6.sh 20240107 21:20:05 all (62/914): mdconfig.sh 20240107 21:20:08 all (63/914): mdconfig3.sh stress2: newblk leak: 158/164. 20240107 21:20:12 all (64/914): mdconfig4.sh 20240107 21:20:16 all (65/914): memguard4.sh 20240107 21:20:19 all (66/914): mkfifo5.sh 20240107 21:20:23 all (67/914): mkfifo7.sh 20240107 21:20:27 all (68/914): mlockall5.sh 20240107 21:20:30 all (69/914): mmap.sh 20240107 21:20:34 all (70/914): mmap12.sh 20240107 21:20:38 all (71/914): mmap16.sh 20240107 21:20:41 all (72/914): mmap17.sh 20240107 21:20:45 all (73/914): mmap20.sh 20240107 21:20:48 all (74/914): mmap24.sh 20240107 21:20:52 all (75/914): mmap30.sh 20240107 21:20:56 all (76/914): mmap33.sh 20240107 21:21:00 all (77/914): mmap35.sh 20240107 21:21:03 all (78/914): mmap36.sh 20240107 21:21:07 all (79/914): mount.sh 20240107 21:21:10 all (80/914): mountro3.sh stress2: newblk leak: 2047/2052. 20240107 21:21:14 all (81/914): mprotect.sh 20240107 21:21:18 all (82/914): mprotect3.sh 20240107 21:21:22 all (83/914): msdos19.sh stress2: newblk leak: 497/504. 20240107 21:21:25 all (84/914): msdos2.sh 20240107 21:21:29 all (85/914): msdos3.sh 20240107 21:21:32 all (86/914): msdos7.sh 20240107 21:21:36 all (87/914): multicast2.sh 20240107 21:21:40 all (88/914): nanosleep.sh 20240107 21:21:43 all (89/914): nfs14.sh 20240107 21:21:47 all (90/914): nfs15lockd3.sh 20240107 21:21:50 all (91/914): nfs8.sh 20240107 21:21:54 all (92/914): nfs_halfpage.sh 20240107 21:21:57 all (93/914): nfs_halfpage2.sh 20240107 21:22:01 all (94/914): nfsdelegation.sh 20240107 21:22:05 all (95/914): nfsdepth.sh 20240107 21:22:08 all (96/914): nfsrename.sh 20240107 21:22:12 all (97/914): nfssillyrename.sh 20240107 21:22:15 all (98/914): nullfs13.sh 20240107 21:22:19 all (99/914): nullfs14.sh 20240107 21:22:22 all (100/914): nullfs15.sh 20240107 21:22:26 all (101/914): nullfs21.sh 20240107 21:22:30 all (102/914): nullfs23.sh 20240107 21:22:33 all (103/914): nullfs29.sh 20240107 21:22:37 all (104/914): nullfs4.sh Jan 7 21:22:39 mercat1 mountd[3614]: can't change attributes for /: netcred already exists for given addr/mask Jan 7 21:22:39 mercat1 mountd[3614]: can't change attributes for /var/tmp: netcred already exists for given addr/mask Jan 7 21:22:39 mercat1 mountd[3614]: bad exports list line '/var/tmp -alldirs -maproot' stress2: mount leak: 13/45 20240107 21:22:41 all (105/914): nullfs6.sh Jan 7 21:22:43 mercat1 mountd[3614]: can't change attributes for /: netcred already exists for given addr/mask Jan 7 21:22:43 mercat1 mountd[3614]: can't change attributes for /var/tmp: netcred already exists for given addr/mask Jan 7 21:22:43 mercat1 mountd[3614]: bad exports list line '/var/tmp -alldirs -maproot' 20240107 21:22:44 all (106/914): nullfs7.sh 20240107 21:22:48 all (107/914): nullfs9.sh Jan 7 21:22:50 mercat1 mountd[3614]: can't change attributes for /: netcred already exists for given addr/mask Jan 7 21:22:50 mercat1 mountd[3614]: can't change attributes for /var/tmp: netcred already exists for given addr/mask Jan 7 21:22:50 mercat1 mountd[3614]: bad exports list line '/var/tmp -alldirs -maproot' 20240107 21:22:52 all (108/914): numa.sh 20240107 21:22:55 all (109/914): oom.sh 20240107 21:22:59 all (110/914): open.sh 20240107 21:23:02 all (111/914): parallelmount2.sh 20240107 21:23:06 all (112/914): pathconf.sh 20240107 21:23:09 all (113/914): pathconf2.sh 20240107 21:23:13 all (114/914): pcatch.sh 20240107 21:23:16 all (115/914): pcatch2.sh 20240107 21:23:20 all (116/914): ping.sh 20240107 21:23:24 all (117/914): pkru.sh 20240107 21:23:27 all (118/914): pkru2.sh 20240107 21:23:31 all (119/914): poll.sh 20240107 21:23:34 all (120/914): posix_fadvise.sh 20240107 21:23:38 all (121/914): posix_fadvise2.sh 20240107 21:23:42 all (122/914): procfs5.sh 20240107 21:23:46 all (123/914): procfs6.sh 20240107 21:23:49 all (124/914): procstat.sh 20240107 21:23:53 all (125/914): pthread9.sh 20240107 21:23:56 all (126/914): ptrace.sh 20240107 21:24:00 all (127/914): ptrace3.sh 20240107 21:24:04 all (128/914): pts2.sh 20240107 21:24:08 all (129/914): quota5.sh 20240107 21:24:11 all (130/914): rename13.sh 20240107 21:24:15 all (131/914): rename4.sh 20240107 21:24:18 all (132/914): revoke.sh 20240107 21:24:22 all (133/914): ruby.sh 20240107 21:24:26 all (134/914): rwlock_ronly.sh 20240107 21:24:30 all (135/914): schedfuzz.sh 20240107 21:24:33 all (136/914): seekdir.sh 20240107 21:24:37 all (137/914): seekhole.sh 20240107 21:24:41 all (138/914): segnp.sh 20240107 21:24:44 all (139/914): segregs.sh 20240107 21:24:48 all (140/914): select3.sh 20240107 21:24:52 all (141/914): sendfile19.sh 20240107 21:24:55 all (142/914): sendfile2.sh lock order reversal: 1st 0xfffff802e27038c0 so_snd_sx (so_snd_sx, sx) @ kern/uipc_socket.c:4075 2nd 0xfffffe019d2c6e80 ufs (ufs, lockmgr) @ kern/kern_sendfile.c:860 lock order so_snd_sx -> ufs attempted at: #0 0xffffffff80bca253 at witness_checkorder+0xb63 #1 0xffffffff80b223e3 at lockmgr_lock_flags+0x93 #2 0xffffffff80ece5cd at ffs_lock+0x9d #3 0xffffffff8114539d at VOP_LOCK1_APV+0x3d #4 0xffffffff80c67c33 at _vn_lock+0x53 #5 0xffffffff80b51e40 at vn_sendfile+0x760 #6 0xffffffff80b53d09 at sendfile+0x119 #7 0xffffffff8106c4e3 at amd64_syscall+0x153 #8 0xffffffff8103e18b at fast_syscall_common+0xf8 20240107 21:24:59 all (143/914): sendfile20.sh 20240107 21:25:03 all (144/914): sendfile4.sh 20240107 21:25:06 all (145/914): setrlimit.sh Jan 7 21:25:09 mercat1 mountd[3614]: could not remount /mnt: Operation not supported Jan 7 21:25:09 mercat1 mountd[3614]: can't change attributes for /var/tmp: netcred already exists for given addr/mask Jan 7 21:25:09 mercat1 mountd[3614]: bad exports list line '/var/tmp -alldirs -maproot' 20240107 21:25:10 all (146/914): setrlimit2.sh 20240107 21:25:14 all (147/914): setuid.sh 20240107 21:25:18 all (148/914): shm_super.sh 20240107 21:25:21 all (149/914): sigaltstack.sh 20240107 21:25:25 all (150/914): signal2.sh 20240107 21:25:29 all (151/914): sigreturn.sh 20240107 21:25:32 all (152/914): snap12.sh 20240107 21:25:36 all (153/914): snap13.sh 20240107 21:25:40 all (154/914): snap2-1.sh lock order reversal: 1st 0xfffffe00397c5730 bufwait (bufwait, lockmgr) @ ufs/ffs/ffs_vnops.c:328 2nd 0xfffff804d4477830 snaplk (snaplk, lockmgr) @ ufs/ffs/ffs_snapshot.c:2330 lock order snaplk -> bufwait established at: #0 0xffffffff80bc99ea at witness_checkorder+0x2fa #1 0xffffffff80b22bf6 at lockmgr_xlock_hard+0x96 #2 0xffffffff80b23495 at __lockmgr_args+0x205 #3 0xffffffff80c4cb90 at bnoreuselist+0xc0 #4 0xffffffff80c38abf at vop_stdadvise+0x14f #5 0xffffffff81148170 at VOP_ADVISE_APV+0x60 #6 0xffffffff806de501 at mdstart_vnode+0x541 #7 0xffffffff806dc13c at md_kthread+0x20c #8 0xffffffff80b0acf2 at fork_exit+0x82 #9 0xffffffff8103e8de at fork_trampoline+0xe lock order bufwait -> snaplk attempted at: #0 0xffffffff80bca253 at witness_checkorder+0xb63 #1 0xffffffff80b22bf6 at lockmgr_xlock_hard+0x96 #2 0xffffffff80b23495 at __lockmgr_args+0x205 #3 0xffffffff80ea47d3 at ffs_copyonwrite+0x1a3 #4 0xffffffff80ecd470 at ffs_geom_strategy+0xd0 #5 0xffffffff80ee28d3 at ufs_strategy+0x83 #6 0xffffffff81145828 at VOP_STRATEGY_APV+0x68 #7 0xffffffff80c1edcf at bufstrategy+0x3f #8 0xffffffff80c1ec6a at bufwrite+0x24a #9 0xffffffff80ecfac1 at ffs_syncvnode+0x391 #10 0xffffffff80ece46e at ffs_fsync+0x1e #11 0xffffffff81143e5d at VOP_FSYNC_APV+0x3d #12 0xffffffff80ee03a4 at ufs_remove+0x114 #13 0xffffffff81144009 at VOP_REMOVE_APV+0x89 #14 0xffffffff80c5f423 at kern_funlinkat+0x483 #15 0xffffffff80c5ef98 at sys_unlink+0x28 #16 0xffffffff8106c4e3 at amd64_syscall+0x153 #17 0xffffffff8103e18b at fast_syscall_common+0xf8 20240107 21:25:44 all (155/914): snap2.sh 20240107 21:25:47 all (156/914): sndstat.sh 20240107 21:25:51 all (157/914): socketpair.sh 20240107 21:25:55 all (158/914): socketpair2.sh 20240107 21:25:58 all (159/914): socketpair3.sh 20240107 21:26:02 all (160/914): suj2.sh 20240107 21:26:06 all (161/914): suj24.sh 20240107 21:26:09 all (162/914): suj32.sh 20240107 21:26:13 all (163/914): suj35.sh 20240107 21:26:17 all (164/914): suj7.sh Failed to find journal. Use tunefs to create one Failed to start journal: 2 20240107 21:26:21 all (165/914): suj8.sh Jan 7 21:26:23 mercat1 kernel: pid 83338 (dd), uid 0 inumber 4 on /mnt: filesystem full Jan 7 21:26:24 mercat1 kernel: pid 83354 (dd), uid 0 inumber 5 on /mnt: filesystem full 20240107 21:26:25 all (166/914): syzkaller1.sh 20240107 21:26:29 all (167/914): syzkaller2.sh 20240107 21:26:32 all (168/914): syzkaller22.sh 20240107 21:26:36 all (169/914): syzkaller29.sh 20240107 21:26:40 all (170/914): syzkaller3.sh 20240107 21:26:43 all (171/914): syzkaller30.sh 20240107 21:26:47 all (172/914): syzkaller35.sh 20240107 21:26:51 all (173/914): syzkaller36.sh 20240107 21:26:55 all (174/914): syzkaller37.sh 20240107 21:26:58 all (175/914): syzkaller38.sh 20240107 21:27:02 all (176/914): syzkaller39.sh 20240107 21:27:06 all (177/914): syzkaller40.sh 20240107 21:27:09 all (178/914): syzkaller41.sh 20240107 21:27:13 all (179/914): syzkaller44.sh 20240107 21:27:17 all (180/914): syzkaller45.sh 20240107 21:27:21 all (181/914): syzkaller46.sh 20240107 21:27:24 all (182/914): syzkaller47.sh 20240107 21:27:28 all (183/914): syzkaller5.sh 20240107 21:27:32 all (184/914): syzkaller6.sh 20240107 21:27:35 all (185/914): syzkaller60.sh 20240107 21:27:39 all (186/914): syzkaller62.sh 20240107 21:27:43 all (187/914): syzkaller63.sh 20240107 21:27:46 all (188/914): syzkaller64.sh 20240107 21:27:50 all (189/914): temp.sh 20240107 21:27:54 all (190/914): tmpfs15.sh 20240107 21:27:57 all (191/914): tmpfs24.sh 20240107 21:28:01 all (192/914): tmpfs26.sh 20240107 21:28:05 all (193/914): tmpfs4.sh 20240107 21:28:09 all (194/914): tmpfs6.sh 20240107 21:28:13 all (195/914): tmpfs7.sh 20240107 21:28:17 all (196/914): trim2.sh 20240107 21:28:21 all (197/914): trim5.sh 20240107 21:28:25 all (198/914): trim6.sh 20240107 21:28:29 all (199/914): trim7.sh 20240107 21:28:32 all (200/914): trim8.sh 20240107 21:28:36 all (201/914): truncate4.sh 20240107 21:28:40 all (202/914): truncate6.sh 20240107 21:28:44 all (203/914): tvnlru.sh 20240107 21:28:48 all (204/914): ufssuspend.sh 20240107 21:28:52 all (205/914): uma_zalloc_arg.sh 20240107 21:28:56 all (206/914): unionfs10.sh Jan 7 21:28:58 mercat1 mountd[3614]: can't change attributes for /: netcred already exists for given addr/mask Jan 7 21:28:58 mercat1 mountd[3614]: can't change attributes for /var/tmp: netcred already exists for given addr/mask Jan 7 21:28:58 mercat1 mountd[3614]: bad exports list line '/var/tmp -alldirs -maproot' Jan 7 21:28:58 mercat1 mountd[3614]: can't change attributes for /: netcred already exists for given addr/mask Jan 7 21:28:58 mercat1 mountd[3614]: can't change attributes for /var/tmp: netcred already exists for given addr/mask Jan 7 21:28:58 mercat1 mountd[3614]: bad exports list line '/var/tmp -alldirs -maproot' Jan 7 21:28:58 mercat1 mountd[3614]: can't change attributes for /: netcred already exists for given addr/mask Jan 7 21:28:58 mercat1 mountd[3614]: can't change attributes for /var/tmp: netcred already exists for given addr/mask Jan 7 21:28:58 mercat1 mountd[3614]: bad exports list line '/var/tmp -alldirs -maproot' unionfs_close: warning: open count is 0 20240107 21:29:00 all (207/914): unionfs15.sh Jan 7 21:29:02 mercat1 mountd[3614]: can't change attributes for /: netcred already exists for given addr/mask Jan 7 21:29:02 mercat1 mountd[3614]: can't change attributes for /var/tmp: netcred already exists for given addr/mask Jan 7 21:29:02 mercat1 mountd[3614]: bad exports list line '/var/tmp -alldirs -maproot' Jan 7 21:29:02 mercat1 mountd[3614]: can't change attributes for /: netcred already exists for given addr/mask Jan 7 21:29:02 mercat1 mountd[3614]: can't change attributes for /var/tmp: netcred already exists for given addr/mask Jan 7 21:29:02 mercat1 mountd[3614]: bad exports list line '/var/tmp -alldirs -maproot' Jan 7 21:29:02 mercat1 mountd[3614]: can't change attributes for /: netcred already exists for given addr/mask Jan 7 21:29:02 mercat1 munionfs_close: warning: open count is 0 ountd[3614]: can't change attributes for /var/tmp: netcred already exists for given addr/mask Jan 7 21:29:02 mercat1 mountd[3614]: bad exports list line '/var/tmp -alldirs -maproot' 20240107 21:29:04 all (208/914): unionfs3.sh Jan 7 21:29:06 mercat1 mountd[3614]: could not remount /mnt: Opunionfs_close: warning: open count is 0 eration not supported Jan 7 21:29:06 mercat1 mountd[3614]: can't export /mnt unionfs does not support mount update Jan 7 21:29:06 mercat1 mountd[3614]: bad exports list line '/mnt -maproot' 20240107 21:29:07 all (209/914): unlink.sh 20240107 21:29:11 all (210/914): vmio.sh 20240107 21:29:15 all (211/914): watchman.sh 20240107 21:29:19 all (212/914): beneath.sh 20240107 21:29:22 all (213/914): beneath3.sh 20240107 21:29:26 all (214/914): beneath4.sh 20240107 21:29:30 all (215/914): crossmp2.sh 20240107 21:29:34 all (216/914): datagram.sh 20240107 21:29:38 all (217/914): datagram2.sh 20240107 21:29:42 all (218/914): execpath.sh 20240107 21:29:47 all (219/914): ext2fs3.sh 20240107 21:29:51 all (220/914): extattr.sh 20240107 21:29:56 all (221/914): fcntl.sh 20240107 21:30:01 all (222/914): geomleak.sh 20240107 21:30:05 all (223/914): growfs2.sh 20240107 21:30:14 all (224/914): isofs.sh 20240107 21:30:18 all (225/914): killpg.sh 20240107 21:30:23 all (226/914): md9.sh Jan 7 21:30:25 mercat1 mountd[3614]: can't change attributes for /: netcred already exists for given addr/mask Jan 7 21:30:25 mercat1 mountd[3614]: can't change attributes for /var/tmp: netcred already exists for given addr/mask Jan 7 21:30:25 mercat1 mountd[3614]: bad exports list line '/var/tmp -alldirs -maproot' 20240107 21:30:27 all (227/914): mmap25.sh 20240107 21:30:32 all (228/914): mmap26.sh 20240107 21:30:37 all (229/914): mmap28.sh 20240107 21:30:41 all (230/914): mmap8.sh 20240107 21:30:46 all (231/914): mmap9.sh 20240107 21:30:51 all (232/914): mountro2.sh 20240107 21:30:55 all (233/914): msdos9.sh 20240107 21:30:59 all (234/914): newfs5.sh 20240107 21:31:05 all (235/914): nlink3.sh 20240107 21:31:10 all (236/914): nlink4.sh 20240107 21:31:14 all (237/914): nullfs10.sh 20240107 21:31:18 all (238/914): nullfs12.sh 20240107 21:31:23 all (239/914): nullfs16.sh 20240107 21:31:28 all (240/914): openlock.sh 20240107 21:31:32 all (241/914): pdfork.sh 20240107 21:31:37 all (242/914): pipe_enomem.sh kern.ipc.maxpipekva exceeded; see tuning(7) 20240107 21:31:42 all (243/914): ptrace11.sh 20240107 21:31:46 all (244/914): ptrace8.sh 20240107 21:31:51 all (245/914): quota9.sh lock order reversal: 1st 0xfffff8046bac9ca0 FFS (FFS Lock, sleep mutex) @ ufs/ufs/ufs_quota.c:750 2nd 0xfffffe016ca9c2c0 struct mount mtx (struct mount mtx, sleep mutex) @ ufs/ufs/ufs_quota.c:756 lock order struct mount mtx -> FFS Lock established at: #0 0xffffffff80bc99ea at witness_checkorder+0x2fa #1 0xffffffff80b2fd73 at __mtx_lock_flags+0x93 #2 0xffffffff80ea71a4 at softdep_flushfiles+0x394 #3 0xffffffff80ecb26c at ffs_unmount+0xac #4 0xffffffff80c43bfc at dounmount+0x7dc #5 0xffffffff80c433bb at kern_unmount+0x2eb #6 0xffffffff8106c4e3 at amd64_syscall+0x153 #7 0xffffffff8103e18b at fast_syscall_common+0xf8 lock order FFS Lock -> struct mount mtx attempted at: #0 0xffffffff80bca253 at witness_checkorder+0xb63 #1 0xffffffff80b2fd73 at __mtx_lock_flags+0x93 #2 0xffffffff80edd23e at quotaoff_inchange+0xbe #3 0xffffffff80ec9821 at ffs_flushfiles+0x161 #4 0xffffffff80ea6ebf at softdep_flushfiles+0xaf #5 0xffffffff80ecb26c at ffs_unmount+0xac #6 0xffffffff80c43bfc at dounmount+0x7dc #7 0xffffffff80c433bb at kern_unmount+0x2eb #8 0xffffffff8106c4e3 at amd64_syscall+0x153 #9 0xffffffff8103e18b at fast_syscall_common+0xf8 stress2: newblk leak: 1597/1604. 20240107 21:31:55 all (246/914): random.sh 20240107 21:32:00 all (247/914): recursiveflushes.sh 20240107 21:32:05 all (248/914): rename6.sh 20240107 21:32:10 all (249/914): sendfile6.sh 20240107 21:32:14 all (250/914): sigstop.sh 20240107 21:32:18 all (251/914): snap.sh 20240107 21:32:22 all (252/914): snap10.sh 20240107 21:32:27 all (253/914): snap9.sh Jan 7 21:32:31 mercat1 kernel: pid 52626 (dd), uid 0 inumber 8 on /mnt: filesystem full 20240107 21:32:32 all (254/914): spin.sh 20240107 21:32:37 all (255/914): truncate5.sh 20240107 21:32:42 all (256/914): umtx_suspend.sh 20240107 21:32:47 all (257/914): unionfs11.sh Jan 7 21:32:49 mercat1 mountd[3614]: can't change attributes for /: netcred already exists for given addr/mask Jan 7 21:32:49 mercat1 mountd[3614]: can't change attributes for /var/tmp: netcred already exists for given addr/mask Jan 7 21:32:49 mercat1 mountd[3614]: bad exports list line '/var/tmp -alldirs -maproot' Jan 7 21:32:49 mercat1 mountd[3614]: can't change attributes for /: netcred already exists for given addr/mask Jan 7 21:32:49 mercat1 mountd[3614]: can't change attributes for /var/tmp: netcred already exists for given addr/mask Jan 7 21:32:49 mercat1 mountd[3614]: bad exports list line '/var/tmp -alldirs -maproot' Jan 7 21:32:49 mercat1 mountd[3614]: can't change attributes for /: netcred already exists for given addr/mask Jan 7 21:32:49 mercat1 mountd[3614]: can't change attributes for /var/tmp: netcred already exists for given addr/mask Jan 7 21:32:49 mercat1 mountd[3614]: bad exports list line '/var/tmp -alldirs -maproot' unionfs_close: warning: open count is 0 20240107 21:32:51 all (258/914): unionfs12.sh Jan 7 21:32:54 mercat1 mountd[3614]: can't change attributes for /: netcred already exists for given addr/mask Jan 7 21:32:54 mercat1 mountd[3614]: can't change attributes for /var/tmp: netcred already exists for given addr/mask Jan 7 21:32:54 mercat1 mountd[3614]: bad exports list line '/var/tmp -alldirs -maproot' Jan 7 21:32:54 mercat1 mountd[3614]: can't change attributes for /: netcred already exists for given addr/mask Jan 7 21:32:54 mercat1 mountd[3614]: can't change attributes for /var/tmp: netcred already exists for given addr/mask Jan 7 21:32:54 mercat1 mountd[3614]: bad exports list line '/var/tmp -alldirs -maproot' Jan 7 21:32:54 mercat1 mountd[3614]: can't change attributes for /: netcred already exists for given addr/mask Jan 7 21:32:54 mercat1 mountd[3614]: can't change attributes for /var/tmp: netcred already exists for given addr/mask Jan 7 21:32:54 mercat1 mountd[3614]: bad exports list line '/var/tmp -alldirs -maproot' unionfs_close: warning: open count is 0 20240107 21:32:55 all (259/914): vfork.sh 20240107 21:32:59 all (260/914): vm_fault.sh 20240107 21:33:08 all (261/914): vm_fault_dontneed.sh 20240107 21:33:13 all (262/914): chroot.sh 20240107 21:33:19 all (263/914): contigmalloc2.sh 20240107 21:33:23 all (264/914): contigmalloc3.sh 20240107 21:33:27 all (265/914): datamove4.sh 20240107 21:33:33 all (266/914): devfd.sh 20240107 21:33:39 all (267/914): dup.sh 20240107 21:33:45 all (268/914): ext4fs2.sh 20240107 21:33:50 all (269/914): extattr3.sh 20240107 21:33:55 all (270/914): fpclone2.sh 20240107 21:34:00 all (271/914): growfs.sh g_dev_taste: g_dev_taste(ufsid/659b0aba703be562) failed to g_attach, error=6 g_dev_taste: g_dev_taste(gptid/1827fd52-ad9c-11ee-8af3-0cc47aa8cdda) failed to g_attach, error=6 20240107 21:34:05 all (272/914): kevent8.sh lock order reversal: 1st 0xfffffe01b2ade940 filedesc structure (filedesc structure, sx) @ kern/kern_descrip.c:1400 2nd 0xfffffe019e94f588 ufs (ufs, lockmgr) @ kern/vfs_subr.c:6494 lock order filedesc structure -> ufs attempted at: #0 0xffffffff80bca253 at witness_checkorder+0xb63 #1 0xffffffff80b224d1 at lockmgr_lock_flags+0x181 #2 0xffffffff80ece5cd at ffs_lock+0x9d #3 0xffffffff8114539d at VOP_LOCK1_APV+0x3d #4 0xffffffff80c67c33 at _vn_lock+0x53 #5 0xffffffff80aff69b at knlist_remove_kq+0x8b #6 0xffffffff80c5acc4 at filt_vfsdetach+0x24 #7 0xffffffff80b00013 at knote_fdclose+0x173 #8 0xffffffff80af730b at closefp_impl+0x9b #9 0xffffffff8106c4e3 at amd64_syscall+0x153 #10 0xffffffff8103e18b at fast_syscall_common+0xf8 20240107 21:34:11 all (273/914): mmap23.sh 20240107 21:34:17 all (274/914): mmap4.sh vnode_pager_putpages: zero-length write at 39976960 reJan 7 21:34:19 sid 131072 0xfffffe019e9eb068: type VREG state VSTATE_CONSTRUCTED op 0xffffffff817376a8 usecount 0, writecount 0, refcount 3203 seqc users 0 hold count flags () flags (VIRF_PGREAD|VI_DOINGINACT|VMP_LAZYLIST) v_object 0xfffff80067d6f630 ref 0 pages 25608 cleanbuf 3200 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff807e5e55740 (pid 5753, mmap4, tid 101446) #0mercat1 kernel: 0xffffffff80b22529 at lockmgr_lock_flags+0x1d9 pid 5753 (mmap4)#1 0xffffffff80ece5cd at ffs_lock+0x9d , uid 0 inumber #2 0xffffffff8114539d at VOP_LOCK1_APV+0x3d 4 on /mnt: files#3 0xffffffff80c67c33 at _vn_lock+0x53 ystem full #4 0xffffffff80c4ea9b at vput_final+0x16b #5 0xffffffff80f112d3 at vm_object_deallocate_vnode+0xe3 #6 0xffffffff80f10fc0 at vm_object_deallocate+0xc0 #7 0xffffffff80f0b5af at vm_map_entry_deallocate+0x2f #8 0xffffffff80efe1c0 at vm_map_process_deferred+0x150 #9 0xffffffff80efdc2c at _vm_map_unlock+0x9c #10 0xffffffff80f079d4 at vm_map_remove+0xc4 #11 0xffffffff80efd1cf at vmspace_dofree+0x3f #12 0xffffffff80efd3c1 at vmspace_exit+0x131 #13 0xffffffff80b05613 at exit1+0x533 #14 0xffffffff80b050dd at sys_exit+0xd #15 0xffffffff8106c4e3 at amd64_syscall+0x153 #16 0xffffffff8103e18b at fast_syscall_common+0xf8 nlink=1, effnlink=1, size=104857600, extsize 0 generation=e8ee3f6b, uid=0, gid=0, flags=0x0 ino 4, on dev md10 vnode_pager_putpages: zero-length write at 39976960 resid 131072 0xfffffe019e9eb068: type VREG state VSTATE_CONSTRUCTED op 0xffffffff817376a8 usecount 1, writecount 0, refcount 3203 seqc users 0 hold count flags () flags (VIRF_PGREAD|VMP_LAZYLIST) v_object 0xfffff80067d6f630 ref 0 pages 25608 cleanbuf 3201 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff807e5e55740 (pid 5761, umount, tid 101446) #0 0xffffffff80b22529 at lockmgr_lock_flags+0x1d9 #1 0xffffffff80ece5cd at ffs_lock+0x9d #2 0xffffffff8114539d at VOP_LOCK1_APV+0x3d #3 0xffffffff80c67c33 at _vn_lock+0x53 #4 0xffffffff80c4e2f5 at vget_finish+0x75 #5 0xffffffff80c512bb at vfs_periodic_msync_inactive+0x16b #6 0xffffffff80c43b97 at dounmount+0x777 #7 0xffffffff80c433bb at kern_unmount+0x2eb #8 0xffffffff8106c4e3 at amd64_syscall+0x153 #9 0xffffffff8103e18b at fast_syscall_common+0xf8 nlink=1, effnlink=1, size=104857600, extsize 0 generation=e8ee3f6b, uid=0, gid=0, flags=0x0 ino 4, on dev md10 Jan 7 21:34:21 mercat1 kernel: pid 5761 (umount), uid 0 inumber 4 on /mnt: filesystem full 20240107 21:34:23 all (275/914): nullfs3.sh 20240107 21:34:27 all (276/914): pmc4.sh hwpmc: SOFT/16/64/0x67 TSC/1/64/0x20 IAP/4/48/0x3ff IAF/3/48/0x67 20240107 21:34:34 all (277/914): procfs2.sh 20240107 21:34:40 all (278/914): pthread.sh 20240107 21:34:46 all (279/914): routetbl.sh 20240107 21:35:50 all (280/914): tmpfs23.sh 20240107 21:35:56 all (281/914): tmpfs5.sh 20240107 21:36:02 all (282/914): udp.sh 20240107 21:36:07 all (283/914): udp2.sh 20240107 21:36:13 all (284/914): unix_socket.sh 20240107 21:36:19 all (285/914): kevent2.sh 20240107 21:36:27 all (286/914): lockd.sh 20240107 21:36:31 all (287/914): mkfifo6.sh 20240107 21:36:38 all (288/914): mmap13.sh 20240107 21:36:45 all (289/914): mountro4.sh 20240107 21:36:52 all (290/914): nfs12.sh 20240107 21:36:55 all (291/914): pmc5.sh hwpmc: SOFT/16/64/0x67 TSC/1/64/0x20 IAP/4/48/0x3ff IAF/3/48/0x67 root Jan 7 22:52:53 mercat1 login[3676]: ROOT LOGIN (root) ON ttyu1 Last login: Fri Jan 5 15:01:20 on ttyu1 FreeBSD 15.0-CURRENT #1 main-n267424-6f55a4e24c94-dirty: Sat Jan 6 16:09:47 CET 2024 pho@mercat1.netperf.freebsd.org:/usr/src/sys/amd64/compile/PHO Welcome to FreeBSD! Release Notes, Errata: https://www.FreeBSD.org/releases/ Security Advisories: https://www.FreeBSD.org/security/ FreeBSD Handbook: https://www.FreeBSD.org/handbook/ FreeBSD FAQ: https://www.FreeBSD.org/faq/ Questions List: https://www.FreeBSD.org/lists/questions/ FreeBSD Forums: https://forums.FreeBSD.org/ Documents installed with the system are in the /usr/local/share/doc/freebsd/ directory, or can be installed later with: pkg install en-freebsd-doc For other languages, replace "en" with a language code like de or fr. Show the version of FreeBSD installed: freebsd-version ; uname -a Please include that output and any error messages when posting questions. Introduction to manual pages: man man FreeBSD directory layout: man hier To change this login announcement, see motd(5). You have new mail. root@mercat1:~ # init 1 root@mercat1:~ # Stopping cron. Waiting for PIDS: 3642. Stopping sshd. Waiting for PIDS: 3659. Stopping inetd. Waiting for PIDS: 3639. Stopping nfsd. Waiting for PIDS: 3626 3638. Stopping mountd. Waiting for PIDS: 3614. Stopping powerd. Waiting for PIDS: 3606. Stopping ntpd. Waiting for PIDS: 3598. Stopping lockd. Waiting for PIDS: 3555. Stopping statd. Waiting for PIDS: 3548. Stopping rpcbind. Waiting for PIDS: 3537if_delmulti_locked: detaching ifnet instance 0xfffff8003180f000 . Stopping watchdogd. Waiting for PIDS: 3531, 3531. Stopping devd. Waiting for PIDS: 3312. Writing entropy file: . Writing early boot entropy file: . . Terminated Jan 7 22:52:59 mercat1 syslogd: exiting on signal 15 if_delmulti_locked: detaching ifnet instance 0xfffff800047c5800 2024-01-07T22:53:19.973068+01:00 mercat1.netperf.freebsd.org init 1 - - some processes would not die; ps axl advised Enter full pathname of shell or RETURN for /bin/sh: root@mercat1:/ # ps -aux USER PID %CPU %MEM VSZ RSS TT STAT STARTED TIME COMMAND root 11 1198.4 0.0 0 192 - RNL Sat22 17727:22.44 [idle] root 0 0.0 0.0 0 1664 - DLs Sat22 0:19.55 [kernel] root 1 0.0 0.0 11740 1208 - ILs Sat22 0:00.09 /sbin/init root 2 0.0 0.0 0 192 - WL Sat22 0:10.89 [clock] root 3 0.0 0.0 0 208 - DL Sat22 0:00.00 [crypto] root 4 0.0 0.0 0 80 - DL Sat22 0:04.86 [cam] root 5 0.0 0.0 0 16 - DL Sat22 0:00.00 [busdma] root 6 0.0 0.0 0 16 - DL Sat22 0:03.29 [rand_harvestq] root 7 0.0 0.0 0 16 - DL Sat22 0:00.22 [enc_daemon0] root 8 0.0 0.0 0 16 - DL Sat22 0:00.16 [enc_daemon1] root 9 0.0 0.0 0 48 - DL Sat22 0:13.71 [pagedaemon] root 10 0.0 0.0 0 16 - DL Sat22 0:00.00 [audit] root 12 0.0 0.0 0 768 - WL Sat22 0:24.83 [intr] root 13 0.0 0.0 0 48 - DL Sat22 0:01.90 [geom] root 14 0.0 0.0 0 16 - DL Sat22 0:00.00 [sequencer 00] root 15 0.0 0.0 0 240 - DL Sat22 0:11.37 [usb] root 16 0.0 0.0 0 16 - DL Sat22 0:00.20 [vmdaemon] root 17 0.0 0.0 0 160 - DL Sat22 0:08.46 [bufdaemon] root 18 0.0 0.0 0 16 - DL Sat22 0:00.23 [vnlru] root 19 0.0 0.0 0 16 - DL Sat22 0:30.72 [syncer] root 3423 0.0 0.0 13452 3228 - DE 21:37 0:00.00 /bin/sh ../tools/vmstat.sh root 6068 0.0 0.0 0 16 - DL 21:27 0:00.00 [aiod1] root 6069 0.0 0.0 0 16 - DL 21:27 0:00.00 [aiod2] root 6070 0.0 0.0 0 16 - DL 21:27 0:00.00 [aiod3] root 6071 0.0 0.0 0 16 - DL 21:27 0:00.00 [aiod4] root 6199 0.0 0.0 0 16 - DL 21:27 0:00.00 [soaiod1] root 6200 0.0 0.0 0 16 - DL 21:27 0:00.00 [soaiod2] root 6201 0.0 0.0 0 16 - DL 21:27 0:00.00 [soaiod3] root 6202 0.0 0.0 0 16 - DL 21:27 0:00.00 [soaiod4] root 70182 0.0 0.0 0 16 - DL 21:33 0:00.00 [ftcleanup] root 88914 0.0 0.0 0 16 - DL 21:26 0:00.00 [sctp_iterator] root 4163 0.0 0.0 13424 3572 u1 Ss 22:53 0:00.01 -sh (sh) root 4165 0.0 0.0 13496 3288 u1 R+ 22:54 0:00.00 ps -aux root 3421 0.0 0.0 12756 2448 0- D 21:37 0:00.00 kldunload hwpmc root@mercat1:/ # procstat -k 3421 PID TID COMM TDNAME KSTACK load: 0.25 cmd: procstat 4166 [kernel linker] 31.09r 0.00u 0.00s 0% 3164k KDB: enter: Break to debugger [ thread pid 11 tid 100003 ] Stopped at kdb_alt_break_internal+0x135: movq $0,0xe370c0(%rip) db> run pho db:0:pho> set $lines 20000 db:0:pho> run pho1 db:1:pho1> dump Dumping 3215 out of 32622 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% Dump complete db:1:pho1> bt Tracing pid 11 tid 100003 td 0xfffff80003c83740 kdb_alt_break_internal() at kdb_alt_break_internal+0x135/frame 0xfffffe00377f0b90 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe00377f0ba0 uart_intr_rxready() at uart_intr_rxready+0xf4/frame 0xfffffe00377f0bd0 uart_intr() at uart_intr+0x118/frame 0xfffffe00377f0c10 intr_event_handle() at intr_event_handle+0x12b/frame 0xfffffe00377f0c80 intr_execute_handlers() at intr_execute_handlers+0x63/frame 0xfffffe00377f0cb0 Xapic_isr1() at Xapic_isr1+0xdc/frame 0xfffffe00377f0cb0 --- interrupt, rip = 0xffffffff804cb59e, rsp = 0xfffffe00377f0d80, rbp = 0xfffffe00377f0db0 --- acpi_cpu_idle() at acpi_cpu_idle+0x27e/frame 0xfffffe00377f0db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe00377f0dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00377f0df0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe00377f0ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00377f0f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377f0f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:1:pho1> show allpcpu Current CPU: 0 cpuid = 0 dynamic pcpu = 0x9fb000 curthread = 0xfffff80003c83740: pid 11 tid 100003 critnest 2 "idle: cpu0" curpcb = 0xfffff80003c83c60 fpcurthread = none idlethread = 0xfffff80003c83740: tid 100003 "idle: cpu0" self = 0xffffffff82210000 curpmap = 0xffffffff8197fe90 tssp = 0xffffffff82210384 rsp0 = 0xfffffe00377f1000 kcr3 = 0x8000000002174004 ucr3 = 0xffffffffffffffff scr3 = 0x34d0d997c gs32p = 0xffffffff82210404 ldt = 0xffffffff82210444 tss = 0xffffffff82210434 curvnet = 0 spin locks held: cpuid = 1 dynamic pcpu = 0xfffffe00bb6ce000 curthread = 0xfffff80003c83000: pid 11 tid 100004 critnest 1 "idle: cpu1" curpcb = 0xfffff80003c83520 fpcurthread = none idlethread = 0xfffff80003c83000: tid 100004 "idle: cpu1" self = 0xffffffff82211000 curpmap = 0xffffffff8197fe90 tssp = 0xffffffff82211384 rsp0 = 0xfffffe00377ec000 kcr3 = 0x8000000002174002 ucr3 = 0xffffffffffffffff scr3 = 0x7e5f35d35 gs32p = 0xffffffff82211404 ldt = 0xffffffff82211444 tss = 0xffffffff82211434 curvnet = 0 spin locks held: cpuid = 2 dynamic pcpu = 0xfffffe00bb6dd000 curthread = 0xfffff80003c84740: pid 11 tid 100005 critnest 1 "idle: cpu2" curpcb = 0xfffff80003c84c60 fpcurthread = none idlethread = 0xfffff80003c84740: tid 100005 "idle: cpu2" self = 0xffffffff82212000 curpmap = 0xffffffff8197fe90 tssp = 0xffffffff82212384 rsp0 = 0xfffffe00377fb000 kcr3 = 0x8000000002174002 ucr3 = 0xffffffffffffffff scr3 = 0x2e346c93c gs32p = 0xffffffff82212404 ldt = 0xffffffff82212444 tss = 0xffffffff82212434 curvnet = 0 spin locks held: cpuid = 3 dynamic pcpu = 0xfffffe00bb6ec000 curthread = 0xfffff80003c84000: pid 11 tid 100006 critnest 1 "idle: cpu3" curpcb = 0xfffff80003c84520 fpcurthread = none idlethread = 0xfffff80003c84000: tid 100006 "idle: cpu3" self = 0xffffffff82213000 curpmap = 0xffffffff8197fe90 tssp = 0xffffffff82213384 rsp0 = 0xfffffe00377f6000 kcr3 = 0x8000000002174002 ucr3 = 0xffffffffffffffff scr3 = 0x6161ada1b gs32p = 0xffffffff82213404 ldt = 0xffffffff82213444 tss = 0xffffffff82213434 curvnet = 0 spin locks held: cpuid = 4 dynamic pcpu = 0xfffffe00bb6fb000 curthread = 0xfffff80003c8a740: pid 11 tid 100007 critnest 1 "idle: cpu4" curpcb = 0xfffff80003c8ac60 fpcurthread = none idlethread = 0xfffff80003c8a740: tid 100007 "idle: cpu4" self = 0xffffffff82214000 curpmap = 0xffffffff8197fe90 tssp = 0xffffffff82214384 rsp0 = 0xfffffe00e4831000 kcr3 = 0x8000000002174002 ucr3 = 0xffffffffffffffff scr3 = 0x46bd60b65 gs32p = 0xffffffff82214404 ldt = 0xffffffff82214444 tss = 0xffffffff82214434 curvnet = 0 spin locks held: cpuid = 5 dynamic pcpu = 0xfffffe00bb70a000 curthread = 0xfffff80003c8a000: pid 11 tid 100008 critnest 1 "idle: cpu5" curpcb = 0xfffff80003c8a520 fpcurthread = none idlethread = 0xfffff80003c8a000: tid 100008 "idle: cpu5" self = 0xffffffff82215000 curpmap = 0xffffffff8197fe90 tssp = 0xffffffff82215384 rsp0 = 0xfffffe0037800000 kcr3 = 0x8000000002174002 ucr3 = 0xffffffffffffffff scr3 = 0x2ceefdfbc gs32p = 0xffffffff82215404 ldt = 0xffffffff82215444 tss = 0xffffffff82215434 curvnet = 0 spin locks held: cpuid = 6 dynamic pcpu = 0xfffffe00bb719000 curthread = 0xfffff80003c74740: pid 11 tid 100009 critnest 1 "idle: cpu6" curpcb = 0xfffff80003c74c60 fpcurthread = none idlethread = 0xfffff80003c74740: tid 100009 "idle: cpu6" self = 0xffffffff82216000 curpmap = 0xffffffff8197fe90 tssp = 0xffffffff82216384 rsp0 = 0xfffffe00e483b000 kcr3 = 0x8000000002174002 ucr3 = 0xffffffffffffffff scr3 = 0x46bd6094f gs32p = 0xffffffff82216404 ldt = 0xffffffff82216444 tss = 0xffffffff82216434 curvnet = 0 spin locks held: cpuid = 7 dynamic pcpu = 0xfffffe00bb728000 curthread = 0xfffff80003c74000: pid 11 tid 100010 critnest 1 "idle: cpu7" curpcb = 0xfffff80003c74520 fpcurthread = none idlethread = 0xfffff80003c74000: tid 100010 "idle: cpu7" self = 0xffffffff82217000 curpmap = 0xffffffff8197fe90 tssp = 0xffffffff82217384 rsp0 = 0xfffffe00e4836000 kcr3 = 0x8000000002174002 ucr3 = 0xffffffffffffffff scr3 = 0x1774edc16 gs32p = 0xffffffff82217404 ldt = 0xffffffff82217444 tss = 0xffffffff82217434 curvnet = 0 spin locks held: cpuid = 8 dynamic pcpu = 0xfffffe00bb737000 curthread = 0xfffff80003c75740: pid 11 tid 100011 critnest 1 "idle: cpu8" curpcb = 0xfffff80003c75c60 fpcurthread = none idlethread = 0xfffff80003c75740: tid 100011 "idle: cpu8" self = 0xffffffff82218000 curpmap = 0xffffffff8197fe90 tssp = 0xffffffff82218384 rsp0 = 0xfffffe00e4845000 kcr3 = 0x8000000002174002 ucr3 = 0xffffffffffffffff scr3 = 0x34ddb7f8d gs32p = 0xffffffff82218404 ldt = 0xffffffff82218444 tss = 0xffffffff82218434 curvnet = 0 spin locks held: cpuid = 9 dynamic pcpu = 0xfffffe00bb746000 curthread = 0xfffff80003c75000: pid 11 tid 100012 critnest 1 "idle: cpu9" curpcb = 0xfffff80003c75520 fpcurthread = none idlethread = 0xfffff80003c75000: tid 100012 "idle: cpu9" self = 0xffffffff82219000 curpmap = 0xffffffff8197fe90 tssp = 0xffffffff82219384 rsp0 = 0xfffffe00e4840000 kcr3 = 0x8000000002174002 ucr3 = 0xffffffffffffffff scr3 = 0x5bb748ae2 gs32p = 0xffffffff82219404 ldt = 0xffffffff82219444 tss = 0xffffffff82219434 curvnet = 0 spin locks held: cpuid = 10 dynamic pcpu = 0xfffffe00bb755000 curthread = 0xfffff80003c76740: pid 11 tid 100013 critnest 1 "idle: cpu10" curpcb = 0xfffff80003c76c60 fpcurthread = none idlethread = 0xfffff80003c76740: tid 100013 "idle: cpu10" self = 0xffffffff8221a000 curpmap = 0xffffffff8197fe90 tssp = 0xffffffff8221a384 rsp0 = 0xfffffe00e484f000 kcr3 = 0x8000000002174002 ucr3 = 0xffffffffffffffff scr3 = 0x46bd60997 gs32p = 0xffffffff8221a404 ldt = 0xffffffff8221a444 tss = 0xffffffff8221a434 curvnet = 0 spin locks held: cpuid = 11 dynamic pcpu = 0xfffffe00bb764000 curthread = 0xfffff80003c76000: pid 11 tid 100014 critnest 1 "idle: cpu11" curpcb = 0xfffff80003c76520 fpcurthread = none idlethread = 0xfffff80003c76000: tid 100014 "idle: cpu11" self = 0xffffffff8221b000 curpmap = 0xffffffff8197fe90 tssp = 0xffffffff8221b384 rsp0 = 0xfffffe00e484a000 kcr3 = 0x8000000002174002 ucr3 = 0xffffffffffffffff scr3 = 0x3cbd1d21 gs32p = 0xffffffff8221b404 ldt = 0xffffffff8221b444 tss = 0xffffffff8221b434 curvnet = 0 spin locks held: db:1:pho1> show alllocks Process 3421 (kldunload) thread 0xfffff801776ff000 (359802) exclusive sx pmc-sx (pmc-sx) r = 0 (0xffffffff819852f0) locked @ /usr/src/sys/dev/hwpmc/hwpmc_mod.c:5693 exclusive sx kernel linker (kernel linker) r = 0 (0xffffffff819812c0) locked @ kern/kern_linker.c:1086 db:1:pho1> show lockedvnods Locked vnodes db:1:pho1> show mount 0xfffffe010e5bd700 /dev/gpt/work on / (ufs) 0xfffffe010e5be280 devfs on /dev (devfs) 0xfffffe016c170280 /dev/gpt/tmp on /tmp (ufs) 0xfffffe01b06b0000 procfs on /proc (procfs) More info: show mount db:1:pho1> show bufqueues bqempty: 84664 Buf domain 0 freebufs 13632 lofreebufs 219 hifreebufs 329 bufspace 10985472 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 1448 (10211328) dirtyq count 0 (0) wakeup 0 lim 25 CPU 9, 1, 13, 1, 0, 0, 3, 6, 2, 10, 5, 3, Locked buffers: 0 space 0 Total buffers: 9364 space 10985472 Buf domain 1 freebufs 12888 lofreebufs 219 hifreebufs 329 bufspace 37330944 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 2188 (36339712) dirtyq count 0 (0) wakeup 0 lim 25 CPU 16, 1, 5, 0, 1, 3, 0, 3, 0, 4, 23, 1, Locked buffers: 0 space 0 Total buffers: 18393 space 37330944 Buf domain 2 freebufs 12827 lofreebufs 219 hifreebufs 329 bufspace 38141952 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 2267 (37269504) dirtyq count 0 (0) wakeup 0 lim 25 CPU 1, 3, 11, 0, 0, 3, 5, 4, 0, 1, 10, 1, Locked buffers: 0 space 0 Total buffers: 12300 space 38141952 Buf domain 3 freebufs 13719 lofreebufs 219 hifreebufs 329 bufspace 9777152 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 1357 (9056256) dirtyq count 0 (0) wakeup 0 lim 25 CPU 9, 1, 4, 0, 2, 0, 24, 6, 2, 1, 6, 2, Locked buffers: 0 space 0 Total buffers: 15826 space 9777152 Buf domain 4 freebufs 13043 lofreebufs 219 hifreebufs 329 bufspace 30121984 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 1936 (26062848) dirtyq count 0 (0) wakeup 0 lim 25 CPU 13, 12, 18, 10, 4, 20, 5, 15, 9, 15, 20, 13, Locked buffers: 0 space 0 Total buffers: 21294 space 30121984 Buf domain 5 freebufs 13401 lofreebufs 219 hifreebufs 329 bufspace 16732160 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 1676 (16179200) dirtyq count 0 (0) wakeup 0 lim 25 CPU 15, 1, 8, 0, 1, 1, 8, 1, 2, 3, 12, 4, Locked buffers: 0 space 0 Total buffers: 17590 space 16732160 Buf domain 6 freebufs 13253 lofreebufs 219 hifreebufs 329 bufspace 24158208 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 1813 (22441984) dirtyq count 0 (0) wakeup 0 lim 25 CPU 24, 0, 8, 1, 5, 1, 11, 3, 1, 6, 4, 3, Locked buffers: 0 space 0 Total buffers: 11164 space 24158208 db:1:pho1> show page vm_cnt.v_free_count: 7468844 vm_cnt.v_inactive_count: 38979 vm_cnt.v_active_count: 1175 vm_cnt.v_laundry_count: 199 vm_cnt.v_wire_count: 615855 vm_cnt.v_free_reserved: 10643 vm_cnt.v_free_min: 51260 vm_cnt.v_free_target: 173111 vm_cnt.v_inactive_target: 259666 db:1:pho1> show pageq pq_free 7468844 dom 0 page_cnt 8123551 free 7468844 pq_act 1175 pq_inact 38979 pq_laund 199 pq_unsw 0 db:0:pho> show freepages DOMAIN: 0 FREE LIST 0: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 001161 | 000000 11 (008192K) | 000401 | 000000 10 (004096K) | 000372 | 000000 09 (002048K) | 001292 | 000001 08 (001024K) | 000995 | 000001 07 (000512K) | 001264 | 000003 06 (000256K) | 001522 | 000030 05 (000128K) | 001721 | 000137 04 (000064K) | 001865 | 000408 03 (000032K) | 002297 | 000521 02 (000016K) | 001082 | 000821 01 (000008K) | 001490 | 003865 00 (000004K) | 000336 | 009426 FREE LIST 1: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000000 | 000000 09 (002048K) | 000000 | 000000 08 (001024K) | 000001 | 000000 07 (000512K) | 000000 | 000000 06 (000256K) | 000001 | 000000 05 (000128K) | 000001 | 000000 04 (000064K) | 000002 | 000000 03 (000032K) | 000000 | 000000 02 (000016K) | 000001 | 000000 01 (000008K) | 000001 | 000000 00 (000004K) | 000001 | 000000 db:0:pho> show uma Zone Size Used Free Requests Sleeps Bucket Total Mem XFree FFS inode 1168 614412 2526 2064805 0 9 720583584 0 VNODE 600 614687 4594 2125364 0 17 371568600 0 FFS2 dinode 256 614412 4728 2064684 0 62 158499840 0 malloc-4096 4096 34151 21 34364 0 2 139968512 0 L VFS Cache 320 251630 526 537013 0 30 80689920 0 S VFS Cache 104 366039 165726 1618776 0 126 55303560 0 VM OBJECT 264 170627 7378 8166250 0 30 46993320 0 mbuf_cluster 2048 16608 254 25603821 0 29 34533376 0 UMA Slabs 0 112 137617 29993 184140 0 126 18772320 0 RADIX NODE 144 32787 83663 31186206 0 76 16768800 0 BUF TRIE 144 636 105316 815004 0 63 15257088 0 pipe 728 3 18092 774894 0 16 13173160 0 malloc-128 128 99755 1894 514198 0 126 13011072 0 swblk 136 25 90919 94211 0 62 12368384 0 vmem btag 56 167559 35109 238285 0 254 11349408 0 malloc-128 128 85726 2035 1306986 0 126 11233408 0 malloc-256 256 82 34943 1159272 0 62 8966400 0 Files 80 7 92993 5316609 0 126 7440000 0 mbuf 256 16555 4519 76863257 0 254 5394944 0 malloc-2048 2048 6 2228 125212 0 8 4575232 0 malloc-8192 8192 35 512 1052 0 1 4481024 0 malloc-4096 4096 373 553 885973 0 2 3792896 0 pbuf 2776 0 1198 0 0 0 3325648 0 THREAD 1824 1394 252 259850 0 8 3002304 0 malloc-16 16 177053 4197 357511 0 254 2900000 0 malloc-128 128 18506 3504 1616026 0 126 2817280 0 malloc-32 32 79286 3622 162767 0 254 2653056 0 malloc-128 128 438 16891 204550 0 126 2218112 0 MAP ENTRY 96 148 22196 30492739 0 127 2145024 0 128 Bucket 1024 943 1000 335899 0 16 1989632 0 256 Bucket 2048 858 96 504256 0 8 1953792 0 64 Bucket 512 1594 1862 235757 0 30 1769472 0 malloc-384 384 22 4378 54053 0 30 1689600 0 32 Bucket 256 1014 5556 319698 0 62 1681920 0 PROC 1376 33 1155 604385 0 8 1634688 0 malloc-32768 32768 10 38 12480 0 1 1572864 0 sctp_ep 1176 0 1270 7 0 254 1493520 0 FPU_save_area 832 1396 395 359174 0 16 1490112 0 malloc-16384 16384 50 32 5486 0 1 1343488 0 malloc-256 256 1484 3646 447203 0 62 1313280 0 swpctrie 144 8 8896 8792 0 62 1282176 0 DIRHASH 1024 1086 154 20178 0 16 1269760 0 malloc-4096 4096 16 276 547 0 2 1196032 0 sctp_asoc 2256 0 510 2 0 254 1150560 0 filedesc0 1072 34 1030 604386 0 8 1140608 0 malloc-64 64 12488 4900 786776 0 254 1112832 0 mbuf_packet 256 3 4318 276308 0 254 1106176 0 malloc-65536 65536 7 9 18 0 1 1048576 0 malloc-32768 32768 13 18 57 0 1 1015808 0 malloc-32768 32768 2 27 31665 0 1 950272 0 malloc-64 64 11683 2807 52769 0 254 927360 0 malloc-65536 65536 3 11 4753 0 1 917504 0 malloc-512 512 1416 336 982791 0 30 897024 0 malloc-384 384 177 2153 4775 0 30 894720 0 malloc-32768 32768 7 20 872 0 1 884736 0 malloc-16384 16384 3 50 655762 0 1 868352 0 malloc-65536 65536 0 13 45 0 1 851968 0 malloc-32768 32768 13 13 49 0 1 851968 0 malloc-256 256 142 3173 354850 0 62 848640 0 malloc-65536 65536 0 12 2132 0 1 786432 0 VMSPACE 616 5 1231 603473 0 16 761376 0 malloc-8192 8192 86 0 86 0 1 704512 0 16 Bucket 144 1545 3159 1304242 0 62 677376 0 g_bio 408 0 1520 2834593 0 31 620160 0 malloc-128 128 3352 1484 15567 0 126 619008 0 malloc-384 384 1203 297 13053 0 30 576000 0 malloc-256 256 25 2165 7825 0 62 560640 0 malloc-128 128 117 4254 13454 0 126 559488 0 lkpicurr 176 13 3092 13 0 62 546480 0 lkpimm 176 3 3079 3 0 62 542432 0 malloc-1024 1024 235 289 25808 0 16 536576 0 UMA Zones 2048 238 6 240 0 8 499712 0 malloc-256 256 308 1597 81498 0 62 487680 0 malloc-256 256 649 1256 942903 0 62 487680 0 malloc-64 64 4439 2869 5028 0 254 467712 0 malloc-2048 2048 155 61 206 0 8 442368 0 malloc-8192 8192 16 37 35148 0 1 434176 0 ksiginfo 112 1170 2394 104805 0 126 399168 0 sctp_raddr 736 0 517 2 0 254 380512 0 Mountpoints 2944 4 120 8314 0 4 365056 0 malloc-32 32 8392 2948 43323 0 254 362880 0 malloc-16384 16384 7 15 80 0 1 360448 0 socket 960 2 370 17866 0 16 357120 0 clpbuf 2776 0 120 46639 0 4 333120 0 malloc-128 128 700 1873 48538 0 126 329344 0 malloc-64 64 68 5035 1210742 0 254 326592 0 malloc-1024 1024 142 174 6939 0 16 323584 0 2 Bucket 32 3146 6934 711723 0 254 322560 0 malloc-16 16 16468 2782 448722 0 254 308000 0 malloc-256 256 10 1190 52179 0 62 307200 0 malloc-8192 8192 3 34 8125 0 1 303104 0 TURNSTILE 136 1647 411 1647 0 62 279888 0 8 Bucket 80 896 2504 435959 0 126 272000 0 malloc-1024 1024 8 240 923080 0 16 253952 0 swrbuf 2776 0 90 166021 0 4 249840 0 malloc-2048 2048 6 114 1136639 0 8 245760 0 SLEEPQUEUE 88 1647 1073 1647 0 126 239360 0 malloc-8192 8192 19 10 3109 0 1 237568 0 malloc-1024 1024 7 225 8128 0 16 237568 0 ttyoutq 256 93 822 3283 0 62 234240 0 malloc-64 64 63 3591 1014559 0 254 233856 0 malloc-64 64 500 3091 5323343 0 254 229824 0 NAMEI 1024 0 224 10318982 0 16 229376 0 malloc-1024 1024 29 195 43364 0 16 229376 0 udp_inpcb 424 2 529 6900 0 30 225144 0 malloc-512 512 2 422 203537 0 30 217088 0 malloc-2048 2048 8 96 17012 0 8 212992 0 malloc-2048 2048 2 96 1474 0 8 200704 0 malloc-1024 1024 2 194 59291 0 16 200704 0 malloc-1024 1024 20 176 566 0 16 200704 0 malloc-128 128 23 1527 93648 0 126 198400 0 malloc-64 64 5 3082 16560 0 254 197568 0 unpcb 256 0 765 10331 0 62 195840 0 malloc-512 512 3 373 912319 0 30 192512 0 malloc-256 256 16 719 11256 0 62 188160 0 PGRP 120 5 1546 1393 0 126 186120 0 4 Bucket 48 124 3572 111185 0 254 177408 0 malloc-512 512 12 332 1104 0 30 176128 0 pcpu-64 64 483 2269 496 0 254 176128 0 TMPFS node 232 0 748 31382 0 62 173536 0 malloc-512 512 1 335 785 0 30 172032 0 ttyinq 160 180 895 6195 0 62 172000 0 PWD 40 5 4237 407201 0 254 169680 0 DEVCTL 1024 1 163 68586 0 0 167936 0 malloc-2048 2048 9 73 9016 0 8 167936 0 ertt_txseginfo 40 0 4141 4964271 0 254 165640 0 tcp_inpcb 1312 0 126 256 0 8 165312 0 KNOTE 160 0 1025 646633 0 62 164000 0 malloc-384 384 61 359 294278 0 30 161280 0 fakepg 104 0 1521 1461 0 126 158184 0 malloc-512 512 3 277 199 0 30 143360 0 ada_ccb 272 0 518 481920 0 30 140896 0 malloc-4096 4096 6 28 505521 0 2 139264 0 malloc-512 512 33 239 55 0 30 139264 0 malloc-4096 4096 1 32 8232 0 2 135168 0 rl_entry 40 383 2950 31882 0 254 133320 0 malloc-65536 65536 2 0 7 0 1 131072 0 malloc-65536 65536 2 0 2 0 1 131072 0 malloc-65536 65536 2 0 2 0 1 131072 0 malloc-32768 32768 4 0 4 0 1 131072 0 malloc-32 32 608 3424 209539 0 254 129024 0 malloc-384 384 13 307 49 0 30 122880 0 udp_inpcb ports 32 1 3779 762 0 254 120960 0 swwbuf 2776 0 40 50067 0 2 111040 0 malloc-32 32 321 2955 51657 0 254 104832 0 malloc-4096 4096 1 24 17537 0 2 102400 0 malloc-32 32 11 3139 33229 0 254 100800 0 FFS1 dinode 128 0 775 118 0 126 99200 0 malloc-16384 16384 2 4 20 0 1 98304 0 malloc-32 32 85 2813 8015 0 254 92736 0 malloc-32 32 77 2695 7250 0 254 88704 0 malloc-16384 16384 5 0 5 0 1 81920 0 UMA Kegs 384 209 4 211 0 30 81792 0 malloc-16 16 264 4736 883730 0 254 80000 0 tcp_inpcb ports 32 0 2394 127 0 254 76608 0 ertt 72 0 952 256 0 126 68544 0 dtrace_state_cache 65536 0 1 1 0 1 65536 0 malloc-384 384 3 157 17 0 30 61440 0 malloc-16 16 256 3494 389586 0 254 60000 0 malloc-4096 4096 14 0 25 0 2 57344 0 malloc-64 64 34 785 70 0 254 52416 0 malloc-32 32 1091 547 552848 0 254 52416 0 malloc-16 16 15 3235 51814 0 254 52000 0 malloc-16 16 62 3188 131811 0 254 52000 0 pcpu-8 8 4784 1360 4825 0 254 49152 0 pcpu-16 16 124 2692 124 0 254 45056 0 sctp_chunk 152 0 260 2 0 254 39520 0 ripcb 392 0 99 8 0 30 38808 0 kenv 258 18 132 27415 0 30 38700 0 hostcache 64 1 566 5 0 254 36288 0 STS VFS Cache 144 0 252 352 0 62 36288 0 malloc-16 16 28 1972 34 0 254 32000 0 malloc-16 16 614 1386 1686005 0 254 32000 0 AIO 208 0 133 2 0 62 27664 0 malloc-8192 8192 3 0 3 0 1 24576 0 syncache 168 0 144 101 0 62 24192 0 umtx pi 96 0 252 2 0 126 24192 0 routing nhops 256 9 81 14 0 62 23040 0 malloc-384 384 8 52 10 0 30 23040 0 vnpbuf 2776 0 8 2484 0 4 22208 0 rtentry 168 12 108 14 0 62 20160 0 cryptop 280 0 70 3 0 30 19600 0 AIOCB 552 0 35 2 0 16 19320 0 cpuset 200 27 69 27 0 62 19200 0 malloc-8192 8192 2 0 2 0 1 16384 0 malloc-1024 1024 11 5 15 0 16 16384 0 sctp_laddr 48 0 336 2 0 254 16128 0 NCLNODE 760 0 20 365 0 16 15200 0 malloc-2048 2048 3 3 3 0 8 12288 0 KMAP ENTRY 96 89 34 157 0 0 11808 0 itimer 352 0 33 20 0 30 11616 0 malloc-384 384 14 16 27 0 30 11520 0 mbuf_jumbo_page 4096 0 2 4 0 2 8192 0 malloc-8192 8192 1 0 1 0 1 8192 0 malloc-2048 2048 2 2 74188 0 8 8192 0 epoch_record pcpu 256 4 12 4 0 62 4096 0 malloc-4096 4096 1 0 13 0 2 4096 0 SMR CPU 32 7 120 7 0 254 4064 0 vtnet_tx_hdr 24 0 167 0 0 254 4008 0 LTS VFS Cache 360 0 11 1 0 30 3960 0 UMA Slabs 1 176 11 11 11 0 62 3872 0 vmem 1856 1 1 1 0 8 3712 0 SMR SHARED 24 7 120 7 0 254 3048 0 taskq_zone 160 0 0 0 0 62 0 0 sctp_asconf_ack 48 0 0 0 0 254 0 0 sctp_asconf 40 0 0 0 0 254 0 0 sctp_stream_msg_out 112 0 0 0 0 254 0 0 sctp_readq 152 0 0 0 0 254 0 0 da_ccb 544 0 0 0 0 16 0 0 tfo_ccache_entries 80 0 0 0 0 126 0 0 tfo 4 0 0 0 0 254 0 0 sackhole 32 0 0 0 0 254 0 0 ipq 56 0 0 0 0 254 0 0 tcp_log_id_node 120 0 0 0 0 126 0 0 tcp_log_id_bucket 176 0 0 0 0 62 0 0 tcp_log 416 0 0 0 0 30 0 0 tcpreass 48 0 0 0 0 254 0 0 udplite_inpcb ports 32 0 0 0 0 254 0 0 udplite_inpcb 424 0 0 0 0 30 0 0 ripcb ports 32 0 0 0 0 254 0 0 IPsec SA lft_c 16 0 0 0 0 254 0 0 AIOLIO 272 0 0 0 0 30 0 0 linux_dma_object 32 0 0 0 0 254 0 0 linux_dma_pctrie 144 0 0 0 0 62 0 0 IOMMU_MAP_ENTRY 104 0 0 0 0 126 0 0 mbuf_jumbo_16k 16384 0 0 0 0 1 0 0 mbuf_jumbo_9k 9216 0 0 0 0 1 0 0 audit_record 1280 0 0 0 0 8 0 0 domainset 40 0 0 0 0 254 0 0 MAC labels 40 0 0 0 0 254 0 0 nfspbuf 2776 0 0 0 0 4 0 0 umtx_shm 88 0 0 0 0 126 0 0 rangeset pctrie nodes 144 0 0 0 0 62 0 0 malloc-65536 65536 0 0 0 0 1 0 0 malloc-32768 32768 0 0 0 0 1 0 0 malloc-32768 32768 0 0 0 0 1 0 0 malloc-16384 16384 0 0 0 0 1 0 0 malloc-16384 16384 0 0 0 0 1 0 0 malloc-16384 16384 0 0 0 0 1 0 0 malloc-512 512 0 0 4 0 30 0 0 pcpu-32 32 0 0 0 0 254 0 0 pcpu-4 4 0 0 0 0 254 0 0 UMA Hash 256 0 0 0 0 62 0 0 db:0:pho> show umacache Zone Size Used Free Requests Bucket debugnet_mbuf_packet 2048 0 0 0 0 debugnet_mbuf_cluster 2048 -6144 0 0 0 debugnet_mbuf 256 -10240 0 0 0 vm pgcache 4096 185268 4897 24098465 37 vm pgcache 4096 41153 3087 34716350 70 buf free cache 848 13168 8099 2910331 19 buffer arena-65 65536 0 1908 775275 5 buffer arena-61 61440 0 0 0 1 buffer arena-57 57344 0 0 0 1 buffer arena-53 53248 0 0 0 1 buffer arena-49 49152 0 0 0 1 buffer arena-45 45056 0 0 0 1 buffer arena-40 40960 0 0 0 1 buffer arena-36 36864 0 0 0 1 buffer arena-32 32768 6420 10 227214 1 buffer arena-28 28672 0 0 0 1 buffer arena-24 24576 0 0 0 1 buffer arena-20 20480 0 0 0 1 buffer arena-16 16384 3 3959 110465 1 buffer arena-12 12288 0 0 0 1 buffer arena-81 8192 0 0 0 1 buffer arena-40 4096 0 0 0 2 kstack_cache 16384 1394 105 259850 2 db:0:pho> acttrace Tracing command idle pid 11 tid 100003 td 0xfffff80003c83740 (CPU 0) kdb_alt_break_internal() at kdb_alt_break_internal+0x135/frame 0xfffffe00377f0b90 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe00377f0ba0 uart_intr_rxready() at uart_intr_rxready+0xf4/frame 0xfffffe00377f0bd0 uart_intr() at uart_intr+0x118/frame 0xfffffe00377f0c10 intr_event_handle() at intr_event_handle+0x12b/frame 0xfffffe00377f0c80 intr_execute_handlers() at intr_execute_handlers+0x63/frame 0xfffffe00377f0cb0 Xapic_isr1() at Xapic_isr1+0xdc/frame 0xfffffe00377f0cb0 --- interrupt, rip = 0xffffffff804cb59e, rsp = 0xfffffe00377f0d80, rbp = 0xfffffe00377f0db0 --- acpi_cpu_idle() at acpi_cpu_idle+0x27e/frame 0xfffffe00377f0db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe00377f0dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00377f0df0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe00377f0ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00377f0f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377f0f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffff80003c83000 (CPU 1) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ce3cdf0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003ce3ce00 trap() at trap+0x56/frame 0xfffffe003ce3cf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce3cf20 --- trap 0x13, rip = 0xffffffff8102877e, rsp = 0xfffffe00377ebd78, rbp = 0xfffffe00377ebdb0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe00377ebdb0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe00377ebdd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00377ebdf0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe00377ebef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00377ebf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377ebf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffff80003c84740 (CPU 2) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ce4bdf0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003ce4be00 trap() at trap+0x56/frame 0xfffffe003ce4bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce4bf20 --- trap 0x13, rip = 0xffffffff8102877e, rsp = 0xfffffe00377fad78, rbp = 0xfffffe00377fadb0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe00377fadb0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe00377fadd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00377fadf0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe00377faef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00377faf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377faf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffff80003c84000 (CPU 3) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ce5adf0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003ce5ae00 trap() at trap+0x56/frame 0xfffffe003ce5af20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce5af20 --- trap 0x13, rip = 0xffffffff8102877e, rsp = 0xfffffe00377f5d78, rbp = 0xfffffe00377f5db0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe00377f5db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe00377f5dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00377f5df0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe00377f5ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00377f5f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377f5f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffff80003c8a740 (CPU 4) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ce69df0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003ce69e00 trap() at trap+0x56/frame 0xfffffe003ce69f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce69f20 --- trap 0x13, rip = 0xffffffff8102877e, rsp = 0xfffffe00e4830d78, rbp = 0xfffffe00e4830db0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe00e4830db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe00e4830dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00e4830df0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe00e4830ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4830f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4830f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffff80003c8a000 (CPU 5) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ce78df0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003ce78e00 trap() at trap+0x56/frame 0xfffffe003ce78f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce78f20 --- trap 0x13, rip = 0xffffffff8102877e, rsp = 0xfffffe00377ffd78, rbp = 0xfffffe00377ffdb0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe00377ffdb0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe00377ffdd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00377ffdf0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe00377ffef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00377fff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377fff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffff80003c74740 (CPU 6) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ce87df0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003ce87e00 trap() at trap+0x56/frame 0xfffffe003ce87f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce87f20 --- trap 0x13, rip = 0xffffffff8102877e, rsp = 0xfffffe00e483ad78, rbp = 0xfffffe00e483adb0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe00e483adb0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe00e483add0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00e483adf0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe00e483aef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e483af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e483af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffff80003c74000 (CPU 7) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ce96df0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003ce96e00 trap() at trap+0x56/frame 0xfffffe003ce96f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce96f20 --- trap 0x13, rip = 0xffffffff8102877e, rsp = 0xfffffe00e4835d78, rbp = 0xfffffe00e4835db0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe00e4835db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe00e4835dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00e4835df0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe00e4835ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4835f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4835f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffff80003c75740 (CPU 8) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003cea5df0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003cea5e00 trap() at trap+0x56/frame 0xfffffe003cea5f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003cea5f20 --- trap 0x13, rip = 0xffffffff8102877e, rsp = 0xfffffe00e4844d78, rbp = 0xfffffe00e4844db0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe00e4844db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe00e4844dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00e4844df0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe00e4844ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4844f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4844f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffff80003c75000 (CPU 9) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ceb4df0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003ceb4e00 trap() at trap+0x56/frame 0xfffffe003ceb4f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ceb4f20 --- trap 0x13, rip = 0xffffffff8102877e, rsp = 0xfffffe00e483fd78, rbp = 0xfffffe00e483fdb0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe00e483fdb0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe00e483fdd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00e483fdf0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe00e483fef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e483ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e483ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffff80003c76740 (CPU 10) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003cec3df0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003cec3e00 trap() at trap+0x56/frame 0xfffffe003cec3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003cec3f20 --- trap 0x13, rip = 0xffffffff8102877e, rsp = 0xfffffe00e484ed78, rbp = 0xfffffe00e484edb0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe00e484edb0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe00e484edd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00e484edf0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe00e484eef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e484ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e484ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffff80003c76000 (CPU 11) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ced2df0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003ced2e00 trap() at trap+0x56/frame 0xfffffe003ced2f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ced2f20 --- trap 0x13, rip = 0xffffffff8102877e, rsp = 0xfffffe00e4849d78, rbp = 0xfffffe00e4849db0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe00e4849db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe00e4849dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00e4849df0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe00e4849ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4849f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4849f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:pho> ps pid ppid pgrp uid state wmesg wchan cmd 4166 4163 4166 0 D+ kernel 0xffffffff819812c0 procstat 4163 1 4163 0 Ss+ wait 0xfffffe016c167580 sh 3423 1 23006 0 DE pmc-sx 0xffffffff819852f0 sh 3421 1 12634 0 DL+ evhrm 0xfffff8000324ee00 kldunload 70182 0 0 0 DL ftcl 0xffffffff8275f5cc [ftcleanup] 6202 0 0 0 DL - 0xffffffff81a9f92c [soaiod4] 6201 0 0 0 DL - 0xffffffff81a9f92c [soaiod3] 6200 0 0 0 DL - 0xffffffff81a9f92c [soaiod2] 6199 0 0 0 DL - 0xffffffff81a9f92c [soaiod1] 6071 0 0 0 DL aiordy 0xfffffe016c140000 [aiod4] 6070 0 0 0 DL aiordy 0xfffffe01b0396560 [aiod3] 6069 0 0 0 DL aiordy 0xfffffe016ccc8060 [aiod2] 6068 0 0 0 DL aiordy 0xfffffe01663aa000 [aiod1] 88914 0 0 0 DL waiting 0xffffffff826cec80 [sctp_iterator] 19 0 0 0 DL syncer 0xffffffff81aa9928 [syncer] 18 0 0 0 DL vlruwt 0xfffffe010e5b9020 [vnlru] 17 0 0 0 DL (threaded) [bufdaemon] 100201 D psleep 0xffffffff81aa8940 [bufdaemon] 100202 D - 0xffffffff81603100 [bufspacedaemon-0] 100203 D - 0xffffffff81603380 [bufspacedaemon-1] 100204 D - 0xffffffff81603600 [bufspacedaemon-2] 100205 D - 0xffffffff81603880 [bufspacedaemon-3] 100206 D - 0xffffffff81603b00 [bufspacedaemon-4] 100207 D - 0xffffffff81603d80 [bufspacedaemon-5] 100208 D - 0xffffffff81604000 [bufspacedaemon-6] 100232 D sdflush 0xfffff8003d474ce8 [/ worker] 100251 D sdflush 0xfffff8003d79fce8 [/tmp worker] 16 0 0 0 DL psleep 0xffffffff81adc450 [vmdaemon] 9 0 0 0 DL (threaded) [pagedaemon] 100197 D psleep 0xffffffff81ac4878 [dom0] 100198 D launds 0xffffffff81ac4884 [laundry: dom0] 100199 D umarcl 0xffffffff80ef0640 [uma] 8 0 0 0 DL idle 0xfffffe003ce72ac0 [enc_daemon1] 7 0 0 0 DL idle 0xfffffe003ce73020 [enc_daemon0] 6 0 0 0 DL - 0xffffffff817c4960 [rand_harvestq] 15 0 0 0 DL (threaded) [usb] 100127 D - 0xfffffe010a1cf440 [usbus0] 100128 D - 0xfffffe010a1cf498 [usbus0] 100129 D - 0xfffffe010a1cf4f0 [usbus0] 100130 D - 0xfffffe010a1cf548 [usbus0] 100131 D - 0xfffffe010a1cf5a0 [usbus0] 100133 D - 0xfffffe00e4d9ccf0 [usbus1] 100134 D - 0xfffffe00e4d9cd48 [usbus1] 100135 D - 0xfffffe00e4d9cda0 [usbus1] 100136 D - 0xfffffe00e4d9cdf8 [usbus1] 100137 D - 0xfffffe00e4d9ce50 [usbus1] 100138 D - 0xfffffe010a57ccf0 [usbus2] 100139 D - 0xfffffe010a57cd48 [usbus2] 100140 D - 0xfffffe010a57cda0 [usbus2] 100141 D - 0xfffffe010a57cdf8 [usbus2] 100142 D - 0xfffffe010a57ce50 [usbus2] 5 0 0 0 DL - 0xffffffff81ae6118 [busdma] 4 0 0 0 DL (threaded) [cam] 100120 D - 0xffffffff81796240 [doneq0] 100121 D - 0xffffffff817962c0 [doneq1] 100122 D - 0xffffffff81796340 [doneq2] 100123 D - 0xffffffff817961c0 [async] 100152 D - 0xffffffff81796090 [scanner] 3 0 0 0 DL (threaded) [crypto] 100107 D crypto_ 0xffffffff81ac1cf0 [crypto] 100108 D crypto_ 0xfffff8000410fc30 [crypto returns 0] 100109 D crypto_ 0xfffff8000410fc80 [crypto returns 1] 100110 D crypto_ 0xfffff8000410fcd0 [crypto returns 2] 100111 D crypto_ 0xfffff8000410fd20 [crypto returns 3] 100112 D crypto_ 0xfffff8000410fd70 [crypto returns 4] 100113 D crypto_ 0xfffff8000410fdc0 [crypto returns 5] 100114 D crypto_ 0xfffff8000410fe10 [crypto returns 6] 100115 D crypto_ 0xfffff8000410fe60 [crypto returns 7] 100116 D crypto_ 0xfffff8000410feb0 [crypto returns 8] 100117 D crypto_ 0xfffff8000410ff00 [crypto returns 9] 100118 D crypto_ 0xfffff8000410ff50 [crypto returns 10] 100119 D crypto_ 0xfffff8000410ffa0 [crypto returns 11] 14 0 0 0 DL seqstat 0xfffff8000407b088 [sequencer 00] 13 0 0 0 DL (threaded) [geom] 100091 D - 0xffffffff8197eb50 [g_event] 100092 D - 0xffffffff8197eb58 [g_up] 100093 D - 0xffffffff8197eb60 [g_down] 2 0 0 0 WL (threaded) [clock] 100077 I [clock (0)] 100078 I [clock (1)] 100079 I [clock (2)] 100080 I [clock (3)] 100081 I [clock (4)] 100082 I [clock (5)] 100083 I [clock (6)] 100084 I [clock (7)] 100085 I [clock (8)] 100086 I [clock (9)] 100087 I [clock (10)] 100088 I [clock (11)] 12 0 0 0 WL (threaded) [intr] 100042 I [swi6: task queue] 100043 I [swi6: Giant taskq] 100045 I [swi5: fast taskq] 100089 I [swi1: netisr 0] 100124 I [irq56: ahci0] 100126 I [irq19: xhci0] 100132 I [irq18: ehci0 ehci1+] 100143 I [irq71: ahci1] 100144 I [swi4: apei] 100145 I [swi0: uart uart] 100159 I [irq73: mlx5_core0] 100160 I [irq74: mlx5_core0] 100161 I [irq72: mlx5_core0] 100162 I [irq75: mlx5_core0] 100163 I [irq76: mlx5_core0] 100164 I [irq77: mlx5_core0] 100165 I [irq78: mlx5_core0] 100166 I [irq79: mlx5_core0] 100167 I [irq80: mlx5_core0] 100168 I [irq81: mlx5_core0] 100169 I [irq82: mlx5_core0] 100170 I [irq83: mlx5_core0] 100171 I [irq84: mlx5_core0] 100172 I [irq85: mlx5_core0] 100173 I [irq86: mlx5_core0] 100180 I [irq88: mlx5_core1] 100181 I [irq89: mlx5_core1] 100182 I [irq87: mlx5_core1] 100183 I [irq90: mlx5_core1] 100184 I [irq91: mlx5_core1] 100185 I [irq92: mlx5_core1] 100186 I [irq93: mlx5_core1] 100187 I [irq94: mlx5_core1] 100188 I [irq95: mlx5_core1] 100189 I [irq96: mlx5_core1] 100190 I [irq97: mlx5_core1] 100191 I [irq98: mlx5_core1] 100192 I [irq99: mlx5_core1] 100193 I [irq100: mlx5_core1] 100194 I [irq101: mlx5_core1] 100240 I [irq102: ioat0] 100241 I [irq103: ioat1] 100242 I [irq104: ioat2] 100243 I [irq105: ioat3] 100244 I [irq106: ioat4] 100245 I [irq107: ioat5] 100246 I [irq108: ioat6] 100247 I [irq109: ioat7] 11 0 0 0 RL (threaded) [idle] 100003 Run CPU 0 [idle: cpu0] 100004 Run CPU 1 [idle: cpu1] 100005 Run CPU 2 [idle: cpu2] 100006 Run CPU 3 [idle: cpu3] 100007 Run CPU 4 [idle: cpu4] 100008 Run CPU 5 [idle: cpu5] 100009 Run CPU 6 [idle: cpu6] 100010 Run CPU 7 [idle: cpu7] 100011 Run CPU 8 [idle: cpu8] 100012 Run CPU 9 [idle: cpu9] 100013 Run CPU 10 [idle: cpu10] 100014 Run CPU 11 [idle: cpu11] 1 0 1 0 SLs wait 0xfffffe00e4c84040 [init] 10 0 0 0 DL audit_w 0xffffffff81ac21f0 [audit] 0 0 0 0 DLs (threaded) [kernel] 100000 D swapin 0xffffffff8197f0c0 [swapper] 100015 D - 0xfffff80003a6f000 [softirq_0] 100016 D - 0xfffff80003a6ed00 [softirq_1] 100017 D - 0xfffff80003a6eb00 [softirq_2] 100018 D - 0xfffff80003a6e900 [softirq_3] 100019 D - 0xfffff80003a6e700 [softirq_4] 100020 D - 0xfffff80003a6e500 [softirq_5] 100021 D - 0xfffff80003a6e300 [softirq_6] 100022 D - 0xfffff80003a6e100 [softirq_7] 100023 D - 0xfffff80003a6de00 [softirq_8] 100024 D - 0xfffff80003a6dc00 [softirq_9] 100025 D - 0xfffff80003a6da00 [softirq_10] 100026 D - 0xfffff80003a6d800 [softirq_11] 100027 D - 0xfffff80003a6d600 [if_io_tqg_0] 100028 D - 0xfffff80003a6d400 [if_io_tqg_1] 100029 D - 0xfffff80003a6d200 [if_io_tqg_2] 100030 D - 0xfffff80003a6d000 [if_io_tqg_3] 100031 D - 0xfffff80003a6cd00 [if_io_tqg_4] 100032 D - 0xfffff80003a6cb00 [if_io_tqg_5] 100033 D - 0xfffff80003a6c900 [if_io_tqg_6] 100034 D - 0xfffff80003a6c700 [if_io_tqg_7] 100035 D - 0xfffff80003a6c500 [if_io_tqg_8] 100036 D - 0xfffff80003a6c300 [if_io_tqg_9] 100037 D - 0xfffff80003a6c100 [if_io_tqg_10] 100038 D - 0xfffff80003c2f300 [if_io_tqg_11] 100039 D - 0xfffff80003c2f100 [if_config_tqg_0] 100040 D - 0xfffff80003c30e00 [pci_hp taskq] 100041 D - 0xfffff80003c30c00 [kqueue_ctx taskq] 100044 D - 0xfffff80003c30600 [thread taskq] 100046 D - 0xfffff80003c30200 [aiod_kick taskq] 100047 D - 0xfffff80003c30000 [deferred_unmount ta] 100048 D - 0xfffff80003c31d00 [inm_free taskq] 100049 D - 0xfffff80003c31b00 [in6m_free taskq] 100050 D - 0xfffff80003c31900 [linuxkpi_irq_wq] 100051 D - 0xfffff80003c31700 [linuxkpi_short_wq_0] 100052 D - 0xfffff80003c31700 [linuxkpi_short_wq_1] 100053 D - 0xfffff80003c31700 [linuxkpi_short_wq_2] 100054 D - 0xfffff80003c31700 [linuxkpi_short_wq_3] 100055 D - 0xfffff80003c31700 [linuxkpi_short_wq_4] 100056 D - 0xfffff80003c31700 [linuxkpi_short_wq_5] 100057 D - 0xfffff80003c31700 [linuxkpi_short_wq_6] 100058 D - 0xfffff80003c31700 [linuxkpi_short_wq_7] 100059 D - 0xfffff80003c31700 [linuxkpi_short_wq_8] 100060 D - 0xfffff80003c31700 [linuxkpi_short_wq_9] 100061 D - 0xfffff80003c31700 [linuxkpi_short_wq_1] 100062 D - 0xfffff80003c31700 [linuxkpi_short_wq_1] 100063 D - 0xfffff80003c31700 [linuxkpi_short_wq_1] 100064 D - 0xfffff80003c32800 [linuxkpi_long_wq_0] 100065 D - 0xfffff80003c32800 [linuxkpi_long_wq_1] 100066 D - 0xfffff80003c32800 [linuxkpi_long_wq_2] 100067 D - 0xfffff80003c32800 [linuxkpi_long_wq_3] 100068 D - 0xfffff80003c32800 [linuxkpi_long_wq_4] 100069 D - 0xfffff80003c32800 [linuxkpi_long_wq_5] 100070 D - 0xfffff80003c32800 [linuxkpi_long_wq_6] 100071 D - 0xfffff80003c32800 [linuxkpi_long_wq_7] 100072 D - 0xfffff80003c32800 [linuxkpi_long_wq_8] 100073 D - 0xfffff80003c32800 [linuxkpi_long_wq_9] 100074 D - 0xfffff80003c32800 [linuxkpi_long_wq_10] 100075 D - 0xfffff80003c32800 [linuxkpi_long_wq_11] 100076 D - 0xfffff80003c32800 [linuxkpi_long_wq_12] 100090 D - 0xfffff80003d27000 [firmware taskq] 100095 D - 0xfffff80003d28900 [crypto_0] 100096 D - 0xfffff80003d28900 [crypto_1] 100097 D - 0xfffff80003d28900 [crypto_2] 100098 D - 0xfffff80003d28900 [crypto_3] 100099 D - 0xfffff80003d28900 [crypto_4] 100100 D - 0xfffff80003d28900 [crypto_5] 100101 D - 0xfffff80003d28900 [crypto_6] 100102 D - 0xfffff80003d28900 [crypto_7] 100103 D - 0xfffff80003d28900 [crypto_8] 100104 D - 0xfffff80003d28900 [crypto_9] 100105 D - 0xfffff80003d28900 [crypto_10] 100106 D - 0xfffff80003d28900 [crypto_11] 100146 D - 0xfffff8003194be00 [acpi_task_0] 100147 D - 0xfffff8003194be00 [acpi_task_1] 100148 D - 0xfffff8003194be00 [acpi_task_2] 100150 D - 0xfffff80003a70100 [mca taskq] 100151 D - 0xfffff80003d2ad00 [CAM taskq] 100155 D - 0xfffff8003194b600 [mlx5_core0-rec] 100156 D - 0xfffff8003194b400 [mlx5_core0-wdg] 100157 D - 0xfffff8003194b200 [mlx5_core0-cmd] 100158 D - 0xfffff8003194b000 [mlx5_page_allocator] 100174 D - 0xfffff8003194dd00 [mlx5_fc] 100175 D - 0xfffff8003194db00 [mlx5_esw_wq] 100176 D - 0xfffff8003194d900 [mlx5_core1-rec] 100177 D - 0xfffff8003194d700 [mlx5_core1-wdg] 100178 D - 0xfffff8003194d500 [mlx5_core1-cmd] 100179 D - 0xfffff8003194d300 [mlx5_page_allocator] 100195 D - 0xfffff80003c2f700 [mlx5_fc] 100196 D - 0xfffff80003c2f500 [mlx5_esw_wq] 102515 D - 0xfffff8023b048200 [unionfs_rele taskq] 102703 D - 0xfffff8072c883c00 [dtrace_taskq] 102704 D - 0xfffff80721301000 [system_taskq_0] 102705 D - 0xfffff80721301000 [system_taskq_1] 102706 D - 0xfffff80721301000 [system_taskq_2] 102707 D - 0xfffff80721301000 [system_taskq_3] 102708 D - 0xfffff80721301000 [system_taskq_4] 102709 D - 0xfffff80721301000 [system_taskq_5] 102710 D - 0xfffff80721301000 [system_taskq_6] 102711 D - 0xfffff80721301000 [system_taskq_7] 102712 D - 0xfffff80721301000 [system_taskq_8] 102713 D - 0xfffff80721301000 [system_taskq_9] 102714 D - 0xfffff80721301000 [system_taskq_10] 102715 D - 0xfffff80721301000 [system_taskq_11] db:0:pho> allt Tracing command kernel pid 0 tid 100000 td 0xffffffff8197f620 sched_switch() at sched_switch+0x5d9/frame 0xffffffff8216ae00 mi_switch() at mi_switch+0x171/frame 0xffffffff8216ae20 sleepq_switch() at sleepq_switch+0x104/frame 0xffffffff8216ae60 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xffffffff8216aea0 _sleep() at _sleep+0x2bb/frame 0xffffffff8216af40 swapper() at swapper+0x75/frame 0xffffffff8216afa0 mi_startup() at mi_startup+0x226/frame 0xffffffff8216aff0 Tracing command kernel pid 0 tid 100015 td 0xfffff80003c77740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4858de0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4858e00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4858e40 msleep_spin_sbt() at msleep_spin_sbt+0x14d/frame 0xfffffe00e4858ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00e4858ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4858f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4858f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100016 td 0xfffff80003c77000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4853de0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4853e00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4853e40 msleep_spin_sbt() at msleep_spin_sbt+0x14d/frame 0xfffffe00e4853ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00e4853ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4853f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4853f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100017 td 0xfffff80003c3b740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4862de0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4862e00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4862e40 msleep_spin_sbt() at msleep_spin_sbt+0x14d/frame 0xfffffe00e4862ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00e4862ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4862f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4862f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100018 td 0xfffff80003c3b000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e485dde0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e485de00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e485de40 msleep_spin_sbt() at msleep_spin_sbt+0x14d/frame 0xfffffe00e485dec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00e485def0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e485df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e485df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100019 td 0xfffff80003c3c740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e486cde0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e486ce00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e486ce40 msleep_spin_sbt() at msleep_spin_sbt+0x14d/frame 0xfffffe00e486cec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00e486cef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e486cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e486cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xfffff80003c3c000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4867de0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4867e00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4867e40 msleep_spin_sbt() at msleep_spin_sbt+0x14d/frame 0xfffffe00e4867ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00e4867ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4867f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4867f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xfffff80003c3d740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4876de0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4876e00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4876e40 msleep_spin_sbt() at msleep_spin_sbt+0x14d/frame 0xfffffe00e4876ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00e4876ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4876f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4876f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xfffff80003c3d000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4871de0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4871e00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4871e40 msleep_spin_sbt() at msleep_spin_sbt+0x14d/frame 0xfffffe00e4871ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00e4871ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4871f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4871f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xfffff80003c3e740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4880de0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4880e00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4880e40 msleep_spin_sbt() at msleep_spin_sbt+0x14d/frame 0xfffffe00e4880ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00e4880ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4880f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4880f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xfffff80003c3e000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e487bde0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e487be00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e487be40 msleep_spin_sbt() at msleep_spin_sbt+0x14d/frame 0xfffffe00e487bec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00e487bef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e487bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e487bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xfffff80003c37740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e488ade0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e488ae00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e488ae40 msleep_spin_sbt() at msleep_spin_sbt+0x14d/frame 0xfffffe00e488aec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00e488aef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e488af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e488af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100026 td 0xfffff80003c37000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4885de0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4885e00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4885e40 msleep_spin_sbt() at msleep_spin_sbt+0x14d/frame 0xfffffe00e4885ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00e4885ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4885f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4885f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100027 td 0xfffff80003c38740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4894de0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4894e00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4894e40 msleep_spin_sbt() at msleep_spin_sbt+0x14d/frame 0xfffffe00e4894ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00e4894ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4894f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4894f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100028 td 0xfffff80003c38000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e488fde0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e488fe00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e488fe40 msleep_spin_sbt() at msleep_spin_sbt+0x14d/frame 0xfffffe00e488fec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00e488fef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e488ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e488ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100029 td 0xfffff80003c39740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e489ede0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e489ee00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e489ee40 msleep_spin_sbt() at msleep_spin_sbt+0x14d/frame 0xfffffe00e489eec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00e489eef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e489ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e489ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100030 td 0xfffff80003c39000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4899de0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4899e00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4899e40 msleep_spin_sbt() at msleep_spin_sbt+0x14d/frame 0xfffffe00e4899ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00e4899ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4899f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4899f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100031 td 0xfffff80003c3a740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e48a8de0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e48a8e00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e48a8e40 msleep_spin_sbt() at msleep_spin_sbt+0x14d/frame 0xfffffe00e48a8ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00e48a8ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e48a8f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48a8f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100032 td 0xfffff80003c3a000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e48a3de0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e48a3e00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e48a3e40 msleep_spin_sbt() at msleep_spin_sbt+0x14d/frame 0xfffffe00e48a3ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00e48a3ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e48a3f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48a3f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100033 td 0xfffff80003c33740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e48b2de0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e48b2e00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e48b2e40 msleep_spin_sbt() at msleep_spin_sbt+0x14d/frame 0xfffffe00e48b2ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00e48b2ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e48b2f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48b2f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100034 td 0xfffff80003c33000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e48adde0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e48ade00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e48ade40 msleep_spin_sbt() at msleep_spin_sbt+0x14d/frame 0xfffffe00e48adec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00e48adef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e48adf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48adf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100035 td 0xfffff80003c34740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e48bcde0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e48bce00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e48bce40 msleep_spin_sbt() at msleep_spin_sbt+0x14d/frame 0xfffffe00e48bcec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00e48bcef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e48bcf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48bcf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100036 td 0xfffff80003c34000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e48b7de0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e48b7e00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e48b7e40 msleep_spin_sbt() at msleep_spin_sbt+0x14d/frame 0xfffffe00e48b7ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00e48b7ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e48b7f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48b7f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100037 td 0xfffff80003c35740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e48c6de0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e48c6e00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e48c6e40 msleep_spin_sbt() at msleep_spin_sbt+0x14d/frame 0xfffffe00e48c6ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00e48c6ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e48c6f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48c6f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100038 td 0xfffff80003c35000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e48c1de0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e48c1e00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e48c1e40 msleep_spin_sbt() at msleep_spin_sbt+0x14d/frame 0xfffffe00e48c1ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00e48c1ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e48c1f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48c1f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100039 td 0xfffff80003c36740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e48d0de0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e48d0e00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e48d0e40 msleep_spin_sbt() at msleep_spin_sbt+0x14d/frame 0xfffffe00e48d0ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00e48d0ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e48d0f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48d0f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100040 td 0xfffff80003c36000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e48cbdc0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e48cbde0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e48cbe20 _sleep() at _sleep+0x2d4/frame 0xfffffe00e48cbec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e48cbef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e48cbf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48cbf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100041 td 0xfffff80003c2b740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e48dadc0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e48dade0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e48dae20 _sleep() at _sleep+0x2d4/frame 0xfffffe00e48daec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e48daef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e48daf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48daf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100044 td 0xfffff80003c2c000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e48dfdc0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e48dfde0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e48dfe20 _sleep() at _sleep+0x2d4/frame 0xfffffe00e48dfec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e48dfef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e48dff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48dff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100046 td 0xfffff80003c2d000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e48e9dc0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e48e9de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e48e9e20 _sleep() at _sleep+0x2d4/frame 0xfffffe00e48e9ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e48e9ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e48e9f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48e9f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100047 td 0xfffff80003c2e740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e48f8dc0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e48f8de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e48f8e20 _sleep() at _sleep+0x2d4/frame 0xfffffe00e48f8ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e48f8ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e48f8f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48f8f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100048 td 0xfffff80003c2e000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e48f3dc0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e48f3de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e48f3e20 _sleep() at _sleep+0x2d4/frame 0xfffffe00e48f3ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e48f3ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e48f3f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48f3f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100049 td 0xfffff80003c27740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4902dc0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4902de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4902e20 _sleep() at _sleep+0x2d4/frame 0xfffffe00e4902ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e4902ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4902f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4902f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100050 td 0xfffff80003c27000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e48fdde0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e48fde00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e48fde40 msleep_spin_sbt() at msleep_spin_sbt+0x14d/frame 0xfffffe00e48fdec0 taskqueue_thread_loop() at taskqueue_thread_loop+0x104/frame 0xfffffe00e48fdef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e48fdf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48fdf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100051 td 0xfffff80003c28740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e490cdc0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e490cde0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e490ce20 _sleep() at _sleep+0x2d4/frame 0xfffffe00e490cec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e490cef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e490cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e490cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100052 td 0xfffff80003c28000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4907dc0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4907de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4907e20 _sleep() at _sleep+0x2d4/frame 0xfffffe00e4907ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e4907ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4907f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4907f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100053 td 0xfffff80003c29740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4916dc0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4916de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4916e20 _sleep() at _sleep+0x2d4/frame 0xfffffe00e4916ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e4916ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4916f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4916f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100054 td 0xfffff80003c29000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4911dc0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4911de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4911e20 _sleep() at _sleep+0x2d4/frame 0xfffffe00e4911ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e4911ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4911f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4911f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100055 td 0xfffff80003c2a740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4920dc0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4920de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4920e20 _sleep() at _sleep+0x2d4/frame 0xfffffe00e4920ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e4920ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4920f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4920f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100056 td 0xfffff80003c2a000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e491bdc0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e491bde0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e491be20 _sleep() at _sleep+0x2d4/frame 0xfffffe00e491bec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e491bef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e491bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e491bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100057 td 0xfffff80003c1c740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e492adc0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e492ade0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e492ae20 _sleep() at _sleep+0x2d4/frame 0xfffffe00e492aec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e492aef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e492af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e492af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100058 td 0xfffff80003c1c000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4925dc0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4925de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4925e20 _sleep() at _sleep+0x2d4/frame 0xfffffe00e4925ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e4925ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4925f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4925f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100059 td 0xfffff80003c20740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4934dc0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4934de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4934e20 _sleep() at _sleep+0x2d4/frame 0xfffffe00e4934ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e4934ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4934f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4934f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100060 td 0xfffff80003c20000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e492fdc0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e492fde0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e492fe20 _sleep() at _sleep+0x2d4/frame 0xfffffe00e492fec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e492fef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e492ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e492ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100061 td 0xfffff80003c21740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e493edc0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e493ede0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e493ee20 _sleep() at _sleep+0x2d4/frame 0xfffffe00e493eec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e493eef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e493ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e493ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100062 td 0xfffff80003c21000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4939dc0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4939de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4939e20 _sleep() at _sleep+0x2d4/frame 0xfffffe00e4939ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e4939ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4939f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4939f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100063 td 0xfffff80003c22740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4948dc0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4948de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4948e20 _sleep() at _sleep+0x2d4/frame 0xfffffe00e4948ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e4948ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4948f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4948f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100064 td 0xfffff80003c22000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4943dc0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4943de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4943e20 _sleep() at _sleep+0x2d4/frame 0xfffffe00e4943ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e4943ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4943f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4943f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100065 td 0xfffff80003c18740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4952dc0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4952de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4952e20 _sleep() at _sleep+0x2d4/frame 0xfffffe00e4952ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e4952ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4952f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4952f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100066 td 0xfffff80003c18000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e494ddc0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e494dde0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e494de20 _sleep() at _sleep+0x2d4/frame 0xfffffe00e494dec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e494def0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e494df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e494df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100067 td 0xfffff80003c19740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e495cdc0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e495cde0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e495ce20 _sleep() at _sleep+0x2d4/frame 0xfffffe00e495cec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e495cef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e495cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e495cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100068 td 0xfffff80003c19000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4957dc0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4957de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4957e20 _sleep() at _sleep+0x2d4/frame 0xfffffe00e4957ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e4957ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4957f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4957f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100069 td 0xfffff80003c1a740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4966dc0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4966de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4966e20 _sleep() at _sleep+0x2d4/frame 0xfffffe00e4966ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e4966ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4966f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4966f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100070 td 0xfffff80003c1a000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4961dc0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4961de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4961e20 _sleep() at _sleep+0x2d4/frame 0xfffffe00e4961ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e4961ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4961f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4961f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100071 td 0xfffff80003c1b740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4970dc0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4970de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4970e20 _sleep() at _sleep+0x2d4/frame 0xfffffe00e4970ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e4970ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4970f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4970f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100072 td 0xfffff80003c1b000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e496bdc0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e496bde0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e496be20 _sleep() at _sleep+0x2d4/frame 0xfffffe00e496bec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e496bef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e496bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e496bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100073 td 0xfffff80003c14740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e497adc0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e497ade0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e497ae20 _sleep() at _sleep+0x2d4/frame 0xfffffe00e497aec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e497aef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e497af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e497af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100074 td 0xfffff80003c14000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4975dc0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4975de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4975e20 _sleep() at _sleep+0x2d4/frame 0xfffffe00e4975ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e4975ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4975f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4975f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100075 td 0xfffff80003c15740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4984dc0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4984de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4984e20 _sleep() at _sleep+0x2d4/frame 0xfffffe00e4984ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e4984ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4984f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4984f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100076 td 0xfffff80003c15000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e497fdc0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e497fde0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e497fe20 _sleep() at _sleep+0x2d4/frame 0xfffffe00e497fec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e497fef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e497ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e497ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100090 td 0xfffff80003d23000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e49f5dc0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e49f5de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e49f5e20 _sleep() at _sleep+0x2d4/frame 0xfffffe00e49f5ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e49f5ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e49f5f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49f5f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100095 td 0xfffff80003d26740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4e48dc0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4e48de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4e48e20 _sleep() at _sleep+0x2d4/frame 0xfffffe00e4e48ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e4e48ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4e48f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e48f30 --- trap 0x6060302, rip = 0x703000703070303, rsp = 0xfff57418fff57420, rbp = 0xfff573e8fff573f0 --- Tracing command kernel pid 0 tid 100096 td 0xfffff80003d26000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4e43dc0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4e43de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4e43e20 _sleep() at _sleep+0x2d4/frame 0xfffffe00e4e43ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e4e43ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4e43f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e43f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100097 td 0xfffff8000411b740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4e52dc0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4e52de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4e52e20 _sleep() at _sleep+0x2d4/frame 0xfffffe00e4e52ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e4e52ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4e52f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e52f30 --- trap 0x4, rip = 0x300000000, rsp = 0x400000007, rbp = 0xffffff00120046c8 --- ??() at 0x300000000/frame 0xffffff00120046c8 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00377f0280 kdb_reenter() at kdb_reenter+0x2b/frame 0xfffffe00377f0290 calltrap() at calltrap+0x8/frame 0xfffffe00377f0290 --- trap 0xc, rip = 0xffffffff8103b130, rsp = 0xfffffe00377f0360, rbp = 0xfffffe00377f03f0 --- db_read_bytes() at db_read_bytes+0xa0/frame 0xfffffe00377f03f0 db_get_value() at db_get_value+0x31/frame 0xfffffe00377f0430 db_backtrace() at db_backtrace+0x1d9/frame 0xfffffe00377f04b0 db_trace_thread() at db_trace_thread+0x3a/frame 0xfffffe00377f04d0 _db_stack_trace_all() at _db_stack_trace_all+0xfd/frame 0xfffffe00377f0570 db_command() at db_command+0x310/frame 0xfffffe00377f0630 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00377f06d0 db_command() at db_command+0x310/frame 0xfffffe00377f0790 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00377f07a0 db_trap() at db_trap+0xe6/frame 0xfffffe00377f0830 kdb_trap() at kdb_trap+0x253/frame 0xfffffe00377f0980 trap() at trap+0x286/frame 0xfffffe00377f0aa0 calltrap() at calltrap+0x8/frame 0xfffffe00377f0aa0 --- trap 0x3, rip = 0xffffffff80ba4b45, rsp = 0xfffffe00377f0b70, rbp = 0xfffffe00377f0b90 --- kdb_alt_break_internal() at kdb_alt_break_internal+0x135/frame 0xfffffe00377f0b90 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe00377f0ba0 uart_intr_rxready() at uart_intr_rxready+0xf4/frame 0xfffffe00377f0bd0 uart_intr() at uart_intr+0x118/frame 0xfffffe00377f0c10 intr_event_handle() at intr_event_handle+0x12b/frame 0xfffffe00377f0c80 intr_execute_handlers() at intr_execute_handlers+0x63/frame 0xfffffe00377f0cb0 Xapic_isr1() at Xapic_isr1+0xdc/frame 0xfffffe00377f0cb0 --- interrupt, rip = 0xffffffff804cb59e, rsp = 0xfffffe00377f0d80, rbp = 0xfffffe00377f0db0 --- acpi_cpu_idle() at acpi_cpu_idle+0x27e/frame 0xfffffe00377f0db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe00377f0dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00377f0df0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe00377f0ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00377f0f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377f0f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address ffffff00120046d0 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00377f03e0 kdb_reenter() at kdb_reenter+0x2b/frame 0xfffffe00377f03f0 db_get_value() at db_get_value+0x4b/frame 0xfffffe00377f0430 db_backtrace() at db_backtrace+0x1d9/frame 0xfffffe00377f04b0 db_trace_thread() at db_trace_thread+0x3a/frame 0xfffffe00377f04d0 _db_stack_trace_all() at _db_stack_trace_all+0xfd/frame 0xfffffe00377f0570 db_command() at db_command+0x310/frame 0xfffffe00377f0630 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00377f06d0 db_command() at db_command+0x310/frame 0xfffffe00377f0790 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00377f07a0 db_trap() at db_trap+0xe6/frame 0xfffffe00377f0830 kdb_trap() at kdb_trap+0x253/frame 0xfffffe00377f0980 trap() at trap+0x286/frame 0xfffffe00377f0aa0 calltrap() at calltrap+0x8/frame 0xfffffe00377f0aa0 --- trap 0x3, rip = 0xffffffff80ba4b45, rsp = 0xfffffe00377f0b70, rbp = 0xfffffe00377f0b90 --- kdb_alt_break_internal() at kdb_alt_break_internal+0x135/frame 0xfffffe00377f0b90 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe00377f0ba0 uart_intr_rxready() at uart_intr_rxready+0xf4/frame 0xfffffe00377f0bd0 uart_intr() at uart_intr+0x118/frame 0xfffffe00377f0c10 intr_event_handle() at intr_event_handle+0x12b/frame 0xfffffe00377f0c80 intr_execute_handlers() at intr_execute_handlers+0x63/frame 0xfffffe00377f0cb0 Xapic_isr1() at Xapic_isr1+0xdc/frame 0xfffffe00377f0cb0 --- interrupt, rip = 0xffffffff804cb59e, rsp = 0xfffffe00377f0d80, rbp = 0xfffffe00377f0db0 --- acpi_cpu_idle() at acpi_cpu_idle+0x27e/frame 0xfffffe00377f0db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe00377f0dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00377f0df0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe00377f0ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00377f0f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377f0f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100098 td 0xfffff8000411b000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4e4ddc0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4e4dde0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4e4de20 _sleep() at _sleep+0x2d4/frame 0xfffffe00e4e4dec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e4e4def0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4e4df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e4df30 --- trap 0xffffffff, rip = 0xffffffff000000e0, rsp = 0x200000003, rbp = 0xffffffffffffffff --- ??() at 0xffffffff000000e0/frame 0xffffffffffffffff Tracing command kernel pid 0 tid 100099 td 0xfffff8000411c740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4e5cdc0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4e5cde0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4e5ce20 _sleep() at _sleep+0x2d4/frame 0xfffffe00e4e5cec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e4e5cef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4e5cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e5cf30 --- trap 0x5328202e, rip = 0x6547336e6547203a, rsp = 0x4f50202c64253d54, rbp = 0x5328202e2e2e326e --- Tracing command kernel pid 0 tid 100100 td 0xfffff8000411c000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4e57dc0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4e57de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4e57e20 _sleep() at _sleep+0x2d4/frame 0xfffffe00e4e57ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e4e57ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4e57f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e57f30 --- trap 0x10272900, rip = 0x1b10150162a2b01, rsp = 0x56182c2d00f7122e, rbp = 0x1620e2122002c82 --- Tracing command kernel pid 0 tid 100101 td 0xfffff8000411d740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4e66dc0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4e66de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4e66e20 _sleep() at _sleep+0x2d4/frame 0xfffffe00e4e66ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e4e66ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4e66f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e66f30 --- trap 0x58450301, rip = 0x7e24453966fffffe, rsp = 0xffffff40820f083a, rbp = 0xc22b99c103fffffe --- Tracing command kernel pid 0 tid 100102 td 0xfffff8000411d000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4e61dc0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4e61de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4e61e20 _sleep() at _sleep+0x2d4/frame 0xfffffe00e4e61ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e4e61ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4e61f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e61f30 --- trap 0xfffff4f8, rip = 0xc0840874013c0000, rsp = 0xc68b52006a000373, rbp = 0xca8100001a89e8c3 --- Tracing command kernel pid 0 tid 100103 td 0xfffff8000411e740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4e70dc0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4e70de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4e70e20 _sleep() at _sleep+0x2d4/frame 0xfffffe00e4e70ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e4e70ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4e70f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e70f30 --- trap 0x4302444, rip = 0x14c4833824440324, rsp = 0xffff970ae8565553, rbp = 0x54890472c23b2424 --- Tracing command kernel pid 0 tid 100104 td 0xfffff8000411e000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4e6bdc0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4e6bde0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4e6be20 _sleep() at _sleep+0x2d4/frame 0xfffffe00e4e6bec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e4e6bef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4e6bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e6bf30 --- trap 0x1b0c35d, rip = 0x7d830cc483ffffed, rsp = 0x8bc2b60fd2320cc4, rbp = 0x33d88b008b10458b --- Tracing command kernel pid 0 tid 100105 td 0xfffff80004114740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4e7adc0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4e7ade0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4e7ae20 _sleep() at _sleep+0x2d4/frame 0xfffffe00e4e7aec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e4e7aef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4e7af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e7af30 --- trap 0x75ff0c75, rip = 0x2075ff2475ff176a, rsp = 0xe9fffffaede80a75, rbp = 0xff1c75ff2075ff24 --- Tracing command kernel pid 0 tid 100106 td 0xfffff80004114000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4e75dc0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4e75de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4e75e20 _sleep() at _sleep+0x2d4/frame 0xfffffe00e4e75ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e4e75ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4e75f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e75f30 --- trap 0xbe0574c0, rip = 0x40000000d00046e, rsp = 0xad72020b7d800b45, rbp = 0x8300046fabe853f6 --- Tracing command kernel pid 0 tid 100146 td 0xfffff8003192b740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe010da28de0 mi_switch() at mi_switch+0x171/frame 0xfffffe010da28e00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe010da28e40 msleep_spin_sbt() at msleep_spin_sbt+0x14d/frame 0xfffffe010da28ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0x104/frame 0xfffffe010da28ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010da28f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da28f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100147 td 0xfffff8003192b000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4ffcde0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4ffce00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4ffce40 msleep_spin_sbt() at msleep_spin_sbt+0x14d/frame 0xfffffe00e4ffcec0 taskqueue_thread_loop() at taskqueue_thread_loop+0x104/frame 0xfffffe00e4ffcef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4ffcf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ffcf30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100148 td 0xfffff8003192c740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe010da32de0 mi_switch() at mi_switch+0x171/frame 0xfffffe010da32e00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe010da32e40 msleep_spin_sbt() at msleep_spin_sbt+0x14d/frame 0xfffffe010da32ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0x104/frame 0xfffffe010da32ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010da32f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da32f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100150 td 0xfffff8003192d740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe010da3cde0 mi_switch() at mi_switch+0x171/frame 0xfffffe010da3ce00 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe010da3ce40 msleep_spin_sbt() at msleep_spin_sbt+0x14d/frame 0xfffffe010da3cec0 taskqueue_thread_loop() at taskqueue_thread_loop+0x104/frame 0xfffffe010da3cef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010da3cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da3cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100151 td 0xfffff8003192d000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe010da37dc0 mi_switch() at mi_switch+0x171/frame 0xfffffe010da37de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe010da37e20 _sleep() at _sleep+0x2d4/frame 0xfffffe010da37ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe010da37ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010da37f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da37f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100155 td 0xfffff80031939000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe010da41dc0 mi_switch() at mi_switch+0x171/frame 0xfffffe010da41de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe010da41e20 _sleep() at _sleep+0x2d4/frame 0xfffffe010da41ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe010da41ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010da41f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da41f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100156 td 0xfffff800318e4740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe010da5adc0 mi_switch() at mi_switch+0x171/frame 0xfffffe010da5ade0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe010da5ae20 _sleep() at _sleep+0x2d4/frame 0xfffffe010da5aec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe010da5aef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010da5af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da5af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100157 td 0xfffff800318e4000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe010da55dc0 mi_switch() at mi_switch+0x171/frame 0xfffffe010da55de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe010da55e20 _sleep() at _sleep+0x2d4/frame 0xfffffe010da55ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe010da55ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010da55f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da55f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100158 td 0xfffff800318e5740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe010da64dc0 mi_switch() at mi_switch+0x171/frame 0xfffffe010da64de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe010da64e20 _sleep() at _sleep+0x2d4/frame 0xfffffe010da64ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe010da64ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010da64f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da64f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100174 td 0xfffff80038212740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe010dab4dc0 mi_switch() at mi_switch+0x171/frame 0xfffffe010dab4de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe010dab4e20 _sleep() at _sleep+0x2d4/frame 0xfffffe010dab4ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe010dab4ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010dab4f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010dab4f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100175 td 0xfffff80038212000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe010daafdc0 mi_switch() at mi_switch+0x171/frame 0xfffffe010daafde0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe010daafe20 _sleep() at _sleep+0x2d4/frame 0xfffffe010daafec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe010daafef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010daaff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010daaff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100176 td 0xfffff80038213740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe010dabedc0 mi_switch() at mi_switch+0x171/frame 0xfffffe010dabede0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe010dabee20 _sleep() at _sleep+0x2d4/frame 0xfffffe010dabeec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe010dabeef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010dabef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010dabef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100177 td 0xfffff80038213000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe010dab9dc0 mi_switch() at mi_switch+0x171/frame 0xfffffe010dab9de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe010dab9e20 _sleep() at _sleep+0x2d4/frame 0xfffffe010dab9ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe010dab9ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010dab9f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010dab9f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100178 td 0xfffff80038214740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe010dac8dc0 mi_switch() at mi_switch+0x171/frame 0xfffffe010dac8de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe010dac8e20 _sleep() at _sleep+0x2d4/frame 0xfffffe010dac8ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe010dac8ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010dac8f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010dac8f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100179 td 0xfffff80038214000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe010dac3dc0 mi_switch() at mi_switch+0x171/frame 0xfffffe010dac3de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe010dac3e20 _sleep() at _sleep+0x2d4/frame 0xfffffe010dac3ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe010dac3ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010dac3f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010dac3f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100195 td 0xfffff800044f4000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe010db13dc0 mi_switch() at mi_switch+0x171/frame 0xfffffe010db13de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe010db13e20 _sleep() at _sleep+0x2d4/frame 0xfffffe010db13ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe010db13ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010db13f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db13f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100196 td 0xfffff800044f5740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe010db22dc0 mi_switch() at mi_switch+0x171/frame 0xfffffe010db22de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe010db22e20 _sleep() at _sleep+0x2d4/frame 0xfffffe010db22ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe010db22ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010db22f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db22f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 102515 td 0xfffff806b2426740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe016d171dc0 mi_switch() at mi_switch+0x171/frame 0xfffffe016d171de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe016d171e20 _sleep() at _sleep+0x2d4/frame 0xfffffe016d171ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe016d171ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe016d171f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe016d171f30 --- trap 0xc, rip = 0x828f10c23, rsp = 0x82f9aa610, rbp = 0x82f9aa640 --- Tracing command kernel pid 0 tid 102703 td 0xfffff80135aec740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe01b64addc0 mi_switch() at mi_switch+0x171/frame 0xfffffe01b64adde0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe01b64ade20 _sleep() at _sleep+0x2d4/frame 0xfffffe01b64adec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01b64adef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01b64adf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01b64adf30 --- trap 0xc, rip = 0x82aa6fc66, rsp = 0x82ee00610, rbp = 0x82ee00640 --- Tracing command kernel pid 0 tid 102704 td 0xfffff801b9580000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe01b64b7dc0 mi_switch() at mi_switch+0x171/frame 0xfffffe01b64b7de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe01b64b7e20 _sleep() at _sleep+0x2d4/frame 0xfffffe01b64b7ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01b64b7ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01b64b7f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01b64b7f30 --- trap 0xc, rip = 0x82aa6fc2a, rsp = 0x82b8fb610, rbp = 0x82b8fb640 --- Tracing command kernel pid 0 tid 102705 td 0xfffff806c0f4f000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe01b64a8dc0 mi_switch() at mi_switch+0x171/frame 0xfffffe01b64a8de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe01b64a8e20 _sleep() at _sleep+0x2d4/frame 0xfffffe01b64a8ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01b64a8ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01b64a8f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01b64a8f30 --- trap 0xc, rip = 0x82aa71635, rsp = 0x8304d93c0, rbp = 0x8304d9400 --- Tracing command kernel pid 0 tid 102706 td 0xfffff8003d073740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe01b64c6dc0 mi_switch() at mi_switch+0x171/frame 0xfffffe01b64c6de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe01b64c6e20 _sleep() at _sleep+0x2d4/frame 0xfffffe01b64c6ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01b64c6ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01b64c6f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01b64c6f30 --- trap 0xc, rip = 0x829371c3a, rsp = 0x82ba88610, rbp = 0x82ba88640 --- Tracing command kernel pid 0 tid 102707 td 0xfffff804d4a6d000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe016d1addc0 mi_switch() at mi_switch+0x171/frame 0xfffffe016d1adde0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe016d1ade20 _sleep() at _sleep+0x2d4/frame 0xfffffe016d1adec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe016d1adef0 fork_exit() at fork_exit+0x82/frame 0xfffffe016d1adf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe016d1adf30 --- trap 0xc, rip = 0x82833acc0, rsp = 0x82ceff610, rbp = 0x82ceff640 --- Tracing command kernel pid 0 tid 102708 td 0xfffff80239c71000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe01af8f4dc0 mi_switch() at mi_switch+0x171/frame 0xfffffe01af8f4de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe01af8f4e20 _sleep() at _sleep+0x2d4/frame 0xfffffe01af8f4ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01af8f4ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01af8f4f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01af8f4f30 --- trap 0xc, rip = 0x82b7bc651, rsp = 0x82d8a83c0, rbp = 0x82d8a8400 --- Tracing command kernel pid 0 tid 102709 td 0xfffff802cef40000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4fc5dc0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4fc5de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4fc5e20 _sleep() at _sleep+0x2d4/frame 0xfffffe00e4fc5ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e4fc5ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4fc5f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4fc5f30 --- trap 0xc, rip = 0x82b7bac21, rsp = 0x8338a9610, rbp = 0x8338a9640 --- Tracing command kernel pid 0 tid 102710 td 0xfffff8072ed62740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe01af9f3dc0 mi_switch() at mi_switch+0x171/frame 0xfffffe01af9f3de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe01af9f3e20 _sleep() at _sleep+0x2d4/frame 0xfffffe01af9f3ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01af9f3ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01af9f3f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01af9f3f30 --- trap 0xc, rip = 0x821f085ba, rsp = 0x823f00f48, rbp = 0x823f00f60 --- Tracing command kernel pid 0 tid 102711 td 0xfffff807e5f41740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4fd9dc0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4fd9de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4fd9e20 _sleep() at _sleep+0x2d4/frame 0xfffffe00e4fd9ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00e4fd9ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4fd9f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4fd9f30 --- trap 0xc, rip = 0x821f085ba, rsp = 0x824c2bf48, rbp = 0x824c2bf60 --- Tracing command kernel pid 0 tid 102712 td 0xfffff807e541a000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe010da04dc0 mi_switch() at mi_switch+0x171/frame 0xfffffe010da04de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe010da04e20 _sleep() at _sleep+0x2d4/frame 0xfffffe010da04ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe010da04ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010da04f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da04f30 --- trap 0xc, rip = 0x821f085ba, rsp = 0x827c05f48, rbp = 0x827c05f60 --- Tracing command kernel pid 0 tid 102713 td 0xfffff8003d127740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe01af9cbdc0 mi_switch() at mi_switch+0x171/frame 0xfffffe01af9cbde0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe01af9cbe20 _sleep() at _sleep+0x2d4/frame 0xfffffe01af9cbec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01af9cbef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01af9cbf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01af9cbf30 --- trap 0xc, rip = 0x821f085ba, rsp = 0x826e86f48, rbp = 0x826e86f60 --- Tracing command kernel pid 0 tid 102714 td 0xfffff804d4fe9000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe01b64c1dc0 mi_switch() at mi_switch+0x171/frame 0xfffffe01b64c1de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe01b64c1e20 _sleep() at _sleep+0x2d4/frame 0xfffffe01b64c1ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01b64c1ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01b64c1f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01b64c1f30 --- trap 0xc, rip = 0x821f085ba, rsp = 0x829179f48, rbp = 0x829179f60 --- Tracing command kernel pid 0 tid 102715 td 0xfffff80135b78740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe01af92bdc0 mi_switch() at mi_switch+0x171/frame 0xfffffe01af92bde0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe01af92be20 _sleep() at _sleep+0x2d4/frame 0xfffffe01af92bec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01af92bef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01af92bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01af92bf30 --- trap 0xc, rip = 0x821f085ba, rsp = 0x82608bf48, rbp = 0x82608bf60 --- Tracing command init pid 1 tid 100002 td 0xfffff80003c82000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00377e1a20 mi_switch() at mi_switch+0x171/frame 0xfffffe00377e1a40 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00377e1a80 sleepq_catch_signals() at sleepq_catch_signals+0x276/frame 0xfffffe00377e1ad0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00377e1ae0 _sleep() at _sleep+0x2ca/frame 0xfffffe00377e1b80 kern_wait6() at kern_wait6+0x481/frame 0xfffffe00377e1c10 sys_wait4() at sys_wait4+0x6d/frame 0xfffffe00377e1e00 amd64_syscall() at amd64_syscall+0x153/frame 0xfffffe00377e1f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00377e1f30 --- syscall (7, FreeBSD ELF64, wait4), rip = 0x28da5a, rsp = 0x820c5ada8, rbp = 0x820c5ae90 --- Tracing command clock pid 2 tid 100077 td 0xfffff80003c16740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e49beea0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e49beec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe00e49beef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e49bef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49bef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command clock pid 2 tid 100078 td 0xfffff80003c16000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e49b9ea0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e49b9ec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe00e49b9ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e49b9f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49b9f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command clock pid 2 tid 100079 td 0xfffff80003c17740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e49c8ea0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e49c8ec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe00e49c8ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e49c8f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49c8f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command clock pid 2 tid 100080 td 0xfffff80003c17000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e49c3ea0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e49c3ec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe00e49c3ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e49c3f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49c3f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command clock pid 2 tid 100081 td 0xfffff80003d2b740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e49d2ea0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e49d2ec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe00e49d2ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e49d2f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49d2f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command clock pid 2 tid 100082 td 0xfffff80003d2b000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e49cdea0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e49cdec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe00e49cdef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e49cdf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49cdf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command clock pid 2 tid 100083 td 0xfffff80003d2c740 fork_trampoline() at fork_trampoline Tracing command clock pid 2 tid 100084 td 0xfffff80003d2c000 fork_trampoline() at fork_trampoline Tracing command clock pid 2 tid 100085 td 0xfffff80003d2d740 fork_trampoline() at fork_trampoline Tracing command clock pid 2 tid 100086 td 0xfffff80003d2d000 fork_trampoline() at fork_trampoline Tracing command clock pid 2 tid 100087 td 0xfffff80003d2e740 fork_trampoline() at fork_trampoline Tracing command clock pid 2 tid 100088 td 0xfffff80003d2e000 fork_trampoline() at fork_trampoline Tracing command crypto pid 3 tid 100107 td 0xfffff80004115740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4e84db0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4e84dd0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4e84e10 _sleep() at _sleep+0x2d4/frame 0xfffffe00e4e84eb0 crypto_dispatch_thread() at crypto_dispatch_thread+0x193/frame 0xfffffe00e4e84ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4e84f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e84f30 --- trap 0xd00037e, rip = 0x45fe5959fffec66f, rsp = 0x5e5ffffffd91820f, rbp = 0xff0c0048206851c8 --- Tracing command crypto pid 3 tid 100108 td 0xfffff80004115000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4e7fdb0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4e7fdd0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4e7fe10 _sleep() at _sleep+0x2d4/frame 0xfffffe00e4e7feb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe00e4e7fef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4e7ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e7ff30 --- trap 0x4c458b28, rip = 0xeb80054c8966ffff, rsp = 0xe1c1c18bc8b70fff, rbp = 0x51ffffff400584b7 --- Tracing command crypto pid 3 tid 100109 td 0xfffff80004116740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4e8edb0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4e8edd0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4e8ee10 _sleep() at _sleep+0x2d4/frame 0xfffffe00e4e8eeb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe00e4e8eef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4e8ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e8ef30 --- trap 0x75084589, rip = 0x5d3966db33530000, rsp = 0xe8560c75ff571475, rbp = 0xff1075ff531875ff --- Tracing command crypto pid 3 tid 100110 td 0xfffff80004116000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4e89db0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4e89dd0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4e89e10 _sleep() at _sleep+0x2d4/frame 0xfffffe00e4e89eb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe00e4e89ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4e89f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e89f30 --- trap 0x99e85750, rip = 0x2b5045c758296a, rsp = 0x38805c458b5c4589, rbp = 0x5753fffe862fe857 --- Tracing command crypto pid 3 tid 100111 td 0xfffff80004117740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4e98db0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4e98dd0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4e98e10 _sleep() at _sleep+0x2d4/frame 0xfffffe00e4e98eb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe00e4e98ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4e98f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e98f30 --- trap 0x57000226, rip = 0xf5756530c458b10, rsp = 0x3a000000dcbe1045, rbp = 0x1075ff560a03408c --- Tracing command crypto pid 3 tid 100112 td 0xfffff80004117000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4e93db0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4e93dd0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4e93e10 _sleep() at _sleep+0x2d4/frame 0xfffffe00e4e93eb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe00e4e93ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4e93f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e93f30 --- trap 0xc1404cc4, rip = 0x1420885048d59c0, rsp = 0x6a137502147d8019, rbp = 0x8dc0b60ffffde609 --- Tracing command crypto pid 3 tid 100113 td 0xfffff80004107740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4ea2db0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4ea2dd0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4ea2e10 _sleep() at _sleep+0x2d4/frame 0xfffffe00e4ea2eb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe00e4ea2ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4ea2f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ea2f30 --- trap 0x8b51511c, rip = 0x5600000a36838a08, rsp = 0xe85357fffffdd6e8, rbp = 0x56ec8b55c35df1f7 --- Tracing command crypto pid 3 tid 100114 td 0xfffff80004107000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4e9ddb0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4e9ddd0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4e9de10 _sleep() at _sleep+0x2d4/frame 0xfffffe00e4e9deb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe00e4e9def0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4e9df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e9df30 --- trap 0xf03c2f6, rip = 0xfffccd62e80875ff, rsp = 0xcdc8e80875ff50c0, rbp = 0xf45589c9b60fec4d --- Tracing command crypto pid 3 tid 100115 td 0xfffff8000410c740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4eacdb0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4eacdd0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4eace10 _sleep() at _sleep+0x2d4/frame 0xfffffe00e4eaceb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe00e4eacef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4eacf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4eacf30 --- trap 0xff458d18, rip = 0x8dfc8b5151686a50, rsp = 0x516a6a50ff458d18, rbp = 0xfc8b515100000084 --- Tracing command crypto pid 3 tid 100116 td 0xfffff8000410c000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4ea7db0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4ea7dd0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4ea7e10 _sleep() at _sleep+0x2d4/frame 0xfffffe00e4ea7eb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe00e4ea7ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4ea7f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ea7f30 --- trap 0x15c06bc7, rip = 0x148800020646938a, rsp = 0x8400fe45c6000201, rbp = 0x2b76303b000220d4 --- Tracing command crypto pid 3 tid 100117 td 0xfffff8000410d740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4eb6db0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4eb6dd0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4eb6e10 _sleep() at _sleep+0x2d4/frame 0xfffffe00e4eb6eb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe00e4eb6ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4eb6f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4eb6f30 --- trap 0xc75ff57, rip = 0xf24d0f653076ae0, rsp = 0x66a406afffd828d, rbp = 0xfbb62ce8ffef45c6 --- Tracing command crypto pid 3 tid 100118 td 0xfffff8000410d000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4eb1db0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4eb1dd0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4eb1e10 _sleep() at _sleep+0x2d4/frame 0xfffffe00e4eb1eb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe00e4eb1ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4eb1f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4eb1f30 --- trap 0xb60fffff, rip = 0xd6184d8c8d880c8d, rsp = 0x56538734ff106a51, rbp = 0xef7d801075000229 --- Tracing command crypto pid 3 tid 100119 td 0xfffff8000410e740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4ec0db0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4ec0dd0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4ec0e10 _sleep() at _sleep+0x2d4/frame 0xfffffe00e4ec0eb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe00e4ec0ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4ec0f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ec0f30 --- trap 0x4475ff2c, rip = 0xe0c1c18b4674c785, rsp = 0x1ffffe7810a8b, rbp = 0x537475ffffffff71 --- Tracing command cam pid 4 tid 100120 td 0xfffff8000410e000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4ebbda0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4ebbdc0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4ebbe00 _sleep() at _sleep+0x2d4/frame 0xfffffe00e4ebbea0 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe00e4ebbef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4ebbf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ebbf30 --- trap 0x8d374688, rip = 0x9968500b45, rsp = 0x68500b458d394688, rbp = 0x9668500b458d --- Tracing command cam pid 4 tid 100121 td 0xfffff800041fc740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4ecada0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4ecadc0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4ecae00 _sleep() at _sleep+0x2d4/frame 0xfffffe00e4ecaea0 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe00e4ecaef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4ecaf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ecaf30 --- trap 0xc107241e, rip = 0xb60fc0fec902c002, rsp = 0x5db60f02e2c1006f, rbp = 0x16d45c60100f604 --- Tracing command cam pid 4 tid 100122 td 0xfffff800041fc000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4ec5da0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4ec5dc0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4ec5e00 _sleep() at _sleep+0x2d4/frame 0xfffffe00e4ec5ea0 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe00e4ec5ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4ec5f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ec5f30 --- trap 0x45c614c4, rip = 0xf8830a74016c45f6, rsp = 0x83480b798000003f, rbp = 0x1f88340fec88348 --- Tracing command cam pid 4 tid 100123 td 0xfffff80004201740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4ed4da0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4ed4dc0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4ed4e00 _sleep() at _sleep+0x2d4/frame 0xfffffe00e4ed4ea0 xpt_async_td() at xpt_async_td+0x74/frame 0xfffffe00e4ed4ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4ed4f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ed4f30 --- trap 0xe8530c75, rip = 0x57501147d801188, rsp = 0xc483fffe7f3ce853, rbp = 0xeb041345c602fb45 --- Tracing command cam pid 4 tid 100152 td 0xfffff80031939740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe010da46dc0 mi_switch() at mi_switch+0x171/frame 0xfffffe010da46de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe010da46e20 _sleep() at _sleep+0x2d4/frame 0xfffffe010da46ec0 xpt_scanner_thread() at xpt_scanner_thread+0x158/frame 0xfffffe010da46ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010da46f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da46f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command busdma pid 5 tid 100125 td 0xfffff8000469d000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4ed9da0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4ed9dc0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4ed9e00 _sleep() at _sleep+0x2d4/frame 0xfffffe00e4ed9ea0 busdma_thread() at busdma_thread+0xc5/frame 0xfffffe00e4ed9ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4ed9f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ed9f30 --- trap 0x4d958dd0, rip = 0x73fff98305723f77, rsp = 0x753b04728b2372dc, rbp = 0x8d078bffffef6ae8 --- Tracing command rand_harvestq pid 6 tid 100149 td 0xfffff8003192c000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe010da2dd20 mi_switch() at mi_switch+0x171/frame 0xfffffe010da2dd40 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe010da2dd80 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010da2ddc0 _sleep() at _sleep+0x2bb/frame 0xfffffe010da2de60 random_kthread() at random_kthread+0xb7/frame 0xfffffe010da2def0 fork_exit() at fork_exit+0x82/frame 0xfffffe010da2df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da2df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon0 pid 7 tid 100153 td 0xfffff80004201000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4ecfd80 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4ecfda0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4ecfde0 _sleep() at _sleep+0x2d4/frame 0xfffffe00e4ecfe80 enc_daemon() at enc_daemon+0xdd/frame 0xfffffe00e4ecfef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4ecff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ecff30 --- trap 0xec8b55c3, rip = 0xc75ff0875ff1875, rsp = 0x75ff560c408b0845, rbp = 0xc95bc0335e714688 --- Tracing command enc_daemon1 pid 8 tid 100154 td 0xfffff80004205740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe010da50d80 mi_switch() at mi_switch+0x171/frame 0xfffffe010da50da0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe010da50de0 _sleep() at _sleep+0x2d4/frame 0xfffffe010da50e80 enc_daemon() at enc_daemon+0xdd/frame 0xfffffe010da50ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010da50f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da50f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 9 tid 100197 td 0xfffff800051e1740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe010db389b0 mi_switch() at mi_switch+0x171/frame 0xfffffe010db389d0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe010db38a10 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db38a50 _sleep() at _sleep+0x2bb/frame 0xfffffe010db38af0 vm_pageout_worker() at vm_pageout_worker+0x28c/frame 0xfffffe010db38eb0 vm_pageout() at vm_pageout+0x1d7/frame 0xfffffe010db38ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010db38f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db38f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 9 tid 100198 td 0xfffff800047dc740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe010db4ea70 mi_switch() at mi_switch+0x171/frame 0xfffffe010db4ea90 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe010db4ead0 _sleep() at _sleep+0x2d4/frame 0xfffffe010db4eb70 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0xb2f/frame 0xfffffe010db4eef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010db4ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db4ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 9 tid 100199 td 0xfffff800047dc000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe010db3dd80 mi_switch() at mi_switch+0x171/frame 0xfffffe010db3dda0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe010db3dde0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db3de20 _sleep() at _sleep+0x2bb/frame 0xfffffe010db3dec0 uma_reclaim_worker() at uma_reclaim_worker+0xc8/frame 0xfffffe010db3def0 fork_exit() at fork_exit+0x82/frame 0xfffffe010db3df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db3df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command audit pid 10 tid 100001 td 0xfffff80003c82740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00377e6dd0 mi_switch() at mi_switch+0x171/frame 0xfffffe00377e6df0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00377e6e30 _cv_wait() at _cv_wait+0x163/frame 0xfffffe00377e6e90 audit_worker() at audit_worker+0x8f/frame 0xfffffe00377e6ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00377e6f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377e6f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100003 td 0xfffff80003c83740 (CPU 0) kdb_alt_break_internal() at kdb_alt_break_internal+0x135/frame 0xfffffe00377f0b90 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe00377f0ba0 uart_intr_rxready() at uart_intr_rxready+0xf4/frame 0xfffffe00377f0bd0 uart_intr() at uart_intr+0x118/frame 0xfffffe00377f0c10 intr_event_handle() at intr_event_handle+0x12b/frame 0xfffffe00377f0c80 intr_execute_handlers() at intr_execute_handlers+0x63/frame 0xfffffe00377f0cb0 Xapic_isr1() at Xapic_isr1+0xdc/frame 0xfffffe00377f0cb0 --- interrupt, rip = 0xffffffff804cb59e, rsp = 0xfffffe00377f0d80, rbp = 0xfffffe00377f0db0 --- acpi_cpu_idle() at acpi_cpu_idle+0x27e/frame 0xfffffe00377f0db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe00377f0dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00377f0df0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe00377f0ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00377f0f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377f0f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffff80003c83000 (CPU 1) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ce3cdf0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003ce3ce00 trap() at trap+0x56/frame 0xfffffe003ce3cf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce3cf20 --- trap 0x13, rip = 0xffffffff8102877e, rsp = 0xfffffe00377ebd78, rbp = 0xfffffe00377ebdb0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe00377ebdb0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe00377ebdd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00377ebdf0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe00377ebef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00377ebf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377ebf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffff80003c84740 (CPU 2) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ce4bdf0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003ce4be00 trap() at trap+0x56/frame 0xfffffe003ce4bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce4bf20 --- trap 0x13, rip = 0xffffffff8102877e, rsp = 0xfffffe00377fad78, rbp = 0xfffffe00377fadb0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe00377fadb0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe00377fadd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00377fadf0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe00377faef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00377faf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377faf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffff80003c84000 (CPU 3) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ce5adf0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003ce5ae00 trap() at trap+0x56/frame 0xfffffe003ce5af20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce5af20 --- trap 0x13, rip = 0xffffffff8102877e, rsp = 0xfffffe00377f5d78, rbp = 0xfffffe00377f5db0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe00377f5db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe00377f5dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00377f5df0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe00377f5ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00377f5f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377f5f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffff80003c8a740 (CPU 4) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ce69df0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003ce69e00 trap() at trap+0x56/frame 0xfffffe003ce69f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce69f20 --- trap 0x13, rip = 0xffffffff8102877e, rsp = 0xfffffe00e4830d78, rbp = 0xfffffe00e4830db0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe00e4830db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe00e4830dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00e4830df0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe00e4830ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4830f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4830f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffff80003c8a000 (CPU 5) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ce78df0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003ce78e00 trap() at trap+0x56/frame 0xfffffe003ce78f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce78f20 --- trap 0x13, rip = 0xffffffff8102877e, rsp = 0xfffffe00377ffd78, rbp = 0xfffffe00377ffdb0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe00377ffdb0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe00377ffdd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00377ffdf0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe00377ffef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00377fff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377fff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffff80003c74740 (CPU 6) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ce87df0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003ce87e00 trap() at trap+0x56/frame 0xfffffe003ce87f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce87f20 --- trap 0x13, rip = 0xffffffff8102877e, rsp = 0xfffffe00e483ad78, rbp = 0xfffffe00e483adb0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe00e483adb0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe00e483add0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00e483adf0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe00e483aef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e483af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e483af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffff80003c74000 (CPU 7) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ce96df0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003ce96e00 trap() at trap+0x56/frame 0xfffffe003ce96f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce96f20 --- trap 0x13, rip = 0xffffffff8102877e, rsp = 0xfffffe00e4835d78, rbp = 0xfffffe00e4835db0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe00e4835db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe00e4835dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00e4835df0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe00e4835ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4835f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4835f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffff80003c75740 (CPU 8) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003cea5df0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003cea5e00 trap() at trap+0x56/frame 0xfffffe003cea5f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003cea5f20 --- trap 0x13, rip = 0xffffffff8102877e, rsp = 0xfffffe00e4844d78, rbp = 0xfffffe00e4844db0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe00e4844db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe00e4844dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00e4844df0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe00e4844ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4844f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4844f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffff80003c75000 (CPU 9) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ceb4df0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003ceb4e00 trap() at trap+0x56/frame 0xfffffe003ceb4f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ceb4f20 --- trap 0x13, rip = 0xffffffff8102877e, rsp = 0xfffffe00e483fd78, rbp = 0xfffffe00e483fdb0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe00e483fdb0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe00e483fdd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00e483fdf0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe00e483fef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e483ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e483ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffff80003c76740 (CPU 10) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003cec3df0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003cec3e00 trap() at trap+0x56/frame 0xfffffe003cec3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003cec3f20 --- trap 0x13, rip = 0xffffffff8102877e, rsp = 0xfffffe00e484ed78, rbp = 0xfffffe00e484edb0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe00e484edb0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe00e484edd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00e484edf0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe00e484eef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e484ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e484ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffff80003c76000 (CPU 11) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ced2df0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003ced2e00 trap() at trap+0x56/frame 0xfffffe003ced2f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ced2f20 --- trap 0x13, rip = 0xffffffff8102877e, rsp = 0xfffffe00e4849d78, rbp = 0xfffffe00e4849db0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe00e4849db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe00e4849dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00e4849df0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe00e4849ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4849f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4849f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100042 td 0xfffff80003c2b000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e48d5e40 mi_switch() at mi_switch+0x171/frame 0xfffffe00e48d5e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e48d5ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e48d5f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e48d5f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100043 td 0xfffff80003c2c740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100045 td 0xfffff80003c2d740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100089 td 0xfffff80003d23740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e49fae40 mi_switch() at mi_switch+0x171/frame 0xfffffe00e49fae60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e49faef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e49faf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49faf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100124 td 0xfffff8000469d740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4edee40 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4edee60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4edeef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4edef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4edef30 --- trap 0x3c0, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xfe80d727facddea4 --- Tracing command intr pid 12 tid 100126 td 0xfffff8000469e740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4ee8e40 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4ee8e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4ee8ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4ee8f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ee8f30 --- trap 0x1, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0x30646870 --- Tracing command intr pid 12 tid 100132 td 0xfffff800047d9740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4f06e40 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4f06e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4f06ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4f06f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f06f30 --- trap 0x7f, rip = 0x2020900000000, rsp = 0x7000000000, rbp = 0x100020204 --- Tracing command intr pid 12 tid 100143 td 0xfffff8000505e000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100144 td 0xfffff8000506a740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100145 td 0xfffff8000506a000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4f49e40 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4f49e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00e4f49ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4f49f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f49f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0 --- Tracing command intr pid 12 tid 100159 td 0xfffff800318e5000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe010da5fe40 mi_switch() at mi_switch+0x171/frame 0xfffffe010da5fe60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe010da5fef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010da5ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da5ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100160 td 0xfffff800318e6740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe010da6ee40 mi_switch() at mi_switch+0x171/frame 0xfffffe010da6ee60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe010da6eef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010da6ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da6ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100161 td 0xfffff800318e6000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100162 td 0xfffff800318e7740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100163 td 0xfffff800318e7000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100164 td 0xfffff80038215740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100165 td 0xfffff80038215000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100166 td 0xfffff80038216740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100167 td 0xfffff80038216000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100168 td 0xfffff80038217740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100169 td 0xfffff80038217000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100170 td 0xfffff80038218740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100171 td 0xfffff80038218000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100172 td 0xfffff80038211740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100173 td 0xfffff80038211000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100180 td 0xfffff8003cbf3740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe010dad2e40 mi_switch() at mi_switch+0x171/frame 0xfffffe010dad2e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe010dad2ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010dad2f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010dad2f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100181 td 0xfffff80004205000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe010da4be40 mi_switch() at mi_switch+0x171/frame 0xfffffe010da4be60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe010da4bef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010da4bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010da4bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100182 td 0xfffff80004206740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100183 td 0xfffff80004206000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100184 td 0xfffff800044f7740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100185 td 0xfffff800044f7000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100186 td 0xfffff800044f8740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100187 td 0xfffff800044f8000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100188 td 0xfffff800044f9740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100189 td 0xfffff800044f9000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100190 td 0xfffff800044fa740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100191 td 0xfffff800044fa000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100192 td 0xfffff800044f3740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100193 td 0xfffff800044f3000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100194 td 0xfffff800044f4740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100240 td 0xfffff8003cbf6740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100241 td 0xfffff8003cbf6000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100242 td 0xfffff8003cc68740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100243 td 0xfffff8003cc68000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100244 td 0xfffff8003cc69740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100245 td 0xfffff8003cc69000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100246 td 0xfffff8003cc4e740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100247 td 0xfffff8003cc4e000 fork_trampoline() at fork_trampoline Tracing command geom pid 13 tid 100091 td 0xfffff80003d24740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4e34dc0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4e34de0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4e34e20 _sleep() at _sleep+0x2d4/frame 0xfffffe00e4e34ec0 g_run_events() at g_run_events+0x434/frame 0xfffffe00e4e34ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4e34f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e34f30 --- trap 0x76a6024, rip = 0x44c6565378778d53, rsp = 0x8497ff3c247489, rbp = 0x6814c4834824448b --- Tracing command geom pid 13 tid 100092 td 0xfffff80003d24000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e49ffdb0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e49ffdd0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e49ffe10 _sleep() at _sleep+0x2d4/frame 0xfffffe00e49ffeb0 g_io_schedule_up() at g_io_schedule_up+0x3c/frame 0xfffffe00e49ffee0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe00e49ffef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e49fff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49fff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100093 td 0xfffff80003d25740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4e3edb0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4e3edd0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4e3ee10 _sleep() at _sleep+0x2d4/frame 0xfffffe00e4e3eeb0 g_io_schedule_down() at g_io_schedule_down+0x4c/frame 0xfffffe00e4e3eee0 g_down_procbody() at g_down_procbody+0x5c/frame 0xfffffe00e4e3eef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4e3ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e3ef30 --- trap 0xd, rip = 0x1000000e0ffffff, rsp = 0x1000000e0ffffff, rbp = 0xe0ffff07002428 --- Tracing command sequencer 00 pid 14 tid 100094 td 0xfffff80003d25000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4e39db0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4e39dd0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4e39e10 _cv_wait() at _cv_wait+0x163/frame 0xfffffe00e4e39e70 seq_eventthread() at seq_eventthread+0x8c/frame 0xfffffe00e4e39ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4e39f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4e39f30 --- trap 0x82e06b32, rip = 0x182bc0ec79e60087, rsp = 0xa366b94a1cbb8a50, rbp = 0xdcb7b2f928208f02 --- Tracing command usb pid 15 tid 100127 td 0xfffff8000469e000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4ee3e00 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4ee3e20 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4ee3e60 _cv_wait() at _cv_wait+0x163/frame 0xfffffe00e4ee3ec0 usb_process() at usb_process+0xb0/frame 0xfffffe00e4ee3ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4ee3f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ee3f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command usb pid 15 tid 100128 td 0xfffff8000469f740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4ef2e00 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4ef2e20 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4ef2e60 _cv_wait() at _cv_wait+0x163/frame 0xfffffe00e4ef2ec0 usb_process() at usb_process+0xb0/frame 0xfffffe00e4ef2ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4ef2f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ef2f30 --- trap 0x540, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0x50006700630054 --- Tracing command usb pid 15 tid 100129 td 0xfffff8000469f000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4eede00 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4eede20 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4eede60 _cv_wait() at _cv_wait+0x163/frame 0xfffffe00e4eedec0 usb_process() at usb_process+0xb0/frame 0xfffffe00e4eedef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4eedf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4eedf30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xb8664 --- Tracing command usb pid 15 tid 100130 td 0xfffff800046a7740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4efce00 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4efce20 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4efce60 _cv_wait() at _cv_wait+0x163/frame 0xfffffe00e4efcec0 usb_process() at usb_process+0xb0/frame 0xfffffe00e4efcef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4efcf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4efcf30 --- trap 0x33c80b0a, rip = 0xfee89589d103c80b, rsp = 0xfef0958bfffffee0, rbp = 0x858b02eac1fffffe --- Tracing command usb pid 15 tid 100131 td 0xfffff800046a7000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4ef7e00 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4ef7e20 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4ef7e60 _cv_wait() at _cv_wait+0x163/frame 0xfffffe00e4ef7ec0 usb_process() at usb_process+0xb0/frame 0xfffffe00e4ef7ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4ef7f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4ef7f30 --- trap 0xff25, rip = 0xcb888808458b00e2, rsp = 0x45c708c483ffffe6, rbp = 0xc8828808558b --- Tracing command usb pid 15 tid 100133 td 0xfffff800047d9000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4f01e00 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4f01e20 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4f01e60 _cv_wait() at _cv_wait+0x163/frame 0xfffffe00e4f01ec0 usb_process() at usb_process+0xb0/frame 0xfffffe00e4f01ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4f01f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f01f30 --- trap 0xffe98130, rip = 0x1000b8057400, rsp = 0x7774c023c07e0f66, rbp = 0xd37e0f0d7406fb83 --- Tracing command usb pid 15 tid 100134 td 0xfffff800047da740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4f10e00 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4f10e20 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4f10e60 _cv_wait() at _cv_wait+0x163/frame 0xfffffe00e4f10ec0 usb_process() at usb_process+0xb0/frame 0xfffffe00e4f10ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4f10f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f10f30 --- trap 0x8024b4ff, rip = 0x6a00000522e9010f, rsp = 0x70247c836620c7, rbp = 0x896c2474ff016a50 --- Tracing command usb pid 15 tid 100135 td 0xfffff800047da000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4f0be00 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4f0be20 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4f0be60 _cv_wait() at _cv_wait+0x163/frame 0xfffffe00e4f0bec0 usb_process() at usb_process+0xb0/frame 0xfffffe00e4f0bef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4f0bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f0bf30 --- trap 0xb589ffff, rip = 0x8d89fffffde4b589, rsp = 0xfffdf4b589fffffd, rbp = 0xfec4b589fffffef0 --- Tracing command usb pid 15 tid 100136 td 0xfffff800047db740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4f1ae00 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4f1ae20 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4f1ae60 _cv_wait() at _cv_wait+0x163/frame 0xfffffe00e4f1aec0 usb_process() at usb_process+0xb0/frame 0xfffffe00e4f1aef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4f1af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f1af30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafaf6c617470 --- Tracing command usb pid 15 tid 100137 td 0xfffff800047db000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4f15e00 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4f15e20 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4f15e60 _cv_wait() at _cv_wait+0x163/frame 0xfffffe00e4f15ec0 usb_process() at usb_process+0xb0/frame 0xfffffe00e4f15ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4f15f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f15f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xc8664 --- Tracing command usb pid 15 tid 100138 td 0xfffff8000505c740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4f30e00 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4f30e20 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4f30e60 _cv_wait() at _cv_wait+0x163/frame 0xfffffe00e4f30ec0 usb_process() at usb_process+0xb0/frame 0xfffffe00e4f30ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4f30f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f30f30 --- trap 0x3fa000, rip = 0x3fc000, rsp = 0x1000, rbp = 0x1000 --- Tracing command usb pid 15 tid 100139 td 0xfffff8000505c000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4f2be00 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4f2be20 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4f2be60 _cv_wait() at _cv_wait+0x163/frame 0xfffffe00e4f2bec0 usb_process() at usb_process+0xb0/frame 0xfffffe00e4f2bef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4f2bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f2bf30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command usb pid 15 tid 100140 td 0xfffff8000505d740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4f3ae00 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4f3ae20 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4f3ae60 _cv_wait() at _cv_wait+0x163/frame 0xfffffe00e4f3aec0 usb_process() at usb_process+0xb0/frame 0xfffffe00e4f3aef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4f3af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f3af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100141 td 0xfffff8000505d000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4f35e00 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4f35e20 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4f35e60 _cv_wait() at _cv_wait+0x163/frame 0xfffffe00e4f35ec0 usb_process() at usb_process+0xb0/frame 0xfffffe00e4f35ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4f35f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f35f30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command usb pid 15 tid 100142 td 0xfffff8000505e740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e4f44e00 mi_switch() at mi_switch+0x171/frame 0xfffffe00e4f44e20 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e4f44e60 _cv_wait() at _cv_wait+0x163/frame 0xfffffe00e4f44ec0 usb_process() at usb_process+0xb0/frame 0xfffffe00e4f44ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e4f44f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e4f44f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vmdaemon pid 16 tid 100200 td 0xfffff800051e1000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe010db27d80 mi_switch() at mi_switch+0x171/frame 0xfffffe010db27da0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe010db27de0 _sleep() at _sleep+0x2d4/frame 0xfffffe010db27e80 vm_daemon() at vm_daemon+0x82/frame 0xfffffe010db27ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010db27f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db27f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100201 td 0xfffff800051e2740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe010db58d60 mi_switch() at mi_switch+0x171/frame 0xfffffe010db58d80 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe010db58dc0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db58e00 _sleep() at _sleep+0x2bb/frame 0xfffffe010db58ea0 buf_daemon() at buf_daemon+0x121/frame 0xfffffe010db58ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010db58f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db58f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100202 td 0xfffff8003ccb7740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe010db62d40 mi_switch() at mi_switch+0x171/frame 0xfffffe010db62d60 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe010db62da0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db62de0 _sleep() at _sleep+0x2bb/frame 0xfffffe010db62e80 bufspace_daemon() at bufspace_daemon+0x322/frame 0xfffffe010db62ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010db62f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db62f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100203 td 0xfffff8003ccb7000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe010db5dd40 mi_switch() at mi_switch+0x171/frame 0xfffffe010db5dd60 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe010db5dda0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db5dde0 _sleep() at _sleep+0x2bb/frame 0xfffffe010db5de80 bufspace_daemon() at bufspace_daemon+0x322/frame 0xfffffe010db5def0 fork_exit() at fork_exit+0x82/frame 0xfffffe010db5df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db5df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100204 td 0xfffff8003ccb8740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe010db6cd40 mi_switch() at mi_switch+0x171/frame 0xfffffe010db6cd60 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe010db6cda0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db6cde0 _sleep() at _sleep+0x2bb/frame 0xfffffe010db6ce80 bufspace_daemon() at bufspace_daemon+0x322/frame 0xfffffe010db6cef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010db6cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db6cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100205 td 0xfffff8003ccb8000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe010db67d40 mi_switch() at mi_switch+0x171/frame 0xfffffe010db67d60 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe010db67da0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db67de0 _sleep() at _sleep+0x2bb/frame 0xfffffe010db67e80 bufspace_daemon() at bufspace_daemon+0x322/frame 0xfffffe010db67ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010db67f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db67f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100206 td 0xfffff8003ccb9740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe010db71d40 mi_switch() at mi_switch+0x171/frame 0xfffffe010db71d60 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe010db71da0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db71de0 _sleep() at _sleep+0x2bb/frame 0xfffffe010db71e80 bufspace_daemon() at bufspace_daemon+0x322/frame 0xfffffe010db71ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010db71f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db71f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100207 td 0xfffff8003ccb9000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe011011fd40 mi_switch() at mi_switch+0x171/frame 0xfffffe011011fd60 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe011011fda0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe011011fde0 _sleep() at _sleep+0x2bb/frame 0xfffffe011011fe80 bufspace_daemon() at bufspace_daemon+0x322/frame 0xfffffe011011fef0 fork_exit() at fork_exit+0x82/frame 0xfffffe011011ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe011011ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100208 td 0xfffff8003ccc1740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe010db7bd40 mi_switch() at mi_switch+0x171/frame 0xfffffe010db7bd60 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe010db7bda0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db7bde0 _sleep() at _sleep+0x2bb/frame 0xfffffe010db7be80 bufspace_daemon() at bufspace_daemon+0x322/frame 0xfffffe010db7bef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010db7bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db7bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100232 td 0xfffff8003cc6c740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe013b3b5d70 mi_switch() at mi_switch+0x171/frame 0xfffffe013b3b5d90 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe013b3b5dd0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe013b3b5e10 _sleep() at _sleep+0x2bb/frame 0xfffffe013b3b5eb0 softdep_flush() at softdep_flush+0x188/frame 0xfffffe013b3b5ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe013b3b5f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe013b3b5f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100251 td 0xfffff8003d06f000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe01661c6d70 mi_switch() at mi_switch+0x171/frame 0xfffffe01661c6d90 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe01661c6dd0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe01661c6e10 _sleep() at _sleep+0x2bb/frame 0xfffffe01661c6eb0 softdep_flush() at softdep_flush+0x188/frame 0xfffffe01661c6ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01661c6f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01661c6f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vnlru pid 18 tid 100209 td 0xfffff800051e2000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe010db53d10 mi_switch() at mi_switch+0x171/frame 0xfffffe010db53d30 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe010db53d70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010db53db0 _sleep() at _sleep+0x2bb/frame 0xfffffe010db53e50 vnlru_proc() at vnlru_proc+0x18b/frame 0xfffffe010db53ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010db53f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010db53f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command syncer pid 19 tid 100210 td 0xfffff800051e3740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe01661b2d50 mi_switch() at mi_switch+0x171/frame 0xfffffe01661b2d70 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe01661b2db0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe01661b2df0 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x186/frame 0xfffffe01661b2e60 sched_sync() at sched_sync+0x6ae/frame 0xfffffe01661b2ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01661b2f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01661b2f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kldunload pid 3421 tid 359802 td 0xfffff801776ff000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe069f5edb80 mi_switch() at mi_switch+0x171/frame 0xfffffe069f5edba0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe069f5edbe0 _sleep() at _sleep+0x2d4/frame 0xfffffe069f5edc80 _eventhandler_deregister() at _eventhandler_deregister+0x191/frame 0xfffffe069f5edcc0 load() at load+0x1cb/frame 0xfffffe069f5edd10 kern_syscall_module_handler() at kern_syscall_module_handler+0xce/frame 0xfffffe069f5edd50 module_unload() at module_unload+0x32/frame 0xfffffe069f5edd70 linker_file_unload() at linker_file_unload+0x1eb/frame 0xfffffe069f5eddb0 kern_kldunload() at kern_kldunload+0x18e/frame 0xfffffe069f5ede00 amd64_syscall() at amd64_syscall+0x153/frame 0xfffffe069f5edf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe069f5edf30 --- syscall (444, FreeBSD ELF64, kldunloadf), rip = 0x172ed823f73a, rsp = 0x172ed63f8798, rbp = 0x172ed63f8ff0 --- Tracing command sh pid 3423 tid 103670 td 0xfffff80616bc9000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe069f5b3bb0 mi_switch() at mi_switch+0x171/frame 0xfffffe069f5b3bd0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe069f5b3c10 _sx_xlock_hard() at _sx_xlock_hard+0x481/frame 0xfffffe069f5b3cb0 _sx_xlock() at _sx_xlock+0xb0/frame 0xfffffe069f5b3cf0 pmc_process_exit() at pmc_process_exit+0xc0/frame 0xfffffe069f5b3d80 exit1() at exit1+0x370/frame 0xfffffe069f5b3df0 sys_exit() at sys_exit+0xd/frame 0xfffffe069f5b3e00 amd64_syscall() at amd64_syscall+0x153/frame 0xfffffe069f5b3f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe069f5b3f30 --- syscall (1, FreeBSD ELF64, exit), rip = 0x196b545f771a, rsp = 0x196b532d8ca8, rbp = 0x196b532d8da0 --- Tracing command sh pid 4163 tid 100250 td 0xfffff8003d90b740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe016a3d2a20 mi_switch() at mi_switch+0x171/frame 0xfffffe016a3d2a40 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe016a3d2a80 sleepq_catch_signals() at sleepq_catch_signals+0x276/frame 0xfffffe016a3d2ad0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe016a3d2ae0 _sleep() at _sleep+0x2ca/frame 0xfffffe016a3d2b80 kern_wait6() at kern_wait6+0x481/frame 0xfffffe016a3d2c10 sys_wait4() at sys_wait4+0x6d/frame 0xfffffe016a3d2e00 amd64_syscall() at amd64_syscall+0x153/frame 0xfffffe016a3d2f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe016a3d2f30 --- syscall (7, FreeBSD ELF64, wait4), rip = 0x33f971fb2c1a, rsp = 0x33f970803c28, rbp = 0x33f970803cd0 --- Tracing command procstat pid 4166 tid 103667 td 0xfffff80616b2d740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe069f5a4920 mi_switch() at mi_switch+0x171/frame 0xfffffe069f5a4940 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe069f5a4980 _sx_slock_hard() at _sx_slock_hard+0x2dd/frame 0xfffffe069f5a4a10 _sx_slock_int() at _sx_slock_int+0xad/frame 0xfffffe069f5a4a50 linker_search_symbol_name_flags() at linker_search_symbol_name_flags+0x4e/frame 0xfffffe069f5a4a80 stack_sbuf_print_flags() at stack_sbuf_print_flags+0x8e/frame 0xfffffe069f5a4b10 sysctl_kern_proc_kstack() at sysctl_kern_proc_kstack+0x1de/frame 0xfffffe069f5a4bd0 sysctl_root_handler_locked() at sysctl_root_handler_locked+0x9c/frame 0xfffffe069f5a4c20 sysctl_root() at sysctl_root+0x21e/frame 0xfffffe069f5a4ca0 userland_sysctl() at userland_sysctl+0x184/frame 0xfffffe069f5a4d50 sys___sysctl() at sys___sysctl+0x60/frame 0xfffffe069f5a4e00 amd64_syscall() at amd64_syscall+0x153/frame 0xfffffe069f5a4f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe069f5a4f30 --- syscall (202, FreeBSD ELF64, __sysctl), rip = 0x3e7e4754343a, rsp = 0x3e7e42fb54f8, rbp = 0x3e7e42fb5530 --- Tracing command ftcleanup pid 70182 tid 101185 td 0xfffff8003d1ef000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe01107acda0 mi_switch() at mi_switch+0x171/frame 0xfffffe01107acdc0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe01107ace00 _sleep() at _sleep+0x2d4/frame 0xfffffe01107acea0 fasttrap_pid_cleanup_cb() at fasttrap_pid_cleanup_cb+0x26d/frame 0xfffffe01107acef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01107acf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01107acf30 --- trap 0xc, rip = 0x196b545f771a, rsp = 0x196b532d8ca8, rbp = 0x196b532d8da0 --- Tracing command aiod1 pid 6068 tid 100266 td 0xfffff8003d071740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe0110757d60 mi_switch() at mi_switch+0x171/frame 0xfffffe0110757d80 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe0110757dc0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0110757e00 _sleep() at _sleep+0x2bb/frame 0xfffffe0110757ea0 aio_daemon() at aio_daemon+0x31a/frame 0xfffffe0110757ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0110757f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0110757f30 --- trap 0xc, rip = 0x2ff6de2a271a, rsp = 0x2ff6dc657f78, rbp = 0x2ff6dc657f90 --- Tracing command aiod2 pid 6069 tid 101535 td 0xfffff8023aa4f740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe013b3f3d60 mi_switch() at mi_switch+0x171/frame 0xfffffe013b3f3d80 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe013b3f3dc0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe013b3f3e00 _sleep() at _sleep+0x2bb/frame 0xfffffe013b3f3ea0 aio_daemon() at aio_daemon+0x31a/frame 0xfffffe013b3f3ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe013b3f3f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe013b3f3f30 --- trap 0xc, rip = 0x196b545f771a, rsp = 0x196b532d8ca8, rbp = 0x196b532d8da0 --- Tracing command aiod3 pid 6070 tid 101440 td 0xfffff80281c6d740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe016d1b2d60 mi_switch() at mi_switch+0x171/frame 0xfffffe016d1b2d80 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe016d1b2dc0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe016d1b2e00 _sleep() at _sleep+0x2bb/frame 0xfffffe016d1b2ea0 aio_daemon() at aio_daemon+0x31a/frame 0xfffffe016d1b2ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe016d1b2f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe016d1b2f30 --- trap 0xc, rip = 0x196b545f771a, rsp = 0x196b532d8ca8, rbp = 0x196b532d8da0 --- Tracing command aiod4 pid 6071 tid 101474 td 0xfffff80195a7d740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe01107bbd60 mi_switch() at mi_switch+0x171/frame 0xfffffe01107bbd80 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe01107bbdc0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe01107bbe00 _sleep() at _sleep+0x2bb/frame 0xfffffe01107bbea0 aio_daemon() at aio_daemon+0x31a/frame 0xfffffe01107bbef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01107bbf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01107bbf30 --- trap 0xc, rip = 0x38385180c71a, rsp = 0x38384fd39778, rbp = 0x38384fd39790 --- Tracing command soaiod1 pid 6199 tid 101238 td 0xfffff804d46c3740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe01af8d9d70 mi_switch() at mi_switch+0x171/frame 0xfffffe01af8d9d90 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe01af8d9dd0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe01af8d9e10 _sleep() at _sleep+0x2bb/frame 0xfffffe01af8d9eb0 soaio_kproc_loop() at soaio_kproc_loop+0x126/frame 0xfffffe01af8d9ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01af8d9f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01af8d9f30 --- trap 0xc, rip = 0x1daefc76c71a, rsp = 0x1daefa5adcd8, rbp = 0x1daefa5adcf0 --- Tracing command soaiod2 pid 6200 tid 101635 td 0xfffff80281c73000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe01af9dfd70 mi_switch() at mi_switch+0x171/frame 0xfffffe01af9dfd90 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe01af9dfdd0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe01af9dfe10 _sleep() at _sleep+0x2bb/frame 0xfffffe01af9dfeb0 soaio_kproc_loop() at soaio_kproc_loop+0x126/frame 0xfffffe01af9dfef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01af9dff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01af9dff30 --- trap 0xc, rip = 0x36c7833fc71a, rsp = 0x36c7828bd898, rbp = 0x36c7828bd8b0 --- Tracing command soaiod3 pid 6201 tid 100573 td 0xfffff8034d79d000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe01661cbd70 mi_switch() at mi_switch+0x171/frame 0xfffffe01661cbd90 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe01661cbdd0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe01661cbe10 _sleep() at _sleep+0x2bb/frame 0xfffffe01661cbeb0 soaio_kproc_loop() at soaio_kproc_loop+0x126/frame 0xfffffe01661cbef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01661cbf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01661cbf30 --- trap 0xc, rip = 0x196b545f771a, rsp = 0x196b532d8ca8, rbp = 0x196b532d8da0 --- Tracing command soaiod4 pid 6202 tid 101468 td 0xfffff80195179000 sched_switch() at sched_switch+0x5d9/frame 0xfffffe01107a2d70 mi_switch() at mi_switch+0x171/frame 0xfffffe01107a2d90 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe01107a2dd0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe01107a2e10 _sleep() at _sleep+0x2bb/frame 0xfffffe01107a2eb0 soaio_kproc_loop() at soaio_kproc_loop+0x126/frame 0xfffffe01107a2ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01107a2f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01107a2f30 --- trap 0xc, rip = 0x196b545f771a, rsp = 0x196b532d8ca8, rbp = 0x196b532d8da0 --- Tracing command sctp_iterator pid 88914 tid 101543 td 0xfffff800050f9740 sched_switch() at sched_switch+0x5d9/frame 0xfffffe00e49a7dd0 mi_switch() at mi_switch+0x171/frame 0xfffffe00e49a7df0 sleepq_switch() at sleepq_switch+0x104/frame 0xfffffe00e49a7e30 _sleep() at _sleep+0x2d4/frame 0xfffffe00e49a7ed0 sctp_iterator_thread() at sctp_iterator_thread+0x59/frame 0xfffffe00e49a7ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00e49a7f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e49a7f30 --- trap 0xc, rip = 0x1d603281871a, rsp = 0x1d602e2feb58, rbp = 0x1d602e2feb70 --- db> reset Uptime: 1d0h41m24s (kgdb) proc 3421 (kgdb) bt #0 sched_switch (td=td@entry=0xfffff801776ff000, flags=flags@entry=0x103) at ../../../kern/sched_ule.c:2297 #1 0xffffffff80b63191 in mi_switch (flags=flags@entry=0x103) at ../../../kern/kern_synch.c:546 #2 0xffffffff80bb5dc4 in sleepq_switch (wchan=0xfffff8000324ee00, pri=0x0) at ../../../kern/subr_sleepqueue.c:607 #3 0xffffffff80bb5c9c in sleepq_wait (wchan=, pri=) at ../../../kern/subr_sleepqueue.c:658 #4 0xffffffff80b626f4 in _sleep (ident=ident@entry=0xfffff8000324ee00, lock=lock@entry=0xfffff8000324ee10, priority=priority@entry=0x0, wmesg=0xffffffff81271f60 "evhrm", sbt=sbt@entry=0x0, pr=pr@entry=0x0, flags=0x100) at ../../../kern/kern_synch.c:221 #5 0xffffffff80ba02b1 in _eventhandler_deregister (list=0xfffff8000324ee00, tag=0xfffff80005176000, wait=) at ../../../kern/subr_eventhandler.c:221 #6 0xffffffff80ba011c in eventhandler_deregister (list=, tag=) at ../../../kern/subr_eventhandler.c:229 #7 0xffffffff827826cb in pmc_cleanup () at /usr/src/sys/dev/hwpmc/hwpmc_mod.c:5703 #8 load (module=, cmd=, cmd@entry=, arg=) at /usr/src/sys/dev/hwpmc/hwpmc_mod.c:5869 #9 0xffffffff80b63c5e in kern_syscall_module_handler (sysents=0xffffffff816c1d80 , mod=0xfffff8061629d800, what=, arg=0xffffffff82796968 ) at ../../../kern/kern_syscalls.c:215 #10 0xffffffff80b2ee82 in module_unload (mod=mod@entry=0xfffff8061629d800) at ../../../kern/kern_module.c:258 #11 0xffffffff80b1df0b in linker_file_unload (file=file@entry=0xfffff8002b82b780, flags=flags@entry=0x0) at ../../../kern/kern_linker.c:719 #12 0xffffffff80b1f74e in kern_kldunload (td=, fileid=0x21, flags=0x0) at ../../../kern/kern_linker.c:1231 #13 0xffffffff8106c4e3 in syscallenter (td=0xfffff801776ff000) at ../../../amd64/amd64/../../kern/subr_syscall.c:186 #14 amd64_syscall (td=0xfffff801776ff000, traced=0x0) at ../../../amd64/amd64/trap.c:1192 #15 #16 0x0000172ed823f73a in ?? () Backtrace stopped: Cannot access memory at address 0x172ed63f8798 (kgdb) f 5 #5 0xffffffff80ba02b1 in _eventhandler_deregister (list=0xfffff8000324ee00, tag=0xfffff80005176000, wait=) at ../../../kern/subr_eventhandler.c:221 221 mtx_sleep(list, &list->el_lock, 0, "evhrm", 0); (kgdb) l 216 TAILQ_FOREACH(ep, &list->el_entries, ee_link) 217 ep->ee_priority = EHE_DEAD_PRIORITY; 218 } 219 } 220 while (wait && list->el_runcount > 0) 221 mtx_sleep(list, &list->el_lock, 0, "evhrm", 0); 222 EHL_UNLOCK(list); 223 } 224 225 void (kgdb) info loc ep = (kgdb) p *list $1 = {el_name = 0xfffff8000324ee50 "process_exit", el_flags = 0x0, el_runcount = 0x1, el_lock = {lock_object = { lo_name = 0xfffff8000324ee50 "process_exit", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xfffff8087fd7b000}, mtx_lock = 0x0}, el_link = {tqe_next = 0xfffff8000324ee80, tqe_prev = 0xfffff8000324edb0}, el_entries = {tqh_first = 0xfffff800317766c0, tqh_last = 0xfffff80135805340}} (kgdb) f 6 #6 0xffffffff80ba011c in eventhandler_deregister (list=, tag=) at ../../../kern/subr_eventhandler.c:229 229 _eventhandler_deregister(list, tag, true); (kgdb) l 224 225 void 226 eventhandler_deregister(struct eventhandler_list *list, eventhandler_tag tag) 227 { 228 229 _eventhandler_deregister(list, tag, true); 230 } 231 232 void 233 eventhandler_deregister_nowait(struct eventhandler_list *list, (kgdb) f 7 #7 0xffffffff827826cb in pmc_cleanup () at /usr/src/sys/dev/hwpmc/hwpmc_mod.c:5703 5703 EVENTHANDLER_DEREGISTER(process_exit, pmc_exit_tag); (kgdb) l 5698 5699 pmc_hook = NULL; /* prevent new threads from entering module */ 5700 5701 /* deregister event handlers */ 5702 EVENTHANDLER_DEREGISTER(process_fork, pmc_fork_tag); 5703 EVENTHANDLER_DEREGISTER(process_exit, pmc_exit_tag); 5704 EVENTHANDLER_DEREGISTER(kld_load, pmc_kld_load_tag); 5705 EVENTHANDLER_DEREGISTER(kld_unload, pmc_kld_unload_tag); 5706 5707 /* send SIGBUS to all owner threads, free up allocations */ (kgdb) info loc _el = cpu = ph = po = tmp = maxcpu = pb = c = prh = _el = _el = _el = _el = (kgdb) -- Test scenario: src/tools/test/stress2/misc/hwpmc5.sh