panic: crunuse: ref -1 not > 0 on cred 0xfffff80003631c00, vmcore.989 KDB: debugger backends: ddb KDB: current backend: ddb ---<>--- Copyright (c) 1992-2026 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 16.0-CURRENT #1 nocharge-n282847-5c30658f2616: Sun Jan 4 06:59:27 CET 2026 pho@mercat1.netperf.freebsd.org:/var/tmp/deviant3/sys/amd64/compile/PHO amd64 FreeBSD clang version 19.1.7 (https://github.com/llvm/llvm-project.git llvmorg-19.1.7-0-gcd708029e0b2) WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. sysctl_register_oid: can't re-use a leaf (machdep.hwpstate_pkg_ctrl)! VT(vga): resolution 640x480 CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.17-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab Structured Extended Features3=0x9c000400 XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics real memory = 34359738368 (32768 MB) avail memory = 33305763840 (31762 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 12 CPUs FreeBSD/SMP: 1 package(s) x 6 core(s) x 2 hardware threads random: registering fast source Intel Secure Key RNG random: fast provider: "Intel Secure Key RNG" random: unblocking device. ioapic0 irqs 0-23 ioapic1 irqs 24-47 Launching APs: 1 4 10 3 7 9 8 11 2 6 5 random: entropy device external interface kbd1 at kbdmux0 vtvga0: smbios0: at iomem 0xf05e0-0xf05fe smbios0: Entry point: v2.1 (32-bit), Version: 3.0, BCD Revision: 3.0 aesni0: acpi0: <> acpi0: Power Button (fixed) cpu0: on acpi0 atrtc0: port 0x70-0x71,0x74-0x77 irq 8 on acpi0 atrtc0: registered as a time-of-day clock, resolution 1.000000s Event timer "RTC" frequency 32768 Hz quality 0 attimer0: port 0x40-0x43,0x50-0x53 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Event timer "HPET" frequency 14318180 Hz quality 350 Event timer "HPET1" frequency 14318180 Hz quality 340 Event timer "HPET2" frequency 14318180 Hz quality 340 Event timer "HPET3" frequency 14318180 Hz quality 340 Event timer "HPET4" frequency 14318180 Hz quality 340 Event timer "HPET5" frequency 14318180 Hz quality 340 Event timer "HPET6" frequency 14318180 Hz quality 340 Event timer "HPET7" frequency 14318180 Hz quality 340 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 pcib0: on acpi0 pci0: on pcib0 pci0: at device 11.1 (no driver attached) pci0: at device 11.2 (no driver attached) pci0: at device 16.1 (no driver attached) pci0: at device 16.6 (no driver attached) pci0: at device 18.1 (no driver attached) acpi_syscontainer0: on acpi0 pcib1: port 0xcf8-0xcff on acpi0 pci1: on pcib1 pcib2: irq 26 at device 1.0 on pci1 pci2: on pcib2 pcib3: irq 32 at device 2.0 on pci1 pci3: on pcib3 pci3: at device 0.0 (no driver attached) pci3: at device 0.1 (no driver attached) pcib4: irq 40 at device 3.0 on pci1 pci4: on pcib4 pci1: at device 17.0 (no driver attached) ahci0: port 0xf110-0xf117,0xf100-0xf103,0xf0f0-0xf0f7,0xf0e0-0xf0e3,0xf020-0xf03f mem 0xfb416000-0xfb4167ff irq 16 at device 17.4 on pci1 ahci0: AHCI v1.30 with 4 6Gbps ports, Port Multiplier not supported ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahcich2: at channel 2 on ahci0 ahcich3: at channel 3 on ahci0 ahciem0: on ahci0 xhci0: mem 0xfb400000-0xfb40ffff irq 19 at device 20.0 on pci1 xhci0: 32 bytes context size, 64-bit DMA xhci0: xECP capabilities usbus0 on xhci0 usbus0: 5.0Gbps Super Speed USB v3.0 pci1: at device 22.0 (no driver attached) pci1: at device 22.1 (no driver attached) ehci0: mem 0xfb412000-0xfb4123ff irq 18 at device 26.0 on pci1 usbus1: EHCI version 1.0 usbus1 on ehci0 usbus1: 480Mbps High Speed USB v2.0 pcib5: irq 16 at device 28.0 on pci1 pci5: on pcib5 pcib6: irq 18 at device 28.2 on pci1 pci6: on pcib6 pcib7: at device 0.0 on pci6 pci7: on pcib7 vgapci0: port 0xe000-0xe07f mem 0xfa000000-0xfaffffff,0xfb000000-0xfb01ffff irq 18 at device 0.0 on pci7 vgapci0: Boot video device pcib8: irq 16 at device 28.4 on pci1 pci8: on pcib8 igb0: port 0xd020-0xd03f mem 0xfb320000-0xfb33ffff,0xfb344000-0xfb347fff irq 16 at device 0.0 on pci8 igb0: EEPROM V1.63-0 eTrack 0x800009fa igb0: Using 1024 TX descriptors and 1024 RX descriptors igb0: queue equality ugen0.3: at usbus0 usbhid0 on uhub3 usbhid0: on usbus0 hidbus0: on usbhid0 hkbd0: on hidbus0 kbd2 at hkbd0 usbhid1 on uhub3 usbhid1: on usbus0 hidbus1: on usbhid1 Setting hostuuid: 00000000-0000-0000-0000-002590c99976. Setting hostid: 0x90b83241. Starting file system checks: WARNING: / was not properly dismounted Mounting local filesystems:. Autoloading module: acpi_wmi Autoloading module: hms Autoloading module: ichsmb Autoloading module: ioat ioat0: mem 0x383ffff1c000-0x383ffff1ffff irq 31 at device 4.0 on pci1 ioat0: Capabilities: 2f7 ioat1: mem 0x383ffff18000-0x383ffff1bfff irq 39 at device 4.1 on pci1 ioat1: Capabilities: 2f7 ioat2: mem 0x383ffff14000-0x383ffff17fff irq 31 at device 4.2 on pci1 ioat2: Capabilities: f7 ioat3: mem 0x383ffff10000-0x383ffff13fff irq 39 at device 4.3 on pci1 ioat3: Capabilities: f7 ioat4: mem 0x383ffff0c000-0x383ffff0ffff irq 31 at device 4.4 on pci1 ioat4: Capabilities: f7 ioat5: mem 0x383ffff08000-0x383ffff0bfff irq 39 at device 4.5 on pci1 ioat5: Capabilities: f7 ioat6: mem 0x383ffff04000-0x383ffff07fff irq 31 at device 4.6 on pci1 ioat6: Capabilities: f7 ioat7: mem 0x383ffff00000-0x383ffff03fff irq 39 at device 4.7 on pci1 ioat7: Capabilities: f7 ichsmb0: port 0x580-0x59f mem 0x383ffff21000-0x383ffff210ff irq 18 at device 31.3 on pci1 smbus0: on ichsmb0 acpi_wmi0: on acpi0 acpi_wmi0: cannot find EC device hms0: on hidbus1 hms0: 3 buttons and [XYW] coordinates ID=0 fsck2+ fsck -fy /tmp ** /dev/gpt/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 446 files, 34433 used, 1230974 free (214 frags, 153845 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** + set +x Updating CPU Microcode... CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.00-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab Structured Extended Features3=0x9c000400 XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics Done. ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/e2fsprogs /usr/local/lib/gcc12 /usr/local/lib/perl5/5.36/mach/CORE 32-bit compatibility ldconfig path: /usr/lib32 /usr/local/lib32/compat /usr/local/lib32/gcc12 Setting hostname: mercat1.netperf.freebsd.org. Setting up harvesting: PURE_RDRAND,[RANDOMDEV],[CALLOUT],[UMA],[FS_ATIME],SWI,INTERRUPT,NET_NG,[NET_ETHER],NET_TUN,MOUSE,KEYBOARD,ATTACH,CACHED Feeding entropy: . igb0: link state changed to UP debugnet_any_ifnet_update: Bad dn_init result from igb0 (ifp 0xfffff8000514fc00), ignoring. lo0: link state changed to UP igb0: link state changed to DOWN Starting Network: lo0 igb0 igb1 mce0 mce1. lo0: flags=1008049 metric 0 mtu 16384 options=680003 inet 127.0.0.1 netmask 0xff000000 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x3 groups: lo nd6 options=21 igb0: flags=8843 metric 0 mtu 1500 options=4e507bb ether 0c:c4:7a:a8:cd:da inet6 fe80::ec4:7aff:fea8:cdda%igb0 prefixlen 64 scopeid 0x1 media: Ethernet autoselect status: no carrier nd6 options=21 igb1: flags=8802 metric 0 mtu 1500 options=4e507bb ether 0c:c4:7a:a8:cd:db media: Ethernet autoselect status: no carrier nd6 options=29 mce0: flags=8802 metric 0 mtu 1500 options=66ef07bb ether 7c:fe:90:30:ee:38 media: Ethernet autoselect status: no carrier nd6 options=29 mce1: flags=8802 metric 0 mtu 1500 options=66ef07bb ether 7c:fe:90:30:ee:39 media: Ethernet autoselect status: no carrier nd6 options=29 Starting devd. igb0: link state changed to UP Autoloading module: mlx5 Autoloading module: mlx5 Starting Network: igb1. igb1: flags=8802 metric 0 mtu 1500 options=4e507bb ether 0c:c4:7a:a8:cd:db media: Ethernet autoselect status: no carrier nd6 options=29 Starting Network: mce0. mce0: flags=8802 metric 0 mtu 1500 options=66ef07bb ether 7c:fe:90:30:ee:38 media: Ethernet autoselect status: no carrier nd6 options=29 Starting Network: mce1. mce1: flags=8802 metric 0 mtu 1500 options=66ef07bb ether 7c:fe:90:30:ee:39 media: Ethernet autoselect status: no carrier nd6 options=29 Starting dhclient. DHCPREQUEST on igb0 to 255.255.255.255 port 67 DHCPACK from 192.168.5.1 bound to 192.168.5.171 -- renewal in 300 seconds. route: message indicates error: File exists add host 127.0.0.1: gateway lo0 fib 0: route already in table route: message indicates error: File exists add host ::1: gateway lo0 fib 0: route already in table add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Creating and/or trimming log files. Starting syslogd. No core dumps found. Starting watchdogd. Setting date via ntp. 4 Jan 07:02:56 ntpdate[3462]: step time server 192.168.5.1 offset -1.578003 sec Clearing /tmp (X related). Recovering vi editor sessions:. Updating motd:. Updating /var/run/os-release done. Security policy loaded: MAC/ntpd (mac_ntpd) Starting ntpd. Mounting late filesystems:. Starting powerd. Starting inetd. Starting cron. Performing sanity check on sshd configuration. Starting sshd. Sun Jan 4 07:02 FreeBSD/amd64 (mercat1.netperf.freebsd.org) (ttyu1) login: Jan 4 07:04:23 mercat1 su[3651]: pho to root on /dev/pts/0 20260104 07:07:10 all (1/1): mmap18.sh 20260104 07:08:40 all (1/1): mmap18.sh 20260104 07:10:04 all (1/1): mmap18.sh 20260104 07:11:27 all (1/1): mmap18.sh 20260104 07:12:51 all (1/1): mmap18.sh 20260104 07:14:14 all (1/1): mmap18.sh 20260104 07:15:38 all (1/1): mmap18.sh 20260104 07:17:01 all (1/1): mmap18.sh stress2: pts leak: 1/2 20260104 07:18:25 all (1/1): mmap18.sh 20260104 07:19:49 all (1/1): mmap18.sh 20260104 07:21:12 all (1/1): mmap18.sh 20260104 07:22:36 all (1/1): mmap18.sh 20260104 07:23:59 all (1/1): mmap18.sh 20260104 07:25:23 all (1/1): mmap18.sh 20260104 07:26:46 all (1/1): mmap18.sh 20260104 07:28:10 all (1/1): mmap18.sh 20260104 07:29:34 all (1/1): mmap18.sh 20260104 07:30:57 all (1/1): mmap18.sh 20260104 07:32:21 all (1/1): mmap18.sh 20260104 07:33:54 all (1/1): mmap18.sh 20260104 07:35:18 all (1/1): mmap18.sh 20260104 07:36:41 all (1/1): mmap18.sh 20260104 07:38:05 all (1/1): mmap18.sh 20260104 07:39:29 all (1/1): mmap18.sh 20260104 07:40:52 all (1/1): mmap18.sh 20260104 07:42:16 all (1/1): mmap18.sh 20260104 07:43:39 all (1/1): mmap18.sh 20260104 07:45:03 all (1/1): mmap18.sh 20260104 07:46:26 all (1/1): mmap18.sh 20260104 07:47:50 all (1/1): mmap18.sh 20260104 07:49:14 all (1/1): mmap18.sh 20260104 07:50:37 all (1/1): mmap18.sh 20260104 07:52:01 all (1/1): mmap18.sh 20260104 07:53:24 all (1/1): mmap18.sh 20260104 07:54:48 all (1/1): mmap18.sh 20260104 07:56:12 all (1/1): mmap18.sh 20260104 07:57:35 all (1/1): mmap18.sh 20260104 07:58:59 all (1/1): mmap18.sh 20260104 08:00:22 all (1/1): mmap18.sh 20260104 08:01:46 all (1/1): mmap18.sh 20260104 08:03:10 all (1/1): mmap18.sh 20260104 08:04:33 all (1/1): mmap18.sh 20260104 08:05:57 all (1/1): mmap18.sh 20260104 08:07:20 all (1/1): mmap18.sh 20260104 08:08:44 all (1/1): mmap18.sh 20260104 08:10:07 all (1/1): mmap18.sh 20260104 08:11:31 all (1/1): mmap18.sh 20260104 08:12:55 all (1/1): mmap18.sh 20260104 08:14:18 all (1/1): mmap18.sh 20260104 08:15:42 all (1/1): mmap18.sh 20260104 08:17:06 all (1/1): mmap18.sh 20260104 08:18:28 all.sh done, elapsed 0 day(s), 01:11.18 20260104 08:19:13 all (1/61): mmap.sh 20260104 08:19:16 all (2/61): mmap10.sh 20260104 08:19:23 all (3/61): mmap11.sh lock order reversal: 1st 0xffffffff81a019c0 proctree (proctree, sx) @ kern/imgact_elf.c:2509 2nd 0xfffffe0178938760 ufs (ufs, lockmgr) @ kern/vfs_vnops.c:706 lock order proctree -> ufs attempted at: #0 0xffffffff80c11ea1 at witness_checkorder+0xbe1 #1 0xffffffff80b652b7 at lockmgr_lock_flags+0x157 #2 0xffffffff80f4534d at ffs_lock+0x9d #3 0xffffffff811ce9f2 at VOP_LOCK1_APV+0x32 #4 0xffffffff80cbc023 at _vn_lock+0x53 #5 0xffffffff80cbc646 at vn_rdwr+0x1e6 #6 0xffffffff80cbcd00 at vn_rdwr_inchunks+0x90 #7 0xffffffff80b0afd7 at core_vn_write+0x37 #8 0xffffffff80b4380f at sbuf_drain_core_output+0x8f #9 0xffffffff80bf9577 at sbuf_drain+0x57 #10 0xffffffff80bf96c7 at sbuf_put_bytes+0xa7 #11 0xffffffff80bf960e at sbuf_bcat+0xe #12 0xffffffff80b7b7eb at kern_proc_out+0xdb #13 0xffffffff80b0dc88 at elf64_note_procstat_proc+0x98 #14 0xffffffff80b0cb22 at elf64_coredump+0x3d2 #15 0xffffffff80b0bc22 at coredump_vnode+0xbb2 #16 0xffffffff80bbb4d5 at sigexit+0x2c5 #17 0xffffffff80b9f485 at postsig+0x1a5 20260104 08:24:31 all (4/61): mmap12.sh 20260104 08:24:35 all (5/61): mmap13.sh 20260104 08:24:41 all (6/61): mmap14.sh 20260104 08:26:59 all (7/61): mmap15.sh 20260104 08:32:02 all (8/61): mmap16.sh 20260104 08:32:06 all (9/61): mmap17.sh 20260104 08:32:09 all (10/61): mmap19.sh 20260104 08:35:18 all (11/61): mmap2.sh 20260104 08:45:27 all (12/61): mmap20.sh 20260104 08:45:31 all (13/61): mmap21.sh stress2: newblk leak: 4456/4463. 20260104 08:45:45 all (14/61): mmap22.sh 20260104 08:50:48 all (15/61): mmap23.sh 20260104 08:50:54 all (16/61): mmap24.sh 20260104 08:50:57 all (17/61): mmap25.sh 20260104 08:51:02 all (18/61): mmap26.sh 20260104 08:51:06 all (19/61): mmap27.sh 20260104 08:53:13 all (20/61): mmap28.sh 20260104 08:53:16 all (21/61): mmap29.sh 20260104 08:54:20 all (22/61): mmap3.sh 20260104 09:04:26 all (23/61): mmap30.sh 20260104 09:04:30 all (24/61): mmap31.sh 20260104 09:06:36 all (25/61): mmap32.sh 20260104 09:09:00 all (26/61): mmap33.sh 20260104 09:09:03 all (27/61): mmap34.sh 20260104 09:14:18 all (28/61): mmap35.sh 20260104 09:14:21 all (29/61): mmap36.sh 20260104 09:14:25 all (30/61): mmap37.sh 20260104 09:14:58 all (31/61): mmap38.sh 20260104 09:21:09 all (32/61): mmap39.sh 20260104 09:23:18 all (33/61): mmap4.sh vnode_pager_putpages: zero-length write at 39976960 resid 131072 0xfffffe01786914d0: type VREG state VSTATE_CONSTRUCTED op 0xffffffff81b44d08 usecount 0, writecount 0, refcount 3203 seqc users 0 hold count flags () flags (VIRF_PGREAD|VI_DOINGINACT|VMP_LAZYLIST) v_object 0xfffff802e9963a50 ref 0 pages 25608 cleanbuf 3200 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff804d15c6780 (pid 29268, mmap4, tid 622203) #0 0xffffffff80b65318 at lockmgr_lock_flags+0x1b8 #1 0xffffffff80f4534d at ffs_lock+0x9d #2 0xffffffff811ce9f2 at VOP_LOCK1_APV+0x32 #3 0xffffffff80cbc023 at _vn_lock+0x53 #4 0xffffffff80ca10e9 at vput_final+0x269 #5 0xffffffff80f8b761 at vm_object_deallocate_vnode+0xc1 #6 0xffffffff80f8b4cd at vm_object_deallocate+0x9d #7 0xffffffff80f846eb at vm_map_entry_deallocate+0x2b #8 0xffffffff80f78774 at vm_map_process_deferred+0x134 #9 0xffffffff80f7826d at _vm_map_unlock+0x8d #10 0xffffffff80f81108 at vm_map_remove+0xb8 #11 0xffffffff80f778df at vmspace_dofree+0x3f #12 0xffffffff80f77a92 at vmspace_exit+0x102 #13 0xffffffff80b447c3 at exit1+0x533 #14 0xffffffff80b4428d at sys__exit+0xd #15 0xffffffff81101ab9 at amd64_syscall+0x169 #16 0xffffffff810d071b at fast_syscall_common+0xf8 nlink=1, effnlink=1, size=104857600, extsize=0 generation=852a2ae2, uid=0, gid=0, flaJan 4 09:23:20 gs=0x0 ino 4, on dev md10 mercat1 kernel: pid 29268 (mmap4), uid 0 inumber 4 on /mnt: filesystem full vnode_pager_putpages: zero-length write at 39976960 resid 131072 0xfffffe01786914d0: type VREG state VSTATE_CONSTRUCTED op 0xffffffff81b44d08 usecount 1, writecount 0, refcount 3203 seqc users 0 hold count flags () flags (VIRF_PGREAD|VMP_LAZYLIST) v_object 0xfffff802e9963a50 ref 0 pages 25608 cleanbuf 3201 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff804d15c6780 (pid 29276, umount, tid 622203) #0 0xffffffff80b65318 at lockmgr_lock_flags+0x1b8 #1 0xffffffff80f4534d at ffs_lock+0x9d #2 0xffffffff811ce9f2 at VOP_LOCK1_APV+0x32 #3 0xffffffff80cbc023 at _vn_lock+0x53 #4 0xffffffff80ca087f at vget_finish+0xaf #5 0xffffffff80ca39db at vfs_periodic_msync_inactive+0x14b #6 0xffffffff80c9592c at dounmount+0x61c #7 0xffffffff80c952ac at kern_unmount+0x30c #8 0xffffffff81101ab9 at amd64_syscall+0x169 #9 0xffffffff810d071b at fast_syscall_common+0xf8 nlink=1, effnlink=1, size=104857600, extsize=0 generation=852a2ae2, uid=0, gid=0, flags=0x0 ino 4, on dev md10 Jan 4 09:23:21 mercat1 kernel: pid 29276 (umount), uid 0 inumber 4 on /mnt: filesystem full 20260104 09:23:23 all (34/61): mmap40.sh 20260104 09:29:36 all (35/61): mmap41.sh 20260104 09:31:43 all (36/61): mmap42.sh 20260104 09:31:46 all (37/61): mmap43.sh 20260104 09:37:09 all (38/61): mmap44.sh 20260104 09:37:12 all (39/61): mmap45.sh 20260104 09:37:15 all (40/61): mmap46.sh 20260104 09:37:19 all (41/61): mmap47.sh 20260104 09:37:22 all (42/61): mmap48.sh 20260104 09:37:25 all (43/61): mmap5.sh 20260104 09:39:29 all (44/61): mmap6.sh 20260104 09:44:35 all (45/61): mmap7.sh 20260104 09:45:00 all (46/61): mmap8.sh 20260104 09:45:04 all (47/61): mmap9.sh 20260104 09:45:09 all (48/61): mprotect.sh 20260104 09:45:12 all (49/61): mprotect2.sh 20260104 09:45:32 all (50/61): mprotect3.sh 20260104 09:45:35 all (51/61): mprotect4.sh 20260104 09:47:38 all (52/61): mprotect5.sh 20260104 09:49:41 all (53/61): mprotect6.sh 20260104 09:51:54 all (54/61): pg_zero.sh 20260104 09:55:02 all (55/61): rwlock_ronly.sh 20260104 09:55:05 all (56/61): syzkaller67.sh 20260104 09:55:10 all (57/61): syzkaller8.sh 20260104 09:56:13 all (58/61): syzkaller87.sh 20260104 09:59:22 all (59/61): swap_reserve.sh 20260104 09:59:26 all (60/61): vmp.sh 20260104 10:03:37 all (61/61): vmp2.sh 20260104 10:07:50 all (1/61): mmap.sh 20260104 10:07:53 all (2/61): mmap10.sh 20260104 10:08:04 all (3/61): mmap11.sh Jan 4 10:08:49 mercat1 kernel: pid 88176 (swap), jid 0, uid 0, was killed: a thread waited too long to allocate a page 20260104 10:13:09 all (4/61): mmap12.sh 20260104 10:13:12 all (5/61): mmap13.sh 20260104 10:13:19 all (6/61): mmap14.sh Jan 4 10:14:01 mercat1 kernel: pid 93637 (swap), jid 0, uid 0, was killed: a thread waited too long to allocate a page 20260104 10:15:37 all (7/61): mmap15.sh 20260104 10:20:41 all (8/61): mmap16.sh 20260104 10:20:44 all (9/61): mmap17.sh 20260104 10:20:45 all.sh done, elapsed 0 day(s), 02:01.33 Stopping sshd. Waiting for PIDS: 3598. Stopping cron. Waiting for PIDS: 3581. Stopping inetd. Waiting for PIDS: 3576. Stopping powerd. Waiting for PIDS: 3555. Stopping ntpd. Waiting for PIDS: 3538. Stopping watchdogd. Waiting for PIDS: 3440, 3440. Stopping devd. Waiting for PIDS: 3271. Writing entropy file: . Writing early boot entropy file: . . Terminated Jan 4 10:21:01 mercat1 syslogd: exiting on signal 15 panic: crunuse: ref -1 not > 0 on cred 0xfffff80003631c00 cpuid = 3 time = 1767518461 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00ffc078f0 vpanic() at vpanic+0x136/frame 0xfffffe00ffc07a20 panic() at panic+0x43/frame 0xfffffe00ffc07a80 crunuse() at crunuse+0xf5/frame 0xfffffe00ffc07ab0 crcowfree() at crcowfree+0x9/frame 0xfffffe00ffc07ac0 thread_wait() at thread_wait+0x9c/frame 0xfffffe00ffc07ae0 proc_reap() at proc_reap+0x588/frame 0xfffffe00ffc07b20 proc_to_reap() at proc_to_reap+0x3be/frame 0xfffffe00ffc07b70 kern_wait6() at kern_wait6+0x1ab/frame 0xfffffe00ffc07c10 sys_wait4() at sys_wait4+0x6b/frame 0xfffffe00ffc07e00 amd64_syscall() at amd64_syscall+0x169/frame 0xfffffe00ffc07f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00ffc07f30 --- syscall (7, FreeBSD ELF64, wait4), rip = 0x2d762a, rsp = 0x8208121f8, rbp = 0x820812200 --- KDB: enter: panic [ thread pid 1 tid 100002 ] Stopped at kdb_enter+0x33: movq $0,0x1212882(%rip) db> run pho db:0:pho> set $lines 20000 db:0:pho> run pho1 db:1:pho1> dump Dumping 1529 out of 32618 MB:..2%..11%..21%..31%..41%..51%..61%..71%..81%..91% Dump complete db:1:pho1> bt Tracing pid 1 tid 100002 td 0xfffff8000489b000 kdb_enter() at kdb_enter+0x33/frame 0xfffffe00ffc07a20 panic() at panic+0x43/frame 0xfffffe00ffc07a80 crunuse() at crunuse+0xf5/frame 0xfffffe00ffc07ab0 crcowfree() at crcowfree+0x9/frame 0xfffffe00ffc07ac0 thread_wait() at thread_wait+0x9c/frame 0xfffffe00ffc07ae0 proc_reap() at proc_reap+0x588/frame 0xfffffe00ffc07b20 proc_to_reap() at proc_to_reap+0x3be/frame 0xfffffe00ffc07b70 kern_wait6() at kern_wait6+0x1ab/frame 0xfffffe00ffc07c10 sys_wait4() at sys_wait4+0x6b/frame 0xfffffe00ffc07e00 amd64_syscall() at amd64_syscall+0x169/frame 0xfffffe00ffc07f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00ffc07f30 --- syscall (7, FreeBSD ELF64, wait4), rip = 0x2d762a, rsp = 0x8208121f8, rbp = 0x820812200 --- db:1:pho1> show allpcpu Current CPU: 3 cpuid = 0 dynamic pcpu = 0x9b4500 curthread = 0xfffff8000489a780: pid 11 tid 100003 critnest 1 "idle: cpu0" curpcb = 0xfffff8000489acd0 fpcurthread = none idlethread = 0xfffff8000489a780: tid 100003 "idle: cpu0" self = 0xffffffff82610000 curpmap = 0xffffffff81da0480 tssp = 0xffffffff82610384 rsp0 = 0xfffffe00ffc17000 kcr3 = 0x8000000002549002 ucr3 = 0xffffffffffffffff scr3 = 0x7f4bdfa27 gs32p = 0xffffffff82610404 ldt = 0xffffffff82610444 tss = 0xffffffff82610434 curvnet = 0 spin locks held: cpuid = 1 dynamic pcpu = 0xfffffe00b2ebc500 curthread = 0xfffff8000cfe7000: pid 3623 tid 100345 critnest 1 "sshd-session" curpcb = 0xfffff8000cfe7550 fpcurthread = 0xfffff8000cfe7000: pid 3623 "sshd-session" idlethread = 0xfffff8000489a000: tid 100004 "idle: cpu1" self = 0xffffffff82611000 curpmap = 0xfffff8000cea7110 tssp = 0xffffffff82611384 rsp0 = 0xfffffe01001ee000 kcr3 = 0x80000002869d17dc ucr3 = 0x80000002869d0fdc scr3 = 0x2869d0fdc gs32p = 0xffffffff82611404 ldt = 0xffffffff82611444 tss = 0xffffffff82611434 curvnet = 0 spin locks held: cpuid = 2 dynamic pcpu = 0xfffffe00b2ecb500 curthread = 0xfffff80004899780: pid 11 tid 100005 critnest 1 "idle: cpu2" curpcb = 0xfffff80004899cd0 fpcurthread = none idlethread = 0xfffff80004899780: tid 100005 "idle: cpu2" self = 0xffffffff82612000 curpmap = 0xffffffff81da0480 tssp = 0xffffffff82612384 rsp0 = 0xfffffe00ffc21000 kcr3 = 0x8000000002549002 ucr3 = 0xffffffffffffffff scr3 = 0x82949ee6d gs32p = 0xffffffff82612404 ldt = 0xffffffff82612444 tss = 0xffffffff82612434 curvnet = 0 spin locks held: cpuid = 3 dynamic pcpu = 0xfffffe00b2eda500 curthread = 0xfffff8000489b000: pid 1 tid 100002 critnest 1 "init" curpcb = 0xfffff8000489b550 fpcurthread = 0xfffff8000489b000: pid 1 "init" idlethread = 0xfffff80004899000: tid 100006 "idle: cpu3" self = 0xffffffff82613000 curpmap = 0xfffff8000ce8c7e8 tssp = 0xffffffff82613384 rsp0 = 0xfffffe00ffc08000 kcr3 = 0x800000001581856e ucr3 = 0x8000000015817d6e scr3 = 0x1f628d98 gs32p = 0xffffffff82613404 ldt = 0xffffffff82613444 tss = 0xffffffff82613434 curvnet = 0 spin locks held: cpuid = 4 dynamic pcpu = 0xfffffe00b2ee9500 curthread = 0xfffff80004898780: pid 11 tid 100007 critnest 1 "idle: cpu4" curpcb = 0xfffff80004898cd0 fpcurthread = none idlethread = 0xfffff80004898780: tid 100007 "idle: cpu4" self = 0xffffffff82614000 curpmap = 0xffffffff81da0480 tssp = 0xffffffff82614384 rsp0 = 0xfffffe00ffc2b000 kcr3 = 0x8000000002549002 ucr3 = 0xffffffffffffffff scr3 = 0x1f628960 gs32p = 0xffffffff82614404 ldt = 0xffffffff82614444 tss = 0xffffffff82614434 curvnet = 0 spin locks held: cpuid = 5 dynamic pcpu = 0xfffffe00b2ef8500 curthread = 0xfffff80004898000: pid 11 tid 100008 critnest 1 "idle: cpu5" curpcb = 0xfffff80004898550 fpcurthread = none idlethread = 0xfffff80004898000: tid 100008 "idle: cpu5" self = 0xffffffff82615000 curpmap = 0xffffffff81da0480 tssp = 0xffffffff82615384 rsp0 = 0xfffffe00ffc26000 kcr3 = 0x8000000002549002 ucr3 = 0xffffffffffffffff scr3 = 0x10ee7c9b5 gs32p = 0xffffffff82615404 ldt = 0xffffffff82615444 tss = 0xffffffff82615434 curvnet = 0 spin locks held: cpuid = 6 dynamic pcpu = 0xfffffe00b2f07500 curthread = 0xfffff800048ac780: pid 11 tid 100009 critnest 1 "idle: cpu6" curpcb = 0xfffff800048accd0 fpcurthread = none idlethread = 0xfffff800048ac780: tid 100009 "idle: cpu6" self = 0xffffffff82616000 curpmap = 0xffffffff81da0480 tssp = 0xffffffff82616384 rsp0 = 0xfffffe00ffc35000 kcr3 = 0x8000000002549002 ucr3 = 0xffffffffffffffff scr3 = 0x3031c1efe gs32p = 0xffffffff82616404 ldt = 0xffffffff82616444 tss = 0xffffffff82616434 curvnet = 0 spin locks held: cpuid = 7 dynamic pcpu = 0xfffffe00b2f16500 curthread = 0xfffff800048ac000: pid 11 tid 100010 critnest 1 "idle: cpu7" curpcb = 0xfffff800048ac550 fpcurthread = none idlethread = 0xfffff800048ac000: tid 100010 "idle: cpu7" self = 0xffffffff82617000 curpmap = 0xffffffff81da0480 tssp = 0xffffffff82617384 rsp0 = 0xfffffe00ffc30000 kcr3 = 0x8000000002549002 ucr3 = 0xffffffffffffffff scr3 = 0x2869d09ed gs32p = 0xffffffff82617404 ldt = 0xffffffff82617444 tss = 0xffffffff82617434 curvnet = 0 spin locks held: cpuid = 8 dynamic pcpu = 0xfffffe00b2f25500 curthread = 0xfffff800048ab780: pid 11 tid 100011 critnest 1 "idle: cpu8" curpcb = 0xfffff800048abcd0 fpcurthread = none idlethread = 0xfffff800048ab780: tid 100011 "idle: cpu8" self = 0xffffffff82618000 curpmap = 0xffffffff81da0480 tssp = 0xffffffff82618384 rsp0 = 0xfffffe00ffc3f000 kcr3 = 0x8000000002549002 ucr3 = 0xffffffffffffffff scr3 = 0x1f628d13 gs32p = 0xffffffff82618404 ldt = 0xffffffff82618444 tss = 0xffffffff82618434 curvnet = 0 spin locks held: cpuid = 9 dynamic pcpu = 0xfffffe00b2f34500 curthread = 0xfffff800048ab000: pid 11 tid 100012 critnest 1 "idle: cpu9" curpcb = 0xfffff800048ab550 fpcurthread = none idlethread = 0xfffff800048ab000: tid 100012 "idle: cpu9" self = 0xffffffff82619000 curpmap = 0xffffffff81da0480 tssp = 0xffffffff82619384 rsp0 = 0xfffffe00ffc3a000 kcr3 = 0x8000000002549002 ucr3 = 0xffffffffffffffff scr3 = 0x3031c1a12 gs32p = 0xffffffff82619404 ldt = 0xffffffff82619444 tss = 0xffffffff82619434 curvnet = 0 spin locks held: cpuid = 10 dynamic pcpu = 0xfffffe00b2f43500 curthread = 0xfffff800048aa780: pid 11 tid 100013 critnest 1 "idle: cpu10" curpcb = 0xfffff800048aacd0 fpcurthread = none idlethread = 0xfffff800048aa780: tid 100013 "idle: cpu10" self = 0xffffffff8261a000 curpmap = 0xffffffff81da0480 tssp = 0xffffffff8261a384 rsp0 = 0xfffffe00ffc49000 kcr3 = 0x8000000002549002 ucr3 = 0xffffffffffffffff scr3 = 0x1f628edd gs32p = 0xffffffff8261a404 ldt = 0xffffffff8261a444 tss = 0xffffffff8261a434 curvnet = 0 spin locks held: cpuid = 11 dynamic pcpu = 0xfffffe00b2f52500 curthread = 0xfffff800048aa000: pid 11 tid 100014 critnest 1 "idle: cpu11" curpcb = 0xfffff800048aa550 fpcurthread = none idlethread = 0xfffff800048aa000: tid 100014 "idle: cpu11" self = 0xffffffff8261b000 curpmap = 0xffffffff81da0480 tssp = 0xffffffff8261b384 rsp0 = 0xfffffe00ffc44000 kcr3 = 0x8000000002549002 ucr3 = 0xffffffffffffffff scr3 = 0x2cc8f8909 gs32p = 0xffffffff8261b404 ldt = 0xffffffff8261b444 tss = 0xffffffff8261b434 curvnet = 0 spin locks held: db:1:pho1> show alllocks Process 3652 (bash) thread 0xfffff8000cee2780 (100303) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe00303d94f0) locked @ kern/vfs_bio.c:1754 exclusive lockmgr ufs (ufs) r = 0 (0xfffffe016f58e510) locked @ kern/vfs_vnops.c:581 Process 1 (init) thread 0xfffff8000489b000 (100002) exclusive sleep mutex cred (cred) r = 0 (0xfffff80003631c00) locked @ kern/kern_prot.c:2474 db:1:pho1> show lockedvnods Locked vnodes vnode 0xfffffe016f58e4a0: type VREG state VSTATE_CONSTRUCTED op 0xffffffff81b44d08 usecount 0, writecount 0, refcount 6 seqc users 0 hold count flags () flags (VIRF_PGREAD|VI_DOINGINACT|VMP_LAZYLIST) v_object 0xfffff8000cf9d780 ref 0 pages 25 cleanbuf 3 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff8000cee2780 (pid 3652, bash, tid 100303) #0 0xffffffff80b65318 at lockmgr_lock_flags+0x1b8 #1 0xffffffff80f4534d at ffs_lock+0x9d #2 0xffffffff811ce9f2 at VOP_LOCK1_APV+0x32 #3 0xffffffff80cbc023 at _vn_lock+0x53 #4 0xffffffff80cbc330 at vn_close1+0x90 #5 0xffffffff80cba64d at vn_closefile+0x3d #6 0xffffffff80b2d14a at _fdrop+0x1a #7 0xffffffff80b30a03 at closef+0x1e3 #8 0xffffffff80b34cd3 at closefp_impl+0x83 #9 0xffffffff81101ab9 at amd64_syscall+0x169 #10 0xffffffff810d071b at fast_syscall_common+0xf8 nlink=1, effnlink=1, size=99245, extsize=0 generation=ea39a2b9, uid=0, gid=0, flags=0x0 ino 20144453, on dev gpt/work db:1:pho1> show mount 0xfffffe00dca0c000 /dev/gpt/work on / (ufs) 0xfffffe00dca0cc40 devfs on /dev (devfs) 0xfffffe015c26f000 /dev/gpt/tmp on /tmp (ufs) More info: show mount db:1:pho1> show bufqueues bqempty: 93045 Buf domain 0 freebufs 12273 lofreebufs 219 hifreebufs 329 bufspace 87793664 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 2829 (87412736) dirtyq count 0 (0) wakeup 0 lim 25 CPU 1, 3, 11, 2, 2, 1, 2, 1, 4, 0, 3, 1, Locked buffers: 0 space 0 Total buffers: 14258 space 87793664 Buf domain 1 freebufs 13126 lofreebufs 219 hifreebufs 329 bufspace 59256832 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 2 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 1957 (58748928) dirtyq count 2 (36864) wakeup 0 lim 25 CPU 0, 2, 22, 4, 4, 3, 6, 2, 1, 1, 1, 2, Locked buffers: 0 space 0 Total buffers: 3053 space 59256832 Buf domain 2 freebufs 12643 lofreebufs 219 hifreebufs 329 bufspace 74964992 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 1 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 2439 (74199040) dirtyq count 1 (4096) wakeup 0 lim 25 CPU 1, 4, 9, 5, 11, 4, 1, 1, 4, 3, 5, 2, Locked buffers: 0 space 0 Total buffers: 5388 space 74964992 Buf domain 3 freebufs 14937 lofreebufs 219 hifreebufs 329 bufspace 4538368 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 1 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 75 (1576960) dirtyq count 1 (4096) wakeup 0 lim 25 CPU 3, 15, 3, 18, 5, 6, 1, 22, 13, 9, 12, 13, Locked buffers: 0 space 0 Total buffers: 70527 space 4538368 Buf domain 4 freebufs 12757 lofreebufs 219 hifreebufs 329 bufspace 71577600 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 2 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 2339 (70955008) dirtyq count 2 (16384) wakeup 0 lim 25 CPU 0, 2, 4, 4, 10, 0, 1, 0, 1, 1, 8, 4, Locked buffers: 0 space 0 Total buffers: 2407 space 71577600 Buf domain 5 freebufs 12546 lofreebufs 219 hifreebufs 329 bufspace 78135296 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 5 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 2519 (76222464) dirtyq count 5 (135168) wakeup 0 lim 25 CPU 4, 20, 1, 4, 1, 2, 0, 13, 2, 9, 7, 0, Locked buffers: 0 space 0 Total buffers: 2809 space 78135296 Buf domain 6 freebufs 14886 lofreebufs 219 hifreebufs 329 bufspace 6295552 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 14 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 196 (4857856) dirtyq count 14 (458752) wakeup 0 lim 25 CPU 1, 4, 0, 4, 1, 0, 3, 3, 0, 2, 16, 2, Locked buffers: 1 space 32768 Total buffers: 7489 space 6295552 db:1:pho1> show page vm_cnt.v_free_count: 7877481 vm_cnt.v_inactive_count: 446 vm_cnt.v_active_count: 484 vm_cnt.v_laundry_count: 190 vm_cnt.v_wire_count: 269349 vm_cnt.v_free_reserved: 10687 vm_cnt.v_free_min: 51473 vm_cnt.v_free_target: 173831 vm_cnt.v_inactive_target: 260746 db:1:pho1> show pageq pq_free 7877481 dom 0 page_cnt 8157343 free 7877481 pq_act 484 pq_inact 446 pq_laund 190 pq_unsw 0 db:0:pho> show freepages DOMAIN: 0 FREE LIST 0: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 | POOL 2 -- -- -- -- -- -- -- -- 12 (016384K) | 000000 | 000192 | 000000 11 (008192K) | 000000 | 000646 | 000001 10 (004096K) | 000000 | 001841 | 000004 09 (002048K) | 000000 | 003047 | 000001 08 (001024K) | 000000 | 002730 | 000002 07 (000512K) | 000000 | 004617 | 000002 06 (000256K) | 000000 | 005818 | 000012 05 (000128K) | 000000 | 007452 | 000011 04 (000064K) | 000000 | 009385 | 000165 03 (000032K) | 000000 | 012999 | 000487 02 (000016K) | 000000 | 014777 | 001715 01 (000008K) | 000000 | 021036 | 000638 00 (000004K) | 000000 | 023881 | 001775 FREE LIST 1: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 | POOL 2 -- -- -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 | 000000 11 (008192K) | 000000 | 000000 | 000000 10 (004096K) | 000000 | 000000 | 000000 09 (002048K) | 000000 | 000000 | 000000 08 (001024K) | 000000 | 000001 | 000000 07 (000512K) | 000000 | 000000 | 000000 06 (000256K) | 000000 | 000001 | 000000 05 (000128K) | 000000 | 000001 | 000000 04 (000064K) | 000000 | 000002 | 000000 03 (000032K) | 000000 | 000000 | 000000 02 (000016K) | 000000 | 000001 | 000000 01 (000008K) | 000000 | 000001 | 000000 00 (000004K) | 000000 | 000001 | 000000 db:0:pho> show uma Zone Size Used Free Requests Sleeps Bucket Total Mem XFree malloc-4096 4096 34120 10 34631 0 2 139796480 0 RADIX NODE 152 14924 524365 1792512112 0 80 81971928 0 mbuf_cluster 2048 15089 23 51718 0 8 30949376 0 swblk 136 505 166767 1745340 0 62 22748992 0 BUF TRIE 152 2396 103554 10536430 0 62 16104400 0 fakepg 88 0 66010 19209461 0 126 5808880 0 UMA Slabs 0 112 44596 3638 110193 0 126 5402208 0 mbuf 256 16449 3052 128005 0 254 4992256 0 VM OBJECT 240 2226 17358 301759846 0 64 4700160 0 malloc-128 128 29254 1529 3286519 0 126 3940224 0 pbuf 2816 0 1396 0 0 0 3931136 0 FFS inode 1168 2473 425 4091394 0 8 3384864 0 MAP ENTRY 96 476 33082 905450380 0 131 3221568 0 THREAD 1860 1153 467 632110 0 8 3013200 0 vmem btag 56 16845 34839 76890 0 254 2894304 0 malloc-128 128 18839 1156 1625991 0 126 2559360 0 VNODE 592 2646 1098 4579783 0 16 2216448 0 swpctrie 152 71 12097 182109 0 62 1849536 0 malloc-128 128 12989 1302 4975246 0 126 1829248 0 malloc-4096 4096 385 4 1451 0 2 1593344 0 malloc-64 64 20035 3086 540594 0 254 1479744 0 256 Bucket 2048 580 84 10318019 0 8 1359872 0 PROC 1368 27 941 18159903 0 8 1324224 0 malloc-4096 4096 28 272 18161270 0 2 1228800 0 FPU_save_area 832 1155 222 644650 0 16 1145664 0 FFS2 dinode 256 2473 1112 4091392 0 62 917760 0 malloc-16384 16384 4 50 193153 0 1 884736 0 S VFS Cache 104 2899 4745 700881 0 126 794976 0 mbuf_packet 256 11 2793 4544 0 254 717824 0 malloc-8192 8192 87 0 87 0 1 712704 0 malloc-32768 32768 9 9 4773 0 1 589824 0 L VFS Cache 320 344 1468 3108 0 30 579840 0 malloc-256 256 1348 752 4756091 0 62 537600 0 malloc-64 64 4393 3923 18885760 0 254 532224 0 lkpicurr 168 13 3083 13 0 62 520128 0 malloc-256 256 1303 692 632412 0 62 510720 0 malloc-384 384 1007 303 5341699 0 30 503040 0 128 Bucket 1024 368 111 2537723 0 16 490496 0 UMA Zones 2048 230 5 230 0 8 481280 0 VMSPACE 584 9 803 18159861 0 16 474208 0 malloc-65536 65536 5 2 3471 0 1 458752 0 64 Bucket 512 468 412 3849656 0 30 450560 0 malloc-32768 32768 13 0 14 0 1 425984 0 malloc-32768 32768 13 0 13 0 1 425984 0 filedesc0 1072 27 344 18159904 0 8 397712 0 malloc-16384 16384 0 24 1018 0 1 393216 0 malloc-256 256 672 813 17459948 0 62 380160 0 malloc-32 32 8461 3131 1508433 0 254 370944 0 malloc-128 128 958 1522 17456 0 126 317440 0 32 Bucket 256 213 1017 9120117 0 62 314880 0 malloc-1024 1024 82 194 9758 0 16 282624 0 malloc-16 16 16144 1356 504358 0 254 280000 0 ksiginfo 112 939 1545 61079 0 126 278208 0 TURNSTILE 136 1621 416 1621 0 62 277032 0 malloc-1024 1024 54 194 893 0 16 253952 0 rl_entry 48 292 4916 2125903 0 254 249984 0 malloc-128 128 361 1561 7256 0 126 246016 0 malloc-16384 16384 13 2 5666 0 1 245760 0 malloc-64 64 667 3113 11618 0 254 241920 0 g_bio 440 16 524 57277141 0 30 237600 0 malloc-2048 2048 18 96 6032 0 8 233472 0 malloc-32768 32768 7 0 8 0 1 229376 0 socket 1024 14 206 535743 0 16 225280 0 malloc-64 64 369 3096 19654954 0 254 221760 0 malloc-1024 1024 5 211 2817687 0 16 221184 0 malloc-128 128 543 1162 3921192 0 126 218240 0 malloc-128 128 182 1523 521437 0 126 218240 0 malloc-2048 2048 102 2 209 0 8 212992 0 malloc-1024 1024 175 25 255 0 16 204800 0 malloc-256 256 117 678 10946984 0 62 203520 0 SLEEPQUEUE 88 1621 683 1621 0 126 202752 0 malloc-64 64 68 3082 10761936 0 254 201600 0 malloc-64 64 49 3101 18160088 0 254 201600 0 malloc-64 64 46 3104 16176 0 254 201600 0 malloc-256 256 33 747 57586 0 62 199680 0 NAMEI 1024 0 192 47464979 0 16 196608 0 malloc-65536 65536 3 0 3 0 1 196608 0 malloc-256 256 16 749 526445 0 62 195840 0 malloc-2048 2048 92 0 94 0 8 188416 0 Files 80 47 2303 41419981 0 126 188000 0 pipe 736 0 253 2865658 0 16 186208 0 PWD 40 9 4637 593290 0 254 185840 0 malloc-512 512 0 360 2647 0 30 184320 0 PGRP 120 8 1510 324 0 126 182160 0 malloc-384 384 78 392 11527 0 30 180480 0 malloc-128 128 6 1389 16068 0 126 178560 0 lkpimm 56 3 3093 3 0 254 173376 0 malloc-32768 32768 5 0 6 0 1 163840 0 malloc-4096 4096 12 25 131885 0 2 151552 0 malloc-1024 1024 3 145 8620 0 16 151552 0 malloc-512 512 85 203 2340 0 30 147456 0 swrbuf 2816 3 49 10992863 0 4 146432 0 malloc-32 32 1197 3087 1409419 0 254 137088 0 malloc-65536 65536 2 0 7 0 1 131072 0 16 Bucket 144 259 637 13105158 0 62 129024 0 ada_ccb 272 0 462 12694478 0 30 125664 0 udp_inpcb 408 2 304 583 0 30 124848 0 8 Bucket 80 218 1332 10792571 0 126 124000 0 unpcb 320 10 350 535043 0 30 115200 0 malloc-8192 8192 13 0 13 0 1 106496 0 malloc-32 32 126 3150 51648 0 254 104832 0 KNOTE 160 10 640 7373 0 62 104000 0 DIRHASH 1024 50 50 5386 0 16 102400 0 DEVCTL 1024 0 100 942 0 0 102400 0 malloc-32 32 80 3070 3887 0 254 100800 0 malloc-512 512 1 183 1142 0 30 94208 0 2 Bucket 32 305 2593 1049606 0 254 92736 0 ttyinq 160 15 560 1170 0 62 92000 0 4 Bucket 48 28 1736 773935 0 254 84672 0 malloc-16 16 873 4377 21222662 0 254 84000 0 malloc-8192 8192 10 0 2457 0 1 81920 0 malloc-512 512 120 40 123 0 30 81920 0 ttyoutq 256 8 307 609 0 62 80640 0 UMA Kegs 384 201 2 201 0 30 77952 0 malloc-65536 65536 1 0 1 0 1 65536 0 malloc-65536 65536 0 1 532 0 1 65536 0 malloc-16384 16384 4 0 4 0 1 65536 0 malloc-256 256 62 193 833121 0 62 65280 0 malloc-1024 1024 25 35 4370 0 16 61440 0 malloc-2048 2048 24 4 34 0 8 57344 0 malloc-32 32 311 1453 454 0 254 56448 0 malloc-16 16 219 3281 1030187 0 254 56000 0 malloc-384 384 70 70 74 0 30 53760 0 pcpu-8 8 4382 2274 4398 0 254 53248 0 malloc-32 32 335 1303 600 0 254 52416 0 malloc-16 16 170 3080 1373 0 254 52000 0 malloc-16384 16384 3 0 16 0 1 49152 0 malloc-8192 8192 6 0 18 0 1 49152 0 malloc-32 32 212 1300 500 0 254 48384 0 malloc-16 16 276 2474 88261 0 254 44000 0 malloc-384 384 56 54 56 0 30 42240 0 pcpu-64 64 466 174 466 0 254 40960 0 malloc-16 16 43 2457 79 0 254 40000 0 malloc-1024 1024 21 15 465 0 16 36864 0 malloc-1024 1024 21 15 22 0 16 36864 0 malloc-64 64 27 540 39 0 254 36288 0 malloc-16 16 81 2169 3069 0 254 36000 0 malloc-256 256 53 82 2080 0 62 34560 0 malloc-32768 32768 1 0 1 0 1 32768 0 malloc-16384 16384 2 0 6 0 1 32768 0 malloc-8192 8192 4 0 42 0 1 32768 0 malloc-8192 8192 4 0 269 0 1 32768 0 Mountpoints 3136 3 7 22 0 2 31360 0 tcp_inpcb 1304 2 22 11 0 8 31296 0 cpuset 200 27 101 27 0 62 25600 0 malloc-2048 2048 4 8 132 0 8 24576 0 mlx5_fs_fgs 712 21 12 21 0 16 23496 0 mlx5_fs_fgs 712 21 12 21 0 16 23496 0 kenv 258 18 72 27697 0 30 23220 0 malloc-384 384 18 42 74 0 30 23040 0 mlx5_fs_ftes 696 22 11 22 0 16 22968 0 mlx5_fs_ftes 696 22 11 22 0 16 22968 0 clpbuf 2816 0 8 873762 0 4 22528 0 malloc-2048 2048 9 1 2387 0 8 20480 0 rtentry 168 12 108 14 0 62 20160 0 routing nhops 256 9 66 14 0 62 19200 0 malloc-16384 16384 1 0 1 0 1 16384 0 malloc-16384 16384 1 0 1 0 1 16384 0 malloc-8192 8192 2 0 3 0 1 16384 0 malloc-512 512 13 19 23 0 30 16384 0 malloc-384 384 17 23 30 0 30 15360 0 malloc-4096 4096 3 0 64 0 2 12288 0 malloc-2048 2048 4 2 64036 0 8 12288 0 malloc-32 32 4 374 977043 0 254 12096 0 malloc-16 16 12 738 12 0 254 12000 0 ripcb 376 0 30 6 0 30 11280 0 vmem 1856 2 3 2 0 8 9280 0 malloc-4096 4096 2 0 89 0 2 8192 0 malloc-512 512 2 14 21 0 30 8192 0 malloc-512 512 2 14 2 0 30 8192 0 pcpu-16 16 10 502 10 0 254 8192 0 epoch_record pcpu 256 4 12 4 0 62 4096 0 malloc-4096 4096 1 0 21 0 2 4096 0 malloc-2048 2048 1 1 1 0 8 4096 0 SMR CPU 32 8 119 8 0 254 4064 0 vtnet_tx_hdr 24 0 167 0 0 254 4008 0 UMA Slabs 1 176 12 10 12 0 62 3872 0 malloc-384 384 6 4 6 0 30 3840 0 malloc-384 384 2 8 10575 0 30 3840 0 mqnode 416 3 6 3 0 30 3744 0 KMAP ENTRY 96 30 9 30 0 0 3744 0 SMR SHARED 24 8 119 8 0 254 3048 0 mqnotifier 216 0 0 0 0 62 0 0 mvdata 64 0 0 0 0 254 0 0 mqueue 248 0 0 0 0 62 0 0 FFS1 dinode 128 0 0 0 0 126 0 0 da_ccb 544 0 0 0 0 16 0 0 tfo_ccache_entries 80 0 0 0 0 126 0 0 tfo 4 0 0 0 0 254 0 0 sackhole 32 0 0 0 0 254 0 0 hostcache 64 0 0 0 0 254 0 0 syncache 168 0 0 2 0 62 0 0 ipq 56 0 0 0 0 254 0 0 tcp_log_id_node 120 0 0 0 0 126 0 0 tcp_log_id_bucket 176 0 0 0 0 62 0 0 tcp_log 416 0 0 0 0 30 0 0 tcpreass 48 0 0 0 0 254 0 0 udplite_inpcb 408 0 0 0 0 30 0 0 IPsec SA lft_c 16 0 0 0 0 254 0 0 itimer 352 0 0 0 0 30 0 0 AIOLIO 272 0 0 0 0 30 0 0 AIOCB 552 0 0 0 0 16 0 0 AIO 208 0 0 0 0 62 0 0 TMPFS node 240 0 0 0 0 62 0 0 NCLNODE 760 0 0 0 0 16 0 0 LTS VFS Cache 360 0 0 0 0 30 0 0 STS VFS Cache 144 0 0 0 0 62 0 0 cryptop 280 0 0 0 0 30 0 0 linux_dma_object 32 0 0 0 0 254 0 0 linux_dma_pctrie 152 0 0 0 0 62 0 0 IOMMU_MAP_ENTRY 112 0 0 0 0 126 0 0 skbuff 1808 0 0 0 0 8 0 0 mbuf_jumbo_16k 16384 0 0 0 0 1 0 0 mbuf_jumbo_9k 9216 0 0 0 0 1 0 0 mbuf_jumbo_page 4096 0 0 10 0 2 0 0 audit_record 1280 0 0 0 0 8 0 0 domainset 40 0 0 0 0 254 0 0 MAC labels 40 0 0 0 0 254 0 0 vnpbuf 2816 0 0 0 0 4 0 0 nfspbuf 2816 0 0 0 0 4 0 0 swwbuf 2816 0 0 826649 0 2 0 0 umtx_shm 88 0 0 0 0 126 0 0 umtx pi 96 0 0 0 0 126 0 0 rangeset pctrie nodes 152 0 0 0 0 62 0 0 malloc-65536 65536 0 0 0 0 1 0 0 malloc-65536 65536 0 0 1 0 1 0 0 malloc-65536 65536 0 0 0 0 1 0 0 malloc-32768 32768 0 0 0 0 1 0 0 malloc-32768 32768 0 0 399735 0 1 0 0 malloc-8192 8192 0 0 0 0 1 0 0 malloc-4096 4096 0 0 12 0 2 0 0 malloc-512 512 0 0 4 0 30 0 0 pcpu-32 32 0 0 0 0 254 0 0 pcpu-4 4 0 0 0 0 254 0 0 UMA Hash 256 0 0 0 0 62 0 0 db:0:pho> show umacache Zone Size Used Free Requests Bucket debugnet_mbuf_packet 2048 0 0 0 0 debugnet_mbuf_cluster 2048 -6144 0 0 0 debugnet_mbuf 256 -10240 0 0 0 vm pgcache 4096 75759 4303 748648113 43 vm pgcache 4096 30732 4859 845595075 33 buf free cache 888 12763 123 16469261 16 buffer arena-65 65536 0 0 0 1 buffer arena-61 61440 0 0 0 1 buffer arena-57 57344 0 0 0 1 buffer arena-53 53248 0 0 0 1 buffer arena-49 49152 0 0 0 1 buffer arena-45 45056 0 0 0 1 buffer arena-40 40960 0 0 0 1 buffer arena-36 36864 0 0 0 1 buffer arena-32 32768 1978 22 13072857 2 buffer arena-28 28672 0 0 0 1 buffer arena-24 24576 0 0 0 1 buffer arena-20 20480 0 0 0 1 buffer arena-16 16384 3 0 109 1 buffer arena-12 12288 0 0 0 1 buffer arena-81 8192 0 0 0 1 buffer arena-40 4096 0 0 0 2 kstack_cache 16384 1153 95 632110 1 db:0:pho> acttrace Tracing command init pid 1 tid 100002 td 0xfffff8000489b000 (CPU 3) kdb_enter() at kdb_enter+0x33/frame 0xfffffe00ffc07a20 panic() at panic+0x43/frame 0xfffffe00ffc07a80 crunuse() at crunuse+0xf5/frame 0xfffffe00ffc07ab0 crcowfree() at crcowfree+0x9/frame 0xfffffe00ffc07ac0 thread_wait() at thread_wait+0x9c/frame 0xfffffe00ffc07ae0 proc_reap() at proc_reap+0x588/frame 0xfffffe00ffc07b20 proc_to_reap() at proc_to_reap+0x3be/frame 0xfffffe00ffc07b70 kern_wait6() at kern_wait6+0x1ab/frame 0xfffffe00ffc07c10 sys_wait4() at sys_wait4+0x6b/frame 0xfffffe00ffc07e00 amd64_syscall() at amd64_syscall+0x169/frame 0xfffffe00ffc07f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00ffc07f30 --- syscall (7, FreeBSD ELF64, wait4), rip = 0x2d762a, rsp = 0x8208121f8, rbp = 0x820812200 --- Tracing command idle pid 11 tid 100003 td 0xfffff8000489a780 (CPU 0) cpustop_handler() at cpustop_handler+0x27/frame 0xffffffff81f22080 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xffffffff81f22090 nmi_handle_intr() at nmi_handle_intr+0xf/frame 0xffffffff81f220b0 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81f220b0 --- trap 0x13, rip = 0xffffffff810b989e, rsp = 0xfffffe00ffc16d68, rbp = 0xfffffe00ffc16db0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe00ffc16db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe00ffc16dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00ffc16df0 sched_idletd() at sched_idletd+0x524/frame 0xfffffe00ffc16ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffc16f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffc16f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffff80004899780 (CPU 2) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe0034a55ef0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe0034a55f00 nmi_handle_intr() at nmi_handle_intr+0xf/frame 0xfffffe0034a55f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0034a55f20 --- trap 0x13, rip = 0xffffffff810b989e, rsp = 0xfffffe00ffc20d68, rbp = 0xfffffe00ffc20db0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe00ffc20db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe00ffc20dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00ffc20df0 sched_idletd() at sched_idletd+0x524/frame 0xfffffe00ffc20ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffc20f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffc20f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffff80004898780 (CPU 4) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe0034a73ef0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe0034a73f00 nmi_handle_intr() at nmi_handle_intr+0xf/frame 0xfffffe0034a73f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0034a73f20 --- trap 0x13, rip = 0xffffffff810b989e, rsp = 0xfffffe00ffc2ad68, rbp = 0xfffffe00ffc2adb0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe00ffc2adb0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe00ffc2add0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00ffc2adf0 sched_idletd() at sched_idletd+0x524/frame 0xfffffe00ffc2aef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffc2af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffc2af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffff80004898000 (CPU 5) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe0034a82ef0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe0034a82f00 nmi_handle_intr() at nmi_handle_intr+0xf/frame 0xfffffe0034a82f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0034a82f20 --- trap 0x13, rip = 0xffffffff810b989e, rsp = 0xfffffe00ffc25d68, rbp = 0xfffffe00ffc25db0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe00ffc25db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe00ffc25dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00ffc25df0 sched_idletd() at sched_idletd+0x524/frame 0xfffffe00ffc25ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffc25f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffc25f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffff800048ac780 (CPU 6) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe0034a91ef0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe0034a91f00 nmi_handle_intr() at nmi_handle_intr+0xf/frame 0xfffffe0034a91f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0034a91f20 --- trap 0x13, rip = 0xffffffff810b989e, rsp = 0xfffffe00ffc34d68, rbp = 0xfffffe00ffc34db0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe00ffc34db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe00ffc34dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00ffc34df0 sched_idletd() at sched_idletd+0x524/frame 0xfffffe00ffc34ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffc34f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffc34f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffff800048ac000 (CPU 7) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe0034aa0ef0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe0034aa0f00 nmi_handle_intr() at nmi_handle_intr+0xf/frame 0xfffffe0034aa0f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0034aa0f20 --- trap 0x13, rip = 0xffffffff810b989e, rsp = 0xfffffe00ffc2fd68, rbp = 0xfffffe00ffc2fdb0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe00ffc2fdb0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe00ffc2fdd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00ffc2fdf0 sched_idletd() at sched_idletd+0x524/frame 0xfffffe00ffc2fef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffc2ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffc2ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffff800048ab780 (CPU 8) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe0034aafef0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe0034aaff00 nmi_handle_intr() at nmi_handle_intr+0xf/frame 0xfffffe0034aaff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0034aaff20 --- trap 0x13, rip = 0xffffffff810b989e, rsp = 0xfffffe00ffc3ed68, rbp = 0xfffffe00ffc3edb0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe00ffc3edb0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe00ffc3edd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00ffc3edf0 sched_idletd() at sched_idletd+0x524/frame 0xfffffe00ffc3eef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffc3ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffc3ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffff800048ab000 (CPU 9) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe0034abeef0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe0034abef00 nmi_handle_intr() at nmi_handle_intr+0xf/frame 0xfffffe0034abef20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0034abef20 --- trap 0x13, rip = 0xffffffff810b989e, rsp = 0xfffffe00ffc39d68, rbp = 0xfffffe00ffc39db0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe00ffc39db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe00ffc39dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00ffc39df0 sched_idletd() at sched_idletd+0x524/frame 0xfffffe00ffc39ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffc39f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffc39f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffff800048aa780 (CPU 10) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe0034acdef0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe0034acdf00 nmi_handle_intr() at nmi_handle_intr+0xf/frame 0xfffffe0034acdf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0034acdf20 --- trap 0x13, rip = 0xffffffff810b989e, rsp = 0xfffffe00ffc48d68, rbp = 0xfffffe00ffc48db0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe00ffc48db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe00ffc48dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00ffc48df0 sched_idletd() at sched_idletd+0x524/frame 0xfffffe00ffc48ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffc48f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffc48f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffff800048aa000 (CPU 11) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe0034adcef0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe0034adcf00 nmi_handle_intr() at nmi_handle_intr+0xf/frame 0xfffffe0034adcf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0034adcf20 --- trap 0x13, rip = 0xffffffff810b989e, rsp = 0xfffffe00ffc43d68, rbp = 0xfffffe00ffc43db0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe00ffc43db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe00ffc43dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00ffc43df0 sched_idletd() at sched_idletd+0x524/frame 0xfffffe00ffc43ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffc43f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffc43f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:pho> ps pid ppid pgrp uid state wmesg wchan cmd 78280 1 78280 2006 Ss+ ttyout 0xfffff80006bee0c0 sh 75554 1 75554 0 Ds swread 0xfffff804d1432928 sshd-session 3652 3651 3652 0 D+ biord 0xfffffe00303d9470 bash 3651 1 3651 0 S+ wait 0xfffffe015c278ab8 sh 3623 1 3623 0 Ds swread 0xfffff8000ceb41a8 sshd-session 3423 1 3423 0 Ss select 0xfffff800159daec0 syslogd 3422 1 3419 0 S select 0xfffff8001f7d0040 syslogd 3419 1 3419 0 Ds swread 0xfffff8000cec7b08 syslogd 18 0 0 0 DL syncer 0xffffffff81eda478 [syncer] 17 0 0 0 DL vlruwt 0xfffffe00dca0a010 [vnlru] 16 0 0 0 DL (threaded) [bufdaemon] 100204 D psleep 0xffffffff81ed9478 [bufdaemon] 100205 D - 0xffffffff81a01e80 [bufspacedaemon-0] 100206 D - 0xffffffff81a02100 [bufspacedaemon-1] 100207 D - 0xffffffff81a02380 [bufspacedaemon-2] 100208 D - 0xffffffff81a02600 [bufspacedaemon-3] 100209 D - 0xffffffff81a02880 [bufspacedaemon-4] 100210 D - 0xffffffff81a02b00 [bufspacedaemon-5] 100211 D - 0xffffffff81a02d80 [bufspacedaemon-6] 100236 D sdflush 0xfffff8001f2ed8e8 [/ worker] 100250 D sdflush 0xfffff800158e34e8 [/tmp worker] 15 0 0 0 DL psleep 0xffffffff81f0e8f0 [vmdaemon] 9 0 0 0 DL (threaded) [pagedaemon] 100200 D psleep 0xffffffff81ef4f88 [dom0] 100201 D launds 0xffffffff81ef4f94 [laundry: dom0] 100202 D umarcl 0xffffffff80f69f40 [uma] 8 0 0 0 DL idle 0xfffffe00dca04558 [enc_daemon1] 7 0 0 0 DL idle 0xfffffe00dca04ab0 [enc_daemon0] 6 0 0 0 DL - 0xffffffff81be0ff0 [rand_harvestq] 14 0 0 0 DL (threaded) [usb] 100128 D - 0xfffffe01027c4440 [usbus0] 100129 D - 0xfffffe01027c4498 [usbus0] 100130 D - 0xfffffe01027c44f0 [usbus0] 100131 D - 0xfffffe01027c4548 [usbus0] 100132 D - 0xfffffe01027c45a0 [usbus0] 100134 D - 0xfffffe00dc99dcf0 [usbus1] 100135 D - 0xfffffe00dc99dd48 [usbus1] 100136 D - 0xfffffe00dc99dda0 [usbus1] 100137 D - 0xfffffe00dc99ddf8 [usbus1] 100138 D - 0xfffffe00dc99de50 [usbus1] 100141 D - 0xfffffe0102b5dcf0 [usbus2] 100142 D - 0xfffffe0102b5dd48 [usbus2] 100143 D - 0xfffffe0102b5dda0 [usbus2] 100144 D - 0xfffffe0102b5ddf8 [usbus2] 100145 D - 0xfffffe0102b5de50 [usbus2] 5 0 0 0 DL - 0xffffffff81b60870 [busdma] 4 0 0 0 DL (threaded) [cam] 100121 D - 0xffffffff81bb2240 [doneq0] 100122 D - 0xffffffff81bb22c0 [doneq1] 100123 D - 0xffffffff81bb2340 [doneq2] 100124 D - 0xffffffff81bb21c0 [async] 100155 D - 0xffffffff81bb2090 [scanner] 3 0 0 0 DL (threaded) [crypto] 100108 D crypto_ 0xffffffff81ef2470 [crypto] 100109 D crypto_ 0xfffff80003a5dc30 [crypto returns 0] 100110 D crypto_ 0xfffff80003a5dc80 [crypto returns 1] 100111 D crypto_ 0xfffff80003a5dcd0 [crypto returns 2] 100112 D crypto_ 0xfffff80003a5dd20 [crypto returns 3] 100113 D crypto_ 0xfffff80003a5dd70 [crypto returns 4] 100114 D crypto_ 0xfffff80003a5ddc0 [crypto returns 5] 100115 D crypto_ 0xfffff80003a5de10 [crypto returns 6] 100116 D crypto_ 0xfffff80003a5de60 [crypto returns 7] 100117 D crypto_ 0xfffff80003a5deb0 [crypto returns 8] 100118 D crypto_ 0xfffff80003a5df00 [crypto returns 9] 100119 D crypto_ 0xfffff80003a5df50 [crypto returns 10] 100120 D crypto_ 0xfffff80003a5dfa0 [crypto returns 11] 13 0 0 0 DL (threaded) [geom] 100093 D - 0xffffffff81d9f120 [g_event] 100094 D - 0xffffffff81d9f128 [g_up] 100095 D - 0xffffffff81d9f130 [g_down] 2 0 0 0 WL (threaded) [clock] 100079 I [clock (0)] 100080 I [clock (1)] 100081 I [clock (2)] 100082 I [clock (3)] 100083 I [clock (4)] 100084 I [clock (5)] 100085 I [clock (6)] 100086 I [clock (7)] 100087 I [clock (8)] 100088 I [clock (9)] 100089 I [clock (10)] 100090 I [clock (11)] 12 0 0 0 WL (threaded) [intr] 100043 I [swi6: task queue] 100044 I [swi6: Giant taskq] 100046 I [swi5: fast taskq] 100091 I [swi1: netisr 0] 100125 I [irq56: ahci0] 100127 I [irq19: xhci0] 100133 I [irq18: ehci0 ehci1+] 100146 I [irq71: ahci1] 100147 I [swi4: apei] 100148 I [swi0: uart uart] 100163 I [irq73: mlx5_core0] 100164 I [irq74: mlx5_core0] 100165 I [irq72: mlx5_core0] 100166 I [irq75: mlx5_core0] 100167 I [irq76: mlx5_core0] 100168 I [irq77: mlx5_core0] 100169 I [irq78: mlx5_core0] 100170 I [irq79: mlx5_core0] 100171 I [irq80: mlx5_core0] 100172 I [irq81: mlx5_core0] 100173 I [irq82: mlx5_core0] 100174 I [irq83: mlx5_core0] 100175 I [irq84: mlx5_core0] 100176 I [irq85: mlx5_core0] 100177 I [irq86: mlx5_core0] 100184 I [irq88: mlx5_core1] 100185 I [irq89: mlx5_core1] 100186 I [irq87: mlx5_core1] 100187 I [irq90: mlx5_core1] 100188 I [irq91: mlx5_core1] 100189 I [irq92: mlx5_core1] 100190 I [irq93: mlx5_core1] 100191 I [irq94: mlx5_core1] 100192 I [irq95: mlx5_core1] 100193 I [irq96: mlx5_core1] 100194 I [irq97: mlx5_core1] 100195 I [irq98: mlx5_core1] 100196 I [irq99: mlx5_core1] 100197 I [irq100: mlx5_core1] 100198 I [irq101: mlx5_core1] 100242 I [irq102: ioat0] 100243 I [irq103: ioat1] 100244 I [irq104: ioat2] 100245 I [irq105: ioat3] 100246 I [irq106: ioat4] 100247 I [irq107: ioat5] 100248 I [irq108: ioat6] 100249 I [irq109: ioat7] 11 0 0 0 RL (threaded) [idle] 100003 Run CPU 0 [idle: cpu0] 100004 CanRun [idle: cpu1] 100005 Run CPU 2 [idle: cpu2] 100006 CanRun [idle: cpu3] 100007 Run CPU 4 [idle: cpu4] 100008 Run CPU 5 [idle: cpu5] 100009 Run CPU 6 [idle: cpu6] 100010 Run CPU 7 [idle: cpu7] 100011 Run CPU 8 [idle: cpu8] 100012 Run CPU 9 [idle: cpu9] 100013 Run CPU 10 [idle: cpu10] 100014 Run CPU 11 [idle: cpu11] 1 0 1 0 RLs CPU 3 [init] 10 0 0 0 DL audit_w 0xffffffff81ef2980 [audit] 0 0 0 0 DLs (threaded) [kernel] 100000 D - 0xffffffff8253fff0 [kernel] 100015 D - 0xfffff80003393000 [softirq_0] 100016 D - 0xfffff80003392e00 [softirq_1] 100017 D - 0xfffff80003392d00 [softirq_2] 100018 D - 0xfffff80003392c00 [softirq_3] 100019 D - 0xfffff80003392b00 [softirq_4] 100020 D - 0xfffff80003392a00 [softirq_5] 100021 D - 0xfffff80003392900 [softirq_6] 100022 D - 0xfffff80003392800 [softirq_7] 100023 D - 0xfffff80003392700 [softirq_8] 100024 D - 0xfffff80003392600 [softirq_9] 100025 D - 0xfffff80003392500 [softirq_10] 100026 D - 0xfffff80003392400 [softirq_11] 100027 D - 0xfffff80003392300 [if_io_tqg_0] 100028 D - 0xfffff80003392200 [if_io_tqg_1] 100029 D - 0xfffff80003392100 [if_io_tqg_2] 100030 D - 0xfffff80003392000 [if_io_tqg_3] 100031 D - 0xfffff80002601e00 [if_io_tqg_4] 100032 D - 0xfffff80002601d00 [if_io_tqg_5] 100033 D - 0xfffff80002601c00 [if_io_tqg_6] 100034 D - 0xfffff80002601b00 [if_io_tqg_7] 100035 D - 0xfffff80002601a00 [if_io_tqg_8] 100036 D - 0xfffff80002601900 [if_io_tqg_9] 100037 D - 0xfffff80002601800 [if_io_tqg_10] 100038 D - 0xfffff80002601700 [if_io_tqg_11] 100039 D - 0xfffff80002601600 [if_config_tqg_0] 100040 D - 0xfffff80002601500 [kqueue_ctx taskq] 100041 D - 0xfffff80002601400 [jail_remove taskq] 100042 D - 0xfffff80002601300 [bus taskq] 100045 D - 0xfffff80002601000 [thread taskq] 100047 D - 0xfffff80078f45d00 [aiod_kick taskq] 100048 D - 0xfffff80078f45c00 [deferred_unmount ta] 100049 D - 0xfffff80078f45b00 [inm_free taskq] 100050 D - 0xfffff80078f45a00 [in6m_free taskq] 100051 D - 0xfffff80078f45900 [linuxkpi_irq_wq] 100052 D - 0xfffff80078f45800 [linuxkpi_short_wq_0] 100053 D - 0xfffff80078f45800 [linuxkpi_short_wq_1] 100054 D - 0xfffff80078f45800 [linuxkpi_short_wq_2] 100055 D - 0xfffff80078f45800 [linuxkpi_short_wq_3] 100056 D - 0xfffff80078f45800 [linuxkpi_short_wq_4] 100057 D - 0xfffff80078f45800 [linuxkpi_short_wq_5] 100058 D - 0xfffff80078f45800 [linuxkpi_short_wq_6] 100059 D - 0xfffff80078f45800 [linuxkpi_short_wq_7] 100060 D - 0xfffff80078f45800 [linuxkpi_short_wq_8] 100061 D - 0xfffff80078f45800 [linuxkpi_short_wq_9] 100062 D - 0xfffff80078f45800 [linuxkpi_short_wq_1] 100063 D - 0xfffff80078f45800 [linuxkpi_short_wq_1] 100064 D - 0xfffff80078f45800 [linuxkpi_short_wq_1] 100065 D - 0xfffff80078f45700 [linuxkpi_long_wq_0] 100066 D - 0xfffff80078f45700 [linuxkpi_long_wq_1] 100067 D - 0xfffff80078f45700 [linuxkpi_long_wq_2] 100068 D - 0xfffff80078f45700 [linuxkpi_long_wq_3] 100069 D - 0xfffff80078f45700 [linuxkpi_long_wq_4] 100070 D - 0xfffff80078f45700 [linuxkpi_long_wq_5] 100071 D - 0xfffff80078f45700 [linuxkpi_long_wq_6] 100072 D - 0xfffff80078f45700 [linuxkpi_long_wq_7] 100073 D - 0xfffff80078f45700 [linuxkpi_long_wq_8] 100074 D - 0xfffff80078f45700 [linuxkpi_long_wq_9] 100075 D - 0xfffff80078f45700 [linuxkpi_long_wq_10] 100076 D - 0xfffff80078f45700 [linuxkpi_long_wq_11] 100077 D - 0xfffff80078f45700 [linuxkpi_long_wq_12] 100092 D - 0xfffff80078f45600 [firmware taskq] 100096 D - 0xfffff8000260db00 [crypto_0] 100097 D - 0xfffff8000260db00 [crypto_1] 100098 D - 0xfffff8000260db00 [crypto_2] 100099 D - 0xfffff8000260db00 [crypto_3] 100100 D - 0xfffff8000260db00 [crypto_4] 100101 D - 0xfffff8000260db00 [crypto_5] 100102 D - 0xfffff8000260db00 [crypto_6] 100103 D - 0xfffff8000260db00 [crypto_7] 100104 D - 0xfffff8000260db00 [crypto_8] 100105 D - 0xfffff8000260db00 [crypto_9] 100106 D - 0xfffff8000260db00 [crypto_10] 100107 D - 0xfffff8000260db00 [crypto_11] 100139 D - 0xfffff8000260d600 [if_igb0_tq] 100140 D - 0xfffff800036d4300 [if_igb1_tq] 100149 D - 0xfffff80006a67500 [acpi_task_0] 100150 D - 0xfffff80006a67500 [acpi_task_1] 100151 D - 0xfffff80006a67500 [acpi_task_2] 100153 D - 0xfffff80003393100 [mca taskq] 100154 D - 0xfffff8000260d500 [CAM taskq] 100158 D - 0xfffff80006a67400 [mlx5_core0-rec] 100159 D - 0xfffff80006a67300 [mlx5_core0-wdg] 100160 D - 0xfffff80006a67200 [mlx5_core0-cmd] 100161 D - 0xfffff80006a67100 [mlx5_fc] 100162 D - 0xfffff80006a67000 [mlx5_page_allocator] 100178 D - 0xfffff80006a68e00 [mlx5_esw_wq] 100179 D - 0xfffff80006a68d00 [mlx5_core1-rec] 100180 D - 0xfffff80006a68c00 [mlx5_core1-wdg] 100181 D - 0xfffff80006a68b00 [mlx5_core1-cmd] 100182 D - 0xfffff80006a68a00 [mlx5_fc] 100183 D - 0xfffff80006a68900 [mlx5_page_allocator] 100199 D - 0xfffff800037a8900 [mlx5_esw_wq] db:0:pho> allt Tracing command kernel pid 0 tid 100000 td 0xffffffff81d9fc00 sched_switch() at sched_switch+0x5e2/frame 0xffffffff8253fea0 mi_switch() at mi_switch+0x172/frame 0xffffffff8253fec0 sleepq_switch() at sleepq_switch+0x109/frame 0xffffffff8253ff00 _sleep() at _sleep+0x2a5/frame 0xffffffff8253ffa0 mi_startup() at mi_startup+0x273/frame 0xffffffff8253fff0 Tracing command kernel pid 0 tid 100015 td 0xfffff800048a9780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffc52df0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffc52e10 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffc52e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00ffc52ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00ffc52ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffc52f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffc52f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100016 td 0xfffff800048a9000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffc4ddf0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffc4de10 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffc4de50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00ffc4dec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00ffc4def0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffc4df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffc4df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100017 td 0xfffff800048b0780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffc5cdf0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffc5ce10 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffc5ce50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00ffc5cec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00ffc5cef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffc5cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffc5cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100018 td 0xfffff800048b0000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffc57df0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffc57e10 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffc57e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00ffc57ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00ffc57ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffc57f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffc57f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100019 td 0xfffff800048af780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffc66df0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffc66e10 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffc66e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00ffc66ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00ffc66ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffc66f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffc66f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xfffff800048af000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffc61df0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffc61e10 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffc61e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00ffc61ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00ffc61ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffc61f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffc61f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xfffff800048ae780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffc70df0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffc70e10 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffc70e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00ffc70ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00ffc70ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffc70f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffc70f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xfffff800048ae000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffc6bdf0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffc6be10 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffc6be50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00ffc6bec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00ffc6bef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffc6bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffc6bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xfffff800048ad780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffc7adf0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffc7ae10 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffc7ae50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00ffc7aec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00ffc7aef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffc7af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffc7af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xfffff800048ad000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffc75df0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffc75e10 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffc75e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00ffc75ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00ffc75ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffc75f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffc75f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xfffff800048b4780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffc84df0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffc84e10 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffc84e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00ffc84ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00ffc84ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffc84f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffc84f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100026 td 0xfffff800048b4000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffc7fdf0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffc7fe10 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffc7fe50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00ffc7fec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00ffc7fef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffc7ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffc7ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100027 td 0xfffff800048b3780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffc8edf0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffc8ee10 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffc8ee50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00ffc8eec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00ffc8eef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffc8ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffc8ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100028 td 0xfffff800048b3000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffc89df0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffc89e10 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffc89e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00ffc89ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00ffc89ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffc89f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffc89f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100029 td 0xfffff800048b2780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffc98df0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffc98e10 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffc98e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00ffc98ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00ffc98ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffc98f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffc98f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100030 td 0xfffff800048b2000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffc93df0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffc93e10 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffc93e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00ffc93ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00ffc93ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffc93f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffc93f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100031 td 0xfffff800048b1780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffca2df0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffca2e10 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffca2e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00ffca2ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00ffca2ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffca2f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffca2f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100032 td 0xfffff800048b1000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffc9ddf0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffc9de10 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffc9de50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00ffc9dec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00ffc9def0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffc9df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffc9df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100033 td 0xfffff800048b8780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffcacdf0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffcace10 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffcace50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00ffcacec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00ffcacef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffcacf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffcacf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100034 td 0xfffff800048b8000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffca7df0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffca7e10 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffca7e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00ffca7ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00ffca7ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffca7f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffca7f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100035 td 0xfffff800048b7780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffcb6df0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffcb6e10 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffcb6e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00ffcb6ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00ffcb6ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffcb6f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffcb6f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100036 td 0xfffff800048b7000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffcb1df0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffcb1e10 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffcb1e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00ffcb1ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00ffcb1ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffcb1f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffcb1f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100037 td 0xfffff800048b6780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffcc0df0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffcc0e10 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffcc0e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00ffcc0ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00ffcc0ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffcc0f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffcc0f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100038 td 0xfffff800048b6000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffcbbdf0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffcbbe10 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffcbbe50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00ffcbbec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00ffcbbef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffcbbf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffcbbf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100039 td 0xfffff800048b5780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffccadf0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffccae10 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffccae50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00ffccaec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe00ffccaef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffccaf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffccaf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100040 td 0xfffff800048b5000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffcc5dc0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffcc5de0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffcc5e20 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffcc5ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00ffcc5ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffcc5f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffcc5f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100041 td 0xfffff800048bc780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffcd4dc0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffcd4de0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffcd4e20 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffcd4ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00ffcd4ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffcd4f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffcd4f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100042 td 0xfffff800048bc000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffccfdc0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffccfde0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffccfe20 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffccfec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00ffccfef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffccff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffccff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100045 td 0xfffff800048ba780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffce8dc0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffce8de0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffce8e20 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffce8ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00ffce8ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffce8f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffce8f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100047 td 0xfffff800048b9780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffcf2dc0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffcf2de0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffcf2e20 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffcf2ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00ffcf2ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffcf2f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffcf2f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100048 td 0xfffff800048b9000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffceddc0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffcedde0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffcede20 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffcedec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00ffcedef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffcedf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffcedf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100049 td 0xfffff800048c0780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffcfcdc0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffcfcde0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffcfce20 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffcfcec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00ffcfcef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffcfcf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffcfcf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100050 td 0xfffff800048c0000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffcf7dc0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffcf7de0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffcf7e20 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffcf7ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00ffcf7ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffcf7f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffcf7f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100051 td 0xfffff800048bf780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffd06df0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffd06e10 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffd06e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00ffd06ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0x104/frame 0xfffffe00ffd06ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffd06f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffd06f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100052 td 0xfffff800048bf000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffd01dc0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffd01de0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffd01e20 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffd01ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00ffd01ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffd01f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffd01f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100053 td 0xfffff800048be780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffd10dc0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffd10de0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffd10e20 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffd10ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00ffd10ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffd10f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffd10f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100054 td 0xfffff800048be000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffd0bdc0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffd0bde0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffd0be20 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffd0bec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00ffd0bef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffd0bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffd0bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100055 td 0xfffff800048bd780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffd1adc0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffd1ade0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffd1ae20 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffd1aec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00ffd1aef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffd1af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffd1af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100056 td 0xfffff800048bd000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffd15dc0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffd15de0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffd15e20 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffd15ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00ffd15ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffd15f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffd15f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100057 td 0xfffff800048c7780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffd24dc0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffd24de0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffd24e20 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffd24ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00ffd24ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffd24f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffd24f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100058 td 0xfffff800048c7000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffd1fdc0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffd1fde0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffd1fe20 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffd1fec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00ffd1fef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffd1ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffd1ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100059 td 0xfffff800048c3780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffd2edc0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffd2ede0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffd2ee20 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffd2eec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00ffd2eef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffd2ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffd2ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100060 td 0xfffff800048c3000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffd29dc0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffd29de0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffd29e20 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffd29ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00ffd29ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffd29f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffd29f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100061 td 0xfffff800048c2780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffd38dc0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffd38de0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffd38e20 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffd38ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00ffd38ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffd38f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffd38f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100062 td 0xfffff800048c2000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffd33dc0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffd33de0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffd33e20 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffd33ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00ffd33ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffd33f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffd33f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100063 td 0xfffff800048c1780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffd42dc0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffd42de0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffd42e20 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffd42ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00ffd42ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffd42f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffd42f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100064 td 0xfffff800048c1000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffd3ddc0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffd3dde0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffd3de20 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffd3dec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00ffd3def0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffd3df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffd3df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100065 td 0xfffff800048cb780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffd4cdc0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffd4cde0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffd4ce20 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffd4cec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00ffd4cef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffd4cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffd4cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100066 td 0xfffff800048cb000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffd47dc0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffd47de0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffd47e20 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffd47ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00ffd47ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffd47f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffd47f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100067 td 0xfffff800048ca780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffd56dc0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffd56de0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffd56e20 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffd56ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00ffd56ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffd56f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffd56f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100068 td 0xfffff800048ca000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffd51dc0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffd51de0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffd51e20 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffd51ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00ffd51ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffd51f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffd51f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100069 td 0xfffff800048c9780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffd60dc0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffd60de0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffd60e20 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffd60ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00ffd60ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffd60f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffd60f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100070 td 0xfffff800048c9000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffd5bdc0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffd5bde0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffd5be20 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffd5bec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00ffd5bef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffd5bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffd5bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100071 td 0xfffff800048c8780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffd6adc0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffd6ade0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffd6ae20 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffd6aec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00ffd6aef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffd6af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffd6af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100072 td 0xfffff800048c8000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffd65dc0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffd65de0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffd65e20 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffd65ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00ffd65ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffd65f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffd65f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100073 td 0xfffff800048cf780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffd74dc0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffd74de0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffd74e20 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffd74ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00ffd74ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffd74f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffd74f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100074 td 0xfffff800048cf000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffd6fdc0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffd6fde0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffd6fe20 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffd6fec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00ffd6fef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffd6ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffd6ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100075 td 0xfffff800048ce780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffd7edc0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffd7ede0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffd7ee20 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffd7eec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00ffd7eef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffd7ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffd7ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100076 td 0xfffff800048ce000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffd79dc0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffd79de0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffd79e20 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffd79ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00ffd79ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffd79f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffd79f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100077 td 0xfffff800048cd780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffd88dc0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffd88de0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffd88e20 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffd88ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00ffd88ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffd88f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffd88f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100092 td 0xfffff800048d6000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffdc9dc0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffdc9de0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffdc9e20 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffdc9ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00ffdc9ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffdc9f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffdc9f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100096 td 0xfffff800048d4000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffddddc0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffdddde0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffddde20 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffdddec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00ffdddef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffdddf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffdddf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100097 td 0xfffff800048db780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffdecdc0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffdecde0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffdece20 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffdecec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00ffdecef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffdecf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffdecf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100098 td 0xfffff800048db000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffde7dc0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffde7de0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffde7e20 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffde7ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00ffde7ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffde7f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffde7f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100099 td 0xfffff800048da780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffdf6dc0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffdf6de0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffdf6e20 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffdf6ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00ffdf6ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffdf6f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffdf6f30 --- trap 0x440055, rip = 0x74006100740053, rsp = 0x6e006f0043006f, rbp = 0x6c0061006e0072 --- Tracing command kernel pid 0 tid 100100 td 0xfffff800048da000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffdf1dc0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffdf1de0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffdf1e20 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffdf1ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00ffdf1ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffdf1f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffdf1f30 --- trap 0x75003b44, rip = 0xb6600001000b808, rsp = 0x2c483491275013b, rbp = 0x83b4466c8b70f45 --- Tracing command kernel pid 0 tid 100101 td 0xfffff800048d9780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffe00dc0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffe00de0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffe00e20 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffe00ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00ffe00ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffe00f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffe00f30 --- trap 0x2c08348, rip = 0xc28b49ead149287b, rsp = 0x4154415756552024, rbp = 0xc641c0ff481573d5 --- Tracing command kernel pid 0 tid 100102 td 0xfffff800048d9000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffdfbdc0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffdfbde0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffdfbe20 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffdfbec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00ffdfbef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffdfbf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffdfbf30 --- trap 0x8445ebd0, rip = 0x838b480c7538394c, rsp = 0x89e800000006b980, rbp = 0x3b4c402444894c5c --- Tracing command kernel pid 0 tid 100103 td 0xfffff800048d8780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffe0adc0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffe0ade0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffe0ae20 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffe0aec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00ffe0aef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffe0af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffe0af30 --- trap 0xc08548ff, rip = 0x48ffffe521e8cf8b, rsp = 0x4c8b78c08548ffff, rbp = 0x4830245c8b488000 --- Tracing command kernel pid 0 tid 100104 td 0xfffff800048d8000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffe05dc0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffe05de0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffe05e20 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffe05ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00ffe05ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffe05f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffe05f30 --- trap 0x8b48d78b, rip = 0x4b8411074, rsp = 0x8b480d74fc3b4912, rbp = 0x2c2f76775c83b00 --- Tracing command kernel pid 0 tid 100105 td 0xfffff800048df780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffe14dc0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffe14de0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffe14e20 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffe14ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00ffe14ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffe14f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffe14f30 --- trap 0x129, rip = 0x5de8c9034802514c, rsp = 0x108966c82b48cb8b, rbp = 0x66d68b493875c63b --- Tracing command kernel pid 0 tid 100106 td 0xfffff800048df000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffe0fdc0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffe0fde0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffe0fe20 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffe0fec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00ffe0fef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffe0ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffe0ff30 --- trap 0xfe3b493e, rip = 0x5de8cb8b4904598d, rsp = 0x25e8cc8b49d38b49, rbp = 0x230840fc63b49e8 --- Tracing command kernel pid 0 tid 100107 td 0xfffff800048de780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffe1edc0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffe1ede0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffe1ee20 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffe1eec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00ffe1eef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffe1ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffe1ef30 --- trap 0xafafafaf, rip = 0xafafafafafafafaf, rsp = 0xafafafafafafafaf, rbp = 0xafafafafafafafaf --- Tracing command kernel pid 0 tid 100139 td 0xfffff80004906000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffeafdf0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffeafe10 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffeafe50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00ffeafec0 taskqueue_thread_loop() at taskqueue_thread_loop+0x104/frame 0xfffffe00ffeafef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffeaff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffeaff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100140 td 0xfffff80004913780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffebedf0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffebee10 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffebee50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00ffebeec0 taskqueue_thread_loop() at taskqueue_thread_loop+0x104/frame 0xfffffe00ffebeef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffebef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffebef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100149 td 0xfffff80009b30780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffef0df0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffef0e10 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffef0e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00ffef0ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0x104/frame 0xfffffe00ffef0ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffef0f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffef0f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100150 td 0xfffff80009b30000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffeebdf0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffeebe10 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffeebe50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00ffeebec0 taskqueue_thread_loop() at taskqueue_thread_loop+0x104/frame 0xfffffe00ffeebef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffeebf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffeebf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100151 td 0xfffff80009b2f780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffefadf0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffefae10 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffefae50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00ffefaec0 taskqueue_thread_loop() at taskqueue_thread_loop+0x104/frame 0xfffffe00ffefaef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffefaf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffefaf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100153 td 0xfffff80009b2e780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00fff04df0 mi_switch() at mi_switch+0x172/frame 0xfffffe00fff04e10 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00fff04e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe00fff04ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0x104/frame 0xfffffe00fff04ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00fff04f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00fff04f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100154 td 0xfffff80009b2e000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffeffdc0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffeffde0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffeffe20 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffeffec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00ffeffef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffefff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffefff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100158 td 0xfffff80009b2a000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00fff09dc0 mi_switch() at mi_switch+0x172/frame 0xfffffe00fff09de0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00fff09e20 _sleep() at _sleep+0x2a5/frame 0xfffffe00fff09ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00fff09ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00fff09f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00fff09f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100159 td 0xfffff80009b3b780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00fff22dc0 mi_switch() at mi_switch+0x172/frame 0xfffffe00fff22de0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00fff22e20 _sleep() at _sleep+0x2a5/frame 0xfffffe00fff22ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00fff22ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00fff22f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00fff22f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100160 td 0xfffff80009b3b000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00fff1ddc0 mi_switch() at mi_switch+0x172/frame 0xfffffe00fff1dde0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00fff1de20 _sleep() at _sleep+0x2a5/frame 0xfffffe00fff1dec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00fff1def0 fork_exit() at fork_exit+0x82/frame 0xfffffe00fff1df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00fff1df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100161 td 0xfffff80009b3a780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00fff2cdc0 mi_switch() at mi_switch+0x172/frame 0xfffffe00fff2cde0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00fff2ce20 _sleep() at _sleep+0x2a5/frame 0xfffffe00fff2cec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00fff2cef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00fff2cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00fff2cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100162 td 0xfffff80009b3a000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00fff27dc0 mi_switch() at mi_switch+0x172/frame 0xfffffe00fff27de0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00fff27e20 _sleep() at _sleep+0x2a5/frame 0xfffffe00fff27ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00fff27ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00fff27f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00fff27f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100178 td 0xfffff80009b42000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00fff77dc0 mi_switch() at mi_switch+0x172/frame 0xfffffe00fff77de0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00fff77e20 _sleep() at _sleep+0x2a5/frame 0xfffffe00fff77ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00fff77ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00fff77f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00fff77f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100179 td 0xfffff80009b41780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00fff86dc0 mi_switch() at mi_switch+0x172/frame 0xfffffe00fff86de0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00fff86e20 _sleep() at _sleep+0x2a5/frame 0xfffffe00fff86ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00fff86ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00fff86f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00fff86f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100180 td 0xfffff80009b41000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00fff81dc0 mi_switch() at mi_switch+0x172/frame 0xfffffe00fff81de0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00fff81e20 _sleep() at _sleep+0x2a5/frame 0xfffffe00fff81ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00fff81ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00fff81f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00fff81f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100181 td 0xfffff80009b40780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00fff90dc0 mi_switch() at mi_switch+0x172/frame 0xfffffe00fff90de0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00fff90e20 _sleep() at _sleep+0x2a5/frame 0xfffffe00fff90ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00fff90ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00fff90f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00fff90f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100182 td 0xfffff80009b40000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00fff8bdc0 mi_switch() at mi_switch+0x172/frame 0xfffffe00fff8bde0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00fff8be20 _sleep() at _sleep+0x2a5/frame 0xfffffe00fff8bec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00fff8bef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00fff8bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00fff8bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100183 td 0xfffff80009b4b780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00fff9adc0 mi_switch() at mi_switch+0x172/frame 0xfffffe00fff9ade0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00fff9ae20 _sleep() at _sleep+0x2a5/frame 0xfffffe00fff9aec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00fff9aef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00fff9af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00fff9af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100199 td 0xfffff80009b53780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00fffeadc0 mi_switch() at mi_switch+0x172/frame 0xfffffe00fffeade0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00fffeae20 _sleep() at _sleep+0x2a5/frame 0xfffffe00fffeaec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe00fffeaef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00fffeaf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00fffeaf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command init pid 1 tid 100002 td 0xfffff8000489b000 (CPU 3) kdb_enter() at kdb_enter+0x33/frame 0xfffffe00ffc07a20 panic() at panic+0x43/frame 0xfffffe00ffc07a80 crunuse() at crunuse+0xf5/frame 0xfffffe00ffc07ab0 crcowfree() at crcowfree+0x9/frame 0xfffffe00ffc07ac0 thread_wait() at thread_wait+0x9c/frame 0xfffffe00ffc07ae0 proc_reap() at proc_reap+0x588/frame 0xfffffe00ffc07b20 proc_to_reap() at proc_to_reap+0x3be/frame 0xfffffe00ffc07b70 kern_wait6() at kern_wait6+0x1ab/frame 0xfffffe00ffc07c10 sys_wait4() at sys_wait4+0x6b/frame 0xfffffe00ffc07e00 amd64_syscall() at amd64_syscall+0x169/frame 0xfffffe00ffc07f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00ffc07f30 --- syscall (7, FreeBSD ELF64, wait4), rip = 0x2d762a, rsp = 0x8208121f8, rbp = 0x820812200 --- Tracing command clock pid 2 tid 100079 td 0xfffff800048cc780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffd92ea0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffd92ec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe00ffd92ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffd92f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffd92f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command clock pid 2 tid 100080 td 0xfffff800048cc000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffd8dea0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffd8dec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe00ffd8def0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffd8df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffd8df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command clock pid 2 tid 100081 td 0xfffff800048d3780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffd9cea0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffd9cec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe00ffd9cef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffd9cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffd9cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command clock pid 2 tid 100082 td 0xfffff800048d3000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffd97ea0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffd97ec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe00ffd97ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffd97f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffd97f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command clock pid 2 tid 100083 td 0xfffff800048d2780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffda6ea0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffda6ec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe00ffda6ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffda6f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffda6f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command clock pid 2 tid 100084 td 0xfffff800048d2000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffda1ea0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffda1ec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe00ffda1ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffda1f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffda1f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command clock pid 2 tid 100085 td 0xfffff800048d1780 fork_trampoline() at fork_trampoline Tracing command clock pid 2 tid 100086 td 0xfffff800048d1000 fork_trampoline() at fork_trampoline Tracing command clock pid 2 tid 100087 td 0xfffff800048d0780 fork_trampoline() at fork_trampoline Tracing command clock pid 2 tid 100088 td 0xfffff800048d0000 fork_trampoline() at fork_trampoline Tracing command clock pid 2 tid 100089 td 0xfffff800048d7780 fork_trampoline() at fork_trampoline Tracing command clock pid 2 tid 100090 td 0xfffff800048d7000 fork_trampoline() at fork_trampoline Tracing command crypto pid 3 tid 100108 td 0xfffff800048de000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffe19dc0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffe19de0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffe19e20 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffe19ec0 crypto_dispatch_thread() at crypto_dispatch_thread+0x193/frame 0xfffffe00ffe19ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffe19f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffe19f30 --- trap 0x1e98316, rip = 0x8b48287551245c38, rsp = 0x10b141ffffed5b05, rbp = 0x244c8b4800000080 --- Tracing command crypto pid 3 tid 100109 td 0xfffff800048dd780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffe28db0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffe28dd0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffe28e10 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffe28eb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe00ffe28ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffe28f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffe28f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100110 td 0xfffff800048dd000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffe23db0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffe23dd0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffe23e10 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffe23eb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe00ffe23ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffe23f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffe23f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100111 td 0xfffff800048dc780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffe32db0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffe32dd0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffe32e10 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffe32eb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe00ffe32ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffe32f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffe32f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100112 td 0xfffff800048dc000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffe2ddb0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffe2ddd0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffe2de10 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffe2deb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe00ffe2def0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffe2df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffe2df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100113 td 0xfffff800048e3780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffe3cdb0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffe3cdd0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffe3ce10 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffe3ceb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe00ffe3cef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffe3cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffe3cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100114 td 0xfffff800048e3000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffe37db0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffe37dd0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffe37e10 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffe37eb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe00ffe37ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffe37f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffe37f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100115 td 0xfffff800048e2780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffe46db0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffe46dd0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffe46e10 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffe46eb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe00ffe46ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffe46f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffe46f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100116 td 0xfffff800048e2000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffe41db0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffe41dd0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffe41e10 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffe41eb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe00ffe41ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffe41f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffe41f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100117 td 0xfffff800048e1780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffe50db0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffe50dd0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffe50e10 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffe50eb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe00ffe50ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffe50f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffe50f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100118 td 0xfffff800048e1000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffe4bdb0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffe4bdd0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffe4be10 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffe4beb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe00ffe4bef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffe4bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffe4bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100119 td 0xfffff800048e0780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffe5adb0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffe5add0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffe5ae10 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffe5aeb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe00ffe5aef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffe5af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffe5af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100120 td 0xfffff800048e0000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffe55db0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffe55dd0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffe55e10 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffe55eb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe00ffe55ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffe55f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffe55f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 4 tid 100121 td 0xfffff800048ea780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffe64da0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffe64dc0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffe64e00 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffe64ea0 xpt_done_td() at xpt_done_td+0xc8/frame 0xfffffe00ffe64ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffe64f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffe64f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 4 tid 100122 td 0xfffff800048ea000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffe5fda0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffe5fdc0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffe5fe00 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffe5fea0 xpt_done_td() at xpt_done_td+0xc8/frame 0xfffffe00ffe5fef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffe5ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffe5ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 4 tid 100123 td 0xfffff800048e9780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffe6eda0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffe6edc0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffe6ee00 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffe6eea0 xpt_done_td() at xpt_done_td+0xc8/frame 0xfffffe00ffe6eef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffe6ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffe6ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 4 tid 100124 td 0xfffff800048e9000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffe69da0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffe69dc0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffe69e00 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffe69ea0 xpt_async_td() at xpt_async_td+0xa1/frame 0xfffffe00ffe69ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffe69f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffe69f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 4 tid 100155 td 0xfffff80009b2a780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00fff0edc0 mi_switch() at mi_switch+0x172/frame 0xfffffe00fff0ede0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00fff0ee20 _sleep() at _sleep+0x2a5/frame 0xfffffe00fff0eec0 xpt_scanner_thread() at xpt_scanner_thread+0xa8/frame 0xfffffe00fff0eef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00fff0ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00fff0ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command busdma pid 5 tid 100126 td 0xfffff800048f5780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffe78da0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffe78dc0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffe78e00 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffe78ea0 busdma_thread() at busdma_thread+0xd9/frame 0xfffffe00ffe78ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffe78f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffe78f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command rand_harvestq pid 6 tid 100152 td 0xfffff80009b2f000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffef5d20 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffef5d40 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffef5d80 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00ffef5dc0 _sleep() at _sleep+0x28c/frame 0xfffffe00ffef5e60 random_kthread() at random_kthread+0xa7/frame 0xfffffe00ffef5ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffef5f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffef5f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon0 pid 7 tid 100156 td 0xfffff80004905780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00fff18da0 mi_switch() at mi_switch+0x172/frame 0xfffffe00fff18dc0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00fff18e00 _sleep() at _sleep+0x2a5/frame 0xfffffe00fff18ea0 enc_daemon() at enc_daemon+0xdd/frame 0xfffffe00fff18ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00fff18f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00fff18f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon1 pid 8 tid 100157 td 0xfffff80004905000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00fff13da0 mi_switch() at mi_switch+0x172/frame 0xfffffe00fff13dc0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00fff13e00 _sleep() at _sleep+0x2a5/frame 0xfffffe00fff13ea0 enc_daemon() at enc_daemon+0xdd/frame 0xfffffe00fff13ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00fff13f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00fff13f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 9 tid 100200 td 0xfffff80009b53000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00fffe59f0 mi_switch() at mi_switch+0x172/frame 0xfffffe00fffe5a10 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00fffe5a50 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00fffe5a90 _sleep() at _sleep+0x28c/frame 0xfffffe00fffe5b30 vm_pageout_worker() at vm_pageout_worker+0x271/frame 0xfffffe00fffe5eb0 vm_pageout() at vm_pageout+0x1d7/frame 0xfffffe00fffe5ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00fffe5f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00fffe5f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 9 tid 100201 td 0xfffff80009b61780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffff4a70 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffff4a90 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffff4ad0 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffff4b70 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0xbde/frame 0xfffffe00ffff4ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffff4f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffff4f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 9 tid 100202 td 0xfffff80009b61000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00fffefd80 mi_switch() at mi_switch+0x172/frame 0xfffffe00fffefda0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00fffefde0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00fffefe20 _sleep() at _sleep+0x28c/frame 0xfffffe00fffefec0 uma_reclaim_worker() at uma_reclaim_worker+0xc8/frame 0xfffffe00fffefef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00fffeff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00fffeff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command audit pid 10 tid 100001 td 0xfffff8000489b780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffc0cdc0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffc0cde0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffc0ce20 _cv_wait() at _cv_wait+0x160/frame 0xfffffe00ffc0ce90 audit_worker() at audit_worker+0x8f/frame 0xfffffe00ffc0cef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffc0cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffc0cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100003 td 0xfffff8000489a780 (CPU 0) cpustop_handler() at cpustop_handler+0x27/frame 0xffffffff81f22080 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xffffffff81f22090 nmi_handle_intr() at nmi_handle_intr+0xf/frame 0xffffffff81f220b0 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81f220b0 --- trap 0x13, rip = 0xffffffff810b989e, rsp = 0xfffffe00ffc16d68, rbp = 0xfffffe00ffc16db0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe00ffc16db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe00ffc16dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00ffc16df0 sched_idletd() at sched_idletd+0x524/frame 0xfffffe00ffc16ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffc16f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffc16f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffff8000489a000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffc11dd0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffc11df0 sched_idletd() at sched_idletd+0x90/frame 0xfffffe00ffc11ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffc11f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffc11f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffff80004899780 (CPU 2) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe0034a55ef0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe0034a55f00 nmi_handle_intr() at nmi_handle_intr+0xf/frame 0xfffffe0034a55f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0034a55f20 --- trap 0x13, rip = 0xffffffff810b989e, rsp = 0xfffffe00ffc20d68, rbp = 0xfffffe00ffc20db0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe00ffc20db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe00ffc20dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00ffc20df0 sched_idletd() at sched_idletd+0x524/frame 0xfffffe00ffc20ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffc20f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffc20f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffff80004899000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffc1bdd0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffc1bdf0 sched_idletd() at sched_idletd+0x90/frame 0xfffffe00ffc1bef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffc1bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffc1bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffff80004898780 (CPU 4) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe0034a73ef0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe0034a73f00 nmi_handle_intr() at nmi_handle_intr+0xf/frame 0xfffffe0034a73f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0034a73f20 --- trap 0x13, rip = 0xffffffff810b989e, rsp = 0xfffffe00ffc2ad68, rbp = 0xfffffe00ffc2adb0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe00ffc2adb0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe00ffc2add0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00ffc2adf0 sched_idletd() at sched_idletd+0x524/frame 0xfffffe00ffc2aef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffc2af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffc2af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffff80004898000 (CPU 5) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe0034a82ef0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe0034a82f00 nmi_handle_intr() at nmi_handle_intr+0xf/frame 0xfffffe0034a82f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0034a82f20 --- trap 0x13, rip = 0xffffffff810b989e, rsp = 0xfffffe00ffc25d68, rbp = 0xfffffe00ffc25db0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe00ffc25db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe00ffc25dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00ffc25df0 sched_idletd() at sched_idletd+0x524/frame 0xfffffe00ffc25ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffc25f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffc25f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffff800048ac780 (CPU 6) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe0034a91ef0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe0034a91f00 nmi_handle_intr() at nmi_handle_intr+0xf/frame 0xfffffe0034a91f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0034a91f20 --- trap 0x13, rip = 0xffffffff810b989e, rsp = 0xfffffe00ffc34d68, rbp = 0xfffffe00ffc34db0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe00ffc34db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe00ffc34dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00ffc34df0 sched_idletd() at sched_idletd+0x524/frame 0xfffffe00ffc34ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffc34f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffc34f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffff800048ac000 (CPU 7) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe0034aa0ef0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe0034aa0f00 nmi_handle_intr() at nmi_handle_intr+0xf/frame 0xfffffe0034aa0f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0034aa0f20 --- trap 0x13, rip = 0xffffffff810b989e, rsp = 0xfffffe00ffc2fd68, rbp = 0xfffffe00ffc2fdb0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe00ffc2fdb0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe00ffc2fdd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00ffc2fdf0 sched_idletd() at sched_idletd+0x524/frame 0xfffffe00ffc2fef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffc2ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffc2ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffff800048ab780 (CPU 8) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe0034aafef0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe0034aaff00 nmi_handle_intr() at nmi_handle_intr+0xf/frame 0xfffffe0034aaff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0034aaff20 --- trap 0x13, rip = 0xffffffff810b989e, rsp = 0xfffffe00ffc3ed68, rbp = 0xfffffe00ffc3edb0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe00ffc3edb0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe00ffc3edd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00ffc3edf0 sched_idletd() at sched_idletd+0x524/frame 0xfffffe00ffc3eef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffc3ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffc3ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffff800048ab000 (CPU 9) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe0034abeef0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe0034abef00 nmi_handle_intr() at nmi_handle_intr+0xf/frame 0xfffffe0034abef20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0034abef20 --- trap 0x13, rip = 0xffffffff810b989e, rsp = 0xfffffe00ffc39d68, rbp = 0xfffffe00ffc39db0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe00ffc39db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe00ffc39dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00ffc39df0 sched_idletd() at sched_idletd+0x524/frame 0xfffffe00ffc39ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffc39f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffc39f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffff800048aa780 (CPU 10) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe0034acdef0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe0034acdf00 nmi_handle_intr() at nmi_handle_intr+0xf/frame 0xfffffe0034acdf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0034acdf20 --- trap 0x13, rip = 0xffffffff810b989e, rsp = 0xfffffe00ffc48d68, rbp = 0xfffffe00ffc48db0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe00ffc48db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe00ffc48dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00ffc48df0 sched_idletd() at sched_idletd+0x524/frame 0xfffffe00ffc48ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffc48f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffc48f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffff800048aa000 (CPU 11) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe0034adcef0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe0034adcf00 nmi_handle_intr() at nmi_handle_intr+0xf/frame 0xfffffe0034adcf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0034adcf20 --- trap 0x13, rip = 0xffffffff810b989e, rsp = 0xfffffe00ffc43d68, rbp = 0xfffffe00ffc43db0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe00ffc43db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe00ffc43dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00ffc43df0 sched_idletd() at sched_idletd+0x524/frame 0xfffffe00ffc43ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffc43f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffc43f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100043 td 0xfffff800048bb780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffcdee40 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffcdee60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00ffcdeef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffcdef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffcdef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100044 td 0xfffff800048bb000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100046 td 0xfffff800048ba000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100091 td 0xfffff800048d6780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffdcee40 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffdcee60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00ffdceef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffdcef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffdcef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100125 td 0xfffff800048cd000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffd83e40 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffd83e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00ffd83ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffd83f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffd83f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100127 td 0xfffff800048f5000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffe73e40 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffe73e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00ffe73ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffe73f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffe73f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100133 td 0xfffff800048ef000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffe91e40 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffe91e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00ffe91ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffe91f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffe91f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100146 td 0xfffff80004918000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100147 td 0xfffff80004914780 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100148 td 0xfffff80004914000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffee1e40 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffee1e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00ffee1ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffee1f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffee1f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100163 td 0xfffff80009b39780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00fff36e40 mi_switch() at mi_switch+0x172/frame 0xfffffe00fff36e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00fff36ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00fff36f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00fff36f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100164 td 0xfffff80009b39000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00fff31e40 mi_switch() at mi_switch+0x172/frame 0xfffffe00fff31e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00fff31ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00fff31f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00fff31f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100165 td 0xfffff80009b38780 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100166 td 0xfffff80009b38000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100167 td 0xfffff80009b3f780 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100168 td 0xfffff80009b3f000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100169 td 0xfffff80009b3e780 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100170 td 0xfffff80009b3e000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100171 td 0xfffff80009b3d780 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100172 td 0xfffff80009b3d000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100173 td 0xfffff80009b3c780 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100174 td 0xfffff80009b3c000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100175 td 0xfffff80009b43780 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100176 td 0xfffff80009b43000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100177 td 0xfffff80009b42780 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100184 td 0xfffff80009b4b000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00fff95e40 mi_switch() at mi_switch+0x172/frame 0xfffffe00fff95e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00fff95ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00fff95f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00fff95f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100185 td 0xfffff80009b52780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00fffa4e40 mi_switch() at mi_switch+0x172/frame 0xfffffe00fffa4e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00fffa4ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00fffa4f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00fffa4f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100186 td 0xfffff80009b52000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100187 td 0xfffff80009b51780 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100188 td 0xfffff80009b51000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100189 td 0xfffff80009b50780 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100190 td 0xfffff80009b50000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100191 td 0xfffff80009b4c780 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100192 td 0xfffff80009b4c000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100193 td 0xfffff80009b56780 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100194 td 0xfffff80009b56000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100195 td 0xfffff80009b55780 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100196 td 0xfffff80009b55000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100197 td 0xfffff80009b54780 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100198 td 0xfffff80009b54000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100242 td 0xfffff8000cf01000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100243 td 0xfffff8000cf00780 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100244 td 0xfffff8000cf00000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100245 td 0xfffff8000cefc780 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100246 td 0xfffff8000cefc000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100247 td 0xfffff8000cf65780 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100248 td 0xfffff8000cf65000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100249 td 0xfffff8000cf64780 fork_trampoline() at fork_trampoline Tracing command geom pid 13 tid 100093 td 0xfffff800048d5780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffdd8dc0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffdd8de0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffdd8e20 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffdd8ec0 g_run_events() at g_run_events+0x434/frame 0xfffffe00ffdd8ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffdd8f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffdd8f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100094 td 0xfffff800048d5000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffdd3db0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffdd3dd0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffdd3e10 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffdd3eb0 g_io_schedule_up() at g_io_schedule_up+0x3c/frame 0xfffffe00ffdd3ee0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe00ffdd3ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffdd3f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffdd3f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100095 td 0xfffff800048d4780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffde2db0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffde2dd0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffde2e10 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffde2eb0 g_io_schedule_down() at g_io_schedule_down+0x3c/frame 0xfffffe00ffde2ee0 g_down_procbody() at g_down_procbody+0x5c/frame 0xfffffe00ffde2ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffde2f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffde2f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100128 td 0xfffff800048f4780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffe82df0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffe82e10 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffe82e50 _cv_wait() at _cv_wait+0x160/frame 0xfffffe00ffe82ec0 usb_process() at usb_process+0xb0/frame 0xfffffe00ffe82ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffe82f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffe82f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100129 td 0xfffff800048f4000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffe7ddf0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffe7de10 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffe7de50 _cv_wait() at _cv_wait+0x160/frame 0xfffffe00ffe7dec0 usb_process() at usb_process+0xb0/frame 0xfffffe00ffe7def0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffe7df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffe7df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100130 td 0xfffff800048f3780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffe8cdf0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffe8ce10 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffe8ce50 _cv_wait() at _cv_wait+0x160/frame 0xfffffe00ffe8cec0 usb_process() at usb_process+0xb0/frame 0xfffffe00ffe8cef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffe8cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffe8cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100131 td 0xfffff800048f3000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffe87df0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffe87e10 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffe87e50 _cv_wait() at _cv_wait+0x160/frame 0xfffffe00ffe87ec0 usb_process() at usb_process+0xb0/frame 0xfffffe00ffe87ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffe87f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffe87f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100132 td 0xfffff800048ef780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffe96df0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffe96e10 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffe96e50 _cv_wait() at _cv_wait+0x160/frame 0xfffffe00ffe96ec0 usb_process() at usb_process+0xb0/frame 0xfffffe00ffe96ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffe96f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffe96f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100134 td 0xfffff80004908780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffea0df0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffea0e10 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffea0e50 _cv_wait() at _cv_wait+0x160/frame 0xfffffe00ffea0ec0 usb_process() at usb_process+0xb0/frame 0xfffffe00ffea0ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffea0f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffea0f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100135 td 0xfffff80004908000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffe9bdf0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffe9be10 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffe9be50 _cv_wait() at _cv_wait+0x160/frame 0xfffffe00ffe9bec0 usb_process() at usb_process+0xb0/frame 0xfffffe00ffe9bef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffe9bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffe9bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100136 td 0xfffff80004907780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffeaadf0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffeaae10 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffeaae50 _cv_wait() at _cv_wait+0x160/frame 0xfffffe00ffeaaec0 usb_process() at usb_process+0xb0/frame 0xfffffe00ffeaaef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffeaaf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffeaaf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100137 td 0xfffff80004907000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffea5df0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffea5e10 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffea5e50 _cv_wait() at _cv_wait+0x160/frame 0xfffffe00ffea5ec0 usb_process() at usb_process+0xb0/frame 0xfffffe00ffea5ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffea5f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffea5f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100138 td 0xfffff80004906780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffeb4df0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffeb4e10 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffeb4e50 _cv_wait() at _cv_wait+0x160/frame 0xfffffe00ffeb4ec0 usb_process() at usb_process+0xb0/frame 0xfffffe00ffeb4ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffeb4f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffeb4f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100141 td 0xfffff8000491a780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffec8df0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffec8e10 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffec8e50 _cv_wait() at _cv_wait+0x160/frame 0xfffffe00ffec8ec0 usb_process() at usb_process+0xb0/frame 0xfffffe00ffec8ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffec8f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffec8f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100142 td 0xfffff8000491a000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffec3df0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffec3e10 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffec3e50 _cv_wait() at _cv_wait+0x160/frame 0xfffffe00ffec3ec0 usb_process() at usb_process+0xb0/frame 0xfffffe00ffec3ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffec3f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffec3f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100143 td 0xfffff80004919780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffed2df0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffed2e10 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffed2e50 _cv_wait() at _cv_wait+0x160/frame 0xfffffe00ffed2ec0 usb_process() at usb_process+0xb0/frame 0xfffffe00ffed2ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffed2f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffed2f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100144 td 0xfffff80004919000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffecddf0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffecde10 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffecde50 _cv_wait() at _cv_wait+0x160/frame 0xfffffe00ffecdec0 usb_process() at usb_process+0xb0/frame 0xfffffe00ffecdef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffecdf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffecdf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100145 td 0xfffff80004918780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffedcdf0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffedce10 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffedce50 _cv_wait() at _cv_wait+0x160/frame 0xfffffe00ffedcec0 usb_process() at usb_process+0xb0/frame 0xfffffe00ffedcef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffedcf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffedcf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vmdaemon pid 15 tid 100203 td 0xfffff80009b65780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffffed80 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffffeda0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffffede0 _sleep() at _sleep+0x2a5/frame 0xfffffe00ffffee80 vm_daemon() at vm_daemon+0x82/frame 0xfffffe00ffffeef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffffef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffffef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 16 tid 100204 td 0xfffff80009b65000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffff9d60 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffff9d80 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffff9dc0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00ffff9e00 _sleep() at _sleep+0x28c/frame 0xfffffe00ffff9ea0 buf_daemon() at buf_daemon+0x151/frame 0xfffffe00ffff9ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffff9f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffff9f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 16 tid 100205 td 0xfffff80004913000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe00ffeb9d40 mi_switch() at mi_switch+0x172/frame 0xfffffe00ffeb9d60 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe00ffeb9da0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00ffeb9de0 _sleep() at _sleep+0x28c/frame 0xfffffe00ffeb9e80 bufspace_daemon() at bufspace_daemon+0x336/frame 0xfffffe00ffeb9ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00ffeb9f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ffeb9f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 16 tid 100206 td 0xfffff80004912780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe0100008d40 mi_switch() at mi_switch+0x172/frame 0xfffffe0100008d60 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe0100008da0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0100008de0 _sleep() at _sleep+0x28c/frame 0xfffffe0100008e80 bufspace_daemon() at bufspace_daemon+0x336/frame 0xfffffe0100008ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0100008f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0100008f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 16 tid 100207 td 0xfffff80004912000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe0100003d40 mi_switch() at mi_switch+0x172/frame 0xfffffe0100003d60 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe0100003da0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0100003de0 _sleep() at _sleep+0x28c/frame 0xfffffe0100003e80 bufspace_daemon() at bufspace_daemon+0x336/frame 0xfffffe0100003ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0100003f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0100003f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 16 tid 100208 td 0xfffff80004911780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe0100012d40 mi_switch() at mi_switch+0x172/frame 0xfffffe0100012d60 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe0100012da0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0100012de0 _sleep() at _sleep+0x28c/frame 0xfffffe0100012e80 bufspace_daemon() at bufspace_daemon+0x336/frame 0xfffffe0100012ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0100012f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0100012f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 16 tid 100209 td 0xfffff80004911000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe010000dd40 mi_switch() at mi_switch+0x172/frame 0xfffffe010000dd60 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe010000dda0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010000dde0 _sleep() at _sleep+0x28c/frame 0xfffffe010000de80 bufspace_daemon() at bufspace_daemon+0x336/frame 0xfffffe010000def0 fork_exit() at fork_exit+0x82/frame 0xfffffe010000df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010000df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 16 tid 100210 td 0xfffff8000490d780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe010001cd40 mi_switch() at mi_switch+0x172/frame 0xfffffe010001cd60 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe010001cda0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010001cde0 _sleep() at _sleep+0x28c/frame 0xfffffe010001ce80 bufspace_daemon() at bufspace_daemon+0x336/frame 0xfffffe010001cef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010001cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010001cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 16 tid 100211 td 0xfffff8000490d000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe0100017d40 mi_switch() at mi_switch+0x172/frame 0xfffffe0100017d60 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe0100017da0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0100017de0 _sleep() at _sleep+0x28c/frame 0xfffffe0100017e80 bufspace_daemon() at bufspace_daemon+0x336/frame 0xfffffe0100017ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0100017f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0100017f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 16 tid 100236 td 0xfffff80009b60000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe0100067d70 mi_switch() at mi_switch+0x172/frame 0xfffffe0100067d90 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe0100067dd0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0100067e10 _sleep() at _sleep+0x28c/frame 0xfffffe0100067eb0 softdep_flush() at softdep_flush+0x188/frame 0xfffffe0100067ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0100067f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0100067f30 --- trap 0xaa33017, rip = 0x13c10a952a70, rsp = 0x13c10a952a40, rbp = 0 --- Tracing command bufdaemon pid 16 tid 100250 td 0xfffff80009b63780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe01000e4d70 mi_switch() at mi_switch+0x172/frame 0xfffffe01000e4d90 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe01000e4dd0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe01000e4e10 _sleep() at _sleep+0x28c/frame 0xfffffe01000e4eb0 softdep_flush() at softdep_flush+0x188/frame 0xfffffe01000e4ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01000e4f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01000e4f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vnlru pid 17 tid 100212 td 0xfffff80009b64780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe0100026d10 mi_switch() at mi_switch+0x172/frame 0xfffffe0100026d30 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe0100026d70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0100026db0 _sleep() at _sleep+0x28c/frame 0xfffffe0100026e50 vnlru_proc() at vnlru_proc+0x274/frame 0xfffffe0100026ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0100026f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0100026f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command syncer pid 18 tid 100213 td 0xfffff80009b64000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe0100021d30 mi_switch() at mi_switch+0x172/frame 0xfffffe0100021d50 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe0100021d90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0100021dd0 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x187/frame 0xfffffe0100021e60 sched_sync() at sched_sync+0x61e/frame 0xfffffe0100021ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0100021f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0100021f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sshd-session pid 75554 tid 112757 td 0xfffff804d1455000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe0178b16970 mi_switch() at mi_switch+0x172/frame 0xfffffe0178b16990 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe0178b169d0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0178b16a10 _sleep() at _sleep+0x28c/frame 0xfffffe0178b16ab0 swap_pager_getpages_locked() at swap_pager_getpages_locked+0x44f/frame 0xfffffe0178b16b20 swap_pager_getpages() at swap_pager_getpages+0x7c/frame 0xfffffe0178b16b90 vm_pager_get_pages() at vm_pager_get_pages+0x59/frame 0xfffffe0178b16be0 vm_fault() at vm_fault+0x82b/frame 0xfffffe0178b16d60 vm_fault_trap() at vm_fault_trap+0x65/frame 0xfffffe0178b16da0 trap_pfault() at trap_pfault+0x26a/frame 0xfffffe0178b16e10 trap() at trap+0x5c5/frame 0xfffffe0178b16f30 calltrap() at calltrap+0x8/frame 0xfffffe0178b16f30 --- trap 0xc, rip = 0x346fc8862dc5, rsp = 0x346fc33cc008, rbp = 0x346fc33cc060 --- Tracing command syslogd pid 3419 tid 100269 td 0xfffff8000cef9780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe0100134970 mi_switch() at mi_switch+0x172/frame 0xfffffe0100134990 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe01001349d0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0100134a10 _sleep() at _sleep+0x28c/frame 0xfffffe0100134ab0 swap_pager_getpages_locked() at swap_pager_getpages_locked+0x44f/frame 0xfffffe0100134b20 swap_pager_getpages() at swap_pager_getpages+0x7c/frame 0xfffffe0100134b90 vm_pager_get_pages() at vm_pager_get_pages+0x59/frame 0xfffffe0100134be0 vm_fault() at vm_fault+0x82b/frame 0xfffffe0100134d60 vm_fault_trap() at vm_fault_trap+0x65/frame 0xfffffe0100134da0 trap_pfault() at trap_pfault+0x26a/frame 0xfffffe0100134e10 trap() at trap+0x5c5/frame 0xfffffe0100134f30 calltrap() at calltrap+0x8/frame 0xfffffe0100134f30 --- trap 0xc, rip = 0x8e5be900d30, rsp = 0x8eddef91a20, rbp = 0x8eddef91a30 --- Tracing command syslogd pid 3422 tid 100265 td 0xfffff8000cf5e000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe01000fdaa0 mi_switch() at mi_switch+0x172/frame 0xfffffe01000fdac0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe01000fdb00 sleepq_catch_signals() at sleepq_catch_signals+0x276/frame 0xfffffe01000fdb50 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe01000fdb60 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe01000fdbd0 kern_select() at kern_select+0xb99/frame 0xfffffe01000fddc0 sys_select() at sys_select+0x57/frame 0xfffffe01000fde00 amd64_syscall() at amd64_syscall+0x169/frame 0xfffffe01000fdf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01000fdf30 --- syscall (93, FreeBSD ELF64, select), rip = 0x8ede2df409a, rsp = 0x8eddef8fcc8, rbp = 0x8eddef8fd80 --- Tracing command syslogd pid 3423 tid 100268 td 0xfffff8000cf9b000 sched_switch() at sched_switch+0x5e2/frame 0xfffffe010011baa0 mi_switch() at mi_switch+0x172/frame 0xfffffe010011bac0 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe010011bb00 sleepq_catch_signals() at sleepq_catch_signals+0x276/frame 0xfffffe010011bb50 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe010011bb60 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe010011bbd0 kern_select() at kern_select+0xb99/frame 0xfffffe010011bdc0 sys_select() at sys_select+0x57/frame 0xfffffe010011be00 amd64_syscall() at amd64_syscall+0x169/frame 0xfffffe010011bf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010011bf30 --- syscall (93, FreeBSD ELF64, select), rip = 0x8ede2df409a, rsp = 0x8eddef8fcc8, rbp = 0x8eddef8fd80 --- Tracing command sshd-session pid 3623 tid 100345 td 0xfffff8000cfe7000 cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe0034a46ef0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe0034a46f00 nmi_handle_intr() at nmi_handle_intr+0xf/frame 0xfffffe0034a46f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0034a46f20 --- trap 0x13, rip = 0xffffffff80bd0fed, rsp = 0xfffffe01001ed7e0, rbp = 0xfffffe01001ed820 --- cpu_search_highest() at cpu_search_highest+0x11d/frame 0xfffffe01001ed820 cpu_search_highest() at cpu_search_highest+0x86/frame 0xfffffe01001ed870 sched_switch() at sched_switch+0x73d/frame 0xfffffe01001ed970 mi_switch() at mi_switch+0x172/frame 0xfffffe01001ed990 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe01001ed9d0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe01001eda10 _sleep() at _sleep+0x28c/frame 0xfffffe01001edab0 swap_pager_getpages_locked() at swap_pager_getpages_locked+0x44f/frame 0xfffffe01001edb20 swap_pager_getpages() at swap_pager_getpages+0x7c/frame 0xfffffe01001edb90 vm_pager_get_pages() at vm_pager_get_pages+0x59/frame 0xfffffe01001edbe0 vm_fault() at vm_fault+0x82b/frame 0xfffffe01001edd60 vm_fault_trap() at vm_fault_trap+0x65/frame 0xfffffe01001edda0 trap_pfault() at trap_pfault+0x26a/frame 0xfffffe01001ede10 trap() at trap+0x5c5/frame 0xfffffe01001edf30 calltrap() at calltrap+0x8/frame 0xfffffe01001edf30 --- trap 0xc, rip = 0x25ace4f87ee0, rsp = 0x25ace1281068, rbp = 0x25ace1281090 --- Tracing command sh pid 3651 tid 100350 td 0xfffff80009b62780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe0100201a20 mi_switch() at mi_switch+0x172/frame 0xfffffe0100201a40 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe0100201a80 sleepq_catch_signals() at sleepq_catch_signals+0x276/frame 0xfffffe0100201ad0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0100201ae0 _sleep() at _sleep+0x29b/frame 0xfffffe0100201b80 kern_wait6() at kern_wait6+0x49e/frame 0xfffffe0100201c10 sys_wait4() at sys_wait4+0x6b/frame 0xfffffe0100201e00 amd64_syscall() at amd64_syscall+0x169/frame 0xfffffe0100201f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0100201f30 --- syscall (7, FreeBSD ELF64, wait4), rip = 0x20716dd2e1fa, rsp = 0x20716ac23968, rbp = 0x20716ac23a20 --- Tracing command bash pid 3652 tid 100303 td 0xfffff8000cee2780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe0100198840 mi_switch() at mi_switch+0x172/frame 0xfffffe0100198860 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe01001988a0 _sleep() at _sleep+0x2a5/frame 0xfffffe0100198940 bufwait() at bufwait+0x84/frame 0xfffffe0100198980 breadn_flags() at breadn_flags+0x1cd/frame 0xfffffe01001989f0 ffs_breadz() at ffs_breadz+0x5c/frame 0xfffffe0100198a70 ffs_update() at ffs_update+0x1b4/frame 0xfffffe0100198af0 ufs_inactive() at ufs_inactive+0x261/frame 0xfffffe0100198b30 VOP_INACTIVE_APV() at VOP_INACTIVE_APV+0x51/frame 0xfffffe0100198b60 vinactivef() at vinactivef+0xc3/frame 0xfffffe0100198ba0 vinactive() at vinactive+0x8c/frame 0xfffffe0100198bd0 vput_final() at vput_final+0x29c/frame 0xfffffe0100198c20 vn_close1() at vn_close1+0x12c/frame 0xfffffe0100198c90 vn_closefile() at vn_closefile+0x3d/frame 0xfffffe0100198d10 _fdrop() at _fdrop+0x1a/frame 0xfffffe0100198d30 closef() at closef+0x1e3/frame 0xfffffe0100198dc0 closefp_impl() at closefp_impl+0x83/frame 0xfffffe0100198e00 amd64_syscall() at amd64_syscall+0x169/frame 0xfffffe0100198f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0100198f30 --- syscall (6, FreeBSD ELF64, close), rip = 0x824dc3e1a, rsp = 0x8203ab1a8, rbp = 0x8203ab1c0 --- Tracing command sh pid 78280 tid 135822 td 0xfffff8000cfe8780 sched_switch() at sched_switch+0x5e2/frame 0xfffffe010014d950 mi_switch() at mi_switch+0x172/frame 0xfffffe010014d970 sleepq_switch() at sleepq_switch+0x109/frame 0xfffffe010014d9b0 sleepq_catch_signals() at sleepq_catch_signals+0x276/frame 0xfffffe010014da00 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe010014da40 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x187/frame 0xfffffe010014dad0 tty_drain() at tty_drain+0x1a4/frame 0xfffffe010014db30 tty_ioctl() at tty_ioctl+0x22e/frame 0xfffffe010014db70 ttydev_ioctl() at ttydev_ioctl+0x21c/frame 0xfffffe010014dbc0 devfs_ioctl() at devfs_ioctl+0xd1/frame 0xfffffe010014dc10 VOP_IOCTL_APV() at VOP_IOCTL_APV+0x51/frame 0xfffffe010014dc40 vn_ioctl() at vn_ioctl+0x160/frame 0xfffffe010014dcb0 devfs_ioctl_f() at devfs_ioctl_f+0x1e/frame 0xfffffe010014dcd0 kern_ioctl() at kern_ioctl+0x2a1/frame 0xfffffe010014dd40 sys_ioctl() at sys_ioctl+0x12f/frame 0xfffffe010014de00 amd64_syscall() at amd64_syscall+0x169/frame 0xfffffe010014df30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010014df30 --- syscall (54, FreeBSD ELF64, ioctl), rip = 0x30624545a03a, rsp = 0x306241369688, rbp = 0x3062413696d0 --- db> reset Uptime: 3h18m31s (kgdb) bt #0 __curthread () at /var/tmp/deviant3/sys/amd64/include/pcpu_aux.h:57 #1 doadump (textdump=textdump@entry=0x0) at ../../../kern/kern_shutdown.c:399 #2 0xffffffff804ad4fa in db_dump (dummy=, dummy2=, dummy3=, dummy4=) at ../../../ddb/db_command.c:596 #3 0xffffffff804ad2ed in db_command (last_cmdp=, cmd_table=, dopager=0x0) at ../../../ddb/db_command.c:508 #4 0xffffffff804ad436 in db_command_script (command=command@entry=0xffffffff81bd5790 "dump") at ../../../ddb/db_command.c:573 #5 0xffffffff804b3218 in db_script_exec (scriptname=, warnifnotfound=) at ../../../ddb/db_script.c:301 #6 0xffffffff804ad2ed in db_command (last_cmdp=, cmd_table=, dopager=0x0) at ../../../ddb/db_command.c:508 #7 0xffffffff804ad436 in db_command_script (command=command@entry=0xffffffff81bd5722 "run pho1") at ../../../ddb/db_command.c:573 #8 0xffffffff804b3218 in db_script_exec (scriptname=, warnifnotfound=) at ../../../ddb/db_script.c:301 #9 0xffffffff804ad2ed in db_command (last_cmdp=, cmd_table=, dopager=0x1) at ../../../ddb/db_command.c:508 #10 0xffffffff804acfad in db_command_loop () at ../../../ddb/db_command.c:555 #11 0xffffffff804b09a6 in db_trap (type=, code=) at ../../../ddb/db_main.c:267 #12 0xffffffff80bea90f in kdb_trap (type=type@entry=0x3, code=code@entry=0x0, tf=tf@entry=0xfffffe00ffc07830) at ../../../kern/subr_kdb.c:790 #13 0xffffffff8110061e in trap (frame=) at ../../../amd64/amd64/trap.c:614 #14 #15 kdb_enter (why=, msg=) at ../../../kern/subr_kdb.c:556 #16 0xffffffff80b9ac9b in vpanic (fmt=0xffffffff8126228d "%s: ref %ld not > 0 on cred %p", ap=ap@entry=0xfffffe00ffc07a60) at ../../../kern/kern_shutdown.c:962 #17 0xffffffff80b9ab03 in panic (fmt=0xffffffff81da0a10 "\260\204\036\201\377\377\377\377") at ../../../kern/kern_shutdown.c:887 #18 0xffffffff80b86875 in crunuse (td=0xfffff8000cefa780) at ../../../kern/kern_prot.c:2481 #19 0xffffffff80b86769 in crcowfree (td=0xffffffff81da0a10 , td@entry=0xfffff8000cefa780) at ../../../kern/kern_prot.c:2523 #20 0xffffffff80bb30bc in thread_cow_free (td=0xfffff8000cefa780) at ../../../kern/kern_thread.c:887 #21 thread_wait (p=p@entry=0xfffffe015c25c008) at ../../../kern/kern_thread.c:1064 #22 0xffffffff80b46218 in proc_reap (td=td@entry=0xfffff8000489b000, p=p@entry=0xfffffe015c25c008, status=status@entry=0xfffffe00ffc07de4, options=) at ../../../kern/kern_exit.c:1028 #23 0xffffffff80b4667e in proc_to_reap (td=td@entry=0xfffff8000489b000, p=p@entry=0xfffffe015c25c008, idtype=idtype@entry=P_ALL, id=id@entry=0x0, status=status@entry=0xfffffe00ffc07de4, options=options@entry=0x30, wrusage=0x0, siginfo=0x0, check_only=0x0) at ../../../kern/kern_exit.c:1192 #24 0xffffffff80b4586b in kern_wait6 (td=td@entry=0xfffff8000489b000, idtype=P_ALL, id=0x0, status=status@entry=0xfffffe00ffc07de4, options=0x30, wrusage=0x0, siginfo=0x0) at ../../../kern/kern_exit.c:1321 #25 0xffffffff80b4548b in kern_wait (status=0xfffffe00ffc07de4, options=0x12, td=, pid=, rusage=) at ../../../kern/kern_exit.c:1233 #26 sys_wait4 (td=0xfffff8000489b000, uap=0xfffff8000489b428) at ../../../kern/kern_exit.c:863 #27 0xffffffff81101ab9 in syscallenter (td=0xfffff8000489b000) at ../../../amd64/amd64/../../kern/subr_syscall.c:193 #28 amd64_syscall (td=0xfffff8000489b000, traced=0x0) at ../../../amd64/amd64/trap.c:1208 #29 #30 0x00000000002d762a in ?? () Backtrace stopped: Cannot access memory at address 0x8208121f8 (kgdb) f 18 #18 0xffffffff80b86875 in crunuse (td=0xfffff8000cefa780) at ../../../kern/kern_prot.c:2481 2481 KASSERT(cr->cr_ref > 0, ("%s: ref %ld not > 0 on cred %p", (kgdb) l 2476 td->td_ucredref = 0; 2477 KASSERT(cr->cr_users > 0, ("%s: users %d not > 0 on cred %p", 2478 __func__, cr->cr_users, cr)); 2479 cr->cr_users--; 2480 if (cr->cr_users == 0) { 2481 KASSERT(cr->cr_ref > 0, ("%s: ref %ld not > 0 on cred %p", 2482 __func__, cr->cr_ref, cr)); 2483 crold = cr; 2484 } else { 2485 cr->cr_ref--; (kgdb) info loc cr = 0xfffff80003631c00 crold = (kgdb) p *td $2 = {td_lock = 0xfffffe0034a84400, td_proc = 0xfffffe015c25c008, td_plist = {tqe_next = 0x0, tqe_prev = 0xfffffe015c25c018}, td_runq = { tqe_next = 0xffffffffffffffff, tqe_prev = 0xffffffffffffffff}, {td_slpq = {tqe_next = 0xffffffffffffffff, tqe_prev = 0xffffffffffffffff}, td_zombie = 0xffffffffffffffff}, td_lockq = {tqe_next = 0x0, tqe_prev = 0x0}, td_hash = { le_next = 0xffffffffffffffff, le_prev = 0xffffffffffffffff}, td_cpuset = 0x0, td_domain = { dr_policy = 0xffffffff81a00120 , dr_iter = 0x36}, td_sel = 0x0, td_sleepqueue = 0xfffff8001f192200, td_turnstile = 0xfffff8000cef8240, td_pad1 = 0x0, td_umtxq = 0xfffff8000507ac00, td_tid = 0x18784, td_sigqueue = {sq_signals = {__bits = { 0x0, 0x0, 0x0, 0x0}}, sq_kill = {__bits = {0x0, 0x0, 0x0, 0x0}}, sq_ptrace = {__bits = {0x0, 0x0, 0x0, 0x0}}, sq_list = { tqh_first = 0x0, tqh_last = 0xfffff8000cefa858}, sq_proc = 0xfffffe015c25c008, sq_flags = 0x1}, td_lend_user_pri = 0xff, td_allocdomain = 0x0, td_base_ithread_pri = 0x0, td_kmsan = 0x0, td_flags = 0x4, td_ast = 0x8000, td_inhibitors = 0x0, td_pflags = 0x100, td_pflags2 = 0x20, td_dupfd = 0x0, td_sqqueue = 0x0, td_wchan = 0x0, td_wmesg = 0x0, td_owepreempt = 0x0, td_tsqueue = 0x0, _td_pad0 = "\000", td_locks = 0x0, td_rw_rlocks = 0x0, td_sx_slocks = 0x0, td_lk_slocks = 0x0, td_wantedlock = 0x0, td_blocked = 0x0, td_lockname = 0x0, td_contested = {lh_first = 0x0}, td_sleeplocks = 0xffffffff81e61738 , td_intr_nesting_level = 0x0, td_pinned = 0x0, td_realucred = 0xfffff80003631c00, td_ucred = 0xfffff80003631c00, td_limit = 0xfffff800033ac300, td_slptick = 0x0, td_blktick = 0x0, td_swvoltick = 0x80ac9548, td_swinvoltick = 0x0, td_cow = 0xc2, td_ru = {ru_utime = {tv_sec = 0x0, tv_usec = 0x0}, ru_stime = {tv_sec = 0x0, tv_usec = 0x0}, ru_maxrss = 0x2d74, ru_ixrss = 0x17c, ru_idrss = 0x18, ru_isrss = 0x100, ru_minflt = 0x1fa, ru_majflt = 0x2d, ru_nswap = 0x0, ru_inblock = 0x13, ru_oublock = 0x0, ru_msgsnd = 0x0, ru_msgrcv = 0x0, ru_nsignals = 0x0, ru_nvcsw = 0x41, ru_nivcsw = 0x0}, td_rux = {rux_runtime = 0x31ab57f, rux_uticks = 0x0, rux_sticks = 0x2, rux_iticks = 0x0, rux_uu = 0x0, rux_su = 0x0, rux_tu = 0x0}, td_incruntime = 0x0, td_runtime = 0x31ab57f, td_pticks = 0x0, td_sticks = 0x0, td_iticks = 0x0, td_uticks = 0x0, td_intrval = 0xffffffff, td_oldsigmask = { __bits = {0x0, 0x0, 0x0, 0x0}}, td_generation = 0x40, td_sigstk = {ss_sp = 0x0, ss_size = 0x0, ss_flags = 0x4}, td_xsig = 0x0, td_profil_addr = 0x0, td_profil_ticks = 0x0, td_name = "sh", '\000' , td_fpop = 0x0, td_dbgflags = 0x8000, td_si = { si_signo = 0x1, si_errno = 0x0, si_code = 0x10006, si_pid = 0x0, si_uid = 0x0, si_status = 0x0, si_addr = 0x0, si_value = { sival_int = 0x0, sival_ptr = 0x0, sigval_int = 0x0, sigval_ptr = 0x0}, _reason = {_fault = {_trapno = 0x0}, _timer = {_timerid = 0x0, _overrun = 0x0}, _mesgq = {_mqd = 0x0}, _poll = {_band = 0x0}, _capsicum = {_syscall = 0x0}, __spare__ = {__spare1__ = 0x0, __spare2__ = {0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0}}}}, td_ng_outbound = 0x0, td_osd = {osd_nslots = 0x0, osd_slots = 0x0, osd_next = { le_next = 0x0, le_prev = 0x0}}, td_map_def_user = 0x0, td_dbg_forked = 0x0, td_no_sleeping = 0x0, td_vp_reserved = 0x0, td_su = 0x0, td_sleeptimo = 0x0, td_rtcgen = 0x0, td_errno = 0x6, td_vslock_sz = 0x0, td_kcov_info = 0x0, td_ucredref = 0x0, td_kexterr = { error = 0x0, msg = 0x0, p1 = 0x0, p2 = 0x0, cat = 0x0, src_line = 0x0}, td_sigmask = {__bits = {0x0, 0x0, 0x0, 0x0}}, td_rqindex = 0x38, td_base_pri = 0x38, td_priority = 0x38, td_pri_class = 0x3, td_user_pri = 0x38, td_base_user_pri = 0x38, td_rb_list = 0x0, td_rbp_list = 0x0, td_rb_inact = 0x0, td_sa = {code = 0x36, original_code = 0x36, callp = 0xffffffff81abead0 , args = {0x0, 0x802c7415, 0x2d9c9ea28764, 0x1, 0x0, 0x0, 0x0, 0x0}}, td_sigblock_ptr = 0x43d2081504a0, td_sigblock_val = 0x0, td_exterr_ptr = 0x88426c3b280, td_pcb = 0xfffff8000cefacd0, td_state = TDS_INACTIVE, td_uretoff = {tdu_retval = {0x0, 0x2d9c9ea28764}, tdu_off = 0x0}, td_cowgen = 0x4, td_slpcallout = {c_links = { le = {le_next = 0xffffffffffffffff, le_prev = 0xffffffffffffffff}, sle = {sle_next = 0xffffffffffffffff}, tqe = { tqe_next = 0xffffffffffffffff, tqe_prev = 0xffffffffffffffff}}, c_time = 0x2e8782364e7d, c_precision = 0x1999997, c_arg = 0xfffff8000cefa780, c_func = 0xffffffff80bfd360 , c_lock = 0x0, c_flags = 0x0, c_iflags = 0x110, c_cpu = 0x3}, td_frame = 0xfffffe0100058f40, td_kstack = 0xfffffe0100055000, td_kstack_pages = 0x4, td_kstack_domain = 0x0, td_critnest = 0x1, td_md = { md_spinlock_count = 0x1, md_saved_flags = 0x246, md_spurflt_addr = 0x0, md_invl_gen = {gen = 0x37e6c16, {link = {le_next = 0x1, le_prev = 0x38}, {next = 0x1, saved_pri = 0x38}}}, md_efirt_tmp = 0x0, md_efirt_dis_pf = 0x0, md_pcb = { pcb_r15 = 0xfffff8000cefa930, pcb_r14 = 0xfffffe015c25c240, pcb_r13 = 0xfffff8000cefa780, pcb_r12 = 0xfffffe015c25c168, pcb_rbp = 0xfffffe0100058c40, pcb_rsp = 0xfffffe0100058c18, pcb_rbx = 0xfffff8000cefa780, pcb_rip = 0xffffffff80bb2db5, pcb_fsbase = 0x2d9c9e613330, pcb_gsbase = 0x0, pcb_kgsbase = 0x0, pcb_cr0 = 0x0, pcb_cr2 = 0x0, pcb_cr3 = 0x0, pcb_cr4 = 0x0, pcb_dr0 = 0x0, pcb_dr1 = 0x0, pcb_dr2 = 0x0, pcb_dr3 = 0x0, pcb_dr6 = 0x0, pcb_dr7 = 0x0, pcb_gdt = {rd_limit = 0x0, rd_base = 0x0}, pcb_idt = {rd_limit = 0x0, rd_base = 0x0}, pcb_ldt = {rd_limit = 0x0, rd_base = 0x0}, pcb_tr = 0x0, pcb_flags = 0x111, pcb_initial_fpucw = 0x37f, pcb_onfault = 0x0, pcb_saved_ucr3 = 0x286c17efd, pcb_tssp = 0x0, pcb_efer = 0x0, pcb_star = 0x0, pcb_lstar = 0x0, pcb_cstar = 0x0, pcb_sfmask = 0x0, pcb_save = 0xfffffe0107a74680, pcb_tlsbase = 0x2d9c9e613330, pcb_pad = {0x0, 0x0, 0x0, 0x0}}, md_stack_base = 0xfffffe0100059000, md_usr_fpu_save = 0xfffffe0107a74680}, td_ar = 0x0, td_lprof = {{lh_first = 0x0}, { lh_first = 0x0}}, td_dtrace = 0xfffff8001f19da00, td_vnet = 0x0, td_vnet_lpush = 0x0, td_intr_frame = 0x0, td_rfppwait_p = 0xfffffe015c279ac0, td_ma = 0x0, td_ma_cnt = 0x0, td_emuldata = 0x0, td_lastcpu = 0x5, td_oncpu = 0xffffffff, td_lkpi_task = 0x0, td_pmcpend = 0x0, td_remotereq = 0x0, td_ktr_io_lim = 0x0} (kgdb) p *cr $1 = {cr_mtx = {lock_object = {lo_name = 0xffffffff8135475c "cred", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xfffff8087fd7c400}, mtx_lock = 0xfffff8000489b000}, cr_ref = 0xffffffffffffffff, cr_users = 0x0, cr_flags = 0x2, cr_audit = {ai_auid = 0xffffffff, ai_mask = {am_success = 0x0, am_failure = 0x0}, ai_termid = {at_port = 0x0, at_type = 0x4, at_addr = {0x0, 0x0, 0x0, 0x0}}, ai_asid = 0x0, ai_flags = 0x0}, cr_ngroups = 0x2, cr_uid = 0x7d6, cr_ruid = 0x7d6, cr_svuid = 0x7d6, cr_gid = 0x7d6, cr_rgid = 0x7d6, cr_svgid = 0x7d6, cr_uidinfo = 0xfffff80006444c80, cr_ruidinfo = 0xfffff80006444c80, cr_prison = 0xffffffff81ac75e0 , cr_loginclass = 0xfffff800033b1040, cr_pspare2 = {0x0, 0x0}, cr_label = 0x0, cr_groups = 0xfffff80003631cc4, cr_agroups = 0x10, cr_smallgroups = {0x0, 0x7d6, 0x0 }} (kgdb) -- Test scenario: src/tools/test/stress2/misc/dummy.sh (real test was a "init 6")