panic: page fault, vmcore.177 KDB: debugger backends: ddb KDB: current backend: ddb ---<>--- Copyright (c) 1992-2020 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 13.0-CURRENT #1 r359611: Sat Apr 4 10:26:36 CEST 2020 pho@mercat1.netperf.freebsd.org:/usr/src/sys/amd64/compile/PHO amd64 FreeBSD clang version 10.0.0 (git@github.com:llvm/llvm-project.git llvmorg-10.0.0-0-gd32170dbd5b) WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. VT(vga): resolution 640x480 CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.07-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics real memory = 34359738368 (32768 MB) avail memory = 33163595776 (31627 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 12 CPUs FreeBSD/SMP: 1 package(s) x 6 core(s) x 2 hardware threads random: registering fast source Intel Secure Key RNG random: fast provider: "Intel Secure Key RNG" random: unblocking device. ioapic0 irqs 0-23 ioapic1 irqs 24-47 Launching APs: 1 5 4 2 8 7 3 10 11 9 6 Timecounter "TSC-low" frequency 1750036068 Hz quality 1000 random: entropy device external interface WARNING: Device "kbd" is Giant locked and may be deleted before FreeBSD 13.0. kbd1 at kbdmux0 000.000053 [4342] netmap_init netmap: loaded module [ath_hal] loaded nexus0 vtvga0: cryptosoft0: acpi0: acpi0: Power Button (fixed) cpu0: on acpi0 atrtc0: port 0x70-0x71,0x74-0x77 irq 8 on acpi0 atrtc0: registered as a time-of-day clock, resolution 1.000000s Event timer "RTC" frequency 32768 Hz quality 0 attimer0: port 0x40-0x43,0x50-0x53 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Event timer "HPET" frequency 14318180 Hz quality 350 Event timer "HPET1" frequency 14318180 Hz quality 340 Event timer "HPET2" frequency 14318180 Hz quality 340 Event timer "HPET3" frequency 14318180 Hz quality 340 Event timer "HPET4" frequency 14318180 Hz quality 340 Event timer "HPET5" frequency 14318180 Hz quality 340 Event timer "HPET6" frequency 14318180 Hz quality 340 Event timer "HPET7" frequency 14318180 Hz quality 340 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 pcib0: on acpi0 pci0: on pcib0 pci0: at device 11.1 (no driver attached) pci0: at device 11.2 (no driver attached) pci0: at device 16.1 (no driver attached) pci0: at device 16.6 (no driver attached) pci0: at device 18.1 (no driver attached) acpi_syscontainer0: on acpi0 acpi_syscontainer1: on acpi0 acpi_syscontainer2: on acpi0 acpi_syscontainer3: on acpi0 pcib1: port 0xcf8-0xcff on acpi0 pci1: on pcib1 pcib2: irq 26 at device 1.0 on pci1 pci2: on pcib2 pcib3: irq 32 at device 2.0 on pci1 pci3: on pcib3 pci3: at device 0.0 (no driver attached) pci3: at device 0.1 (no driver attached) pcib4: irq 40 at device 3.0 on pci1 pci4: on pcib4 pci1: at device 17.0 (no driver attached) ahci0: port 0xf110-0xf117,0xf100-0xf103,0xf0f0-0xf0f7,0xf0e0-0xf0e3,0xf020-0xf03f mem 0xfb438000-0xfb4387ff irq 16 at device 17.4 on pci1 ahci0: AHCI v1.30 with 4 6Gbps ports, Port Multiplier not supported ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahcich2: at channel 2 on ahci0 ahcich3: at channel 3 on ahci0 ahciem0: on ahci0 xhci0: mem 0xfb400000-0xfb40ffff irq 19 at device 20.0 on pci1 xhci0: 32 bytes context size, 64-bit DMA usbus0 on xhci0 usbus0: 5.0Gbps Super Speed USB v3.0 pci1: at device 22.0 (no driver attached) pci1: at device 22.1 (no driver attached) ehci0: mem 0xfb434000-0xfb4343ff irq 18 at device 26.0 on pci1 usbus1: EHCI version 1.0 usbus1 on ehci0 usbus1: 480Mbps High Speed USB v2.0 pcib5: irq 16 at device 28.0 on pci1 pci5: on pcib5 pcib6: irq 18 at device 28.2 on pci1 pci6: on pcib6 pcib7: at device 0.0 on pci6 pci7: on pcib7 vgapci0: port 0xe000-0xe07f mem 0xfa000000-0xfaffffff,0xfb000000-0xfb01ffff irq 18 at device 0.0 on pci7 vgapci0: Boot video device pcib8: irq 16 at device 28.4 on pci1 pci8: on pcib8 igb0: port 0xd020-0xd03f mem 0xfb320000-0xfb33ffff,0xfb344000-0xfb347fff irq 16 at device 0.0 on pci8 igb0: Using 1024 TX descriptors and 1024 RX descriptors igb0: queue equality override not set, capping rx_queues at 6 and tx_queues at 6 igb0: Using 6 RX queues 6 TX queues igb0: Using MSI-X interr. lo0: link state changed to UP Autoloading module: ioat.ko ioat0: mem 0xfb42c000-0xfb42ffff irq 31 at device 4.0 on pci1 ioat0: Capabilities: 2f7 ioat1: mem 0xfb428000-0xfb42bfff irq 39 at device 4.1 on pci1 ioat1: Capabilities: 2f7 ioat2: mem 0xfb424000-0xfb427fff irq 31 at device 4.2 on pci1 ioat2: Capabilities: f7 ioat3: mem 0xfb420000-0xfb423fff irq 39 at device 4.3 on pci1 ioat3: Capabilities: f7 ioat4: mem 0xfb41c000-0xfb41ffff irq 31 at device 4.4 on pci1 ioat4: Capabilities: f7 ioat5: mem 0xfb418000-0xfb41bfff irq 39 at device 4.5 on pci1 ioat5: Capabilities: f7 ioat6: mem 0xfb414000-0xfb417fff irq 31 at device 4.6 on pci1 ioat6: Capabilities: f7 ioat7: mem 0xfb410000-0xfb413fff irq 39 at device 4.7 on pci1 ioat7: Capabilities: f7 Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Starting Network: igb1. igb1: flags=8822 metric 0 mtu 1500 options=4e507bb ether 0c:c4:7a:a8:cd:db media: Ethernet autoselect status: no carrier nd6 options=29 Autoloading module: uhid.ko Autoloading module: ums.ko ums0 on uhub3 ums0: on usbus0 ums0: 3 buttons and [Z] coordinates ID=0 Starting dhclient. DHCPREQUEST on igb0 to 255.255.255.255 port 67 DHCPACK from 192if_delmulti_locked: detaching ifnet instance 0xfffff800041c3800 .168.5.1 bound to 192.168.5.171 -- renewal in 300 seconds. add host 127.0.0.1: gateway lo0 fib 0: route already in table add host ::1: gateway lo0 fib 0: route already in table add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Creating and/or trimming log files. Starting syslogd. Setting date via ntp. 4 Apr 10:29:16 ntpdate[2069]: step time server 192.168.5.1 offset -0.656572 sec Starting rpcbind. NFS access cache time=60 Updating CPU Microcode... CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.07-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab Structured Extended Features3=0x9c000400 XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics Done. Starting watchdogd. No core dumps found. Clearing /tmp (X related). Starting statd. Starting lockd. Recovering vi editor sessions:. fscklock order reversal: 1st 0xfffff80021925a68 ufs (ufs) @ kern/vfs_mount.c:1631 2nd 0xfffff800216fd2e8 devfs (devfs) @ kern/vfs_subr.c:3259 stack backtrace: #0 0xffffffff80c2d4c1 at witness_debugger+0x71 #1 0xffffffff80b92e62 at lockmgr_lock_flags+0x172 #2 0xffffffff810e38b0 at VOP_LOCK1_APV+0x40 #3 0xffffffff80caf034 at _vn_lock+0x54 #4 0xffffffff80c99e05 at vput_final+0x135 #5 0xffffffff80edef4d at ffs_unmount+0x3ed #6 0xffffffff80c91493 at dounmount+0x423 #7 0xffffffff80c91019 at kern_unmount+0x2b9 #8 0xffffffff81066ad9 at amd64_syscall+0x159 #9 0xffffffff8103c9d0 at fast_syscall_common+0x101 ** /dev/gpt/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 299 files, 3555 used, 1261852 free (196 frags, 157707 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** Updating motd:. Mounting late filesystems:. Security policy loaded: MAC/ntpd (mac_ntpd) Starting ntpd. Starting powerd. Configuring vt: blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting cron. Sat Apr 4 10:29 FreeBSD/amd64 (mercat1.netperf.freebsd.org) (ttyu1) login: root Apr 4 10:29:23 mercat1 login[2427]: ROOT LOGIN (root) ON ttyu1 Last login: Sat Apr 4 09:14:28 on ttyu1 FreeBSD 13.0-CURRENT (PHO) #1 r359611: Sat Apr 4 10:26:36 CEST 2020 root@mercat1:~ # Apr 4 10:29:38 mercat1 su[2443]: pho to root on /dev/pts/0 20200404 10:31:02 all (1/1): truncate7.sh pts leak: 1/2 20200404 10:31:06 all (1/1): truncate7.sh 20200404 10:31:10 all (1/1): truncate7.sh 20200404 10:31:15 all (1/1): truncate7.sh 20200404 10:31:19 all (1/1): truncate7.sh 20200404 10:31:23 all (1/1): truncate7.sh 20200404 10:31:27 all (1/1): truncate7.sh 20200404 10:31:32 all (1/1): truncate7.sh 20200404 10:31:37 all (1/1): truncate7.sh 20200404 10:31:41 all (1/1): truncate7.sh 20200404 10:31:45 all (1/1): truncate7.sh 20200404 10:31:49 all (1/1): truncate7.sh 20200404 10:31:54 all (1/1): truncate7.sh 20200404 10:31:58 all (1/1): truncate7.sh 20200404 10:32:02 all (1/1): truncate7.sh 20200404 10:32:06 all (1/1): truncate7.sh 20200404 10:32:10 all (1/1): truncate7.sh 20200404 10:32:14 all (1/1): truncate7.sh 20200404 10:32:18 all (1/1): truncate7.sh 20200404 10:32:22 all (1/1): truncate7.sh 20200404 10:32:27 all (1/1): truncate7.sh 20200404 10:32:32 all (1/1): truncate7.sh 20200404 10:32:35 all (1/1): truncate7.sh 20200404 10:32:39 all (1/1): truncate7.sh 20200404 10:32:44 all (1/1): truncate7.sh 20200404 10:32:49 all (1/1): truncate7.sh 20200404 10:32:54 all (1/1): truncate7.sh 20200404 10:32:57 all (1/1): truncate7.sh 20200404 10:33:02 all (1/1): truncate7.sh 20200404 10:33:07 all (1/1): truncate7.sh 20200404 10:33:11 all (1/1): truncate7.sh 20200404 10:33:14 all (1/1): truncate7.sh 20200404 10:33:19 all (1/1): truncate7.sh 20200404 10:33:24 all (1/1): truncate7.sh 20200404 10:33:28 all (1/1): truncate7.sh 20200404 10:33:33 all (1/1): truncate7.sh 20200404 10:33:37 all (1/1): truncate7.sh 20200404 10:33:42 all (1/1): truncate7.sh 20200404 10:33:46 all (1/1): truncate7.sh 20200404 10:33:50 all (1/1): truncate7.sh 20200404 10:33:54 all (1/1): truncate7.sh 20200404 10:33:59 all (1/1): truncate7.sh 20200404 10:34:03 all (1/1): truncate7.sh 20200404 10:34:08 all (1/1): truncate7.sh 20200404 10:34:12 all (1/1): truncate7.sh 20200404 10:34:16 all (1/1): truncate7.sh 20200404 10:34:21 all (1/1): truncate7.sh 20200404 10:34:25 all (1/1): truncate7.sh 20200404 10:34:29 all (1/1): truncate7.sh 20200404 10:34:33 all (1/1): truncate7.sh 20200404 10:34:37 all (1/1): truncate7.sh 20200404 10:34:41 all (1/1): truncate7.sh 20200404 10:34:46 all (1/1): truncate7.sh 20200404 10:34:50 all (1/1): truncate7.sh 20200404 10:34:55 all (1/1): truncate7.sh 20200404 10:35:00 all (1/1): truncate7.sh 20200404 10:35:05 all (1/1): truncate7.sh 20200404 10:35:10 all (1/1): truncate7.sh 20200404 10:35:14 all (1/1): truncate7.sh 20200404 10:35:18 all (1/1): truncate7.sh 20200404 10:35:22 all (1/1): truncate7.sh 20200404 10:35:26 all (1/1): truncate7.sh 20200404 10:35:29 all (1/1): truncate7.sh 20200404 10:35:33 all (1/1): truncate7.sh 20200404 10:35:38 all (1/1): truncate7.sh 20200404 10:35:42 all (1/1): truncate7.sh 20200404 10:35:45 all (1/1): truncate7.sh 20200404 10:35:49 all (1/1): truncate7.sh 20200404 10:35:54 all (1/1): truncate7.sh 20200404 10:35:59 all (1/1): truncate7.sh 20200404 10:36:03 all (1/1): truncate7.sh 20200404 10:36:08 all (1/1): truncate7.sh 20200404 10:36:12 all (1/1): truncate7.sh 20200404 10:36:17 all (1/1): truncate7.sh 20200404 10:36:21 all (1/1): truncate7.sh 20200404 10:36:25 all (1/1): truncate7.sh 20200404 10:36:29 all (1/1): truncate7.sh 20200404 10:36:33 all (1/1): truncate7.sh 20200404 10:36:38 all (1/1): truncate7.sh 20200404 10:36:42 all (1/1): truncate7.sh 20200404 10:36:47 all (1/1): truncate7.sh 20200404 10:36:52 all (1/1): truncate7.sh 20200404 10:36:57 all (1/1): truncate7.sh 20200404 10:37:01 all (1/1): truncate7.sh 20200404 10:37:05 all (1/1): truncate7.sh 20200404 10:37:10 all (1/1): truncate7.sh 20200404 10:37:15 all (1/1): truncate7.sh 20200404 10:37:19 all (1/1): truncate7.sh 20200404 10:37:22 all (1/1): truncate7.sh 20200404 10:37:27 all (1/1): truncate7.sh 20200404 10:37:32 all (1/1): truncate7.sh 20200404 10:37:37 all (1/1): truncate7.sh 20200404 10:37:41 all (1/1): truncate7.sh 20200404 10:37:44 all (1/1): truncate7.sh 20200404 10:37:48 all (1/1): truncate7.sh 20200404 10:37:53 all (1/1): truncate7.sh 20200404 10:37:57 all (1/1): truncate7.sh 20200404 10:38:01 all (1/1): truncate7.sh 20200404 10:38:06 all (1/1): truncate7.sh 20200404 10:38:10 all (1/1): truncate7.sh 20200404 10:38:15 all (1/1): truncate7.sh 20200404 10:38:18 all (1/1): truncate7.sh 20200404 10:38:22 all (1/1): truncate7.sh 20200404 10:38:25 all.sh done, elapsed 0 day(s), 00:07.23 lock order reversal: 1st 0xfffffe00e7b899b0 filedesc structure (filedesc structure) @ kern/kern_descrip.c:1305 2nd 0 xfffff802fa763568 ufs (ufs) @ kern/vfs_subr.c:5786 stack backtrace: #0 0xffffffff80c2d4c1 at witness_debugger+0x71 #1 0xffffffff80b92e62 at lockmgr_lock_flags+0x172 #2 0xffffffff80ee0e3d at ffs_lock+0x6d #3 0xffffffff810e38b0 at VOP_LOCK1_APV+0x40 #4 0xffffffff80caf034 at _vn_lock+0x54 #5 0xffffffff80b73cd9 at knlist_remove_kq+0x89 #6 0xffffffff80ca4244 at filt_vfsdetach+0x24 #7 0xffffffff80b74771 at knote_fdclose+0x1b1 #8 0xffffffff80b670f4 at closefp+0x104 #9 0xffffffff81066ad9 at amd64_syscall+0x159 #10 0xffffffff8103c9d0 at fast_syscall_common+0x101 20200404 10:38:57 all (1/702): 1st.sh 20200404 10:38:58 all (2/702): 256m.sh 20200404 10:39:00 all (3/702): audit.sh 20200404 10:39:01 all (4/702): beneath2.sh freework leak: 3/6. 20200404 10:39:02 all (5/702): beneath3.sh 20200404 10:39:04 all (6/702): buildworld.sh 20200404 10:39:05 all (7/702): buildworld2.sh 20200404 10:39:07 all (8/702): cluster.sh 20200404 10:39:08 all (9/702): cpuset.sh 20200404 10:39:09 all (10/702): crossmp2.sh 20200404 10:39:11 all (11/702): crossmp6.sh 20200404 10:39:12 all (12/702): datagram2.sh 20200404 10:39:14 all (13/702): datagram3.sh 20200404 10:39:15 all (14/702): datamove.sh freework leak: 36/42. 20200404 10:39:16 all (15/702): datamove3.sh 20200404 10:39:18 all (16/702): devfs2.sh 20200404 10:39:19 all (17/702): devfs5.sh 20200404 10:39:21 all (18/702): dtrace_fault.sh 20200404 10:39:22 all (19/702): dumpfs.sh newblk leak: 273/312. 20200404 10:39:24 all (20/702): dup2.sh 20200404 10:39:25 all (21/702): execi386.sh 20200404 10:39:27 all (22/702): extattr_set_fd.sh 20200404 10:39:28 all (23/702): extattrctl.sh lock order reversal: 1st 0xfffff8030fd08040 ufs_extattr_sx (ufs_extattr_sx) @ ufs/ufs/ufs_extattr.c:119 2nd 0xfffff802fa911068 ufs (ufs) @ ufs/ffs/ffs_vfsops.c:1757 stack backtrace: #0 0xffffffff80c2d4c1 at witness_debugger+0x71 #1 0xffffffff80b9342b at lockmgr_xlock_hard+0x6b #2 0xffffffff80b93ffa at __lockmgr_args+0x62a #3 0xffffffff80edc5a1 at ffs_vgetf+0x161 #4 0xffffffff80eef95b at ufs_root+0x1b #5 0xffffffff80c9e7b0 at vfs_cache_root_fallback+0x140 #6 0xffffffff80ee794f at ufs_extattr_autostart+0x5f #7 0xffffffff80edea2f at ffs_mount+0x1cef #8 0xffffffff80c901ae at vfs_domount+0x80e #9 0xffffffff80c8ec01 at vfs_donmount+0x871 #10 0xffffffff80c8e359 at sys_nmount+0x69 #11 0xffffffff81066ad9 at amd64_syscall+0x159 #12 0xffffffff8103c9d0 at fast_syscall_common+0x101 20200404 10:39:30 all (24/702): fcntl3.sh 20200404 10:39:31 all (25/702): fexecve.sh 20200404 10:39:33 all (26/702): fifo.sh 20200404 10:39:34 all (27/702): fsck2.sh 20200404 10:39:36 all (28/702): fsck3.sh 20200404 10:39:37 all (29/702): fsck4.sh 20200404 10:39:39 all (30/702): geomleak.sh 20200404 10:39:40 all (31/702): getrandom.sh 20200404 10:39:42 all (32/702): gnop3.sh 20200404 10:39:43 all (33/702): gnop5.sh GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. 20200404 10:39:45 all (34/702): holdcnt0.sh 20200404 10:39:46 all (35/702): holdcnt02.sh 20200404 10:39:47 all (36/702): holdcnt03.sh 20200404 10:39:49 all (37/702): holdcnt04.sh 20200404 10:39:50 all (38/702): holdcnt05.sh 20200404 10:39:52 all (39/702): isofs2.sh 20200404 10:39:53 all (40/702): jail.sh 20200404 10:39:54 all (41/702): jail2.sh 20200404 10:39:56 all (42/702): jail3.sh 20200404 10:39:57 all (43/702): jail4.sh 20200404 10:39:59 all (44/702): jexec.sh 20200404 10:40:00 all (45/702): kern_umtx_inf_loop.sh 20200404 10:40:02 all (46/702): kevent10.sh 20200404 10:40:03 all (47/702): kevent3.sh 20200404 10:40:05 all (48/702): ldt.sh 20200404 10:40:06 all (49/702): ldt2.sh 20200404 10:40:08 all (50/702): libMicro.sh 20200404 10:40:09 all (51/702): linux.sh 20200404 10:40:10 all (52/702): lockd.sh 20200404 10:40:12 all (53/702): lockf.sh 20200404 10:40:13 all (54/702): lookup_shared.sh 20200404 10:40:14 all (55/702): mac.sh 20200404 10:40:16 all (56/702): mac_chkexec.sh 20200404 10:40:17 all (57/702): machipc.sh 20200404 10:40:19 all (58/702): machipc2.sh 20200404 10:40:20 all (59/702): maxmemdom.sh 20200404 10:40:21 all (60/702): maxproc.sh 20200404 10:40:23 all (61/702): md4.sh 20200404 10:40:24 all (62/702): md5.sh 20200404 10:40:26 all (63/702): md6.sh 20200404 10:40:27 all (64/702): md8.sh newblk leak: 1472/1784. 20200404 10:40:36 all (65/702): mdconfig.sh 20200404 10:40:38 all (66/702): mdconfig3.sh 20200404 10:40:39 all (67/702): memguard4.sh 20200404 10:40:41 all (68/702): mkfifo5.sh 20200404 10:40:42 all (69/702): mkfifo7.sh 20200404 10:40:44 all (70/702): mlockall5.sh 20200404 10:40:45 all (71/702): mmap.sh 20200404 10:40:47 all (72/702): mmap12.sh 20200404 10:40:48 all (73/702): mmap16.sh 20200404 10:40:49 all (74/702): mmap17.sh 20200404 10:40:51 all (75/702): mmap20.sh 20200404 10:40:52 all (76/702): mmap24.sh 20200404 10:40:54 all (77/702): mmap30.sh 20200404 10:40:55 all (78/702): mmap33.sh 20200404 10:40:57 all (79/702): mmap35.sh 20200404 10:40:58 all (80/702): mmap36.sh 20200404 10:41:00 all (81/702): mount.sh 20200404 10:41:01 all (82/702): mountro2.sh 20200404 10:41:03 all (83/702): mountro3.sh newblk leak: 269/2053. 20200404 10:41:05 all (84/702): mprotect.sh 20200404 10:41:06 all (85/702): msdos2.sh 20200404 10:41:08 all (86/702): msdos3.sh 20200404 10:41:09 all (87/702): msdos7.sh lock order reversal: 1st 0xfffff802fab36a68 msdosfs (msdosfs) @ kern/vfs_syscalls.c:3431 2nd 0xfffff802fab35068 devfs (devfs) @ fs/msdosfs/msdosfs_vnops.c:853 stack backtrace: #0 0xffffffff80c2d4c1 at witness_debugger+0x71 #1 0xffffffff80b92e62 at lockmgr_lock_flags+0x172 #2 0xffffffff810e38b0 at VOP_LOCK1_APV+0x40 #3 0xffffffff80caf034 at _vn_lock+0x54 #4 0xffffffff80a7bc39 at msdosfs_fsync+0x49 #5 0xffffffff810e2549 at VOP_FSYNC_APV+0x59 #6 0xffffffff80caadf0 at kern_fsync+0x180 #7 0xffffffff81066ad9 at amd64_syscall+0x159 #8 0xffffffff8103c9d0 at fast_syscall_common+0x101 20200404 10:41:10 all (88/702): msdos8.sh 20200404 10:41:12 all (89/702): msetdomain.sh 20200404 10:41:13 all (90/702): nanosleep.sh 20200404 10:41:15 all (91/702): nbufkv.sh 20200404 10:41:16 all (92/702): nfs.sh 20200404 10:41:18 all (93/702): nfs12.sh 20200404 10:41:19 all (94/702): nfs14.sh 20200404 10:41:20 all (95/702): nfs15.sh 20200404 10:41:22 all (96/702): nfs15lockd.sh 20200404 10:41:23 all (97/702): nfs15lockd3.sh 20200404 10:41:24 all (98/702): nfs3.sh 20200404 10:41:26 all (99/702): nfs4.sh 20200404 10:41:27 all (100/702): nfs7.sh 20200404 10:41:29 all (101/702): nfs8.sh 20200404 10:41:30 all (102/702): nfs9.sh 20200404 10:41:31 all (103/702): nfs_halfpage.sh 20200404 10:41:33 all (104/702): nfs_halfpage2.sh 20200404 10:41:34 all (105/702): nfsdelegation.sh 20200404 10:41:36 all (106/702): nfsdepth.sh 20200404 10:41:37 all (107/702): nfsrename.sh 20200404 10:41:38 all (108/702): nfssillyrename.sh 20200404 10:41:40 all (109/702): nullfs13.sh 20200404 10:41:41 all (110/702): nullfs14.sh 20200404 10:41:42 all (111/702): nullfs15.sh 20200404 10:41:44 all (112/702): nullfs21.sh 20200404 10:41:45 all (113/702): nullfs23.sh 20200404 10:41:47 all (114/702): nullfs4.sh mount leak: 13/68 20200404 10:41:48 all (115/702): nullfs6.sh 20200404 10:41:50 all (116/702): nullfs7.sh 20200404 10:41:51 all (117/702): nullfs9.sh 20200404 10:41:53 all (118/702): numa.sh 20200404 10:41:54 all (119/702): oom.sh 20200404 10:41:55 all (120/702): open.sh 20200404 10:41:57 all (121/702): pagefault.sh 20200404 10:41:58 all (122/702): parallelmount2.sh 20200404 10:42:00 all (123/702): pathconf.sh 20200404 10:42:01 all (124/702): pathconf2.sh 20200404 10:42:02 all (125/702): pcatch.sh 20200404 10:42:04 all (126/702): pcatch2.sh 20200404 10:42:05 all (127/702): ping.sh 20200404 10:42:06 all (128/702): pkru.sh 20200404 10:42:08 all (129/702): pkru2.sh 20200404 10:42:09 all (130/702): pmc4.sh 20200404 10:42:11 all (131/702): pmc5.sh 20200404 10:42:12 all (132/702): pmc8.sh 20200404 10:42:14 all (133/702): poll.sh 20200404 10:42:15 all (134/702): posix_fadvise.sh 20200404 10:42:17 all (135/702): posix_fadvise2.sh 20200404 10:42:18 all (136/702): procfs5.sh 20200404 10:42:20 all (137/702): procfs6.sh 20200404 10:42:21 all (138/702): procstat.sh 20200404 10:42:22 all (139/702): pthread9.sh 20200404 10:42:24 all (140/702): ptrace.sh 20200404 10:42:25 all (141/702): ptrace3.sh 20200404 10:42:27 all (142/702): pts2.sh 20200404 10:42:28 all (143/702): quota5.sh 20200404 10:42:30 all (144/702): rename13.sh 20200404 10:42:31 all (145/702): rename4.sh 20200404 10:42:32 all (146/702): revoke.sh 20200404 10:42:34 all (147/702): routetbl.sh 20200404 10:42:35 all (148/702): ruby.sh 20200404 10:42:37 all (149/702): rwlock_ronly.sh 20200404 10:42:38 all (150/702): schedfuzz.sh 20200404 10:42:40 all (151/702): seekdir.sh 20200404 10:42:41 all (152/702): segnp.sh 20200404 10:42:43 all (153/702): segregs.sh 20200404 10:42:44 all (154/702): select3.sh 20200404 10:42:45 all (155/702): sendfile.sh lock order reversal: 1st 0xfffffe00dd396278 so_snd_sx (so_snd_sx) @ kern/uipc_sockbuf.c:416 2nd 0xfffff802fa9bd7e8 ufs (ufs) @ kern/kern_sendfile.c:831 stack backtrace: #0 0xffffffff80c2d4c1 at witness_debugger+0x71 #1 0xffffffff80b92d6c at lockmgr_lock_flags+0x7c #2 0xffffffff80ee0e3d at ffs_lock+0x6d #3 0xffffffff810e38b0 at VOP_LOCK1_APV+0x40 #4 0xffffffff80caf034 at _vn_lock+0x54 #5 0xffffffff80bbdd1a at vn_sendfile+0x70a #6 0xffffffff80bbf7e7 at sendfile+0x127 #7 0xffffffff81066ad9 at amd64_syscall+0x159 #8 0xffffffff8103c9d0 at fast_syscall_common+0x101 20200404 10:42:47 all (156/702): sendfile4.sh 20200404 10:42:49 all (157/702): setuid.sh 20200404 10:42:50 all (158/702): shm_super.sh 20200404 10:42:52 all (159/702): sigaltstack.sh 20200404 10:42:53 all (160/702): sigreturn.sh 20200404 10:42:55 all (161/702): sigstop.sh 20200404 10:42:56 all (162/702): snap12.sh lock order reversal: 1st 0xfffff80021a7bce8 ufs (ufs) @ kern/vfs_mount.c:1631 2nd 0xfffff8030f003930 snaplk (snaplk) @ ufs/ffs/ffs_snapshot.c:2132 3rd 0xfffff802faa162e8 ufs (ufs) @ ufs/ffs/ffs_snapshot.c:2133 stack backtrace: #0 0xffffffff80c2d4c1 at witness_debugger+0x71 #1 0xffffffff80b9342b at lockmgr_xlock_hard+0x6b #2 0xffffffff80b93ffa at __lockmgr_args+0x62a #3 0xffffffff80ebcb15 at ffs_snapshot_unmount+0x135 #4 0xffffffff80edc319 at ffs_flushfiles+0x79 #5 0xffffffff80ebe37d at softdep_flushfiles+0x9d #6 0xffffffff80edec39 at ffs_unmount+0xd9 #7 0xffffffff80c91493 at dounmount+0x423 #8 0xffffffff80c91019 at kern_unmount+0x2b9 #9 0xffffffff81066ad9 at amd64_syscall+0x159 #10 0xffffffff8103c9d0 at fast_syscall_common+0x101 20200404 10:42:58 all (163/702): snap2-1.sh lock order reversal: 1st 0xfffffe00388cd210 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:302 2nd 0xfffff8030f003930 snaplk (snaplk) @ ufs/ffs/ffs_snapshot.c:2327 stack backtrace: #0 0xffffffff80c2d4c1 at witness_debugger+0x71 #1 0xffffffff80b9342b at lockmgr_xlock_hard+0x6b #2 0xffffffff80b93ffa at __lockmgr_args+0x62a #3 0xffffffff80ebd176 at ffs_copyonwrite+0x166 #4 0xffffffff80edfe7a at ffs_geom_strategy+0xca #5 0xffffffff80ef3a53 at ufs_strategy+0x83 #6 0xffffffff810e3d21 at VOP_STRATEGY_APV+0x61 #7 0xffffffff80c7491e at bufstrategy+0x3e #8 0xffffffff80c747ba at bufwrite+0x24a #9 0xffffffff80ee1d9d at ffs_syncvnode+0x2bd #10 0xffffffff80ee0cf2 at ffs_fsync+0x22 #11 0xffffffff810e2549 at VOP_FSYNC_APV+0x59 #12 0xffffffff80ef17a8 at ufs_remove+0xd8 #13 0xffffffff810e26f9 at VOP_REMOVE_APV+0x79 #14 0xffffffff80ca7bd8 at kern_funlinkat+0x298 #15 0xffffffff80ca7938 at sys_unlink+0x28 #16 0xffffffff81066ad9 at amd64_syscall+0x159 #17 0xffffffff8103c9d0 at fast_syscall_common+0x101 20200404 10:42:59 all (164/702): snap2.sh 20200404 10:43:01 all (165/702): sndstat.sh 20200404 10:43:02 all (166/702): socketpair.sh 20200404 10:43:04 all (167/702): socketpair2.sh 20200404 10:43:05 all (168/702): suj32.sh 20200404 10:43:07 all (169/702): suj35.sh Apr 4 10:43:08 mercat1 kernel: pid 34800 (mkdir), uid 0 inumber 255 on /mnt: out of inodes 20200404 10:43:08 all (170/702): suj7.sh Failed to find journal. Use tunefs to create one Failed to start journal: 2 20200404 10:43:10 all (171/702): suj8.sh Apr 4 10:43:11 mercat1 kernel: pid 35030 (dd), uid 0 inumber 4 on /mnt: filesystem full Apr 4 10:43:11 mercat1 kernel: pid 35046 (dd), uid 0 inumber 5 on /mnt: filesystem full 20200404 10:43:11 all (172/702): swapoff3.sh 20200404 10:43:13 all (173/702): swapoff4.sh 20200404 10:43:14 all (174/702): swapoff5.sh 20200404 10:43:16 all (175/702): syzkaller1.sh 20200404 10:43:17 all (176/702): syzkaller2.sh 20200404 10:43:19 all (177/702): syzkaller3.sh 20200404 10:43:20 all (178/702): tar.sh 20200404 10:43:22 all (179/702): temp.sh 20200404 10:43:23 all (180/702): tmpfs15.sh 20200404 10:43:24 all (181/702): tmpfs4.sh 20200404 10:43:26 all (182/702): tmpfs6.sh 20200404 10:43:28 all (183/702): trim5.sh 20200404 10:43:29 all (184/702): trim6.sh 20200404 10:43:30 all (185/702): trim7.sh 20200404 10:43:32 all (186/702): trim8.sh 20200404 10:43:33 all (187/702): truncate4.sh 20200404 10:43:35 all (188/702): truncate6.sh 20200404 10:43:36 all (189/702): tvnlru.sh 20200404 10:43:38 all (190/702): ufssuspend.sh 20200404 10:43:39 all (191/702): uma_zalloc_arg.sh 20200404 10:43:41 all (192/702): unlink.sh 20200404 10:43:42 all (193/702): unload.sh 20200404 10:43:44 all (194/702): unload2.sh 20200404 10:43:45 all (195/702): vfork.sh 20200404 10:43:47 all (196/702): vmio.sh 20200404 10:43:48 all (197/702): watchman.sh 20200404 10:43:50 all (198/702): write.sh 20200404 10:43:51 all (199/702): sendfile2.sh 20200404 10:43:53 all (200/702): sendfile6.sh 20200404 10:43:54 all (201/702): contigmalloc2.sh 20200404 10:43:58 all (202/702): contigmalloc3.sh 20200404 10:44:00 all (203/702): datagram.sh 20200404 10:44:02 all (204/702): datamove4.sh 20200404 10:44:05 all (205/702): ext2fs3.sh 20200404 10:44:07 all (206/702): extattr.sh 20200404 10:44:10 all (207/702): fcntl.sh 20200404 10:44:12 all (208/702): fpclone2.sh 20200404 10:44:14 all (209/702): isofs.sh 20200404 10:44:16 all (210/702): killpg.sh 20200404 10:44:19 all (211/702): md9.sh lock order reversal: 1st 0xfffff800214d3080 bufwait (bufwait) @ vm/vm_pager.c:391 2nd 0xfffff800104fda68 tmpfs (tmpfs) @ dev/md/md.c:987 stack backtrace: #0 0xffffffff80c2d4c1 at witness_debugger+0x71 #1 0xffffffff80b94675 at lockmgr_xlock+0x55 #2 0xffffffff810e38b0 at VOP_LOCK1_APV+0x40 #3 0xffffffff80caf034 at _vn_lock+0x54 #4 0xffffffff806ea9c2 at mdstart_vnode+0x462 #5 0xffffffff806e86ae at md_kthread+0x1fe #6 0xffffffff80b7e820 at fork_exit+0x80 #7 0xffffffff8103d0ee at fork_trampoline+0xe 20200404 10:44:21 all (212/702): mmap25.sh 20200404 10:44:23 all (213/702): mmap26.sh 20200404 10:44:26 all (214/702): mmap28.sh Apr 4 10:44:29 mercat1 kernel: Failed to fully fault in a core file segment at VA 0x800e00000 with size 0x9be2000 to be written at offset 0x86e000 for process mmap28 20200404 10:44:29 all (215/702): mmap8.sh 20200404 10:44:32 all (216/702): mmap9.sh 20200404 10:44:34 all (217/702): msdos9.sh 20200404 10:44:37 all (218/702): newfs5.sh 20200404 10:44:40 all (219/702): nullfs10.sh 20200404 10:44:42 all (220/702): nullfs12.sh 20200404 10:44:44 all (221/702): nullfs16.sh 20200404 10:44:46 all (222/702): nullfs3.sh 20200404 10:44:49 all (223/702): openlock.sh 20200404 10:44:51 all (224/702): pipe_enomem.sh kern.ipc.maxpipekva exceeded; see tuning(7) 20200404 10:44:53 all (225/702): procfs2.sh 20200404 10:44:56 all (226/702): ptrace11.sh 20200404 10:44:58 all (227/702): ptrace8.sh 20200404 10:45:01 all (228/702): quota9.sh lock order reversal: 1st 0xfffff80300f59290 FFS (FFS Lock) @ ufs/ufs/ufs_quota.c:759 2nd 0xfffffe00e87b6700 struct mount mtx (struct mount mtx) @ ufs/ufs/ufs_quota.c:765 stack backtrace: #0 0xffffffff80c2d4c1 at witness_debugger+0x71 #1 0xffffffff80b9efc4 at __mtx_lock_flags+0x94 #2 0xffffffff80eee50d at quotaoff_inchange+0xbd #3 0xffffffff80edc3c6 at ffs_flushfiles+0x126 #4 0xffffffff80ebe37d at softdep_flushfiles+0x9d #5 0xffffffff80edec39 at ffs_unmount+0xd9 #6 0xffffffff80c91493 at dounmount+0x423 #7 0xffffffff80c91019 at kern_unmount+0x2b9 #8 0xffffffff81066ad9 at amd64_syscall+0x159 #9 0xffffffff8103c9d0 at fast_syscall_common+0x101 20200404 10:45:03 all (229/702): random.sh 20200404 10:45:05 all (230/702): rename6.sh 20200404 10:45:07 all (231/702): scp.sh 20200404 10:45:09 all (232/702): snap.sh 20200404 10:45:10 all (233/702): snap10.sh 20200404 10:45:13 all (234/702): spin.sh 20200404 10:45:15 all (235/702): suj2.sh 20200404 10:45:17 all (236/702): tmpfs7.sh lock order reversal: 1st 0xfffffe00e576a600 so_snd_sx (so_snd_sx) @ kern/uipc_sockbuf.c:416 2nd 0xfffff806da5e6a68 tmpfs (tmpfs) @ kern/kern_sendfile.c:831 stack backtrace: #0 0xffffffff80c2d4c1 at witness_debugger+0x71 #1 0xffffffff80b944fe at lockmgr_slock+0x5e #2 0xffffffff810e38b0 at VOP_LOCK1_APV+0x40 #3 0xffffffff80caf034 at _vn_lock+0x54 #4 0xffffffff80bbdd1a at vn_sendfile+0x70a #5 0xffffffff80bbf7e7 at sendfile+0x127 #6 0xffffffff81066ad9 at amd64_syscall+0x159 #7 0xffffffff8103c9d0 at fast_syscall_common+0x101 20200404 10:45:19 all (237/702): trim2.sh 20200404 10:45:21 all (238/702): truncate5.sh 20200404 10:45:24 all (239/702): umtx_suspend.sh 20200404 10:45:26 all (240/702): vm_fault_dontneed.sh 20200404 10:45:28 all (241/702): devfd.sh 20200404 10:45:32 all (242/702): dup.sh 20200404 10:45:36 all (243/702): extattr3.sh 20200404 10:45:39 all (244/702): kevent8.sh 20200404 10:45:43 all (245/702): mlockall7.sh 20200404 10:45:47 all (246/702): mmap13.sh 20200404 10:45:50 all (247/702): mmap23.sh 20200404 10:45:54 all (248/702): mmap4.sh vnode_pager_putpages: I/O error 28 0xfffff806dab52780: type VREG usecount 0, writecount 0, refcount 3203 flags (VI_DOINGINACT|VMP_LAZYLIST) v_object 0xfffff804cb6b5630 ref 0 pages 25608 cleanbuf 3200 dirtybuf 1 lock type ufs: EXCL by thread 0xfffffe00e7df3300 (pid 75702, mmap4, tid 101228) #0 0xffffffff80b92ec5 at lockmgr_lock_flags+0x1d5 #1 0xffffffff80ee0e3d at ffs_lock+0x6d #2 0xffffffff810e38b0 at VOP_LOCK1_APV+0x40 #3 0xffffffff80caf034 at _vn_lock+0x54 #4 0xffffffff80c99e05 at vput_final+0x135 #5 0xffffffff80f0c28d at vm_map_process_deferred+0xad #6 0xffffffff80f13e6b at vm_map_remove+0xeb #7 0xffffffff80f0bb50 at vmspace_exit+0xd0 #8 0xffffffff80b79402 at exit1+0x552 #9 0xffffffff80b78ead at sys_sys_exit+0xd #10 0xffffffff81066ad9 at amd64_syscall+0x159 #11 0xffffffff8103c9d0 at fast_syscall_common+0x101 nlink=1, effnlink=1, size=104857600, extsize 0 generation=c8c7526, uid=0, gid=0, flags=0x0 ino 4, on dev md10a vnode_pager_putpages: residual I/O 32768 at 9760 0xfffff806dab52780: type VREG usecount 0, writecount 0, refcount 3203 flags (VI_DOINGINACT|VMP_LAZYLIST) v_object 0xfffff804cb6b5630 ref 0 pages 25608 cleanbuf 3200 dirtybuf 1 lock type ufs: EXCL by thread 0xfffffe00e7df3300 (pid 75702, mmap4, tid 101228) #0 0xffffffff80b92ec5 at lockmgr_lock_flags+0x1d5 #1 0xffffffff80ee0e3d at ffs_lock+0x6d #2 0xffffffff810e38b0 at VOP_LOCK1_APV+0x40 #3 0xffffffff80caf034 at _vn_lock+0x54 Apr 4 10:45:55 #4 0xffffffff80c99e05 at vput_final+0x135 mercat1 kernel: #5 0xffffffff80f0c28d at vm_map_process_deferred+0xad pid 75702 (mmap4#6 0xffffffff80f13e6b at vm_map_remove+0xeb ), uid 0 inumber#7 0xffffffff80f0bb50 at vmspace_exit+0xd0 4 on /mnt: file#8 0xffffffff80b79402 at exit1+0x552 system full #9 0xffffffff80b78ead at sys_sys_exit+0xd #10 0xffffffff81066ad9 at amd64_syscall+0x159 #11 0xffffffff8103c9d0 at fast_syscall_common+0x101 nlink=1, effnlink=1, size=104857600, extsize 0 generation=c8c7526, uid=0, gid=0, flags=0x0 ino 4, on dev md10a vnode_pager_putpages: zero-length write at 40075264 resid 131072 0xfffff806dab52780: type VREG usecount 1, writecount 0, refcount 3203 flags (VMP_LAZYLIST) v_object 0xfffff804cb6b5630 ref 0 pages 25608 cleanbuf 3201 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe00e7b10300 (pid 75710, umount, tid 100635) #0 0xffffffff80b92ec5 at lockmgr_lock_flags+0x1d5 #1 0xffffffff80ee0e3d at ffs_lock+0x6d #2 0xffffffff810e38b0 at VOP_LOCK1_APV+0x40 #3 0xffffffff80caf034 at _vn_lock+0x54 Apr 4 10:45:57 #4 0xffffffff80c9907c at vget_finish+0x6c mercat1 kernel: #5 0xffffffff80c9c8c0 at vfs_periodic_msync_inactive+0x1b0 pid 75710 (umoun#6 0xffffffff80c91422 at dounmount+0x3b2 t), uid 0 inumbe#7 0xffffffff80c91019 at kern_unmount+0x2b9 r 4 on /mnt: fil#8 0xffffffff81066ad9 at amd64_syscall+0x159 esystem full #9 0xffffffff8103c9d0 at fast_syscall_common+0x101 nlink=1, effnlink=1, size=104857600, extsize 0 generation=c8c7526, uid=0, gid=0, flags=0x0 ino 4, on dev md10a 20200404 10:45:57 all (249/702): pthread.sh 20200404 10:46:00 all (250/702): tmpfs5.sh 20200404 10:46:04 all (251/702): udp.sh 20200404 10:46:07 all (252/702): unix_socket.sh 20200404 10:46:11 all (253/702): datamove5.sh 20200404 10:46:16 all (254/702): kevent2.sh 20200404 10:46:20 all (255/702): linger3.sh 20200404 10:46:24 all (256/702): mkfifo6.sh 20200404 10:46:29 all (257/702): mountro4.sh 20200404 10:46:34 all (258/702): procfs3.sh 20200404 10:46:38 all (259/702): ptrace2.sh 20200404 10:46:43 all (260/702): rename11.sh 20200404 10:46:47 all (261/702): symlink4.sh 20200404 10:46:52 all (262/702): truncate7.sh 20200404 10:46:56 all (263/702): growfs.sh g_access(1003): provider ufsid/5e8849823fba3664 has error 6 set g_access(1003): provider ufsid/5e8849823fba3664 has error 6 set g_access(1003): provider ufsid/5e8849823fba3664 has error 6 set g_access(1003): provider gptid/d7e8249a-7650-11ea-bd45-0cc47aa8cdda has error 6 set g_access(1003): provider gptid/d7e8249a-7650-11ea-bd45-0cc47aa8cdda has error 6 set g_access(1003): provider gptid/d7e8249a-7650-11ea-bd45-0cc47aa8cdda has error 6 set g_dev_taste: make_dev_p() failed (gp->name=gptid/d7e8249a-7650-11ea-bd45-0cc47aa8cdda, error=17) g_dev_taste: make_dev_p() failed (gp->name=gptid/d7e8249a-7650-11ea-bd45-0cc47aa8cdda, error=17) g_dev_taste: make_dev_p() failed (gp->name=ufsid/5e8849823fba3664, error=17) g_dev_taste: make_dev_p() failed (gp->name=gptid/d7e8249a-7650-11ea-bd45-0cc47aa8cdda, error=17) g_dev_taste: make_dev_p() failed (gp->name=ufsid/5e8849823fba3664, error=17) g_dev_taste: make_dev_p() failed (gp->name=gptid/d7e8249a-7650-11ea-bd45-0cc47aa8cdda, error=17) g_dev_taste: make_dev_p() failed (gp->name=ufsid/5e8849823fba3664, error=17) GEOM leak: 14/87 20200404 10:47:02 all (264/702): procfs.sh 20200404 10:47:07 all (265/702): pshared.sh 20200404 10:47:12 all (266/702): tmpfs10.sh 20200404 10:47:17 all (267/702): truncate3.sh 20200404 10:47:22 all (268/702): sparse.sh 20200404 10:47:26 all (269/702): linger2.sh Apr 4 10:47:29 mercat1 kernel: pid 12439 (linger2), uid 2007 inumber 889 on /mnt: filesystem full 20200404 10:47:33 all (270/702): linger4.sh Apr 4 10:47:37 mercat1 kernel: pid 13214 (linger4), uid 2007 inumber 103184 on /mnt: out of inodes 20200404 10:47:39 all (271/702): mlockall4.sh 20200404 10:47:46 all (272/702): ptrace9.sh 20200404 10:47:52 all (273/702): quota11.sh 20200404 10:47:59 all (274/702): fork.sh 20200404 10:48:06 all (275/702): sigfastblock.sh 20200404 10:48:13 all (276/702): smrstress.sh 20200404 10:48:22 all (277/702): symlink2.sh 20200404 10:48:30 all (278/702): sysctl.sh 20200404 10:48:37 all (279/702): umountf3.sh 20200404 10:52:45 all (280/702): execve.sh 20200404 10:54:39 all (281/702): tmpfs8.sh 20200404 10:54:50 all (282/702): compare.sh newblk leak: 30730/32783. 20200404 10:55:00 all (283/702): ffs_blkfree.sh 20200404 10:55:10 all (284/702): rename8.sh 20200404 10:55:19 all (285/702): umountf4.sh freework leak: 155/197. 20200404 10:55:29 all (286/702): thr.sh witness_lock_list_get: witness exhausted 20200404 10:55:39 all (287/702): proccontrol.sh 20200404 10:55:50 all (288/702): fsck5.sh 20200404 10:56:01 all (289/702): mprotect2.sh 20200404 10:56:13 all (290/702): nfs15lockd2.sh 20200404 10:56:24 all (291/702): posix_fadvise3.sh 20200404 10:56:36 all (292/702): rdgsbase.sh 20200404 10:56:47 all (293/702): pmc7.sh 20200404 10:57:00 all (294/702): rename9.sh 20200404 10:57:12 all (295/702): shm_open.sh 20200404 10:57:24 all (296/702): tmpfs14.sh 20200404 10:57:36 all (297/702): umountf6.sh 20200404 10:57:49 all (298/702): pipe2.sh 20200404 10:58:02 all (299/702): radix.sh Apr 4 10:58:07 mercat1 kernel: pid 32002 (radix), jid 0, uid 0, was killed: out of swap space 20200404 10:58:12 all (300/702): umountf11.sh 20200404 10:58:25 all (301/702): umountf12.sh 20200404 10:58:39 all (302/702): kevent6.sh 20200404 10:58:57 all (303/702): rdwr.sh 20200404 10:59:12 all (304/702): suj10.sh 20200404 10:59:29 all (305/702): mountu.sh 20200404 10:59:46 all (306/702): rename7.sh 20200404 11:00:03 all (307/702): sem.sh 20200404 11:00:21 all (308/702): sendfile_shm.sh 20200404 11:01:11 all (309/702): suj14.sh Apr 4 11:01:25 mercat1 kernel: pid 75587 (cp), uid 0 inumber 107278 on /mnt: filesystem full Apr 4 11:01:26 mercat1 syslogd: last message repeated 1 times Apr 4 11:01:27 mercat1 kernel: pid 75589 (cp), uid 0 inumber 40864 on /mnt: filesystem full Apr 4 11:01:28 mercat1 kernel: pid 75615 (cp), uid 0 inumber 40871 on /mnt: filesystem full Apr 4 11:01:29 mercat1 kernel: pid 75649 (cp), uid 0 inumber 40871 on /mnt: filesystem full 20200404 11:01:30 all (310/702): f_offset.sh 20200404 11:01:52 all (311/702): mmap7.sh 20200404 11:02:09 all (312/702): tmpfs2.sh 20200404 11:02:27 all (313/702): tmpfs19.sh 20200404 11:02:51 all (314/702): credleak.sh 20200404 11:03:13 all (315/702): mkfifo3.sh 20200404 11:03:35 all (316/702): mmap5.sh 20200404 11:03:56 all (317/702): mountro6.sh 20200404 11:04:18 all (318/702): multicast.sh 20200404 11:04:39 all (319/702): pdfork.sh if_delmulti_locked: detaching ifnet instance 0xfffff800041c3800 20200404 11:05:01 all (320/702): recursiveflushes.sh 20200404 11:05:22 all (321/702): core4.sh Apr 4 11:05:24 mercat1 kernel: Failed to write core file for process core4 (error 5) 20200404 11:05:43 all (322/702): suj33.sh 20200404 11:06:10 all (323/702): pread.sh Apr 4 11:05:43 mercat1 syslogd: last message repeated 59 times 20200404 11:06:33 all (324/702): sendfile5.sh 20200404 11:06:57 all (325/702): nullfs22.sh 20200404 11:07:21 all (326/702): sendmsg2.sh 20200404 11:07:43 all (327/702): multicast2.sh Apr 4 11:07:48 mercat1 mDNSResponder[12410]: mDNSResponder (Engineering Build) (Jan 9 2020 04:51:18) starting Apr 4 11:07:49 mercat1 mDNSResponder[12410]: mDNS_AddDNSServer: Lock not held! mDNS_busy (0) mDNS_reentrancy (0) Apr 4 11:07:49 mercat1 mDNSResponder[12410]: mDNSPlatformSourceAddrForDest: connect 1.1.1.1 failed errno 51 (Network is unreachable) if_delmulti_locked: detaching ifnet instance 0xfffff800041c3800 if_delmulti_locked: detaching ifnet instance 0xfffff800041c3800 if_delmulti_locked: detaching ifnet instance 0xfffff801b5195000 if_delmulti_locked: detaching ifnet instance 0xfffff801b5195000 if_delmulti_locked: detaching ifnet instance 0xfffff801b5195000 if_delmulti_locked: detaching ifnet instance 0xfffff801b5195000 if_delmulti_locked: detaching ifnet instance 0xfffff801b5195000 if_delmulti_locked: detaching ifnet instance 0xfffff801b5195000 if_delmulti_locked: detaching ifnet instance 0xfffff801b5195000 Apr 4 11:07:58 mercat1 mDNSResponder[12410]: mDNSResponder (Engineering Build) (Jan 9 2020 04:51:18) stoppingif_delmulti_locked: detaching ifnet instance 0xfffff800041c3800 20200404 11:08:02 all (328/702): namecache2.sh 20200404 11:08:27 all (329/702): core2.sh 20200404 11:08:53 all (330/702): rename3.sh 20200404 11:09:20 all (331/702): msdos5.sh GEOM leak: 19/106 20200404 11:09:50 all (332/702): sendfile3.sh 20200404 11:10:20 all (333/702): fifo3.sh 20200404 11:10:51 all (334/702): mmap37.sh 20200404 11:11:23 all (335/702): beneath.sh 20200404 11:11:55 all (336/702): pthread5.sh 20200404 11:12:28 all (337/702): split.sh 20200404 11:12:52 all (338/702): vnodes.sh 20200404 11:13:27 all (339/702): ufsbench.sh 20200404 11:14:08 all (340/702): crossmp7.sh ZFS filesystem version: 5 ZFS storage pool version: features support (5000) 20200404 11:15:29 all (341/702): umountf5.sh Apr 4 11:15:46 mercat1 kernel: pid 81018 (mkdir), uid 0 inumber 436 on /mnt: out of inodes Apr 4 11:15:52 mercat1 kernel: pid 81031 (creat), uid 0 inumber 770 on /mnt: out of inodes Apr 4 11:16:06 mercat1 kernel: pid 81030 (creat), uid 0 inumber 385 on /mnt: out of inodes 20200404 11:16:20 all (342/702): quota8.sh 20200404 11:17:07 all (343/702): tcp4.sh Expensive timeout(9) function: 0xffffffff80dfdc40(0xfffff800754e13f0) 0.010737631 s Expensive timeout(9) function: 0xffffffff80dfcbe0(0xfffff805d96d2000) 0.221483927 s 20200404 11:18:00 all (344/702): nullfs11.sh 20200404 11:18:49 all (345/702): bench.sh 20200404 11:19:38 all (346/702): exlock.sh 20200404 11:20:28 all (347/702): fpu.sh 20200404 11:21:20 all (348/702): umountf.sh 20200404 11:22:11 all (349/702): posix_openpt.sh 20200404 11:23:15 all (350/702): suj6.sh 20200404 11:23:35 all (351/702): jumbo.sh 20200404 11:24:34 all (352/702): advlock.sh 20200404 11:25:36 all (353/702): flock.sh 20200404 11:26:37 all (354/702): fsgs.sh 20200404 11:27:38 all (355/702): fts2.sh 20200404 11:28:39 all (356/702): fullpath.sh 20200404 11:29:41 all (357/702): mdconfig2.sh 20200404 11:30:42 all (358/702): midi2.sh 20200404 11:31:43 all (359/702): mkfifo8.sh 20200404 11:32:44 all (360/702): mknod.sh 20200404 11:33:45 all (361/702): mmap21.sh Apr 4 11:35:23 mercat1 kernel: pid 96812 (mmap21), uid 2007 inumber 189 on /tmp: filesystem full Apr 4 11:35:23 mercat1 kernel: Failed to write core file for process mmap21 (error 28) 20200404 11:35:24 all (362/702): mmap29.sh Apr 4 11:35:23 mercat1 syslogd: last message repeated 1 times 20200404 11:36:26 all (363/702): pts3.sh newblk leak: 5527/38310. 20200404 11:37:27 all (364/702): sem_wait.sh 20200404 11:38:28 all (365/702): sendfile8.sh 20200404 11:39:29 all (366/702): sendfile9.sh 20200404 11:40:30 all (367/702): shm.sh 20200404 11:41:32 all (368/702): sigstop2.sh 20200404 11:42:33 all (369/702): socketpair3.sh 20200404 11:43:34 all (370/702): suj5.sh 20200404 11:44:56 all (371/702): fsck.sh 20200404 11:45:58 all (372/702): crossmp5.sh 20200404 11:46:53 all (373/702): crossmp8.sh 20200404 11:47:55 all (374/702): tcp3.sh 20200404 11:49:01 all (375/702): rename10.sh 20200404 11:50:09 all (376/702): gnop2.sh GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. 20200404 11:51:18 all (377/702): quota4.sh 20200404 11:52:25 all (378/702): stack_guard_page.sh Apr 4 11:52:51 mercat1 kernel: pid 84879 (openat), uid 2007 inumber 32801 on /mnt: out of inodes 20200404 11:53:28 all (379/702): tmpfs21.sh 20200404 11:54:37 all (380/702): truss2.sh 20200404 11:55:46 all (381/702): vmstat.sh 20200404 11:56:58 all (382/702): crossmp.sh 20200404 11:58:13 all (383/702): zfs6.sh ZFS filesystem version: 5 ZFS storage pool version: features support (5000) 20200404 11:59:29 all (384/702): mountro5.sh 20200404 12:00:46 all (385/702): mmap18.sh 20200404 12:02:10 all (386/702): pthread2.sh 20200404 12:03:37 all (387/702): tmpfs12.sh Apr 4 12:04:02 mercat1 kernel: pid 63717 (swap), jid 0, uid 0, was killed: out of swap space Apr 4 12:04:12 mercat1 kernel: pid 63713 (swap), jid 0, uid 0, was killed: out of swap space Apr 4 12:04:22 mercat1 kernel: pid 63685 (swap), jid 0, uid 0, was killed: out of swap space Apr 4 12:04:34 mercat1 kernel: pid 63694 (swap), jid 0, uid 0, was killed: out of swap space 20200404 12:04:53 all (388/702): rename12.sh 20200404 12:06:38 all (389/702): pthread7.sh 20200404 12:08:09 all (390/702): pmc6.sh 20200404 12:09:47 all (391/702): msdos10.sh 20200404 12:11:45 all (392/702): ptrace10.sh 20200404 12:13:33 all (393/702): pthread3.sh 20200404 12:15:21 all (394/702): umountf2.sh 20200404 12:17:09 all (395/702): fifo2.sh 20200404 12:19:11 all (396/702): kevent.sh 20200404 12:21:12 all (397/702): kevent14.sh 20200404 12:23:13 all (398/702): kpti.sh 20200404 12:25:14 all (399/702): midi.sh 20200404 12:27:15 all (400/702): sendfile10.sh 20200404 12:29:17 all (401/702): fpclone.sh newblk leak: 4073/42383. 20200404 12:31:20 all (402/702): ftruncate3.sh GEOM leak: 10/116 20200404 12:33:23 all (403/702): overflow3.sh 20200404 12:35:25 all (404/702): fragments.sh Apr 4 12:35:28 mercat1 kernel: pid 91513 (fragments), uid 2007 inumber 51091 on /mnt: filesystem full Apr 4 12:35:29 mercat1 kernel: pid 91520 (fragments), uid 2007 inumber 6206 on /mnt: filesystem full Apr 4 12:35:30 mercat1 kernel: pid 91517 (fragments), uid 2007 inumber 6112 on /mnt: filesystem full Apr 4 12:35:31 mercat1 kernel: pid 91529 (fragments), uid 2007 inumber 6116 on /mnt: filesystem full Apr 4 12:35:32 mercat1 kernel: pid 91524 (fragments), uid 2007 inumber 2 on /mnt: filesystem full Apr 4 12:35:33 mercat1 kernel: pid 91523 (fragments), uid 2007 inumber 2 on /mnt: filesystem full Apr 4 12:35:34 mercat1 kernel: pid 91527 (fragments), uid 2007 inumber 2 on /mnt: filesystem full Apr 4 12:35:35 mercat1 kernel: pid 91522 (fragments), uid 2007 inumber 2 on /mnt: filesystem full Apr 4 12:35:36 mercat1 kernel: pid 91523 (fragments), uid 2007 inumber 2 on /mnt: filesystem full Apr 4 12:35:37 mercat1 kernel: pid 91525 (fragments), uid 2007 inumber 2 on /mnt: filesystem full Apr 4 12:35:38 mercat1 syslogd: last message repeated 1 times Apr 4 12:35:39 mercat1 kernel: pid 91524 (fragments), uid 2007 inumber 2 on /mnt: filesystem full Apr 4 12:35:40 mercat1 kernel: pid 91528 (fragments), uid 2007 inumber 6167 on /mnt: filesystem full Apr 4 12:35:41 mercat1 kernel: pid 92727 (fragments), uid 2007 inumber 6140 on /mnt: filesystem full Apr 4 12:35:42 mercat1 kernel: pid 92728 (fragments), uid 2007 inumber 6297 on /mnt: filesystem full Apr 4 12:35:43 mercat1 kernel: pid 92733 (fragments), uid 2007 inumber 6109 on /mnt: filesystem full Apr 4 12:35:44 mercat1 kernel: pid 93927 (fragments), uid 2007 inumber 6196 on /mnt: filesystem full Apr 4 12:35:45 mercat1 kernel: pid 93938 (fragments), uid 2007 inumber 6083 on /mnt: filesystem full Apr 4 12:35:46 mercat1 kernel: pid 93935 (fragments), uid 2007 inumber 6324 on /mnt: filesystem full Apr 4 12:35:47 mercat1 kernel: pid 93932 (fragments), uid 2007 inumber 6166 on /mnt: filesystem full Apr 4 12:35:48 mercat1 kernel: pid 93947 (fragments), uid 2007 inumber 6237 on /mnt: filesystem full Apr 4 12:35:49 mercat1 kernel: pid 93943 (fragments), uid 2007 inumber 6359 on /mnt: filesystem full Apr 4 12:35:50 mercat1 kernel: pid 93953 (fragments), uid 2007 inumber 6207 on /mnt: filesystem full Apr 4 12:35:51 mercat1 kernel: pid 93950 (fragments), uid 2007 inumber 6379 on /mnt: filesystem full Apr 4 12:35:52 mercat1 kernel: pid 93949 (fragments), uid 2007 inumber 6192 on /mnt: filesystem full Apr 4 12:35:53 mercat1 kernel: pid 95151 (fragments), uid 2007 inumber 6243 on /mnt: filesystem full Apr 4 12:35:54 mercat1 kernel: pid 95154 (fragments), uid 2007 inumber 6406 on /mnt: filesystem full Apr 4 12:35:55 mercat1 kernel: pid 95160 (fragments), uid 2007 inumber 6136 on /mnt: filesystem full Apr 4 12:35:56 mercat1 kernel: pid 95164 (fragments), uid 2007 inumber 6184 on /mnt: filesystem full Apr 4 12:35:57 mercat1 kernel: pid 95162 (fragments), uid 2007 inumber 6130 on /mnt: filesystem full Apr 4 12:35:58 mercat1 kernel: pid 95169 (fragments), uid 2007 inumber 6279 on /mnt: filesystem full Apr 4 12:35:59 mercat1 kernel: pid 95168 (fragments), uid 2007 inumber 6137 on /mnt: filesystem full Apr 4 12:36:00 mercat1 kernel: pid 95176 (fragments), uid 2007 inumber 6188 on /mnt: filesystem full Apr 4 12:36:01 mercat1 kernel: pid 95177 (fragments), uid 2007 inumber 6456 on /mnt: filesystem full Apr 4 12:36:02 mercat1 kernel: pid 95173 (fragments), uid 2007 inumber 6236 on /mnt: filesystem full Apr 4 12:36:03 mercat1 kernel: pid 96074 (fragments), uid 2007 inumber 6145 on /mnt: filesystem full Apr 4 12:36:04 mercat1 kernel: pid 96075 (fragments), uid 2007 inumber 6300 on /mnt: filesystem full Apr 4 12:36:05 mercat1 kernel: pid 96078 (fragments), uid 2007 inumber 6252 on /mnt: filesystem full Apr 4 12:36:06 mercat1 kernel: pid 96391 (fragments), uid 2007 inumber 6385 on /mnt: filesystem full Apr 4 12:36:07 mercat1 kernel: pid 96393 (fragments), uid 2007 inumber 6210 on /mnt: filesystem full Apr 4 12:36:08 mercat1 kernel: pid 96396 (fragments), uid 2007 inumber 6237 on /mnt: filesystem full Apr 4 12:36:09 mercat1 kernel: pid 96395 (fragments), uid 2007 inumber 6352 on /mnt: filesystem full Apr 4 12:36:10 mercat1 kernel: pid 96406 (fragments), uid 2007 inumber 6138 on /mnt: filesystem full Apr 4 12:36:11 mercat1 kernel: pid 96401 (fragments), uid 2007 inumber 6109 on /mnt: filesystem full Apr 4 12:36:12 mercat1 kernel: pid 96413 (fragments), uid 2007 inumber 6182 on /mnt: filesystem full Apr 4 12:36:13 mercat1 kernel: pid 96410 (fragments), uid 2007 inumber 6335 on /mnt: filesystem full Apr 4 12:36:14 mercat1 kernel: pid 97614 (fragments), uid 2007 inumber 6129 on /mnt: filesystem full Apr 4 12:36:15 mercat1 kernel: pid 97612 (fragments), uid 2007 inumber 6298 on /mnt: filesystem full Apr 4 12:36:17 mercat1 kernel: pid 97614 (fragments), uid 2007 inumber 6165 on /mnt: filesystem full Apr 4 12:36:17 mercat1 kernel: pid 97623 (fragments), uid 2007 inumber 6175 on /mnt: filesystem full Apr 4 12:36:18 mercat1 kernel: pid 97623 (fragments), uid 2007 inumber 6216 on /mnt: filesystem full Apr 4 12:36:19 mercat1 kernel: pid 97624 (fragments), uid 2007 inumber 6166 on /mnt: filesystem full Apr 4 12:36:20 mercat1 kernel: pid 97627 (fragments), uid 2007 inumber 6246 on /mnt: filesystem full Apr 4 12:36:21 mercat1 kernel: pid 97631 (fragments), uid 2007 inumber 6107 on /mnt: filesystem full Apr 4 12:36:23 mercat1 kernel: pid 97633 (fragments), uid 2007 inumber 6340 on /mnt: filesystem full Apr 4 12:36:24 mercat1 kernel: pid 97633 (fragments), uid 2007 inumber 2 on /mnt: filesystem full Apr 4 12:36:25 mercat1 kernel: pid 97637 (fragments), uid 2007 inumber 2 on /mnt: filesystem full Apr 4 12:36:25 mercat1 kernel: pid 97633 (fragments), uid 2007 inumber 2 on /mnt: filesystem full Apr 4 12:36:26 mercat1 kernel: pid 97637 (fragments), uid 2007 inumber 6199 on /mnt: filesystem full Apr 4 12:36:28 mercat1 kernel: pid 98835 (fragments), uid 2007 inumber 6163 on /mnt: filesystem full Apr 4 12:36:29 mercat1 kernel: pid 98838 (fragments), uid 2007 inumber 6169 on /mnt: filesystem full Apr 4 12:36:30 mercat1 kernel: pid 98839 (fragments), uid 2007 inumber 6207 on /mnt: filesystem full Apr 4 12:36:31 mercat1 kernel: pid 98845 (fragments), uid 2007 inumber 6180 on /mnt: filesystem full Apr 4 12:36:32 mercat1 kernel: pid 98857 (fragments), uid 2007 inumber 6176 on /mnt: filesystem full Apr 4 12:36:33 mercat1 kernel: pid 98850 (fragments), uid 2007 inumber 6221 on /mnt: filesystem full Apr 4 12:36:34 mercat1 kernel: pid 98851 (fragments), uid 2007 inumber 6229 on /mnt: filesystem full Apr 4 12:36:35 mercat1 kernel: pid 98861 (fragments), uid 2007 inumber 6213 on /mnt: filesystem full Apr 4 12:36:36 mercat1 kernel: pid 98860 (fragments), uid 2007 inumber 6481 on /mnt: filesystem full Apr 4 12:36:37 mercat1 kernel: pid 99 (fragments), uid 2007 inumber 6276 on /mnt: filesystem full Apr 4 12:36:37 mercat1 kernel: pid 99 (fragments), uid 2007 inumber 2 on /mnt: filesystem full Apr 4 12:36:38 mercat1 kernel: pid 98 (fragments), uid 2007 inumber 2 on /mnt: filesystem full Apr 4 12:36:40 mercat1 kernel: pid 100 (fragments), uid 2007 inumber 2 on /mnt: filesystem full Apr 4 12:36:43 mercat1 syslogd: last message repeated 3 times Apr 4 12:36:44 mercat1 kernel: pid 95 (fragments), uid 2007 inumber 2 on /mnt: filesystem full Apr 4 12:36:45 mercat1 kernel: pid 98 (fragments), uid 2007 inumber 2 on /mnt: filesystem full Apr 4 12:36:45 mercat1 kernel: pid 830 (fragments), uid 2007 inumber 6197 on /mnt: filesystem full Apr 4 12:36:47 mercat1 kernel: pid 837 (fragments), uid 2007 inumber 6350 on /mnt: filesystem full Apr 4 12:36:48 mercat1 kernel: pid 832 (fragments), uid 2007 inumber 6270 on /mnt: filesystem full Apr 4 12:36:49 mercat1 kernel: pid 1310 (fragments), uid 2007 inumber 2 on /mnt: filesystem full Apr 4 12:36:50 mercat1 kernel: pid 1308 (fragments), uid 2007 inumber 6197 on /mnt: filesystem full Apr 4 12:36:51 mercat1 kernel: pid 1312 (fragments), uid 2007 inumber 6255 on /mnt: filesystem full Apr 4 12:36:52 mercat1 kernel: pid 1312 (fragments), uid 2007 inumber 6118 on /mnt: filesystem full Apr 4 12:36:53 mercat1 kernel: pid 1318 (fragments), uid 2007 inumber 6112 on /mnt: filesystem full Apr 4 12:36:54 mercat1 kernel: pid 1320 (fragments), uid 2007 inumber 6246 on /mnt: filesystem full Apr 4 12:36:55 mercat1 kernel: pid 1325 (fragments), uid 2007 inumber 6371 on /mnt: filesystem full Apr 4 12:36:56 mercat1 kernel: pid 1330 (fragments), uid 2007 inumber 6154 on /mnt: filesystem full Apr 4 12:36:57 mercat1 kernel: pid 1330 (fragments), uid 2007 inumber 6366 on /mnt: filesystem full Apr 4 12:36:58 mercat1 kernel: pid 2564 (fragments), uid 2007 inumber 6161 on /mnt: filesystem full Apr 4 12:36:59 mercat1 kernel: pid 2564 (fragments), uid 2007 inumber 6374 on /mnt: filesystem full Apr 4 12:37:00 mercat1 kernel: pid 2561 (fragments), uid 2007 inumber 6187 on /mnt: filesystem full Apr 4 12:37:01 mercat1 kernel: pid 2573 (fragments), uid 2007 inumber 6122 on /mnt: filesystem full Apr 4 12:37:02 mercat1 kernel: pid 2570 (fragments), uid 2007 inumber 6166 on /mnt: filesystem full Apr 4 12:37:03 mercat1 kernel: pid 2567 (fragments), uid 2007 inumber 6330 on /mnt: filesystem full Apr 4 12:37:04 mercat1 kernel: pid 2582 (fragments), uid 2007 inumber 6246 on /mnt: filesystem full Apr 4 12:37:05 mercat1 kernel: pid 2584 (fragments), uid 2007 inumber 6327 on /mnt: filesystem full Apr 4 12:37:06 mercat1 kernel: pid 2577 (fragments), uid 2007 inumber 6302 on /mnt: filesystem full Apr 4 12:37:07 mercat1 kernel: pid 2589 (fragments), uid 2007 inumber 6209 on /mnt: filesystem full Apr 4 12:37:08 mercat1 kernel: pid 2590 (fragments), uid 2007 inumber 6107 on /mnt: filesystem full Apr 4 12:37:09 mercat1 kernel: pid 3797 (fragments), uid 2007 inumber 6282 on /mnt: filesystem full Apr 4 12:37:10 mercat1 kernel: pid 3799 (fragments), uid 2007 inumber 6093 on /mnt: filesystem full Apr 4 12:37:11 mercat1 kernel: pid 3805 (fragments), uid 2007 inumber 6212 on /mnt: filesystem full Apr 4 12:37:12 mercat1 kernel: pid 3804 (fragments), uid 2007 inumber 6243 on /mnt: filesystem full Apr 4 12:37:13 mercat1 kernel: pid 3805 (fragments), uid 2007 inumber 6597 on /mnt: filesystem full Apr 4 12:37:14 mercat1 kernel: pid 3809 (fragments), uid 2007 inumber 6285 on /mnt: filesystem full Apr 4 12:37:15 mercat1 kernel: pid 3813 (fragments), uid 2007 inumber 6112 on /mnt: filesystem full Apr 4 12:37:16 mercat1 kernel: pid 3820 (fragments), uid 2007 inumber 6424 on /mnt: filesystem full Apr 4 12:37:17 mercat1 kernel: pid 3831 (fragments), uid 2007 inumber 6107 on /mnt: filesystem full Apr 4 12:37:18 mercat1 kernel: pid 5031 (fragments), uid 2007 inumber 6144 on /mnt: filesystem full Apr 4 12:37:19 mercat1 kernel: pid 5031 (fragments), uid 2007 inumber 6411 on /mnt: filesystem full Apr 4 12:37:20 mercat1 kernel: pid 5031 (fragments), uid 2007 inumber 6324 on /mnt: filesystem full Apr 4 12:37:21 mercat1 kernel: pid 5043 (fragments), uid 2007 inumber 6196 on /mnt: filesystem full Apr 4 12:37:22 mercat1 kernel: pid 5037 (fragments), uid 2007 inumber 6192 on /mnt: filesystem full Apr 4 12:37:23 mercat1 kernel: pid 5036 (fragments), uid 2007 inumber 6355 on /mnt: filesystem full Apr 4 12:37:24 mercat1 kernel: pid 5046 (fragments), uid 2007 inumber 6206 on /mnt: filesystem full Apr 4 12:37:25 mercat1 kernel: pid 5044 (fragments), uid 2007 inumber 6137 on /mnt: filesystem full Apr 4 12:37:26 mercat1 kernel: pid 5058 (fragments), uid 2007 inumber 6120 on /mnt: filesystem full Apr 4 12:37:27 mercat1 kernel: pid 5054 (fragments), uid 2007 inumber 6340 on /mnt: filesystem full Apr 4 12:37:28 mercat1 kernel: pid 5059 (fragments), uid 2007 inumber 6139 on /mnt: filesystem full Apr 4 12:37:29 mercat1 kernel: pid 5052 (fragments), uid 2007 inumber 6349 on /mnt: filesystem full Apr 4 12:37:30 mercat1 kernel: pid 6254 (fragments), uid 2007 inumber 6224 on /mnt: filesystem full Apr 4 12:37:31 mercat1 kernel: pid 6268 (fragments), uid 2007 inumber 6448 on /mnt: filesystem full Apr 4 12:37:32 mercat1 kernel: pid 6262 (fragments), uid 2007 inumber 2 on /mnt: filesystem full Apr 4 12:37:33 mercat1 kernel: pid 6262 (fragments), uid 2007 inumber 6125 on /mnt: filesystem full Apr 4 12:37:34 mercat1 kernel: pid 6272 (fragments), uid 2007 inumber 6274 on /mnt: filesystem full Apr 4 12:37:35 mercat1 kernel: pid 6272 (fragments), uid 2007 inumber 6343 on /mnt: filesystem full Apr 4 12:37:36 mercat1 kernel: pid 6270 (fragments), uid 2007 inumber 6300 on /mnt: filesystem full Apr 4 12:37:37 mercat1 kernel: pid 6284 (fragments), uid 2007 inumber 6199 on /mnt: filesystem full Apr 4 12:37:38 mercat1 kernel: pid 6277 (fragments), uid 2007 inumber 6204 on /mnt: filesystem full Apr 4 12:37:39 mercat1 kernel: pid 6277 (fragments), uid 2007 inumber 6342 on /mnt: filesystem full Apr 4 12:37:40 mercat1 kernel: pid 7484 (fragments), uid 2007 inumber 6370 on /mnt: filesystem full Apr 4 12:37:41 mercat1 kernel: pid 7479 (fragments), uid 2007 inumber 6124 on /mnt: filesystem full Apr 4 12:37:42 mercat1 kernel: pid 7491 (fragments), uid 2007 inumber 6176 on /mnt: filesystem full Apr 4 12:37:43 mercat1 kernel: pid 7491 (fragments), uid 2007 inumber 6137 on /mnt: filesystem full Apr 4 12:37:44 mercat1 kernel: pid 7492 (fragments), uid 2007 inumber 6168 on /mnt: filesystem full Apr 4 12:37:45 mercat1 kernel: pid 7499 (fragments), uid 2007 inumber 6197 on /mnt: filesystem full Apr 4 12:37:46 mercat1 kernel: pid 7494 (fragments), uid 2007 inumber 6182 on /mnt: filesystem full 20200404 12:37:47 all.sh done, elapsed 0 day(s), 01:58.52 20200404 12:43:48 all (1/1): zz-combo03.sh Apr 4 12:44:00 mercat1 su[50833]: pho to root on /dev/pts/2 pts leak: 1/3 20200404 12:46:41 all (1/1): zz-combo03.sh 20200404 12:49:15 all (1/1): zz-combo03.sh 20200404 12:52:01 all (1/1): zz-combo03.sh 20200404 12:54:18 all (1/1): zz-combo03.sh Fatal trap 12: page fault while in kernel mode cpuid = 5; apic id = 05 fault virtual address = 0x190 fault code = supervisor read data, page not present instruction pointer = 0x20:0xffffffff80ee9cee stack pointer = 0x28:0xfffffe00de9f8a40 frame pointer = 0x28:0xfffffe00de9f8a90 code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags = interrupt enabled, resume, IOPL = 0 current process = 34 (vnlru) trap number = 12 panic: page fault cpuid = 4 time = 1585997719 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00de9f86f0 vpanic() at vpanic+0x182/frame 0xfffffe00de9f8740 panic() at panic+0x43/frame 0xfffffe00de9f87a0 trap_fatal() at trap_fatal+0x387/frame 0xfffffe00de9f8800 trap_pfault() at trap_pfault+0x99/frame 0xfffffe00de9f8860 trap() at trap+0x2a5/frame 0xfffffe00de9f8970 calltrap() at calltrap+0x8/frame 0xfffffe00de9f8970 --- trap 0xc, rip = 0xffffffff80ee9cee, rsp = 0xfffffe00de9f8a40, rbp = 0xfffffe00de9f8a90 --- ufs_reclaim() at ufs_reclaim+0x10e/frame 0xfffffe00de9f8a90 VOP_RECLAIM_APV() at VOP_RECLAIM_APV+0x59/frame 0xfffffe00de9f8ab0 vgonel() at vgonel+0x3b7/frame 0xfffffe00de9f8b10 vnlru_proc() at vnlru_proc+0x7fb/frame 0xfffffe00de9f8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00de9f8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00de9f8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- KDB: enter: panic [ thread pid 34 tid 100141 ] Stopped at kdb_enter+0x37: movq $0,0x10901a6(%rip) db> run pho db:0:pho> set $lines 20000 db:0:pho> run pho1 db:1:pho1> dump Dumping 2650 out of 32626 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% Dump complete db:1:pho1> bt Tracing pid 34 tid 100141 td 0xfffffe00d35df500 kdb_enter() at kdb_enter+0x37/frame 0xfffffe00de9f86f0 vpanic() at vpanic+0x19e/frame 0xfffffe00de9f8740 panic() at panic+0x43/frame 0xfffffe00de9f87a0 trap_fatal() at trap_fatal+0x387/frame 0xfffffe00de9f8800 trap_pfault() at trap_pfault+0x99/frame 0xfffffe00de9f8860 trap() at trap+0x2a5/frame 0xfffffe00de9f8970 calltrap() at calltrap+0x8/frame 0xfffffe00de9f8970 --- trap 0xc, rip = 0xffffffff80ee9cee, rsp = 0xfffffe00de9f8a40, rbp = 0xfffffe00de9f8a90 --- ufs_reclaim() at ufs_reclaim+0x10e/frame 0xfffffe00de9f8a90 VOP_RECLAIM_APV() at VOP_RECLAIM_APV+0x59/frame 0xfffffe00de9f8ab0 vgonel() at vgonel+0x3b7/frame 0xfffffe00de9f8b10 vnlru_proc() at vnlru_proc+0x7fb/frame 0xfffffe00de9f8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00de9f8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00de9f8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:1:pho1> show allpcpu Current CPU: 4 cpuid = 0 dynamic pcpu = 0x97bb40 curthread = 0xfffffe0148251e00: pid 54526 tid 101045 critnest 0 "md14" curpcb = 0xfffffe0148252310 fpcurthread = none idlethread = 0xfffffe003e3e0300: tid 100003 "idle: cpu0" self = 0xffffffff82410000 curpmap = 0xffffffff81d9fb50 tssp = 0xffffffff82410384 rsp0 = 0xfffffe00e973dcc0 kcr3 = 0x800000000230d007 ucr3 = 0xffffffffffffffff scr3 = 0x416574c3c gs32p = 0xffffffff82410404 ldt = 0xffffffff82410444 tss = 0xffffffff82410434 tlb gen = 66687666 curvnet = 0 spin locks held: cpuid = 1 dynamic pcpu = 0xfffffe00bc7f3b40 curthread = 0xfffffe00e7a6a300: pid 70528 tid 101199 critnest 0 "egrep" curpcb = 0xfffffe00e7a6a810 fpcurthread = 0xfffffe00e7a6a300: pid 70528 "egrep" idlethread = 0xfffffe003e3dfc00: tid 100004 "idle: cpu1" self = 0xffffffff82411000 curpmap = 0xfffffe01361a1b08 tssp = 0xffffffff82411384 rsp0 = 0xfffffe00e81a2cc0 kcr3 = 0x80000002f7b9f7dc ucr3 = 0x80000006c1673fdc scr3 = 0x6c1673fdc gs32p = 0xffffffff82411404 ldt = 0xffffffff82411444 tss = 0xffffffff82411434 tlb gen = 66687666 curvnet = 0 spin locks held: cpuid = 2 dynamic pcpu = 0xfffffe00bc7ffb40 curthread = 0xfffffe00e7c84300: pid 70497 tid 104744 critnest 0 "umount" curpcb = 0xfffffe00e7c84810 fpcurthread = 0xfffffe00e7c84300: pid 70497 "umount" idlethread = 0xfffffe003e3df500: tid 100005 "idle: cpu2" self = 0xffffffff82412000 curpmap = 0xfffffe013bc21120 tssp = 0xffffffff82412384 rsp0 = 0xfffffe030fc9fcc0 kcr3 = 0x800000057ea7a7ec ucr3 = 0x800000032f1fcfec scr3 = 0x32f1fcfec gs32p = 0xffffffff82412404 ldt = 0xffffffff82412444 tss = 0xffffffff82412434 tlb gen = 66687666 curvnet = 0 spin locks held: cpuid = 3 dynamic pcpu = 0xfffffe00bc80bb40 curthread = 0xfffffe015c08c300: pid 70523 tid 104588 critnest 0 "sh" curpcb = 0xfffffe015c08c810 fpcurthread = 0xfffffe015c08c300: pid 70523 "sh" idlethread = 0xfffffe003e3dee00: tid 100006 "idle: cpu3" self = 0xffffffff82413000 curpmap = 0xfffffe00e7210b08 tssp = 0xffffffff82413384 rsp0 = 0xfffffe0300245cc0 kcr3 = 0x80000005c47994df ucr3 = 0x8000000656632cdf scr3 = 0x656632cdf gs32p = 0xffffffff82413404 ldt = 0xffffffff82413444 tss = 0xffffffff82413434 tlb gen = 66687666 curvnet = 0 spin locks held: cpuid = 4 dynamic pcpu = 0xfffffe00bc817b40 curthread = 0xfffffe00d35df500: pid 34 tid 100141 critnest 1 "vnlru" curpcb = 0xfffffe00d35dfa10 fpcurthread = none idlethread = 0xfffffe003e3de700: tid 100007 "idle: cpu4" self = 0xffffffff82414000 curpmap = 0xffffffff81d9fb50 tssp = 0xffffffff82414384 rsp0 = 0xfffffe00de9f8cc0 kcr3 = 0x800000000230d006 ucr3 = 0xffffffffffffffff scr3 = 0x324350c52 gs32p = 0xffffffff82414404 ldt = 0xffffffff82414444 tss = 0xffffffff82414434 tlb gen = 66687666 curvnet = 0 spin locks held: cpuid = 5 dynamic pcpu = 0xfffffe00bc823b40 curthread = 0xfffffe0179ba8500: pid 70506 tid 100899 critnest 0 "umount" curpcb = 0xfffffe0179ba8a10 fpcurthread = 0xfffffe0179ba8500: pid 70506 "umount" idlethread = 0xfffffe003e3de000: tid 100008 "idle: cpu5" self = 0xffffffff82415000 curpmap = 0xfffffe00e8410120 tssp = 0xffffffff82415384 rsp0 = 0xfffffe030fdeecc0 kcr3 = 0x8000000146f92778 ucr3 = 0x80000001b5880f78 scr3 = 0x1b5880f78 gs32p = 0xffffffff82415404 ldt = 0xffffffff82415444 tss = 0xffffffff82415434 tlb gen = 66687666 curvnet = 0 spin locks held: cpuid = 6 dynamic pcpu = 0xfffffe00bc82fb40 curthread = 0xfffffe00ef239000: pid 70499 tid 104616 critnest 0 "umount" curpcb = 0xfffffe00ef239510 fpcurthread = 0xfffffe00ef239000: pid 70499 "umount" idlethread = 0xfffffe003e3e8a00: tid 100009 "idle: cpu6" self = 0xffffffff82416000 curpmap = 0xfffffe016387fb08 tssp = 0xffffffff82416384 rsp0 = 0xfffffe0300295cc0 kcr3 = 0x80000005e259d1a5 ucr3 = 0x80000007143de9a5 scr3 = 0x1463209a2 gs32p = 0xffffffff82416404 ldt = 0xffffffff82416444 tss = 0xffffffff82416434 tlb gen = 66687666 curvnet = 0 spin locks held: cpuid = 7 dynamic pcpu = 0xfffffe00bc83bb40 curthread = 0xfffffe003e1efe00: pid 13 tid 100062 critnest 0 "g_event" curpcb = 0xfffffe003e1f0310 fpcurthread = none idlethread = 0xfffffe003e3e8300: tid 100010 "idle: cpu7" self = 0xffffffff82417000 curpmap = 0xffffffff81d9fb50 tssp = 0xffffffff82417384 rsp0 = 0xfffffe0037acdcc0 kcr3 = 0x800000000230d005 ucr3 = 0xffffffffffffffff scr3 = 0x7143de895 gs32p = 0xffffffff82417404 ldt = 0xffffffff82417444 tss = 0xffffffff82417434 tlb gen = 66687666 curvnet = 0 spin locks held: cpuid = 8 dynamic pcpu = 0xfffffe00bc847b40 curthread = 0xfffffe00d5dfd800: pid 70426 tid 102276 critnest 0 "sh" curpcb = 0xfffffe00d5dfdd10 fpcurthread = 0xfffffe00d5dfd800: pid 70426 "sh" idlethread = 0xfffffe003e3e7c00: tid 100011 "idle: cpu8" self = 0xffffffff82418000 curpmap = 0xfffffe00eaf7cb08 tssp = 0xffffffff82418384 rsp0 = 0xfffffe02fa6a5cc0 kcr3 = 0x80000005832b94db ucr3 = 0x800000053a61ccdb scr3 = 0x5221acda gs32p = 0xffffffff82418404 ldt = 0xffffffff82418444 tss = 0xffffffff82418434 tlb gen = 66687666 curvnet = 0 spin locks held: cpuid = 9 dynamic pcpu = 0xfffffe00bc853b40 curthread = 0xfffffe012a29f700: pid 70519 tid 101756 critnest 0 "umount" curpcb = 0xfffffe012a29fc10 fpcurthread = 0xfffffe012a29f700: pid 70519 "umount" idlethread = 0xfffffe003e3e7500: tid 100012 "idle: cpu9" self = 0xffffffff82419000 curpmap = 0xfffffe013bc21b08 tssp = 0xffffffff82419384 rsp0 = 0xfffffe00ef747cc0 kcr3 = 0x8000000300f464fc ucr3 = 0x800000063e73fcfc scr3 = 0x63e73fcfc gs32p = 0xffffffff82419404 ldt = 0xffffffff82419444 tss = 0xffffffff82419434 tlb gen = 66687665 curvnet = 0 spin locks held: cpuid = 10 dynamic pcpu = 0xfffffe00bc85fb40 curthread = 0xfffffe015a984c00: pid 70518 tid 101272 critnest 0 "umount" curpcb = 0xfffffe015a985110 fpcurthread = 0xfffffe015a984c00: pid 70518 "umount" idlethread = 0xfffffe003e3e6e00: tid 100013 "idle: cpu10" self = 0xffffffff8241a000 curpmap = 0xfffffe0135fefb08 tssp = 0xffffffff8241a384 rsp0 = 0xfffffe00ea112cc0 kcr3 = 0x8000000603a7d4c1 ucr3 = 0x8000000449765cc1 scr3 = 0x5221acc2 gs32p = 0xffffffff8241a404 ldt = 0xffffffff8241a444 tss = 0xffffffff8241a434 tlb gen = 66687666 curvnet = 0 spin locks held: cpuid = 11 dynamic pcpu = 0xfffffe00bc86bb40 curthread = 0xfffffe015ce69700: pid 70510 tid 100820 critnest 0 "umount" curpcb = 0xfffffe015ce69c10 fpcurthread = 0xfffffe015ce69700: pid 70510 "umount" idlethread = 0xfffffe003e3e6700: tid 100014 "idle: cpu11" self = 0xffffffff8241b000 curpmap = 0xfffffe00d35f0120 tssp = 0xffffffff8241b384 rsp0 = 0xfffffe00ebe31cc0 kcr3 = 0x800000080cab3430 ucr3 = 0x800000024229dc30 scr3 = 0x24229dc30 gs32p = 0xffffffff8241b404 ldt = 0xffffffff8241b444 tss = 0xffffffff8241b434 tlb gen = 66687666 curvnet = 0 spin locks held: db:1:pho1> show alllocks db:1:pho1> show lockedvnods Locked vnodes vnode 0xfffff8010e3d9280: type VREG usecount 1, writecount 1, refcount 4 flags (VMP_LAZYLIST) v_object 0xfffff8002186ee70 ref 0 pages 24 cleanbuf 2 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe00d39fce00 (pid 2062, syslogd, tid 100171) #0 0xffffffff80b92ec5 at lockmgr_lock_flags+0x1d5 #1 0xffffffff80ee0e3d at ffs_lock+0x6d #2 0xffffffff810e38b0 at VOP_LOCK1_APV+0x40 #3 0xffffffff80caf034 at _vn_lock+0x54 #4 0xffffffff80caad68 at kern_fsync+0xf8 #5 0xffffffff81066ad9 at amd64_syscall+0x159 #6 0xffffffff8103c9d0 at fast_syscall_common+0x101 nlink=1, effnlink=1, size=844032, extsize 0 generation=364dadc6, uid=0, gid=0, flags=0x0 ino 9951777, on dev gpt/work vnode 0xfffff805d6b8ec80: type VDIR usecount 1, writecount 0, refcount 3 mountedhere 0xfffffe00e87ac000 flags (VMP_LAZYLIST) v_object 0xfffff8062a95be70 ref 0 pages 1 cleanbuf 1 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe012a29f700 (pid 70519, umount, tid 101756) #0 0xffffffff80b92ec5 at lockmgr_lock_flags+0x1d5 #1 0xffffffff80ee0e3d at ffs_lock+0x6d #2 0xffffffff810e38b0 at VOP_LOCK1_APV+0x40 #3 0xffffffff80caf034 at _vn_lock+0x54 #4 0xffffffff80c910d7 at dounmount+0x67 #5 0xffffffff80c91019 at kern_unmount+0x2b9 #6 0xffffffff81066ad9 at amd64_syscall+0x159 #7 0xffffffff8103c9d0 at fast_syscall_common+0x101 nlink=2, effnlink=2, size=512, extsize 0 generation=d5712377, uid=0, gid=0, flags=0x0 ino 106098432, on dev gpt/work vnode 0xfffff804d8264780: type VDIR usecount 1, writecount 0, refcount 3 mountedhere 0xfffffe00e7b96b80 flags (VMP_LAZYLIST) v_object 0xfffff803f8316948 ref 0 pages 1 cleanbuf 1 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe00ef239000 (pid 70499, umount, tid 104616) #0 0xffffffff80b92ec5 at lockmgr_lock_flags+0x1d5 #1 0xffffffff80ee0e3d at ffs_lock+0x6d #2 0xffffffff810e38b0 at VOP_LOCK1_APV+0x40 #3 0xffffffff80caf034 at _vn_lock+0x54 #4 0xffffffff80c910d7 at dounmount+0x67 #5 0xffffffff80c91019 at kern_unmount+0x2b9 #6 0xffffffff81066ad9 at amd64_syscall+0x159 #7 0xffffffff8103c9d0 at fast_syscall_common+0x101 nlink=2, effnlink=2, size=512, extsize 0 generation=69e411e0, uid=0, gid=0, flags=0x0 ino 44301312, on dev gpt/work vnode 0xfffff804ce230500: type VDIR usecount 1, writecount 0, refcount 3 mountedhere 0xfffffe00e8403b80 flags (VMP_LAZYLIST) v_object 0xfffff80647450528 ref 0 pages 1 cleanbuf 1 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe015c092e00 (pid 70503, umount, tid 104537) #0 0xffffffff80b92ec5 at lockmgr_lock_flags+0x1d5 #1 0xffffffff80ee0e3d at ffs_lock+0x6d #2 0xffffffff810e38b0 at VOP_LOCK1_APV+0x40 #3 0xffffffff80caf034 at _vn_lock+0x54 #4 0xffffffff80c910d7 at dounmount+0x67 #5 0xffffffff80c91019 at kern_unmount+0x2b9 #6 0xffffffff81066ad9 at amd64_syscall+0x159 #7 0xffffffff8103c9d0 at fast_syscall_common+0x101 nlink=2, effnlink=2, size=512, extsize 0 generation=607e4b65, uid=0, gid=0, flags=0x0 ino 83947776, on dev gpt/work vnode 0xfffff801b5a01a00: type VDIR usecount 1, writecount 0, refcount 3 mountedhere 0xfffffe00e8794000 flags (VMP_LAZYLIST) v_object 0xfffff806308b6840 ref 0 pages 1 cleanbuf 1 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe00e7c84300 (pid 70497, umount, tid 104744) #0 0xffffffff80b92ec5 at lockmgr_lock_flags+0x1d5 #1 0xffffffff80ee0e3d at ffs_lock+0x6d #2 0xffffffff810e38b0 at VOP_LOCK1_APV+0x40 #3 0xffffffff80caf034 at _vn_lock+0x54 #4 0xffffffff80c910d7 at dounmount+0x67 #5 0xffffffff80c91019 at kern_unmount+0x2b9 #6 0xffffffff81066ad9 at amd64_syscall+0x159 #7 0xffffffff8103c9d0 at fast_syscall_common+0x101 nlink=2, effnlink=2, size=512, extsize 0 generation=4f4c9adb, uid=0, gid=0, flags=0x0 ino 84028032, on dev gpt/work vnode 0xfffff806c144b500: type VDIR usecount 1, writecount 0, refcount 3 mountedhere 0xfffffe00d35dbb80 flags (VMP_LAZYLIST) v_object 0xfffff8039db87528 ref 0 pages 1 cleanbuf 1 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe015ce69700 (pid 70510, umount, tid 100820) #0 0xffffffff80b92ec5 at lockmgr_lock_flags+0x1d5 #1 0xffffffff80ee0e3d at ffs_lock+0x6d #2 0xffffffff810e38b0 at VOP_LOCK1_APV+0x40 #3 0xffffffff80caf034 at _vn_lock+0x54 #4 0xffffffff80c910d7 at dounmount+0x67 #5 0xffffffff80c91019 at kern_unmount+0x2b9 #6 0xffffffff81066ad9 at amd64_syscall+0x159 #7 0xffffffff8103c9d0 at fast_syscall_common+0x101 nlink=2, effnlink=2, size=512, extsize 0 generation=48ceba43, uid=0, gid=0, flags=0x0 ino 84108288, on dev gpt/work vnode 0xfffff803e9a27500: type VDIR usecount 1, writecount 0, refcount 3 mountedhere 0xfffffe00e87acb80 flags (VMP_LAZYLIST) v_object 0xfffff803e8c94528 ref 0 pages 1 cleanbuf 1 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe015a984c00 (pid 70518, umount, tid 101272) #0 0xffffffff80b92ec5 at lockmgr_lock_flags+0x1d5 #1 0xffffffff80ee0e3d at ffs_lock+0x6d #2 0xffffffff810e38b0 at VOP_LOCK1_APV+0x40 #3 0xffffffff80caf034 at _vn_lock+0x54 #4 0xffffffff80c910d7 at dounmount+0x67 #5 0xffffffff80c91019 at kern_unmount+0x2b9 #6 0xffffffff81066ad9 at amd64_syscall+0x159 #7 0xffffffff8103c9d0 at fast_syscall_common+0x101 nlink=2, effnlink=2, size=512, extsize 0 generation=2e16281, uid=0, gid=0, flags=0x0 ino 85793664, on dev gpt/work vnode 0xfffff80818a2a500: type VDIR usecount 1, writecount 0, refcount 3 mountedhere 0xfffffe00e7c61000 flags (VMP_LAZYLIST) v_object 0xfffff803b18e4630 ref 0 pages 1 cleanbuf 1 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe0179ba8500 (pid 70506, umount, tid 100899) #0 0xffffffff80b92ec5 at lockmgr_lock_flags+0x1d5 #1 0xffffffff80ee0e3d at ffs_lock+0x6d #2 0xffffffff810e38b0 at VOP_LOCK1_APV+0x40 #3 0xffffffff80caf034 at _vn_lock+0x54 #4 0xffffffff80c910d7 at dounmount+0x67 #5 0xffffffff80c91019 at kern_unmount+0x2b9 #6 0xffffffff81066ad9 at amd64_syscall+0x159 #7 0xffffffff8103c9d0 at fast_syscall_common+0x101 nlink=2, effnlink=2, size=512, extsize 0 generation=b53b459, uid=0, gid=0, flags=0x0 ino 84188544, on dev gpt/work vnode 0xfffff8083d3efa00: type VDIR usecount 0, writecount 0, refcount 3 mountedhere 0 flags (VIRF_DOOMED) v_object 0xfffff803b18e4a50 ref 0 pages 1 cleanbuf 1 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe0179ba8500 (pid 70506, umount, tid 100899) #0 0xffffffff80b92ec5 at lockmgr_lock_flags+0x1d5 #1 0xffffffff80ee0e3d at ffs_lock+0x6d #2 0xffffffff810e38b0 at VOP_LOCK1_APV+0x40 #3 0xffffffff80caf034 at _vn_lock+0x54 #4 0xffffffff80c9ada0 at vflush+0xd0 #5 0xffffffff80edc415 at ffs_flushfiles+0x175 #6 0xffffffff80edec4a at ffs_unmount+0xea #7 0xffffffff80c91493 at dounmount+0x423 #8 0xffffffff80c91019 at kern_unmount+0x2b9 #9 0xffffffff81066ad9 at amd64_syscall+0x159 #10 0xffffffff8103c9d0 at fast_syscall_common+0x101 nlink=2, effnlink=2, size=512, extsize 0 generation=504ce05a, uid=2007, gid=0, flags=0x0 ino 240569, on dev md18a vnode 0xfffff8048beb0a00: type VDIR usecount 0, writecount 0, refcount 1 mountedhere 0 flags (VIRF_DOOMED) v_object 0xfffff803b6097840 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe012a29f700 (pid 70519, umount, tid 101756) #0 0xffffffff80b92ec5 at lockmgr_lock_flags+0x1d5 #1 0xffffffff80ee0e3d at ffs_lock+0x6d #2 0xffffffff810e38b0 at VOP_LOCK1_APV+0x40 #3 0xffffffff80caf034 at _vn_lock+0x54 #4 0xffffffff80c9ada0 at vflush+0xd0 #5 0xffffffff80edc415 at ffs_flushfiles+0x175 #6 0xffffffff80edec4a at ffs_unmount+0xea #7 0xffffffff80c91493 at dounmount+0x423 #8 0xffffffff80c91019 at kern_unmount+0x2b9 #9 0xffffffff81066ad9 at amd64_syscall+0x159 #10 0xffffffff8103c9d0 at fast_syscall_common+0x101 nlink=3, effnlink=3, size=512, extsize 0 generation=37b5fac, uid=2007, gid=0, flags=0x0 ino 160294, on dev md10a db:1:pho1> show mount 0xfffffe00d35dc700 /dev/gpt/work on / (ufs) 0xfffffe00d35dd280 devfs on /dev (devfs) 0xfffffe00e569f280 /dev/gpt/tmp on /tmp (ufs) 0xfffffe00e7fb9280 192.168.5.1:tank/users/pho/mercat1 on /media (nfs) 0xfffffe00e7c62700 procfs on /proc (procfs) 0xfffffe00e7c61000 /dev/md18a on /mnt18 (ufs) 0xfffffe00d35dbb80 /dev/md16a on /mnt16 (ufs) 0xfffffe00e8403b80 /dev/md14a on /mnt14 (ufs) 0xfffffe00e7b96b80 /dev/md12a on /mnt12 (ufs) 0xfffffe00e8794000 /dev/md15a on /mnt15 (ufs) 0xfffffe00e87acb80 /dev/md17a on /mnt17 (ufs) 0xfffffe00e87ac000 /dev/md10a on /mnt10 (ufs) More info: show mount db:1:pho1> show bufqueues bqempty: 101228 Buf domain 0 freebufs 14894 lofreebufs 219 hifreebufs 329 bufspace 7446528 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 3 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 227 (7196672) dirtyq count 4 (102400) wakeup 0 lim 25 CPU 0, 1, 0, 0, 0, 1, 0, 0, 1, 0, 0, 1, Locked buffers: 5 space 163840 Total buffers: 15420 space 7446528 Buf domain 1 freebufs 12485 lofreebufs 219 hifreebufs 329 bufspace 86224896 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 11 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 2602 (84791296) dirtyq count 14 (458752) wakeup 0 lim 25 CPU 2, 1, 6, 1, 0, 0, 0, 0, 6, 0, 0, 16, Locked buffers: 4 space 131072 Total buffers: 17199 space 86224896 Buf domain 2 freebufs 15071 lofreebufs 219 hifreebufs 329 bufspace 1335296 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 1 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 52 (1265664) dirtyq count 1 (32768) wakeup 0 lim 25 CPU 1, 0, 1, 1, 0, 1, 0, 1, 1, 0, 2, 1, Locked buffers: 0 space 0 Total buffers: 14712 space 1335296 Buf domain 3 freebufs 15039 lofreebufs 219 hifreebufs 329 bufspace 2584576 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 21 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 44 (1142784) dirtyq count 21 (688128) wakeup 0 lim 25 CPU 0, 2, 2, 3, 0, 0, 13, 7, 0, 0, 1, 1, Locked buffers: 1 space 4096 Total buffers: 14453 space 2584576 Buf domain 4 freebufs 15031 lofreebufs 219 hifreebufs 329 bufspace 2617344 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 91 (2564096) dirtyq count 0 (0) wakeup 0 lim 25 CPU 1, 0, 2, 4, 1, 0, 0, 0, 0, 2, 0, 1, Locked buffers: 0 space 0 Total buffers: 14553 space 2617344 Buf domain 5 freebufs 15025 lofreebufs 219 hifreebufs 329 bufspace 3203072 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 104 (3149824) dirtyq count 0 (0) wakeup 0 lim 25 CPU 0, 0, 0, 0, 1, 0, 2, 0, 0, 1, 0, 0, Locked buffers: 0 space 0 Total buffers: 14788 space 3203072 Buf domain 6 freebufs 14956 lofreebufs 219 hifreebufs 329 bufspace 5197824 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 36 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 122 (3653632) dirtyq count 36 (1150976) wakeup 0 lim 25 CPU 0, 0, 1, 1, 1, 3, 0, 2, 0, 1, 10, 0, Locked buffers: 0 space 0 Total buffers: 14806 space 5197824 db:1:pho1> show page vm_cnt.v_free_count: 7561392 vm_cnt.v_inactive_count: 65958 vm_cnt.v_active_count: 24844 vm_cnt.v_laundry_count: 149 vm_cnt.v_wire_count: 467712 vm_cnt.v_free_reserved: 10644 vm_cnt.v_free_min: 51264 vm_cnt.v_free_target: 173124 vm_cnt.v_inactive_target: 259686 db:1:pho1> show pageq pq_free 7561392 dom 0 page_cnt 8124099 free 7561392 pq_act 24844 pq_inact 65958 pq_laund 149 pq_unsw 0 db:0:pho> show freepages DOMAIN: 0 FREE LIST 0: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000683 | 000002 11 (008192K) | 000497 | 000002 10 (004096K) | 000752 | 000012 09 (002048K) | 000520 | 000113 08 (001024K) | 002026 | 000147 07 (000512K) | 003399 | 000389 06 (000256K) | 005215 | 000737 05 (000128K) | 007972 | 000791 04 (000064K) | 009873 | 002783 03 (000032K) | 021533 | 004899 02 (000016K) | 041208 | 007293 01 (000008K) | 028637 | 009801 00 (000004K) | 027162 | 010109 FREE LIST 1: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000000 | 000000 09 (002048K) | 000000 | 000000 08 (001024K) | 000000 | 000000 07 (000512K) | 000000 | 000000 06 (000256K) | 000000 | 000001 05 (000128K) | 000001 | 000000 04 (000064K) | 000002 | 000000 03 (000032K) | 000000 | 000000 02 (000016K) | 000001 | 000000 01 (000008K) | 000000 | 000000 00 (000004K) | 000001 | 000000 db:0:pho> show uma Zone Size Used Free Requests Sleeps Bucket Total Mem XFree socket 904 63 939789 6538982 0 16 849626208 0 VM OBJECT 264 6668 551842 161194954 0 30 147446640 0 Files 80 214 941536 211856528 0 126 75340000 0 THREAD 1792 3710 17467 37387488 0 8 37949184 0 mbuf_cluster 2048 15361 219 571428 0 8 31907840 0 RADIX NODE 144 34787 87704 160119115 0 62 17638704 0 BUF TRIE 144 469 105483 57860503 0 62 15257088 0 128 128 77925 2551 229509977 0 126 10300928 0 vmem btag 56 125796 50231 2671742 0 254 9857512 0 128 128 66377 1513 2243205 0 126 8689920 0 swblk 136 1670 55489 283858 0 62 7773624 0 mbuf 256 16484 8970 384401851 0 254 6516224 0 VMSPACE 2536 100 2390 11055795 0 4 6314640 0 128 128 42390 1568 19259661 0 126 5626624 0 PROC 1320 146 3433 10861375 0 8 4724280 0 S VFS Cache 108 12745 25739 35980403 0 126 4156272 0 4096 4096 512 329 16114577 0 2 3444736 0 UMA Slabs 0 112 12480 16935 606869 0 126 3294480 0 128 128 505 24946 8752955 0 126 3257728 0 TURNSTILE 136 21178 410 21178 0 62 2935968 0 16 16 176413 3087 6611045 0 254 2872000 0 256 256 173 10942 17413030 0 62 2845440 0 128 128 86 21986 4821879 0 126 2825216 0 VNODE 640 1095 3237 90034040 0 16 2772480 0 32 32 77481 3033 49621123 0 254 2576448 0 128 128 406 18907 38393056 0 126 2472064 0 512 512 3916 748 14012957 0 30 2387968 0 128 128 110 16878 2764323 0 126 2174464 0 256 256 27 7938 4154098 0 62 2039040 0 128 128 14381 1522 5848586 0 126 2035584 0 SLEEPQUEUE 88 21178 326 21178 0 126 1892352 0 FFS2 dinode 256 1041 6009 52405713 0 62 1804800 0 FFS inode 160 1041 9559 52407274 0 62 1696000 0 MAP ENTRY 96 3915 11625 384886250 0 126 1491840 0 256 256 5 5485 23355060 0 62 1405440 0 256 Bucket 2048 570 106 2997401 0 8 1384448 0 32768 32768 12 29 3366 0 1 1343488 0 256 256 531 4629 78991023 0 62 1320960 0 32768 32768 12 27 259091 0 1 1277952 0 256 256 526 4364 12767451 0 62 1251840 0 128 Bucket 1024 372 847 3622286 0 16 1248256 0 64 Bucket 512 551 1881 14373821 0 30 1245184 0 DIRHASH 1024 804 372 215879 0 16 1204224 0 512 512 25 2175 11295433 0 30 1126400 0 16384 16384 50 11 59495 0 1 999424 0 32768 32768 0 29 967978 0 1 950272 0 pbuf 984 0 950 0 0 0 934800 0 65536 65536 3 11 2417 0 1 917504 0 32 Bucket 256 291 2993 4289448 0 62 840704 0 swpctrie 144 252 5572 25061 0 62 838656 0 mbuf_packet 256 27 3049 52457822 0 254 787456 0 65536 65536 0 12 3654 0 1 786432 0 64 64 8876 2842 151358038 0 254 749952 0 8192 8192 86 0 92 0 1 704512 0 filedesc0 1088 146 470 10861376 0 8 670208 0 16384 16384 3 36 174149 0 1 638976 0 4 Bucket 48 106 13082 944046 0 254 633024 0 64 64 9297 405 17148 0 254 620928 0 ksiginfo 112 3554 1882 1638437 0 126 608832 0 64 64 6779 2607 256613243 0 254 600704 0 65536 65536 5 4 41 0 1 589824 0 NAMEI 1024 0 548 386342804 0 16 561152 0 8192 8192 32 27 458175 0 1 483328 0 16384 16384 16 13 2511182 0 1 475136 0 1024 1024 257 199 5003116 0 16 466944 0 2 Bucket 32 541 13571 10096109 0 254 451584 0 g_bio 408 14 1026 322759274 0 33 424320 0 16 Bucket 144 834 1965 8751189 0 62 403056 0 8 Bucket 80 235 4765 3066797 0 126 400000 0 32768 32768 12 0 30 0 1 393216 0 8192 8192 25 23 404842 0 1 393216 0 Mountpoints 2944 13 111 60013 0 4 365056 0 256 256 330 1050 62388293 0 62 353280 0 2048 2048 145 9 199 0 8 315392 0 4096 4096 68 4 1992 0 2 294912 0 64 64 309 3786 22338565 0 254 262080 0 selfd 64 890 3016 56984099 0 254 249984 0 256 256 39 936 1354018 0 62 249600 0 1024 1024 44 192 2564778 0 16 241664 0 64 64 93 3561 998911 0 254 233856 0 2048 2048 4 110 3944871 0 8 233472 0 1024 1024 31 193 4110262 0 16 229376 0 1024 1024 13 207 347602 0 16 225280 0 pipe 760 14 276 19333100 0 16 220400 0 1024 1024 1 211 7527665 0 16 217088 0 512 512 53 363 2653649 0 30 212992 0 2048 2048 2 100 85585 0 8 208896 0 256 256 110 685 7130 0 62 203520 0 64 64 59 3091 983623 0 254 201600 0 1024 1024 2 194 76976 0 16 200704 0 512 512 0 392 915067 0 30 200704 0 UMA Zones 2048 89 8 351 0 8 198656 0 64 64 36 3051 3296597 0 254 197568 0 65536 65536 3 0 4 0 1 196608 0 65536 65536 3 0 3 0 1 196608 0 rl_entry 40 2346 2502 2346 0 254 193920 0 NCLNODE 744 3 247 1009 0 16 186000 0 unpcb 256 28 692 6531266 0 62 184320 0 udp_inpcb 488 20 332 912 0 30 171776 0 32768 32768 3 2 2701 0 1 163840 0 fakepg 104 0 1521 5702 0 126 158184 0 8192 8192 18 1 3136 0 1 155648 0 4096 4096 16 22 931 0 2 155648 0 512 512 179 125 1859777 0 30 155648 0 4096 4096 12 24 1096250 0 2 147456 0 512 512 11 277 30286 0 30 147456 0 PWD 32 24 4512 53938484 0 254 145152 0 4096 4096 1 32 26211 0 2 135168 0 65536 65536 2 0 7 0 1 131072 0 32 32 149 3379 1536467 0 254 112896 0 KNOTE 160 7 693 64735054 0 62 112000 0 32 32 306 3096 87324911 0 254 108864 0 32 32 231 3045 262479 0 254 104832 0 4096 4096 1 24 46647 0 2 102400 0 32 32 74 3076 57917 0 254 100800 0 32 32 50 3100 263074 0 254 100800 0 L VFS Cache 328 29 271 34988 0 30 98400 0 STS VFS Cache 148 0 650 10413 0 62 96200 0 1024 1024 7 81 20149 0 16 90112 0 ttyinq 160 360 190 26093521 0 62 88000 0 16384 16384 5 0 6 0 1 81920 0 1024 1024 9 67 51 0 16 77824 0 ttyoutq 256 182 118 13916539 0 62 76800 0 udpcb 32 20 2374 912 0 254 76608 0 rentr 24 0 3173 11337311 0 254 76152 0 LTS VFS Cache 368 0 187 411 0 30 68816 0 64 64 148 923 2196536 0 254 68544 0 32 32 33 2109 2603554 0 254 68544 0 65536 65536 1 0 1 0 1 65536 0 procdesc 136 3 461 1396661 0 62 63104 0 4096 4096 14 0 26 0 2 57344 0 16 16 487 3013 23056470 0 254 56000 0 KMAP ENTRY 96 66 477 105 0 126 52128 0 16 16 81 3169 263116 0 254 52000 0 16 16 124 3126 8601502 0 254 52000 0 16 16 27 3223 134965 0 254 52000 0 mt_stats_zone 64 444 324 455 0 254 49152 0 64 pcpu 8 3399 2233 4970 0 254 45056 0 32 32 534 852 109172 0 254 44352 0 cpuset 104 27 314 27 0 126 35464 0 32768 32768 1 0 1 0 1 32768 0 16384 16384 2 0 77 0 1 32768 0 8192 8192 4 0 6 0 1 32768 0 2048 2048 8 8 30755283 0 8 32768 0 512 512 20 44 837 0 30 32768 0 UMA Kegs 384 78 6 340 0 30 32256 0 rtentry 208 12 140 18 0 62 31616 0 tcpcb 1008 12 16 6745 0 16 28224 0 mt_zone 24 444 725 455 0 254 28056 0 16 16 250 1500 3284 0 254 28000 0 clpbuf 984 0 28 2818573 0 2 27552 0 swrbuf 984 0 26 41182 0 2 25584 0 tcp_inpcb 488 12 36 6745 0 30 23424 0 16 16 40 1210 43275094 0 254 20000 0 16 16 468 782 901192 0 254 20000 0 8192 8192 2 0 2306 0 1 16384 0 8192 8192 2 0 2 0 1 16384 0 2048 2048 5 3 9877492 0 8 16384 0 VNODEPOLL 120 5 127 291 0 126 15840 0 ripcb 488 1 31 19 0 30 15616 0 MAP 216 2 69 2 0 62 15336 0 512 512 15 9 30 0 30 12288 0 int pcpu 4 498 2574 41250 0 254 12288 0 syncache 168 0 72 2140 0 62 12096 0 mbuf_jumbo_page 4096 0 2 14216029 0 2 8192 0 2048 2048 2 2 512 0 8 8192 0 2048 2048 2 2 5636 0 8 8192 0 epoch_record pcpu 256 4 12 4 0 62 4096 0 4096 4096 1 0 13 0 2 4096 0 2048 2048 2 0 8925 0 8 4096 0 hostcache 96 1 41 1 0 126 4032 0 vmem 1856 1 1 1 0 8 3712 0 UMA Slabs 1 176 14 6 17 0 62 3520 0 SMR CPU 32 1 62 1 0 254 2016 0 SMR SHARED 24 1 62 1 0 254 1512 0 taskq_zone 48 0 0 0 0 254 0 0 dtrace_state_cache 16384 0 0 1 0 1 0 0 TMPFS node 232 0 0 32038723 0 62 0 0 TMPFS dirent 64 0 0 37881519 0 254 0 0 FFS1 dinode 128 0 0 11 0 126 0 0 udplite_inpcb 488 0 0 0 0 30 0 0 sctp_asconf_ack 48 0 0 0 0 254 0 0 sctp_asconf 40 0 0 0 0 254 0 0 sctp_stream_msg_out 112 0 0 0 0 126 0 0 sctp_readq 152 0 0 0 0 62 0 0 sctp_chunk 152 0 0 0 0 62 0 0 sctp_raddr 736 0 0 0 0 16 0 0 sctp_laddr 48 0 0 6 0 254 0 0 sctp_asoc 2288 0 0 0 0 4 0 0 sctp_ep 1280 0 0 0 0 8 0 0 tcp_log_node 120 0 0 0 0 126 0 0 tcp_log_bucket 184 0 0 0 0 62 0 0 tcp_log 408 0 0 0 0 30 0 0 tcpreass 48 0 0 24547 0 254 0 0 tfo_ccache_entries 80 0 0 0 0 126 0 0 tfo 4 0 0 0 0 254 0 0 sackhole 32 0 0 31930 0 254 0 0 tcptw 88 0 0 1180 0 126 0 0 ipq 56 0 0 0 0 254 0 0 IPsec SA lft_c 16 0 0 0 0 254 0 0 itimer 352 0 0 1 0 30 0 0 AIOLIO 280 0 0 0 0 30 0 0 AIOCB 752 0 0 0 0 16 0 0 AIOP 32 0 0 0 0 254 0 0 AIO 208 0 0 0 0 62 0 0 vtnet_tx_hdr 24 0 0 0 0 254 0 0 crypto_session 72 0 0 0 0 126 0 0 cryptop 240 0 0 0 0 62 0 0 nvme_request 128 0 0 0 0 126 0 0 FPU_save_area 832 0 0 0 0 16 0 0 DMAR_MAP_ENTRY 128 0 0 0 0 126 0 0 mbuf_extpgs 256 0 0 0 0 62 0 0 mbuf_jumbo_16k 16384 0 0 0 0 1 0 0 mbuf_jumbo_9k 9216 0 0 0 0 1 0 0 audit_record 1280 0 0 0 0 8 0 0 domainset 40 0 0 0 0 254 0 0 MAC labels 40 0 0 0 0 254 0 0 vnpbuf 984 0 0 2484 0 8 0 0 mdpbuf 984 0 0 337300 0 0 0 0 nfspbuf 984 0 0 0 0 2 0 0 swwbuf 984 0 0 147220 0 0 0 0 umtx_shm 88 0 0 35 0 126 0 0 umtx pi 96 0 0 57808559 0 126 0 0 rangeset pctrie nodes 144 0 0 0 0 62 0 0 65536 65536 0 0 12 0 1 0 0 32768 32768 0 0 0 0 1 0 0 32768 32768 0 0 0 0 1 0 0 16384 16384 0 0 0 0 1 0 0 16384 16384 0 0 0 0 1 0 0 16384 16384 0 0 0 0 1 0 0 8192 8192 0 0 0 0 1 0 0 UMA Hash 256 0 0 0 0 62 0 0 db:0:pho> show umacache Zone Size Used Free Requests Bucket debugnet_mbuf_packet 2048 0 0 0 0 debugnet_mbuf_cluster 2048 -6144 0 0 0 debugnet_mbuf 256 -10240 0 0 0 kstack_cache 16384 3583 18 37387359 1 vm pgcache 4096 109971 2294 254433448 16 vm pgcache 4096 185132 2135 502633290 12 buf free cache 984 3430 1273 50810300 16 buffer arena-65 65536 2 7 192 1 buffer arena-61 61440 0 0 0 1 buffer arena-57 57344 0 0 0 1 buffer arena-53 53248 0 0 0 1 buffer arena-49 49152 0 0 0 1 buffer arena-45 45056 0 0 0 1 buffer arena-40 40960 0 0 0 1 buffer arena-36 36864 0 0 0 1 buffer arena-32 32768 289 1158 31882689 15 buffer arena-28 28672 0 0 0 1 buffer arena-24 24576 0 0 0 1 buffer arena-20 20480 0 0 0 1 buffer arena-16 16384 17 56 3936733 1 buffer arena-12 12288 0 0 0 1 buffer arena-81 8192 0 0 0 1 buffer arena-40 4096 0 0 36 2 db:0:pho> acttrace Tracing command egrep pid 70528 tid 101199 td 0xfffffe00e7a6a300 (CPU 1) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e17de00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e17de10 trap() at trap+0x56/frame 0xfffffe003e17df20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e17df20 --- trap 0x13, rip = 0xffffffff80c0c160, rsp = 0xfffffe00e81a2590, rbp = 0xfffffe00e81a25a0 --- lock_delay() at lock_delay+0x30/frame 0xfffffe00e81a25a0 _mtx_lock_spin_cookie() at _mtx_lock_spin_cookie+0xc1/frame 0xfffffe00e81a2610 __mtx_lock_spin_flags() at __mtx_lock_spin_flags+0xd5/frame 0xfffffe00e81a2650 smp_targeted_tlb_shootdown() at smp_targeted_tlb_shootdown+0xbf/frame 0xfffffe00e81a26c0 pmap_invalidate_all() at pmap_invalidate_all+0x123/frame 0xfffffe00e81a2720 pmap_remove() at pmap_remove+0x4cd/frame 0xfffffe00e81a2790 vm_map_delete() at vm_map_delete+0x3e0/frame 0xfffffe00e81a27f0 vm_map_remove() at vm_map_remove+0x81/frame 0xfffffe00e81a2820 pipeclose() at pipeclose+0x2c7/frame 0xfffffe00e81a2860 pipe_close() at pipe_close+0x5f/frame 0xfffffe00e81a2890 _fdrop() at _fdrop+0x1a/frame 0xfffffe00e81a28b0 closef() at closef+0x1db/frame 0xfffffe00e81a2940 fdescfree_fds() at fdescfree_fds+0x3c/frame 0xfffffe00e81a2990 fdescfree() at fdescfree+0x36c/frame 0xfffffe00e81a2a50 exit1() at exit1+0x4a3/frame 0xfffffe00e81a2ac0 sys_sys_exit() at sys_sys_exit+0xd/frame 0xfffffe00e81a2ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e81a2bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e81a2bf0 --- syscall (1, FreeBSD ELF64, sys_sys_exit), rip = 0x80040c95a, rsp = 0x7fffffffe518, rbp = 0x7fffffffe530 --- Tracing command sh pid 70523 tid 104588 td 0xfffffe015c08c300 (CPU 3) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e195e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e195e10 trap() at trap+0x56/frame 0xfffffe003e195f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e195f20 --- trap 0x13, rip = 0xffffffff80c0c160, rsp = 0xfffffe0300245700, rbp = 0xfffffe0300245710 --- lock_delay() at lock_delay+0x30/frame 0xfffffe0300245710 _sx_xlock_hard() at _sx_xlock_hard+0x199/frame 0xfffffe03002457b0 _sx_xlock() at _sx_xlock+0xba/frame 0xfffffe03002457f0 vm_map_remove() at vm_map_remove+0x4f/frame 0xfffffe0300245820 pipeclose() at pipeclose+0x2c7/frame 0xfffffe0300245860 pipe_close() at pipe_close+0x5f/frame 0xfffffe0300245890 _fdrop() at _fdrop+0x1a/frame 0xfffffe03002458b0 closef() at closef+0x1db/frame 0xfffffe0300245940 fdescfree_fds() at fdescfree_fds+0x3c/frame 0xfffffe0300245990 fdescfree() at fdescfree+0x36c/frame 0xfffffe0300245a50 exit1() at exit1+0x4a3/frame 0xfffffe0300245ac0 sys_sys_exit() at sys_sys_exit+0xd/frame 0xfffffe0300245ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe0300245bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0300245bf0 --- syscall (1, FreeBSD ELF64, sys_sys_exit), rip = 0x80040b95a, rsp = 0x7fffffffe5a8, rbp = 0x7fffffffe690 --- Tracing command umount pid 70519 tid 101756 td 0xfffffe012a29f700 (CPU 9) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1dde00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1dde10 trap() at trap+0x56/frame 0xfffffe003e1ddf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1ddf20 --- trap 0x13, rip = 0xffffffff80c2db5a, rsp = 0xfffffe00ef747618, rbp = 0xfffffe00ef747630 --- witness_unlock() at witness_unlock+0xa/frame 0xfffffe00ef747630 _rw_wunlock_cookie() at _rw_wunlock_cookie+0x54/frame 0xfffffe00ef747650 bufobj_invalbuf() at bufobj_invalbuf+0x236/frame 0xfffffe00ef7476b0 vgonel() at vgonel+0x2be/frame 0xfffffe00ef747710 vflush() at vflush+0x303/frame 0xfffffe00ef747850 ffs_flushfiles() at ffs_flushfiles+0x175/frame 0xfffffe00ef7478c0 ffs_unmount() at ffs_unmount+0xea/frame 0xfffffe00ef747940 dounmount() at dounmount+0x423/frame 0xfffffe00ef7479a0 kern_unmount() at kern_unmount+0x2b9/frame 0xfffffe00ef747ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00ef747bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ef747bf0 --- syscall (22, FreeBSD ELF64, sys_unmount), rip = 0x8002e1eda, rsp = 0x7fffffffd278, rbp = 0x7fffffffd7b0 --- Tracing command umount pid 70518 tid 101272 td 0xfffffe015a984c00 (CPU 10) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1e9e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1e9e10 trap() at trap+0x56/frame 0xfffffe003e1e9f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1e9f20 --- trap 0x13, rip = 0xffffffff80c0c162, rsp = 0xfffffe00ea1127d0, rbp = 0xfffffe00ea1127e0 --- lock_delay() at lock_delay+0x32/frame 0xfffffe00ea1127e0 _sx_xlock_hard() at _sx_xlock_hard+0x199/frame 0xfffffe00ea112880 _sx_xlock() at _sx_xlock+0xba/frame 0xfffffe00ea1128c0 ffs_unmount() at ffs_unmount+0x335/frame 0xfffffe00ea112940 dounmount() at dounmount+0x423/frame 0xfffffe00ea1129a0 kern_unmount() at kern_unmount+0x2b9/frame 0xfffffe00ea112ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00ea112bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ea112bf0 --- syscall (22, FreeBSD ELF64, sys_unmount), rip = 0x8002e1eda, rsp = 0x7fffffffd278, rbp = 0x7fffffffd7b0 --- Tracing command umount pid 70510 tid 100820 td 0xfffffe015ce69700 (CPU 11) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1f5e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1f5e10 trap() at trap+0x56/frame 0xfffffe003e1f5f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1f5f20 --- trap 0x13, rip = 0xffffffff80c0c162, rsp = 0xfffffe00ebe317d0, rbp = 0xfffffe00ebe317e0 --- lock_delay() at lock_delay+0x32/frame 0xfffffe00ebe317e0 _sx_xlock_hard() at _sx_xlock_hard+0x199/frame 0xfffffe00ebe31880 _sx_xlock() at _sx_xlock+0xba/frame 0xfffffe00ebe318c0 ffs_unmount() at ffs_unmount+0x335/frame 0xfffffe00ebe31940 dounmount() at dounmount+0x423/frame 0xfffffe00ebe319a0 kern_unmount() at kern_unmount+0x2b9/frame 0xfffffe00ebe31ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00ebe31bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ebe31bf0 --- syscall (22, FreeBSD ELF64, sys_unmount), rip = 0x8002e1eda, rsp = 0x7fffffffd278, rbp = 0x7fffffffd7b0 --- Tracing command umount pid 70506 tid 100899 td 0xfffffe0179ba8500 (CPU 5) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1ade00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1ade10 trap() at trap+0x56/frame 0xfffffe003e1adf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1adf20 --- trap 0x13, rip = 0xffffffff80c0c160, rsp = 0xfffffe030fdee370, rbp = 0xfffffe030fdee380 --- lock_delay() at lock_delay+0x30/frame 0xfffffe030fdee380 _mtx_lock_spin_cookie() at _mtx_lock_spin_cookie+0xc1/frame 0xfffffe030fdee3f0 __mtx_lock_spin_flags() at __mtx_lock_spin_flags+0xd5/frame 0xfffffe030fdee430 smp_targeted_tlb_shootdown() at smp_targeted_tlb_shootdown+0xbf/frame 0xfffffe030fdee4a0 pmap_invalidate_range() at pmap_invalidate_range+0x1b8/frame 0xfffffe030fdee510 allocbuf() at allocbuf+0x1fe/frame 0xfffffe030fdee570 brelse() at brelse+0x3d7/frame 0xfffffe030fdee5d0 flushbuflist() at flushbuflist+0x166/frame 0xfffffe030fdee650 bufobj_invalbuf() at bufobj_invalbuf+0x8b/frame 0xfffffe030fdee6b0 vgonel() at vgonel+0x2be/frame 0xfffffe030fdee710 vflush() at vflush+0x303/frame 0xfffffe030fdee850 ffs_flushfiles() at ffs_flushfiles+0x175/frame 0xfffffe030fdee8c0 ffs_unmount() at ffs_unmount+0xea/frame 0xfffffe030fdee940 dounmount() at dounmount+0x423/frame 0xfffffe030fdee9a0 kern_unmount() at kern_unmount+0x2b9/frame 0xfffffe030fdeead0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe030fdeebf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe030fdeebf0 --- syscall (22, FreeBSD ELF64, sys_unmount), rip = 0x8002e1eda, rsp = 0x7fffffffd278, rbp = 0x7fffffffd7b0 --- Tracing command umount pid 70499 tid 104616 td 0xfffffe00ef239000 (CPU 6) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1b9e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1b9e10 trap() at trap+0x56/frame 0xfffffe003e1b9f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1b9f20 --- trap 0x13, rip = 0xffffffff80c0c160, rsp = 0xfffffe03002957d0, rbp = 0xfffffe03002957e0 --- lock_delay() at lock_delay+0x30/frame 0xfffffe03002957e0 _sx_xlock_hard() at _sx_xlock_hard+0x199/frame 0xfffffe0300295880 _sx_xlock() at _sx_xlock+0xba/frame 0xfffffe03002958c0 ffs_unmount() at ffs_unmount+0x335/frame 0xfffffe0300295940 dounmount() at dounmount+0x423/frame 0xfffffe03002959a0 kern_unmount() at kern_unmount+0x2b9/frame 0xfffffe0300295ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe0300295bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0300295bf0 --- syscall (22, FreeBSD ELF64, sys_unmount), rip = 0x8002e1eda, rsp = 0x7fffffffd278, rbp = 0x7fffffffd7b0 --- Tracing command umount pid 70497 tid 104744 td 0xfffffe00e7c84300 (CPU 2) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e189e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e189e10 trap() at trap+0x56/frame 0xfffffe003e189f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e189f20 --- trap 0x13, rip = 0xffffffff80c0c162, rsp = 0xfffffe030fc9f550, rbp = 0xfffffe030fc9f560 --- lock_delay() at lock_delay+0x32/frame 0xfffffe030fc9f560 _mtx_lock_spin_cookie() at _mtx_lock_spin_cookie+0xc1/frame 0xfffffe030fc9f5d0 __mtx_lock_spin_flags() at __mtx_lock_spin_flags+0xd5/frame 0xfffffe030fc9f610 smp_targeted_tlb_shootdown() at smp_targeted_tlb_shootdown+0xbf/frame 0xfffffe030fc9f680 pmap_invalidate_range() at pmap_invalidate_range+0x1b8/frame 0xfffffe030fc9f6f0 allocbuf() at allocbuf+0x1fe/frame 0xfffffe030fc9f750 brelse() at brelse+0x3d7/frame 0xfffffe030fc9f7b0 flushbuflist() at flushbuflist+0x166/frame 0xfffffe030fc9f830 bufobj_invalbuf() at bufobj_invalbuf+0x8b/frame 0xfffffe030fc9f890 g_vfs_close() at g_vfs_close+0x46/frame 0xfffffe030fc9f8c0 ffs_unmount() at ffs_unmount+0x36e/frame 0xfffffe030fc9f940 dounmount() at dounmount+0x423/frame 0xfffffe030fc9f9a0 kern_unmount() at kern_unmount+0x2b9/frame 0xfffffe030fc9fad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe030fc9fbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe030fc9fbf0 --- syscall (22, FreeBSD ELF64, sys_unmount), rip = 0x8002e1eda, rsp = 0x7fffffffd278, rbp = 0x7fffffffd7b0 --- Tracing command sh pid 70426 tid 102276 td 0xfffffe00d5dfd800 (CPU 8) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1d1e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1d1e10 trap() at trap+0x56/frame 0xfffffe003e1d1f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1d1f20 --- trap 0x13, rip = 0xffffffff80c0c162, rsp = 0xfffffe02fa6a5850, rbp = 0xfffffe02fa6a5860 --- lock_delay() at lock_delay+0x32/frame 0xfffffe02fa6a5860 _sx_xlock_hard() at _sx_xlock_hard+0x199/frame 0xfffffe02fa6a5900 _sx_xlock() at _sx_xlock+0xba/frame 0xfffffe02fa6a5940 vm_map_remove() at vm_map_remove+0x4f/frame 0xfffffe02fa6a5970 pipeclose() at pipeclose+0x2c7/frame 0xfffffe02fa6a59b0 pipe_close() at pipe_close+0x5f/frame 0xfffffe02fa6a59e0 _fdrop() at _fdrop+0x1a/frame 0xfffffe02fa6a5a00 closef() at closef+0x1db/frame 0xfffffe02fa6a5a90 closefp() at closefp+0x96/frame 0xfffffe02fa6a5ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe02fa6a5bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe02fa6a5bf0 --- syscall (6, FreeBSD ELF64, sys_close), rip = 0x80047a83a, rsp = 0x7fffffffe0f8, rbp = 0x7fffffffe250 --- Tracing command md14 pid 54526 tid 101045 td 0xfffffe0148251e00 (CPU 0) cpustop_handler() at cpustop_handler+0x26/frame 0xffffffff81d88600 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xffffffff81d88610 trap() at trap+0x56/frame 0xffffffff81d88720 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81d88720 --- trap 0x13, rip = 0xffffffff80c0c160, rsp = 0xfffffe00e973d740, rbp = 0xfffffe00e973d750 --- lock_delay() at lock_delay+0x30/frame 0xfffffe00e973d750 _mtx_lock_spin_cookie() at _mtx_lock_spin_cookie+0xc1/frame 0xfffffe00e973d7c0 __mtx_lock_spin_flags() at __mtx_lock_spin_flags+0xd5/frame 0xfffffe00e973d800 smp_targeted_tlb_shootdown() at smp_targeted_tlb_shootdown+0xbf/frame 0xfffffe00e973d870 pmap_invalidate_range() at pmap_invalidate_range+0x1b8/frame 0xfffffe00e973d8e0 allocbuf() at allocbuf+0xfd/frame 0xfffffe00e973d940 brelse() at brelse+0x1c1/frame 0xfffffe00e973d9a0 bufdone() at bufdone+0x392/frame 0xfffffe00e973da10 ffs_backgroundwritedone() at ffs_backgroundwritedone+0xc2/frame 0xfffffe00e973da40 bufdone() at bufdone+0x6c/frame 0xfffffe00e973dab0 g_io_deliver() at g_io_deliver+0x25e/frame 0xfffffe00e973db00 g_io_deliver() at g_io_deliver+0x25e/frame 0xfffffe00e973db50 md_kthread() at md_kthread+0x259/frame 0xfffffe00e973dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e973dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e973dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vnlru pid 34 tid 100141 td 0xfffffe00d35df500 (CPU 4) kdb_enter() at kdb_enter+0x37/frame 0xfffffe00de9f86f0 vpanic() at vpanic+0x19e/frame 0xfffffe00de9f8740 panic() at panic+0x43/frame 0xfffffe00de9f87a0 trap_fatal() at trap_fatal+0x387/frame 0xfffffe00de9f8800 trap_pfault() at trap_pfault+0x99/frame 0xfffffe00de9f8860 trap() at trap+0x2a5/frame 0xfffffe00de9f8970 calltrap() at calltrap+0x8/frame 0xfffffe00de9f8970 --- trap 0xc, rip = 0xffffffff80ee9cee, rsp = 0xfffffe00de9f8a40, rbp = 0xfffffe00de9f8a90 --- ufs_reclaim() at ufs_reclaim+0x10e/frame 0xfffffe00de9f8a90 VOP_RECLAIM_APV() at VOP_RECLAIM_APV+0x59/frame 0xfffffe00de9f8ab0 vgonel() at vgonel+0x3b7/frame 0xfffffe00de9f8b10 vnlru_proc() at vnlru_proc+0x7fb/frame 0xfffffe00de9f8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00de9f8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00de9f8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100062 td 0xfffffe003e1efe00 (CPU 7) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1c5e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1c5e10 trap() at trap+0x56/frame 0xfffffe003e1c5f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1c5f20 --- trap 0x13, rip = 0xffffffff80c0c162, rsp = 0xfffffe0037acda80, rbp = 0xfffffe0037acda90 --- lock_delay() at lock_delay+0x32/frame 0xfffffe0037acda90 _sx_xlock_hard() at _sx_xlock_hard+0x199/frame 0xfffffe0037acdb30 _sx_xlock() at _sx_xlock+0xba/frame 0xfffffe0037acdb70 g_run_events() at g_run_events+0x7e/frame 0xfffffe0037acdbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037acdbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037acdbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:pho> ps pid ppid pgrp uid state wmesg wchan cmd 70528 70431 2779 0 RE CPU 1 egrep 70523 70426 46992 0 RE+ CPU 3 sh 70522 54609 46992 0 S+ nanslp 0xffffffff81c83953 sleep 70521 54640 46992 0 S+ nanslp 0xffffffff81c83954 sleep 70519 54608 46992 0 R+ CPU 9 umount 70518 54636 46992 0 R+ CPU 10 umount 70517 54641 46992 0 D+ g_waiti 0xffffffff81c7c8e0 umount 70515 54646 46992 0 D+ g_waiti 0xffffffff81c7c8e0 umount 70511 54642 46992 0 S+ nanslp 0xffffffff81c83953 sleep 70510 54628 46992 0 R+ CPU 11 umount 70509 54616 46992 0 S+ nanslp 0xffffffff81c83953 sleep 70507 54651 46992 0 S+ nanslp 0xffffffff81c83956 sleep 70506 54639 46992 0 R+ CPU 5 umount 70505 54654 46992 0 D+ g_waiti 0xffffffff81c7c8e0 umount 70504 54613 46992 0 S+ nanslp 0xffffffff81c83959 sleep 70503 54620 46992 0 D+ bo_wwai 0xfffff8022bb1d200 umount 70502 54611 46992 0 S+ nanslp 0xffffffff81c83950 sleep 70501 54655 46992 0 S+ nanslp 0xffffffff81c8395a sleep 70500 54637 46992 0 S+ nanslp 0xffffffff81c83953 sleep 70499 54612 46992 0 R+ CPU 6 umount 70497 54623 46992 0 R+ CPU 2 umount 70496 54633 46992 0 S+ nanslp 0xffffffff81c83951 sleep 70483 54624 46992 0 S+ nanslp 0xffffffff81c83952 sleep 70476 54614 46992 0 D+ mntref 0xfffffe00e8785000 umount 70431 2829 2779 0 S wait 0xfffff8035d98aa50 sh 70426 54460 46992 0 R+ CPU 8 sh 54655 54460 46992 0 S+ wait 0xfffff80300ee8000 sh 54654 54460 46992 0 S+ wait 0xfffff80359fc6a50 sh 54651 54460 46992 0 S+ wait 0xfffff8035ea47a50 sh 54646 54460 46992 0 S+ wait 0xfffff8035dc4a000 sh 54642 54460 46992 0 S+ wait 0xfffff80358c13528 sh 54641 54460 46992 0 S+ wait 0xfffff802a14fb000 sh 54640 54460 46992 0 S+ wait 0xfffff8035cd06000 sh 54639 54460 46992 0 S+ wait 0xfffff8035a543000 sh 54637 54460 46992 0 S+ wait 0xfffff803598fa000 sh 54636 54460 46992 0 S+ wait 0xfffff803fc67b528 sh 54633 54460 46992 0 S+ wait 0xfffff802a1435000 sh 54628 54460 46992 0 S+ wait 0xfffff8035a7ca000 sh 54624 54460 46992 0 S+ wait 0xfffff800219c4528 sh 54623 54460 46992 0 S+ wait 0xfffff803fc47a528 sh 54620 54460 46992 0 S+ wait 0xfffff80357c34000 sh 54616 54460 46992 0 S+ wait 0xfffff80358fe9a50 sh 54614 54460 46992 0 S+ wait 0xfffff802a15a9528 sh 54613 54460 46992 0 S+ wait 0xfffff803fce37a50 sh 54612 54460 46992 0 S+ wait 0xfffff8035892e000 sh 54611 54460 46992 0 S+ wait 0xfffff8030fca9000 sh 54609 54460 46992 0 S+ wait 0xfffff8035bd6fa50 sh 54608 54460 46992 0 S+ wait 0xfffff80300ee8528 sh 54603 0 0 0 DL mdwait 0xfffff80226b79000 [md21] 54592 0 0 0 DL mdwait 0xfffff803e9423000 [md20] 54581 0 0 0 DL mdwait 0xfffff80506328000 [md19] 54570 0 0 0 DL mdwait 0xfffff8050db05000 [md18] 54559 0 0 0 DL mdwait 0xfffff80583f7b000 [md17] 54548 0 0 0 DL mdwait 0xfffff80678b57000 [md16] 54537 0 0 0 DL mdwait 0xfffff8072935d000 [md15] 54526 0 0 0 RL CPU 0 [md14] 54515 0 0 0 DL mdwait 0xfffff8037efec000 [md13] 54504 0 0 0 DL mdwait 0xfffff8001be3d000 [md12] 54493 0 0 0 DL mdwait 0xfffff801c5936000 [md11] 54482 0 0 0 DL mdwait 0xfffff80433e4c000 [md10] 54460 54458 46992 0 S+ wait 0xfffff803fc47ca50 sh 54459 46992 46992 0 S+ piperd 0xfffff80406f485f0 tee 54458 54457 46992 0 S+ wait 0xfffff803fc4de000 sh 54457 46992 46992 0 S+ wait 0xfffff802a171da50 sh 51721 50833 51721 0 S+ select 0xfffff80719526340 bash 50833 50824 50833 0 S+ pause 0xfffff80358ed10a8 csh 50824 50412 50824 2006 S+ wait 0xfffff80358ed1528 su 50412 50399 50412 2006 Ss+ wait 0xfffff803fc6a6a50 bash 50399 50239 50239 2006 S select 0xfffff80205b6bb40 sshd 50239 2365 50239 0 Ss select 0xfffff8028853bac0 sshd 46992 2445 46992 0 S+ wait 0xfffff8035857c528 sh 66397 0 0 0 DL ftcl 0xffffffff82e064f4 [ftcleanup] 4365 1 4362 2006 S+ select 0xfffff800032804c0 tail 4362 3099 4362 2006 S+ kqread 0xfffff800213c6700 tail 3099 2846 3099 2006 SWs+ wait 0xfffff80021a88a50 bash 2846 2756 2756 2006 S select 0xfffff800041e3340 sshd 2832 2779 2779 0 S piperd 0xfffff80300f1f5f0 sh 2830 2779 2779 0 S piperd 0xfffff80021ae92f8 awk 2829 2779 2779 0 S wait 0xfffff800215e3528 sh 2779 1 2779 0 SWs wait 0xfffff800215e3a50 sh 2756 2365 2756 0 Ss select 0xfffff800216c76c0 sshd 2445 2443 2445 0 S+ wait 0xfffff80021968528 bash 2443 2442 2443 0 SW+ pause 0xfffff800218f2af8 csh 2442 2436 2442 2006 SW+ wait 0xfffff8024f486a50 su 2436 2435 2436 2006 SWs+ wait 0xfffff80004183a50 bash 2435 2432 2432 2006 S select 0xfffff800216c7840 sshd 2432 2365 2432 0 Ss select 0xfffff80021721d40 sshd 2428 2427 2428 0 S+ ttyin 0xfffff80017005cb0 csh 2427 1 2427 0 SWs+ wait 0xfffff8024fdca000 login 2426 1 2426 0 Ss+ ttyin 0xfffff800170080b0 getty 2425 1 2425 0 Ss+ ttyin 0xfffff800211220b0 getty 2424 1 2424 0 Ss+ ttyin 0xfffff800211224b0 getty 2423 1 2423 0 Ss+ ttyin 0xfffff800211228b0 getty 2422 1 2422 0 Ss+ ttyin 0xfffff80021122cb0 getty 2421 1 2421 0 Ss+ ttyin 0xfffff800211210b0 getty 2420 1 2420 0 Ss+ ttyin 0xfffff800211214b0 getty 2419 1 2419 0 Ss+ ttyin 0xfffff800211218b0 getty 2418 1 2418 0 Ss+ ttyin 0xfffff80021121cb0 getty 2369 1 2369 0 Ss nanslp 0xffffffff81c83957 cron 2365 1 2365 0 Ss select 0xfffff8000327f740 sshd 2337 1 2337 0 Ss select 0xfffff8000327f7c0 powerd 2334 1 2334 123 Ss (threaded) ntpd 100201 S select 0xfffff80021721ac0 ntpd 100566 S usem 0xfffff8035ea99b80 ntpd 2269 1 2269 0 Ss rpcsvc 0xfffff80003fda860 NLM: master 2266 1 2266 0 Ss select 0xfffff80003a0cc40 rpc.statd 2220 1 2220 0 Ss nanslp 0xffffffff81c83955 watchdogd 2072 1 2072 0 Ss select 0xfffff80003a0cb40 rpcbind 2062 1 2062 0 Ds bo_wwai 0xfffff8010e3d9480 syslogd 1991 1 1991 0 Ss select 0xfffff80021721b40 devd 1986 1 1986 65 Ss select 0xfffff800041e37c0 dhclient 1927 1 1927 0 Ss select 0xfffff800041e3740 dhclient 1924 1 1924 0 Ss select 0xfffff800032800c0 dhclient 34 0 0 0 RL CPU 4 [vnlru] 33 0 0 0 DL syncer 0xffffffff81d59dd8 [syncer] 32 0 0 0 DL (threaded) [bufdaemon] 100131 D qsleep 0xffffffff81d592d8 [bufdaemon] 100133 D - 0xffffffff8180aa00 [bufspacedaemon-0] 100134 D - 0xffffffff81812cc0 [bufspacedaemon-1] 100135 D - 0xffffffff8181af80 [bufspacedaemon-2] 100136 D - 0xffffffff81823240 [bufspacedaemon-3] 100137 D - 0xffffffff8182b500 [bufspacedaemon-4] 100138 D - 0xffffffff818337c0 [bufspacedaemon-5] 100139 D - 0xffffffff8183ba80 [bufspacedaemon-6] 100150 D sdflush 0xfffff80003925ce8 [/ worker] 100215 D sdflush 0xfffff80003ff68e8 [/tmp worker] 31 0 0 0 DL psleep 0xffffffff81d74c88 [vmdaemon] 30 0 0 0 DL (threaded) [pagedaemon] 100128 D psleep 0xffffffff81da0bd8 [dom0] 100130 D launds 0xffffffff81da0be4 [laundry: dom0] 100132 D umarcl 0xffffffff80effcc0 [uma] 29 0 0 0 DL idle 0xfffff80021286528 [enc_daemon1] 28 0 0 0 DL idle 0xfffff8002120aa50 [enc_daemon0] 27 0 0 0 DL - 0xffffffff81ade1b0 [rand_harvestq] 26 0 0 0 DL waiting 0xffffffff81de61a0 [sctp_iterator] 25 0 0 0 DL - 0xffffffff81d58cdc [soaiod4] 24 0 0 0 DL - 0xffffffff81d58cdc [soaiod3] 23 0 0 0 DL - 0xffffffff81d58cdc [soaiod2] 22 0 0 0 DL - 0xffffffff81d58cdc [soaiod1] 21 0 0 0 DL (threaded) [usb] 100096 D - 0xfffffe00d2d84440 [usbus0] 100097 D - 0xfffffe00d2d84498 [usbus0] 100098 D - 0xfffffe00d2d844f0 [usbus0] 100099 D - 0xfffffe00d2d84548 [usbus0] 100100 D - 0xfffffe00d2d845a0 [usbus0] 100102 D - 0xfffffe003e4a2cf0 [usbus1] 100103 D - 0xfffffe003e4a2d48 [usbus1] 100104 D - 0xfffffe003e4a2da0 [usbus1] 100105 D - 0xfffffe003e4a2df8 [usbus1] 100106 D - 0xfffffe003e4a2e50 [usbus1] 100107 D - 0xfffffe00d2e23cf0 [usbus2] 100108 D - 0xfffffe00d2e23d48 [usbus2] 100109 D - 0xfffffe00d2e23da0 [usbus2] 100110 D - 0xfffffe00d2e23df8 [usbus2] 100111 D - 0xfffffe00d2e23e50 [usbus2] 20 0 0 0 RL (threaded) [cam] 100091 D - 0xffffffff819b95c0 [doneq0] 100092 RunQ [doneq1] 100093 D - 0xffffffff819b96c0 [doneq2] 100125 D - 0xffffffff819b9488 [scanner] 19 0 0 0 DL crypto_ 0xfffff80003af0c50 [crypto returns 11] 18 0 0 0 DL crypto_ 0xfffff80003af0bf0 [crypto returns 10] 17 0 0 0 DL crypto_ 0xfffff80003af0b90 [crypto returns 9] 16 0 0 0 DL crypto_ 0xfffff80003af0b30 [crypto returns 8] 15 0 0 0 DL crypto_ 0xfffff80003af0ad0 [crypto returns 7] 9 0 0 0 DL crypto_ 0xfffff80003af0a70 [crypto returns 6] 8 0 0 0 DL crypto_ 0xfffff80003af0a10 [crypto returns 5] 7 0 0 0 DL crypto_ 0xfffff80003af09b0 [crypto returns 4] 6 0 0 0 DL crypto_ 0xfffff80003af0950 [crypto returns 3] 5 0 0 0 DL crypto_ 0xfffff80003af08f0 [crypto returns 2] 4 0 0 0 DL crypto_ 0xfffff80003af0890 [crypto returns 1] 3 0 0 0 DL crypto_ 0xfffff80003af0830 [crypto returns 0] 2 0 0 0 DL crypto_ 0xffffffff81d6ed10 [crypto] 14 0 0 0 DL seqstat 0xfffff80003a31488 [sequencer 00] 13 0 0 0 RL (threaded) [geom] 100062 Run CPU 7 [g_event] 100063 D - 0xffffffff81d9f218 [g_up] 100064 D - 0xffffffff81d9f210 [g_down] 12 0 0 0 WL (threaded) [intr] 100043 I [swi6: task queue] 100044 I [swi6: Giant taskq] 100046 I [swi5: fast taskq] 100047 I [swi4: clock (0)] 100048 I [swi4: clock (1)] 100049 I [swi4: clock (2)] 100050 I [swi4: clock (3)] 100051 I [swi4: clock (4)] 100052 I [swi4: clock (5)] 100053 I [swi4: clock (6)] 100054 I [swi4: clock (7)] 100055 I [swi4: clock (8)] 100056 I [swi4: clock (9)] 100057 I [swi4: clock (10)] 100058 I [swi4: clock (11)] 100059 I [swi1: netisr 0] 100060 I [swi3: vm] 100094 I [irq56: ahci0] 100095 I [irq19: xhci0] 100101 I [irq18: ehci0 ehci1] 100112 I [irq71: ahci1] 100113 I [swi0: uart uart] 100175 I [irq72: ioat0] 100176 I [irq73: ioat1] 100177 I [irq74: ioat2] 100178 I [irq75: ioat3] 100179 I [irq76: ioat4] 100180 I [irq77: ioat5] 100181 I [irq78: ioat6] 100182 I [irq79: ioat7] 11 0 0 0 RL (threaded) [idle] 100003 CanRun [idle: cpu0] 100004 CanRun [idle: cpu1] 100005 CanRun [idle: cpu2] 100006 CanRun [idle: cpu3] 100007 CanRun [idle: cpu4] 100008 CanRun [idle: cpu5] 100009 CanRun [idle: cpu6] 100010 CanRun [idle: cpu7] 100011 CanRun [idle: cpu8] 100012 CanRun [idle: cpu9] 100013 CanRun [idle: cpu10] 100014 CanRun [idle: cpu11] 1 0 1 0 SLs wait 0xfffff800038ed000 [init] 10 0 0 0 DL audit_w 0xffffffff81de6d28 [audit] 0 0 0 0 DLs (threaded) [kernel] 100000 D swapin 0xffffffff81d8e808 [swapper] 100015 D - 0xfffff800037df100 [softirq_0] 100016 D - 0xfffff800037dee00 [softirq_1] 100017 D - 0xfffff800037dec00 [softirq_2] 100018 D - 0xfffff800037dea00 [softirq_3] 100019 D - 0xfffff800037de800 [softirq_4] 100020 D - 0xfffff800037de600 [softirq_5] 100021 D - 0xfffff800037de400 [softirq_6] 100022 D - 0xfffff800037de200 [softirq_7] 100023 D - 0xfffff800037de000 [softirq_8] 100024 D - 0xfffff800037ddd00 [softirq_9] 100025 D - 0xfffff800037ddb00 [softirq_10] 100026 D - 0xfffff800037dd900 [softirq_11] 100027 D - 0xfffff800037dd700 [if_io_tqg_0] 100028 D - 0xfffff800037dd500 [if_io_tqg_1] 100029 D - 0xfffff800037dd300 [if_io_tqg_2] 100030 D - 0xfffff800037dd100 [if_io_tqg_3] 100031 D - 0xfffff800037dce00 [if_io_tqg_4] 100032 D - 0xfffff800037dcc00 [if_io_tqg_5] 100033 D - 0xfffff800037dca00 [if_io_tqg_6] 100034 D - 0xfffff800037dc800 [if_io_tqg_7] 100035 D - 0xfffff800037dc600 [if_io_tqg_8] 100036 D - 0xfffff800037dc400 [if_io_tqg_9] 100037 D - 0xfffff800037dc200 [if_io_tqg_10] 100038 D - 0xfffff800037dc000 [if_io_tqg_11] 100039 D - 0xfffff8000393b200 [if_config_tqg_0] 100040 D - 0xfffff800037c9e00 [in6m_free taskq] 100041 D - 0xfffff800037c9d00 [aiod_kick taskq] 100042 D - 0xfffff800037c9c00 [kqueue_ctx taskq] 100045 D - 0xfffff800037c9900 [thread taskq] 100061 D - 0xfffff80003a7f300 [firmware taskq] 100066 D - 0xfffff80003a7f100 [crypto_0] 100067 D - 0xfffff80003a7f100 [crypto_1] 100068 D - 0xfffff80003a7f100 [crypto_2] 100069 D - 0xfffff80003a7f100 [crypto_3] 100070 D - 0xfffff80003a7f100 [crypto_4] 100071 D - 0xfffff80003a7f100 [crypto_5] 100072 D - 0xfffff80003a7f100 [crypto_6] 100073 D - 0xfffff80003a7f100 [crypto_7] 100074 D - 0xfffff80003a7f100 [crypto_8] 100075 D - 0xfffff80003a7f100 [crypto_9] 100076 D - 0xfffff80003a7f100 [crypto_10] 100077 D - 0xfffff80003a7f100 [crypto_11] 100114 D - 0xfffff80017081b00 [mca taskq] 100121 D - 0xfffff8002110f500 [acpi_task_0] 100122 D - 0xfffff8002110f500 [acpi_task_1] 100123 D - 0xfffff8002110f500 [acpi_task_2] 100124 D - 0xfffff80003a80d00 [CAM taskq] 100271 D - 0xfffff80300f82e00 [dtrace_taskq] 100272 D - 0xfffff80300fe9200 [system_taskq_0] 100273 D - 0xfffff80300fe9200 [system_taskq_1] 100274 D - 0xfffff80300fe9200 [system_taskq_2] 100276 D - 0xfffff80300fe9200 [system_taskq_3] 100277 D - 0xfffff80300fe9200 [system_taskq_4] 100278 D - 0xfffff80300fe9200 [system_taskq_5] 100279 D - 0xfffff80300fe9200 [system_taskq_6] 100280 D - 0xfffff80300fe9200 [system_taskq_7] 100281 D - 0xfffff80300fe9200 [system_taskq_8] 100284 D - 0xfffff80300fe9200 [system_taskq_9] 100286 D - 0xfffff80300fe9200 [system_taskq_10] 100289 D - 0xfffff80300fe9200 [system_taskq_11] 89287 1 69388 0 Z+ pdfork db:0:pho> allt Tracing command egrep pid 70528 tid 101199 td 0xfffffe00e7a6a300 (CPU 1) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e17de00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e17de10 trap() at trap+0x56/frame 0xfffffe003e17df20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e17df20 --- trap 0x13, rip = 0xffffffff80c0c160, rsp = 0xfffffe00e81a2590, rbp = 0xfffffe00e81a25a0 --- lock_delay() at lock_delay+0x30/frame 0xfffffe00e81a25a0 _mtx_lock_spin_cookie() at _mtx_lock_spin_cookie+0xc1/frame 0xfffffe00e81a2610 __mtx_lock_spin_flags() at __mtx_lock_spin_flags+0xd5/frame 0xfffffe00e81a2650 smp_targeted_tlb_shootdown() at smp_targeted_tlb_shootdown+0xbf/frame 0xfffffe00e81a26c0 pmap_invalidate_all() at pmap_invalidate_all+0x123/frame 0xfffffe00e81a2720 pmap_remove() at pmap_remove+0x4cd/frame 0xfffffe00e81a2790 vm_map_delete() at vm_map_delete+0x3e0/frame 0xfffffe00e81a27f0 vm_map_remove() at vm_map_remove+0x81/frame 0xfffffe00e81a2820 pipeclose() at pipeclose+0x2c7/frame 0xfffffe00e81a2860 pipe_close() at pipe_close+0x5f/frame 0xfffffe00e81a2890 _fdrop() at _fdrop+0x1a/frame 0xfffffe00e81a28b0 closef() at closef+0x1db/frame 0xfffffe00e81a2940 fdescfree_fds() at fdescfree_fds+0x3c/frame 0xfffffe00e81a2990 fdescfree() at fdescfree+0x36c/frame 0xfffffe00e81a2a50 exit1() at exit1+0x4a3/frame 0xfffffe00e81a2ac0 sys_sys_exit() at sys_sys_exit+0xd/frame 0xfffffe00e81a2ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e81a2bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e81a2bf0 --- syscall (1, FreeBSD ELF64, sys_sys_exit), rip = 0x80040c95a, rsp = 0x7fffffffe518, rbp = 0x7fffffffe530 --- Tracing command sh pid 70523 tid 104588 td 0xfffffe015c08c300 (CPU 3) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e195e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e195e10 trap() at trap+0x56/frame 0xfffffe003e195f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e195f20 --- trap 0x13, rip = 0xffffffff80c0c160, rsp = 0xfffffe0300245700, rbp = 0xfffffe0300245710 --- lock_delay() at lock_delay+0x30/frame 0xfffffe0300245710 _sx_xlock_hard() at _sx_xlock_hard+0x199/frame 0xfffffe03002457b0 _sx_xlock() at _sx_xlock+0xba/frame 0xfffffe03002457f0 vm_map_remove() at vm_map_remove+0x4f/frame 0xfffffe0300245820 pipeclose() at pipeclose+0x2c7/frame 0xfffffe0300245860 pipe_close() at pipe_close+0x5f/frame 0xfffffe0300245890 _fdrop() at _fdrop+0x1a/frame 0xfffffe03002458b0 closef() at closef+0x1db/frame 0xfffffe0300245940 fdescfree_fds() at fdescfree_fds+0x3c/frame 0xfffffe0300245990 fdescfree() at fdescfree+0x36c/frame 0xfffffe0300245a50 exit1() at exit1+0x4a3/frame 0xfffffe0300245ac0 sys_sys_exit() at sys_sys_exit+0xd/frame 0xfffffe0300245ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe0300245bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0300245bf0 --- syscall (1, FreeBSD ELF64, sys_sys_exit), rip = 0x80040b95a, rsp = 0x7fffffffe5a8, rbp = 0x7fffffffe690 --- Tracing command sleep pid 70522 tid 102054 td 0xfffffe00e9277300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e514c870 mi_switch() at mi_switch+0x155/frame 0xfffffe00e514c890 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e514c8d0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e514c930 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e514c970 _sleep() at _sleep+0x258/frame 0xfffffe00e514ca10 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe00e514ca90 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00e514cad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e514cbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e514cbf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003abbaa, rsp = 0x7fffffffe6c8, rbp = 0x7fffffffe710 --- Tracing command sleep pid 70521 tid 101902 td 0xfffffe013dc48800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00ec025870 mi_switch() at mi_switch+0x155/frame 0xfffffe00ec025890 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00ec0258d0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00ec025930 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00ec025970 _sleep() at _sleep+0x258/frame 0xfffffe00ec025a10 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe00ec025a90 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00ec025ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00ec025bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ec025bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003abbaa, rsp = 0x7fffffffe6c8, rbp = 0x7fffffffe710 --- Tracing command umount pid 70519 tid 101756 td 0xfffffe012a29f700 (CPU 9) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1dde00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1dde10 trap() at trap+0x56/frame 0xfffffe003e1ddf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1ddf20 --- trap 0x13, rip = 0xffffffff80c2db5a, rsp = 0xfffffe00ef747618, rbp = 0xfffffe00ef747630 --- witness_unlock() at witness_unlock+0xa/frame 0xfffffe00ef747630 _rw_wunlock_cookie() at _rw_wunlock_cookie+0x54/frame 0xfffffe00ef747650 bufobj_invalbuf() at bufobj_invalbuf+0x236/frame 0xfffffe00ef7476b0 vgonel() at vgonel+0x2be/frame 0xfffffe00ef747710 vflush() at vflush+0x303/frame 0xfffffe00ef747850 ffs_flushfiles() at ffs_flushfiles+0x175/frame 0xfffffe00ef7478c0 ffs_unmount() at ffs_unmount+0xea/frame 0xfffffe00ef747940 dounmount() at dounmount+0x423/frame 0xfffffe00ef7479a0 kern_unmount() at kern_unmount+0x2b9/frame 0xfffffe00ef747ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00ef747bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ef747bf0 --- syscall (22, FreeBSD ELF64, sys_unmount), rip = 0x8002e1eda, rsp = 0x7fffffffd278, rbp = 0x7fffffffd7b0 --- Tracing command umount pid 70518 tid 101272 td 0xfffffe015a984c00 (CPU 10) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1e9e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1e9e10 trap() at trap+0x56/frame 0xfffffe003e1e9f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1e9f20 --- trap 0x13, rip = 0xffffffff80c0c162, rsp = 0xfffffe00ea1127d0, rbp = 0xfffffe00ea1127e0 --- lock_delay() at lock_delay+0x32/frame 0xfffffe00ea1127e0 _sx_xlock_hard() at _sx_xlock_hard+0x199/frame 0xfffffe00ea112880 _sx_xlock() at _sx_xlock+0xba/frame 0xfffffe00ea1128c0 ffs_unmount() at ffs_unmount+0x335/frame 0xfffffe00ea112940 dounmount() at dounmount+0x423/frame 0xfffffe00ea1129a0 kern_unmount() at kern_unmount+0x2b9/frame 0xfffffe00ea112ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00ea112bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ea112bf0 --- syscall (22, FreeBSD ELF64, sys_unmount), rip = 0x8002e1eda, rsp = 0x7fffffffd278, rbp = 0x7fffffffd7b0 --- Tracing command umount pid 70517 tid 100602 td 0xfffffe013eeb8500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0300272910 mi_switch() at mi_switch+0x155/frame 0xfffffe0300272930 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0300272970 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe03002729b0 _sleep() at _sleep+0x26c/frame 0xfffffe0300272a50 g_waitidle() at g_waitidle+0x9f/frame 0xfffffe0300272a70 userret() at userret+0x32a/frame 0xfffffe0300272ad0 amd64_syscall() at amd64_syscall+0x213/frame 0xfffffe0300272bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0300272bf0 --- syscall (0, FreeBSD ELF64, nosys), rip = 0x8002e1eda, rsp = 0x7fffffffd278, rbp = 0x7fffffffd7b0 --- Tracing command umount pid 70515 tid 100858 td 0xfffffe012902ba00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e80c4910 mi_switch() at mi_switch+0x155/frame 0xfffffe00e80c4930 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e80c4970 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e80c49b0 _sleep() at _sleep+0x26c/frame 0xfffffe00e80c4a50 g_waitidle() at g_waitidle+0x9f/frame 0xfffffe00e80c4a70 userret() at userret+0x32a/frame 0xfffffe00e80c4ad0 amd64_syscall() at amd64_syscall+0x213/frame 0xfffffe00e80c4bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e80c4bf0 --- syscall (0, FreeBSD ELF64, nosys), rip = 0x8002e1eda, rsp = 0x7fffffffd278, rbp = 0x7fffffffd7b0 --- Tracing command sleep pid 70511 tid 104494 td 0xfffffe00e91f0300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe02fe6ea870 mi_switch() at mi_switch+0x155/frame 0xfffffe02fe6ea890 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe02fe6ea8d0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe02fe6ea930 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe02fe6ea970 _sleep() at _sleep+0x258/frame 0xfffffe02fe6eaa10 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe02fe6eaa90 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe02fe6eaad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe02fe6eabf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe02fe6eabf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003abbaa, rsp = 0x7fffffffe6c8, rbp = 0x7fffffffe710 --- Tracing command umount pid 70510 tid 100820 td 0xfffffe015ce69700 (CPU 11) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1f5e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1f5e10 trap() at trap+0x56/frame 0xfffffe003e1f5f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1f5f20 --- trap 0x13, rip = 0xffffffff80c0c162, rsp = 0xfffffe00ebe317d0, rbp = 0xfffffe00ebe317e0 --- lock_delay() at lock_delay+0x32/frame 0xfffffe00ebe317e0 _sx_xlock_hard() at _sx_xlock_hard+0x199/frame 0xfffffe00ebe31880 _sx_xlock() at _sx_xlock+0xba/frame 0xfffffe00ebe318c0 ffs_unmount() at ffs_unmount+0x335/frame 0xfffffe00ebe31940 dounmount() at dounmount+0x423/frame 0xfffffe00ebe319a0 kern_unmount() at kern_unmount+0x2b9/frame 0xfffffe00ebe31ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00ebe31bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ebe31bf0 --- syscall (22, FreeBSD ELF64, sys_unmount), rip = 0x8002e1eda, rsp = 0x7fffffffd278, rbp = 0x7fffffffd7b0 --- Tracing command sleep pid 70509 tid 101553 td 0xfffffe00ef3a8c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe02fa74f870 mi_switch() at mi_switch+0x155/frame 0xfffffe02fa74f890 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe02fa74f8d0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe02fa74f930 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe02fa74f970 _sleep() at _sleep+0x258/frame 0xfffffe02fa74fa10 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe02fa74fa90 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe02fa74fad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe02fa74fbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe02fa74fbf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003abbaa, rsp = 0x7fffffffe6c8, rbp = 0x7fffffffe710 --- Tracing command sleep pid 70507 tid 103353 td 0xfffffe012677a100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe02fc24f870 mi_switch() at mi_switch+0x155/frame 0xfffffe02fc24f890 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe02fc24f8d0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe02fc24f930 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe02fc24f970 _sleep() at _sleep+0x258/frame 0xfffffe02fc24fa10 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe02fc24fa90 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe02fc24fad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe02fc24fbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe02fc24fbf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003abbaa, rsp = 0x7fffffffe6c8, rbp = 0x7fffffffe710 --- Tracing command umount pid 70506 tid 100899 td 0xfffffe0179ba8500 (CPU 5) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1ade00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1ade10 trap() at trap+0x56/frame 0xfffffe003e1adf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1adf20 --- trap 0x13, rip = 0xffffffff80c0c160, rsp = 0xfffffe030fdee370, rbp = 0xfffffe030fdee380 --- lock_delay() at lock_delay+0x30/frame 0xfffffe030fdee380 _mtx_lock_spin_cookie() at _mtx_lock_spin_cookie+0xc1/frame 0xfffffe030fdee3f0 __mtx_lock_spin_flags() at __mtx_lock_spin_flags+0xd5/frame 0xfffffe030fdee430 smp_targeted_tlb_shootdown() at smp_targeted_tlb_shootdown+0xbf/frame 0xfffffe030fdee4a0 pmap_invalidate_range() at pmap_invalidate_range+0x1b8/frame 0xfffffe030fdee510 allocbuf() at allocbuf+0x1fe/frame 0xfffffe030fdee570 brelse() at brelse+0x3d7/frame 0xfffffe030fdee5d0 flushbuflist() at flushbuflist+0x166/frame 0xfffffe030fdee650 bufobj_invalbuf() at bufobj_invalbuf+0x8b/frame 0xfffffe030fdee6b0 vgonel() at vgonel+0x2be/frame 0xfffffe030fdee710 vflush() at vflush+0x303/frame 0xfffffe030fdee850 ffs_flushfiles() at ffs_flushfiles+0x175/frame 0xfffffe030fdee8c0 ffs_unmount() at ffs_unmount+0xea/frame 0xfffffe030fdee940 dounmount() at dounmount+0x423/frame 0xfffffe030fdee9a0 kern_unmount() at kern_unmount+0x2b9/frame 0xfffffe030fdeead0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe030fdeebf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe030fdeebf0 --- syscall (22, FreeBSD ELF64, sys_unmount), rip = 0x8002e1eda, rsp = 0x7fffffffd278, rbp = 0x7fffffffd7b0 --- Tracing command umount pid 70505 tid 102063 td 0xfffffe00e9bd2000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00ea36f910 mi_switch() at mi_switch+0x155/frame 0xfffffe00ea36f930 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00ea36f970 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00ea36f9b0 _sleep() at _sleep+0x26c/frame 0xfffffe00ea36fa50 g_waitidle() at g_waitidle+0x9f/frame 0xfffffe00ea36fa70 userret() at userret+0x32a/frame 0xfffffe00ea36fad0 amd64_syscall() at amd64_syscall+0x213/frame 0xfffffe00ea36fbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ea36fbf0 --- syscall (0, FreeBSD ELF64, nosys), rip = 0x8002e1eda, rsp = 0x7fffffffd278, rbp = 0x7fffffffd7b0 --- Tracing command sleep pid 70504 tid 101428 td 0xfffffe00e9a28700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe030fc63870 mi_switch() at mi_switch+0x155/frame 0xfffffe030fc63890 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe030fc638d0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe030fc63930 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe030fc63970 _sleep() at _sleep+0x258/frame 0xfffffe030fc63a10 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe030fc63a90 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe030fc63ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe030fc63bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe030fc63bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003abbaa, rsp = 0x7fffffffe6c8, rbp = 0x7fffffffe710 --- Tracing command umount pid 70503 tid 104537 td 0xfffffe015c092e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe02fe7a3690 mi_switch() at mi_switch+0x155/frame 0xfffffe02fe7a36b0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe02fe7a36f0 _sleep() at _sleep+0x2cd/frame 0xfffffe02fe7a3790 bufobj_wwait() at bufobj_wwait+0x89/frame 0xfffffe02fe7a37d0 vn_fsync_buf() at vn_fsync_buf+0x2b7/frame 0xfffffe02fe7a3830 VOP_FSYNC_APV() at VOP_FSYNC_APV+0x59/frame 0xfffffe02fe7a3850 ffs_flushfiles() at ffs_flushfiles+0xcb/frame 0xfffffe02fe7a38c0 ffs_unmount() at ffs_unmount+0xea/frame 0xfffffe02fe7a3940 dounmount() at dounmount+0x423/frame 0xfffffe02fe7a39a0 kern_unmount() at kern_unmount+0x2b9/frame 0xfffffe02fe7a3ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe02fe7a3bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe02fe7a3bf0 --- syscall (22, FreeBSD ELF64, sys_unmount), rip = 0x8002e1eda, rsp = 0x7fffffffd278, rbp = 0x7fffffffd7b0 --- Tracing command sleep pid 70502 tid 101268 td 0xfffffe0164f91300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe02fbff8870 mi_switch() at mi_switch+0x155/frame 0xfffffe02fbff8890 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe02fbff88d0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe02fbff8930 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe02fbff8970 _sleep() at _sleep+0x258/frame 0xfffffe02fbff8a10 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe02fbff8a90 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe02fbff8ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe02fbff8bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe02fbff8bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003abbaa, rsp = 0x7fffffffe6c8, rbp = 0x7fffffffe710 --- Tracing command sleep pid 70501 tid 101837 td 0xfffffe01348ae800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00ebee0870 mi_switch() at mi_switch+0x155/frame 0xfffffe00ebee0890 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00ebee08d0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00ebee0930 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00ebee0970 _sleep() at _sleep+0x258/frame 0xfffffe00ebee0a10 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe00ebee0a90 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00ebee0ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00ebee0bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ebee0bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003abbaa, rsp = 0x7fffffffe6c8, rbp = 0x7fffffffe710 --- Tracing command sleep pid 70500 tid 101882 td 0xfffffe013c9d3300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00ebfc1870 mi_switch() at mi_switch+0x155/frame 0xfffffe00ebfc1890 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00ebfc18d0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00ebfc1930 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00ebfc1970 _sleep() at _sleep+0x258/frame 0xfffffe00ebfc1a10 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe00ebfc1a90 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00ebfc1ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00ebfc1bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ebfc1bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003abbaa, rsp = 0x7fffffffe6c8, rbp = 0x7fffffffe710 --- Tracing command umount pid 70499 tid 104616 td 0xfffffe00ef239000 (CPU 6) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1b9e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1b9e10 trap() at trap+0x56/frame 0xfffffe003e1b9f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1b9f20 --- trap 0x13, rip = 0xffffffff80c0c160, rsp = 0xfffffe03002957d0, rbp = 0xfffffe03002957e0 --- lock_delay() at lock_delay+0x30/frame 0xfffffe03002957e0 _sx_xlock_hard() at _sx_xlock_hard+0x199/frame 0xfffffe0300295880 _sx_xlock() at _sx_xlock+0xba/frame 0xfffffe03002958c0 ffs_unmount() at ffs_unmount+0x335/frame 0xfffffe0300295940 dounmount() at dounmount+0x423/frame 0xfffffe03002959a0 kern_unmount() at kern_unmount+0x2b9/frame 0xfffffe0300295ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe0300295bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0300295bf0 --- syscall (22, FreeBSD ELF64, sys_unmount), rip = 0x8002e1eda, rsp = 0x7fffffffd278, rbp = 0x7fffffffd7b0 --- Tracing command umount pid 70497 tid 104744 td 0xfffffe00e7c84300 (CPU 2) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e189e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e189e10 trap() at trap+0x56/frame 0xfffffe003e189f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e189f20 --- trap 0x13, rip = 0xffffffff80c0c162, rsp = 0xfffffe030fc9f550, rbp = 0xfffffe030fc9f560 --- lock_delay() at lock_delay+0x32/frame 0xfffffe030fc9f560 _mtx_lock_spin_cookie() at _mtx_lock_spin_cookie+0xc1/frame 0xfffffe030fc9f5d0 __mtx_lock_spin_flags() at __mtx_lock_spin_flags+0xd5/frame 0xfffffe030fc9f610 smp_targeted_tlb_shootdown() at smp_targeted_tlb_shootdown+0xbf/frame 0xfffffe030fc9f680 pmap_invalidate_range() at pmap_invalidate_range+0x1b8/frame 0xfffffe030fc9f6f0 allocbuf() at allocbuf+0x1fe/frame 0xfffffe030fc9f750 brelse() at brelse+0x3d7/frame 0xfffffe030fc9f7b0 flushbuflist() at flushbuflist+0x166/frame 0xfffffe030fc9f830 bufobj_invalbuf() at bufobj_invalbuf+0x8b/frame 0xfffffe030fc9f890 g_vfs_close() at g_vfs_close+0x46/frame 0xfffffe030fc9f8c0 ffs_unmount() at ffs_unmount+0x36e/frame 0xfffffe030fc9f940 dounmount() at dounmount+0x423/frame 0xfffffe030fc9f9a0 kern_unmount() at kern_unmount+0x2b9/frame 0xfffffe030fc9fad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe030fc9fbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe030fc9fbf0 --- syscall (22, FreeBSD ELF64, sys_unmount), rip = 0x8002e1eda, rsp = 0x7fffffffd278, rbp = 0x7fffffffd7b0 --- Tracing command sleep pid 70496 tid 102283 td 0xfffffe00e7de4100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e80d8870 mi_switch() at mi_switch+0x155/frame 0xfffffe00e80d8890 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e80d88d0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e80d8930 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e80d8970 _sleep() at _sleep+0x258/frame 0xfffffe00e80d8a10 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe00e80d8a90 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00e80d8ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e80d8bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e80d8bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003abbaa, rsp = 0x7fffffffe6c8, rbp = 0x7fffffffe710 --- Tracing command sleep pid 70483 tid 100707 td 0xfffffe00ef3d5300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe030fdb7870 mi_switch() at mi_switch+0x155/frame 0xfffffe030fdb7890 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe030fdb78d0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe030fdb7930 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe030fdb7970 _sleep() at _sleep+0x258/frame 0xfffffe030fdb7a10 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe030fdb7a90 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe030fdb7ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe030fdb7bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe030fdb7bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003abbaa, rsp = 0x7fffffffe6c8, rbp = 0x7fffffffe710 --- Tracing command umount pid 70476 tid 100499 td 0xfffffe00d39ff800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe030031c810 mi_switch() at mi_switch+0x155/frame 0xfffffe030031c830 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe030031c870 _sleep() at _sleep+0x2cd/frame 0xfffffe030031c910 vfs_mount_destroy() at vfs_mount_destroy+0xf4/frame 0xfffffe030031c940 dounmount() at dounmount+0x746/frame 0xfffffe030031c9a0 kern_unmount() at kern_unmount+0x2b9/frame 0xfffffe030031cad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe030031cbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe030031cbf0 --- syscall (22, FreeBSD ELF64, sys_unmount), rip = 0x8002e1eda, rsp = 0x7fffffffd278, rbp = 0x7fffffffd7b0 --- Tracing command sh pid 70431 tid 102402 td 0xfffffe013eeba800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00ec0c56e0 mi_switch() at mi_switch+0x155/frame 0xfffffe00ec0c5700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00ec0c5740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00ec0c57a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00ec0c57b0 _sleep() at _sleep+0x2c3/frame 0xfffffe00ec0c5850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00ec0c58e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe00ec0c5ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00ec0c5bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ec0c5bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ba4a, rsp = 0x7fffffffe0d8, rbp = 0x7fffffffe190 --- Tracing command sh pid 70426 tid 102276 td 0xfffffe00d5dfd800 (CPU 8) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1d1e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1d1e10 trap() at trap+0x56/frame 0xfffffe003e1d1f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1d1f20 --- trap 0x13, rip = 0xffffffff80c0c162, rsp = 0xfffffe02fa6a5850, rbp = 0xfffffe02fa6a5860 --- lock_delay() at lock_delay+0x32/frame 0xfffffe02fa6a5860 _sx_xlock_hard() at _sx_xlock_hard+0x199/frame 0xfffffe02fa6a5900 _sx_xlock() at _sx_xlock+0xba/frame 0xfffffe02fa6a5940 vm_map_remove() at vm_map_remove+0x4f/frame 0xfffffe02fa6a5970 pipeclose() at pipeclose+0x2c7/frame 0xfffffe02fa6a59b0 pipe_close() at pipe_close+0x5f/frame 0xfffffe02fa6a59e0 _fdrop() at _fdrop+0x1a/frame 0xfffffe02fa6a5a00 closef() at closef+0x1db/frame 0xfffffe02fa6a5a90 closefp() at closefp+0x96/frame 0xfffffe02fa6a5ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe02fa6a5bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe02fa6a5bf0 --- syscall (6, FreeBSD ELF64, sys_close), rip = 0x80047a83a, rsp = 0x7fffffffe0f8, rbp = 0x7fffffffe250 --- Tracing command sh pid 54655 tid 100264 td 0xfffffe00e7cc9800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e89806e0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e8980700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e8980740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e89807a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e89807b0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e8980850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00e89808e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe00e8980ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e8980bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e8980bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ba4a, rsp = 0x7fffffffe2b8, rbp = 0x7fffffffe370 --- Tracing command sh pid 54654 tid 101257 td 0xfffffe00e7de3a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e51b16e0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e51b1700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e51b1740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e51b17a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e51b17b0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e51b1850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00e51b18e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe00e51b1ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e51b1bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e51b1bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ba4a, rsp = 0x7fffffffe108, rbp = 0x7fffffffe1c0 --- Tracing command sh pid 54651 tid 101554 td 0xfffffe00ef3df700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe02fa7546e0 mi_switch() at mi_switch+0x155/frame 0xfffffe02fa754700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe02fa754740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe02fa7547a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe02fa7547b0 _sleep() at _sleep+0x2c3/frame 0xfffffe02fa754850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe02fa7548e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe02fa754ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe02fa754bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe02fa754bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ba4a, rsp = 0x7fffffffe2b8, rbp = 0x7fffffffe370 --- Tracing command sh pid 54646 tid 102150 td 0xfffffe00e7af0a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e82586e0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e8258700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e8258740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e82587a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e82587b0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e8258850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00e82588e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe00e8258ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e8258bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e8258bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ba4a, rsp = 0x7fffffffe108, rbp = 0x7fffffffe1c0 --- Tracing command sh pid 54642 tid 100397 td 0xfffffe00e9a49c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00ebf586e0 mi_switch() at mi_switch+0x155/frame 0xfffffe00ebf58700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00ebf58740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00ebf587a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00ebf587b0 _sleep() at _sleep+0x2c3/frame 0xfffffe00ebf58850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00ebf588e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe00ebf58ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00ebf58bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ebf58bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ba4a, rsp = 0x7fffffffe2b8, rbp = 0x7fffffffe370 --- Tracing command sh pid 54641 tid 100466 td 0xfffffe015e0dd000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe02fcb996e0 mi_switch() at mi_switch+0x155/frame 0xfffffe02fcb99700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe02fcb99740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe02fcb997a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe02fcb997b0 _sleep() at _sleep+0x2c3/frame 0xfffffe02fcb99850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe02fcb998e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe02fcb99ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe02fcb99bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe02fcb99bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ba4a, rsp = 0x7fffffffe108, rbp = 0x7fffffffe1c0 --- Tracing command sh pid 54640 tid 102005 td 0xfffffe014cc21300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00ea02c6e0 mi_switch() at mi_switch+0x155/frame 0xfffffe00ea02c700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00ea02c740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00ea02c7a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00ea02c7b0 _sleep() at _sleep+0x2c3/frame 0xfffffe00ea02c850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00ea02c8e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe00ea02cad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00ea02cbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ea02cbf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ba4a, rsp = 0x7fffffffe2b8, rbp = 0x7fffffffe370 --- Tracing command sh pid 54639 tid 102381 td 0xfffffe00e7ebba00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00ea1446e0 mi_switch() at mi_switch+0x155/frame 0xfffffe00ea144700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00ea144740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00ea1447a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00ea1447b0 _sleep() at _sleep+0x2c3/frame 0xfffffe00ea144850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00ea1448e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe00ea144ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00ea144bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ea144bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ba4a, rsp = 0x7fffffffe108, rbp = 0x7fffffffe1c0 --- Tracing command sh pid 54637 tid 102114 td 0xfffffe00e7df3300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe02fa6b46e0 mi_switch() at mi_switch+0x155/frame 0xfffffe02fa6b4700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe02fa6b4740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe02fa6b47a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe02fa6b47b0 _sleep() at _sleep+0x2c3/frame 0xfffffe02fa6b4850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe02fa6b48e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe02fa6b4ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe02fa6b4bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe02fa6b4bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ba4a, rsp = 0x7fffffffe2b8, rbp = 0x7fffffffe370 --- Tracing command sh pid 54636 tid 104696 td 0xfffffe00ef3c9e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe02fcae06e0 mi_switch() at mi_switch+0x155/frame 0xfffffe02fcae0700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe02fcae0740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe02fcae07a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe02fcae07b0 _sleep() at _sleep+0x2c3/frame 0xfffffe02fcae0850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe02fcae08e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe02fcae0ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe02fcae0bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe02fcae0bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ba4a, rsp = 0x7fffffffe108, rbp = 0x7fffffffe1c0 --- Tracing command sh pid 54633 tid 104619 td 0xfffffe00e91ee000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe030036c6e0 mi_switch() at mi_switch+0x155/frame 0xfffffe030036c700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe030036c740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe030036c7a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe030036c7b0 _sleep() at _sleep+0x2c3/frame 0xfffffe030036c850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe030036c8e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe030036cad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe030036cbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe030036cbf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ba4a, rsp = 0x7fffffffe2b8, rbp = 0x7fffffffe370 --- Tracing command sh pid 54628 tid 101761 td 0xfffffe012902b300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00ef7606e0 mi_switch() at mi_switch+0x155/frame 0xfffffe00ef760700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00ef760740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00ef7607a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00ef7607b0 _sleep() at _sleep+0x2c3/frame 0xfffffe00ef760850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00ef7608e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe00ef760ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00ef760bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ef760bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ba4a, rsp = 0x7fffffffe108, rbp = 0x7fffffffe1c0 --- Tracing command sh pid 54624 tid 101282 td 0xfffffe014012b000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e80b06e0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e80b0700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e80b0740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e80b07a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e80b07b0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e80b0850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00e80b08e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe00e80b0ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e80b0bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e80b0bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ba4a, rsp = 0x7fffffffe2b8, rbp = 0x7fffffffe370 --- Tracing command sh pid 54623 tid 104574 td 0xfffffe00ef361a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe03002866e0 mi_switch() at mi_switch+0x155/frame 0xfffffe0300286700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0300286740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe03002867a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe03002867b0 _sleep() at _sleep+0x2c3/frame 0xfffffe0300286850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe03002868e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe0300286ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe0300286bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0300286bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ba4a, rsp = 0x7fffffffe108, rbp = 0x7fffffffe1c0 --- Tracing command sh pid 54620 tid 102093 td 0xfffffe01348abe00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe02fa4986e0 mi_switch() at mi_switch+0x155/frame 0xfffffe02fa498700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe02fa498740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe02fa4987a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe02fa4987b0 _sleep() at _sleep+0x2c3/frame 0xfffffe02fa498850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe02fa4988e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe02fa498ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe02fa498bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe02fa498bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ba4a, rsp = 0x7fffffffe108, rbp = 0x7fffffffe1c0 --- Tracing command sh pid 54616 tid 101345 td 0xfffffe00e9a39c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e884a6e0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e884a700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e884a740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e884a7a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e884a7b0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e884a850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00e884a8e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe00e884aad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e884abf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e884abf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ba4a, rsp = 0x7fffffffe2b8, rbp = 0x7fffffffe370 --- Tracing command sh pid 54614 tid 100297 td 0xfffffe01266b3700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00377956e0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037795700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037795740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00377957a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00377957b0 _sleep() at _sleep+0x2c3/frame 0xfffffe0037795850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00377958e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe0037795ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe0037795bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0037795bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ba4a, rsp = 0x7fffffffe108, rbp = 0x7fffffffe1c0 --- Tracing command sh pid 54613 tid 103079 td 0xfffffe015be7ee00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe03018f96e0 mi_switch() at mi_switch+0x155/frame 0xfffffe03018f9700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe03018f9740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe03018f97a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe03018f97b0 _sleep() at _sleep+0x2c3/frame 0xfffffe03018f9850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe03018f98e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe03018f9ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe03018f9bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe03018f9bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ba4a, rsp = 0x7fffffffe2b8, rbp = 0x7fffffffe370 --- Tracing command sh pid 54612 tid 101326 td 0xfffffe0161837000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00ea2256e0 mi_switch() at mi_switch+0x155/frame 0xfffffe00ea225700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00ea225740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00ea2257a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00ea2257b0 _sleep() at _sleep+0x2c3/frame 0xfffffe00ea225850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00ea2258e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe00ea225ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00ea225bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ea225bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ba4a, rsp = 0x7fffffffe108, rbp = 0x7fffffffe1c0 --- Tracing command sh pid 54611 tid 100646 td 0xfffffe00e7de1000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e81e86e0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e81e8700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e81e8740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e81e87a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e81e87b0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e81e8850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00e81e88e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe00e81e8ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e81e8bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e81e8bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ba4a, rsp = 0x7fffffffe2b8, rbp = 0x7fffffffe370 --- Tracing command sh pid 54609 tid 104867 td 0xfffffe01266c2100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe030fc456e0 mi_switch() at mi_switch+0x155/frame 0xfffffe030fc45700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe030fc45740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe030fc457a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe030fc457b0 _sleep() at _sleep+0x2c3/frame 0xfffffe030fc45850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe030fc458e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe030fc45ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe030fc45bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe030fc45bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ba4a, rsp = 0x7fffffffe2b8, rbp = 0x7fffffffe370 --- Tracing command sh pid 54608 tid 101802 td 0xfffffe0164f8fe00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e82d06e0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e82d0700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e82d0740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e82d07a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e82d07b0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e82d0850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00e82d08e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe00e82d0ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e82d0bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e82d0bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ba4a, rsp = 0x7fffffffe108, rbp = 0x7fffffffe1c0 --- Tracing command md21 pid 54603 tid 102099 td 0xfffffe0154989700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe003779aa50 mi_switch() at mi_switch+0x155/frame 0xfffffe003779aa70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe003779aab0 _sleep() at _sleep+0x2cd/frame 0xfffffe003779ab50 md_kthread() at md_kthread+0xe3/frame 0xfffffe003779abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003779abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003779abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command md20 pid 54592 tid 100614 td 0xfffffe015f353700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e94b8a50 mi_switch() at mi_switch+0x155/frame 0xfffffe00e94b8a70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e94b8ab0 _sleep() at _sleep+0x2cd/frame 0xfffffe00e94b8b50 md_kthread() at md_kthread+0xe3/frame 0xfffffe00e94b8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e94b8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e94b8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command md19 pid 54581 tid 104576 td 0xfffffe01266f0500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0300259a50 mi_switch() at mi_switch+0x155/frame 0xfffffe0300259a70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0300259ab0 _sleep() at _sleep+0x2cd/frame 0xfffffe0300259b50 md_kthread() at md_kthread+0xe3/frame 0xfffffe0300259bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0300259bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0300259bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command md18 pid 54570 tid 101582 td 0xfffffe00e9272500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe02fa7e0a50 mi_switch() at mi_switch+0x155/frame 0xfffffe02fa7e0a70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe02fa7e0ab0 _sleep() at _sleep+0x2cd/frame 0xfffffe02fa7e0b50 md_kthread() at md_kthread+0xe3/frame 0xfffffe02fa7e0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe02fa7e0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe02fa7e0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command md17 pid 54559 tid 100562 td 0xfffffe00e7b05800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e810aa50 mi_switch() at mi_switch+0x155/frame 0xfffffe00e810aa70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e810aab0 _sleep() at _sleep+0x2cd/frame 0xfffffe00e810ab50 md_kthread() at md_kthread+0xe3/frame 0xfffffe00e810abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e810abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e810abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command md16 pid 54548 tid 104703 td 0xfffffe01266af000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe02fcadba50 mi_switch() at mi_switch+0x155/frame 0xfffffe02fcadba70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe02fcadbab0 _sleep() at _sleep+0x2cd/frame 0xfffffe02fcadbb50 md_kthread() at md_kthread+0xe3/frame 0xfffffe02fcadbbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe02fcadbbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe02fcadbbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command md15 pid 54537 tid 104613 td 0xfffffe01266bcc00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe030030da50 mi_switch() at mi_switch+0x155/frame 0xfffffe030030da70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe030030dab0 _sleep() at _sleep+0x2cd/frame 0xfffffe030030db50 md_kthread() at md_kthread+0xe3/frame 0xfffffe030030dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe030030dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe030030dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command md14 pid 54526 tid 101045 td 0xfffffe0148251e00 (CPU 0) cpustop_handler() at cpustop_handler+0x26/frame 0xffffffff81d88600 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xffffffff81d88610 trap() at trap+0x56/frame 0xffffffff81d88720 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81d88720 --- trap 0x13, rip = 0xffffffff80c0c160, rsp = 0xfffffe00e973d740, rbp = 0xfffffe00e973d750 --- lock_delay() at lock_delay+0x30/frame 0xfffffe00e973d750 _mtx_lock_spin_cookie() at _mtx_lock_spin_cookie+0xc1/frame 0xfffffe00e973d7c0 __mtx_lock_spin_flags() at __mtx_lock_spin_flags+0xd5/frame 0xfffffe00e973d800 smp_targeted_tlb_shootdown() at smp_targeted_tlb_shootdown+0xbf/frame 0xfffffe00e973d870 pmap_invalidate_range() at pmap_invalidate_range+0x1b8/frame 0xfffffe00e973d8e0 allocbuf() at allocbuf+0xfd/frame 0xfffffe00e973d940 brelse() at brelse+0x1c1/frame 0xfffffe00e973d9a0 bufdone() at bufdone+0x392/frame 0xfffffe00e973da10 ffs_backgroundwritedone() at ffs_backgroundwritedone+0xc2/frame 0xfffffe00e973da40 bufdone() at bufdone+0x6c/frame 0xfffffe00e973dab0 g_io_deliver() at g_io_deliver+0x25e/frame 0xfffffe00e973db00 g_io_deliver() at g_io_deliver+0x25e/frame 0xfffffe00e973db50 md_kthread() at md_kthread+0x259/frame 0xfffffe00e973dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e973dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e973dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command md13 pid 54515 tid 100567 td 0xfffffe00dd3fd500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e8206a50 mi_switch() at mi_switch+0x155/frame 0xfffffe00e8206a70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e8206ab0 _sleep() at _sleep+0x2cd/frame 0xfffffe00e8206b50 md_kthread() at md_kthread+0xe3/frame 0xfffffe00e8206bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e8206bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e8206bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command md12 pid 54504 tid 100726 td 0xfffffe00e9a2a300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe02fa641a50 mi_switch() at mi_switch+0x155/frame 0xfffffe02fa641a70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe02fa641ab0 _sleep() at _sleep+0x2cd/frame 0xfffffe02fa641b50 md_kthread() at md_kthread+0xe3/frame 0xfffffe02fa641bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe02fa641bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe02fa641bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command md11 pid 54493 tid 101958 td 0xfffffe00e9bb6e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe02fcbe9a50 mi_switch() at mi_switch+0x155/frame 0xfffffe02fcbe9a70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe02fcbe9ab0 _sleep() at _sleep+0x2cd/frame 0xfffffe02fcbe9b50 md_kthread() at md_kthread+0xe3/frame 0xfffffe02fcbe9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe02fcbe9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe02fcbe9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command md10 pid 54482 tid 101480 td 0xfffffe00e572e700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00ea2a7a50 mi_switch() at mi_switch+0x155/frame 0xfffffe00ea2a7a70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00ea2a7ab0 _sleep() at _sleep+0x2cd/frame 0xfffffe00ea2a7b50 md_kthread() at md_kthread+0xe3/frame 0xfffffe00ea2a7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00ea2a7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ea2a7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sh pid 54460 tid 100263 td 0xfffffe015bec9800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe030fc186e0 mi_switch() at mi_switch+0x155/frame 0xfffffe030fc18700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe030fc18740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe030fc187a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe030fc187b0 _sleep() at _sleep+0x2c3/frame 0xfffffe030fc18850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe030fc188e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe030fc18ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe030fc18bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe030fc18bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ba4a, rsp = 0x7fffffffe2c8, rbp = 0x7fffffffe380 --- Tracing command tee pid 54459 tid 102230 td 0xfffffe016e328500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e9495840 mi_switch() at mi_switch+0x155/frame 0xfffffe00e9495860 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e94958a0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e9495900 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e9495910 _sleep() at _sleep+0x2c3/frame 0xfffffe00e94959b0 pipe_read() at pipe_read+0x42b/frame 0xfffffe00e9495a10 dofileread() at dofileread+0x81/frame 0xfffffe00e9495a60 sys_read() at sys_read+0xc0/frame 0xfffffe00e9495ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e9495bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e9495bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80041a81a, rsp = 0x7fffffffe6a8, rbp = 0x7fffffffe700 --- Tracing command sh pid 54458 tid 103028 td 0xfffffe015beb5100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe03017216e0 mi_switch() at mi_switch+0x155/frame 0xfffffe0301721700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0301721740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe03017217a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe03017217b0 _sleep() at _sleep+0x2c3/frame 0xfffffe0301721850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe03017218e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe0301721ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe0301721bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0301721bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ba4a, rsp = 0x7fffffffe2c8, rbp = 0x7fffffffe380 --- Tracing command sh pid 54457 tid 102177 td 0xfffffe01323c8800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe02fbffd6e0 mi_switch() at mi_switch+0x155/frame 0xfffffe02fbffd700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe02fbffd740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe02fbffd7a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe02fbffd7b0 _sleep() at _sleep+0x2c3/frame 0xfffffe02fbffd850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe02fbffd8e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe02fbffdad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe02fbffdbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe02fbffdbf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ba4a, rsp = 0x7fffffffe258, rbp = 0x7fffffffe310 --- Tracing command bash pid 51721 tid 102412 td 0xfffffe00e9278800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe030fdc6700 mi_switch() at mi_switch+0x155/frame 0xfffffe030fdc6720 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe030fdc6760 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe030fdc67c0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe030fdc67d0 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe030fdc6830 seltdwait() at seltdwait+0x8d/frame 0xfffffe030fdc6870 kern_select() at kern_select+0x87a/frame 0xfffffe030fdc6a50 sys_pselect() at sys_pselect+0x127/frame 0xfffffe030fdc6ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe030fdc6bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe030fdc6bf0 --- syscall (522, FreeBSD ELF64, sys_pselect), rip = 0x800534b6a, rsp = 0x7fffffffd5d8, rbp = 0x7fffffffd6a0 --- Tracing command csh pid 50833 tid 102176 td 0xfffffe0164f92800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00ea3838d0 mi_switch() at mi_switch+0x155/frame 0xfffffe00ea3838f0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00ea383930 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00ea383990 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00ea3839a0 _sleep() at _sleep+0x2c3/frame 0xfffffe00ea383a40 kern_sigsuspend() at kern_sigsuspend+0xec/frame 0xfffffe00ea383aa0 sys_sigsuspend() at sys_sigsuspend+0x31/frame 0xfffffe00ea383ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00ea383bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ea383bf0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x8004a1aca, rsp = 0x7fffffffdff8, rbp = 0x7fffffffe080 --- Tracing command su pid 50824 tid 100722 td 0xfffffe0179ba7000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe02fa4f26e0 mi_switch() at mi_switch+0x155/frame 0xfffffe02fa4f2700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe02fa4f2740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe02fa4f27a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe02fa4f27b0 _sleep() at _sleep+0x2c3/frame 0xfffffe02fa4f2850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe02fa4f28e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe02fa4f2ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe02fa4f2bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe02fa4f2bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003f3a4a, rsp = 0x7fffffffe608, rbp = 0x7fffffffeb40 --- Tracing command bash pid 50412 tid 103121 td 0xfffffe0126756800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe03019c16e0 mi_switch() at mi_switch+0x155/frame 0xfffffe03019c1700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe03019c1740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe03019c17a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe03019c17b0 _sleep() at _sleep+0x2c3/frame 0xfffffe03019c1850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe03019c18e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe03019c1ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe03019c1bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe03019c1bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800534a4a, rsp = 0x7fffffffe778, rbp = 0x7fffffffe7d0 --- Tracing command sshd pid 50399 tid 103342 td 0xfffffe00e9239800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe02fc254740 mi_switch() at mi_switch+0x155/frame 0xfffffe02fc254760 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe02fc2547a0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe02fc254800 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe02fc254810 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe02fc254870 seltdwait() at seltdwait+0x8d/frame 0xfffffe02fc2548b0 kern_select() at kern_select+0x87a/frame 0xfffffe02fc254a90 sys_select() at sys_select+0x56/frame 0xfffffe02fc254ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe02fc254bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe02fc254bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8008e17fa, rsp = 0x7fffffffa548, rbp = 0x7fffffffa580 --- Tracing command sshd pid 50239 tid 102119 td 0xfffffe015ce6c100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00ea2667c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00ea2667e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00ea266820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00ea266880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00ea266890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00ea2668f0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00ea266930 kern_poll() at kern_poll+0x48b/frame 0xfffffe00ea266ab0 sys_poll() at sys_poll+0x50/frame 0xfffffe00ea266ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00ea266bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ea266bf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x80088500a, rsp = 0x7fffffffe5a8, rbp = 0x7fffffffe5e0 --- Tracing command sh pid 46992 tid 101245 td 0xfffffe015e0df300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e97dd6e0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e97dd700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e97dd740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e97dd7a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e97dd7b0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e97dd850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00e97dd8e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe00e97ddad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e97ddbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e97ddbf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ba4a, rsp = 0x7fffffffe578, rbp = 0x7fffffffe630 --- Tracing command ftcleanup pid 66397 tid 100626 td 0xfffffe00d5dfb500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e8088a60 mi_switch() at mi_switch+0x155/frame 0xfffffe00e8088a80 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e8088ac0 _sleep() at _sleep+0x2cd/frame 0xfffffe00e8088b60 fasttrap_pid_cleanup_cb() at fasttrap_pid_cleanup_cb+0x269/frame 0xfffffe00e8088bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e8088bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e8088bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command tail pid 4365 tid 100199 td 0xfffffe00e7e94500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e5170740 mi_switch() at mi_switch+0x155/frame 0xfffffe00e5170760 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e51707a0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e5170800 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e5170810 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e5170870 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e51708b0 kern_select() at kern_select+0x87a/frame 0xfffffe00e5170a90 sys_select() at sys_select+0x56/frame 0xfffffe00e5170ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e5170bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5170bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80042d7fa, rsp = 0x7fffffffe708, rbp = 0x7fffffffe7c0 --- Tracing command tail pid 4362 tid 100152 td 0xfffffe00dd3fc700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e50314f0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e5031510 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e5031550 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e50315b0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e50315f0 _sleep() at _sleep+0x258/frame 0xfffffe00e5031690 kqueue_kevent() at kqueue_kevent+0xab4/frame 0xfffffe00e5031960 kern_kevent_fp() at kern_kevent_fp+0x95/frame 0xfffffe00e50319b0 kern_kevent() at kern_kevent+0x80/frame 0xfffffe00e5031a10 kern_kevent_generic() at kern_kevent_generic+0x70/frame 0xfffffe00e5031a70 sys_kevent() at sys_kevent+0x61/frame 0xfffffe00e5031ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e5031bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5031bf0 --- syscall (560, FreeBSD ELF64, sys_kevent), rip = 0x800415e4a, rsp = 0x7fffffffe858, rbp = 0x7fffffffe9a0 --- Tracing command bash pid 3099 tid 100157 td 0xfffffe00d35e4a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e504a6e0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00de9f7da0 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00de9f7db0 trap() at trap+0x6c/frame 0xfffffe00de9f7ec0 calltrap() at calltrap+0x8/frame 0xfffffe00de9f7ec0 --- trap 0xc, rip = 0xffffffff810393b0, rsp = 0xfffffe00de9f7f90, rbp = 0xfffffe00de9f8020 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe00de9f8020 db_get_value() at db_get_value+0x32/frame 0xfffffe00de9f8060 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00de9f80f0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00de9f8110 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00de9f81b0 db_command() at db_command+0x25c/frame 0xfffffe00de9f8280 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00de9f8320 db_command() at db_command+0x25c/frame 0xfffffe00de9f83f0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00de9f8400 db_trap() at db_trap+0xe8/frame 0xfffffe00de9f8490 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00de9f8500 trap() at trap+0x7b8/frame 0xfffffe00de9f8610 calltrap() at calltrap+0x8/frame 0xfffffe00de9f8610 --- trap 0x3, rip = 0xffffffff80c0ab97, rsp = 0xfffffe00de9f86e0, rbp = 0xfffffe00de9f86f0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00de9f86f0 vpanic() at vpanic+0x19e/frame 0xfffffe00de9f8740 panic() at panic+0x43/frame 0xfffffe00de9f87a0 trap_fatal() at trap_fatal+0x387/frame 0xfffffe00de9f8800 trap_pfault() at trap_pfault+0x99/frame 0xfffffe00de9f8860 trap() at trap+0x2a5/frame 0xfffffe00de9f8970 calltrap() at calltrap+0x8/frame 0xfffffe00de9f8970 --- trap 0xc, rip = 0xffffffff80ee9cee, rsp = 0xfffffe00de9f8a40, rbp = 0xfffffe00de9f8a90 --- ufs_reclaim() at ufs_reclaim+0x10e/frame 0xfffffe00de9f8a90 VOP_RECLAIM_APV() at VOP_RECLAIM_APV+0x59/frame 0xfffffe00de9f8ab0 vgonel() at vgonel+0x3b7/frame 0xfffffe00de9f8b10 vnlru_proc() at vnlru_proc+0x7fb/frame 0xfffffe00de9f8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00de9f8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00de9f8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00e504a6e8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00de9f8010 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00de9f8020 db_get_value() at db_get_value+0x4c/frame 0xfffffe00de9f8060 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00de9f80f0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00de9f8110 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00de9f81b0 db_command() at db_command+0x25c/frame 0xfffffe00de9f8280 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00de9f8320 db_command() at db_command+0x25c/frame 0xfffffe00de9f83f0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00de9f8400 db_trap() at db_trap+0xe8/frame 0xfffffe00de9f8490 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00de9f8500 trap() at trap+0x7b8/frame 0xfffffe00de9f8610 calltrap() at calltrap+0x8/frame 0xfffffe00de9f8610 --- trap 0x3, rip = 0xffffffff80c0ab97, rsp = 0xfffffe00de9f86e0, rbp = 0xfffffe00de9f86f0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00de9f86f0 vpanic() at vpanic+0x19e/frame 0xfffffe00de9f8740 panic() at panic+0x43/frame 0xfffffe00de9f87a0 trap_fatal() at trap_fatal+0x387/frame 0xfffffe00de9f8800 trap_pfault() at trap_pfault+0x99/frame 0xfffffe00de9f8860 trap() at trap+0x2a5/frame 0xfffffe00de9f8970 calltrap() at calltrap+0x8/frame 0xfffffe00de9f8970 --- trap 0xc, rip = 0xffffffff80ee9cee, rsp = 0xfffffe00de9f8a40, rbp = 0xfffffe00de9f8a90 --- ufs_reclaim() at ufs_reclaim+0x10e/frame 0xfffffe00de9f8a90 VOP_RECLAIM_APV() at VOP_RECLAIM_APV+0x59/frame 0xfffffe00de9f8ab0 vgonel() at vgonel+0x3b7/frame 0xfffffe00de9f8b10 vnlru_proc() at vnlru_proc+0x7fb/frame 0xfffffe00de9f8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00de9f8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00de9f8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sshd pid 2846 tid 100238 td 0xfffffe00e7ebc100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e8042740 mi_switch() at mi_switch+0x155/frame 0xfffffe00e8042760 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e80427a0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e8042800 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e8042810 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e8042870 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e80428b0 kern_select() at kern_select+0x87a/frame 0xfffffe00e8042a90 sys_select() at sys_select+0x56/frame 0xfffffe00e8042ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e8042bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e8042bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8008e17fa, rsp = 0x7fffffffa548, rbp = 0x7fffffffa580 --- Tracing command sh pid 2832 tid 100553 td 0xfffffe00e7afae00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e8056840 mi_switch() at mi_switch+0x155/frame 0xfffffe00e8056860 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e80568a0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e8056900 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e8056910 _sleep() at _sleep+0x2c3/frame 0xfffffe00e80569b0 pipe_read() at pipe_read+0x42b/frame 0xfffffe00e8056a10 dofileread() at dofileread+0x81/frame 0xfffffe00e8056a60 sys_read() at sys_read+0xc0/frame 0xfffffe00e8056ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e8056bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e8056bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80047a81a, rsp = 0x7fffffffde08, rbp = 0x7fffffffe330 --- Tracing command awk pid 2830 tid 100552 td 0xfffffe00e7af1800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e806a840 mi_switch() at mi_switch+0x155/frame 0xfffffe00e806a860 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e806a8a0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e806a900 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e806a910 _sleep() at _sleep+0x2c3/frame 0xfffffe00e806a9b0 pipe_read() at pipe_read+0x42b/frame 0xfffffe00e806aa10 dofileread() at dofileread+0x81/frame 0xfffffe00e806aa60 sys_read() at sys_read+0xc0/frame 0xfffffe00e806aad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e806abf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e806abf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80047e81a, rsp = 0x7fffffffe328, rbp = 0x7fffffffe340 --- Tracing command sh pid 2829 tid 100551 td 0xfffffe00e7399800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e80796e0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e8079700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e8079740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e80797a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e80797b0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e8079850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00e80798e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe00e8079ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e8079bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e8079bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ba4a, rsp = 0x7fffffffe318, rbp = 0x7fffffffe3d0 --- Tracing command sh pid 2779 tid 100546 td 0xfffffe00e7b02000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e80d36e0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00de9f7da0 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00de9f7db0 trap() at trap+0x6c/frame 0xfffffe00de9f7ec0 calltrap() at calltrap+0x8/frame 0xfffffe00de9f7ec0 --- trap 0xc, rip = 0xffffffff810393b0, rsp = 0xfffffe00de9f7f90, rbp = 0xfffffe00de9f8020 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe00de9f8020 db_get_value() at db_get_value+0x32/frame 0xfffffe00de9f8060 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00de9f80f0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00de9f8110 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00de9f81b0 db_command() at db_command+0x25c/frame 0xfffffe00de9f8280 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00de9f8320 db_command() at db_command+0x25c/frame 0xfffffe00de9f83f0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00de9f8400 db_trap() at db_trap+0xe8/frame 0xfffffe00de9f8490 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00de9f8500 trap() at trap+0x7b8/frame 0xfffffe00de9f8610 calltrap() at calltrap+0x8/frame 0xfffffe00de9f8610 --- trap 0x3, rip = 0xffffffff80c0ab97, rsp = 0xfffffe00de9f86e0, rbp = 0xfffffe00de9f86f0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00de9f86f0 vpanic() at vpanic+0x19e/frame 0xfffffe00de9f8740 panic() at panic+0x43/frame 0xfffffe00de9f87a0 trap_fatal() at trap_fatal+0x387/frame 0xfffffe00de9f8800 trap_pfault() at trap_pfault+0x99/frame 0xfffffe00de9f8860 trap() at trap+0x2a5/frame 0xfffffe00de9f8970 calltrap() at calltrap+0x8/frame 0xfffffe00de9f8970 --- trap 0xc, rip = 0xffffffff80ee9cee, rsp = 0xfffffe00de9f8a40, rbp = 0xfffffe00de9f8a90 --- ufs_reclaim() at ufs_reclaim+0x10e/frame 0xfffffe00de9f8a90 VOP_RECLAIM_APV() at VOP_RECLAIM_APV+0x59/frame 0xfffffe00de9f8ab0 vgonel() at vgonel+0x3b7/frame 0xfffffe00de9f8b10 vnlru_proc() at vnlru_proc+0x7fb/frame 0xfffffe00de9f8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00de9f8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00de9f8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00e80d36e8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00de9f8010 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00de9f8020 db_get_value() at db_get_value+0x4c/frame 0xfffffe00de9f8060 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00de9f80f0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00de9f8110 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00de9f81b0 db_command() at db_command+0x25c/frame 0xfffffe00de9f8280 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00de9f8320 db_command() at db_command+0x25c/frame 0xfffffe00de9f83f0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00de9f8400 db_trap() at db_trap+0xe8/frame 0xfffffe00de9f8490 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00de9f8500 trap() at trap+0x7b8/frame 0xfffffe00de9f8610 calltrap() at calltrap+0x8/frame 0xfffffe00de9f8610 --- trap 0x3, rip = 0xffffffff80c0ab97, rsp = 0xfffffe00de9f86e0, rbp = 0xfffffe00de9f86f0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00de9f86f0 vpanic() at vpanic+0x19e/frame 0xfffffe00de9f8740 panic() at panic+0x43/frame 0xfffffe00de9f87a0 trap_fatal() at trap_fatal+0x387/frame 0xfffffe00de9f8800 trap_pfault() at trap_pfault+0x99/frame 0xfffffe00de9f8860 trap() at trap+0x2a5/frame 0xfffffe00de9f8970 calltrap() at calltrap+0x8/frame 0xfffffe00de9f8970 --- trap 0xc, rip = 0xffffffff80ee9cee, rsp = 0xfffffe00de9f8a40, rbp = 0xfffffe00de9f8a90 --- ufs_reclaim() at ufs_reclaim+0x10e/frame 0xfffffe00de9f8a90 VOP_RECLAIM_APV() at VOP_RECLAIM_APV+0x59/frame 0xfffffe00de9f8ab0 vgonel() at vgonel+0x3b7/frame 0xfffffe00de9f8b10 vnlru_proc() at vnlru_proc+0x7fb/frame 0xfffffe00de9f8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00de9f8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00de9f8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sshd pid 2756 tid 100193 td 0xfffffe00e572fc00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e51227c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e51227e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e5122820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e5122880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e5122890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e51228f0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e5122930 kern_poll() at kern_poll+0x48b/frame 0xfffffe00e5122ab0 sys_poll() at sys_poll+0x50/frame 0xfffffe00e5122ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e5122bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5122bf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x80088500a, rsp = 0x7fffffffe5a8, rbp = 0x7fffffffe5e0 --- Tracing command bash pid 2445 tid 100218 td 0xfffffe00d39ff100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e51cf6e0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e51cf700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e51cf740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e51cf7a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e51cf7b0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e51cf850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00e51cf8e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe00e51cfad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e51cfbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e51cfbf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800534a4a, rsp = 0x7fffffffe628, rbp = 0x7fffffffe680 --- Tracing command csh pid 2443 tid 100214 td 0xfffffe00d35e1800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e51bb8d0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00de9f7da0 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00de9f7db0 trap() at trap+0x6c/frame 0xfffffe00de9f7ec0 calltrap() at calltrap+0x8/frame 0xfffffe00de9f7ec0 --- trap 0xc, rip = 0xffffffff810393b0, rsp = 0xfffffe00de9f7f90, rbp = 0xfffffe00de9f8020 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe00de9f8020 db_get_value() at db_get_value+0x32/frame 0xfffffe00de9f8060 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00de9f80f0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00de9f8110 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00de9f81b0 db_command() at db_command+0x25c/frame 0xfffffe00de9f8280 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00de9f8320 db_command() at db_command+0x25c/frame 0xfffffe00de9f83f0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00de9f8400 db_trap() at db_trap+0xe8/frame 0xfffffe00de9f8490 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00de9f8500 trap() at trap+0x7b8/frame 0xfffffe00de9f8610 calltrap() at calltrap+0x8/frame 0xfffffe00de9f8610 --- trap 0x3, rip = 0xffffffff80c0ab97, rsp = 0xfffffe00de9f86e0, rbp = 0xfffffe00de9f86f0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00de9f86f0 vpanic() at vpanic+0x19e/frame 0xfffffe00de9f8740 panic() at panic+0x43/frame 0xfffffe00de9f87a0 trap_fatal() at trap_fatal+0x387/frame 0xfffffe00de9f8800 trap_pfault() at trap_pfault+0x99/frame 0xfffffe00de9f8860 trap() at trap+0x2a5/frame 0xfffffe00de9f8970 calltrap() at calltrap+0x8/frame 0xfffffe00de9f8970 --- trap 0xc, rip = 0xffffffff80ee9cee, rsp = 0xfffffe00de9f8a40, rbp = 0xfffffe00de9f8a90 --- ufs_reclaim() at ufs_reclaim+0x10e/frame 0xfffffe00de9f8a90 VOP_RECLAIM_APV() at VOP_RECLAIM_APV+0x59/frame 0xfffffe00de9f8ab0 vgonel() at vgonel+0x3b7/frame 0xfffffe00de9f8b10 vnlru_proc() at vnlru_proc+0x7fb/frame 0xfffffe00de9f8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00de9f8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00de9f8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00e51bb8d8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00de9f8010 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00de9f8020 db_get_value() at db_get_value+0x4c/frame 0xfffffe00de9f8060 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00de9f80f0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00de9f8110 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00de9f81b0 db_command() at db_command+0x25c/frame 0xfffffe00de9f8280 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00de9f8320 db_command() at db_command+0x25c/frame 0xfffffe00de9f83f0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00de9f8400 db_trap() at db_trap+0xe8/frame 0xfffffe00de9f8490 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00de9f8500 trap() at trap+0x7b8/frame 0xfffffe00de9f8610 calltrap() at calltrap+0x8/frame 0xfffffe00de9f8610 --- trap 0x3, rip = 0xffffffff80c0ab97, rsp = 0xfffffe00de9f86e0, rbp = 0xfffffe00de9f86f0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00de9f86f0 vpanic() at vpanic+0x19e/frame 0xfffffe00de9f8740 panic() at panic+0x43/frame 0xfffffe00de9f87a0 trap_fatal() at trap_fatal+0x387/frame 0xfffffe00de9f8800 trap_pfault() at trap_pfault+0x99/frame 0xfffffe00de9f8860 trap() at trap+0x2a5/frame 0xfffffe00de9f8970 calltrap() at calltrap+0x8/frame 0xfffffe00de9f8970 --- trap 0xc, rip = 0xffffffff80ee9cee, rsp = 0xfffffe00de9f8a40, rbp = 0xfffffe00de9f8a90 --- ufs_reclaim() at ufs_reclaim+0x10e/frame 0xfffffe00de9f8a90 VOP_RECLAIM_APV() at VOP_RECLAIM_APV+0x59/frame 0xfffffe00de9f8ab0 vgonel() at vgonel+0x3b7/frame 0xfffffe00de9f8b10 vnlru_proc() at vnlru_proc+0x7fb/frame 0xfffffe00de9f8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00de9f8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00de9f8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command su pid 2442 tid 100203 td 0xfffffe00e7e96800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e51846e0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00de9f7da0 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00de9f7db0 trap() at trap+0x6c/frame 0xfffffe00de9f7ec0 calltrap() at calltrap+0x8/frame 0xfffffe00de9f7ec0 --- trap 0xc, rip = 0xffffffff810393b0, rsp = 0xfffffe00de9f7f90, rbp = 0xfffffe00de9f8020 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe00de9f8020 db_get_value() at db_get_value+0x32/frame 0xfffffe00de9f8060 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00de9f80f0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00de9f8110 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00de9f81b0 db_command() at db_command+0x25c/frame 0xfffffe00de9f8280 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00de9f8320 db_command() at db_command+0x25c/frame 0xfffffe00de9f83f0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00de9f8400 db_trap() at db_trap+0xe8/frame 0xfffffe00de9f8490 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00de9f8500 trap() at trap+0x7b8/frame 0xfffffe00de9f8610 calltrap() at calltrap+0x8/frame 0xfffffe00de9f8610 --- trap 0x3, rip = 0xffffffff80c0ab97, rsp = 0xfffffe00de9f86e0, rbp = 0xfffffe00de9f86f0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00de9f86f0 vpanic() at vpanic+0x19e/frame 0xfffffe00de9f8740 panic() at panic+0x43/frame 0xfffffe00de9f87a0 trap_fatal() at trap_fatal+0x387/frame 0xfffffe00de9f8800 trap_pfault() at trap_pfault+0x99/frame 0xfffffe00de9f8860 trap() at trap+0x2a5/frame 0xfffffe00de9f8970 calltrap() at calltrap+0x8/frame 0xfffffe00de9f8970 --- trap 0xc, rip = 0xffffffff80ee9cee, rsp = 0xfffffe00de9f8a40, rbp = 0xfffffe00de9f8a90 --- ufs_reclaim() at ufs_reclaim+0x10e/frame 0xfffffe00de9f8a90 VOP_RECLAIM_APV() at VOP_RECLAIM_APV+0x59/frame 0xfffffe00de9f8ab0 vgonel() at vgonel+0x3b7/frame 0xfffffe00de9f8b10 vnlru_proc() at vnlru_proc+0x7fb/frame 0xfffffe00de9f8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00de9f8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00de9f8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00e51846e8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00de9f8010 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00de9f8020 db_get_value() at db_get_value+0x4c/frame 0xfffffe00de9f8060 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00de9f80f0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00de9f8110 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00de9f81b0 db_command() at db_command+0x25c/frame 0xfffffe00de9f8280 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00de9f8320 db_command() at db_command+0x25c/frame 0xfffffe00de9f83f0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00de9f8400 db_trap() at db_trap+0xe8/frame 0xfffffe00de9f8490 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00de9f8500 trap() at trap+0x7b8/frame 0xfffffe00de9f8610 calltrap() at calltrap+0x8/frame 0xfffffe00de9f8610 --- trap 0x3, rip = 0xffffffff80c0ab97, rsp = 0xfffffe00de9f86e0, rbp = 0xfffffe00de9f86f0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00de9f86f0 vpanic() at vpanic+0x19e/frame 0xfffffe00de9f8740 panic() at panic+0x43/frame 0xfffffe00de9f87a0 trap_fatal() at trap_fatal+0x387/frame 0xfffffe00de9f8800 trap_pfault() at trap_pfault+0x99/frame 0xfffffe00de9f8860 trap() at trap+0x2a5/frame 0xfffffe00de9f8970 calltrap() at calltrap+0x8/frame 0xfffffe00de9f8970 --- trap 0xc, rip = 0xffffffff80ee9cee, rsp = 0xfffffe00de9f8a40, rbp = 0xfffffe00de9f8a90 --- ufs_reclaim() at ufs_reclaim+0x10e/frame 0xfffffe00de9f8a90 VOP_RECLAIM_APV() at VOP_RECLAIM_APV+0x59/frame 0xfffffe00de9f8ab0 vgonel() at vgonel+0x3b7/frame 0xfffffe00de9f8b10 vnlru_proc() at vnlru_proc+0x7fb/frame 0xfffffe00de9f8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00de9f8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00de9f8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bash pid 2436 tid 100162 td 0xfffffe003e4b6300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e50636e0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00de9f7da0 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00de9f7db0 trap() at trap+0x6c/frame 0xfffffe00de9f7ec0 calltrap() at calltrap+0x8/frame 0xfffffe00de9f7ec0 --- trap 0xc, rip = 0xffffffff810393b0, rsp = 0xfffffe00de9f7f90, rbp = 0xfffffe00de9f8020 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe00de9f8020 db_get_value() at db_get_value+0x32/frame 0xfffffe00de9f8060 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00de9f80f0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00de9f8110 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00de9f81b0 db_command() at db_command+0x25c/frame 0xfffffe00de9f8280 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00de9f8320 db_command() at db_command+0x25c/frame 0xfffffe00de9f83f0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00de9f8400 db_trap() at db_trap+0xe8/frame 0xfffffe00de9f8490 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00de9f8500 trap() at trap+0x7b8/frame 0xfffffe00de9f8610 calltrap() at calltrap+0x8/frame 0xfffffe00de9f8610 --- trap 0x3, rip = 0xffffffff80c0ab97, rsp = 0xfffffe00de9f86e0, rbp = 0xfffffe00de9f86f0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00de9f86f0 vpanic() at vpanic+0x19e/frame 0xfffffe00de9f8740 panic() at panic+0x43/frame 0xfffffe00de9f87a0 trap_fatal() at trap_fatal+0x387/frame 0xfffffe00de9f8800 trap_pfault() at trap_pfault+0x99/frame 0xfffffe00de9f8860 trap() at trap+0x2a5/frame 0xfffffe00de9f8970 calltrap() at calltrap+0x8/frame 0xfffffe00de9f8970 --- trap 0xc, rip = 0xffffffff80ee9cee, rsp = 0xfffffe00de9f8a40, rbp = 0xfffffe00de9f8a90 --- ufs_reclaim() at ufs_reclaim+0x10e/frame 0xfffffe00de9f8a90 VOP_RECLAIM_APV() at VOP_RECLAIM_APV+0x59/frame 0xfffffe00de9f8ab0 vgonel() at vgonel+0x3b7/frame 0xfffffe00de9f8b10 vnlru_proc() at vnlru_proc+0x7fb/frame 0xfffffe00de9f8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00de9f8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00de9f8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00e50636e8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00de9f8010 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00de9f8020 db_get_value() at db_get_value+0x4c/frame 0xfffffe00de9f8060 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00de9f80f0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00de9f8110 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00de9f81b0 db_command() at db_command+0x25c/frame 0xfffffe00de9f8280 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00de9f8320 db_command() at db_command+0x25c/frame 0xfffffe00de9f83f0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00de9f8400 db_trap() at db_trap+0xe8/frame 0xfffffe00de9f8490 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00de9f8500 trap() at trap+0x7b8/frame 0xfffffe00de9f8610 calltrap() at calltrap+0x8/frame 0xfffffe00de9f8610 --- trap 0x3, rip = 0xffffffff80c0ab97, rsp = 0xfffffe00de9f86e0, rbp = 0xfffffe00de9f86f0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00de9f86f0 vpanic() at vpanic+0x19e/frame 0xfffffe00de9f8740 panic() at panic+0x43/frame 0xfffffe00de9f87a0 trap_fatal() at trap_fatal+0x387/frame 0xfffffe00de9f8800 trap_pfault() at trap_pfault+0x99/frame 0xfffffe00de9f8860 trap() at trap+0x2a5/frame 0xfffffe00de9f8970 calltrap() at calltrap+0x8/frame 0xfffffe00de9f8970 --- trap 0xc, rip = 0xffffffff80ee9cee, rsp = 0xfffffe00de9f8a40, rbp = 0xfffffe00de9f8a90 --- ufs_reclaim() at ufs_reclaim+0x10e/frame 0xfffffe00de9f8a90 VOP_RECLAIM_APV() at VOP_RECLAIM_APV+0x59/frame 0xfffffe00de9f8ab0 vgonel() at vgonel+0x3b7/frame 0xfffffe00de9f8b10 vnlru_proc() at vnlru_proc+0x7fb/frame 0xfffffe00de9f8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00de9f8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00de9f8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sshd pid 2435 tid 100228 td 0xfffffe00e7f22100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e8004740 mi_switch() at mi_switch+0x155/frame 0xfffffe00e8004760 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e80047a0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e8004800 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e8004810 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e8004870 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e80048b0 kern_select() at kern_select+0x87a/frame 0xfffffe00e8004a90 sys_select() at sys_select+0x56/frame 0xfffffe00e8004ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e8004bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e8004bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8008e17fa, rsp = 0x7fffffffa548, rbp = 0x7fffffffa580 --- Tracing command sshd pid 2432 tid 100153 td 0xfffffe00d5dfc300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e50367c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e50367e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e5036820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e5036880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e5036890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e50368f0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e5036930 kern_poll() at kern_poll+0x48b/frame 0xfffffe00e5036ab0 sys_poll() at sys_poll+0x50/frame 0xfffffe00e5036ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e5036bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5036bf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x80088500a, rsp = 0x7fffffffe5a8, rbp = 0x7fffffffe5e0 --- Tracing command csh pid 2428 tid 100143 td 0xfffffe00d39fd500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e50047c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e50047e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e5004820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e5004880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e5004890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e50048f0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e5004920 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e5004980 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e50049b0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e5004a10 dofileread() at dofileread+0x81/frame 0xfffffe00e5004a60 sys_read() at sys_read+0xc0/frame 0xfffffe00e5004ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e5004bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5004bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80051081a, rsp = 0x7fffffffe1e8, rbp = 0x7fffffffe210 --- Tracing command login pid 2427 tid 100226 td 0xfffffe00e7f22800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e51f76e0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00de9f7da0 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00de9f7db0 trap() at trap+0x6c/frame 0xfffffe00de9f7ec0 calltrap() at calltrap+0x8/frame 0xfffffe00de9f7ec0 --- trap 0xc, rip = 0xffffffff810393b0, rsp = 0xfffffe00de9f7f90, rbp = 0xfffffe00de9f8020 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe00de9f8020 db_get_value() at db_get_value+0x32/frame 0xfffffe00de9f8060 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00de9f80f0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00de9f8110 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00de9f81b0 db_command() at db_command+0x25c/frame 0xfffffe00de9f8280 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00de9f8320 db_command() at db_command+0x25c/frame 0xfffffe00de9f83f0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00de9f8400 db_trap() at db_trap+0xe8/frame 0xfffffe00de9f8490 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00de9f8500 trap() at trap+0x7b8/frame 0xfffffe00de9f8610 calltrap() at calltrap+0x8/frame 0xfffffe00de9f8610 --- trap 0x3, rip = 0xffffffff80c0ab97, rsp = 0xfffffe00de9f86e0, rbp = 0xfffffe00de9f86f0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00de9f86f0 vpanic() at vpanic+0x19e/frame 0xfffffe00de9f8740 panic() at panic+0x43/frame 0xfffffe00de9f87a0 trap_fatal() at trap_fatal+0x387/frame 0xfffffe00de9f8800 trap_pfault() at trap_pfault+0x99/frame 0xfffffe00de9f8860 trap() at trap+0x2a5/frame 0xfffffe00de9f8970 calltrap() at calltrap+0x8/frame 0xfffffe00de9f8970 --- trap 0xc, rip = 0xffffffff80ee9cee, rsp = 0xfffffe00de9f8a40, rbp = 0xfffffe00de9f8a90 --- ufs_reclaim() at ufs_reclaim+0x10e/frame 0xfffffe00de9f8a90 VOP_RECLAIM_APV() at VOP_RECLAIM_APV+0x59/frame 0xfffffe00de9f8ab0 vgonel() at vgonel+0x3b7/frame 0xfffffe00de9f8b10 vnlru_proc() at vnlru_proc+0x7fb/frame 0xfffffe00de9f8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00de9f8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00de9f8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00e51f76e8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00de9f8010 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00de9f8020 db_get_value() at db_get_value+0x4c/frame 0xfffffe00de9f8060 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00de9f80f0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00de9f8110 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00de9f81b0 db_command() at db_command+0x25c/frame 0xfffffe00de9f8280 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00de9f8320 db_command() at db_command+0x25c/frame 0xfffffe00de9f83f0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00de9f8400 db_trap() at db_trap+0xe8/frame 0xfffffe00de9f8490 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00de9f8500 trap() at trap+0x7b8/frame 0xfffffe00de9f8610 calltrap() at calltrap+0x8/frame 0xfffffe00de9f8610 --- trap 0x3, rip = 0xffffffff80c0ab97, rsp = 0xfffffe00de9f86e0, rbp = 0xfffffe00de9f86f0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00de9f86f0 vpanic() at vpanic+0x19e/frame 0xfffffe00de9f8740 panic() at panic+0x43/frame 0xfffffe00de9f87a0 trap_fatal() at trap_fatal+0x387/frame 0xfffffe00de9f8800 trap_pfault() at trap_pfault+0x99/frame 0xfffffe00de9f8860 trap() at trap+0x2a5/frame 0xfffffe00de9f8970 calltrap() at calltrap+0x8/frame 0xfffffe00de9f8970 --- trap 0xc, rip = 0xffffffff80ee9cee, rsp = 0xfffffe00de9f8a40, rbp = 0xfffffe00de9f8a90 --- ufs_reclaim() at ufs_reclaim+0x10e/frame 0xfffffe00de9f8a90 VOP_RECLAIM_APV() at VOP_RECLAIM_APV+0x59/frame 0xfffffe00de9f8ab0 vgonel() at vgonel+0x3b7/frame 0xfffffe00de9f8b10 vnlru_proc() at vnlru_proc+0x7fb/frame 0xfffffe00de9f8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00de9f8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00de9f8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command getty pid 2426 tid 100225 td 0xfffffe00e7f37000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e51f27c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e51f27e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e51f2820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e51f2880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e51f2890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e51f28f0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e51f2920 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e51f2980 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e51f29b0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e51f2a10 dofileread() at dofileread+0x81/frame 0xfffffe00e51f2a60 sys_read() at sys_read+0xc0/frame 0xfffffe00e51f2ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e51f2bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e51f2bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043781a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2425 tid 100224 td 0xfffffe00e7f37700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e51ed7c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e51ed7e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e51ed820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e51ed880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e51ed890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e51ed8f0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e51ed920 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e51ed980 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e51ed9b0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e51eda10 dofileread() at dofileread+0x81/frame 0xfffffe00e51eda60 sys_read() at sys_read+0xc0/frame 0xfffffe00e51edad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e51edbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e51edbf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043781a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2424 tid 100223 td 0xfffffe00e7395100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e51e87c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e51e87e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e51e8820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e51e8880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e51e8890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e51e88f0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e51e8920 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e51e8980 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e51e89b0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e51e8a10 dofileread() at dofileread+0x81/frame 0xfffffe00e51e8a60 sys_read() at sys_read+0xc0/frame 0xfffffe00e51e8ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e51e8bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e51e8bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043781a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2423 tid 100222 td 0xfffffe00e7395800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e51e37c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e51e37e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e51e3820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e51e3880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e51e3890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e51e38f0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e51e3920 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e51e3980 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e51e39b0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e51e3a10 dofileread() at dofileread+0x81/frame 0xfffffe00e51e3a60 sys_read() at sys_read+0xc0/frame 0xfffffe00e51e3ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e51e3bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e51e3bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043781a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2422 tid 100221 td 0xfffffe00e7396000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e51de7c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e51de7e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e51de820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e51de880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e51de890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e51de8f0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e51de920 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e51de980 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e51de9b0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e51dea10 dofileread() at dofileread+0x81/frame 0xfffffe00e51dea60 sys_read() at sys_read+0xc0/frame 0xfffffe00e51dead0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e51debf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e51debf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043781a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2421 tid 100194 td 0xfffffe00d61fb300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e51277c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e51277e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e5127820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e5127880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e5127890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e51278f0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e5127920 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e5127980 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e51279b0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e5127a10 dofileread() at dofileread+0x81/frame 0xfffffe00e5127a60 sys_read() at sys_read+0xc0/frame 0xfffffe00e5127ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e5127bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5127bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043781a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2420 tid 100219 td 0xfffffe00e7396700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e51d47c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e51d47e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e51d4820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e51d4880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e51d4890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e51d48f0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e51d4920 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e51d4980 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e51d49b0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e51d4a10 dofileread() at dofileread+0x81/frame 0xfffffe00e51d4a60 sys_read() at sys_read+0xc0/frame 0xfffffe00e51d4ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e51d4bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e51d4bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043781a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2419 tid 100163 td 0xfffffe00d35de000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e50687c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e50687e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e5068820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e5068880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e5068890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e50688f0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e5068920 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e5068980 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e50689b0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e5068a10 dofileread() at dofileread+0x81/frame 0xfffffe00e5068a60 sys_read() at sys_read+0xc0/frame 0xfffffe00e5068ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e5068bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5068bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043781a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2418 tid 100142 td 0xfffffe00d31a7800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00de9fd7c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00de9fd7e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00de9fd820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00de9fd880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00de9fd890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00de9fd8f0 tty_wait() at tty_wait+0x42/frame 0xfffffe00de9fd920 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00de9fd980 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00de9fd9b0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00de9fda10 dofileread() at dofileread+0x81/frame 0xfffffe00de9fda60 sys_read() at sys_read+0xc0/frame 0xfffffe00de9fdad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00de9fdbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00de9fdbf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043781a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command cron pid 2369 tid 100187 td 0xfffffe00e5698500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e50f8870 mi_switch() at mi_switch+0x155/frame 0xfffffe00e50f8890 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e50f88d0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e50f8930 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e50f8970 _sleep() at _sleep+0x258/frame 0xfffffe00e50f8a10 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe00e50f8a90 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00e50f8ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e50f8bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e50f8bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003dcbaa, rsp = 0x7fffffffeaa8, rbp = 0x7fffffffec90 --- Tracing command sshd pid 2365 tid 100207 td 0xfffffe00e7e93000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e5198740 mi_switch() at mi_switch+0x155/frame 0xfffffe00e5198760 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e51987a0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e5198800 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e5198810 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e5198870 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e51988b0 kern_select() at kern_select+0x87a/frame 0xfffffe00e5198a90 sys_select() at sys_select+0x56/frame 0xfffffe00e5198ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e5198bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5198bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8008e17fa, rsp = 0x7fffffffe638, rbp = 0x7fffffffe670 --- Tracing command powerd pid 2337 tid 100217 td 0xfffffe00e7f1f700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e51ca700 mi_switch() at mi_switch+0x155/frame 0xfffffe00e51ca720 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e51ca760 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e51ca7c0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e51ca800 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00e51ca870 seltdwait() at seltdwait+0x6b/frame 0xfffffe00e51ca8b0 kern_select() at kern_select+0x87a/frame 0xfffffe00e51caa90 sys_select() at sys_select+0x56/frame 0xfffffe00e51caad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e51cabf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e51cabf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8004347fa, rsp = 0x7fffffffeb58, rbp = 0x7fffffffeca0 --- Tracing command ntpd pid 2334 tid 100201 td 0xfffffe00e7e93e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e517a740 mi_switch() at mi_switch+0x155/frame 0xfffffe00e517a760 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e517a7a0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e517a800 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e517a810 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e517a870 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e517a8b0 kern_select() at kern_select+0x87a/frame 0xfffffe00e517aa90 sys_select() at sys_select+0x56/frame 0xfffffe00e517aad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e517abf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e517abf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80080f7fa, rsp = 0x7fffffffdec8, rbp = 0x7fffffffdf00 --- Tracing command ntpd pid 2334 tid 100566 td 0xfffffe0172cf8800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e8253820 mi_switch() at mi_switch+0x155/frame 0xfffffe00e8253840 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e8253880 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e82538e0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e82538f0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e8253990 umtxq_sleep() at umtxq_sleep+0x19e/frame 0xfffffe00e82539f0 do_sem2_wait() at do_sem2_wait+0x38f/frame 0xfffffe00e8253a80 __umtx_op_sem2_wait() at __umtx_op_sem2_wait+0x76/frame 0xfffffe00e8253ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e8253bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e8253bf0 --- syscall (454, FreeBSD ELF64, sys__umtx_op), rip = 0x800706a6a, rsp = 0x7fffdff3aee8, rbp = 0x7fffdff3af60 --- Tracing command rpc.lockd pid 2269 tid 100198 td 0xfffffe00e7eb9700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e516b640 mi_switch() at mi_switch+0x155/frame 0xfffffe00e516b660 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e516b6a0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e516b700 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e516b740 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00e516b7b0 svc_run_internal() at svc_run_internal+0xb05/frame 0xfffffe00e516b8f0 svc_run() at svc_run+0x253/frame 0xfffffe00e516b950 sys_nlm_syscall() at sys_nlm_syscall+0x74d/frame 0xfffffe00e516bad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e516bbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e516bbf0 --- syscall (154, FreeBSD ELF64, sys_nlm_syscall), rip = 0x8002f9b5a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec90 --- Tracing command rpc.statd pid 2266 tid 100184 td 0xfffffe00e7398300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e50e9700 mi_switch() at mi_switch+0x155/frame 0xfffffe00e50e9720 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e50e9760 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e50e97c0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e50e9800 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00e50e9870 seltdwait() at seltdwait+0x6b/frame 0xfffffe00e50e98b0 kern_select() at kern_select+0x87a/frame 0xfffffe00e50e9a90 sys_select() at sys_select+0x56/frame 0xfffffe00e50e9ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e50e9bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e50e9bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80042a7fa, rsp = 0x7fffffffea68, rbp = 0x7fffffffebb0 --- Tracing command watchdogd pid 2220 tid 100208 td 0xfffffe00d61fac00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e519d870 mi_switch() at mi_switch+0x155/frame 0xfffffe00e519d890 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e519d8d0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e519d930 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e519d970 _sleep() at _sleep+0x258/frame 0xfffffe00e519da10 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe00e519da90 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00e519dad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e519dbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e519dbf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003c5baa, rsp = 0x7fffffffea68, rbp = 0x7fffffffeab0 --- Tracing command rpcbind pid 2072 tid 100170 td 0xfffffe00d61fba00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e50a3780 mi_switch() at mi_switch+0x155/frame 0xfffffe00e50a37a0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e50a37e0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e50a3840 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e50a3880 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00e50a38f0 seltdwait() at seltdwait+0x6b/frame 0xfffffe00e50a3930 kern_poll() at kern_poll+0x48b/frame 0xfffffe00e50a3ab0 sys_poll() at sys_poll+0x50/frame 0xfffffe00e50a3ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e50a3bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e50a3bf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003d300a, rsp = 0x7fffffffca08, rbp = 0x7fffffffec20 --- Tracing command syslogd pid 2062 tid 100171 td 0xfffffe00d39fce00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e50a8840 mi_switch() at mi_switch+0x155/frame 0xfffffe00e50a8860 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e50a88a0 _sleep() at _sleep+0x2cd/frame 0xfffffe00e50a8940 bufobj_wwait() at bufobj_wwait+0x89/frame 0xfffffe00e50a8980 ffs_syncvnode() at ffs_syncvnode+0x317/frame 0xfffffe00e50a8a00 ffs_fsync() at ffs_fsync+0x22/frame 0xfffffe00e50a8a40 VOP_FSYNC_APV() at VOP_FSYNC_APV+0x59/frame 0xfffffe00e50a8a60 kern_fsync() at kern_fsync+0x180/frame 0xfffffe00e50a8ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e50a8bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e50a8bf0 --- syscall (95, FreeBSD ELF64, sys_fsync), rip = 0x80043b86a, rsp = 0x7fffffffe718, rbp = 0x7fffffffec90 --- Tracing command devd pid 1991 tid 100166 td 0xfffffe00e569a100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e5083700 mi_switch() at mi_switch+0x155/frame 0xfffffe00e5083720 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e5083760 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e50837c0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e5083800 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00e5083870 seltdwait() at seltdwait+0x6b/frame 0xfffffe00e50838b0 kern_select() at kern_select+0x87a/frame 0xfffffe00e5083a90 sys_select() at sys_select+0x56/frame 0xfffffe00e5083ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e5083bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5083bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x2f63aa, rsp = 0x7fffffffcb18, rbp = 0x7fffffffecb0 --- Tracing command dhclient pid 1986 tid 100191 td 0xfffffe00e5697e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e510c780 mi_switch() at mi_switch+0x155/frame 0xfffffe00e510c7a0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e510c7e0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e510c840 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e510c880 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00e510c8f0 seltdwait() at seltdwait+0x6b/frame 0xfffffe00e510c930 kern_poll() at kern_poll+0x48b/frame 0xfffffe00e510cab0 sys_poll() at sys_poll+0x50/frame 0xfffffe00e510cad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e510cbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e510cbf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003f800a, rsp = 0x7fffffffebf8, rbp = 0x7fffffffec30 --- Tracing command dhclient pid 1927 tid 100146 td 0xfffffe003e4b7100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e50137c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e50137e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e5013820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e5013880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e5013890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e50138f0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e5013930 kern_poll() at kern_poll+0x48b/frame 0xfffffe00e5013ab0 sys_poll() at sys_poll+0x50/frame 0xfffffe00e5013ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e5013bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5013bf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003f800a, rsp = 0x7fffffffec08, rbp = 0x7fffffffec30 --- Tracing command dhclient pid 1924 tid 100144 td 0xfffffe00d35dee00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e5009740 mi_switch() at mi_switch+0x155/frame 0xfffffe00e5009760 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e50097a0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e5009800 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e5009810 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e5009870 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e50098b0 kern_select() at kern_select+0x87a/frame 0xfffffe00e5009a90 sys_select() at sys_select+0x56/frame 0xfffffe00e5009ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e5009bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5009bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8004547fa, rsp = 0x7fffffffe9b8, rbp = 0x7fffffffea70 --- Tracing command vnlru pid 34 tid 100141 td 0xfffffe00d35df500 (CPU 4) kdb_enter() at kdb_enter+0x37/frame 0xfffffe00de9f86f0 vpanic() at vpanic+0x19e/frame 0xfffffe00de9f8740 panic() at panic+0x43/frame 0xfffffe00de9f87a0 trap_fatal() at trap_fatal+0x387/frame 0xfffffe00de9f8800 trap_pfault() at trap_pfault+0x99/frame 0xfffffe00de9f8860 trap() at trap+0x2a5/frame 0xfffffe00de9f8970 calltrap() at calltrap+0x8/frame 0xfffffe00de9f8970 --- trap 0xc, rip = 0xffffffff80ee9cee, rsp = 0xfffffe00de9f8a40, rbp = 0xfffffe00de9f8a90 --- ufs_reclaim() at ufs_reclaim+0x10e/frame 0xfffffe00de9f8a90 VOP_RECLAIM_APV() at VOP_RECLAIM_APV+0x59/frame 0xfffffe00de9f8ab0 vgonel() at vgonel+0x3b7/frame 0xfffffe00de9f8b10 vnlru_proc() at vnlru_proc+0x7fb/frame 0xfffffe00de9f8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00de9f8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00de9f8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command syncer pid 33 tid 100140 td 0xfffffe00d35dfc00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00de9f3a10 mi_switch() at mi_switch+0x155/frame 0xfffffe00de9f3a30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00de9f3a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00de9f3ab0 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x184/frame 0xfffffe00de9f3b20 sched_sync() at sched_sync+0x67b/frame 0xfffffe00de9f3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00de9f3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00de9f3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100131 td 0xfffffe00d35e0300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d7442a20 mi_switch() at mi_switch+0x155/frame 0xfffffe00d7442a40 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d7442a80 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00d7442ac0 _sleep() at _sleep+0x26c/frame 0xfffffe00d7442b60 buf_daemon() at buf_daemon+0x112/frame 0xfffffe00d7442bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d7442bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d7442bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100133 td 0xfffffe00d35e7c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d75eca10 mi_switch() at mi_switch+0x155/frame 0xfffffe00d75eca30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d75eca70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00d75ecab0 _sleep() at _sleep+0x26c/frame 0xfffffe00d75ecb50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00d75ecbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d75ecbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d75ecbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100134 td 0xfffffe00d35e7500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d75f1a10 mi_switch() at mi_switch+0x155/frame 0xfffffe00d75f1a30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d75f1a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00d75f1ab0 _sleep() at _sleep+0x26c/frame 0xfffffe00d75f1b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00d75f1bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d75f1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d75f1bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100135 td 0xfffffe00d35e6e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d75f6a10 mi_switch() at mi_switch+0x155/frame 0xfffffe00d75f6a30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d75f6a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00d75f6ab0 _sleep() at _sleep+0x26c/frame 0xfffffe00d75f6b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00d75f6bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d75f6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d75f6bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100136 td 0xfffffe00d35e6700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d75fba10 mi_switch() at mi_switch+0x155/frame 0xfffffe00d75fba30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d75fba70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00d75fbab0 _sleep() at _sleep+0x26c/frame 0xfffffe00d75fbb50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00d75fbbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d75fbbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d75fbbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100137 td 0xfffffe00d35e6000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00de8e4a10 mi_switch() at mi_switch+0x155/frame 0xfffffe00de8e4a30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00de8e4a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00de8e4ab0 _sleep() at _sleep+0x26c/frame 0xfffffe00de8e4b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00de8e4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00de8e4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00de8e4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100138 td 0xfffffe00d35e5800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00de9e9a10 mi_switch() at mi_switch+0x155/frame 0xfffffe00de9e9a30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00de9e9a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00de9e9ab0 _sleep() at _sleep+0x26c/frame 0xfffffe00de9e9b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00de9e9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00de9e9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00de9e9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100139 td 0xfffffe00d35e5100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00de9eea10 mi_switch() at mi_switch+0x155/frame 0xfffffe00de9eea30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00de9eea70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00de9eeab0 _sleep() at _sleep+0x26c/frame 0xfffffe00de9eeb50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00de9eebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00de9eebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00de9eebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100150 td 0xfffffe00d31a6a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e5027a40 mi_switch() at mi_switch+0x155/frame 0xfffffe00e5027a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e5027aa0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e5027ae0 _sleep() at _sleep+0x26c/frame 0xfffffe00e5027b80 softdep_flush() at softdep_flush+0x16e/frame 0xfffffe00e5027bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e5027bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e5027bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100215 td 0xfffffe00d35e1100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e51c0a40 mi_switch() at mi_switch+0x155/frame 0xfffffe00e51c0a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e51c0aa0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e51c0ae0 _sleep() at _sleep+0x26c/frame 0xfffffe00e51c0b80 softdep_flush() at softdep_flush+0x16e/frame 0xfffffe00e51c0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e51c0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e51c0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vmdaemon pid 31 tid 100129 td 0xfffffe00d35e0a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d7438a40 mi_switch() at mi_switch+0x155/frame 0xfffffe00d7438a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d7438aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe00d7438b40 vm_daemon() at vm_daemon+0x82/frame 0xfffffe00d7438bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d7438bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d7438bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100128 td 0xfffffe00d6092e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d7433670 mi_switch() at mi_switch+0x155/frame 0xfffffe00d7433690 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d74336d0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00d7433710 _sleep() at _sleep+0x26c/frame 0xfffffe00d74337b0 vm_pageout_worker() at vm_pageout_worker+0x279/frame 0xfffffe00d7433b70 vm_pageout() at vm_pageout+0x193/frame 0xfffffe00d7433bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d7433bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d7433bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100130 td 0xfffffe00d35e4300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d743d830 mi_switch() at mi_switch+0x155/frame 0xfffffe00d743d850 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d743d890 _sleep() at _sleep+0x2cd/frame 0xfffffe00d743d930 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0xc11/frame 0xfffffe00d743dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d743dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d743dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100132 td 0xfffffe00d35e3c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d7447a40 mi_switch() at mi_switch+0x155/frame 0xfffffe00d7447a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d7447aa0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00d7447ae0 _sleep() at _sleep+0x26c/frame 0xfffffe00d7447b80 uma_reclaim_worker() at uma_reclaim_worker+0xb8/frame 0xfffffe00d7447bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d7447bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d7447bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon1 pid 29 tid 100127 td 0xfffffe00d5dfd100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d742ea40 mi_switch() at mi_switch+0x155/frame 0xfffffe00d742ea60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d742eaa0 _sleep() at _sleep+0x2cd/frame 0xfffffe00d742eb40 enc_daemon() at enc_daemon+0xe4/frame 0xfffffe00d742ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d742ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d742ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon0 pid 28 tid 100126 td 0xfffffe00d61fc800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d7429a40 mi_switch() at mi_switch+0x155/frame 0xfffffe00d7429a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d7429aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe00d7429b40 enc_daemon() at enc_daemon+0xe4/frame 0xfffffe00d7429bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d7429bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d7429bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command rand_harvestq pid 27 tid 100120 td 0xfffffe00d6095800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037bfb9f0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037bfba10 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bfba50 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037bfba90 _sleep() at _sleep+0x26c/frame 0xfffffe0037bfbb30 random_kthread() at random_kthread+0x67/frame 0xfffffe0037bfbbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bfbbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bfbbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sctp_iterator pid 26 tid 100119 td 0xfffffe00d61f9000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037bf6a90 mi_switch() at mi_switch+0x155/frame 0xfffffe0037bf6ab0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bf6af0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037bf6b90 sctp_iterator_thread() at sctp_iterator_thread+0x59/frame 0xfffffe0037bf6bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bf6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bf6bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod4 pid 25 tid 100118 td 0xfffffe00d6092000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037bf1a30 mi_switch() at mi_switch+0x155/frame 0xfffffe0037bf1a50 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bf1a90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037bf1ad0 _sleep() at _sleep+0x26c/frame 0xfffffe0037bf1b70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe0037bf1bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bf1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bf1bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod3 pid 24 tid 100117 td 0xfffffe00d6092700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037beca30 mi_switch() at mi_switch+0x155/frame 0xfffffe0037beca50 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037beca90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037becad0 _sleep() at _sleep+0x26c/frame 0xfffffe0037becb70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe0037becbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037becbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037becbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod2 pid 23 tid 100116 td 0xfffffe003e45ec00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037be7a30 mi_switch() at mi_switch+0x155/frame 0xfffffe0037be7a50 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037be7a90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037be7ad0 _sleep() at _sleep+0x26c/frame 0xfffffe0037be7b70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe0037be7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037be7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037be7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod1 pid 22 tid 100115 td 0xfffffe003e45f300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037be2a30 mi_switch() at mi_switch+0x155/frame 0xfffffe0037be2a50 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037be2a90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037be2ad0 _sleep() at _sleep+0x26c/frame 0xfffffe0037be2b70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe0037be2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037be2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037be2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100096 td 0xfffffe003e4b4e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b77ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b77ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b77b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b77b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b77bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b77bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b77bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100097 td 0xfffffe003e4b4700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b7cab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b7cad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b7cb10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b7cb70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b7cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b7cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b7cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100098 td 0xfffffe003e4b4000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b81ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b81ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b81b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b81b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b81bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b81bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b81bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100099 td 0xfffffe003e1aa800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b86ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b86ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b86b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b86b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b86bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b86bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b86bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100100 td 0xfffffe003e1aa100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b8bab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b8bad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b8bb10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b8bb70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b8bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b8bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b8bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100102 td 0xfffffe00d2e1a500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b95ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b95ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b95b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b95b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b95bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b95bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b95bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100103 td 0xfffffe00d2e19e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b9aab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b9aad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b9ab10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b9ab70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b9abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b9abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b9abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100104 td 0xfffffe00d2e19700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b9fab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b9fad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b9fb10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b9fb70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b9fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b9fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b9fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100105 td 0xfffffe00d2e19000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037ba4ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037ba4ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ba4b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037ba4b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037ba4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ba4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ba4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100106 td 0xfffffe003e4b7800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037ba9ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037ba9ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ba9b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037ba9b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037ba9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ba9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ba9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100107 td 0xfffffe003e1b6100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037baeab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037baead0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037baeb10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037baeb70 usb_process() at usb_process+0xc3/frame 0xfffffe0037baebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037baebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037baebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100108 td 0xfffffe00d31a4e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037bb3ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037bb3ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bb3b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037bb3b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037bb3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bb3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bb3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100109 td 0xfffffe00d31a4700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037bb8ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037bb8ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bb8b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037bb8b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037bb8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bb8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bb8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100110 td 0xfffffe00d31a4000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037bbdab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037bbdad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bbdb10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037bbdb70 usb_process() at usb_process+0xc3/frame 0xfffffe0037bbdbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bbdbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bbdbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100111 td 0xfffffe00d2e1c800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037bc2ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037bc2ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bc2b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037bc2b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037bc2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bc2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bc2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100091 td 0xfffffe003e1a7700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b5ea60 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b5ea80 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b5eac0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b5eb60 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe0037b5ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b5ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b5ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100092 td 0xfffffe003e1a7000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b63a60 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b63a80 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b63ac0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b63b60 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe0037b63bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b63bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b63bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100093 td 0xfffffe003e1b6800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b68a60 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b68a80 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b68ac0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b68b60 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe0037b68bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b68bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b68bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100125 td 0xfffffe00d6093500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d7424a70 mi_switch() at mi_switch+0x155/frame 0xfffffe00d7424a90 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d7424ad0 _sleep() at _sleep+0x2cd/frame 0xfffffe00d7424b70 xpt_scanner_thread() at xpt_scanner_thread+0x68/frame 0xfffffe00d7424bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d7424bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d7424bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 11 pid 19 tid 100090 td 0xfffffe003e1a7e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b59a40 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b59a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b59aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b59b40 crypto_ret_proc() at crypto_ret_proc+0x240/frame 0xfffffe0037b59bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b59bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b59bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 10 pid 18 tid 100089 td 0xfffffe003e1a8500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b54a40 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b54a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b54aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b54b40 crypto_ret_proc() at crypto_ret_proc+0x240/frame 0xfffffe0037b54bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b54bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b54bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 9 pid 17 tid 100088 td 0xfffffe003e1a8c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b4fa40 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b4fa60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b4faa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b4fb40 crypto_ret_proc() at crypto_ret_proc+0x240/frame 0xfffffe0037b4fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b4fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b4fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 8 pid 16 tid 100087 td 0xfffffe003e1a9300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b4aa40 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b4aa60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b4aaa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b4ab40 crypto_ret_proc() at crypto_ret_proc+0x240/frame 0xfffffe0037b4abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b4abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b4abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 7 pid 15 tid 100086 td 0xfffffe003e1c2800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b45a40 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b45a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b45aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b45b40 crypto_ret_proc() at crypto_ret_proc+0x240/frame 0xfffffe0037b45bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b45bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b45bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 6 pid 9 tid 100085 td 0xfffffe003e1b3000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b40a40 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b40a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b40aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b40b40 crypto_ret_proc() at crypto_ret_proc+0x240/frame 0xfffffe0037b40bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b40bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b40bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 5 pid 8 tid 100084 td 0xfffffe003e1b3700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b3ba40 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b3ba60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b3baa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b3bb40 crypto_ret_proc() at crypto_ret_proc+0x240/frame 0xfffffe0037b3bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b3bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b3bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 4 pid 7 tid 100083 td 0xfffffe003e1b3e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b36a40 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b36a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b36aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b36b40 crypto_ret_proc() at crypto_ret_proc+0x240/frame 0xfffffe0037b36bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b36bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b36bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 3 pid 6 tid 100082 td 0xfffffe003e1b4500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b31a40 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b31a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b31aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b31b40 crypto_ret_proc() at crypto_ret_proc+0x240/frame 0xfffffe0037b31bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b31bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b31bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 2 pid 5 tid 100081 td 0xfffffe003e1b4c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b2ca40 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b2ca60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b2caa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b2cb40 crypto_ret_proc() at crypto_ret_proc+0x240/frame 0xfffffe0037b2cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b2cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b2cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 1 pid 4 tid 100080 td 0xfffffe003e1b5300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b27a40 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b27a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b27aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b27b40 crypto_ret_proc() at crypto_ret_proc+0x240/frame 0xfffffe0037b27bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b27bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b27bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 0 pid 3 tid 100079 td 0xfffffe003e1b5a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b22a40 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b22a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b22aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b22b40 crypto_ret_proc() at crypto_ret_proc+0x240/frame 0xfffffe0037b22bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b22bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b22bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 2 tid 100078 td 0xfffffe003e1bf000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b1da70 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b1da90 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b1dad0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b1db70 crypto_proc() at crypto_proc+0x24b/frame 0xfffffe0037b1dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b1dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b1dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sequencer 00 pid 14 tid 100065 td 0xfffffe003e1e5a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037adca70 mi_switch() at mi_switch+0x155/frame 0xfffffe0037adca90 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037adcad0 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037adcb30 seq_eventthread() at seq_eventthread+0x91/frame 0xfffffe0037adcbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037adcbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037adcbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100062 td 0xfffffe003e1efe00 (CPU 7) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1c5e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1c5e10 trap() at trap+0x56/frame 0xfffffe003e1c5f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1c5f20 --- trap 0x13, rip = 0xffffffff80c0c162, rsp = 0xfffffe0037acda80, rbp = 0xfffffe0037acda90 --- lock_delay() at lock_delay+0x32/frame 0xfffffe0037acda90 _sx_xlock_hard() at _sx_xlock_hard+0x199/frame 0xfffffe0037acdb30 _sx_xlock() at _sx_xlock+0xba/frame 0xfffffe0037acdb70 g_run_events() at g_run_events+0x7e/frame 0xfffffe0037acdbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037acdbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037acdbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100063 td 0xfffffe003e1e6800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037ad2a70 mi_switch() at mi_switch+0x155/frame 0xfffffe0037ad2a90 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ad2ad0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ad2b70 g_io_schedule_up() at g_io_schedule_up+0x3c/frame 0xfffffe0037ad2ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe0037ad2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ad2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ad2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100064 td 0xfffffe003e1e6100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037ad7a70 mi_switch() at mi_switch+0x155/frame 0xfffffe0037ad7a90 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ad7ad0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ad7b70 g_io_schedule_down() at g_io_schedule_down+0x4c/frame 0xfffffe0037ad7ba0 g_down_procbody() at g_down_procbody+0x5c/frame 0xfffffe0037ad7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ad7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ad7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100043 td 0xfffffe003e463000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037a0eb00 mi_switch() at mi_switch+0x155/frame 0xfffffe0037a0eb20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037a0ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a0ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a0ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100044 td 0xfffffe003e460800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037a13b00 mi_switch() at mi_switch+0x155/frame 0xfffffe0037a13b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037a13bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a13bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a13bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100046 td 0xfffffe003e45fa00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100047 td 0xfffffe003e1ef700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037a52b00 mi_switch() at mi_switch+0x155/frame 0xfffffe0037a52b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037a52bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a52bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a52bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100048 td 0xfffffe003e1ef000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037a57b00 mi_switch() at mi_switch+0x155/frame 0xfffffe0037a57b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037a57bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a57bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a57bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100049 td 0xfffffe003e466800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037a5cb00 mi_switch() at mi_switch+0x155/frame 0xfffffe0037a5cb20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037a5cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a5cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a5cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100050 td 0xfffffe003e466100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037a61b00 mi_switch() at mi_switch+0x155/frame 0xfffffe0037a61b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037a61bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a61bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a61bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100051 td 0xfffffe003e465a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037a66b00 mi_switch() at mi_switch+0x155/frame 0xfffffe0037a66b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037a66bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a66bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a66bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100052 td 0xfffffe003e465300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037a6bb00 mi_switch() at mi_switch+0x155/frame 0xfffffe0037a6bb20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037a6bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a6bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a6bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100053 td 0xfffffe003e464c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037a70b00 mi_switch() at mi_switch+0x155/frame 0xfffffe0037a70b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037a70bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a70bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a70bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100054 td 0xfffffe003e464500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037a75b00 mi_switch() at mi_switch+0x155/frame 0xfffffe0037a75b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037a75bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a75bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a75bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100055 td 0xfffffe003e1e3000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037a7ab00 mi_switch() at mi_switch+0x155/frame 0xfffffe0037a7ab20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037a7abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a7abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a7abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100056 td 0xfffffe003e1f2800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037a7fb00 mi_switch() at mi_switch+0x155/frame 0xfffffe0037a7fb20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037a7fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a7fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a7fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100057 td 0xfffffe003e1f2100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037a84b00 mi_switch() at mi_switch+0x155/frame 0xfffffe0037a84b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037a84bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a84bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a84bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100058 td 0xfffffe003e1f1a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037a89b00 mi_switch() at mi_switch+0x155/frame 0xfffffe0037a89b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037a89bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a89bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a89bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100059 td 0xfffffe003e1f1300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037a8eb00 mi_switch() at mi_switch+0x155/frame 0xfffffe0037a8eb20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037a8ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a8ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a8ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100060 td 0xfffffe003e1f0c00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100094 td 0xfffffe003e4b5c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b6db00 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b6db20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037b6dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b6dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b6dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100095 td 0xfffffe003e4b5500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b72b00 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b72b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037b72bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b72bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b72bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100101 td 0xfffffe003e1a9a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b90b00 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b90b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037b90bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b90bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b90bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100112 td 0xfffffe00d2e1c100 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100113 td 0xfffffe00d2e1ba00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037bccb00 mi_switch() at mi_switch+0x155/frame 0xfffffe0037bccb20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037bccbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bccbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bccbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100175 td 0xfffffe00e70d2300 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100176 td 0xfffffe00e70d1c00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100177 td 0xfffffe00e70d1500 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100178 td 0xfffffe00e70d0e00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100179 td 0xfffffe00e70d0700 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100180 td 0xfffffe00e70d0000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100181 td 0xfffffe00e7394a00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100182 td 0xfffffe00e7394300 fork_trampoline() at fork_trampoline Tracing command idle pid 11 tid 100003 td 0xfffffe003e3e0300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add46ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add46ae0 sched_idletd() at sched_idletd+0x41d/frame 0xfffffe00add46bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add46bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add46bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffffe003e3dfc00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add4bac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add4bae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add4bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add4bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add4bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffffe003e3df500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add50ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add50ae0 sched_idletd() at sched_idletd+0x41d/frame 0xfffffe00add50bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add50bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add50bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffffe003e3dee00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add55ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add55ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add55bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add55bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add55bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffffe003e3de700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add5aac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add5aae0 sched_idletd() at sched_idletd+0x41d/frame 0xfffffe00add5abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add5abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add5abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffffe003e3de000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add5fac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add5fae0 sched_idletd() at sched_idletd+0x9e/frame 0xfffffe00add5fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add5fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add5fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffffe003e3e8a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add64ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add64ae0 sched_idletd() at sched_idletd+0x9e/frame 0xfffffe00add64bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add64bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add64bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffffe003e3e8300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add69ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add69ae0 sched_idletd() at sched_idletd+0x41d/frame 0xfffffe00add69bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add69bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add69bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffffe003e3e7c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add6eac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add6eae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add6ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add6ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add6ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffffe003e3e7500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add73ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add73ae0 sched_idletd() at sched_idletd+0x9e/frame 0xfffffe00add73bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add73bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add73bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffffe003e3e6e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add78ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add78ae0 sched_idletd() at sched_idletd+0x41d/frame 0xfffffe00add78bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add78bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add78bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffffe003e3e6700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add7dac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add7dae0 sched_idletd() at sched_idletd+0x9e/frame 0xfffffe00add7dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add7dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add7dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command init pid 1 tid 100002 td 0xfffffe003e3e0a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add416e0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add41700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00add41740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00add417a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00add417b0 _sleep() at _sleep+0x2c3/frame 0xfffffe00add41850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00add418e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe00add41ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00add41bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00add41bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x2b133a, rsp = 0x7fffffffe778, rbp = 0x7fffffffe7e0 --- Tracing command audit pid 10 tid 100001 td 0xfffffe003e3e1100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add3ca90 mi_switch() at mi_switch+0x155/frame 0xfffffe00add3cab0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00add3caf0 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe00add3cb50 audit_worker() at audit_worker+0x9f/frame 0xfffffe00add3cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add3cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add3cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xffffffff81d9f300 sched_switch() at sched_switch+0x5b2/frame 0xffffffff82306c10 mi_switch() at mi_switch+0x155/frame 0xffffffff82306c30 sleepq_switch() at sleepq_switch+0x11a/frame 0xffffffff82306c70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xffffffff82306cb0 _sleep() at _sleep+0x26c/frame 0xffffffff82306d50 swapper() at swapper+0x75/frame 0xffffffff82306da0 mi_startup() at mi_startup+0x2ed/frame 0xffffffff82306df0 btext() at btext+0x2c Tracing command kernel pid 0 tid 100015 td 0xfffffe003e3e6000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add82ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add82ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00add82b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00add82b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00add82bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add82bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add82bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100016 td 0xfffffe003e3e1800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add87ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add87ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00add87b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00add87b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00add87bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add87bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add87bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100017 td 0xfffffe003e455300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add8cab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add8cad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00add8cb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00add8cb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00add8cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add8cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add8cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100018 td 0xfffffe003e454c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add91ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add91ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00add91b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00add91b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00add91bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add91bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add91bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100019 td 0xfffffe003e454500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add96ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add96ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00add96b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00add96b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00add96bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add96bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add96bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xfffffe003e453e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add9bab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add9bad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00add9bb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00add9bb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00add9bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add9bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add9bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xfffffe003e453700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00adda0ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00adda0ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00adda0b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00adda0b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00adda0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adda0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adda0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xfffffe003e453000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00adda5ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00adda5ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00adda5b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00adda5b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00adda5bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adda5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adda5bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xfffffe003e3e9800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addaaab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addaaad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addaab10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addaab80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addaabb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addaabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addaabf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xfffffe003e3e9100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addafab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addafad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addafb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addafb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addafbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addafbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addafbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xfffffe003e458c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addb4ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addb4ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addb4b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addb4b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addb4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addb4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addb4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100026 td 0xfffffe003e458500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addb9ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addb9ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addb9b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addb9b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addb9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addb9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addb9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100027 td 0xfffffe003e457e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addbeab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addbead0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addbeb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addbeb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addbebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addbebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addbebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100028 td 0xfffffe003e457700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addc3ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addc3ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addc3b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addc3b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addc3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addc3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addc3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100029 td 0xfffffe003e457000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addc8ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addc8ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addc8b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addc8b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addc8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addc8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addc8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100030 td 0xfffffe003e456800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addcdab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addcdad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addcdb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addcdb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addcdbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addcdbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addcdbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100031 td 0xfffffe003e456100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addd2ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addd2ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addd2b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addd2b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addd2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addd2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addd2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100032 td 0xfffffe003e455a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addd7ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addd7ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addd7b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addd7b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addd7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addd7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addd7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100033 td 0xfffffe003e45e500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00adddcab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00adddcad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00adddcb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00adddcb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00adddcbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adddcbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adddcbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100034 td 0xfffffe003e45de00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00adde1ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00adde1ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00adde1b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00adde1b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00adde1bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adde1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adde1bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100035 td 0xfffffe003e45d700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00adde6ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00adde6ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00adde6b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00adde6b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00adde6bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adde6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adde6bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100036 td 0xfffffe003e45d000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addebab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addebad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addebb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addebb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addebbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addebbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addebbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100037 td 0xfffffe003e45a800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addf0ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addf0ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addf0b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addf0b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addf0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addf0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addf0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100038 td 0xfffffe003e45a100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addf5ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addf5ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addf5b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addf5b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addf5bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addf5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addf5bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100039 td 0xfffffe003e459a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addfaab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addfaad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addfab10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addfab80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addfabb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addfabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addfabf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100040 td 0xfffffe003e459300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addffa80 mi_switch() at mi_switch+0x155/frame 0xfffffe00addffaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addffae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00addffb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00addffbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addffbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addffbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100041 td 0xfffffe003e463e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037a04a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037a04aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037a04ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037a04b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037a04bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a04bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a04bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100042 td 0xfffffe003e463700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037a09a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037a09aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037a09ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037a09b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037a09bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a09bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a09bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100045 td 0xfffffe003e460100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037a18a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037a18aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037a18ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037a18b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037a18bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a18bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a18bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100061 td 0xfffffe003e1f0500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037ac8a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037ac8aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ac8ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ac8b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037ac8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ac8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ac8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100066 td 0xfffffe003e1e5300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037ae1a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037ae1aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ae1ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ae1b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037ae1bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ae1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ae1bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100067 td 0xfffffe003e1e4c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037ae6a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037ae6aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ae6ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ae6b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037ae6bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ae6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ae6bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100068 td 0xfffffe003e1e4500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037aeba80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037aebaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037aebae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037aebb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037aebbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037aebbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037aebbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100069 td 0xfffffe003e1e3e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037af0a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037af0aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037af0ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037af0b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037af0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037af0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037af0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100070 td 0xfffffe003e1e3700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037af5a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037af5aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037af5ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037af5b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037af5bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037af5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037af5bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100071 td 0xfffffe003e1c2100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037afaa80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037afaaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037afaae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037afab80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037afabb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037afabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037afabf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100072 td 0xfffffe003e1c1a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037affa80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037affaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037affae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037affb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037affbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037affbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037affbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100073 td 0xfffffe003e1c1300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b04a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b04aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b04ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b04b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037b04bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b04bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b04bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100074 td 0xfffffe003e1c0c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b09a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b09aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b09ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b09b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037b09bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b09bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b09bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100075 td 0xfffffe003e1c0500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b0ea80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b0eaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b0eae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b0eb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037b0ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b0ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b0ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100076 td 0xfffffe003e1bfe00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b13a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b13aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b13ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b13b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037b13bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b13bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b13bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100077 td 0xfffffe003e1bf700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b18a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b18aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b18ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b18b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037b18bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b18bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b18bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100114 td 0xfffffe00d2e1b300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037bd1ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037bd1ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bd1b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0037bd1b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xef/frame 0xfffffe0037bd1bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bd1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bd1bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100121 td 0xfffffe00d6095100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d7410ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00d7410ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d7410b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00d7410b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xef/frame 0xfffffe00d7410bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d7410bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d7410bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100122 td 0xfffffe00d6094a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d7415ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00d7415ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d7415b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00d7415b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xef/frame 0xfffffe00d7415bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d7415bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d7415bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100123 td 0xfffffe00d6094300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d741aab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00d741aad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d741ab10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00d741ab80 taskqueue_thread_loop() at taskqueue_thread_loop+0xef/frame 0xfffffe00d741abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d741abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d741abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100124 td 0xfffffe00d6093c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d741fa80 mi_switch() at mi_switch+0x155/frame 0xfffffe00d741faa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d741fae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00d741fb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00d741fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d741fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d741fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100271 td 0xfffffe00e7df3a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e8320a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e8320aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e8320ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00e8320b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00e8320bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e8320bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e8320bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100272 td 0xfffffe00e7c6f800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e82d5a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e82d5aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e82d5ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00e82d5b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00e82d5bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e82d5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e82d5bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100273 td 0xfffffe00e7c41e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e82a3a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e82a3aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e82a3ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00e82a3b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00e82a3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e82a3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e82a3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100274 td 0xfffffe00e86dee00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e83caa80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e83caaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e83caae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00e83cab80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00e83cabb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e83cabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e83cabf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100276 td 0xfffffe00e7c88300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e83cfa80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e83cfaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e83cfae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00e83cfb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00e83cfbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e83cfbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e83cfbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100277 td 0xfffffe00e7af0300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e8316a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e8316aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e8316ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00e8316b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00e8316bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e8316bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e8316bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100278 td 0xfffffe00e7e53000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e8377a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e8377aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e8377ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00e8377b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00e8377bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e8377bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e8377bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100279 td 0xfffffe00dd3fea00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e8345a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e8345aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e8345ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00e8345b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00e8345bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e8345bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e8345bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100280 td 0xfffffe00e9909800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e82b7a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e82b7aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e82b7ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00e82b7b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00e82b7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e82b7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e82b7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100281 td 0xfffffe00e9909100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e8386a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e8386aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e8386ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00e8386b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00e8386bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e8386bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e8386bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100284 td 0xfffffe00e9908a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e8224a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e8224aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e8224ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00e8224b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00e8224bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e8224bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e8224bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100286 td 0xfffffe00e9908300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e836da80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e836daa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e836dae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00e836db80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00e836dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e836dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e836dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100289 td 0xfffffe00e9907c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e82bca80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e82bcaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e82bcae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00e82bcb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00e82bcbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e82bcbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e82bcbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:pho> show allchains chain 1: thread 102054 (pid 70522, sleep) is sleeping on 0xffffffff81c83953 "nanslp" chain 2: thread 101902 (pid 70521, sleep) is sleeping on 0xffffffff81c83954 "nanslp" chain 3: thread 100602 (pid 70517, umount) is sleeping on 0xffffffff81c7c8e0 "g_waitidle" chain 4: thread 100858 (pid 70515, umount) is sleeping on 0xffffffff81c7c8e0 "g_waitidle" chain 5: thread 104494 (pid 70511, sleep) is sleeping on 0xffffffff81c83953 "nanslp" chain 6: thread 101553 (pid 70509, sleep) is sleeping on 0xffffffff81c83953 "nanslp" chain 7: thread 103353 (pid 70507, sleep) is sleeping on 0xffffffff81c83956 "nanslp" chain 8: thread 102063 (pid 70505, umount) is sleeping on 0xffffffff81c7c8e0 "g_waitidle" chain 9: thread 101428 (pid 70504, sleep) is sleeping on 0xffffffff81c83959 "nanslp" chain 10: thread 104537 (pid 70503, umount) is sleeping on 0xfffff8022bb1d200 "bo_wwait" chain 11: thread 101268 (pid 70502, sleep) is sleeping on 0xffffffff81c83950 "nanslp" chain 12: thread 101837 (pid 70501, sleep) is sleeping on 0xffffffff81c8395a "nanslp" chain 13: thread 101882 (pid 70500, sleep) is sleeping on 0xffffffff81c83953 "nanslp" chain 14: thread 102283 (pid 70496, sleep) is sleeping on 0xffffffff81c83951 "nanslp" chain 15: thread 100707 (pid 70483, sleep) is sleeping on 0xffffffff81c83952 "nanslp" chain 16: thread 100499 (pid 70476, umount) is sleeping on 0xfffffe00e8785000 "mntref" chain 17: thread 102402 (pid 70431, sh) is sleeping on 0xfffff8035d98aa50 "wait" chain 18: thread 100264 (pid 54655, sh) is sleeping on 0xfffff80300ee8000 "wait" chain 19: thread 101257 (pid 54654, sh) is sleeping on 0xfffff80359fc6a50 "wait" chain 20: thread 101554 (pid 54651, sh) is sleeping on 0xfffff8035ea47a50 "wait" chain 21: thread 102150 (pid 54646, sh) is sleeping on 0xfffff8035dc4a000 "wait" chain 22: thread 100397 (pid 54642, sh) is sleeping on 0xfffff80358c13528 "wait" chain 23: thread 100466 (pid 54641, sh) is sleeping on 0xfffff802a14fb000 "wait" chain 24: thread 102005 (pid 54640, sh) is sleeping on 0xfffff8035cd06000 "wait" chain 25: thread 102381 (pid 54639, sh) is sleeping on 0xfffff8035a543000 "wait" chain 26: thread 102114 (pid 54637, sh) is sleeping on 0xfffff803598fa000 "wait" chain 27: thread 104696 (pid 54636, sh) is sleeping on 0xfffff803fc67b528 "wait" chain 28: thread 104619 (pid 54633, sh) is sleeping on 0xfffff802a1435000 "wait" chain 29: thread 101761 (pid 54628, sh) is sleeping on 0xfffff8035a7ca000 "wait" chain 30: thread 101282 (pid 54624, sh) is sleeping on 0xfffff800219c4528 "wait" chain 31: thread 104574 (pid 54623, sh) is sleeping on 0xfffff803fc47a528 "wait" chain 32: thread 102093 (pid 54620, sh) is sleeping on 0xfffff80357c34000 "wait" chain 33: thread 101345 (pid 54616, sh) is sleeping on 0xfffff80358fe9a50 "wait" chain 34: thread 100297 (pid 54614, sh) is sleeping on 0xfffff802a15a9528 "wait" chain 35: thread 103079 (pid 54613, sh) is sleeping on 0xfffff803fce37a50 "wait" chain 36: thread 101326 (pid 54612, sh) is sleeping on 0xfffff8035892e000 "wait" chain 37: thread 100646 (pid 54611, sh) is sleeping on 0xfffff8030fca9000 "wait" chain 38: thread 104867 (pid 54609, sh) is sleeping on 0xfffff8035bd6fa50 "wait" chain 39: thread 101802 (pid 54608, sh) is sleeping on 0xfffff80300ee8528 "wait" chain 40: thread 102099 (pid 54603, md21) is sleeping on 0xfffff80226b79000 "mdwait" chain 41: thread 100614 (pid 54592, md20) is blocked on lockmgrKDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00de9f7d90 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00de9f7da0 trap() at trap+0x6c/frame 0xfffffe00de9f7eb0 calltrap() at calltrap+0x8/frame 0xfffffe00de9f7eb0 --- trap 0xc, rip = 0xffffffff80cb904f, rsp = 0xfffffe00de9f7f80, rbp = 0xfffffe00de9f7f80 --- strlen() at strlen+0x1f/frame 0xfffffe00de9f7f80 kvprintf() at kvprintf+0xf70/frame 0xfffffe00de9f80b0 db_printf() at db_printf+0x5c/frame 0xfffffe00de9f8130 lockmgr_chain() at lockmgr_chain+0x3e/frame 0xfffffe00de9f8150 print_lockchain() at print_lockchain+0x94/frame 0xfffffe00de9f8180 db_show_allchains() at db_show_allchains+0x97/frame 0xfffffe00de9f81b0 db_command() at db_command+0x25c/frame 0xfffffe00de9f8280 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00de9f8320 db_command() at db_command+0x25c/frame 0xfffffe00de9f83f0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00de9f8400 db_trap() at db_trap+0xe8/frame 0xfffffe00de9f8490 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00de9f8500 trap() at trap+0x7b8/frame 0xfffffe00de9f8610 calltrap() at calltrap+0x8/frame 0xfffffe00de9f8610 --- trap 0x3, rip = 0xffffffff80c0ab97, rsp = 0xfffffe00de9f86e0, rbp = 0xfffffe00de9f86f0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00de9f86f0 vpanic() at vpanic+0x19e/frame 0xfffffe00de9f8740 panic() at panic+0x43/frame 0xfffffe00de9f87a0 trap_fatal() at trap_fatal+0x387/frame 0xfffffe00de9f8800 trap_pfault() at trap_pfault+0x99/frame 0xfffffe00de9f8860 trap() at trap+0x2a5/frame 0xfffffe00de9f8970 calltrap() at calltrap+0x8/frame 0xfffffe00de9f8970 --- trap 0xc, rip = 0xffffffff80ee9cee, rsp = 0xfffffe00de9f8a40, rbp = 0xfffffe00de9f8a90 --- ufs_reclaim() at ufs_reclaim+0x10e/frame 0xfffffe00de9f8a90 VOP_RECLAIM_APV() at VOP_RECLAIM_APV+0x59/frame 0xfffffe00de9f8ab0 vgonel() at vgonel+0x3b7/frame 0xfffffe00de9f8b10 vnlru_proc() at vnlru_proc+0x7fb/frame 0xfffffe00de9f8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00de9f8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00de9f8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Script command 'show allchains' returned error db:0:pho> chain 1: thread 102054 (pid 70522, sleep) is sleeping on 0xffffffff81c83953 "nanslp" chain 2: thread 101902 (pid 70521, sleep) is sleeping on 0xffffffff81c83954 "nanslp" chain 3: thread 100602 (pid 70517, umount) is sleeping on 0xffffffff81c7c8e0 "g_waitidle" chain 4: thread 100858 (pid 70515, umount) is sleeping on 0xffffffff81c7c8e0 "g_waitidle" chain 5: thread 104494 (pid 70511, sleep) is sleeping on 0xffffffff81c83953 "nanslp" chain 6: thread 101553 (pid 70509, sleep) is sleeping on 0xffffffff81c83953 "nanslp" chain 7: thread 103353 (pid 70507, sleep) is sleeping on 0xffffffff81c83956 "nanslp" chain 8: thread 102063 (pid 70505, umount) is sleeping on 0xffffffff81c7c8e0 "g_waitidle" chain 9: thread 101428 (pid 70504, sleep) is sleeping on 0xffffffff81c83959 "nanslp" chain 10: thread 104537 (pid 70503, umount) is sleeping on 0xfffff8022bb1d200 "bo_wwait" chain 11: thread 101268 (pid 70502, sleep) is sleeping on 0xffffffff81c83950 "nanslp" chain 12: thread 101837 (pid 70501, sleep) is sleeping on 0xffffffff81c8395a "nanslp" chain 13: thread 101882 (pid 70500, sleep) is sleeping on 0xffffffff81c83953 "nanslp" chain 14: thread 102283 (pid 70496, sleep) is sleeping on 0xffffffff81c83951 "nanslp" chain 15: thread 100707 (pid 70483, sleep) is sleeping on 0xffffffff81c83952 "nanslp" chain 16: thread 100499 (pid 70476, umount) is sleeping on 0xfffffe00e8785000 "mntref" chain 17: thread 102402 (pid 70431, sh) is sleeping on 0xfffff8035d98aa50 "wait" chain 18: thread 100264 (pid 54655, sh) is sleeping on 0xfffff80300ee8000 "wait" chain 19: thread 101257 (pid 54654, sh) is sleeping on 0xfffff80359fc6a50 "wait" chain 20: thread 101554 (pid 54651, sh) is sleeping on 0xfffff8035ea47a50 "wait" chain 21: thread 102150 (pid 54646, sh) is sleeping on 0xfffff8035dc4a000 "wait" chain 22: thread 100397 (pid 54642, sh) is sleeping on 0xfffff80358c13528 "wait" chain 23: thread 100466 (pid 54641, sh) is sleeping on 0xfffff802a14fb000 "wait" chain 24: thread 102005 (pid 54640, sh) is sleeping on 0xfffff8035cd06000 "wait" chain 25: thread 102381 (pid 54639, sh) is sleeping on 0xfffff8035a543000 "wait" chain 26: thread 102114 (pid 54637, sh) is sleeping on 0xfffff803598fa000 "wait" chain 27: thread 104696 (pid 54636, sh) is sleeping on 0xfffff803fc67b528 "wait" chain 28: thread 104619 (pid 54633, sh) is sleeping on 0xfffff802a1435000 "wait" chain 29: thread 101761 (pid 54628, sh) is sleeping on 0xfffff8035a7ca000 "wait" chain 30: thread 101282 (pid 54624, sh) is sleeping on 0xfffff800219c4528 "wait" chain 31: thread 104574 (pid 54623, sh) is sleeping on 0xfffff803fc47a528 "wait" chain 32: thread 102093 (pid 54620, sh) is sleeping on 0xfffff80357c34000 "wait" chain 33: thread 101345 (pid 54616, sh) is sleeping on 0xfffff80358fe9a50 "wait" chain 34: thread 100297 (pid 54614, sh) is sleeping on 0xfffff802a15a9528 "wait" chain 35: thread 103079 (pid 54613, sh) is sleeping on 0xfffff803fce37a50 "wait" chain 36: thread 101326 (pid 54612, sh) is sleeping on 0xfffff8035892e000 "wait" chain 37: thread 100646 (pid 54611, sh) is sleeping on 0xfffff8030fca9000 "wait" chain 38: thread 104867 (pid 54609, sh) is sleeping on 0xfffff8035bd6fa50 "wait" chain 39: thread 101802 (pid 54608, sh) is sleeping on 0xfffff80300ee8528 "wait" chain 40: thread 102099 (pid 54603, md21) is sleeping on 0xfffff80226b79000 "mdwait" chain 41: thread 100614 (pid 54592, md20) is blocked on lockmgrKDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00de9f7d90 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00de9f7da0 trap() at trap+0x6c/frame 0xfffffe00de9f7eb0 calltrap() at calltrap+0x8/frame 0xfffffe00de9f7eb0 --- trap 0xc, rip = 0xffffffff80cb904f, rsp = 0xfffffe00de9f7f80, rbp = 0xfffffe00de9f7f80 --- strlen() at strlen+0x1f/frame 0xfffffe00de9f7f80 kvprintf() at kvprintf+0xf70/frame 0xfffffe00de9f80b0 db_printf() at db_printf+0x5c/frame 0xfffffe00de9f8130 lockmgr_chain() at lockmgr_chain+0x3e/frame 0xfffffe00de9f8150 print_lockchain() at print_lockchain+0x94/frame 0xfffffe00de9f8180 db_show_allchains() at db_show_allchains+0x97/frame 0xfffffe00de9f81b0 db_command() at db_command+0x25c/frame 0xfffffe00de9f8280 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00de9f8320 db_command() at db_command+0x25c/frame 0xfffffe00de9f83f0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00de9f8400 db_trap() at db_trap+0xe8/frame 0xfffffe00de9f8490 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00de9f8500 trap() at trap+0x7b8/frame 0xfffffe00de9f8610 calltrap() at calltrap+0x8/frame 0xfffffe00de9f8610 --- trap 0x3, rip = 0xffffffff80c0ab97, rsp = 0xfffffe00de9f86e0, rbp = 0xfffffe00de9f86f0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00de9f86f0 vpanic() at vpanic+0x19e/frame 0xfffffe00de9f8740 panic() at panic+0x43/frame 0xfffffe00de9f87a0 trap_fatal() at trap_fatal+0x387/frame 0xfffffe00de9f8800 trap_pfault() at trap_pfault+0x99/frame 0xfffffe00de9f8860 trap() at trap+0x2a5/frame 0xfffffe00de9f8970 calltrap() at calltrap+0x8/frame 0xfffffe00de9f8970 --- trap 0xc, rip = 0xffffffff80ee9cee, rsp = 0xfffffe00de9f8a40, rbp = 0xfffffe00de9f8a90 --- ufs_reclaim() at ufs_reclaim+0x10e/frame 0xfffffe00de9f8a90 VOP_RECLAIM_APV() at VOP_RECLAIM_APV+0x59/frame 0xfffffe00de9f8ab0 vgonel() at vgonel+0x3b7/frame 0xfffffe00de9f8b10 vnlru_proc() at vnlru_proc+0x7fb/frame 0xfffffe00de9f8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00de9f8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00de9f8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Script command '' returned error db> reset cpu_reset: Restarting BSP cpu_reset_proxy: Stopped CPU 4 (kgdb) bt #0 __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:55 #1 doadump (textdump=0x0) at ../../../kern/kern_shutdown.c:394 #2 0xffffffff8049b44a in db_dump (dummy=, dummy2=, dummy3=, dummy4=) at ../../../ddb/db_command.c:575 #3 0xffffffff8049b20c in db_command (last_cmdp=, cmd_table=, dopager=0x0) at ../../../ddb/db_command.c:482 #4 0xffffffff804a0168 in db_script_exec (scriptname=, warnifnotfound=) at ../../../ddb/db_script.c:304 #5 0xffffffff8049b20c in db_command (last_cmdp=, cmd_table=, dopager=0x0) at ../../../ddb/db_command.c:482 #6 0xffffffff804a0168 in db_script_exec (scriptname=, warnifnotfound=) at ../../../ddb/db_script.c:304 #7 0xffffffff8049b20c in db_command (last_cmdp=, cmd_table=, dopager=0x1) at ../../../ddb/db_command.c:482 #8 0xffffffff8049af7d in db_command_loop () at ../../../ddb/db_command.c:535 #9 0xffffffff8049e178 in db_trap (type=, code=) at ../../../ddb/db_main.c:253 #10 0xffffffff80c0b404 in kdb_trap (type=0x3, code=0x0, tf=) at ../../../kern/subr_kdb.c:699 #11 0xffffffff81065c88 in trap (frame=0xfffffe00de9f8620) at ../../../amd64/amd64/trap.c:578 #12 #13 kdb_enter (why=0xffffffff811f62f8 "panic", msg=) at ../../../kern/subr_kdb.c:486 #14 0xffffffff80bc0e1e in vpanic (fmt=, ap=) at ../../../kern/kern_shutdown.c:902 #15 0xffffffff80bc0bb3 in panic (fmt=0xffffffff81c7d198 "\235\241\033\201\377\377\377\377") at ../../../kern/kern_shutdown.c:839 #16 0xffffffff810660d7 in trap_fatal (frame=0xfffffe00de9f8980, eva=0x190) at ../../../amd64/amd64/trap.c:919 #17 0xffffffff81066179 in trap_pfault (frame=0xfffffe00de9f8980, usermode=, signo=, ucode=) at ../../../amd64/amd64/trap.c:736 #18 0xffffffff81065775 in trap (frame=0xfffffe00de9f8980) at ../../../amd64/amd64/trap.c:400 #19 #20 0xffffffff80ee9cee in ufs_reclaim (ap=0xfffffe00de9f8ac0) at ../../../ufs/ufs/ufs_inode.c:247 #21 0xffffffff810e3739 in VOP_RECLAIM_APV (vop=0xffffffff81959f98 , a=0xfffffe00de9f8ac0) at vnode_if.c:1928 #22 0xffffffff80c9bac7 in VOP_RECLAIM (vp=0xfffff80525c6c780, td=0xfffffe00d35df500) at ./vnode_if.h:850 #23 vgonel (vp=0xfffff80525c6c780) at ../../../kern/vfs_subr.c:4002 #24 0xffffffff80ca0b9b in vlrureclaim (trigger=0x8, target=, reclaim_nc_src=) at ../../../kern/vfs_subr.c:1179 #25 vnlru_proc () at ../../../kern/vfs_subr.c:1455 #26 0xffffffff80b7e820 in fork_exit (callout=0xffffffff80ca03a0 , arg=0x0, frame=0xfffffe00de9f8c00) at ../../../kern/kern_fork.c:1051 #27 (kgdb) f 20 #20 0xffffffff80ee9cee in ufs_reclaim (ap=0xfffffe00de9f8ac0) at ../../../ufs/ufs/ufs_inode.c:247 247 UFS_UPDATE(vp, 0); (kgdb) l 242 ufsdirhash_free(ip); 243 #endif 244 245 if (ip->i_flag & IN_LAZYMOD) 246 UFS_INODE_SET_FLAG(ip, IN_MODIFIED); 247 UFS_UPDATE(vp, 0); 248 /* 249 * Remove the inode from its hash chain. 250 */ 251 vfs_hash_remove(vp); (kgdb) info loc vp = 0xfffff80525c6c780 ip = 0xfffff805d68fdd20 i = 0x2 (kgdb) p *vp $1 = {v_type = VDIR, v_irflag = 0x1, v_op = 0xffffffff81959f98 , v_data = 0xfffff805d68fdd20, v_mount = 0xfffffe00e8785000, v_nmntvnodes = {tqe_next = 0x0, tqe_prev = 0xfffffe00e8785060}, {v_mountedhere = 0x0, v_unpcb = 0x0, v_rdev = 0x0, v_fifoinfo = 0x0}, v_hashlist = {le_next = 0x0, le_prev = 0xfffffe00e7f35828}, v_cache_src = {lh_first = 0x0}, v_cache_dst = {tqh_first = 0x0, tqh_last = 0xfffff80525c6c7d0}, v_cache_dd = 0x0, v_lock = {lock_object = { lo_name = 0xffffffff8110effc "ufs", lo_flags = 0x6fb0000, lo_data = 0x0, lo_witness = 0x0}, lk_lock = 0xfffffe00d35df500, lk_exslpfail = 0x0, lk_timo = 0x33, lk_pri = 0x60, lk_stack = {depth = 0x6, pcs = {0xffffffff80b92ec5, 0xffffffff80ee0e3d, 0xffffffff810e38b0, 0xffffffff80ca0a43, 0xffffffff80b7e820, 0xffffffff8103d0ee, 0x0 }}}, v_interlock = {lock_object = {lo_name = 0xffffffff8123caa3 "vnode interlock", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0x0}, mtx_lock = 0x0}, v_vnlock = 0xfffff80525c6c7e8, v_vnodelist = {tqe_next = 0xfffff80003b2ac00, tqe_prev = 0xfffff8055054a158}, v_lazylist = { tqe_next = 0xfffff8052580c780, tqe_prev = 0xfffff8071463f3e8}, v_bufobj = {bo_lock = {lock_object = {lo_name = 0xffffffff811fbe94 "bufobj interlock", lo_flags = 0x5230000, lo_data = 0x0, lo_witness = 0x0}, rw_lock = 0x1}, bo_ops = 0xffffffff8191e5c0 , bo_object = 0x0, bo_synclist = { le_next = 0xfffff8031df943f8, le_prev = 0xfffff80003a9f2c8}, bo_private = 0xfffff80525c6c780, bo_clean = {bv_hd = {tqh_first = 0x0, tqh_last = 0xfffff80525c6c940}, bv_root = {pt_root = 0x0}, bv_cnt = 0x0}, bo_dirty = {bv_hd = {tqh_first = 0x0, tqh_last = 0xfffff80525c6c960}, bv_root = {pt_root = 0x0}, bv_cnt = 0x0}, bo_numoutput = 0x0, bo_flag = 0x4, bo_domain = 0x3, bo_bsize = 0x8000}, v_pollinfo = 0x0, v_label = 0x0, v_lockf = 0x0, v_rl = {rl_waiters = {tqh_first = 0x0, tqh_last = 0xfffff80525c6c9b0}, rl_currdep = 0x0}, v_cstart = 0x0, v_lasta = 0x0, v_lastw = 0x0, v_clen = 0x0, v_holdcnt = 0x1, v_usecount = 0x0, v_iflag = 0x0, v_vflag = 0x0, v_mflag = 0x0, v_dbatchcpu = 0xffff, v_writecount = 0x0, v_hash = 0x3ab1c} (kgdb) p *ip $2 = {i_nextsnap = {tqe_next = 0x0, tqe_prev = 0x0}, i_vnode = 0xfffff80525c6c780, i_ump = 0xfffff805f1abc400, i_dquot = {0x0, 0x0}, i_un = {dirhash = 0x0, snapblklist = 0x0}, dinode_u = {din1 = 0xfffff80525ac5c00, din2 = 0xfffff80525ac5c00}, i_number = 0x3ab1c, i_flag = 0x400, i_effnlink = 0x3, i_count = 0x1f4, i_endoff = 0x200, i_diroff = 0x0, i_offset = 0xc, i_nextclustercg = 0xffffffff, i_ea_area = 0x0, i_ea_len = 0x0, i_ea_error = 0x0, i_ea_refs = 0x0, i_size = 0x200, i_gen = 0x815a5722, i_flags = 0x0, i_uid = 0x7d7, i_gid = 0x0, i_mode = 0x41f8, i_nlink = 0x3} (kgdb) -- Test scenario: misc/zz-combo03.txt