Page fault in ufs_reclaim+0x79, vmcore.175 KDB: debugger backends: ddb KDB: current backend: ddb ---<>--- Copyright (c) 1992-2020 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 13.0-CURRENT #0 r359587: Fri Apr 3 07:25:15 CEST 2020 pho@mercat1.netperf.freebsd.org:/usr/src/sys/amd64/compile/PHO amd64 FreeBSD clang version 10.0.0 (git@github.com:llvm/llvm-project.git llvmorg-10.0.0-0-gd32170dbd5b) WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. VT(vga): resolution 640x480 CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.07-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics real memory = 34359738368 (32768 MB) avail memory = 33163595776 (31627 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 12 CPUs FreeBSD/SMP: 1 package(s) x 6 core(s) x 2 hardware threads random: registering fast source Intel Secure Key RNG random: fast provider: "Intel Secure Key RNG" random: unblocking device. ioapic0 irqs 0-23 ioapic1 irqs 24-47 Launching APs: 1 11 6 9 3 2 10 5 7 4 8 Timecounter "TSC-low" frequency 1750036668 Hz quality 1000 random: entropy device external interface WARNING: Device "kbd" is Giant locked and may be deleted before FreeBSD 13.0. kbd1 at kbdmux0 000.000053 [4342] netmap_init netmap: loaded module [ath_hal] loaded nexus0 vtvga0: cryptosoft0: acpi0: acpi0: Power Button (fixed) cpu0: on acpi0 atrtc0: port 0x70-0x71,0x74-0x77 irq 8 on acpi0 atrtc0: registered as a time-of-day clock, resolution 1.000000s Event timer "RTC" frequency 32768 Hz quality 0 attimer0: port 0x40-0x43,0x50-0x53 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Event timer "HPET" frequency 14318180 Hz quality 350 Event timer "HPET1" frequency 14318180 Hz quality 340 Event timer "HPET2" frequency 14318180 Hz quality 340 Event timer "HPET3" frequency 14318180 Hz quality 340 Event timer "HPET4" frequency 14318180 Hz quality 340 Event timer "HPET5" frequency 14318180 Hz quality 340 Event timer "HPET6" frequency 14318180 Hz quality 340 Event timer "HPET7" frequency 14318180 Hz quality 340 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 pcib0: on acpi0 pci0: on pcib0 pci0: at device 11.1 (no driver attached) pci0: at device 11.2 (no driver attached) pci0: at device 16.1 (no driver attached) pci0: at device 16.6 (no driver attached) pci0: at device 18.1 (no driver attached) acpi_syscontainer0: on acpi0 acpi_syscontainer1: on acpi0 acpi_syscontainer2: on acpi0 acpi_syscontainer3: on acpi0 pcib1: port 0xcf8-0xcff on acpi0 pci1: on pcib1 pcib2: irq 26 at device 1.0 on pci1 pci2: on pcib2 pcib3: irq 32 at device 2.0 on pci1 pci3: on pcib3 pci3: at device 0.0 (no driver attached) pci3: at device 0.1 (no driver attached) pcib4: irq 40 at device 3.0 on pci1 pci4: on pcib4 pci1: at device 17.0 (no driver attached) ahci0: port 0xf110-0xf117,0xf100-0xf103,0xf0f0-0xf0f7,0xf0e0-0xf0e3,0xf020-0xf03f mem 0xfb438000-0xfb4387ff irq 16 at device 17.4 on pci1 ahci0: AHCI v1.30 with 4 6Gbps ports, Port Multiplier not supported ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahcich2: at channel 2 on ahci0 ahcich3: at channel 3 on ahci0 ahciem0: on ahci0 xhci0: mem 0xfb400000-0xfb40ffff irq 19 at device 20.0 on pci1 xhci0: 32 bytes context size, 64-bit DMA usbus0 on xhci0 usbus0: 5.0Gbps Super Speed USB v3.0 pci1: at device 22.0 (no driver attached) pci1: at device 22.1 (no driver attached) ehci0: mem 0xfb434000-0xfb4343ff irq 18 at device 26.0 on pci1 usbus1: EHCI version 1.0 usbus1 on ehci0 usbus1: 480Mbps High Speed USB v2.0 pcib5: irq 16 at device 28.0 on pci1 pci5: on pcib5 pcib6: irq 18 at device 28.2 on pci1 pci6: on pcib6 pcib7: at device 0.0 on pci6 pci7: on pcib7 vgapci0: port 0xe000-0xe07f mem 0xfa000000-0xfaffffff,0xfb000000-0xfb01ffff irq 18 at device 0.0 on pci7 vgapci0: Boot video device pcib8: irq 16 at device 28.4 on pci1 pci8: on pcib8 igb0: port 0xd020-0xd03f mem 0xfb320000-0xfb33ffff,0xfb344000-0xfb347fff irq 16 at device 0.0 on pci8 igb0: Using 1024 TX descriptors and 1024 RX descriptors igb0: queue equality override not set, ith 8 removable, self powered . ugen0.3: at usbus0 ukbd0 on uhub3 ukbd0: on usbus0 kbd2 at ukbd0 lo0: link state changed to UP Autoloading module: ioat.ko ioat0: mem 0xfb42c000-0xfb42ffff irq 31 at device 4.0 on pci1 ioat0: Capabilities: 2f7 ioat1: mem 0xfb428000-0xfb42bfff irq 39 at device 4.1 on pci1 ioat1: Capabilities: 2f7 ioat2: mem 0xfb424000-0xfb427fff irq 31 at device 4.2 on pci1 ioat2: Capabilities: f7 ioat3: mem 0xfb420000-0xfb423fff irq 39 at device 4.3 on pci1 ioat3: Capabilities: f7 ioat4: mem 0xfb41c000-0xfb41ffff irq 31 at device 4.4 on pci1 ioat4: Capabilities: f7 ioat5: mem 0xfb418000-0xfb41bfff irq 39 at device 4.5 on pci1 ioat5: Capabilities: f7 ioat6: mem 0xfb414000-0xfb417fff irq 31 at device 4.6 on pci1 ioat6: Capabilities: f7 ioat7: mem 0xfb410000-0xfb413fff irq 39 at device 4.7 on pci1 ioat7: Capabilities: f7 Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Starting Network: igb1. igb1: flags=8822 metric 0 mtu 1500 options=4e507bb ether 0c:c4:7a:a8:cd:db media: Ethernet autoselect status: no carrier nd6 options=29 Autoloading module: uhid.ko Autoloading module: ums.ko ums0 on uhub3 ums0: on usbus0 ums0: 3 buttons and [Z] coordinates ID=0 Starting dhclient. DHCPREQUEST on igb0 to 255.255.255.255 port 67 DHCPACK from 192if_delmulti_locked: detaching ifnet instance 0xfffff8000415f800 .168.5.1 bound to 192.168.5.171 -- renewal in 300 seconds. add host 127.0.0.1: gateway lo0 fib 0: route already in table add host ::1: gateway lo0 fib 0: route already in table add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Creating and/or trimming log files. Starting syslogd. Setting date via ntp. 3 Apr 07:49:13 ntpdate[2073]: step time server 192.168.5.1 offset +0.094294 sec Starting rpcbind. NFS access cache time=60 Updating CPU Microcode... CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.07-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab Structured Extended Features3=0x9c000400 XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics Done. Starting watchdogd. No core dumps found. Clearing /tmp (X related). Starting statd. Starting lockd. Recovering vi editor sessions:. fscklock order reversal: 1st 0xfffff80021598568 ufs (ufs) @ kern/vfs_mount.c:1631 2nd 0xfffff800216c92e8 devfs (devfs) @ kern/vfs_subr.c:3259 stack backtrace: #0 0xffffffff80c2d4c1 at witness_debugger+0x71 #1 0xffffffff80b92e62 at lockmgr_lock_flags+0x172 #2 0xffffffff810e38b0 at VOP_LOCK1_APV+0x40 #3 0xffffffff80caf034 at _vn_lock+0x54 #4 0xffffffff80c99e05 at vput_final+0x135 #5 0xffffffff80edef4d at ffs_unmount+0x3ed #6 0xffffffff80c91493 at dounmount+0x423 #7 0xffffffff80c91019 at kern_unmount+0x2b9 #8 0xffffffff81066ad9 at amd64_syscall+0x159 #9 0xffffffff8103c5a0 at fast_syscall_common+0x101 ** /dev/gpt/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 301 files, 3731 used, 1261676 free (180 frags, 157687 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** Updating motd:. Mounting late filesystems:. Security policy loaded: MAC/ntpd (mac_ntpd) Starting ntpd. Starting powerd. Configuring vt: blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting cron. Fri Apr 3 07:49 FreeBSD/amd64 (mercat1.netperf.freebsd.org) (ttyu1) login: root Apr 3 07:49:21 mercat1 login[2431]: ROOT LOGIN (root) ON ttyu1 Last login: Thu Apr 2 10:54:14 on ttyu1 FreeBSD 13.0-CURRENT (PHO) #0 r359587: Fri Apr 3 07:25:15 CEST 2020 78root@mercat1:~ # vi [?1h=~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~/tmp/vi.X3Y5kbxpPb: new file: line 1:q[?1l> [?1l>root@mercat1:~ # Apr 3 07:49:41 mercat1 su[2446]: pho to root on /dev/pts/0 20200403 07:49:54 all (1/702): 1st.sh 20200403 07:49:56 all (2/702): 256m.sh select leak: 2/61 20200403 07:49:58 all (3/702): audit.sh select leak: 1/62 20200403 07:49:59 all (4/702): beneath2.sh select leak: 2/64 20200403 07:50:03 all (5/702): beneath3.sh select leak: 1/65 20200403 07:50:05 all (6/702): buildworld.sh select leak: 2/67 20200403 07:50:06 all (7/702): buildworld2.sh select leak: 3/70 20200403 07:50:08 all (8/702): cluster.sh select leak: 1/71 20200403 07:50:09 all (9/702): cpuset.sh 20200403 07:50:10 all (10/702): crossmp2.sh select leak: 1/72 20200403 07:50:12 all (11/702): crossmp6.sh select leak: 1/73 20200403 07:50:13 all (12/702): datagram2.sh 20200403 07:50:15 all (13/702): datagram3.sh select leak: 1/74 20200403 07:50:17 all (14/702): datamove.sh select leak: 2/76 20200403 07:50:18 all (15/702): datamove3.sh 20200403 07:50:20 all (16/702): devfs2.sh select leak: 3/79 20200403 07:50:21 all (17/702): devfs5.sh select leak: 1/80 20200403 07:50:23 all (18/702): dtrace_fault.sh 20200403 07:50:24 all (19/702): dumpfs.sh 20200403 07:50:26 all (20/702): dup2.sh select leak: 1/81 20200403 07:50:27 all (21/702): execi386.sh select leak: 1/82 20200403 07:50:29 all (22/702): extattr_set_fd.sh select leak: 3/85 20200403 07:50:31 all (23/702): extattrctl.sh lock order reversal: 1st 0xfffff80021248e40 ufs_extattr_sx (ufs_extattr_sx) @ ufs/ufs/ufs_extattr.c:119 2nd 0xfffff8017f28f068 ufs (ufs) @ ufs/ffs/ffs_vfsops.c:1757 stack backtrace: #0 0xffffffff80c2d4c1 at witness_debugger+0x71 #1 0xffffffff80b9342b at lockmgr_xlock_hard+0x6b #2 0xffffffff80b93ffa at __lockmgr_args+0x62a #3 0xffffffff80edc5a1 at ffs_vgetf+0x161 #4 0xffffffff80eef52b at ufs_root+0x1b #5 0xffffffff80c9e7b0 at vfs_cache_root_fallback+0x140 #6 0xffffffff80ee794f at ufs_extattr_autostart+0x5f #7 0xffffffff80edea2f at ffs_mount+0x1cef #8 0xffffffff80c901ae at vfs_domount+0x80e #9 0xffffffff80c8ec01 at vfs_donmount+0x871 #10 0xffffffff80c8e359 at sys_nmount+0x69 #11 0xffffffff81066ad9 at amd64_syscall+0x159 #12 0xffffffff8103c5a0 at fast_syscall_common+0x101 select leak: 1/86 20200403 07:50:32 all (24/702): fcntl3.sh select leak: 1/87 20200403 07:50:34 all (25/702): fexecve.sh 20200403 07:50:35 all (26/702): fifo.sh 20200403 07:50:37 all (27/702): fsck2.sh select leak: 2/89 20200403 07:50:38 all (28/702): fsck3.sh select leak: 1/90 20200403 07:50:40 all (29/702): fsck4.sh select leak: 2/92 20200403 07:50:41 all (30/702): geomleak.sh select leak: 1/93 20200403 07:50:43 all (31/702): getrandom.sh select leak: 2/95 20200403 07:50:44 all (32/702): gnop3.sh select leak: 1/96 20200403 07:50:46 all (33/702): gnop5.sh GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. select leak: 2/98 20200403 07:50:47 all (34/702): holdcnt0.sh 20200403 07:50:49 all (35/702): holdcnt02.sh select leak: 1/99 20200403 07:50:50 all (36/702): holdcnt03.sh select leak: 2/101 20200403 07:50:52 all (37/702): holdcnt04.sh 20200403 07:50:53 all (38/702): holdcnt05.sh 20200403 07:50:55 all (39/702): isofs2.sh 20200403 07:50:56 all (40/702): jail.sh select leak: 1/102 20200403 07:50:58 all (41/702): jail2.sh 20200403 07:50:59 all (42/702): jail3.sh 20200403 07:51:00 all (43/702): jail4.sh select leak: 1/103 20200403 07:51:02 all (44/702): jexec.sh 20200403 07:51:03 all (45/702): kern_umtx_inf_loop.sh select leak: 1/104 20200403 07:51:05 all (46/702): kevent10.sh select leak: 1/105 20200403 07:51:06 all (47/702): kevent3.sh select leak: 1/106 20200403 07:51:08 all (48/702): ldt.sh 20200403 07:51:10 all (49/702): ldt2.sh select leak: 1/107 20200403 07:51:11 all (50/702): libMicro.sh 20200403 07:51:12 all (51/702): linux.sh select leak: 1/108 20200403 07:51:14 all (52/702): lockd.sh 20200403 07:51:15 all (53/702): lockf.sh select leak: 2/110 20200403 07:51:17 all (54/702): lookup_shared.sh select leak: 2/112 20200403 07:51:18 all (55/702): mac.sh 20200403 07:51:19 all (56/702): mac_chkexec.sh 20200403 07:51:21 all (57/702): machipc.sh 20200403 07:51:22 all (58/702): machipc2.sh 20200403 07:51:23 all (59/702): maxmemdom.sh select leak: 2/114 20200403 07:51:25 all (60/702): maxproc.sh select leak: 2/116 20200403 07:51:26 all (61/702): md4.sh select leak: 1/117 20200403 07:51:28 all (62/702): md5.sh select leak: 2/119 20200403 07:51:29 all (63/702): md6.sh select leak: 3/122 20200403 07:51:31 all (64/702): md8.sh newblk leak: 1144/1786. select leak: 64/186 20200403 07:51:40 all (65/702): mdconfig.sh 20200403 07:51:42 all (66/702): mdconfig3.sh 20200403 07:51:43 all (67/702): memguard4.sh 20200403 07:51:45 all (68/702): mkfifo5.sh 20200403 07:51:46 all (69/702): mkfifo7.sh 20200403 07:51:48 all (70/702): mlockall5.sh 20200403 07:51:49 all (71/702): mmap.sh 20200403 07:51:51 all (72/702): mmap12.sh 20200403 07:51:52 all (73/702): mmap16.sh 20200403 07:51:54 all (74/702): mmap17.sh 20200403 07:51:55 all (75/702): mmap20.sh 20200403 07:51:57 all (76/702): mmap24.sh 20200403 07:51:58 all (77/702): mmap30.sh 20200403 07:52:00 all (78/702): mmap33.sh 20200403 07:52:01 all (79/702): mmap35.sh 20200403 07:52:03 all (80/702): mmap36.sh 20200403 07:52:04 all (81/702): mount.sh 20200403 07:52:06 all (82/702): mountro2.sh 20200403 07:52:07 all (83/702): mountro3.sh newblk leak: 268/2054. 20200403 07:52:09 all (84/702): mprotect.sh 20200403 07:52:11 all (85/702): msdos2.sh 20200403 07:52:12 all (86/702): msdos3.sh 20200403 07:52:14 all (87/702): msdos7.sh lock order reversal: 1st 0xfffff8017f58a7e8 msdosfs (msdosfs) @ kern/vfs_syscalls.c:3431 2nd 0xfffff8017fd882e8 devfs (devfs) @ fs/msdosfs/msdosfs_vnops.c:853 stack backtrace: #0 0xffffffff80c2d4c1 at witness_debugger+0x71 #1 0xffffffff80b92e62 at lockmgr_lock_flags+0x172 #2 0xffffffff810e38b0 at VOP_LOCK1_APV+0x40 #3 0xffffffff80caf034 at _vn_lock+0x54 #4 0xffffffff80a7bc39 at msdosfs_fsync+0x49 #5 0xffffffff810e2549 at VOP_FSYNC_APV+0x59 #6 0xffffffff80caadf0 at kern_fsync+0x180 #7 0xffffffff81066ad9 at amd64_syscall+0x159 #8 0xffffffff8103c5a0 at fast_syscall_common+0x101 20200403 07:52:15 all (88/702): msdos8.sh 20200403 07:52:17 all (89/702): msetdomain.sh 20200403 07:52:18 all (90/702): nanosleep.sh 20200403 07:52:20 all (91/702): nbufkv.sh 20200403 07:52:21 all (92/702): nfs.sh 20200403 07:52:23 all (93/702): nfs12.sh 20200403 07:52:24 all (94/702): nfs14.sh 20200403 07:52:25 all (95/702): nfs15.sh 20200403 07:52:27 all (96/702): nfs15lockd.sh 20200403 07:52:28 all (97/702): nfs15lockd3.sh 20200403 07:52:30 all (98/702): nfs3.sh 20200403 07:52:31 all (99/702): nfs4.sh 20200403 07:52:32 all (100/702): nfs7.sh 20200403 07:52:34 all (101/702): nfs8.sh 20200403 07:52:35 all (102/702): nfs9.sh 20200403 07:52:37 all (103/702): nfs_halfpage.sh 20200403 07:52:38 all (104/702): nfs_halfpage2.sh 20200403 07:52:40 all (105/702): nfsdelegation.sh 20200403 07:52:41 all (106/702): nfsdepth.sh 20200403 07:52:42 all (107/702): nfsrename.sh 20200403 07:52:44 all (108/702): nfssillyrename.sh 20200403 07:52:45 all (109/702): nullfs13.sh 20200403 07:52:47 all (110/702): nullfs14.sh 20200403 07:52:48 all (111/702): nullfs15.sh 20200403 07:52:50 all (112/702): nullfs21.sh 20200403 07:52:51 all (113/702): nullfs23.sh 20200403 07:52:53 all (114/702): nullfs4.sh mount leak: 13/44 20200403 07:52:54 all (115/702): nullfs6.sh 20200403 07:52:55 all (116/702): nullfs7.sh 20200403 07:52:57 all (117/702): nullfs9.sh 20200403 07:52:58 all (118/702): numa.sh 20200403 07:53:00 all (119/702): oom.sh 20200403 07:53:01 all (120/702): open.sh 20200403 07:53:03 all (121/702): pagefault.sh 20200403 07:53:04 all (122/702): parallelmount2.sh select leak: 1/187 20200403 07:53:06 all (123/702): pathconf.sh 20200403 07:53:07 all (124/702): pathconf2.sh 20200403 07:53:08 all (125/702): pcatch.sh 20200403 07:53:10 all (126/702): pcatch2.sh select leak: 1/188 20200403 07:53:11 all (127/702): ping.sh 20200403 07:53:13 all (128/702): pkru.sh 20200403 07:53:14 all (129/702): pkru2.sh 20200403 07:53:15 all (130/702): pmc4.sh 20200403 07:53:17 all (131/702): pmc5.sh 20200403 07:53:19 all (132/702): pmc8.sh 20200403 07:53:20 all (133/702): poll.sh 20200403 07:53:22 all (134/702): posix_fadvise.sh 20200403 07:53:23 all (135/702): posix_fadvise2.sh 20200403 07:53:25 all (136/702): procfs5.sh 20200403 07:53:26 all (137/702): procfs6.sh 20200403 07:53:27 all (138/702): procstat.sh 20200403 07:53:29 all (139/702): pthread9.sh 20200403 07:53:30 all (140/702): ptrace.sh 20200403 07:53:32 all (141/702): ptrace3.sh 20200403 07:53:33 all (142/702): pts2.sh 20200403 07:53:35 all (143/702): quota5.sh 20200403 07:53:36 all (144/702): rename13.sh 20200403 07:53:38 all (145/702): rename4.sh 20200403 07:53:39 all (146/702): revoke.sh select leak: 1/189 20200403 07:53:41 all (147/702): routetbl.sh select leak: 1/190 20200403 07:53:42 all (148/702): ruby.sh 20200403 07:53:44 all (149/702): rwlock_ronly.sh 20200403 07:53:45 all (150/702): schedfuzz.sh 20200403 07:53:47 all (151/702): scp.sh 20200403 07:53:49 all (152/702): seekdir.sh select leak: 1/191 20200403 07:53:50 all (153/702): segnp.sh 20200403 07:53:52 all (154/702): segregs.sh 20200403 07:53:53 all (155/702): select3.sh 20200403 07:53:55 all (156/702): sendfile.sh 20200403 07:53:57 all (157/702): sendfile2.sh lock order reversal: 1st 0xfffffe00e68cd9b0 filedesc structure (filedesc structure) @ kern/sys_generic.c:1556 2nd 0xfffff80625264068 ufs (ufs) @ kern/vfs_vnops.c:1553 stack backtrace: #0 0xffffffff80c2d4c1 at witness_debugger+0x71 #1 0xffffffff80b92e62 at lockmgr_lock_flags+0x172 #2 0xffffffff80ee0e3d at ffs_lock+0x6d #3 0xffffffff810e38b0 at VOP_LOCK1_APV+0x40 #4 0xffffffff80caf034 at _vn_lock+0x54 #5 0xffffffff80cad96a at vn_poll+0x3a #6 0xffffffff80c33cf9 at kern_poll+0x419 #7 0xffffffff80c338d0 at sys_poll+0x50 #8 0xffffffff81066ad9 at amd64_syscall+0x159 #9 0xffffffff8103c5a0 at fast_syscall_common+0x101 20200403 07:54:24 all (158/702): sendfile4.sh 20200403 07:54:26 all (159/702): setuid.sh 20200403 07:54:27 all (160/702): shm_super.sh 20200403 07:54:29 all (161/702): sigaltstack.sh 20200403 07:54:30 all (162/702): sigreturn.sh select leak: 1/192 20200403 07:54:32 all (163/702): sigstop.sh select leak: 1/193 20200403 07:54:33 all (164/702): snap12.sh lock order reversal: 1st 0xfffff8011828e7e8 ufs (ufs) @ kern/vfs_mount.c:1631 2nd 0xfffff8017f360630 snaplk (snaplk) @ ufs/ffs/ffs_snapshot.c:2132 3rd 0xfffff806251d3568 ufs (ufs) @ ufs/ffs/ffs_snapshot.c:2133 stack backtrace: #0 0xffffffff80c2d4c1 at witness_debugger+0x71 #1 0xffffffff80b9342b at lockmgr_xlock_hard+0x6b #2 0xffffffff80b93ffa at __lockmgr_args+0x62a #3 0xffffffff80ebcb15 at ffs_snapshot_unmount+0x135 #4 0xffffffff80edc319 at ffs_flushfiles+0x79 #5 0xffffffff80ebe37d at softdep_flushfiles+0x9d #6 0xffffffff80edec39 at ffs_unmount+0xd9 #7 0xffffffff80c91493 at dounmount+0x423 #8 0xffffffff80c91019 at kern_unmount+0x2b9 #9 0xffffffff81066ad9 at amd64_syscall+0x159 #10 0xffffffff8103c5a0 at fast_syscall_common+0x101 20200403 07:54:35 all (165/702): snap2-1.sh lock order reversal: 1st 0xfffffe003806fae0 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:302 2nd 0xfffff8017f360630 snaplk (snaplk) @ ufs/ffs/ffs_snapshot.c:2327 stack backtrace: #0 0xffffffff80c2d4c1 at witness_debugger+0x71 #1 0xffffffff80b9342b at lockmgr_xlock_hard+0x6b #2 0xffffffff80b93ffa at __lockmgr_args+0x62a #3 0xffffffff80ebd176 at ffs_copyonwrite+0x166 #4 0xffffffff80edfe7a at ffs_geom_strategy+0xca #5 0xffffffff80ef3623 at ufs_strategy+0x83 #6 0xffffffff810e3d21 at VOP_STRATEGY_APV+0x61 #7 0xffffffff80c7491e at bufstrategy+0x3e #8 0xffffffff80c747ba at bufwrite+0x24a #9 0xffffffff80ee1d9d at ffs_syncvnode+0x2bd #10 0xffffffff80ee0cf2 at ffs_fsync+0x22 #11 0xffffffff810e2549 at VOP_FSYNC_APV+0x59 #12 0xffffffff80ef1378 at ufs_remove+0xd8 #13 0xffffffff810e26f9 at VOP_REMOVE_APV+0x79 #14 0xffffffff80ca7bd8 at kern_funlinkat+0x298 #15 0xffffffff80ca7938 at sys_unlink+0x28 #16 0xffffffff81066ad9 at amd64_syscall+0x159 #17 0xffffffff8103c5a0 at fast_syscall_common+0x101 20200403 07:54:37 all (166/702): snap2.sh 20200403 07:54:38 all (167/702): sndstat.sh 20200403 07:54:40 all (168/702): socketpair.sh 20200403 07:54:41 all (169/702): socketpair2.sh 20200403 07:54:43 all (170/702): suj32.sh 20200403 07:54:44 all (171/702): suj35.sh Apr 3 07:54:46 mercat1 kernel: pid 71913 (mkdir), uid 0 inumber 253 on /mnt: out of inodes 20200403 07:54:46 all (172/702): suj7.sh Failed to find journal. Use tunefs to create one Failed to start journal: 2 20200403 07:54:47 all (173/702): suj8.sh Apr 3 07:54:49 mercat1 kernel: pid 73274 (dd), uid 0 inumber 4 on /mnt: filesystem full Apr 3 07:54:49 mercat1 kernel: pid 73290 (dd), uid 0 inumber 5 on /mnt: filesystem full 20200403 07:54:49 all (174/702): swapoff3.sh 20200403 07:54:51 all (175/702): swapoff4.sh 20200403 07:54:52 all (176/702): swapoff5.sh 20200403 07:54:53 all (177/702): syzkaller1.sh 20200403 07:54:55 all (178/702): syzkaller2.sh 20200403 07:54:57 all (179/702): syzkaller3.sh 20200403 07:54:58 all (180/702): tar.sh 20200403 07:55:00 all (181/702): temp.sh 20200403 07:55:01 all (182/702): tmpfs15.sh 20200403 07:55:03 all (183/702): tmpfs4.sh 20200403 07:55:04 all (184/702): tmpfs6.sh 20200403 07:55:06 all (185/702): trim5.sh 20200403 07:55:07 all (186/702): trim6.sh 20200403 07:55:09 all (187/702): trim7.sh 20200403 07:55:10 all (188/702): trim8.sh 20200403 07:55:12 all (189/702): truncate4.sh 20200403 07:55:13 all (190/702): truncate6.sh 20200403 07:55:15 all (191/702): tvnlru.sh 20200403 07:55:16 all (192/702): ufssuspend.sh 20200403 07:55:18 all (193/702): uma_zalloc_arg.sh 20200403 07:55:19 all (194/702): unlink.sh 20200403 07:55:21 all (195/702): unload.sh 20200403 07:55:22 all (196/702): unload2.sh 20200403 07:55:24 all (197/702): vfork.sh 20200403 07:55:26 all (198/702): vmio.sh 20200403 07:55:27 all (199/702): watchman.sh 20200403 07:55:28 all (200/702): write.sh 20200403 07:55:30 all (201/702): contigmalloc3.sh 20200403 07:55:32 all (202/702): datagram.sh 20200403 07:55:35 all (203/702): datamove4.sh 20200403 07:55:38 all (204/702): ext2fs3.sh 20200403 07:55:40 all (205/702): extattr.sh select leak: 1/194 20200403 07:55:43 all (206/702): fcntl.sh 20200403 07:55:45 all (207/702): fpclone2.sh 20200403 07:55:47 all (208/702): isofs.sh 20200403 07:55:49 all (209/702): killpg.sh 20200403 07:55:52 all (210/702): md9.sh lock order reversal: 1st 0xfffff80021474080 bufwait (bufwait) @ vm/vm_pager.c:391 2nd 0xfffff8062ae8d2e8 tmpfs (tmpfs) @ dev/md/md.c:987 stack backtrace: #0 0xffffffff80c2d4c1 at witness_debugger+0x71 #1 0xffffffff80b94675 at lockmgr_xlock+0x55 #2 0xffffffff810e38b0 at VOP_LOCK1_APV+0x40 #3 0xffffffff80caf034 at _vn_lock+0x54 #4 0xffffffff806ea9c2 at mdstart_vnode+0x462 #5 0xffffffff806e86ae at md_kthread+0x1fe #6 0xffffffff80b7e820 at fork_exit+0x80 #7 0xffffffff8103ccbe at fork_trampoline+0xe 20200403 07:55:54 all (211/702): mmap25.sh 20200403 07:55:56 all (212/702): mmap26.sh 20200403 07:55:59 all (213/702): mmap28.sh Apr 3 07:56:00 mercat1 kernel: Failed to fully fault in a core file segment at VA 0x800e00000 with size 0x5d1000 to be written at offset 0x86e000 for process mmap28 20200403 07:56:01 all (214/702): mmap8.sh 20200403 07:56:03 all (215/702): mmap9.sh 20200403 07:56:06 all (216/702): msdos9.sh 20200403 07:56:09 all (217/702): newfs5.sh 20200403 07:56:11 all (218/702): nullfs10.sh 20200403 07:56:13 all (219/702): nullfs12.sh 20200403 07:56:16 all (220/702): nullfs16.sh 20200403 07:56:18 all (221/702): nullfs3.sh 20200403 07:56:20 all (222/702): openlock.sh 20200403 07:56:23 all (223/702): pipe_enomem.sh kern.ipc.maxpipekva exceeded; see tuning(7) 20200403 07:56:25 all (224/702): procfs2.sh 20200403 07:56:28 all (225/702): ptrace11.sh 20200403 07:56:30 all (226/702): ptrace8.sh 20200403 07:56:33 all (227/702): quota9.sh lock order reversal: 1st 0xfffff80021266290 FFS (FFS Lock) @ ufs/ufs/ufs_quota.c:759 2nd 0xfffffe00e6856b80 struct mount mtx (struct mount mtx) @ ufs/ufs/ufs_quota.c:765 stack backtrace: #0 0xffffffff80c2d4c1 at witness_debugger+0x71 #1 0xffffffff80b9efc4 at __mtx_lock_flags+0x94 #2 0xffffffff80eee0dd at quotaoff_inchange+0xbd #3 0xffffffff80edc3c6 at ffs_flushfiles+0x126 #4 0xffffffff80ebe37d at softdep_flushfiles+0x9d #5 0xffffffff80edec39 at ffs_unmount+0xd9 #6 0xffffffff80c91493 at dounmount+0x423 #7 0xffffffff80c91019 at kern_unmount+0x2b9 #8 0xffffffff81066ad9 at amd64_syscall+0x159 #9 0xffffffff8103c5a0 at fast_syscall_common+0x101 20200403 07:56:35 all (228/702): random.sh 20200403 07:56:37 all (229/702): rename6.sh 20200403 07:56:39 all (230/702): sendfile6.sh 20200403 07:56:41 all (231/702): snap.sh 20200403 07:56:43 all (232/702): snap10.sh 20200403 07:56:45 all (233/702): spin.sh 20200403 07:56:48 all (234/702): suj2.sh 20200403 07:56:50 all (235/702): tmpfs7.sh 20200403 07:56:52 all (236/702): trim2.sh 20200403 07:56:54 all (237/702): umtx_suspend.sh 20200403 07:56:56 all (238/702): vm_fault_dontneed.sh 20200403 07:56:58 all (239/702): contigmalloc2.sh 20200403 07:57:01 all (240/702): devfd.sh 20200403 07:57:04 all (241/702): dup.sh 20200403 07:57:08 all (242/702): extattr3.sh select leak: 1/195 20200403 07:57:12 all (243/702): kevent8.sh select leak: 2/197 20200403 07:57:16 all (244/702): mlockall7.sh select leak: 1/198 20200403 07:57:19 all (245/702): mmap13.sh 20200403 07:57:23 all (246/702): mmap23.sh 20200403 07:57:27 all (247/702): mmap4.sh vnode_pager_putpages: I/O error 28 0xfffff8062aad5a00: type VREG usecount 0, writecount 0, refcount 3203 flags (VI_DOINGINACT|VMP_LAZYLIST) v_object 0xfffff80625b52108 ref 0 pages 25608 cleanbuf 3200 dirtybuf 1 lock type ufs: EXCL by thread 0xfffffe00e3fc6a00 (pid 13598, mmap4, tid 100237) #0 0xffffffff80b92ec5 at lockmgr_lock_flags+0x1d5 #1 0xffffffff80ee0e3d at ffs_lock+0x6d #2 0xffffffff810e38b0 at VOP_LOCK1_APV+0x40 #3 0xffffffff80caf034 at _vn_lock+0x54 #4 0xffffffff80c99e05 at vput_final+0x135 #5 0xffffffff80f0be5d at vm_map_process_deferred+0xad #6 0xffffffff80f13a3b at vm_map_remove+0xeb #7 0xffffffff80f0b720 at vmspace_exit+0xd0 #8 0xffffffff80b79402 at exit1+0x552 #9 0xffffffff80b78ead at sys_sys_exit+0xd #10 0xffffffff81066ad9 at amd64_syscall+0x159 #11 0xffffffff8103c5a0 at fast_syscall_common+0x101 nlink=1, effnlink=1, size=104857600, extsize 0 generation=6cbcf55d, uid=0, gid=0, flags=0x0 ino 4, on dev md10a vnode_pager_putpages: residual I/O 32768 at 9760 0xfffff8062aad5a00: type VREG usecount 0, writecount 0, refcount 3203 flags (VI_DOINGINACT|VMP_LAZYLIST) v_object 0xfffff80625b52108 ref 0 pages 25608 cleanbuf 3200 dirtybuf 1 lock type ufs: EXCL by thread 0xfffffe00e3fc6a00 (pid 13598, mmap4, tid 100237) #0 0xffffffff80b92ec5 at lockmgr_lock_flags+0x1d5 #1 0xffffffff80ee0e3d at ffs_lock+0x6d #2 0xffffffff810e38b0 at VApr 3 07:57:28 mercat1 kernel: pid 13598 (mmap4), uid 0 inumber 4 on /mnt: filesystem full OP_LOCK1_APV+0x40 #3 0xffffffff80caf034 at _vn_lock+0x54 #4 0xffffffff80c99e05 at vput_final+0x135 #5 0xffffffff80f0be5d at vm_map_process_deferred+0xad #6 0xffffffff80f13a3b at vm_map_remove+0xeb #7 0xffffffff80f0b720 at vmspace_exit+0xd0 #8 0xffffffff80b79402 at exit1+0x552 #9 0xffffffff80b78ead at sys_sys_exit+0xd #10 0xffffffff81066ad9 at amd64_syscall+0x159 #11 0xffffffff8103c5a0 at fast_syscall_common+0x101 nlink=1, effnlink=1, size=104857600, extsize 0 generation=6cbcf55d, uid=0, gid=0, flags=0x0 ino 4, on dev md10a vnode_pager_putpages: zero-length write at 40075264 resid 131072 0xfffff8062aad5a00: type VREG usecount 1, writecount 0, refcount 3203 flags (VMP_LAZYLIST) v_object 0xfffff80625b52108 ref 0 pages 25608 cleanbuf 3201 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe00d35e6700 (pid 13750, umount, tid 100148) #0 0xffffffff80b92ec5 at lockmgr_lock_flags+0x1d5 #1 0xffffffff80ee0e3d at ffs_lock+0x6d #2 0xffffffff810e38b0 at VOP_LOCK1_APV+0x40 #3 0xffffffff80caf034 at _vn_lock+0x54 #4 0xffffffff80c9907c at vget_finish+0x6c #5 0xffffffff80c9c8c0 at vfs_periodic_msync_inactive+0x1b0 #6 0xffffffff80c91422 at dounmount+0x3b2 Apr 3 07:57:29 #7 0xffffffff80c91019 at kern_unmount+0x2b9 mercat1 kernel: #8 0xffffffff81066ad9 at amd64_syscall+0x159 pid 13750 (umoun#9 0xffffffff8103c5a0 at fast_syscall_common+0x101 nlink=1, effnlink=1, size=104857600, extsize 0 generation=6cbcf55d, uid=0, gid=0, flags=0x0 ino 4, on dev md10a t), uid 0 inumber 4 on /mnt: filesystem full 20200403 07:57:30 all (248/702): pthread.sh 20200403 07:57:33 all (249/702): tmpfs5.sh 20200403 07:57:36 all (250/702): truncate5.sh 20200403 07:57:39 all (251/702): udp.sh 20200403 07:57:43 all (252/702): unix_socket.sh 20200403 07:57:46 all (253/702): datamove5.sh 20200403 07:57:51 all (254/702): kevent2.sh 20200403 07:57:55 all (255/702): linger3.sh 20200403 07:58:00 all (256/702): mkfifo6.sh select leak: 3/201 20200403 07:58:05 all (257/702): mountro4.sh select leak: 1/202 20200403 07:58:09 all (258/702): procfs3.sh select leak: 1/203 20200403 07:58:14 all (259/702): ptrace2.sh select leak: 1/204 20200403 07:58:18 all (260/702): rename11.sh select leak: 3/207 20200403 07:58:22 all (261/702): symlink4.sh select leak: 1/208 20200403 07:58:27 all (262/702): truncate3.sh select leak: 1/209 20200403 07:58:32 all (263/702): truncate7.sh select leak: 2/211 20200403 07:58:37 all (264/702): growfs.sh g_access(1003): provider ufsid/5e86d08ee815da61 has error 6 set g_access(1003): provider ufsid/5e86d08ee815da61 has error 6 set g_access(1003): provider ufsid/5e86d08ee815da61 has error 6 set g_access(1003): provider gptid/29bb7913-7570-11ea-a9da-0cc47aa8cdda has error 6 set g_access(1003): provider gptid/29bb7913-7570-11ea-a9da-0cc47aa8cdda has error 6 set g_access(1003): provider gptid/29bb7913-7570-11ea-a9da-0cc47aa8cdda has error 6 set g_dev_taste: make_dev_p() failed (gp->name=gptid/29bb7913-7570-11ea-a9da-0cc47aa8cdda, error=17) g_dev_taste: make_dev_p() failed (gp->name=gptid/29bb7913-7570-11ea-a9da-0cc47aa8cdda, error=17) g_dev_taste: make_dev_p() failed (gp->name=ufsid/5e86d08ee815da61, error=17) g_dev_taste: make_dev_p() failed (gp->name=gptid/29bb7913-7570-11ea-a9da-0cc47aa8cdda, error=17) g_dev_taste: make_dev_p() failed (gp->name=ufsid/5e86d08ee815da61, error=17) g_dev_taste: make_dev_p() failed (gp->name=gptid/29bb7913-7570-11ea-a9da-0cc47aa8cdda, error=17) g_dev_taste: make_dev_p() failed (gp->name=ufsid/5e86d08ee815da61, error=17) GEOM leak: 14/87 select leak: 2/213 20200403 07:58:42 all (265/702): procfs.sh select leak: 2/215 20200403 07:58:47 all (266/702): pshared.sh select leak: 3/218 20200403 07:58:53 all (267/702): sparse.sh select leak: 3/221 20200403 07:59:02 all (268/702): tmpfs10.sh select leak: 3/224 20200403 07:59:07 all (269/702): fork.sh select leak: 3/227 20200403 07:59:14 all (270/702): linger2.sh Apr 3 07:59:17 mercat1 kernel: pid 51420 (linger2), uid 2007 inumber 889 on /mnt: filesystem full select leak: 4/231 20200403 07:59:20 all (271/702): linger4.sh Apr 3 07:59:25 mercat1 kernel: pid 52760 (linger4), uid 2007 inumber 47415 on /mnt: out of inodes select leak: 3/234 20200403 07:59:27 all (272/702): mlockall4.sh select leak: 2/236 20200403 07:59:33 all (273/702): ptrace9.sh select leak: 4/240 20200403 07:59:40 all (274/702): quota11.sh select leak: 3/243 20200403 07:59:46 all (275/702): sigfastblock.sh select leak: 4/247 20200403 07:59:54 all (276/702): smrstress.sh select leak: 2/249 20200403 08:00:03 all (277/702): symlink2.sh select leak: 2/251 20200403 08:00:11 all (278/702): sysctl.sh select leak: 3/254 20200403 08:00:18 all (279/702): execve.sh select leak: 2/256 20200403 08:00:29 all (280/702): tmpfs8.sh select leak: 3/259 20200403 08:00:38 all (281/702): compare.sh select leak: 2/261 20200403 08:00:47 all (282/702): ffs_blkfree.sh newblk leak: 26628/28682. select leak: 4/265 20200403 08:00:56 all (283/702): rename8.sh 20200403 08:01:06 all (284/702): umountf4.sh select leak: 2/267 20200403 08:01:15 all (285/702): proccontrol.sh select leak: 2/269 20200403 08:01:26 all (286/702): thr.sh witness_lock_list_get: witness exhausted select leak: 2/271 20200403 08:01:36 all (287/702): fsck5.sh select leak: 3/274 20200403 08:01:47 all (288/702): mprotect2.sh select leak: 2/276 20200403 08:01:58 all (289/702): nfs15lockd2.sh select leak: 1/277 20200403 08:02:10 all (290/702): posix_fadvise3.sh select leak: 3/280 20200403 08:02:21 all (291/702): rdgsbase.sh select leak: 3/283 20200403 08:02:33 all (292/702): umountf6.sh select leak: 3/286 20200403 08:02:46 all (293/702): pmc7.sh select leak: 3/289 20200403 08:02:58 all (294/702): radix.sh Apr 3 08:03:03 mercat1 kernel: pid 20903 (radix), jid 0, uid 0, was killed: out of swap space select leak: 2/291 20200403 08:03:09 all (295/702): rename9.sh select leak: 2/293 20200403 08:03:24 all (296/702): shm_open.sh select leak: 2/295 20200403 08:03:36 all (297/702): tmpfs14.sh select leak: 2/297 20200403 08:03:49 all (298/702): pipe2.sh select leak: 3/300 20200403 08:04:07 all (299/702): umountf11.sh select leak: 3/303 20200403 08:04:21 all (300/702): umountf12.sh select leak: 5/308 20200403 08:04:35 all (301/702): kevent6.sh select leak: 2/310 20200403 08:04:50 all (302/702): rdwr.sh select leak: 2/312 20200403 08:05:05 all (303/702): suj10.sh select leak: 3/315 20200403 08:05:23 all (304/702): mountu.sh select leak: 3/318 20200403 08:05:40 all (305/702): rename7.sh select leak: 3/321 20200403 08:05:57 all (306/702): sem.sh select leak: 3/324 20200403 08:06:14 all (307/702): suj14.sh Apr 3 08:06:27 mercat1 kernel: pid 83454 (cp), uid 0 inumber 238065 on /mnt: filesystem full Apr 3 08:06:28 mercat1 syslogd: last message repeated 1 times Apr 3 08:06:29 mercat1 kernel: pid 83814 (cp), uid 0 inumber 40716 on /mnt: filesystem full Apr 3 08:06:30 mercat1 kernel: pid 83842 (cp), uid 0 inumber 40722 on /mnt: filesystem full Apr 3 08:06:31 mercat1 kernel: pid 83876 (cp), uid 0 inumber 40722 on /mnt: filesystem full select leak: 3/327 20200403 08:06:32 all (308/702): f_offset.sh select leak: 4/331 20200403 08:06:52 all (309/702): mmap7.sh select leak: 2/333 20200403 08:07:33 all (310/702): tmpfs2.sh select leak: 2/335 20200403 08:07:52 all (311/702): sendfile_shm.sh select leak: 3/338 20200403 08:09:43 all (312/702): credleak.sh select leak: 3/341 20200403 08:10:03 all (313/702): tmpfs19.sh select leak: 4/345 20200403 08:10:35 all (314/702): mkfifo3.sh select leak: 2/347 20200403 08:10:57 all (315/702): mmap5.sh select leak: 4/351 20200403 08:11:17 all (316/702): mountro6.sh select leak: 4/355 20200403 08:11:38 all (317/702): multicast.sh select leak: 2/357 20200403 08:12:00 all (318/702): pdfork.sh if_delmulti_locked: detaching ifnet instance 0xfffff8000415f800 select leak: 5/362 20200403 08:12:22 all (319/702): recursiveflushes.sh select leak: 1/363 20200403 08:12:43 all (320/702): core4.sh Apr 3 08:12:45 mercat1 kernel: Failed to write core file for process core4 (error 5) select leak: 3/366 20200403 08:13:04 all (321/702): suj33.sh select leak: 1/367 20200403 08:13:27 all (322/702): pread.sh Apr 3 08:13:04 mercat1 syslogd: last message repeated 59 times select leak: 2/369 20200403 08:13:50 all (323/702): sendfile5.sh select leak: 3/372 20200403 08:14:16 all (324/702): nullfs22.sh select leak: 1/373 20200403 08:14:40 all (325/702): sendmsg2.sh select leak: 3/376 20200403 08:15:02 all (326/702): multicast2.sh Apr 3 08:15:05 mercat1 mDNSResponder[25194]: mDNSResponder (Engineering Build) (Jan 9 2020 04:51:18) starting Apr 3 08:15:05 mercat1 mDNSResponder[25194]: mDNS_AddDNSServer: Lock not held! mDNS_busy (0) mDNS_reentrancy (0) Apr 3 08:15:05 mercat1 mDNSResponder[25194]: mDNSPlatformSourceAddrForDest: connect 1.1.1.1 failed errno 51 (Network is unreachable) if_delmulti_locked: detaching ifnet instance 0xfffff80385707000 if_delmulti_locked: detaching ifnet instance 0xfffff80385707000 if_delmulti_locked: detaching ifnet instance 0xfffff8000415f800 if_delmulti_locked: detaching ifnet instance 0xfffff80385707000 if_delmulti_locked: detaching ifnet instance 0xfffff8000415f800 if_delmulti_locked: detaching ifnet instance 0xfffff80385707000 if_delmulti_locked: detaching ifnet instance 0xfffff80385707000 if_delmulti_locked: detaching ifnet instance 0xfffff80385707000 if_delmulti_locked: detaching ifnet instance 0xfffff80385707000 if_delmulti_locked: detaching ifnet instance 0xfffff80385707000 if_delmulti_locked: detaching ifnet instance 0xfffff80385707000 if_delmulti_locked: detaching ifnet instance 0xfffff80385707000 if_delmulti_locked: detaching ifnet instance 0xfffff8000415f800 Apr 3 08:17:08 mercat1 mDNSResponder[25194]: mDNSResponder (Engineering Build) (Jan 9 2020 04:51:18) stopping select leak: 2/378 20200403 08:17:08 all (327/702): namecache2.sh if_delmulti_locked: detaching ifnet instance 0xfffff8000415f800 if_delmulti_locked: detaching ifnet instance 0xfffff8000415f800 select leak: 2/380 20200403 08:17:36 all (328/702): core2.sh select leak: 1/381 20200403 08:18:03 all (329/702): rename3.sh select leak: 3/384 20200403 08:18:30 all (330/702): msdos5.sh GEOM leak: 19/106 select leak: 2/386 20200403 08:18:59 all (331/702): sendfile3.sh select leak: 3/389 20200403 08:19:29 all (332/702): fifo3.sh select leak: 2/391 20200403 08:20:01 all (333/702): mmap37.sh select leak: 2/393 20200403 08:20:33 all (334/702): beneath.sh select leak: 2/395 20200403 08:21:05 all (335/702): pthread5.sh select leak: 1/396 20200403 08:22:08 all (336/702): split.sh select leak: 3/399 20200403 08:22:37 all (337/702): vnodes.sh select leak: 4/403 20200403 08:23:13 all (338/702): umountf5.sh Apr 3 08:23:18 mercat1 kernel: pid 20060 (mkdir), uid 0 inumber 873 on /mnt: out of inodes Apr 3 08:23:19 mercat1 kernel: pid 20056 (mkdir), uid 0 inumber 885 on /mnt: out of inodes Apr 3 08:23:22 mercat1 kernel: pid 20046 (mkdir), uid 0 inumber 381 on /mnt: out of inodes Apr 3 08:23:30 mercat1 kernel: pid 20038 (mkdir), uid 0 inumber 763 on /mnt: out of inodes Apr 3 08:23:38 mercat1 kernel: pid 20062 (mkdir), uid 0 inumber 700 on /mnt: out of inodes Apr 3 08:23:44 mercat1 kernel: pid 20044 (mkdir), uid 0 inumber 874 on /mnt: out of inodes Apr 3 08:23:53 mercat1 kernel: pid 20058 (mkdir), uid 0 inumber 1521 on /mnt: out of inodes select leak: 4/407 20200403 08:24:45 all (339/702): tcp4.sh Expensive timeout(9) function: 0xffffffff80dfcbe0(0xfffff80780358bd0) 0.018741725 s Expensive timeout(9) function: 0xffffffff80dfdc40(0xfffff803fbf063f0) 0.094236303 s select leak: 2/409 20200403 08:25:22 all (340/702): ufsbench.sh select leak: 4/413 20200403 08:26:03 all (341/702): crossmp7.sh ZFS filesystem version: 5 ZFS storage pool version: features support (5000) select leak: 11/424 20200403 08:26:46 all (342/702): quota8.sh newblk leak: 2/28684. select leak: 3/427 20200403 08:27:32 all (343/702): nullfs11.sh select leak: 2/429 20200403 08:28:21 all (344/702): umountf.sh select leak: 3/432 20200403 08:28:58 all (345/702): bench.sh select leak: 9/441 20200403 08:29:48 all (346/702): exlock.sh select leak: 4/445 20200403 08:30:39 all (347/702): fpu.sh select leak: 2/447 20200403 08:31:30 all (348/702): posix_openpt.sh select leak: 4/451 20200403 08:32:23 all (349/702): jumbo.sh select leak: 3/454 20200403 08:33:23 all (350/702): suj6.sh select leak: 3/457 20200403 08:34:17 all (351/702): suj5.sh select leak: 2/459 20200403 08:35:40 all (352/702): advlock.sh select leak: 1/460 20200403 08:36:42 all (353/702): flock.sh select leak: 2/462 20200403 08:37:43 all (354/702): fsgs.sh select leak: 2/464 20200403 08:38:44 all (355/702): fts2.sh select leak: 3/467 20200403 08:39:45 all (356/702): fullpath.sh select leak: 3/470 20200403 08:40:47 all (357/702): mdconfig2.sh select leak: 2/472 20200403 08:41:48 all (358/702): midi2.sh select leak: 4/476 20200403 08:42:49 all (359/702): mkfifo8.sh select leak: 4/480 20200403 08:43:50 all (360/702): mknod.sh select leak: 3/483 20200403 08:44:51 all (361/702): mmap29.sh select leak: 3/486 20200403 08:45:53 all (362/702): pts3.sh newblk leak: 9652/38336. select leak: 4/490 20200403 08:46:54 all (363/702): sem_wait.sh select leak: 4/494 20200403 08:47:55 all (364/702): sendfile8.sh select leak: 3/497 20200403 08:48:56 all (365/702): sendfile9.sh select leak: 4/501 20200403 08:49:57 all (366/702): shm.sh select leak: 3/504 20200403 08:50:59 all (367/702): sigstop2.sh select leak: 2/506 20200403 08:52:00 all (368/702): socketpair3.sh select leak: 17/523 20200403 08:53:01 all (369/702): crossmp8.sh select leak: 1/524 20200403 08:54:03 all (370/702): fsck.sh select leak: 3/527 20200403 08:55:05 all (371/702): crossmp5.sh 20200403 08:56:04 all (372/702): tcp3.sh select leak: 2/529 20200403 08:57:10 all (373/702): rename10.sh select leak: 2/531 20200403 08:58:20 all (374/702): tmpfs21.sh select leak: 3/534 20200403 08:59:31 all (375/702): gnop2.sh GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. select leak: 1/535 20200403 09:00:40 all (376/702): quota4.sh select leak: 2/537 20200403 09:01:53 all (377/702): stack_guard_page.sh Apr 3 09:01:59 mercat1 kernel: pid 74817 (rw), uid 2007 inumber 61425 on /mnt: filesystem full Apr 3 09:02:03 mercat1 kernel: pid 74792 (rw), uid 2007 inumber 97936 on /mnt: filesystem full Apr 3 09:02:28 mercat1 kernel: pid 74840 (swap), jid 0, uid 2007, was killed: out of swap space select leak: 2/539 20200403 09:03:02 all (378/702): truss2.sh select leak: 3/542 20200403 09:04:14 all (379/702): vmstat.sh select leak: 2/544 20200403 09:05:16 all (380/702): crossmp.sh select leak: 4/548 20200403 09:06:30 all (381/702): mmap21.sh Apr 3 09:07:27 mercat1 kernel: pid 35796 (mmap21), uid 2007 inumber 256 on /tmp: filesystem full Apr 3 09:07:27 mercat1 kernel: Failed to write core file for process mmap21 (error 28) 20200403 09:07:27 all (382/702): zfs6.sh ZFS filesystem version: 5 ZFS storage pool version: features support (5000) Apr 3 09:07:27 mercat1 syslogd: last message repeated 1 times select leak: 7/555 20200403 09:08:45 all (383/702): mountro5.sh select leak: 3/558 20200403 09:10:02 all (384/702): mmap18.sh select leak: 2/560 20200403 09:11:23 all (385/702): pthread2.sh select leak: 4/564 20200403 09:12:50 all (386/702): tmpfs12.sh Apr 3 09:13:12 mercat1 kernel: pid 22171 (swap), jid 0, uid 0, was killed: out of swap space Apr 3 09:13:27 mercat1 kernel: pid 22225 (swap), jid 0, uid 0, was killed: out of swap space Apr 3 09:13:47 mercat1 kernel: pid 22215 (swap), jid 0, uid 0, was killed: out of swap space select leak: 4/568 20200403 09:14:23 all (387/702): pthread7.sh select leak: 2/570 20200403 09:15:54 all (388/702): rename12.sh select leak: 3/573 20200403 09:17:22 all (389/702): pmc6.sh select leak: 8/581 20200403 09:19:01 all (390/702): msdos10.sh select leak: 1/582 20200403 09:20:44 all (391/702): ptrace10.sh select leak: 2/584 20200403 09:22:32 all (392/702): pthread3.sh select leak: 3/587 20200403 09:24:21 all (393/702): umountf2.sh select leak: 4/591 20200403 09:26:39 all (394/702): fifo2.sh select leak: 2/593 20200403 09:28:40 all (395/702): kevent.sh select leak: 4/597 20200403 09:30:42 all (396/702): kevent14.sh select leak: 2/599 20200403 09:32:43 all (397/702): kpti.sh select leak: 4/603 20200403 09:34:44 all (398/702): midi.sh select leak: 4/607 20200403 09:36:45 all (399/702): sendfile10.sh select leak: 2/609 20200403 09:38:47 all (400/702): callout_reset_on.sh select leak: 4/613 20200403 09:40:17 all (401/702): fpclone.sh select leak: 5/618 20200403 09:42:20 all (402/702): ftruncate3.sh GEOM leak: 10/116 select leak: 2/620 20200403 09:44:24 all (403/702): overflow3.sh select leak: 1/621 20200403 09:46:26 all (404/702): syscall4.sh WARNING pid 7844 (calls): ioctl sign-extension ioctl f4be77f1edf WARNING pid 7876 (calls): ioctl sign-extension ioctl 217af77f1d1d WARNING pid 7891 (calls): ioctl sign-extension ioctl 4d20d7c63acf WARNING pid 7910 (calls): ioctl sign-extension ioctl de699850288b4df5 WARNING pid 7934 (calls): ioctl sign-extension ioctl af314ff0272 WARNING pid 7988 (calls): ioctl sign-extension ioctl da150f143c0 WARNING pid 8016 (calls): ioctl sign-extension ioctl c4a823ad671919b1 WARNING pid 8186 (calls): ioctl sign-extension ioctl 6d81ce083175 WARNING pid 8427 (calls): ioctl sign-extension ioctl 2b56c7af8b64d28f WARNING pid 9372 (calls): ioctl sign-extension ioctl fd74abb695a83558 WARNING pid 9476 (calls): ioctl sign-extension ioctl 7b595693c644 WARNING pid 9548 (calls): ioctl sign-extension ioctl 50af8e0f340f WARNING pid 9693 (calls): ioctl sign-extension ioctl ce966894efa44189 WARNING pid 9695 (calls): ioctl sign-extension ioctl 1988f3d5af61ccf WARNING pid 9706 (calls): ioctl sign-extension ioctl 5e2b5eb4816c WARNING pid 9723 (calls): ioctl sign-extension ioctl 74ce70223bf663b9 WARNING pid 9767 (calls): ioctl sign-extension ioctl 4b569fc7cc61 WARNING pid 9805 (calls): ioctl sign-extension ioctl 7ffd18bee464 WARNING pid 9946 (calls): ioctl sign-extension ioctl cdd0f1831000c6d2 WARNING pid 9997 (calls): ioctl sign-extension ioctl 364a4f486013 WARNING pid 10032 (calls): ioctl sign-extension ioctl 64f531c98e68 WARNING pid 10046 (calls): ioctl sign-extension ioctl 1e33c168b976 WARNING pid 10221 (calls): ioctl sign-extension ioctl 5fc40719ec29 WARNING pid 10254 (calls): ioctl sign-extension ioctl b445fa41030 WARNING pid 10295 (calls): ioctl sign-extension ioctl 99bd32e67e3 WARNING pid 10337 (calls): ioctl sign-extension ioctl 719d1e46628b WARNING pid 10352 (calls): ioctl sign-extension ioctl 1c35af1f3660 WARNING pid 10363 (calls): ioctl sign-extension ioctl 8aa4f278df077a8d WARNING pid 10477 (calls): ioctl sign-extension ioctl b0c10517c95d27e WARNING pid 10912 (calls): ioctl sign-extension ioctl 75cfb29510f10cfd WARNING pid 10984 (calls): ioctl sign-extension ioctl 41de27c59d6f WARNING pid 11397 (calls): ioctl sign-extension ioctl b29fce519cb03e30 WARNING pid 12079 (calls): ioctl sign-extension ioctl d705ec550b835417 WARNING pid 12091 (calls): ioctl sign-extension ioctl 535b140439ea2376 WARNING pid 12133 (calls): ioctl sign-extension ioctl 3a004ef8459a WARNING pid 12162 (calls): ioctl sign-extension ioctl 36ed554e041847b0 WARNING pid 12168 (calls): ioctl sign-extension ioctl f0d446071fe24a98 WARNING pid 12334 (calls): ioctl sign-extension ioctl 5476dc72f633 select leak: 3/624 20200403 09:48:33 all (405/702): fragments.sh Apr 3 09:48:36 mercat1 kernel: pid 14428 (fragments), uid 2007 inumber 117620 on /mnt: filesystem full Apr 3 09:48:37 mercat1 kernel: pid 14438 (fragments), uid 2007 inumber 7393 on /mnt: filesystem full Apr 3 09:48:38 mercat1 kernel: pid 14435 (fragments), uid 2007 inumber 7471 on /mnt: filesystem full Apr 3 09:48:39 mercat1 kernel: pid 14446 (fragments), uid 2007 inumber 7335 on /mnt: filesystem full Apr 3 09:48:40 mercat1 kernel: pid 14450 (fragments), uid 2007 inumber 7161 on /mnt: filesystem full Apr 3 09:48:41 mercat1 kernel: pid 14453 (fragments), uid 2007 inumber 7145 on /mnt: filesystem full Apr 3 09:48:42 mercat1 kernel: pid 14461 (fragments), uid 2007 inumber 7085 on /mnt: filesystem full Apr 3 09:48:43 mercat1 kernel: pid 14462 (fragments), uid 2007 inumber 7352 on /mnt: filesystem full Apr 3 09:48:44 mercat1 kernel: pid 15664 (fragments), uid 2007 inumber 7195 on /mnt: filesystem full Apr 3 09:48:45 mercat1 kernel: pid 15665 (fragments), uid 2007 inumber 7186 on /mnt: filesystem full Apr 3 09:48:46 mercat1 kernel: pid 15675 (fragments), uid 2007 inumber 7553 on /mnt: filesystem full Apr 3 09:48:47 mercat1 kernel: pid 15673 (fragments), uid 2007 inumber 7311 on /mnt: filesystem full Apr 3 09:48:48 mercat1 kernel: pid 15682 (fragments), uid 2007 inumber 7100 on /mnt: filesystem full Apr 3 09:48:49 mercat1 kernel: pid 15684 (fragments), uid 2007 inumber 7196 on /mnt: filesystem full Apr 3 09:48:50 mercat1 kernel: pid 15689 (fragments), uid 2007 inumber 2 on /mnt: filesystem full Apr 3 09:48:51 mercat1 kernel: pid 15686 (fragments), uid 2007 inumber 7188 on /mnt: filesystem full Apr 3 09:48:52 mercat1 kernel: pid 15697 (fragments), uid 2007 inumber 7173 on /mnt: filesystem full Apr 3 09:48:53 mercat1 kernel: pid 15700 (fragments), uid 2007 inumber 7603 on /mnt: filesystem full Apr 3 09:48:54 mercat1 kernel: pid 15708 (fragments), uid 2007 inumber 7101 on /mnt: filesystem full Apr 3 09:48:55 mercat1 kernel: pid 16913 (fragments), uid 2007 inumber 7155 on /mnt: filesystem full Apr 3 09:48:56 mercat1 kernel: pid 16910 (fragments), uid 2007 inumber 7137 on /mnt: filesystem full Apr 3 09:48:57 mercat1 kernel: pid 16919 (fragments), uid 2007 inumber 7362 on /mnt: filesystem full Apr 3 09:48:58 mercat1 kernel: pid 16917 (fragments), uid 2007 inumber 7078 on /mnt: filesystem full Apr 3 09:48:59 mercat1 kernel: pid 16921 (fragments), uid 2007 inumber 7079 on /mnt: filesystem full Apr 3 09:49:00 mercat1 kernel: pid 16924 (fragments), uid 2007 inumber 7082 on /mnt: filesystem full Apr 3 09:49:01 mercat1 kernel: pid 16934 (fragments), uid 2007 inumber 7139 on /mnt: filesystem full Apr 3 09:49:02 mercat1 kernel: pid 16937 (fragments), uid 2007 inumber 7087 on /mnt: filesystem full Apr 3 09:49:03 mercat1 kernel: pid 16944 (fragments), uid 2007 inumber 7252 on /mnt: filesystem full Apr 3 09:49:04 mercat1 kernel: pid 16944 (fragments), uid 2007 inumber 7171 on /mnt: filesystem full Apr 3 09:49:05 mercat1 kernel: pid 18146 (fragments), uid 2007 inumber 7317 on /mnt: filesystem full Apr 3 09:49:06 mercat1 kernel: pid 18149 (fragments), uid 2007 inumber 7403 on /mnt: filesystem full Apr 3 09:49:07 mercat1 kernel: pid 18150 (fragments), uid 2007 inumber 7190 on /mnt: filesystem full Apr 3 09:49:08 mercat1 kernel: pid 18153 (fragments), uid 2007 inumber 7331 on /mnt: filesystem full Apr 3 09:49:09 mercat1 kernel: pid 18160 (fragments), uid 2007 inumber 7323 on /mnt: filesystem full Apr 3 09:49:10 mercat1 kernel: pid 18163 (fragments), uid 2007 inumber 7215 on /mnt: filesystem full Apr 3 09:49:11 mercat1 kernel: pid 18162 (fragments), uid 2007 inumber 7102 on /mnt: filesystem full Apr 3 09:49:12 mercat1 kernel: pid 18174 (fragments), uid 2007 inumber 7357 on /mnt: filesystem full Apr 3 09:49:13 mercat1 kernel: pid 18181 (fragments), uid 2007 inumber 7071 on /mnt: filesystem full Apr 3 09:49:14 mercat1 kernel: pid 18179 (fragments), uid 2007 inumber 7300 on /mnt: filesystem full Apr 3 09:49:15 mercat1 kernel: pid 18181 (fragments), uid 2007 inumber 7117 on /mnt: filesystem full Apr 3 09:49:16 mercat1 kernel: pid 19385 (fragments), uid 2007 inumber 7293 on /mnt: filesystem full Apr 3 09:49:17 mercat1 kernel: pid 19394 (fragments), uid 2007 inumber 7191 on /mnt: filesystem full Apr 3 09:49:18 mercat1 kernel: pid 19396 (fragments), uid 2007 inumber 7142 on /mnt: filesystem full Apr 3 09:49:19 mercat1 kernel: pid 19401 (fragments), uid 2007 inumber 7104 on /mnt: filesystem full Apr 3 09:49:20 mercat1 kernel: pid 19407 (fragments), uid 2007 inumber 7220 on /mnt: filesystem full Apr 3 09:49:21 mercat1 kernel: pid 19410 (fragments), uid 2007 inumber 7191 on /mnt: filesystem full Apr 3 09:49:22 mercat1 kernel: pid 19415 (fragments), uid 2007 inumber 7167 on /mnt: filesystem full Apr 3 09:49:23 mercat1 kernel: pid 19421 (fragments), uid 2007 inumber 7104 on /mnt: filesystem full Apr 3 09:49:24 mercat1 kernel: pid 19425 (fragments), uid 2007 inumber 7185 on /mnt: filesystem full Apr 3 09:49:25 mercat1 kernel: pid 19427 (fragments), uid 2007 inumber 7103 on /mnt: filesystem full Apr 3 09:49:26 mercat1 kernel: pid 19423 (fragments), uid 2007 inumber 2 on /mnt: filesystem full Apr 3 09:49:29 mercat1 syslogd: last message repeated 3 times Apr 3 09:49:30 mercat1 kernel: pid 19430 (fragments), uid 2007 inumber 2 on /mnt: filesystem full Apr 3 09:49:31 mercat1 kernel: pid 20636 (fragments), uid 2007 inumber 7270 on /mnt: filesystem full Apr 3 09:49:32 mercat1 kernel: pid 20641 (fragments), uid 2007 inumber 7180 on /mnt: filesystem full Apr 3 09:49:33 mercat1 kernel: pid 20638 (fragments), uid 2007 inumber 7268 on /mnt: filesystem full Apr 3 09:49:34 mercat1 kernel: pid 20643 (fragments), uid 2007 inumber 7243 on /mnt: filesystem full Apr 3 09:49:35 mercat1 kernel: pid 20652 (fragments), uid 2007 inumber 7210 on /mnt: filesystem full Apr 3 09:49:36 mercat1 kernel: pid 20647 (fragments), uid 2007 inumber 2 on /mnt: filesystem full Apr 3 09:49:37 mercat1 kernel: pid 21860 (fragments), uid 2007 inumber 7142 on /mnt: filesystem full Apr 3 09:49:38 mercat1 kernel: pid 21853 (fragments), uid 2007 inumber 2 on /mnt: filesystem full Apr 3 09:49:39 mercat1 kernel: pid 21868 (fragments), uid 2007 inumber 7103 on /mnt: filesystem full Apr 3 09:49:40 mercat1 kernel: pid 21864 (fragments), uid 2007 inumber 7201 on /mnt: filesystem full Apr 3 09:49:41 mercat1 kernel: pid 21876 (fragments), uid 2007 inumber 7147 on /mnt: filesystem full Apr 3 09:49:42 mercat1 kernel: pid 21878 (fragments), uid 2007 inumber 7295 on /mnt: filesystem full Apr 3 09:49:44 mercat1 kernel: pid 21880 (fragments), uid 2007 inumber 2 on /mnt: filesystem full Apr 3 09:49:44 mercat1 kernel: pid 21883 (fragments), uid 2007 inumber 7260 on /mnt: filesystem full Apr 3 09:49:45 mercat1 kernel: pid 21890 (fragments), uid 2007 inumber 7213 on /mnt: filesystem full Apr 3 09:49:46 mercat1 kernel: pid 21909 (fragments), uid 2007 inumber 7265 on /mnt: filesystem full Apr 3 09:49:47 mercat1 kernel: pid 21905 (fragments), uid 2007 inumber 7205 on /mnt: filesystem full Apr 3 09:49:48 mercat1 kernel: pid 21904 (fragments), uid 2007 inumber 7142 on /mnt: filesystem full Apr 3 09:49:49 mercat1 kernel: pid 23112 (fragments), uid 2007 inumber 7201 on /mnt: filesystem full Apr 3 09:49:51 mercat1 kernel: pid 23119 (fragments), uid 2007 inumber 7067 on /mnt: filesystem full Apr 3 09:49:52 mercat1 kernel: pid 23122 (fragments), uid 2007 inumber 7138 on /mnt: filesystem full Apr 3 09:49:52 mercat1 kernel: pid 23120 (fragments), uid 2007 inumber 7095 on /mnt: filesystem full Apr 3 09:49:53 mercat1 kernel: pid 23131 (fragments), uid 2007 inumber 7177 on /mnt: filesystem full Apr 3 09:49:54 mercat1 kernel: pid 23127 (fragments), uid 2007 inumber 7104 on /mnt: filesystem full Apr 3 09:49:56 mercat1 kernel: pid 23137 (fragments), uid 2007 inumber 7232 on /mnt: filesystem full Apr 3 09:49:57 mercat1 kernel: pid 23136 (fragments), uid 2007 inumber 7284 on /mnt: filesystem full Apr 3 09:49:57 mercat1 kernel: pid 23472 (fragments), uid 2007 inumber 7088 on /mnt: filesystem full Apr 3 09:49:58 mercat1 kernel: pid 23470 (fragments), uid 2007 inumber 2 on /mnt: filesystem full Apr 3 09:49:59 mercat1 kernel: pid 23475 (fragments), uid 2007 inumber 7410 on /mnt: filesystem full Apr 3 09:50:00 mercat1 kernel: pid 24352 (fragments), uid 2007 inumber 7209 on /mnt: filesystem full Apr 3 09:50:01 mercat1 kernel: pid 24350 (fragments), uid 2007 inumber 7194 on /mnt: filesystem full Apr 3 09:50:03 mercat1 kernel: pid 24353 (fragments), uid 2007 inumber 7321 on /mnt: filesystem full Apr 3 09:50:04 mercat1 kernel: pid 24351 (fragments), uid 2007 inumber 2 on /mnt: filesystem full Apr 3 09:50:09 mercat1 syslogd: last message repeated 5 times Apr 3 09:50:10 mercat1 kernel: pid 25558 (fragments), uid 2007 inumber 7238 on /mnt: filesystem full Apr 3 09:50:11 mercat1 kernel: pid 25563 (fragments), uid 2007 inumber 7506 on /mnt: filesystem full Apr 3 09:50:12 mercat1 kernel: pid 25564 (fragments), uid 2007 inumber 7214 on /mnt: filesystem full Apr 3 09:50:12 mercat1 kernel: pid 25578 (fragments), uid 2007 inumber 2 on /mnt: filesystem full Apr 3 09:50:14 mercat1 kernel: pid 25577 (fragments), uid 2007 inumber 7372 on /mnt: filesystem full Apr 3 09:50:15 mercat1 kernel: pid 25580 (fragments), uid 2007 inumber 7073 on /mnt: filesystem full Apr 3 09:50:16 mercat1 kernel: pid 25583 (fragments), uid 2007 inumber 7319 on /mnt: filesystem full Apr 3 09:50:17 mercat1 kernel: pid 25595 (fragments), uid 2007 inumber 7187 on /mnt: filesystem full Apr 3 09:50:18 mercat1 kernel: pid 25592 (fragments), uid 2007 inumber 7073 on /mnt: filesystem full Apr 3 09:50:19 mercat1 kernel: pid 25602 (fragments), uid 2007 inumber 7211 on /mnt: filesystem full Apr 3 09:50:20 mercat1 kernel: pid 25597 (fragments), uid 2007 inumber 7155 on /mnt: filesystem full Apr 3 09:50:21 mercat1 kernel: pid 26806 (fragments), uid 2007 inumber 7164 on /mnt: filesystem full Apr 3 09:50:22 mercat1 kernel: pid 26806 (fragments), uid 2007 inumber 7228 on /mnt: filesystem full Apr 3 09:50:23 mercat1 kernel: pid 26815 (fragments), uid 2007 inumber 7347 on /mnt: filesystem full Apr 3 09:50:24 mercat1 kernel: pid 26817 (fragments), uid 2007 inumber 7374 on /mnt: filesystem full Apr 3 09:50:25 mercat1 kernel: pid 26824 (fragments), uid 2007 inumber 7208 on /mnt: filesystem full Apr 3 09:50:26 mercat1 kernel: pid 26821 (fragments), uid 2007 inumber 7069 on /mnt: filesystem full select leak: 2/626 20200403 09:50:27 all (406/702): mmap27.sh select leak: 5/631 20200403 09:52:38 all (407/702): setsockopt2.sh select leak: 3/634 20200403 09:55:22 all (408/702): snap11.sh select leak: 8/642 20200403 09:57:25 all (409/702): tmpfs22.sh select leak: 2/644 20200403 09:59:29 all (410/702): umount4.sh select leak: 3/647 20200403 10:01:32 all (411/702): vm_map.sh select leak: 2/649 20200403 10:03:35 all (412/702): fifo4.sh select leak: 1/650 20200403 10:05:42 all (413/702): fts3.sh select leak: 4/654 20200403 10:07:47 all (414/702): graid1_3.sh g_access(1003): provider ufsid/5e86d08ee815da61 has error 6 set g_access(1003): provider gptid/29bb7913-7570-11ea-a9da-0cc47aa8cdda has error 6 set select leak: 3/657 20200403 10:09:51 all (415/702): poll2.sh select leak: 1/658 20200403 10:11:58 all (416/702): shm2.sh select leak: 2/660 20200403 10:14:04 all (417/702): truncate9.sh select leak: 4/664 20200403 10:16:07 all (418/702): graid1_10.sh g_access(1003): provider ufsid/5e86d08ee815da61 has error 6 set g_access(1003): provider gptid/29bb7913-7570-11ea-a9da-0cc47aa8cdda has error 6 set select leak: 1/665 20200403 10:18:13 all (419/702): tmpfs13.sh select leak: 2/667 20200403 10:20:18 all (420/702): flock_open_close.sh select leak: 1/668 20200403 10:22:34 all (421/702): mmap31.sh select leak: 5/673 20200403 10:24:35 all (422/702): nullfs18.sh select leak: 2/675 20200403 10:26:46 all (423/702): racct.sh select leak: 3/678 20200403 10:28:53 all (424/702): umountf3.sh Apr 3 10:28:57 mercat1 kernel: pid 98100 (dd), uid 0 inumber 153 on /tmp: filesystem full select leak: 5/683 20200403 10:28:57 all (425/702): contigmalloc.sh Apr 3 10:29:25 mercat1 kernel: pid 13407 (tail), uid 2006 inumber 232 on /tmp: filesystem full select leak: 7/690 20200403 10:31:08 all (426/702): swappedout.sh select leak: 7/697 20200403 10:33:16 all (427/702): truncate2.sh select leak: 3/700 20200403 10:35:24 all (428/702): kevent4.sh newblk leak: 5062/43398. select leak: 4/704 20200403 10:37:40 all (429/702): arp.sh Apr 3 10:39:03 mercat1 kernel: pid 34105 (swap), jid 0, uid 0, was killed: out of swap space select leak: 3/707 20200403 10:39:48 all (430/702): vmstat2.sh select leak: 3/710 20200403 10:42:05 all (431/702): namecache.sh select leak: 2/712 20200403 10:44:23 all (432/702): pthread4.sh select leak: 4/716 20200403 10:46:38 all (433/702): tmpfs9.sh Apr 3 10:48:42 mercat1 kernel: pid 78968 (swap), jid 0, uid 0, was killed: out of swap space select leak: 3/719 20200403 10:48:48 all (434/702): link2.sh Apr 3 10:49:37 mercat1 kernel: pid 30452 (swap), jid 0, uid 0, was killed: out of swap space select leak: 3/722 20200403 10:52:24 all (435/702): nullfs19.sh select leak: 4/726 20200403 10:55:14 all (436/702): mmap32.sh select leak: 2/728 20200403 10:57:35 all (437/702): zz-combo03.sh Fatal trap 12: page fault while in kernel mode cpuid = 0; apic id = 00 fault virtual address = 0x190 fault code = supervisor read data, page not present instruction pointer = 0x20:0xffffffff80ee9909 stack pointer = 0x28:0xfffffe00e37f3a70 frame pointer = 0x28:0xfffffe00e37f3a90 code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags = interrupt enabled, resume, IOPL = 0 current process = 34 (vnlru) trap number = 12 panic: page fault cpuid = 0 time = 1585904317 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e37f3720 vpanic() at vpanic+0x182/frame 0xfffffe00e37f3770 panic() at panic+0x43/frame 0xfffffe00e37f37d0 trap_fatal() at trap_fatal+0x387/frame 0xfffffe00e37f3830 trap_pfault() at trap_pfault+0x99/frame 0xfffffe00e37f3890 trap() at trap+0x2a5/frame 0xfffffe00e37f39a0 calltrap() at calltrap+0x8/frame 0xfffffe00e37f39a0 --- trap 0xc, rip = 0xffffffff80ee9909, rsp = 0xfffffe00e37f3a70, rbp = 0xfffffe00e37f3a90 --- ufs_reclaim() at ufs_reclaim+0x79/frame 0xfffffe00e37f3a90 VOP_RECLAIM_APV() at VOP_RECLAIM_APV+0x59/frame 0xfffffe00e37f3ab0 vgonel() at vgonel+0x3b7/frame 0xfffffe00e37f3b10 vnlru_proc() at vnlru_proc+0x7fb/frame 0xfffffe00e37f3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e37f3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e37f3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- KDB: enter: panic [ thread pid 34 tid 100140 ] Stopped at kdb_enter+0x37: movq $0,0x10901a6(%rip) db> run pho db:0:pho> set $lines 20000 db:0:pho> run pho1 db:1:pho1> dump Dumping 2772 out of 32626 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% Dump complete db:1:pho1> bt Tracing pid 34 tid 100140 td 0xfffffe00d35df500 kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e37f3720 vpanic() at vpanic+0x19e/frame 0xfffffe00e37f3770 panic() at panic+0x43/frame 0xfffffe00e37f37d0 trap_fatal() at trap_fatal+0x387/frame 0xfffffe00e37f3830 trap_pfault() at trap_pfault+0x99/frame 0xfffffe00e37f3890 trap() at trap+0x2a5/frame 0xfffffe00e37f39a0 calltrap() at calltrap+0x8/frame 0xfffffe00e37f39a0 --- trap 0xc, rip = 0xffffffff80ee9909, rsp = 0xfffffe00e37f3a70, rbp = 0xfffffe00e37f3a90 --- ufs_reclaim() at ufs_reclaim+0x79/frame 0xfffffe00e37f3a90 VOP_RECLAIM_APV() at VOP_RECLAIM_APV+0x59/frame 0xfffffe00e37f3ab0 vgonel() at vgonel+0x3b7/frame 0xfffffe00e37f3b10 vnlru_proc() at vnlru_proc+0x7fb/frame 0xfffffe00e37f3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e37f3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e37f3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:1:pho1> show allpcpu Current CPU: 0 cpuid = 0 dynamic pcpu = 0x97bb40 curthread = 0xfffffe00d35df500: pid 34 tid 100140 critnest 1 "vnlru" curpcb = 0xfffffe00d35dfa10 fpcurthread = none idlethread = 0xfffffe003e3e0300: tid 100003 "idle: cpu0" self = 0xffffffff82410000 curpmap = 0xffffffff81d9fb50 tssp = 0xffffffff82410384 rsp0 = 0xfffffe00e37f3cc0 kcr3 = 0x800000000230d002 ucr3 = 0xffffffffffffffff scr3 = 0x50b3a9bcd gs32p = 0xffffffff82410404 ldt = 0xffffffff82410444 tss = 0xffffffff82410434 tlb gen = 197417443 curvnet = 0 spin locks held: cpuid = 1 dynamic pcpu = 0xfffffe00bc7f3b40 curthread = 0xfffffe003e3dfc00: pid 11 tid 100004 critnest 1 "idle: cpu1" curpcb = 0xfffffe003e3e0110 fpcurthread = none idlethread = 0xfffffe003e3dfc00: tid 100004 "idle: cpu1" self = 0xffffffff82411000 curpmap = 0xffffffff81d9fb50 tssp = 0xffffffff82411384 rsp0 = 0xfffffe00add4bcc0 kcr3 = 0x800000000230d003 ucr3 = 0xffffffffffffffff scr3 = 0x413f6ada2 gs32p = 0xffffffff82411404 ldt = 0xffffffff82411444 tss = 0xffffffff82411434 tlb gen = 197417443 curvnet = 0 spin locks held: cpuid = 2 dynamic pcpu = 0xfffffe00bc7ffb40 curthread = 0xfffffe003e3df500: pid 11 tid 100005 critnest 1 "idle: cpu2" curpcb = 0xfffffe003e3dfa10 fpcurthread = none idlethread = 0xfffffe003e3df500: tid 100005 "idle: cpu2" self = 0xffffffff82412000 curpmap = 0xffffffff81d9fb50 tssp = 0xffffffff82412384 rsp0 = 0xfffffe00add50cc0 kcr3 = 0x800000000230d004 ucr3 = 0xffffffffffffffff scr3 = 0x413cd7b4e gs32p = 0xffffffff82412404 ldt = 0xffffffff82412444 tss = 0xffffffff82412434 tlb gen = 197417443 curvnet = 0 spin locks held: cpuid = 3 dynamic pcpu = 0xfffffe00bc80bb40 curthread = 0xfffffe014a776000: pid 79037 tid 105588 critnest 0 "umount" curpcb = 0xfffffe014a776510 fpcurthread = 0xfffffe014a776000: pid 79037 "umount" idlethread = 0xfffffe003e3dee00: tid 100006 "idle: cpu3" self = 0xffffffff82413000 curpmap = 0xfffffe017796cb08 tssp = 0xffffffff82413384 rsp0 = 0xfffffe035d0f4cc0 kcr3 = 0x80000007569c6418 ucr3 = 0x80000005e7e08c18 scr3 = 0x5e7e08c18 gs32p = 0xffffffff82413404 ldt = 0xffffffff82413444 tss = 0xffffffff82413434 tlb gen = 197417443 curvnet = 0 spin locks held: cpuid = 4 dynamic pcpu = 0xfffffe00bc817b40 curthread = 0xfffffe013074b300: pid 79033 tid 102330 critnest 0 "umount" curpcb = 0xfffffe013074b810 fpcurthread = 0xfffffe013074b300: pid 79033 "umount" idlethread = 0xfffffe003e3de700: tid 100007 "idle: cpu4" self = 0xffffffff82414000 curpmap = 0xfffffe01212ef120 tssp = 0xffffffff82414384 rsp0 = 0xfffffe0130881cc0 kcr3 = 0x800000066f58b6c1 ucr3 = 0x80000005c2b3dec1 scr3 = 0x5c2b3dec1 gs32p = 0xffffffff82414404 ldt = 0xffffffff82414444 tss = 0xffffffff82414434 tlb gen = 197417443 curvnet = 0 spin locks held: cpuid = 5 dynamic pcpu = 0xfffffe00bc823b40 curthread = 0xfffffe012d923a00: pid 79021 tid 103540 critnest 0 "umount" curpcb = 0xfffffe012d923f10 fpcurthread = 0xfffffe012d923a00: pid 79021 "umount" idlethread = 0xfffffe003e3de000: tid 100008 "idle: cpu5" self = 0xffffffff82415000 curpmap = 0xfffffe015ba714f0 tssp = 0xffffffff82415384 rsp0 = 0xfffffe033dad1cc0 kcr3 = 0x80000004f37033b5 ucr3 = 0x80000008251b1bb5 scr3 = 0x8251b1bb5 gs32p = 0xffffffff82415404 ldt = 0xffffffff82415444 tss = 0xffffffff82415434 tlb gen = 197417443 curvnet = 0 spin locks held: cpuid = 6 dynamic pcpu = 0xfffffe00bc82fb40 curthread = 0xfffffe003e3e8a00: pid 11 tid 100009 critnest 1 "idle: cpu6" curpcb = 0xfffffe003e3e8f10 fpcurthread = none idlethread = 0xfffffe003e3e8a00: tid 100009 "idle: cpu6" self = 0xffffffff82416000 curpmap = 0xffffffff81d9fb50 tssp = 0xffffffff82416384 rsp0 = 0xfffffe00add64cc0 kcr3 = 0x800000000230d003 ucr3 = 0xffffffffffffffff scr3 = 0x413b2fa31 gs32p = 0xffffffff82416404 ldt = 0xffffffff82416444 tss = 0xffffffff82416434 tlb gen = 197417443 curvnet = 0 spin locks held: cpuid = 7 dynamic pcpu = 0xfffffe00bc83bb40 curthread = 0xfffffe012be88a00: pid 79036 tid 106191 critnest 0 "umount" curpcb = 0xfffffe012be88f10 fpcurthread = 0xfffffe012be88a00: pid 79036 "umount" idlethread = 0xfffffe003e3e8300: tid 100010 "idle: cpu7" self = 0xffffffff82417000 curpmap = 0xfffffe0164040120 tssp = 0xffffffff82417384 rsp0 = 0xfffffe0366cc7cc0 kcr3 = 0x800000058ed1e167 ucr3 = 0x800000058ecf6967 scr3 = 0x58ecf6967 gs32p = 0xffffffff82417404 ldt = 0xffffffff82417444 tss = 0xffffffff82417434 tlb gen = 197417442 curvnet = 0 spin locks held: cpuid = 8 dynamic pcpu = 0xfffffe00bc847b40 curthread = 0xfffffe0169939800: pid 79025 tid 102950 critnest 0 "umount" curpcb = 0xfffffe0169939d10 fpcurthread = 0xfffffe0169939800: pid 79025 "umount" idlethread = 0xfffffe003e3e7c00: tid 100011 "idle: cpu8" self = 0xffffffff82418000 curpmap = 0xfffffe0164252b08 tssp = 0xffffffff82418384 rsp0 = 0xfffffe0342d44cc0 kcr3 = 0x80000006038d0292 ucr3 = 0x8000000724305a92 scr3 = 0x724305a92 gs32p = 0xffffffff82418404 ldt = 0xffffffff82418444 tss = 0xffffffff82418434 tlb gen = 197417443 curvnet = 0 spin locks held: cpuid = 9 dynamic pcpu = 0xfffffe00bc853b40 curthread = 0xfffffe015a32e500: pid 79027 tid 103199 critnest 0 "umount" curpcb = 0xfffffe015a32ea10 fpcurthread = 0xfffffe015a32e500: pid 79027 "umount" idlethread = 0xfffffe003e3e7500: tid 100012 "idle: cpu9" self = 0xffffffff82419000 curpmap = 0xfffffe0119870120 tssp = 0xffffffff82419384 rsp0 = 0xfffffe033f422cc0 kcr3 = 0x800000025ace64a9 ucr3 = 0x80000003a278cca9 scr3 = 0x3a278cca9 gs32p = 0xffffffff82419404 ldt = 0xffffffff82419444 tss = 0xffffffff82419434 tlb gen = 197417443 curvnet = 0 spin locks held: cpuid = 10 dynamic pcpu = 0xfffffe00bc85fb40 curthread = 0xfffffe015a146c00: pid 79032 tid 104227 critnest 0 "umount" curpcb = 0xfffffe015a147110 fpcurthread = 0xfffffe015a146c00: pid 79032 "umount" idlethread = 0xfffffe003e3e6e00: tid 100013 "idle: cpu10" self = 0xffffffff8241a000 curpmap = 0xfffffe01212f44f0 tssp = 0xffffffff8241a384 rsp0 = 0xfffffe034164acc0 kcr3 = 0x80000001f71b055c ucr3 = 0x800000050b3a9d5c scr3 = 0x50b3a9d5c gs32p = 0xffffffff8241a404 ldt = 0xffffffff8241a444 tss = 0xffffffff8241a434 tlb gen = 197417443 curvnet = 0 spin locks held: cpuid = 11 dynamic pcpu = 0xfffffe00bc86bb40 curthread = 0xfffffe00e784b000: pid 79038 tid 102386 critnest 0 "umount" curpcb = 0xfffffe00e784b510 fpcurthread = 0xfffffe00e784b000: pid 79038 "umount" idlethread = 0xfffffe003e3e6700: tid 100014 "idle: cpu11" self = 0xffffffff8241b000 curpmap = 0xfffffe01641fc120 tssp = 0xffffffff8241b384 rsp0 = 0xfffffe00e70a2cc0 kcr3 = 0x800000042fd701fa ucr3 = 0x800000020da289fa scr3 = 0x20da289fa gs32p = 0xffffffff8241b404 ldt = 0xffffffff8241b444 tss = 0xffffffff8241b434 tlb gen = 197417443 curvnet = 0 spin locks held: db:1:pho1> show alllocks db:1:pho1> show lockedvnods Locked vnodes vnode 0xfffff8076eecfc80: type VDIR usecount 1, writecount 0, refcount 3 mountedhere 0xfffffe00e6873280 flags (VMP_LAZYLIST) v_object 0xfffff80350676e70 ref 0 pages 1 cleanbuf 1 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe015a32e500 (pid 79027, umount, tid 103199) #0 0xffffffff80b92ec5 at lockmgr_lock_flags+0x1d5 #1 0xffffffff80ee0e3d at ffs_lock+0x6d #2 0xffffffff810e38b0 at VOP_LOCK1_APV+0x40 #3 0xffffffff80caf034 at _vn_lock+0x54 #4 0xffffffff80c910d7 at dounmount+0x67 #5 0xffffffff80c91019 at kern_unmount+0x2b9 #6 0xffffffff81066ad9 at amd64_syscall+0x159 #7 0xffffffff8103c5a0 at fast_syscall_common+0x101 nlink=2, effnlink=2, size=512, extsize 0 generation=9a5a4324, uid=0, gid=0, flags=0x0 ino 48153600, on dev gpt/work vnode 0xfffff80276c7aa00: type VDIR usecount 1, writecount 0, refcount 4 mountedhere 0xfffffe00e684e700 flags (VMP_LAZYLIST) v_object 0xfffff803e913d000 ref 0 pages 1 cleanbuf 1 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe00e784b000 (pid 79038, umount, tid 102386) #0 0xffffffff80b92ec5 at lockmgr_lock_flags+0x1d5 #1 0xffffffff80ee0e3d at ffs_lock+0x6d #2 0xffffffff810e38b0 at VOP_LOCK1_APV+0x40 #3 0xffffffff80caf034 at _vn_lock+0x54 #4 0xffffffff80c910d7 at dounmount+0x67 #5 0xffffffff80c91019 at kern_unmount+0x2b9 #6 0xffffffff81066ad9 at amd64_syscall+0x159 #7 0xffffffff8103c5a0 at fast_syscall_common+0x101 nlink=2, effnlink=2, size=512, extsize 0 generation=74b75fc, uid=0, gid=0, flags=0x0 ino 73675008, on dev gpt/work vnode 0xfffff80679520000: type VDIR usecount 1, writecount 0, refcount 3 mountedhere 0xfffffe00e6871000 flags (VMP_LAZYLIST) v_object 0xfffff80737543420 ref 0 pages 1 cleanbuf 1 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe0169939800 (pid 79025, umount, tid 102950) #0 0xffffffff80b92ec5 at lockmgr_lock_flags+0x1d5 #1 0xffffffff80ee0e3d at ffs_lock+0x6d #2 0xffffffff810e38b0 at VOP_LOCK1_APV+0x40 #3 0xffffffff80caf034 at _vn_lock+0x54 #4 0xffffffff80c910d7 at dounmount+0x67 #5 0xffffffff80c91019 at kern_unmount+0x2b9 #6 0xffffffff81066ad9 at amd64_syscall+0x159 #7 0xffffffff8103c5a0 at fast_syscall_common+0x101 nlink=2, effnlink=2, size=512, extsize 0 generation=a26eafda, uid=0, gid=0, flags=0x0 ino 42054144, on dev gpt/work vnode 0xfffff80107cf1780: type VDIR usecount 1, writecount 0, refcount 3 mountedhere 0xfffffe00e685fb80 flags (VMP_LAZYLIST) v_object 0xfffff807103d7b58 ref 0 pages 1 cleanbuf 1 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe013074b300 (pid 79033, umount, tid 102330) #0 0xffffffff80b92ec5 at lockmgr_lock_flags+0x1d5 #1 0xffffffff80ee0e3d at ffs_lock+0x6d #2 0xffffffff810e38b0 at VOP_LOCK1_APV+0x40 #3 0xffffffff80caf034 at _vn_lock+0x54 #4 0xffffffff80c910d7 at dounmount+0x67 #5 0xffffffff80c91019 at kern_unmount+0x2b9 #6 0xffffffff81066ad9 at amd64_syscall+0x159 #7 0xffffffff8103c5a0 at fast_syscall_common+0x101 nlink=2, effnlink=2, size=512, extsize 0 generation=94a1d6f, uid=0, gid=0, flags=0x0 ino 101684352, on dev gpt/work vnode 0xfffff805c916c500: type VDIR usecount 1, writecount 0, refcount 3 mountedhere 0xfffffe00e6861280 flags (VMP_LAZYLIST) v_object 0xfffff80636613420 ref 0 pages 1 cleanbuf 1 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe014a776000 (pid 79037, umount, tid 105588) #0 0xffffffff80b92ec5 at lockmgr_lock_flags+0x1d5 #1 0xffffffff80ee0e3d at ffs_lock+0x6d #2 0xffffffff810e38b0 at VOP_LOCK1_APV+0x40 #3 0xffffffff80caf034 at _vn_lock+0x54 #4 0xffffffff80c910d7 at dounmount+0x67 #5 0xffffffff80c91019 at kern_unmount+0x2b9 #6 0xffffffff81066ad9 at amd64_syscall+0x159 #7 0xffffffff8103c5a0 at fast_syscall_common+0x101 nlink=2, effnlink=2, size=512, extsize 0 generation=cca24d90, uid=0, gid=0, flags=0x0 ino 81780864, on dev gpt/work vnode 0xfffff8019602b500: type VDIR usecount 1, writecount 0, refcount 3 mountedhere 0xfffffe00e6854700 flags (VMP_LAZYLIST) v_object 0xfffff80287a71d68 ref 0 pages 1 cleanbuf 1 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe012d923a00 (pid 79021, umount, tid 103540) #0 0xffffffff80b92ec5 at lockmgr_lock_flags+0x1d5 #1 0xffffffff80ee0e3d at ffs_lock+0x6d #2 0xffffffff810e38b0 at VOP_LOCK1_APV+0x40 #3 0xffffffff80caf034 at _vn_lock+0x54 #4 0xffffffff80c910d7 at dounmount+0x67 #5 0xffffffff80c91019 at kern_unmount+0x2b9 #6 0xffffffff81066ad9 at amd64_syscall+0x159 #7 0xffffffff8103c5a0 at fast_syscall_common+0x101 nlink=2, effnlink=2, size=512, extsize 0 generation=65bc786a, uid=0, gid=0, flags=0x0 ino 81861120, on dev gpt/work vnode 0xfffff80276c0ca00: type VDIR usecount 1, writecount 0, refcount 3 mountedhere 0xfffffe00e6846280 flags (VMP_LAZYLIST) v_object 0xfffff8006ea14a50 ref 0 pages 1 cleanbuf 1 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe012be88a00 (pid 79036, umount, tid 106191) #0 0xffffffff80b92ec5 at lockmgr_lock_flags+0x1d5 #1 0xffffffff80ee0e3d at ffs_lock+0x6d #2 0xffffffff810e38b0 at VOP_LOCK1_APV+0x40 #3 0xffffffff80caf034 at _vn_lock+0x54 #4 0xffffffff80c910d7 at dounmount+0x67 #5 0xffffffff80c91019 at kern_unmount+0x2b9 #6 0xffffffff81066ad9 at amd64_syscall+0x159 #7 0xffffffff8103c5a0 at fast_syscall_common+0x101 nlink=2, effnlink=2, size=512, extsize 0 generation=776447ab, uid=0, gid=0, flags=0x0 ino 73755264, on dev gpt/work vnode 0xfffff80441717500: type VDIR usecount 1, writecount 0, refcount 3 mountedhere 0xfffffe00e685a700 flags (VMP_LAZYLIST) v_object 0xfffff8064f9d2420 ref 0 pages 1 cleanbuf 1 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe015a146c00 (pid 79032, umount, tid 104227) #0 0xffffffff80b92ec5 at lockmgr_lock_flags+0x1d5 #1 0xffffffff80ee0e3d at ffs_lock+0x6d #2 0xffffffff810e38b0 at VOP_LOCK1_APV+0x40 #3 0xffffffff80caf034 at _vn_lock+0x54 #4 0xffffffff80c910d7 at dounmount+0x67 #5 0xffffffff80c91019 at kern_unmount+0x2b9 #6 0xffffffff81066ad9 at amd64_syscall+0x159 #7 0xffffffff8103c5a0 at fast_syscall_common+0x101 nlink=2, effnlink=2, size=512, extsize 0 generation=eba80872, uid=0, gid=0, flags=0x0 ino 722304, on dev gpt/work vnode 0xfffff803444bc280: type VDIR usecount 0, writecount 0, refcount 2 mountedhere 0 flags (VIRF_DOOMED) v_object 0xfffff80749cb9420 ref 0 pages 0 cleanbuf 1 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe014a776000 (pid 79037, umount, tid 105588) #0 0xffffffff80b92ec5 at lockmgr_lock_flags+0x1d5 #1 0xffffffff80ee0e3d at ffs_lock+0x6d #2 0xffffffff810e38b0 at VOP_LOCK1_APV+0x40 #3 0xffffffff80caf034 at _vn_lock+0x54 #4 0xffffffff80c9ada0 at vflush+0xd0 #5 0xffffffff80edc415 at ffs_flushfiles+0x175 #6 0xffffffff80edec4a at ffs_unmount+0xea #7 0xffffffff80c91493 at dounmount+0x423 #8 0xffffffff80c91019 at kern_unmount+0x2b9 #9 0xffffffff81066ad9 at amd64_syscall+0x159 #10 0xffffffff8103c5a0 at fast_syscall_common+0x101 nlink=20, effnlink=20, size=5632, extsize 0 generation=4babb5cc, uid=2007, gid=0, flags=0x0 ino 80000, on dev md16a vnode 0xfffff8075670aa00: type VDIR usecount 0, writecount 0, refcount 3 mountedhere 0 flags (VIRF_DOOMED|VV_ROOT) v_object 0xfffff805a85bc528 ref 0 pages 1 cleanbuf 1 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe013074b300 (pid 79033, umount, tid 102330) #0 0xffffffff80b92ec5 at lockmgr_lock_flags+0x1d5 #1 0xffffffff80ee0e3d at ffs_lock+0x6d #2 0xffffffff810e38b0 at VOP_LOCK1_APV+0x40 #3 0xffffffff80caf034 at _vn_lock+0x54 #4 0xffffffff80c9ada0 at vflush+0xd0 #5 0xffffffff80edc415 at ffs_flushfiles+0x175 #6 0xffffffff80edec4a at ffs_unmount+0xea #7 0xffffffff80c91493 at dounmount+0x423 #8 0xffffffff80c91019 at kern_unmount+0x2b9 #9 0xffffffff81066ad9 at amd64_syscall+0x159 #10 0xffffffff8103c5a0 at fast_syscall_common+0x101 nlink=4, effnlink=4, size=512, extsize 0 generation=252733f8, uid=0, gid=0, flags=0x0 ino 2, on dev md14a vnode 0xfffff8024aa9f280: type VDIR usecount 0, writecount 0, refcount 3 mountedhere 0 flags (VIRF_DOOMED|VV_ROOT) v_object 0xfffff80069c7d840 ref 0 pages 1 cleanbuf 1 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe015a146c00 (pid 79032, umount, tid 104227) #0 0xffffffff80b92ec5 at lockmgr_lock_flags+0x1d5 #1 0xffffffff80ee0e3d at ffs_lock+0x6d #2 0xffffffff810e38b0 at VOP_LOCK1_APV+0x40 #3 0xffffffff80caf034 at _vn_lock+0x54 #4 0xffffffff80c9ada0 at vflush+0xd0 #5 0xffffffff80edc415 at ffs_flushfiles+0x175 #6 0xffffffff80edec4a at ffs_unmount+0xea #7 0xffffffff80c91493 at dounmount+0x423 #8 0xffffffff80c91019 at kern_unmount+0x2b9 #9 0xffffffff81066ad9 at amd64_syscall+0x159 #10 0xffffffff8103c5a0 at fast_syscall_common+0x101 nlink=4, effnlink=4, size=512, extsize 0 generation=729a4170, uid=0, gid=0, flags=0x0 ino 2, on dev md20a vnode 0xfffff8062a02b000: type VDIR usecount 0, writecount 0, refcount 1 mountedhere 0 flags (VIRF_DOOMED) v_object 0xfffff80710680948 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe012be88a00 (pid 79036, umount, tid 106191) #0 0xffffffff80b92ec5 at lockmgr_lock_flags+0x1d5 #1 0xffffffff80ee0e3d at ffs_lock+0x6d #2 0xffffffff810e38b0 at VOP_LOCK1_APV+0x40 #3 0xffffffff80caf034 at _vn_lock+0x54 #4 0xffffffff80c9ada0 at vflush+0xd0 #5 0xffffffff80edc415 at ffs_flushfiles+0x175 #6 0xffffffff80edec4a at ffs_unmount+0xea #7 0xffffffff80c91493 at dounmount+0x423 #8 0xffffffff80c91019 at kern_unmount+0x2b9 #9 0xffffffff81066ad9 at amd64_syscall+0x159 #10 0xffffffff8103c5a0 at fast_syscall_common+0x101 nlink=3, effnlink=3, size=512, extsize 0 generation=1af4e742, uid=2007, gid=0, flags=0x0 ino 80574, on dev md18a vnode 0xfffff805c9484000: type VDIR usecount 0, writecount 0, refcount 3 mountedhere 0 flags (VIRF_DOOMED) v_object 0xfffff80287322e70 ref 0 pages 1 cleanbuf 1 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe0169939800 (pid 79025, umount, tid 102950) #0 0xffffffff80b92ec5 at lockmgr_lock_flags+0x1d5 #1 0xffffffff80ee0e3d at ffs_lock+0x6d #2 0xffffffff810e38b0 at VOP_LOCK1_APV+0x40 #3 0xffffffff80caf034 at _vn_lock+0x54 #4 0xffffffff80c9ada0 at vflush+0xd0 #5 0xffffffff80edc415 at ffs_flushfiles+0x175 #6 0xffffffff80edec4a at ffs_unmount+0xea #7 0xffffffff80c91493 at dounmount+0x423 #8 0xffffffff80c91019 at kern_unmount+0x2b9 #9 0xffffffff81066ad9 at amd64_syscall+0x159 #10 0xffffffff8103c5a0 at fast_syscall_common+0x101 nlink=2, effnlink=2, size=512, extsize 0 generation=152d5aa2, uid=2007, gid=0, flags=0x0 ino 240050, on dev md13a vnode 0xfffff8024ff3ea00: type VDIR usecount 0, writecount 0, refcount 2 mountedhere 0 flags (VIRF_DOOMED) v_object 0xfffff80352f57e70 ref 0 pages 0 cleanbuf 1 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe015a32e500 (pid 79027, umount, tid 103199) #0 0xffffffff80b92ec5 at lockmgr_lock_flags+0x1d5 #1 0xffffffff80ee0e3d at ffs_lock+0x6d #2 0xffffffff810e38b0 at VOP_LOCK1_APV+0x40 #3 0xffffffff80caf034 at _vn_lock+0x54 #4 0xffffffff80c9ada0 at vflush+0xd0 #5 0xffffffff80edc415 at ffs_flushfiles+0x175 #6 0xffffffff80edec4a at ffs_unmount+0xea #7 0xffffffff80c91493 at dounmount+0x423 #8 0xffffffff80c91019 at kern_unmount+0x2b9 #9 0xffffffff81066ad9 at amd64_syscall+0x159 #10 0xffffffff8103c5a0 at fast_syscall_common+0x101 nlink=3, effnlink=3, size=512, extsize 0 generation=3488cfd9, uid=2007, gid=0, flags=0x0 ino 80026, on dev md10a vnode 0xfffff800216c6280: type VDIR usecount 0, writecount 0, refcount 2 mountedhere 0 flags (VIRF_DOOMED) v_object 0xfffff8006ff64e70 ref 0 pages 0 cleanbuf 1 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe012d923a00 (pid 79021, umount, tid 103540) #0 0xffffffff80b92ec5 at lockmgr_lock_flags+0x1d5 #1 0xffffffff80ee0e3d at ffs_lock+0x6d #2 0xffffffff810e38b0 at VOP_LOCK1_APV+0x40 #3 0xffffffff80caf034 at _vn_lock+0x54 #4 0xffffffff80c9ada0 at vflush+0xd0 #5 0xffffffff80edc415 at ffs_flushfiles+0x175 #6 0xffffffff80edec4a at ffs_unmount+0xea #7 0xffffffff80c91493 at dounmount+0x423 #8 0xffffffff80c91019 at kern_unmount+0x2b9 #9 0xffffffff81066ad9 at amd64_syscall+0x159 #10 0xffffffff8103c5a0 at fast_syscall_common+0x101 nlink=3, effnlink=3, size=512, extsize 0 generation=c982f2b, uid=2007, gid=0, flags=0x0 ino 320056, on dev md17a db:1:pho1> show mount 0xfffffe00d35dc700 /dev/gpt/work on / (ufs) 0xfffffe00d35dd280 devfs on /dev (devfs) 0xfffffe00e44ac280 /dev/gpt/tmp on /tmp (ufs) 0xfffffe00e44a4700 procfs on /proc (procfs) 0xfffffe00e6861280 /dev/md16a on /mnt16 (ufs) 0xfffffe00e684e700 /dev/md12a on /mnt12 (ufs) 0xfffffe00e685fb80 /dev/md14a on /mnt14 (ufs) 0xfffffe00e685a700 /dev/md20a on /mnt20 (ufs) 0xfffffe00e6846280 /dev/md18a on /mnt18 (ufs) 0xfffffe00e6871000 /dev/md13a on /mnt13 (ufs) 0xfffffe00e6873280 /dev/md10a on /mnt10 (ufs) 0xfffffe00e6854700 /dev/md17a on /mnt17 (ufs) More info: show mount db:1:pho1> show bufqueues bqempty: 101708 Buf domain 0 freebufs 14880 lofreebufs 219 hifreebufs 329 bufspace 3428352 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 20 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 125 (2248704) dirtyq count 20 (655360) wakeup 0 lim 25 CPU 13, 9, 4, 11, 10, 10, 11, 8, 7, 5, 14, 6, Locked buffers: 0 space 0 Total buffers: 11478 space 3428352 Buf domain 1 freebufs 14387 lofreebufs 219 hifreebufs 329 bufspace 21237760 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 51 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 607 (19140608) dirtyq count 51 (1642496) wakeup 0 lim 25 CPU 9, 4, 0, 12, 6, 9, 9, 9, 8, 8, 7, 7, Locked buffers: 0 space 0 Total buffers: 19069 space 21237760 Buf domain 2 freebufs 13585 lofreebufs 219 hifreebufs 329 bufspace 47464448 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 19 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 1428 (46399488) dirtyq count 19 (622592) wakeup 0 lim 25 CPU 7, 13, 5, 9, 9, 11, 8, 4, 10, 6, 10, 9, Locked buffers: 1 space 4096 Total buffers: 16257 space 47464448 Buf domain 3 freebufs 14858 lofreebufs 219 hifreebufs 329 bufspace 3436544 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 15 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 160 (2506752) dirtyq count 15 (491520) wakeup 0 lim 25 CPU 9, 8, 10, 0, 7, 10, 7, 7, 11, 11, 11, 9, Locked buffers: 2 space 12288 Total buffers: 12185 space 3436544 Buf domain 4 freebufs 15024 lofreebufs 219 hifreebufs 329 bufspace 655360 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 1 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 15 (217088) dirtyq count 1 (32768) wakeup 0 lim 25 CPU 7, 8, 6, 9, 11, 6, 6, 9, 9, 7, 5, 10, Locked buffers: 0 space 0 Total buffers: 13849 space 655360 Buf domain 5 freebufs 14851 lofreebufs 219 hifreebufs 329 bufspace 5918720 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 1 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 176 (5419008) dirtyq count 1 (32768) wakeup 0 lim 25 CPU 8, 10, 9, 8, 10, 5, 8, 11, 8, 16, 8, 4, Locked buffers: 1 space 4096 Total buffers: 12712 space 5918720 Buf domain 6 freebufs 14830 lofreebufs 219 hifreebufs 329 bufspace 6283264 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 63 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 144 (3760128) dirtyq count 63 (2064384) wakeup 0 lim 25 CPU 7, 6, 0, 7, 9, 8, 7, 10, 11, 3, 11, 17, Locked buffers: 2 space 8192 Total buffers: 20381 space 6283264 db:1:pho1> show page vm_cnt.v_free_count: 7595791 vm_cnt.v_inactive_count: 774 vm_cnt.v_active_count: 31603 vm_cnt.v_laundry_count: 50 vm_cnt.v_wire_count: 491261 vm_cnt.v_free_reserved: 10644 vm_cnt.v_free_min: 51264 vm_cnt.v_free_target: 173124 vm_cnt.v_inactive_target: 259686 db:1:pho1> show pageq pq_free 7595791 dom 0 page_cnt 8124099 free 7595791 pq_act 31603 pq_inact 774 pq_laund 50 pq_unsw 0 db:0:pho> show freepages DOMAIN: 0 FREE LIST 0: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000110 | 000043 11 (008192K) | 000578 | 000037 10 (004096K) | 001236 | 000120 09 (002048K) | 001520 | 000321 08 (001024K) | 002493 | 000459 07 (000512K) | 004434 | 000890 06 (000256K) | 007233 | 001399 05 (000128K) | 010094 | 002197 04 (000064K) | 015095 | 003113 03 (000032K) | 026007 | 004791 02 (000016K) | 043169 | 006463 01 (000008K) | 031665 | 008739 00 (000004K) | 038023 | 009764 FREE LIST 1: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000000 | 000000 09 (002048K) | 000000 | 000000 08 (001024K) | 000000 | 000000 07 (000512K) | 000000 | 000000 06 (000256K) | 000001 | 000000 05 (000128K) | 000001 | 000000 04 (000064K) | 000002 | 000000 03 (000032K) | 000000 | 000000 02 (000016K) | 000001 | 000000 01 (000008K) | 000000 | 000000 00 (000004K) | 000001 | 000000 db:0:pho> show uma Zone Size Used Free Requests Sleeps Bucket Total Mem XFree socket 904 56 939778 6927897 0 16 849609936 0 VM OBJECT 264 8287 563018 193424350 0 30 150824520 0 THREAD 1792 5229 41355 31831203 0 8 83478528 0 Files 80 193 941557 283572656 0 126 75340000 0 mbuf_cluster 2048 14964 40 2151631 0 8 30728192 0 RADIX NODE 144 32287 137076 251986994 0 62 24388272 0 swblk 136 1764 127402 1233809 0 62 17566576 0 BUF TRIE 144 506 105446 35715020 0 62 15257088 0 128 128 93204 1160 20235034 0 126 12078592 0 VMSPACE 2536 89 4078 14561206 0 4 10567512 0 vmem btag 56 131254 54493 2440250 0 254 10401832 0 128 128 78159 1883 425729856 0 126 10245376 0 128 128 66616 1522 2715300 0 126 8721664 0 S VFS Cache 108 12447 57861 57512649 0 126 7593264 0 PROC 1320 139 4961 14366526 0 8 6732000 0 TURNSTILE 136 46585 497 46585 0 62 6403152 0 128 128 405 46064 39683758 0 126 5948032 0 mbuf 256 16484 3726 363693194 0 254 5173760 0 fakepg 104 0 48711 3349929 0 126 5065944 0 SLEEPQUEUE 88 46585 295 46585 0 126 4125440 0 128 128 505 29286 20296061 0 126 3813248 0 4096 4096 505 318 17000176 0 2 3371008 0 UMA Slabs 0 112 11975 15964 617258 0 126 3129168 0 512 512 5229 859 14157717 0 30 3117056 0 256 256 527 11053 15006650 0 62 2964480 0 16 16 176875 3125 7703130 0 254 2880000 0 256 256 138 10992 31046844 0 62 2849280 0 32 32 77577 3063 28541265 0 254 2580480 0 VNODE 640 1624 1544 107397051 0 16 2027520 0 128 128 14375 1156 12833065 0 126 1987968 0 512 512 22 3794 18297503 0 30 1953792 0 256 256 6 7224 24511829 0 62 1850880 0 64 64 149 24484 3893860 0 254 1576512 0 MAP ENTRY 96 3204 12546 747781409 0 126 1512000 0 swpctrie 144 261 9987 93956 0 62 1475712 0 128 Bucket 1024 375 924 7367395 0 16 1330176 0 FFS2 dinode 256 1573 3302 35524578 0 62 1248000 0 256 Bucket 2048 490 116 5787493 0 8 1241088 0 256 256 26 4249 1745016 0 62 1094400 0 128 128 86 8408 2740884 0 126 1087232 0 32768 32768 12 20 43579 0 1 1048576 0 FFS inode 160 1573 4802 35527866 0 62 1020000 0 64 Bucket 512 413 1467 9399505 0 30 962560 0 16384 16384 50 4 59418 0 1 884736 0 pbuf 984 0 792 0 0 0 779328 0 ksiginfo 112 5074 1766 1789667 0 126 766080 0 256 256 745 2240 81537920 0 62 764160 0 64 64 8871 3036 220884349 0 254 762048 0 32768 32768 0 23 611247 0 1 753664 0 8192 8192 86 0 103 0 1 704512 0 mbuf_packet 256 27 2653 46093773 0 254 686080 0 filedesc0 1088 139 463 14366527 0 8 654976 0 128 128 112 4724 2126444 0 126 619008 0 64 64 9297 342 17148 0 254 616896 0 64 64 6804 2834 345695366 0 254 616832 0 65536 65536 0 9 174922 0 1 589824 0 DIRHASH 1024 75 461 240569 0 16 548864 0 65536 65536 3 5 3384 0 1 524288 0 8192 8192 34 26 456482 0 1 491520 0 32 Bucket 256 285 1589 11374151 0 62 479744 0 65536 65536 6 1 45 0 1 458752 0 NAMEI 1024 0 416 633465829 0 16 425984 0 1024 1024 258 138 4828397 0 16 405504 0 32768 32768 12 0 34 0 1 393216 0 32768 32768 12 0 136402 0 1 393216 0 8192 8192 25 23 848226 0 1 393216 0 256 256 322 1073 60516674 0 62 357120 0 Mountpoints 2944 13 107 59837 0 4 353280 0 2048 2048 146 10 340 0 8 319488 0 4096 4096 70 0 2562 0 2 286720 0 16 Bucket 144 464 1327 11788084 0 62 257904 0 selfd 64 1060 2846 151266400 0 254 249984 0 rl_entry 40 5098 1063 5098 0 254 246440 0 16384 16384 14 1 2486618 0 1 245760 0 2048 2048 4 112 3776143 0 8 237568 0 1024 1024 1 223 9724484 0 16 229376 0 64 64 295 3233 31637661 0 254 225792 0 64 64 288 3051 1164002 0 254 213696 0 512 512 53 363 3232612 0 30 212992 0 g_bio 408 0 520 161845275 0 30 212160 0 1024 1024 40 160 2598015 0 16 204800 0 2048 2048 1 97 175649 0 8 200704 0 1024 1024 2 194 201110 0 16 200704 0 UMA Zones 2048 93 4 355 0 8 198656 0 4 Bucket 48 293 3823 1176034 0 254 197568 0 65536 65536 3 0 4 0 1 196608 0 65536 65536 3 0 3 0 1 196608 0 4096 4096 12 36 2052557 0 2 196608 0 64 64 94 2867 1150379 0 254 189504 0 256 256 110 625 21805 0 62 188160 0 256 256 36 699 1999745 0 62 188160 0 pipe 760 10 235 20050468 0 16 186200 0 1024 1024 18 154 260831 0 16 176128 0 PWD 32 19 5273 52771959 0 254 169344 0 1024 1024 30 130 3650800 0 16 163840 0 512 512 0 320 1980172 0 30 163840 0 8 Bucket 80 467 1533 12145202 0 126 160000 0 8192 8192 19 0 3160 0 1 155648 0 AIOCB 752 0 195 508 0 16 146640 0 udp_inpcb 488 20 276 71202 0 30 144448 0 512 512 181 99 1852808 0 30 143360 0 65536 65536 2 0 7 0 1 131072 0 4096 4096 1 31 82507 0 2 131072 0 AIO 208 0 627 406 0 62 130416 0 2 Bucket 32 379 3653 10570421 0 254 129024 0 KNOTE 160 7 693 67166482 0 62 112000 0 32 32 235 3041 536934 0 254 104832 0 unpcb 256 23 382 6516079 0 62 103680 0 32 32 149 3001 2010295 0 254 100800 0 32 32 74 3076 146025 0 254 100800 0 32 32 304 2846 75582002 0 254 100800 0 32768 32768 3 0 18425 0 1 98304 0 ttyinq 160 345 205 23340646 0 62 88000 0 4096 4096 1 20 28370 0 2 86016 0 16384 16384 5 0 6 0 1 81920 0 ttyoutq 256 174 126 12448339 0 62 76800 0 rentr 24 0 3173 12165029 0 254 76152 0 65536 65536 1 0 1 0 1 65536 0 4096 4096 16 0 975 0 2 65536 0 udpcb 32 20 1870 71202 0 254 60480 0 4096 4096 14 0 25 0 2 57344 0 16 16 483 3017 21455324 0 254 56000 0 mt_stats_zone 64 445 387 458 0 254 53248 0 16384 16384 3 0 154568 0 1 49152 0 cpuset 104 27 438 144 0 126 48360 0 KMAP ENTRY 96 69 432 117 0 126 48096 0 16 16 79 2921 1020777 0 254 48000 0 64 pcpu 8 3415 2217 4986 0 254 45056 0 64 64 35 658 2843868 0 254 44352 0 32 32 50 1336 357575 0 254 44352 0 1024 1024 7 33 20200 0 16 40960 0 32 32 534 726 108248 0 254 40320 0 mt_zone 24 445 1058 458 0 254 36072 0 16 16 124 2126 8173942 0 254 36000 0 L VFS Cache 328 29 79 32258 0 30 35424 0 32768 32768 1 0 1 0 1 32768 0 16384 16384 2 0 77 0 1 32768 0 8192 8192 4 0 6 0 1 32768 0 UMA Kegs 384 82 2 344 0 30 32256 0 16 16 254 1746 3288 0 254 32000 0 rtentry 208 12 140 18 0 62 31616 0 512 512 21 35 831 0 30 28672 0 512 512 11 45 30272 0 30 28672 0 AIOP 32 4 878 4 0 254 28224 0 32 32 33 849 12886902 0 254 28224 0 procdesc 136 3 200 1365870 0 62 27608 0 2048 2048 8 4 23015926 0 8 24576 0 16 16 27 1473 145722 0 254 24000 0 tcpcb 1008 10 10 107885 0 16 20160 0 16 16 40 1210 110224160 0 254 20000 0 16 16 468 782 901192 0 254 20000 0 swrbuf 984 0 20 84725 0 2 19680 0 tcp_inpcb 488 10 30 107885 0 30 19520 0 8192 8192 2 0 2093 0 1 16384 0 8192 8192 2 0 2 0 1 16384 0 2048 2048 5 3 9962206 0 8 16384 0 512 512 15 17 30 0 30 16384 0 MAP 216 2 69 2 0 62 15336 0 1024 1024 9 3 51 0 16 12288 0 int pcpu 4 482 2590 41244 0 254 12288 0 2048 2048 2 2 506 0 8 8192 0 VNODEPOLL 120 4 62 278 0 126 7920 0 epoch_record pcpu 256 4 12 4 0 62 4096 0 4096 4096 1 0 13 0 2 4096 0 2048 2048 2 0 8589 0 8 4096 0 2048 2048 2 0 5636 0 8 4096 0 ripcb 488 1 7 84126 0 30 3904 0 mqnode 416 3 6 3 0 30 3744 0 vmem 1856 1 1 1 0 8 3712 0 UMA Slabs 1 176 14 6 17 0 62 3520 0 SMR CPU 32 1 62 1 0 254 2016 0 SMR SHARED 24 1 62 1 0 254 1512 0 mqnotifier 216 0 0 0 0 62 0 0 mvdata 64 0 0 0 0 254 0 0 mqueue 264 0 0 0 0 30 0 0 taskq_zone 48 0 0 0 0 254 0 0 dtrace_state_cache 16384 0 0 1 0 1 0 0 TMPFS node 232 0 0 64672569 0 62 0 0 TMPFS dirent 64 0 0 88969955 0 254 0 0 FFS1 dinode 128 0 0 11 0 126 0 0 udplite_inpcb 488 0 0 0 0 30 0 0 sctp_asconf_ack 48 0 0 0 0 254 0 0 sctp_asconf 40 0 0 0 0 254 0 0 sctp_stream_msg_out 112 0 0 0 0 126 0 0 sctp_readq 152 0 0 0 0 62 0 0 sctp_chunk 152 0 0 0 0 62 0 0 sctp_raddr 736 0 0 0 0 16 0 0 sctp_laddr 48 0 0 6 0 254 0 0 sctp_asoc 2288 0 0 0 0 4 0 0 sctp_ep 1280 0 0 70167 0 8 0 0 tcp_log_node 120 0 0 0 0 126 0 0 tcp_log_bucket 184 0 0 0 0 62 0 0 tcp_log 408 0 0 0 0 30 0 0 tcpreass 48 0 0 18615 0 254 0 0 tfo_ccache_entries 80 0 0 0 0 126 0 0 tfo 4 0 0 0 0 254 0 0 sackhole 32 0 0 24036 0 254 0 0 hostcache 96 0 0 1 0 126 0 0 syncache 168 0 0 10199 0 62 0 0 tcptw 88 0 0 1366 0 126 0 0 ipq 56 0 0 0 0 254 0 0 IPsec SA lft_c 16 0 0 0 0 254 0 0 itimer 352 0 0 1 0 30 0 0 AIOLIO 280 0 0 0 0 30 0 0 NCLNODE 744 0 0 0 0 16 0 0 LTS VFS Cache 368 0 0 0 0 30 0 0 STS VFS Cache 148 0 0 0 0 62 0 0 vtnet_tx_hdr 24 0 0 0 0 254 0 0 crypto_session 72 0 0 0 0 126 0 0 cryptop 240 0 0 0 0 62 0 0 nvme_request 128 0 0 0 0 126 0 0 FPU_save_area 832 0 0 0 0 16 0 0 DMAR_MAP_ENTRY 128 0 0 0 0 126 0 0 mbuf_extpgs 256 0 0 0 0 62 0 0 mbuf_jumbo_16k 16384 0 0 0 0 1 0 0 mbuf_jumbo_9k 9216 0 0 0 0 1 0 0 mbuf_jumbo_page 4096 0 0 14125409 0 2 0 0 audit_record 1280 0 0 0 0 8 0 0 domainset 40 0 0 37 0 254 0 0 MAC labels 40 0 0 0 0 254 0 0 clpbuf 984 0 0 5421156 0 2 0 0 vnpbuf 984 0 0 2484 0 8 0 0 mdpbuf 984 0 0 239414 0 0 0 0 nfspbuf 984 0 0 0 0 2 0 0 swwbuf 984 0 0 661616 0 0 0 0 umtx_shm 88 0 0 35 0 126 0 0 umtx pi 96 0 0 57135731 0 126 0 0 rangeset pctrie nodes 144 0 0 0 0 62 0 0 65536 65536 0 0 12 0 1 0 0 32768 32768 0 0 0 0 1 0 0 32768 32768 0 0 0 0 1 0 0 16384 16384 0 0 0 0 1 0 0 16384 16384 0 0 0 0 1 0 0 16384 16384 0 0 0 0 1 0 0 8192 8192 0 0 0 0 1 0 0 UMA Hash 256 0 0 0 0 62 0 0 db:0:pho> show umacache Zone Size Used Free Requests Bucket debugnet_mbuf_packet 2048 0 0 0 0 debugnet_mbuf_cluster 2048 -6144 0 0 0 debugnet_mbuf 256 -10240 0 0 0 kstack_cache 16384 5102 9 31831074 1 vm pgcache 4096 118609 2134 312972170 7 vm pgcache 4096 133139 2174 745841336 16 buf free cache 984 3516 707 44685021 16 buffer arena-65 65536 0 0 127 1 buffer arena-61 61440 0 0 0 1 buffer arena-57 57344 0 0 0 1 buffer arena-53 53248 0 0 0 1 buffer arena-49 49152 0 0 0 1 buffer arena-45 45056 0 0 0 1 buffer arena-40 40960 0 0 0 1 buffer arena-36 36864 0 0 0 1 buffer arena-32 32768 1301 582 12263494 4 buffer arena-28 28672 0 0 0 1 buffer arena-24 24576 0 0 0 1 buffer arena-20 20480 0 0 0 1 buffer arena-16 16384 19 27 3807284 1 buffer arena-12 12288 0 0 0 1 buffer arena-81 8192 0 0 0 1 buffer arena-40 4096 0 0 41 2 db:0:pho> acttrace Tracing command umount pid 79038 tid 102386 td 0xfffffe00e784b000 (CPU 11) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1f5e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1f5e10 trap() at trap+0x56/frame 0xfffffe003e1f5f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1f5f20 --- trap 0x13, rip = 0xffffffff80c0c160, rsp = 0xfffffe00e70a2760, rbp = 0xfffffe00e70a2770 --- lock_delay() at lock_delay+0x30/frame 0xfffffe00e70a2770 _mtx_lock_spin_cookie() at _mtx_lock_spin_cookie+0xc1/frame 0xfffffe00e70a27e0 __mtx_lock_spin_flags() at __mtx_lock_spin_flags+0xd5/frame 0xfffffe00e70a2820 smp_rendezvous_cpus() at smp_rendezvous_cpus+0xb8/frame 0xfffffe00e70a2870 smp_rendezvous_cpus_retry() at smp_rendezvous_cpus_retry+0x68/frame 0xfffffe00e70a28d0 vfs_op_enter() at vfs_op_enter+0xae/frame 0xfffffe00e70a2940 dounmount() at dounmount+0xf3/frame 0xfffffe00e70a29a0 kern_unmount() at kern_unmount+0x2b9/frame 0xfffffe00e70a2ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e70a2bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e70a2bf0 --- syscall (22, FreeBSD ELF64, sys_unmount), rip = 0x8002e1eda, rsp = 0x7fffffffd268, rbp = 0x7fffffffd7a0 --- Tracing command umount pid 79037 tid 105588 td 0xfffffe014a776000 (CPU 3) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e195e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e195e10 trap() at trap+0x56/frame 0xfffffe003e195f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e195f20 --- trap 0x13, rip = 0xffffffff80c0c162, rsp = 0xfffffe035d0f4370, rbp = 0xfffffe035d0f4380 --- lock_delay() at lock_delay+0x32/frame 0xfffffe035d0f4380 _mtx_lock_spin_cookie() at _mtx_lock_spin_cookie+0xc1/frame 0xfffffe035d0f43f0 __mtx_lock_spin_flags() at __mtx_lock_spin_flags+0xd5/frame 0xfffffe035d0f4430 smp_targeted_tlb_shootdown() at smp_targeted_tlb_shootdown+0xbf/frame 0xfffffe035d0f44a0 pmap_invalidate_range() at pmap_invalidate_range+0x1b8/frame 0xfffffe035d0f4510 allocbuf() at allocbuf+0xfd/frame 0xfffffe035d0f4570 brelse() at brelse+0x1c1/frame 0xfffffe035d0f45d0 flushbuflist() at flushbuflist+0x166/frame 0xfffffe035d0f4650 bufobj_invalbuf() at bufobj_invalbuf+0x8b/frame 0xfffffe035d0f46b0 vgonel() at vgonel+0x2be/frame 0xfffffe035d0f4710 vflush() at vflush+0x303/frame 0xfffffe035d0f4850 ffs_flushfiles() at ffs_flushfiles+0x175/frame 0xfffffe035d0f48c0 ffs_unmount() at ffs_unmount+0xea/frame 0xfffffe035d0f4940 dounmount() at dounmount+0x423/frame 0xfffffe035d0f49a0 kern_unmount() at kern_unmount+0x2b9/frame 0xfffffe035d0f4ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe035d0f4bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe035d0f4bf0 --- syscall (22, FreeBSD ELF64, sys_unmount), rip = 0x8002e1eda, rsp = 0x7fffffffd268, rbp = 0x7fffffffd7a0 --- Tracing command umount pid 79036 tid 106191 td 0xfffffe012be88a00 (CPU 7) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1c5e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1c5e10 trap() at trap+0x56/frame 0xfffffe003e1c5f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1c5f20 --- trap 0x13, rip = 0xffffffff80bdf102, rsp = 0xfffffe0366cc7660, rbp = 0xfffffe0366cc7680 --- umtx_shm_object_terminated() at umtx_shm_object_terminated+0x12/frame 0xfffffe0366cc7680 vnode_destroy_vobject() at vnode_destroy_vobject+0x67/frame 0xfffffe0366cc76b0 vgonel() at vgonel+0x37a/frame 0xfffffe0366cc7710 vflush() at vflush+0x303/frame 0xfffffe0366cc7850 ffs_flushfiles() at ffs_flushfiles+0x175/frame 0xfffffe0366cc78c0 ffs_unmount() at ffs_unmount+0xea/frame 0xfffffe0366cc7940 dounmount() at dounmount+0x423/frame 0xfffffe0366cc79a0 kern_unmount() at kern_unmount+0x2b9/frame 0xfffffe0366cc7ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe0366cc7bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0366cc7bf0 --- syscall (22, FreeBSD ELF64, sys_unmount), rip = 0x8002e1eda, rsp = 0x7fffffffd268, rbp = 0x7fffffffd7a0 --- Tracing command umount pid 79033 tid 102330 td 0xfffffe013074b300 (CPU 4) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1a1e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1a1e10 trap() at trap+0x56/frame 0xfffffe003e1a1f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1a1f20 --- trap 0x13, rip = 0xffffffff80c0c162, rsp = 0xfffffe0130881370, rbp = 0xfffffe0130881380 --- lock_delay() at lock_delay+0x32/frame 0xfffffe0130881380 _mtx_lock_spin_cookie() at _mtx_lock_spin_cookie+0xc1/frame 0xfffffe01308813f0 __mtx_lock_spin_flags() at __mtx_lock_spin_flags+0xd5/frame 0xfffffe0130881430 smp_targeted_tlb_shootdown() at smp_targeted_tlb_shootdown+0xbf/frame 0xfffffe01308814a0 pmap_invalidate_range() at pmap_invalidate_range+0x1b8/frame 0xfffffe0130881510 allocbuf() at allocbuf+0x1fe/frame 0xfffffe0130881570 brelse() at brelse+0x3d7/frame 0xfffffe01308815d0 flushbuflist() at flushbuflist+0x166/frame 0xfffffe0130881650 bufobj_invalbuf() at bufobj_invalbuf+0x8b/frame 0xfffffe01308816b0 vgonel() at vgonel+0x2be/frame 0xfffffe0130881710 vflush() at vflush+0x303/frame 0xfffffe0130881850 ffs_flushfiles() at ffs_flushfiles+0x175/frame 0xfffffe01308818c0 ffs_unmount() at ffs_unmount+0xea/frame 0xfffffe0130881940 dounmount() at dounmount+0x423/frame 0xfffffe01308819a0 kern_unmount() at kern_unmount+0x2b9/frame 0xfffffe0130881ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe0130881bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0130881bf0 --- syscall (22, FreeBSD ELF64, sys_unmount), rip = 0x8002e1eda, rsp = 0x7fffffffd268, rbp = 0x7fffffffd7a0 --- Tracing command umount pid 79032 tid 104227 td 0xfffffe015a146c00 (CPU 10) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1e9e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1e9e10 trap() at trap+0x56/frame 0xfffffe003e1e9f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1e9f20 --- trap 0x13, rip = 0xffffffff80c0c160, rsp = 0xfffffe034164a370, rbp = 0xfffffe034164a380 --- lock_delay() at lock_delay+0x30/frame 0xfffffe034164a380 _mtx_lock_spin_cookie() at _mtx_lock_spin_cookie+0xc1/frame 0xfffffe034164a3f0 __mtx_lock_spin_flags() at __mtx_lock_spin_flags+0xd5/frame 0xfffffe034164a430 smp_targeted_tlb_shootdown() at smp_targeted_tlb_shootdown+0xbf/frame 0xfffffe034164a4a0 pmap_invalidate_range() at pmap_invalidate_range+0x1b8/frame 0xfffffe034164a510 allocbuf() at allocbuf+0x1fe/frame 0xfffffe034164a570 brelse() at brelse+0x3d7/frame 0xfffffe034164a5d0 flushbuflist() at flushbuflist+0x166/frame 0xfffffe034164a650 bufobj_invalbuf() at bufobj_invalbuf+0x8b/frame 0xfffffe034164a6b0 vgonel() at vgonel+0x2be/frame 0xfffffe034164a710 vflush() at vflush+0x303/frame 0xfffffe034164a850 ffs_flushfiles() at ffs_flushfiles+0x175/frame 0xfffffe034164a8c0 ffs_unmount() at ffs_unmount+0xea/frame 0xfffffe034164a940 dounmount() at dounmount+0x423/frame 0xfffffe034164a9a0 kern_unmount() at kern_unmount+0x2b9/frame 0xfffffe034164aad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe034164abf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe034164abf0 --- syscall (22, FreeBSD ELF64, sys_unmount), rip = 0x8002e1eda, rsp = 0x7fffffffd268, rbp = 0x7fffffffd7a0 --- Tracing command umount pid 79027 tid 103199 td 0xfffffe015a32e500 (CPU 9) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1dde00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1dde10 trap() at trap+0x56/frame 0xfffffe003e1ddf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1ddf20 --- trap 0x13, rip = 0xffffffff80c0c162, rsp = 0xfffffe033f422370, rbp = 0xfffffe033f422380 --- lock_delay() at lock_delay+0x32/frame 0xfffffe033f422380 _mtx_lock_spin_cookie() at _mtx_lock_spin_cookie+0xc1/frame 0xfffffe033f4223f0 __mtx_lock_spin_flags() at __mtx_lock_spin_flags+0xd5/frame 0xfffffe033f422430 smp_targeted_tlb_shootdown() at smp_targeted_tlb_shootdown+0xbf/frame 0xfffffe033f4224a0 pmap_invalidate_range() at pmap_invalidate_range+0x1b8/frame 0xfffffe033f422510 allocbuf() at allocbuf+0xfd/frame 0xfffffe033f422570 brelse() at brelse+0x1c1/frame 0xfffffe033f4225d0 flushbuflist() at flushbuflist+0x166/frame 0xfffffe033f422650 bufobj_invalbuf() at bufobj_invalbuf+0x8b/frame 0xfffffe033f4226b0 vgonel() at vgonel+0x2be/frame 0xfffffe033f422710 vflush() at vflush+0x303/frame 0xfffffe033f422850 ffs_flushfiles() at ffs_flushfiles+0x175/frame 0xfffffe033f4228c0 ffs_unmount() at ffs_unmount+0xea/frame 0xfffffe033f422940 dounmount() at dounmount+0x423/frame 0xfffffe033f4229a0 kern_unmount() at kern_unmount+0x2b9/frame 0xfffffe033f422ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe033f422bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe033f422bf0 --- syscall (22, FreeBSD ELF64, sys_unmount), rip = 0x8002e1eda, rsp = 0x7fffffffd268, rbp = 0x7fffffffd7a0 --- Tracing command umount pid 79025 tid 102950 td 0xfffffe0169939800 (CPU 8) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1d1e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1d1e10 trap() at trap+0x56/frame 0xfffffe003e1d1f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1d1f20 --- trap 0x13, rip = 0xffffffff80c0c162, rsp = 0xfffffe0342d44370, rbp = 0xfffffe0342d44380 --- lock_delay() at lock_delay+0x32/frame 0xfffffe0342d44380 _mtx_lock_spin_cookie() at _mtx_lock_spin_cookie+0xc1/frame 0xfffffe0342d443f0 __mtx_lock_spin_flags() at __mtx_lock_spin_flags+0xd5/frame 0xfffffe0342d44430 smp_targeted_tlb_shootdown() at smp_targeted_tlb_shootdown+0xbf/frame 0xfffffe0342d444a0 pmap_invalidate_range() at pmap_invalidate_range+0x1b8/frame 0xfffffe0342d44510 allocbuf() at allocbuf+0x1fe/frame 0xfffffe0342d44570 brelse() at brelse+0x3d7/frame 0xfffffe0342d445d0 flushbuflist() at flushbuflist+0x166/frame 0xfffffe0342d44650 bufobj_invalbuf() at bufobj_invalbuf+0x8b/frame 0xfffffe0342d446b0 vgonel() at vgonel+0x2be/frame 0xfffffe0342d44710 vflush() at vflush+0x303/frame 0xfffffe0342d44850 ffs_flushfiles() at ffs_flushfiles+0x175/frame 0xfffffe0342d448c0 ffs_unmount() at ffs_unmount+0xea/frame 0xfffffe0342d44940 dounmount() at dounmount+0x423/frame 0xfffffe0342d449a0 kern_unmount() at kern_unmount+0x2b9/frame 0xfffffe0342d44ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe0342d44bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0342d44bf0 --- syscall (22, FreeBSD ELF64, sys_unmount), rip = 0x8002e1eda, rsp = 0x7fffffffd268, rbp = 0x7fffffffd7a0 --- Tracing command umount pid 79021 tid 103540 td 0xfffffe012d923a00 (CPU 5) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1ade00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1ade10 trap() at trap+0x56/frame 0xfffffe003e1adf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1adf20 --- trap 0x13, rip = 0xffffffff80c0c162, rsp = 0xfffffe033dad1370, rbp = 0xfffffe033dad1380 --- lock_delay() at lock_delay+0x32/frame 0xfffffe033dad1380 _mtx_lock_spin_cookie() at _mtx_lock_spin_cookie+0xc1/frame 0xfffffe033dad13f0 __mtx_lock_spin_flags() at __mtx_lock_spin_flags+0xd5/frame 0xfffffe033dad1430 smp_targeted_tlb_shootdown() at smp_targeted_tlb_shootdown+0xbf/frame 0xfffffe033dad14a0 pmap_invalidate_range() at pmap_invalidate_range+0x1b8/frame 0xfffffe033dad1510 allocbuf() at allocbuf+0xfd/frame 0xfffffe033dad1570 brelse() at brelse+0x1c1/frame 0xfffffe033dad15d0 flushbuflist() at flushbuflist+0x166/frame 0xfffffe033dad1650 bufobj_invalbuf() at bufobj_invalbuf+0x8b/frame 0xfffffe033dad16b0 vgonel() at vgonel+0x2be/frame 0xfffffe033dad1710 vflush() at vflush+0x303/frame 0xfffffe033dad1850 ffs_flushfiles() at ffs_flushfiles+0x175/frame 0xfffffe033dad18c0 ffs_unmount() at ffs_unmount+0xea/frame 0xfffffe033dad1940 dounmount() at dounmount+0x423/frame 0xfffffe033dad19a0 kern_unmount() at kern_unmount+0x2b9/frame 0xfffffe033dad1ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe033dad1bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe033dad1bf0 --- syscall (22, FreeBSD ELF64, sys_unmount), rip = 0x8002e1eda, rsp = 0x7fffffffd268, rbp = 0x7fffffffd7a0 --- Tracing command vnlru pid 34 tid 100140 td 0xfffffe00d35df500 (CPU 0) kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e37f3720 vpanic() at vpanic+0x19e/frame 0xfffffe00e37f3770 panic() at panic+0x43/frame 0xfffffe00e37f37d0 trap_fatal() at trap_fatal+0x387/frame 0xfffffe00e37f3830 trap_pfault() at trap_pfault+0x99/frame 0xfffffe00e37f3890 trap() at trap+0x2a5/frame 0xfffffe00e37f39a0 calltrap() at calltrap+0x8/frame 0xfffffe00e37f39a0 --- trap 0xc, rip = 0xffffffff80ee9909, rsp = 0xfffffe00e37f3a70, rbp = 0xfffffe00e37f3a90 --- ufs_reclaim() at ufs_reclaim+0x79/frame 0xfffffe00e37f3a90 VOP_RECLAIM_APV() at VOP_RECLAIM_APV+0x59/frame 0xfffffe00e37f3ab0 vgonel() at vgonel+0x3b7/frame 0xfffffe00e37f3b10 vnlru_proc() at vnlru_proc+0x7fb/frame 0xfffffe00e37f3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e37f3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e37f3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffffe003e3dfc00 (CPU 1) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e17de00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e17de10 trap() at trap+0x56/frame 0xfffffe003e17df20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e17df20 --- trap 0x13, rip = 0xffffffff81024d36, rsp = 0xfffffe00add4ba50, rbp = 0xfffffe00add4ba50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add4ba50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add4baa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add4bac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add4bae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add4bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add4bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add4bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffffe003e3df500 (CPU 2) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e189e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e189e10 trap() at trap+0x56/frame 0xfffffe003e189f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e189f20 --- trap 0x13, rip = 0xffffffff81024d36, rsp = 0xfffffe00add50a50, rbp = 0xfffffe00add50a50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add50a50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add50aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add50ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add50ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add50bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add50bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add50bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffffe003e3e8a00 (CPU 6) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1b9e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1b9e10 trap() at trap+0x56/frame 0xfffffe003e1b9f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1b9f20 --- trap 0x13, rip = 0xffffffff81024d36, rsp = 0xfffffe00add64a50, rbp = 0xfffffe00add64a50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add64a50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add64aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add64ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add64ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add64bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add64bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add64bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:pho> ps pid ppid pgrp uid state wmesg wchan cmd 79038 63176 2449 0 R+ CPU 11 umount 79037 63192 2449 0 R+ CPU 3 umount 79036 63198 2449 0 R+ CPU 7 umount 79033 63183 2449 0 R+ CPU 4 umount 79032 63206 2449 0 R+ CPU 10 umount 79027 63172 2449 0 R+ CPU 9 umount 79025 63178 2449 0 R+ CPU 8 umount 79021 63195 2449 0 R+ CPU 5 umount 79019 63201 2449 0 D+ mntref 0xfffffe00e684d000 umount 79017 63175 2449 0 S+ nanslp 0xffffffff81c83958 sleep 79015 63197 2449 0 S+ nanslp 0xffffffff81c83956 sleep 79014 63199 2449 0 S+ nanslp 0xffffffff81c83953 sleep 79013 63173 2449 0 S+ nanslp 0xffffffff81c83959 sleep 79012 63177 2449 0 S+ nanslp 0xffffffff81c83954 sleep 79011 63179 2449 0 S+ nanslp 0xffffffff81c8395a sleep 79010 63211 2449 0 S+ nanslp 0xffffffff81c83951 sleep 79008 63185 2449 0 S+ nanslp 0xffffffff81c8395a sleep 78994 63193 2449 0 S+ nanslp 0xffffffff81c83956 sleep 78992 63209 2449 0 S+ nanslp 0xffffffff81c83957 sleep 78990 63188 2449 0 S+ nanslp 0xffffffff81c83952 sleep 78989 63204 2449 0 S+ nanslp 0xffffffff81c83950 sleep 78936 10566 10516 0 S nanslp 0xffffffff81c83958 sleep 63211 63024 2449 0 S+ wait 0xfffff801e6655a50 sh 63209 63024 2449 0 S+ wait 0xfffff805884ee000 sh 63206 63024 2449 0 S+ wait 0xfffff8080004b528 sh 63204 63024 2449 0 S+ wait 0xfffff803caff3a50 sh 63201 63024 2449 0 S+ wait 0xfffff8019cbbe000 sh 63199 63024 2449 0 S+ wait 0xfffff80801a95a50 sh 63198 63024 2449 0 S+ wait 0xfffff801abce0528 sh 63197 63024 2449 0 S+ wait 0xfffff803ca032000 sh 63195 63024 2449 0 S+ wait 0xfffff8061f267000 sh 63193 63024 2449 0 S+ wait 0xfffff801e6655000 sh 63192 63024 2449 0 S+ wait 0xfffff8019f85ea50 sh 63188 63024 2449 0 S+ wait 0xfffff803caff3000 sh 63185 63024 2449 0 S+ wait 0xfffff801a9249000 sh 63183 63024 2449 0 S+ wait 0xfffff803ca407528 sh 63179 63024 2449 0 S+ wait 0xfffff8061f267528 sh 63178 63024 2449 0 S+ wait 0xfffff8002169b528 sh 63177 63024 2449 0 S+ wait 0xfffff803cab9ba50 sh 63176 63024 2449 0 S+ wait 0xfffff803cadc8a50 sh 63175 63024 2449 0 S+ wait 0xfffff807790d6000 sh 63173 63024 2449 0 S+ wait 0xfffff803ca1c8a50 sh 63172 63024 2449 0 S+ wait 0xfffff803caa08a50 sh 63167 0 0 0 DL mdwait 0xfffff8071fa89000 [md21] 63156 0 0 0 DL mdwait 0xfffff8058ed8a000 [md20] 63145 0 0 0 DL mdwait 0xfffff8048805b000 [md19] 63134 0 0 0 DL mdwait 0xfffff8075fa8c000 [md18] 63123 0 0 0 DL mdwait 0xfffff802dedc0000 [md17] 63112 0 0 0 DL mdwait 0xfffff80686b26000 [md16] 63101 0 0 0 DL mdwait 0xfffff8030e8ce000 [md15] 63090 0 0 0 DL mdwait 0xfffff8019f8c0000 [md14] 63079 0 0 0 DL mdwait 0xfffff8034f270000 [md13] 63068 0 0 0 DL mdwait 0xfffff807b8c7f000 [md12] 63057 0 0 0 DL mdwait 0xfffff80792c0f000 [md11] 63046 0 0 0 DL mdwait 0xfffff807794e6000 [md10] 63024 63023 2449 0 S+ pause 0xfffff8055caca5d0 sh 63023 63021 2449 0 S+ wait 0xfffff805b2013528 sh 63022 2449 2449 0 S+ piperd 0xfffff807fa773be0 tee 63021 2449 2449 0 S+ wait 0xfffff806f7c43000 sh 7718 0 0 0 DL aiordy 0xfffff8002127f000 [aiod4] 7717 0 0 0 DL aiordy 0xfffff8061f3c5000 [aiod3] 7716 0 0 0 DL aiordy 0xfffff803ca829528 [aiod2] 7715 0 0 0 DL aiordy 0xfffff8024add3000 [aiod1] 3061 0 0 0 DL ftcl 0xffffffff82e064f4 [ftcleanup] 13407 1 13404 2006 S+ select 0xfffff8000417c040 tail 13404 7841 13404 2006 S+ kqread 0xfffff8001b030800 tail 10569 10516 10516 0 S piperd 0xfffff802fc8c52f8 sh 10567 10516 10516 0 S piperd 0xfffff8024a3a4be0 awk 10566 10516 10516 0 S wait 0xfffff8024a95e528 sh 10516 1 10516 0 SWs wait 0xfffff80021694a50 sh 7841 7663 7841 2006 SWs+ wait 0xfffff80021280a50 bash 7663 6026 6026 2006 S select 0xfffff800210193c0 sshd 6026 2369 6026 0 Ss select 0xfffff80003a0e340 sshd 2449 2448 2449 0 S+ wait 0xfffff8024add3a50 sh 2448 2446 2448 0 S+ select 0xfffff800214cb940 bash 2446 2445 2446 0 SW+ pause 0xfffff8002169b0a8 csh 2445 2440 2445 2006 SW+ wait 0xfffff8024a553a50 su 2440 2439 2440 2006 SWs+ wait 0xfffff800219fea50 bash 2439 2436 2436 2006 S select 0xfffff800215476c0 sshd 2436 2369 2436 0 Ss select 0xfffff80003a0e540 sshd 2432 2431 2432 0 S+ ttyin 0xfffff800041dfcb0 csh 2431 1 2431 0 SWs+ wait 0xfffff80021befa50 login 2430 1 2430 0 Ss+ ttyin 0xfffff800041e20b0 getty 2429 1 2429 0 Ss+ ttyin 0xfffff800211390b0 getty 2428 1 2428 0 Ss+ ttyin 0xfffff800211394b0 getty 2427 1 2427 0 Ss+ ttyin 0xfffff800211398b0 getty 2426 1 2426 0 Ss+ ttyin 0xfffff80021139cb0 getty 2425 1 2425 0 Ss+ ttyin 0xfffff8002113c0b0 getty 2424 1 2424 0 Ss+ ttyin 0xfffff8002113c4b0 getty 2423 1 2423 0 Ss+ ttyin 0xfffff8002113c8b0 getty 2422 1 2422 0 Ss+ ttyin 0xfffff8002113ccb0 getty 2373 1 2373 0 Ss nanslp 0xffffffff81c83955 cron 2369 1 2369 0 Ss select 0xfffff800219ddd40 sshd 2341 1 2341 0 Ss select 0xfffff80004187440 powerd 2338 1 2338 123 Ss (threaded) ntpd 100165 S select 0xfffff80003a0e2c0 ntpd 2273 1 2273 0 Ss rpcsvc 0xfffff8001b0b3660 NLM: master 2270 1 2270 0 Ss select 0xfffff800218fbcc0 rpc.statd 2224 1 2224 0 Ss nanslp 0xffffffff81c83959 watchdogd 2076 1 2076 0 Ss select 0xfffff800041875c0 rpcbind 2066 1 2066 0 Ss select 0xfffff80021019440 syslogd 1995 1 1995 0 Ss select 0xfffff80003280240 devd 1990 1 1990 65 Ss select 0xfffff800041877c0 dhclient 1931 1 1931 0 Ss select 0xfffff800041934c0 dhclient 1928 1 1928 0 Ss select 0xfffff8000417c240 dhclient 34 0 0 0 RL CPU 0 [vnlru] 33 0 0 0 DL syncer 0xffffffff81d59dd8 [syncer] 32 0 0 0 DL (threaded) [bufdaemon] 100130 D qsleep 0xffffffff81d592d8 [bufdaemon] 100131 D - 0xffffffff8180aa00 [bufspacedaemon-0] 100132 D - 0xffffffff81812cc0 [bufspacedaemon-1] 100133 D - 0xffffffff8181af80 [bufspacedaemon-2] 100134 D - 0xffffffff81823240 [bufspacedaemon-3] 100137 D - 0xffffffff8182b500 [bufspacedaemon-4] 100138 D - 0xffffffff818337c0 [bufspacedaemon-5] 100139 D - 0xffffffff8183ba80 [bufspacedaemon-6] 100150 D sdflush 0xfffff80003cc10e8 [/ worker] 100211 D sdflush 0xfffff8024ab30ce8 [/tmp worker] 31 0 0 0 DL psleep 0xffffffff81d74c88 [vmdaemon] 30 0 0 0 DL (threaded) [pagedaemon] 100128 D psleep 0xffffffff81da0bd8 [dom0] 100135 D launds 0xffffffff81da0be4 [laundry: dom0] 100141 D umarcl 0xffffffff80eff890 [uma] 29 0 0 0 DL idle 0xfffff8002127f528 [enc_daemon1] 28 0 0 0 DL idle 0xfffff8002120ca50 [enc_daemon0] 27 0 0 0 DL - 0xffffffff81ade1b0 [rand_harvestq] 26 0 0 0 DL waiting 0xffffffff81de61a0 [sctp_iterator] 25 0 0 0 DL - 0xffffffff81d58cdc [soaiod4] 24 0 0 0 DL - 0xffffffff81d58cdc [soaiod3] 23 0 0 0 DL - 0xffffffff81d58cdc [soaiod2] 22 0 0 0 DL - 0xffffffff81d58cdc [soaiod1] 21 0 0 0 DL (threaded) [usb] 100096 D - 0xfffffe00d2d84440 [usbus0] 100097 D - 0xfffffe00d2d84498 [usbus0] 100098 D - 0xfffffe00d2d844f0 [usbus0] 100099 D - 0xfffffe00d2d84548 [usbus0] 100100 D - 0xfffffe00d2d845a0 [usbus0] 100102 D - 0xfffffe003e4a2cf0 [usbus1] 100103 D - 0xfffffe003e4a2d48 [usbus1] 100104 D - 0xfffffe003e4a2da0 [usbus1] 100105 D - 0xfffffe003e4a2df8 [usbus1] 100106 D - 0xfffffe003e4a2e50 [usbus1] 100107 D - 0xfffffe00d2e23cf0 [usbus2] 100108 D - 0xfffffe00d2e23d48 [usbus2] 100109 D - 0xfffffe00d2e23da0 [usbus2] 100110 D - 0xfffffe00d2e23df8 [usbus2] 100111 D - 0xfffffe00d2e23e50 [usbus2] 20 0 0 0 RL (threaded) [cam] 100091 D - 0xffffffff819b95c0 [doneq0] 100092 RunQ [doneq1] 100093 D - 0xffffffff819b96c0 [doneq2] 100125 D - 0xffffffff819b9488 [scanner] 19 0 0 0 DL crypto_ 0xfffff80003b12c50 [crypto returns 11] 18 0 0 0 DL crypto_ 0xfffff80003b12bf0 [crypto returns 10] 17 0 0 0 DL crypto_ 0xfffff80003b12b90 [crypto returns 9] 16 0 0 0 DL crypto_ 0xfffff80003b12b30 [crypto returns 8] 15 0 0 0 DL crypto_ 0xfffff80003b12ad0 [crypto returns 7] 9 0 0 0 DL crypto_ 0xfffff80003b12a70 [crypto returns 6] 8 0 0 0 DL crypto_ 0xfffff80003b12a10 [crypto returns 5] 7 0 0 0 DL crypto_ 0xfffff80003b129b0 [crypto returns 4] 6 0 0 0 DL crypto_ 0xfffff80003b12950 [crypto returns 3] 5 0 0 0 DL crypto_ 0xfffff80003b128f0 [crypto returns 2] 4 0 0 0 DL crypto_ 0xfffff80003b12890 [crypto returns 1] 3 0 0 0 DL crypto_ 0xfffff80003b12830 [crypto returns 0] 2 0 0 0 DL crypto_ 0xffffffff81d6ed10 [crypto] 14 0 0 0 DL seqstat 0xfffff80003a38488 [sequencer 00] 13 0 0 0 DL (threaded) [geom] 100062 D - 0xffffffff81d9f208 [g_event] 100063 D - 0xffffffff81d9f218 [g_up] 100064 D - 0xffffffff81d9f210 [g_down] 12 0 0 0 WL (threaded) [intr] 100043 I [swi6: task queue] 100044 I [swi6: Giant taskq] 100046 I [swi5: fast taskq] 100047 I [swi4: clock (0)] 100048 I [swi4: clock (1)] 100049 I [swi4: clock (2)] 100050 I [swi4: clock (3)] 100051 I [swi4: clock (4)] 100052 I [swi4: clock (5)] 100053 I [swi4: clock (6)] 100054 I [swi4: clock (7)] 100055 I [swi4: clock (8)] 100056 I [swi4: clock (9)] 100057 I [swi4: clock (10)] 100058 I [swi4: clock (11)] 100059 I [swi1: netisr 0] 100060 I [swi3: vm] 100094 I [irq56: ahci0] 100095 I [irq19: xhci0] 100101 I [irq18: ehci0 ehci1] 100112 I [irq71: ahci1] 100113 I [swi0: uart uart] 100176 I [irq72: ioat0] 100177 I [irq73: ioat1] 100178 I [irq74: ioat2] 100179 I [irq75: ioat3] 100180 I [irq76: ioat4] 100181 I [irq77: ioat5] 100182 I [irq78: ioat6] 100183 I [irq79: ioat7] 11 0 0 0 RL (threaded) [idle] 100003 CanRun [idle: cpu0] 100004 Run CPU 1 [idle: cpu1] 100005 Run CPU 2 [idle: cpu2] 100006 CanRun [idle: cpu3] 100007 CanRun [idle: cpu4] 100008 CanRun [idle: cpu5] 100009 Run CPU 6 [idle: cpu6] 100010 CanRun [idle: cpu7] 100011 CanRun [idle: cpu8] 100012 CanRun [idle: cpu9] 100013 CanRun [idle: cpu10] 100014 CanRun [idle: cpu11] 1 0 1 0 SLs wait 0xfffff800038ed000 [init] 10 0 0 0 DL audit_w 0xffffffff81de6d28 [audit] 0 0 0 0 DLs (threaded) [kernel] 100000 D swapin 0xffffffff81d8e808 [swapper] 100015 D - 0xfffff800037df100 [softirq_0] 100016 D - 0xfffff800037dee00 [softirq_1] 100017 D - 0xfffff800037dec00 [softirq_2] 100018 D - 0xfffff800037dea00 [softirq_3] 100019 D - 0xfffff800037de800 [softirq_4] 100020 D - 0xfffff800037de600 [softirq_5] 100021 D - 0xfffff800037de400 [softirq_6] 100022 D - 0xfffff800037de200 [softirq_7] 100023 D - 0xfffff800037de000 [softirq_8] 100024 D - 0xfffff800037ddd00 [softirq_9] 100025 D - 0xfffff800037ddb00 [softirq_10] 100026 D - 0xfffff800037dd900 [softirq_11] 100027 D - 0xfffff800037dd700 [if_io_tqg_0] 100028 D - 0xfffff800037dd500 [if_io_tqg_1] 100029 D - 0xfffff800037dd300 [if_io_tqg_2] 100030 D - 0xfffff800037dd100 [if_io_tqg_3] 100031 D - 0xfffff800037dce00 [if_io_tqg_4] 100032 D - 0xfffff800037dcc00 [if_io_tqg_5] 100033 D - 0xfffff800037dca00 [if_io_tqg_6] 100034 D - 0xfffff800037dc800 [if_io_tqg_7] 100035 D - 0xfffff800037dc600 [if_io_tqg_8] 100036 D - 0xfffff800037dc400 [if_io_tqg_9] 100037 D - 0xfffff800037dc200 [if_io_tqg_10] 100038 D - 0xfffff800037dc000 [if_io_tqg_11] 100039 D - 0xfffff8000393b200 [if_config_tqg_0] 100040 D - 0xfffff800037c9e00 [in6m_free taskq] 100041 D - 0xfffff800037c9d00 [aiod_kick taskq] 100042 D - 0xfffff800037c9c00 [kqueue_ctx taskq] 100045 D - 0xfffff800037c9900 [thread taskq] 100061 D - 0xfffff80003a86300 [firmware taskq] 100066 D - 0xfffff80003a86100 [crypto_0] 100067 D - 0xfffff80003a86100 [crypto_1] 100068 D - 0xfffff80003a86100 [crypto_2] 100069 D - 0xfffff80003a86100 [crypto_3] 100070 D - 0xfffff80003a86100 [crypto_4] 100071 D - 0xfffff80003a86100 [crypto_5] 100072 D - 0xfffff80003a86100 [crypto_6] 100073 D - 0xfffff80003a86100 [crypto_7] 100074 D - 0xfffff80003a86100 [crypto_8] 100075 D - 0xfffff80003a86100 [crypto_9] 100076 D - 0xfffff80003a86100 [crypto_10] 100077 D - 0xfffff80003a86100 [crypto_11] 100114 D - 0xfffff8001b0b6400 [mca taskq] 100121 D - 0xfffff80021134500 [acpi_task_0] 100122 D - 0xfffff80021134500 [acpi_task_1] 100123 D - 0xfffff80021134500 [acpi_task_2] 100124 D - 0xfffff80003a83d00 [CAM taskq] 100827 D - 0xfffff800211ec300 [dtrace_taskq] 100830 D - 0xfffff8017fb28d00 [system_taskq_0] 100831 D - 0xfffff8017fb28d00 [system_taskq_1] 100832 D - 0xfffff8017fb28d00 [system_taskq_2] 100833 D - 0xfffff8017fb28d00 [system_taskq_3] 100834 D - 0xfffff8017fb28d00 [system_taskq_4] 100835 D - 0xfffff8017fb28d00 [system_taskq_5] 100837 D - 0xfffff8017fb28d00 [system_taskq_6] 100838 D - 0xfffff8017fb28d00 [system_taskq_7] 100839 D - 0xfffff8017fb28d00 [system_taskq_8] 100840 D - 0xfffff8017fb28d00 [system_taskq_9] 100842 D - 0xfffff8017fb28d00 [system_taskq_10] 100843 D - 0xfffff8017fb28d00 [system_taskq_11] 2179 1 2449 0 Z+ pdfork db:0:pho> allt Tracing command umount pid 79038 tid 102386 td 0xfffffe00e784b000 (CPU 11) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1f5e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1f5e10 trap() at trap+0x56/frame 0xfffffe003e1f5f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1f5f20 --- trap 0x13, rip = 0xffffffff80c0c160, rsp = 0xfffffe00e70a2760, rbp = 0xfffffe00e70a2770 --- lock_delay() at lock_delay+0x30/frame 0xfffffe00e70a2770 _mtx_lock_spin_cookie() at _mtx_lock_spin_cookie+0xc1/frame 0xfffffe00e70a27e0 __mtx_lock_spin_flags() at __mtx_lock_spin_flags+0xd5/frame 0xfffffe00e70a2820 smp_rendezvous_cpus() at smp_rendezvous_cpus+0xb8/frame 0xfffffe00e70a2870 smp_rendezvous_cpus_retry() at smp_rendezvous_cpus_retry+0x68/frame 0xfffffe00e70a28d0 vfs_op_enter() at vfs_op_enter+0xae/frame 0xfffffe00e70a2940 dounmount() at dounmount+0xf3/frame 0xfffffe00e70a29a0 kern_unmount() at kern_unmount+0x2b9/frame 0xfffffe00e70a2ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e70a2bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e70a2bf0 --- syscall (22, FreeBSD ELF64, sys_unmount), rip = 0x8002e1eda, rsp = 0x7fffffffd268, rbp = 0x7fffffffd7a0 --- Tracing command umount pid 79037 tid 105588 td 0xfffffe014a776000 (CPU 3) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e195e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e195e10 trap() at trap+0x56/frame 0xfffffe003e195f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e195f20 --- trap 0x13, rip = 0xffffffff80c0c162, rsp = 0xfffffe035d0f4370, rbp = 0xfffffe035d0f4380 --- lock_delay() at lock_delay+0x32/frame 0xfffffe035d0f4380 _mtx_lock_spin_cookie() at _mtx_lock_spin_cookie+0xc1/frame 0xfffffe035d0f43f0 __mtx_lock_spin_flags() at __mtx_lock_spin_flags+0xd5/frame 0xfffffe035d0f4430 smp_targeted_tlb_shootdown() at smp_targeted_tlb_shootdown+0xbf/frame 0xfffffe035d0f44a0 pmap_invalidate_range() at pmap_invalidate_range+0x1b8/frame 0xfffffe035d0f4510 allocbuf() at allocbuf+0xfd/frame 0xfffffe035d0f4570 brelse() at brelse+0x1c1/frame 0xfffffe035d0f45d0 flushbuflist() at flushbuflist+0x166/frame 0xfffffe035d0f4650 bufobj_invalbuf() at bufobj_invalbuf+0x8b/frame 0xfffffe035d0f46b0 vgonel() at vgonel+0x2be/frame 0xfffffe035d0f4710 vflush() at vflush+0x303/frame 0xfffffe035d0f4850 ffs_flushfiles() at ffs_flushfiles+0x175/frame 0xfffffe035d0f48c0 ffs_unmount() at ffs_unmount+0xea/frame 0xfffffe035d0f4940 dounmount() at dounmount+0x423/frame 0xfffffe035d0f49a0 kern_unmount() at kern_unmount+0x2b9/frame 0xfffffe035d0f4ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe035d0f4bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe035d0f4bf0 --- syscall (22, FreeBSD ELF64, sys_unmount), rip = 0x8002e1eda, rsp = 0x7fffffffd268, rbp = 0x7fffffffd7a0 --- Tracing command umount pid 79036 tid 106191 td 0xfffffe012be88a00 (CPU 7) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1c5e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1c5e10 trap() at trap+0x56/frame 0xfffffe003e1c5f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1c5f20 --- trap 0x13, rip = 0xffffffff80bdf102, rsp = 0xfffffe0366cc7660, rbp = 0xfffffe0366cc7680 --- umtx_shm_object_terminated() at umtx_shm_object_terminated+0x12/frame 0xfffffe0366cc7680 vnode_destroy_vobject() at vnode_destroy_vobject+0x67/frame 0xfffffe0366cc76b0 vgonel() at vgonel+0x37a/frame 0xfffffe0366cc7710 vflush() at vflush+0x303/frame 0xfffffe0366cc7850 ffs_flushfiles() at ffs_flushfiles+0x175/frame 0xfffffe0366cc78c0 ffs_unmount() at ffs_unmount+0xea/frame 0xfffffe0366cc7940 dounmount() at dounmount+0x423/frame 0xfffffe0366cc79a0 kern_unmount() at kern_unmount+0x2b9/frame 0xfffffe0366cc7ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe0366cc7bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0366cc7bf0 --- syscall (22, FreeBSD ELF64, sys_unmount), rip = 0x8002e1eda, rsp = 0x7fffffffd268, rbp = 0x7fffffffd7a0 --- Tracing command umount pid 79033 tid 102330 td 0xfffffe013074b300 (CPU 4) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1a1e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1a1e10 trap() at trap+0x56/frame 0xfffffe003e1a1f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1a1f20 --- trap 0x13, rip = 0xffffffff80c0c162, rsp = 0xfffffe0130881370, rbp = 0xfffffe0130881380 --- lock_delay() at lock_delay+0x32/frame 0xfffffe0130881380 _mtx_lock_spin_cookie() at _mtx_lock_spin_cookie+0xc1/frame 0xfffffe01308813f0 __mtx_lock_spin_flags() at __mtx_lock_spin_flags+0xd5/frame 0xfffffe0130881430 smp_targeted_tlb_shootdown() at smp_targeted_tlb_shootdown+0xbf/frame 0xfffffe01308814a0 pmap_invalidate_range() at pmap_invalidate_range+0x1b8/frame 0xfffffe0130881510 allocbuf() at allocbuf+0x1fe/frame 0xfffffe0130881570 brelse() at brelse+0x3d7/frame 0xfffffe01308815d0 flushbuflist() at flushbuflist+0x166/frame 0xfffffe0130881650 bufobj_invalbuf() at bufobj_invalbuf+0x8b/frame 0xfffffe01308816b0 vgonel() at vgonel+0x2be/frame 0xfffffe0130881710 vflush() at vflush+0x303/frame 0xfffffe0130881850 ffs_flushfiles() at ffs_flushfiles+0x175/frame 0xfffffe01308818c0 ffs_unmount() at ffs_unmount+0xea/frame 0xfffffe0130881940 dounmount() at dounmount+0x423/frame 0xfffffe01308819a0 kern_unmount() at kern_unmount+0x2b9/frame 0xfffffe0130881ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe0130881bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0130881bf0 --- syscall (22, FreeBSD ELF64, sys_unmount), rip = 0x8002e1eda, rsp = 0x7fffffffd268, rbp = 0x7fffffffd7a0 --- Tracing command umount pid 79032 tid 104227 td 0xfffffe015a146c00 (CPU 10) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1e9e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1e9e10 trap() at trap+0x56/frame 0xfffffe003e1e9f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1e9f20 --- trap 0x13, rip = 0xffffffff80c0c160, rsp = 0xfffffe034164a370, rbp = 0xfffffe034164a380 --- lock_delay() at lock_delay+0x30/frame 0xfffffe034164a380 _mtx_lock_spin_cookie() at _mtx_lock_spin_cookie+0xc1/frame 0xfffffe034164a3f0 __mtx_lock_spin_flags() at __mtx_lock_spin_flags+0xd5/frame 0xfffffe034164a430 smp_targeted_tlb_shootdown() at smp_targeted_tlb_shootdown+0xbf/frame 0xfffffe034164a4a0 pmap_invalidate_range() at pmap_invalidate_range+0x1b8/frame 0xfffffe034164a510 allocbuf() at allocbuf+0x1fe/frame 0xfffffe034164a570 brelse() at brelse+0x3d7/frame 0xfffffe034164a5d0 flushbuflist() at flushbuflist+0x166/frame 0xfffffe034164a650 bufobj_invalbuf() at bufobj_invalbuf+0x8b/frame 0xfffffe034164a6b0 vgonel() at vgonel+0x2be/frame 0xfffffe034164a710 vflush() at vflush+0x303/frame 0xfffffe034164a850 ffs_flushfiles() at ffs_flushfiles+0x175/frame 0xfffffe034164a8c0 ffs_unmount() at ffs_unmount+0xea/frame 0xfffffe034164a940 dounmount() at dounmount+0x423/frame 0xfffffe034164a9a0 kern_unmount() at kern_unmount+0x2b9/frame 0xfffffe034164aad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe034164abf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe034164abf0 --- syscall (22, FreeBSD ELF64, sys_unmount), rip = 0x8002e1eda, rsp = 0x7fffffffd268, rbp = 0x7fffffffd7a0 --- Tracing command umount pid 79027 tid 103199 td 0xfffffe015a32e500 (CPU 9) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1dde00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1dde10 trap() at trap+0x56/frame 0xfffffe003e1ddf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1ddf20 --- trap 0x13, rip = 0xffffffff80c0c162, rsp = 0xfffffe033f422370, rbp = 0xfffffe033f422380 --- lock_delay() at lock_delay+0x32/frame 0xfffffe033f422380 _mtx_lock_spin_cookie() at _mtx_lock_spin_cookie+0xc1/frame 0xfffffe033f4223f0 __mtx_lock_spin_flags() at __mtx_lock_spin_flags+0xd5/frame 0xfffffe033f422430 smp_targeted_tlb_shootdown() at smp_targeted_tlb_shootdown+0xbf/frame 0xfffffe033f4224a0 pmap_invalidate_range() at pmap_invalidate_range+0x1b8/frame 0xfffffe033f422510 allocbuf() at allocbuf+0xfd/frame 0xfffffe033f422570 brelse() at brelse+0x1c1/frame 0xfffffe033f4225d0 flushbuflist() at flushbuflist+0x166/frame 0xfffffe033f422650 bufobj_invalbuf() at bufobj_invalbuf+0x8b/frame 0xfffffe033f4226b0 vgonel() at vgonel+0x2be/frame 0xfffffe033f422710 vflush() at vflush+0x303/frame 0xfffffe033f422850 ffs_flushfiles() at ffs_flushfiles+0x175/frame 0xfffffe033f4228c0 ffs_unmount() at ffs_unmount+0xea/frame 0xfffffe033f422940 dounmount() at dounmount+0x423/frame 0xfffffe033f4229a0 kern_unmount() at kern_unmount+0x2b9/frame 0xfffffe033f422ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe033f422bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe033f422bf0 --- syscall (22, FreeBSD ELF64, sys_unmount), rip = 0x8002e1eda, rsp = 0x7fffffffd268, rbp = 0x7fffffffd7a0 --- Tracing command umount pid 79025 tid 102950 td 0xfffffe0169939800 (CPU 8) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1d1e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1d1e10 trap() at trap+0x56/frame 0xfffffe003e1d1f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1d1f20 --- trap 0x13, rip = 0xffffffff80c0c162, rsp = 0xfffffe0342d44370, rbp = 0xfffffe0342d44380 --- lock_delay() at lock_delay+0x32/frame 0xfffffe0342d44380 _mtx_lock_spin_cookie() at _mtx_lock_spin_cookie+0xc1/frame 0xfffffe0342d443f0 __mtx_lock_spin_flags() at __mtx_lock_spin_flags+0xd5/frame 0xfffffe0342d44430 smp_targeted_tlb_shootdown() at smp_targeted_tlb_shootdown+0xbf/frame 0xfffffe0342d444a0 pmap_invalidate_range() at pmap_invalidate_range+0x1b8/frame 0xfffffe0342d44510 allocbuf() at allocbuf+0x1fe/frame 0xfffffe0342d44570 brelse() at brelse+0x3d7/frame 0xfffffe0342d445d0 flushbuflist() at flushbuflist+0x166/frame 0xfffffe0342d44650 bufobj_invalbuf() at bufobj_invalbuf+0x8b/frame 0xfffffe0342d446b0 vgonel() at vgonel+0x2be/frame 0xfffffe0342d44710 vflush() at vflush+0x303/frame 0xfffffe0342d44850 ffs_flushfiles() at ffs_flushfiles+0x175/frame 0xfffffe0342d448c0 ffs_unmount() at ffs_unmount+0xea/frame 0xfffffe0342d44940 dounmount() at dounmount+0x423/frame 0xfffffe0342d449a0 kern_unmount() at kern_unmount+0x2b9/frame 0xfffffe0342d44ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe0342d44bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0342d44bf0 --- syscall (22, FreeBSD ELF64, sys_unmount), rip = 0x8002e1eda, rsp = 0x7fffffffd268, rbp = 0x7fffffffd7a0 --- Tracing command umount pid 79021 tid 103540 td 0xfffffe012d923a00 (CPU 5) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1ade00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1ade10 trap() at trap+0x56/frame 0xfffffe003e1adf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1adf20 --- trap 0x13, rip = 0xffffffff80c0c162, rsp = 0xfffffe033dad1370, rbp = 0xfffffe033dad1380 --- lock_delay() at lock_delay+0x32/frame 0xfffffe033dad1380 _mtx_lock_spin_cookie() at _mtx_lock_spin_cookie+0xc1/frame 0xfffffe033dad13f0 __mtx_lock_spin_flags() at __mtx_lock_spin_flags+0xd5/frame 0xfffffe033dad1430 smp_targeted_tlb_shootdown() at smp_targeted_tlb_shootdown+0xbf/frame 0xfffffe033dad14a0 pmap_invalidate_range() at pmap_invalidate_range+0x1b8/frame 0xfffffe033dad1510 allocbuf() at allocbuf+0xfd/frame 0xfffffe033dad1570 brelse() at brelse+0x1c1/frame 0xfffffe033dad15d0 flushbuflist() at flushbuflist+0x166/frame 0xfffffe033dad1650 bufobj_invalbuf() at bufobj_invalbuf+0x8b/frame 0xfffffe033dad16b0 vgonel() at vgonel+0x2be/frame 0xfffffe033dad1710 vflush() at vflush+0x303/frame 0xfffffe033dad1850 ffs_flushfiles() at ffs_flushfiles+0x175/frame 0xfffffe033dad18c0 ffs_unmount() at ffs_unmount+0xea/frame 0xfffffe033dad1940 dounmount() at dounmount+0x423/frame 0xfffffe033dad19a0 kern_unmount() at kern_unmount+0x2b9/frame 0xfffffe033dad1ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe033dad1bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe033dad1bf0 --- syscall (22, FreeBSD ELF64, sys_unmount), rip = 0x8002e1eda, rsp = 0x7fffffffd268, rbp = 0x7fffffffd7a0 --- Tracing command umount pid 79019 tid 100771 td 0xfffffe0130786100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00eab03810 mi_switch() at mi_switch+0x155/frame 0xfffffe00eab03830 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00eab03870 _sleep() at _sleep+0x2cd/frame 0xfffffe00eab03910 vfs_mount_destroy() at vfs_mount_destroy+0xf4/frame 0xfffffe00eab03940 dounmount() at dounmount+0x746/frame 0xfffffe00eab039a0 kern_unmount() at kern_unmount+0x2b9/frame 0xfffffe00eab03ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00eab03bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00eab03bf0 --- syscall (22, FreeBSD ELF64, sys_unmount), rip = 0x8002e1eda, rsp = 0x7fffffffd268, rbp = 0x7fffffffd7a0 --- Tracing command sleep pid 79017 tid 103182 td 0xfffffe015a322c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe033f3cb870 mi_switch() at mi_switch+0x155/frame 0xfffffe033f3cb890 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe033f3cb8d0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe033f3cb930 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe033f3cb970 _sleep() at _sleep+0x258/frame 0xfffffe033f3cba10 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe033f3cba90 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe033f3cbad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe033f3cbbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe033f3cbbf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003abbaa, rsp = 0x7fffffffe6b8, rbp = 0x7fffffffe700 --- Tracing command sleep pid 79015 tid 103185 td 0xfffffe015a317a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe033f3da870 mi_switch() at mi_switch+0x155/frame 0xfffffe033f3da890 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe033f3da8d0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe033f3da930 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe033f3da970 _sleep() at _sleep+0x258/frame 0xfffffe033f3daa10 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe033f3daa90 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe033f3daad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe033f3dabf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe033f3dabf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003abbaa, rsp = 0x7fffffffe6b8, rbp = 0x7fffffffe700 --- Tracing command sleep pid 79014 tid 100915 td 0xfffffe012beb5100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe035a82c870 mi_switch() at mi_switch+0x155/frame 0xfffffe035a82c890 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe035a82c8d0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe035a82c930 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe035a82c970 _sleep() at _sleep+0x258/frame 0xfffffe035a82ca10 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe035a82ca90 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe035a82cad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe035a82cbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe035a82cbf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003abbaa, rsp = 0x7fffffffe6b8, rbp = 0x7fffffffe700 --- Tracing command sleep pid 79013 tid 104967 td 0xfffffe014ac58a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe036937b870 mi_switch() at mi_switch+0x155/frame 0xfffffe036937b890 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe036937b8d0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe036937b930 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe036937b970 _sleep() at _sleep+0x258/frame 0xfffffe036937ba10 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe036937ba90 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe036937bad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe036937bbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe036937bbf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003abbaa, rsp = 0x7fffffffe6b8, rbp = 0x7fffffffe700 --- Tracing command sleep pid 79012 tid 102194 td 0xfffffe01670a0500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe033bb10870 mi_switch() at mi_switch+0x155/frame 0xfffffe033bb10890 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe033bb108d0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe033bb10930 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe033bb10970 _sleep() at _sleep+0x258/frame 0xfffffe033bb10a10 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe033bb10a90 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe033bb10ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe033bb10bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe033bb10bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003abbaa, rsp = 0x7fffffffe6b8, rbp = 0x7fffffffe700 --- Tracing command sleep pid 79011 tid 103428 td 0xfffffe01699e2700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe033f69f870 mi_switch() at mi_switch+0x155/frame 0xfffffe033f69f890 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe033f69f8d0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe033f69f930 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe033f69f970 _sleep() at _sleep+0x258/frame 0xfffffe033f69fa10 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe033f69fa90 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe033f69fad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe033f69fbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe033f69fbf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003abbaa, rsp = 0x7fffffffe6b8, rbp = 0x7fffffffe700 --- Tracing command sleep pid 79010 tid 104074 td 0xfffffe012d966500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe033fb49870 mi_switch() at mi_switch+0x155/frame 0xfffffe033fb49890 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe033fb498d0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe033fb49930 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe033fb49970 _sleep() at _sleep+0x258/frame 0xfffffe033fb49a10 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe033fb49a90 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe033fb49ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe033fb49bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe033fb49bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003abbaa, rsp = 0x7fffffffe6b8, rbp = 0x7fffffffe700 --- Tracing command sleep pid 79008 tid 102838 td 0xfffffe0169952e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe033d312870 mi_switch() at mi_switch+0x155/frame 0xfffffe033d312890 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe033d3128d0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe033d312930 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe033d312970 _sleep() at _sleep+0x258/frame 0xfffffe033d312a10 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe033d312a90 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe033d312ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe033d312bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe033d312bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003abbaa, rsp = 0x7fffffffe6b8, rbp = 0x7fffffffe700 --- Tracing command sleep pid 78994 tid 100408 td 0xfffffe00e3a30000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe033fbee870 mi_switch() at mi_switch+0x155/frame 0xfffffe033fbee890 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe033fbee8d0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe033fbee930 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe033fbee970 _sleep() at _sleep+0x258/frame 0xfffffe033fbeea10 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe033fbeea90 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe033fbeead0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe033fbeebf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe033fbeebf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003abbaa, rsp = 0x7fffffffe6b8, rbp = 0x7fffffffe700 --- Tracing command sleep pid 78992 tid 104231 td 0xfffffe012d7d4000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe034165e870 mi_switch() at mi_switch+0x155/frame 0xfffffe034165e890 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe034165e8d0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe034165e930 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe034165e970 _sleep() at _sleep+0x258/frame 0xfffffe034165ea10 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe034165ea90 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe034165ead0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe034165ebf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe034165ebf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003abbaa, rsp = 0x7fffffffe6b8, rbp = 0x7fffffffe700 --- Tracing command sleep pid 78990 tid 100787 td 0xfffffe012d8a5500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe033f827870 mi_switch() at mi_switch+0x155/frame 0xfffffe033f827890 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe033f8278d0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe033f827930 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe033f827970 _sleep() at _sleep+0x258/frame 0xfffffe033f827a10 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe033f827a90 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe033f827ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe033f827bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe033f827bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003abbaa, rsp = 0x7fffffffe6b8, rbp = 0x7fffffffe700 --- Tracing command sleep pid 78989 tid 103550 td 0xfffffe01699f0300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe033db03870 mi_switch() at mi_switch+0x155/frame 0xfffffe033db03890 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe033db038d0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe033db03930 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe033db03970 _sleep() at _sleep+0x258/frame 0xfffffe033db03a10 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe033db03a90 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe033db03ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe033db03bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe033db03bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003abbaa, rsp = 0x7fffffffe6b8, rbp = 0x7fffffffe700 --- Tracing command sleep pid 78936 tid 103990 td 0xfffffe012d962c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe03415a3870 mi_switch() at mi_switch+0x155/frame 0xfffffe03415a3890 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe03415a38d0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe03415a3930 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe03415a3970 _sleep() at _sleep+0x258/frame 0xfffffe03415a3a10 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe03415a3a90 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe03415a3ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe03415a3bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe03415a3bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003abbaa, rsp = 0x7fffffffe6a8, rbp = 0x7fffffffe6f0 --- Tracing command sh pid 63211 tid 105804 td 0xfffffe00d3dd9a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe03663306e0 mi_switch() at mi_switch+0x155/frame 0xfffffe0366330700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0366330740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe03663307a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe03663307b0 _sleep() at _sleep+0x2c3/frame 0xfffffe0366330850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe03663308e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe0366330ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe0366330bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0366330bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ba4a, rsp = 0x7fffffffe2b8, rbp = 0x7fffffffe370 --- Tracing command sh pid 63209 tid 105935 td 0xfffffe0146fb5500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe03549c16e0 mi_switch() at mi_switch+0x155/frame 0xfffffe03549c1700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe03549c1740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe03549c17a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe03549c17b0 _sleep() at _sleep+0x2c3/frame 0xfffffe03549c1850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe03549c18e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe03549c1ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe03549c1bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe03549c1bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ba4a, rsp = 0x7fffffffe2b8, rbp = 0x7fffffffe370 --- Tracing command sh pid 63206 tid 101939 td 0xfffffe00e75c1000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00f04e96e0 mi_switch() at mi_switch+0x155/frame 0xfffffe00f04e9700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00f04e9740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00f04e97a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00f04e97b0 _sleep() at _sleep+0x2c3/frame 0xfffffe00f04e9850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00f04e98e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe00f04e9ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00f04e9bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00f04e9bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ba4a, rsp = 0x7fffffffe108, rbp = 0x7fffffffe1c0 --- Tracing command sh pid 63204 tid 103737 td 0xfffffe0169a11800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe033f8ae6e0 mi_switch() at mi_switch+0x155/frame 0xfffffe033f8ae700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe033f8ae740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe033f8ae7a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe033f8ae7b0 _sleep() at _sleep+0x2c3/frame 0xfffffe033f8ae850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe033f8ae8e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe033f8aead0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe033f8aebf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe033f8aebf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ba4a, rsp = 0x7fffffffe2b8, rbp = 0x7fffffffe370 --- Tracing command sh pid 63201 tid 106038 td 0xfffffe014a8bf500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe03539c66e0 mi_switch() at mi_switch+0x155/frame 0xfffffe03539c6700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe03539c6740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe03539c67a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe03539c67b0 _sleep() at _sleep+0x2c3/frame 0xfffffe03539c6850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe03539c68e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe03539c6ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe03539c6bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe03539c6bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ba4a, rsp = 0x7fffffffe108, rbp = 0x7fffffffe1c0 --- Tracing command sh pid 63199 tid 101789 td 0xfffffe01250fb100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e7d1a6e0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e7d1a700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e7d1a740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e7d1a7a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e7d1a7b0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e7d1a850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00e7d1a8e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe00e7d1aad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e7d1abf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e7d1abf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ba4a, rsp = 0x7fffffffe2b8, rbp = 0x7fffffffe370 --- Tracing command sh pid 63198 tid 104875 td 0xfffffe012df34800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe036799f6e0 mi_switch() at mi_switch+0x155/frame 0xfffffe036799f700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe036799f740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe036799f7a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe036799f7b0 _sleep() at _sleep+0x2c3/frame 0xfffffe036799f850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe036799f8e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe036799fad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe036799fbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe036799fbf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ba4a, rsp = 0x7fffffffe108, rbp = 0x7fffffffe1c0 --- Tracing command sh pid 63197 tid 101430 td 0xfffffe00e66e6000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e7a956e0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e7a95700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e7a95740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e7a957a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e7a957b0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e7a95850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00e7a958e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe00e7a95ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e7a95bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e7a95bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ba4a, rsp = 0x7fffffffe2b8, rbp = 0x7fffffffe370 --- Tracing command sh pid 63195 tid 104130 td 0xfffffe015a13ba00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe033de636e0 mi_switch() at mi_switch+0x155/frame 0xfffffe033de63700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe033de63740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe033de637a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe033de637b0 _sleep() at _sleep+0x2c3/frame 0xfffffe033de63850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe033de638e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe033de63ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe033de63bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe033de63bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ba4a, rsp = 0x7fffffffe108, rbp = 0x7fffffffe1c0 --- Tracing command sh pid 63193 tid 105836 td 0xfffffe00d3dd8c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe03663d06e0 mi_switch() at mi_switch+0x155/frame 0xfffffe03663d0700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe03663d0740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe03663d07a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe03663d07b0 _sleep() at _sleep+0x2c3/frame 0xfffffe03663d0850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe03663d08e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe03663d0ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe03663d0bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe03663d0bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ba4a, rsp = 0x7fffffffe2b8, rbp = 0x7fffffffe370 --- Tracing command sh pid 63192 tid 105552 td 0xfffffe014a90ca00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe035d0406e0 mi_switch() at mi_switch+0x155/frame 0xfffffe035d040700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe035d040740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe035d0407a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe035d0407b0 _sleep() at _sleep+0x2c3/frame 0xfffffe035d040850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe035d0408e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe035d040ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe035d040bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe035d040bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ba4a, rsp = 0x7fffffffe108, rbp = 0x7fffffffe1c0 --- Tracing command sh pid 63188 tid 103759 td 0xfffffe0169a10a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe033f91c6e0 mi_switch() at mi_switch+0x155/frame 0xfffffe033f91c700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe033f91c740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe033f91c7a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe033f91c7b0 _sleep() at _sleep+0x2c3/frame 0xfffffe033f91c850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe033f91c8e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe033f91cad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe033f91cbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe033f91cbf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ba4a, rsp = 0x7fffffffe2b8, rbp = 0x7fffffffe370 --- Tracing command sh pid 63185 tid 106158 td 0xfffffe012be86700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0366c226e0 mi_switch() at mi_switch+0x155/frame 0xfffffe0366c22700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0366c22740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe0366c227a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0366c227b0 _sleep() at _sleep+0x2c3/frame 0xfffffe0366c22850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe0366c228e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe0366c22ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe0366c22bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0366c22bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ba4a, rsp = 0x7fffffffe2b8, rbp = 0x7fffffffe370 --- Tracing command sh pid 63183 tid 104415 td 0xfffffe012d7f8700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe033fdf86e0 mi_switch() at mi_switch+0x155/frame 0xfffffe033fdf8700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe033fdf8740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe033fdf87a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe033fdf87b0 _sleep() at _sleep+0x2c3/frame 0xfffffe033fdf8850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe033fdf88e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe033fdf8ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe033fdf8bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe033fdf8bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ba4a, rsp = 0x7fffffffe108, rbp = 0x7fffffffe1c0 --- Tracing command sh pid 63179 tid 104123 td 0xfffffe015a13c100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe033de406e0 mi_switch() at mi_switch+0x155/frame 0xfffffe033de40700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe033de40740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe033de407a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe033de407b0 _sleep() at _sleep+0x2c3/frame 0xfffffe033de40850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe033de408e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe033de40ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe033de40bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe033de40bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ba4a, rsp = 0x7fffffffe2b8, rbp = 0x7fffffffe370 --- Tracing command sh pid 63178 tid 101368 td 0xfffffe015ca95a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe033b9996e0 mi_switch() at mi_switch+0x155/frame 0xfffffe033b999700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe033b999740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe033b9997a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe033b9997b0 _sleep() at _sleep+0x2c3/frame 0xfffffe033b999850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe033b9998e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe033b999ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe033b999bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe033b999bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ba4a, rsp = 0x7fffffffe108, rbp = 0x7fffffffe1c0 --- Tracing command sh pid 63177 tid 103115 td 0xfffffe015a316c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe033f27c6e0 mi_switch() at mi_switch+0x155/frame 0xfffffe033f27c700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe033f27c740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe033f27c7a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe033f27c7b0 _sleep() at _sleep+0x2c3/frame 0xfffffe033f27c850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe033f27c8e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe033f27cad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe033f27cbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe033f27cbf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ba4a, rsp = 0x7fffffffe2b8, rbp = 0x7fffffffe370 --- Tracing command sh pid 63176 tid 103583 td 0xfffffe01699f2e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe033dba86e0 mi_switch() at mi_switch+0x155/frame 0xfffffe033dba8700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe033dba8740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe033dba87a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe033dba87b0 _sleep() at _sleep+0x2c3/frame 0xfffffe033dba8850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe033dba88e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe033dba8ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe033dba8bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe033dba8bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ba4a, rsp = 0x7fffffffe108, rbp = 0x7fffffffe1c0 --- Tracing command sh pid 63175 tid 105858 td 0xfffffe014775f500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe03548406e0 mi_switch() at mi_switch+0x155/frame 0xfffffe0354840700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0354840740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe03548407a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe03548407b0 _sleep() at _sleep+0x2c3/frame 0xfffffe0354840850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe03548408e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe0354840ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe0354840bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0354840bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ba4a, rsp = 0x7fffffffe2b8, rbp = 0x7fffffffe370 --- Tracing command sh pid 63173 tid 104406 td 0xfffffe012d986500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe033fdcb6e0 mi_switch() at mi_switch+0x155/frame 0xfffffe033fdcb700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe033fdcb740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe033fdcb7a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe033fdcb7b0 _sleep() at _sleep+0x2c3/frame 0xfffffe033fdcb850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe033fdcb8e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe033fdcbad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe033fdcbbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe033fdcbbf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ba4a, rsp = 0x7fffffffe2b8, rbp = 0x7fffffffe370 --- Tracing command sh pid 63172 tid 103176 td 0xfffffe01699b1100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe033f3ad6e0 mi_switch() at mi_switch+0x155/frame 0xfffffe033f3ad700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe033f3ad740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe033f3ad7a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe033f3ad7b0 _sleep() at _sleep+0x2c3/frame 0xfffffe033f3ad850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe033f3ad8e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe033f3adad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe033f3adbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe033f3adbf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ba4a, rsp = 0x7fffffffe108, rbp = 0x7fffffffe1c0 --- Tracing command md21 pid 63167 tid 105880 td 0xfffffe01499f0500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe03548aea50 mi_switch() at mi_switch+0x155/frame 0xfffffe03548aea70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe03548aeab0 _sleep() at _sleep+0x2cd/frame 0xfffffe03548aeb50 md_kthread() at md_kthread+0xe3/frame 0xfffffe03548aebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe03548aebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe03548aebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command md20 pid 63156 tid 100524 td 0xfffffe00e6646e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe033dabda50 mi_switch() at mi_switch+0x155/frame 0xfffffe033dabda70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe033dabdab0 _sleep() at _sleep+0x2cd/frame 0xfffffe033dabdb50 md_kthread() at md_kthread+0xe3/frame 0xfffffe033dabdbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe033dabdbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe033dabdbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command md19 pid 63145 tid 101987 td 0xfffffe00f02ec800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0130949a50 mi_switch() at mi_switch+0x155/frame 0xfffffe0130949a70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0130949ab0 _sleep() at _sleep+0x2cd/frame 0xfffffe0130949b50 md_kthread() at md_kthread+0xe3/frame 0xfffffe0130949bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0130949bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0130949bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command md18 pid 63134 tid 105112 td 0xfffffe014a9a0300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe034d0fea50 mi_switch() at mi_switch+0x155/frame 0xfffffe034d0fea70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe034d0feab0 _sleep() at _sleep+0x2cd/frame 0xfffffe034d0feb50 md_kthread() at md_kthread+0xe3/frame 0xfffffe034d0febb0 fork_exit() at fork_exit+0x80/frame 0xfffffe034d0febf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe034d0febf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command md17 pid 63123 tid 101034 td 0xfffffe012884fc00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e7b9ea50 mi_switch() at mi_switch+0x155/frame 0xfffffe00e7b9ea70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e7b9eab0 _sleep() at _sleep+0x2cd/frame 0xfffffe00e7b9eb50 md_kthread() at md_kthread+0xe3/frame 0xfffffe00e7b9ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e7b9ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e7b9ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command md16 pid 63112 tid 100826 td 0xfffffe014c843e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe034d00ea50 mi_switch() at mi_switch+0x155/frame 0xfffffe034d00ea70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe034d00eab0 _sleep() at _sleep+0x2cd/frame 0xfffffe034d00eb50 md_kthread() at md_kthread+0xe3/frame 0xfffffe034d00ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe034d00ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe034d00ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command md15 pid 63101 tid 104955 td 0xfffffe011efa7700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe036933fa50 mi_switch() at mi_switch+0x155/frame 0xfffffe036933fa70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe036933fab0 _sleep() at _sleep+0x2cd/frame 0xfffffe036933fb50 md_kthread() at md_kthread+0xe3/frame 0xfffffe036933fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe036933fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe036933fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command md14 pid 63090 tid 104113 td 0xfffffe015a13c800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe033de0ea50 mi_switch() at mi_switch+0x155/frame 0xfffffe033de0ea70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe033de0eab0 _sleep() at _sleep+0x2cd/frame 0xfffffe033de0eb50 md_kthread() at md_kthread+0xe3/frame 0xfffffe033de0ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe033de0ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe033de0ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command md13 pid 63079 tid 101768 td 0xfffffe00f02ec100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e7d01a50 mi_switch() at mi_switch+0x155/frame 0xfffffe00e7d01a70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e7d01ab0 _sleep() at _sleep+0x2cd/frame 0xfffffe00e7d01b50 md_kthread() at md_kthread+0xe3/frame 0xfffffe00e7d01bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e7d01bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e7d01bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command md12 pid 63068 tid 106227 td 0xfffffe01595cf100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0366d7ba50 mi_switch() at mi_switch+0x155/frame 0xfffffe0366d7ba70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0366d7bab0 _sleep() at _sleep+0x2cd/frame 0xfffffe0366d7bb50 md_kthread() at md_kthread+0xe3/frame 0xfffffe0366d7bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0366d7bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0366d7bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command md11 pid 63057 tid 103758 td 0xfffffe014cad4300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe033f917a50 mi_switch() at mi_switch+0x155/frame 0xfffffe033f917a70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe033f917ab0 _sleep() at _sleep+0x2cd/frame 0xfffffe033f917b50 md_kthread() at md_kthread+0xe3/frame 0xfffffe033f917bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe033f917bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe033f917bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command md10 pid 63046 tid 100803 td 0xfffffe013079f000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe033de59a50 mi_switch() at mi_switch+0x155/frame 0xfffffe033de59a70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe033de59ab0 _sleep() at _sleep+0x2cd/frame 0xfffffe033de59b50 md_kthread() at md_kthread+0xe3/frame 0xfffffe033de59bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe033de59bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe033de59bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sh pid 63024 tid 104966 td 0xfffffe011efaa800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe03693768d0 mi_switch() at mi_switch+0x155/frame 0xfffffe03693768f0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0369376930 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe0369376990 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe03693769a0 _sleep() at _sleep+0x2c3/frame 0xfffffe0369376a40 kern_sigsuspend() at kern_sigsuspend+0xec/frame 0xfffffe0369376aa0 sys_sigsuspend() at sys_sigsuspend+0x31/frame 0xfffffe0369376ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe0369376bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0369376bf0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x80040baca, rsp = 0x7fffffffe2e8, rbp = 0x7fffffffe3a0 --- Tracing command sh pid 63023 tid 106226 td 0xfffffe014a8cd100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0366d766e0 mi_switch() at mi_switch+0x155/frame 0xfffffe0366d76700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0366d76740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe0366d767a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0366d767b0 _sleep() at _sleep+0x2c3/frame 0xfffffe0366d76850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe0366d768e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe0366d76ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe0366d76bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0366d76bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ba4a, rsp = 0x7fffffffe2c8, rbp = 0x7fffffffe380 --- Tracing command tee pid 63022 tid 105834 td 0xfffffe0147760300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe03663c6840 mi_switch() at mi_switch+0x155/frame 0xfffffe03663c6860 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe03663c68a0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe03663c6900 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe03663c6910 _sleep() at _sleep+0x2c3/frame 0xfffffe03663c69b0 pipe_read() at pipe_read+0x42b/frame 0xfffffe03663c6a10 dofileread() at dofileread+0x81/frame 0xfffffe03663c6a60 sys_read() at sys_read+0xc0/frame 0xfffffe03663c6ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe03663c6bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe03663c6bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80041a81a, rsp = 0x7fffffffe698, rbp = 0x7fffffffe6f0 --- Tracing command sh pid 63021 tid 106001 td 0xfffffe0149672100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe035390d6e0 mi_switch() at mi_switch+0x155/frame 0xfffffe035390d700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe035390d740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe035390d7a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe035390d7b0 _sleep() at _sleep+0x2c3/frame 0xfffffe035390d850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe035390d8e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe035390dad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe035390dbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe035390dbf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ba4a, rsp = 0x7fffffffa788, rbp = 0x7fffffffa840 --- Tracing command aiod4 pid 7718 tid 101595 td 0xfffffe0163f71500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe03477c1a20 mi_switch() at mi_switch+0x155/frame 0xfffffe03477c1a40 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe03477c1a80 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe03477c1ac0 _sleep() at _sleep+0x26c/frame 0xfffffe03477c1b60 aio_daemon() at aio_daemon+0x2da/frame 0xfffffe03477c1bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe03477c1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe03477c1bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command aiod3 pid 7717 tid 104426 td 0xfffffe012d7ece00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe033bc31a20 mi_switch() at mi_switch+0x155/frame 0xfffffe033bc31a40 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe033bc31a80 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe033bc31ac0 _sleep() at _sleep+0x26c/frame 0xfffffe033bc31b60 aio_daemon() at aio_daemon+0x2da/frame 0xfffffe033bc31bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe033bc31bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe033bc31bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command aiod2 pid 7716 tid 102413 td 0xfffffe015ca93700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e7ac7a20 mi_switch() at mi_switch+0x155/frame 0xfffffe00e7ac7a40 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e7ac7a80 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e7ac7ac0 _sleep() at _sleep+0x26c/frame 0xfffffe00e7ac7b60 aio_daemon() at aio_daemon+0x2da/frame 0xfffffe00e7ac7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e7ac7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e7ac7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command aiod1 pid 7715 tid 101769 td 0xfffffe012d7f9500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e6fdaa20 mi_switch() at mi_switch+0x155/frame 0xfffffe00e6fdaa40 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e6fdaa80 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e6fdaac0 _sleep() at _sleep+0x26c/frame 0xfffffe00e6fdab60 aio_daemon() at aio_daemon+0x2da/frame 0xfffffe00e6fdabb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e6fdabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e6fdabf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command ftcleanup pid 3061 tid 100174 td 0xfffffe00d5df6e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e38aba60 mi_switch() at mi_switch+0x155/frame 0xfffffe00e38aba80 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e38abac0 _sleep() at _sleep+0x2cd/frame 0xfffffe00e38abb60 fasttrap_pid_cleanup_cb() at fasttrap_pid_cleanup_cb+0x269/frame 0xfffffe00e38abbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e38abbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e38abbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command tail pid 13407 tid 100243 td 0xfffffe00e4495700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e6086740 mi_switch() at mi_switch+0x155/frame 0xfffffe00e6086760 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e60867a0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e6086800 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e6086810 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e6086870 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e60868b0 kern_select() at kern_select+0x87a/frame 0xfffffe00e6086a90 sys_select() at sys_select+0x56/frame 0xfffffe00e6086ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e6086bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e6086bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80042d7fa, rsp = 0x7fffffffe708, rbp = 0x7fffffffe7c0 --- Tracing command tail pid 13404 tid 100201 td 0xfffffe00d61f9700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e39aa4f0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e39aa510 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e39aa550 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e39aa5b0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e39aa5f0 _sleep() at _sleep+0x258/frame 0xfffffe00e39aa690 kqueue_kevent() at kqueue_kevent+0xab4/frame 0xfffffe00e39aa960 kern_kevent_fp() at kern_kevent_fp+0x95/frame 0xfffffe00e39aa9b0 kern_kevent() at kern_kevent+0x80/frame 0xfffffe00e39aaa10 kern_kevent_generic() at kern_kevent_generic+0x70/frame 0xfffffe00e39aaa70 sys_kevent() at sys_kevent+0x61/frame 0xfffffe00e39aaad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e39aabf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e39aabf0 --- syscall (560, FreeBSD ELF64, sys_kevent), rip = 0x800415e4a, rsp = 0x7fffffffe858, rbp = 0x7fffffffe9a0 --- Tracing command sh pid 10569 tid 100231 td 0xfffffe00e64e7c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e604a840 mi_switch() at mi_switch+0x155/frame 0xfffffe00e604a860 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e604a8a0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e604a900 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e604a910 _sleep() at _sleep+0x2c3/frame 0xfffffe00e604a9b0 pipe_read() at pipe_read+0x42b/frame 0xfffffe00e604aa10 dofileread() at dofileread+0x81/frame 0xfffffe00e604aa60 sys_read() at sys_read+0xc0/frame 0xfffffe00e604aad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e604abf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e604abf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80047a81a, rsp = 0x7fffffffde08, rbp = 0x7fffffffe330 --- Tracing command awk pid 10567 tid 100260 td 0xfffffe00e44b9a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e60db840 mi_switch() at mi_switch+0x155/frame 0xfffffe00e60db860 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e60db8a0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e60db900 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e60db910 _sleep() at _sleep+0x2c3/frame 0xfffffe00e60db9b0 pipe_read() at pipe_read+0x42b/frame 0xfffffe00e60dba10 dofileread() at dofileread+0x81/frame 0xfffffe00e60dba60 sys_read() at sys_read+0xc0/frame 0xfffffe00e60dbad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e60dbbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e60dbbf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80047e81a, rsp = 0x7fffffffe318, rbp = 0x7fffffffe330 --- Tracing command sh pid 10566 tid 100261 td 0xfffffe00e44b9300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e60e06e0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e60e0700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e60e0740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e60e07a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e60e07b0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e60e0850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00e60e08e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe00e60e0ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e60e0bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e60e0bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ba4a, rsp = 0x7fffffffe238, rbp = 0x7fffffffe2f0 --- Tracing command sh pid 10516 tid 100245 td 0xfffffe00d39fea00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e60906e0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e37f2dd0 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e37f2de0 trap() at trap+0x6c/frame 0xfffffe00e37f2ef0 calltrap() at calltrap+0x8/frame 0xfffffe00e37f2ef0 --- trap 0xc, rip = 0xffffffff81038f80, rsp = 0xfffffe00e37f2fc0, rbp = 0xfffffe00e37f3050 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe00e37f3050 db_get_value() at db_get_value+0x32/frame 0xfffffe00e37f3090 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00e37f3120 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e37f3140 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e37f31e0 db_command() at db_command+0x25c/frame 0xfffffe00e37f32b0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00e37f3350 db_command() at db_command+0x25c/frame 0xfffffe00e37f3420 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e37f3430 db_trap() at db_trap+0xe8/frame 0xfffffe00e37f34c0 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00e37f3530 trap() at trap+0x7b8/frame 0xfffffe00e37f3640 calltrap() at calltrap+0x8/frame 0xfffffe00e37f3640 --- trap 0x3, rip = 0xffffffff80c0ab97, rsp = 0xfffffe00e37f3710, rbp = 0xfffffe00e37f3720 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e37f3720 vpanic() at vpanic+0x19e/frame 0xfffffe00e37f3770 panic() at panic+0x43/frame 0xfffffe00e37f37d0 trap_fatal() at trap_fatal+0x387/frame 0xfffffe00e37f3830 trap_pfault() at trap_pfault+0x99/frame 0xfffffe00e37f3890 trap() at trap+0x2a5/frame 0xfffffe00e37f39a0 calltrap() at calltrap+0x8/frame 0xfffffe00e37f39a0 --- trap 0xc, rip = 0xffffffff80ee9909, rsp = 0xfffffe00e37f3a70, rbp = 0xfffffe00e37f3a90 --- ufs_reclaim() at ufs_reclaim+0x79/frame 0xfffffe00e37f3a90 VOP_RECLAIM_APV() at VOP_RECLAIM_APV+0x59/frame 0xfffffe00e37f3ab0 vgonel() at vgonel+0x3b7/frame 0xfffffe00e37f3b10 vnlru_proc() at vnlru_proc+0x7fb/frame 0xfffffe00e37f3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e37f3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e37f3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00e60906e8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e37f3040 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e37f3050 db_get_value() at db_get_value+0x4c/frame 0xfffffe00e37f3090 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00e37f3120 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e37f3140 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e37f31e0 db_command() at db_command+0x25c/frame 0xfffffe00e37f32b0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00e37f3350 db_command() at db_command+0x25c/frame 0xfffffe00e37f3420 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e37f3430 db_trap() at db_trap+0xe8/frame 0xfffffe00e37f34c0 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00e37f3530 trap() at trap+0x7b8/frame 0xfffffe00e37f3640 calltrap() at calltrap+0x8/frame 0xfffffe00e37f3640 --- trap 0x3, rip = 0xffffffff80c0ab97, rsp = 0xfffffe00e37f3710, rbp = 0xfffffe00e37f3720 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e37f3720 vpanic() at vpanic+0x19e/frame 0xfffffe00e37f3770 panic() at panic+0x43/frame 0xfffffe00e37f37d0 trap_fatal() at trap_fatal+0x387/frame 0xfffffe00e37f3830 trap_pfault() at trap_pfault+0x99/frame 0xfffffe00e37f3890 trap() at trap+0x2a5/frame 0xfffffe00e37f39a0 calltrap() at calltrap+0x8/frame 0xfffffe00e37f39a0 --- trap 0xc, rip = 0xffffffff80ee9909, rsp = 0xfffffe00e37f3a70, rbp = 0xfffffe00e37f3a90 --- ufs_reclaim() at ufs_reclaim+0x79/frame 0xfffffe00e37f3a90 VOP_RECLAIM_APV() at VOP_RECLAIM_APV+0x59/frame 0xfffffe00e37f3ab0 vgonel() at vgonel+0x3b7/frame 0xfffffe00e37f3b10 vnlru_proc() at vnlru_proc+0x7fb/frame 0xfffffe00e37f3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e37f3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e37f3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bash pid 7841 tid 100160 td 0xfffffe00d5df8300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e38596e0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e37f2dd0 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e37f2de0 trap() at trap+0x6c/frame 0xfffffe00e37f2ef0 calltrap() at calltrap+0x8/frame 0xfffffe00e37f2ef0 --- trap 0xc, rip = 0xffffffff81038f80, rsp = 0xfffffe00e37f2fc0, rbp = 0xfffffe00e37f3050 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe00e37f3050 db_get_value() at db_get_value+0x32/frame 0xfffffe00e37f3090 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00e37f3120 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e37f3140 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e37f31e0 db_command() at db_command+0x25c/frame 0xfffffe00e37f32b0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00e37f3350 db_command() at db_command+0x25c/frame 0xfffffe00e37f3420 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e37f3430 db_trap() at db_trap+0xe8/frame 0xfffffe00e37f34c0 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00e37f3530 trap() at trap+0x7b8/frame 0xfffffe00e37f3640 calltrap() at calltrap+0x8/frame 0xfffffe00e37f3640 --- trap 0x3, rip = 0xffffffff80c0ab97, rsp = 0xfffffe00e37f3710, rbp = 0xfffffe00e37f3720 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e37f3720 vpanic() at vpanic+0x19e/frame 0xfffffe00e37f3770 panic() at panic+0x43/frame 0xfffffe00e37f37d0 trap_fatal() at trap_fatal+0x387/frame 0xfffffe00e37f3830 trap_pfault() at trap_pfault+0x99/frame 0xfffffe00e37f3890 trap() at trap+0x2a5/frame 0xfffffe00e37f39a0 calltrap() at calltrap+0x8/frame 0xfffffe00e37f39a0 --- trap 0xc, rip = 0xffffffff80ee9909, rsp = 0xfffffe00e37f3a70, rbp = 0xfffffe00e37f3a90 --- ufs_reclaim() at ufs_reclaim+0x79/frame 0xfffffe00e37f3a90 VOP_RECLAIM_APV() at VOP_RECLAIM_APV+0x59/frame 0xfffffe00e37f3ab0 vgonel() at vgonel+0x3b7/frame 0xfffffe00e37f3b10 vnlru_proc() at vnlru_proc+0x7fb/frame 0xfffffe00e37f3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e37f3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e37f3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00e38596e8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e37f3040 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e37f3050 db_get_value() at db_get_value+0x4c/frame 0xfffffe00e37f3090 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00e37f3120 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e37f3140 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e37f31e0 db_command() at db_command+0x25c/frame 0xfffffe00e37f32b0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00e37f3350 db_command() at db_command+0x25c/frame 0xfffffe00e37f3420 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e37f3430 db_trap() at db_trap+0xe8/frame 0xfffffe00e37f34c0 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00e37f3530 trap() at trap+0x7b8/frame 0xfffffe00e37f3640 calltrap() at calltrap+0x8/frame 0xfffffe00e37f3640 --- trap 0x3, rip = 0xffffffff80c0ab97, rsp = 0xfffffe00e37f3710, rbp = 0xfffffe00e37f3720 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e37f3720 vpanic() at vpanic+0x19e/frame 0xfffffe00e37f3770 panic() at panic+0x43/frame 0xfffffe00e37f37d0 trap_fatal() at trap_fatal+0x387/frame 0xfffffe00e37f3830 trap_pfault() at trap_pfault+0x99/frame 0xfffffe00e37f3890 trap() at trap+0x2a5/frame 0xfffffe00e37f39a0 calltrap() at calltrap+0x8/frame 0xfffffe00e37f39a0 --- trap 0xc, rip = 0xffffffff80ee9909, rsp = 0xfffffe00e37f3a70, rbp = 0xfffffe00e37f3a90 --- ufs_reclaim() at ufs_reclaim+0x79/frame 0xfffffe00e37f3a90 VOP_RECLAIM_APV() at VOP_RECLAIM_APV+0x59/frame 0xfffffe00e37f3ab0 vgonel() at vgonel+0x3b7/frame 0xfffffe00e37f3b10 vnlru_proc() at vnlru_proc+0x7fb/frame 0xfffffe00e37f3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e37f3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e37f3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sshd pid 7663 tid 100200 td 0xfffffe00d61f9e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e39a5740 mi_switch() at mi_switch+0x155/frame 0xfffffe00e39a5760 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e39a57a0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e39a5800 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e39a5810 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e39a5870 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e39a58b0 kern_select() at kern_select+0x87a/frame 0xfffffe00e39a5a90 sys_select() at sys_select+0x56/frame 0xfffffe00e39a5ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e39a5bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e39a5bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8008e17fa, rsp = 0x7fffffffa548, rbp = 0x7fffffffa580 --- Tracing command sshd pid 6026 tid 100146 td 0xfffffe00d61fc100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e38137c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e38137e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e3813820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e3813880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e3813890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e38138f0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e3813930 kern_poll() at kern_poll+0x48b/frame 0xfffffe00e3813ab0 sys_poll() at sys_poll+0x50/frame 0xfffffe00e3813ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e3813bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3813bf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x80088500a, rsp = 0x7fffffffe5a8, rbp = 0x7fffffffe5e0 --- Tracing command sh pid 2449 tid 100219 td 0xfffffe00d35de000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e38456e0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e3845700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e3845740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e38457a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e38457b0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e3845850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00e38458e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe00e3845ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e3845bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3845bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ba4a, rsp = 0x7fffffffaaa8, rbp = 0x7fffffffab60 --- Tracing command bash pid 2448 tid 100226 td 0xfffffe00e44b7000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e6031700 mi_switch() at mi_switch+0x155/frame 0xfffffe00e6031720 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e6031760 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e60317c0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e60317d0 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e6031830 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e6031870 kern_select() at kern_select+0x87a/frame 0xfffffe00e6031a50 sys_pselect() at sys_pselect+0x127/frame 0xfffffe00e6031ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e6031bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e6031bf0 --- syscall (522, FreeBSD ELF64, sys_pselect), rip = 0x800534b6a, rsp = 0x7fffffffd5b8, rbp = 0x7fffffffd680 --- Tracing command csh pid 2446 tid 100157 td 0xfffffe00d35e6000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e384a8d0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e37f2dd0 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e37f2de0 trap() at trap+0x6c/frame 0xfffffe00e37f2ef0 calltrap() at calltrap+0x8/frame 0xfffffe00e37f2ef0 --- trap 0xc, rip = 0xffffffff81038f80, rsp = 0xfffffe00e37f2fc0, rbp = 0xfffffe00e37f3050 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe00e37f3050 db_get_value() at db_get_value+0x32/frame 0xfffffe00e37f3090 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00e37f3120 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e37f3140 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e37f31e0 db_command() at db_command+0x25c/frame 0xfffffe00e37f32b0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00e37f3350 db_command() at db_command+0x25c/frame 0xfffffe00e37f3420 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e37f3430 db_trap() at db_trap+0xe8/frame 0xfffffe00e37f34c0 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00e37f3530 trap() at trap+0x7b8/frame 0xfffffe00e37f3640 calltrap() at calltrap+0x8/frame 0xfffffe00e37f3640 --- trap 0x3, rip = 0xffffffff80c0ab97, rsp = 0xfffffe00e37f3710, rbp = 0xfffffe00e37f3720 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e37f3720 vpanic() at vpanic+0x19e/frame 0xfffffe00e37f3770 panic() at panic+0x43/frame 0xfffffe00e37f37d0 trap_fatal() at trap_fatal+0x387/frame 0xfffffe00e37f3830 trap_pfault() at trap_pfault+0x99/frame 0xfffffe00e37f3890 trap() at trap+0x2a5/frame 0xfffffe00e37f39a0 calltrap() at calltrap+0x8/frame 0xfffffe00e37f39a0 --- trap 0xc, rip = 0xffffffff80ee9909, rsp = 0xfffffe00e37f3a70, rbp = 0xfffffe00e37f3a90 --- ufs_reclaim() at ufs_reclaim+0x79/frame 0xfffffe00e37f3a90 VOP_RECLAIM_APV() at VOP_RECLAIM_APV+0x59/frame 0xfffffe00e37f3ab0 vgonel() at vgonel+0x3b7/frame 0xfffffe00e37f3b10 vnlru_proc() at vnlru_proc+0x7fb/frame 0xfffffe00e37f3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e37f3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e37f3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00e384a8d8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e37f3040 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e37f3050 db_get_value() at db_get_value+0x4c/frame 0xfffffe00e37f3090 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00e37f3120 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e37f3140 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e37f31e0 db_command() at db_command+0x25c/frame 0xfffffe00e37f32b0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00e37f3350 db_command() at db_command+0x25c/frame 0xfffffe00e37f3420 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e37f3430 db_trap() at db_trap+0xe8/frame 0xfffffe00e37f34c0 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00e37f3530 trap() at trap+0x7b8/frame 0xfffffe00e37f3640 calltrap() at calltrap+0x8/frame 0xfffffe00e37f3640 --- trap 0x3, rip = 0xffffffff80c0ab97, rsp = 0xfffffe00e37f3710, rbp = 0xfffffe00e37f3720 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e37f3720 vpanic() at vpanic+0x19e/frame 0xfffffe00e37f3770 panic() at panic+0x43/frame 0xfffffe00e37f37d0 trap_fatal() at trap_fatal+0x387/frame 0xfffffe00e37f3830 trap_pfault() at trap_pfault+0x99/frame 0xfffffe00e37f3890 trap() at trap+0x2a5/frame 0xfffffe00e37f39a0 calltrap() at calltrap+0x8/frame 0xfffffe00e37f39a0 --- trap 0xc, rip = 0xffffffff80ee9909, rsp = 0xfffffe00e37f3a70, rbp = 0xfffffe00e37f3a90 --- ufs_reclaim() at ufs_reclaim+0x79/frame 0xfffffe00e37f3a90 VOP_RECLAIM_APV() at VOP_RECLAIM_APV+0x59/frame 0xfffffe00e37f3ab0 vgonel() at vgonel+0x3b7/frame 0xfffffe00e37f3b10 vnlru_proc() at vnlru_proc+0x7fb/frame 0xfffffe00e37f3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e37f3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e37f3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command su pid 2445 tid 100227 td 0xfffffe00e64e9800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e60366e0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e37f2dd0 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e37f2de0 trap() at trap+0x6c/frame 0xfffffe00e37f2ef0 calltrap() at calltrap+0x8/frame 0xfffffe00e37f2ef0 --- trap 0xc, rip = 0xffffffff81038f80, rsp = 0xfffffe00e37f2fc0, rbp = 0xfffffe00e37f3050 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe00e37f3050 db_get_value() at db_get_value+0x32/frame 0xfffffe00e37f3090 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00e37f3120 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e37f3140 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e37f31e0 db_command() at db_command+0x25c/frame 0xfffffe00e37f32b0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00e37f3350 db_command() at db_command+0x25c/frame 0xfffffe00e37f3420 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e37f3430 db_trap() at db_trap+0xe8/frame 0xfffffe00e37f34c0 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00e37f3530 trap() at trap+0x7b8/frame 0xfffffe00e37f3640 calltrap() at calltrap+0x8/frame 0xfffffe00e37f3640 --- trap 0x3, rip = 0xffffffff80c0ab97, rsp = 0xfffffe00e37f3710, rbp = 0xfffffe00e37f3720 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e37f3720 vpanic() at vpanic+0x19e/frame 0xfffffe00e37f3770 panic() at panic+0x43/frame 0xfffffe00e37f37d0 trap_fatal() at trap_fatal+0x387/frame 0xfffffe00e37f3830 trap_pfault() at trap_pfault+0x99/frame 0xfffffe00e37f3890 trap() at trap+0x2a5/frame 0xfffffe00e37f39a0 calltrap() at calltrap+0x8/frame 0xfffffe00e37f39a0 --- trap 0xc, rip = 0xffffffff80ee9909, rsp = 0xfffffe00e37f3a70, rbp = 0xfffffe00e37f3a90 --- ufs_reclaim() at ufs_reclaim+0x79/frame 0xfffffe00e37f3a90 VOP_RECLAIM_APV() at VOP_RECLAIM_APV+0x59/frame 0xfffffe00e37f3ab0 vgonel() at vgonel+0x3b7/frame 0xfffffe00e37f3b10 vnlru_proc() at vnlru_proc+0x7fb/frame 0xfffffe00e37f3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e37f3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e37f3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00e60366e8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e37f3040 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e37f3050 db_get_value() at db_get_value+0x4c/frame 0xfffffe00e37f3090 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00e37f3120 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e37f3140 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e37f31e0 db_command() at db_command+0x25c/frame 0xfffffe00e37f32b0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00e37f3350 db_command() at db_command+0x25c/frame 0xfffffe00e37f3420 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e37f3430 db_trap() at db_trap+0xe8/frame 0xfffffe00e37f34c0 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00e37f3530 trap() at trap+0x7b8/frame 0xfffffe00e37f3640 calltrap() at calltrap+0x8/frame 0xfffffe00e37f3640 --- trap 0x3, rip = 0xffffffff80c0ab97, rsp = 0xfffffe00e37f3710, rbp = 0xfffffe00e37f3720 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e37f3720 vpanic() at vpanic+0x19e/frame 0xfffffe00e37f3770 panic() at panic+0x43/frame 0xfffffe00e37f37d0 trap_fatal() at trap_fatal+0x387/frame 0xfffffe00e37f3830 trap_pfault() at trap_pfault+0x99/frame 0xfffffe00e37f3890 trap() at trap+0x2a5/frame 0xfffffe00e37f39a0 calltrap() at calltrap+0x8/frame 0xfffffe00e37f39a0 --- trap 0xc, rip = 0xffffffff80ee9909, rsp = 0xfffffe00e37f3a70, rbp = 0xfffffe00e37f3a90 --- ufs_reclaim() at ufs_reclaim+0x79/frame 0xfffffe00e37f3a90 VOP_RECLAIM_APV() at VOP_RECLAIM_APV+0x59/frame 0xfffffe00e37f3ab0 vgonel() at vgonel+0x3b7/frame 0xfffffe00e37f3b10 vnlru_proc() at vnlru_proc+0x7fb/frame 0xfffffe00e37f3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e37f3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e37f3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bash pid 2440 tid 100161 td 0xfffffe00d35e1100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e385e6e0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e37f2dd0 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e37f2de0 trap() at trap+0x6c/frame 0xfffffe00e37f2ef0 calltrap() at calltrap+0x8/frame 0xfffffe00e37f2ef0 --- trap 0xc, rip = 0xffffffff81038f80, rsp = 0xfffffe00e37f2fc0, rbp = 0xfffffe00e37f3050 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe00e37f3050 db_get_value() at db_get_value+0x32/frame 0xfffffe00e37f3090 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00e37f3120 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e37f3140 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e37f31e0 db_command() at db_command+0x25c/frame 0xfffffe00e37f32b0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00e37f3350 db_command() at db_command+0x25c/frame 0xfffffe00e37f3420 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e37f3430 db_trap() at db_trap+0xe8/frame 0xfffffe00e37f34c0 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00e37f3530 trap() at trap+0x7b8/frame 0xfffffe00e37f3640 calltrap() at calltrap+0x8/frame 0xfffffe00e37f3640 --- trap 0x3, rip = 0xffffffff80c0ab97, rsp = 0xfffffe00e37f3710, rbp = 0xfffffe00e37f3720 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e37f3720 vpanic() at vpanic+0x19e/frame 0xfffffe00e37f3770 panic() at panic+0x43/frame 0xfffffe00e37f37d0 trap_fatal() at trap_fatal+0x387/frame 0xfffffe00e37f3830 trap_pfault() at trap_pfault+0x99/frame 0xfffffe00e37f3890 trap() at trap+0x2a5/frame 0xfffffe00e37f39a0 calltrap() at calltrap+0x8/frame 0xfffffe00e37f39a0 --- trap 0xc, rip = 0xffffffff80ee9909, rsp = 0xfffffe00e37f3a70, rbp = 0xfffffe00e37f3a90 --- ufs_reclaim() at ufs_reclaim+0x79/frame 0xfffffe00e37f3a90 VOP_RECLAIM_APV() at VOP_RECLAIM_APV+0x59/frame 0xfffffe00e37f3ab0 vgonel() at vgonel+0x3b7/frame 0xfffffe00e37f3b10 vnlru_proc() at vnlru_proc+0x7fb/frame 0xfffffe00e37f3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e37f3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e37f3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00e385e6e8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e37f3040 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e37f3050 db_get_value() at db_get_value+0x4c/frame 0xfffffe00e37f3090 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00e37f3120 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e37f3140 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e37f31e0 db_command() at db_command+0x25c/frame 0xfffffe00e37f32b0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00e37f3350 db_command() at db_command+0x25c/frame 0xfffffe00e37f3420 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e37f3430 db_trap() at db_trap+0xe8/frame 0xfffffe00e37f34c0 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00e37f3530 trap() at trap+0x7b8/frame 0xfffffe00e37f3640 calltrap() at calltrap+0x8/frame 0xfffffe00e37f3640 --- trap 0x3, rip = 0xffffffff80c0ab97, rsp = 0xfffffe00e37f3710, rbp = 0xfffffe00e37f3720 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e37f3720 vpanic() at vpanic+0x19e/frame 0xfffffe00e37f3770 panic() at panic+0x43/frame 0xfffffe00e37f37d0 trap_fatal() at trap_fatal+0x387/frame 0xfffffe00e37f3830 trap_pfault() at trap_pfault+0x99/frame 0xfffffe00e37f3890 trap() at trap+0x2a5/frame 0xfffffe00e37f39a0 calltrap() at calltrap+0x8/frame 0xfffffe00e37f39a0 --- trap 0xc, rip = 0xffffffff80ee9909, rsp = 0xfffffe00e37f3a70, rbp = 0xfffffe00e37f3a90 --- ufs_reclaim() at ufs_reclaim+0x79/frame 0xfffffe00e37f3a90 VOP_RECLAIM_APV() at VOP_RECLAIM_APV+0x59/frame 0xfffffe00e37f3ab0 vgonel() at vgonel+0x3b7/frame 0xfffffe00e37f3b10 vnlru_proc() at vnlru_proc+0x7fb/frame 0xfffffe00e37f3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e37f3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e37f3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sshd pid 2439 tid 100225 td 0xfffffe00e44b7700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e602c740 mi_switch() at mi_switch+0x155/frame 0xfffffe00e602c760 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e602c7a0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e602c800 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e602c810 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e602c870 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e602c8b0 kern_select() at kern_select+0x87a/frame 0xfffffe00e602ca90 sys_select() at sys_select+0x56/frame 0xfffffe00e602cad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e602cbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e602cbf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8008e17fa, rsp = 0x7fffffffa548, rbp = 0x7fffffffa580 --- Tracing command sshd pid 2436 tid 100162 td 0xfffffe00e3a7f100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e38637c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e38637e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e3863820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e3863880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e3863890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e38638f0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e3863930 kern_poll() at kern_poll+0x48b/frame 0xfffffe00e3863ab0 sys_poll() at sys_poll+0x50/frame 0xfffffe00e3863ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e3863bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3863bf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x80088500a, rsp = 0x7fffffffe5a8, rbp = 0x7fffffffe5e0 --- Tracing command csh pid 2432 tid 100208 td 0xfffffe00e64e6700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e39cd7c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e39cd7e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e39cd820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e39cd880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e39cd890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e39cd8f0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e39cd920 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e39cd980 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e39cd9b0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e39cda10 dofileread() at dofileread+0x81/frame 0xfffffe00e39cda60 sys_read() at sys_read+0xc0/frame 0xfffffe00e39cdad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e39cdbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e39cdbf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80051081a, rsp = 0x7fffffffe1e8, rbp = 0x7fffffffe210 --- Tracing command login pid 2431 tid 100223 td 0xfffffe00e64afc00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e60226e0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e37f2dd0 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e37f2de0 trap() at trap+0x6c/frame 0xfffffe00e37f2ef0 calltrap() at calltrap+0x8/frame 0xfffffe00e37f2ef0 --- trap 0xc, rip = 0xffffffff81038f80, rsp = 0xfffffe00e37f2fc0, rbp = 0xfffffe00e37f3050 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe00e37f3050 db_get_value() at db_get_value+0x32/frame 0xfffffe00e37f3090 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00e37f3120 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e37f3140 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e37f31e0 db_command() at db_command+0x25c/frame 0xfffffe00e37f32b0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00e37f3350 db_command() at db_command+0x25c/frame 0xfffffe00e37f3420 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e37f3430 db_trap() at db_trap+0xe8/frame 0xfffffe00e37f34c0 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00e37f3530 trap() at trap+0x7b8/frame 0xfffffe00e37f3640 calltrap() at calltrap+0x8/frame 0xfffffe00e37f3640 --- trap 0x3, rip = 0xffffffff80c0ab97, rsp = 0xfffffe00e37f3710, rbp = 0xfffffe00e37f3720 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e37f3720 vpanic() at vpanic+0x19e/frame 0xfffffe00e37f3770 panic() at panic+0x43/frame 0xfffffe00e37f37d0 trap_fatal() at trap_fatal+0x387/frame 0xfffffe00e37f3830 trap_pfault() at trap_pfault+0x99/frame 0xfffffe00e37f3890 trap() at trap+0x2a5/frame 0xfffffe00e37f39a0 calltrap() at calltrap+0x8/frame 0xfffffe00e37f39a0 --- trap 0xc, rip = 0xffffffff80ee9909, rsp = 0xfffffe00e37f3a70, rbp = 0xfffffe00e37f3a90 --- ufs_reclaim() at ufs_reclaim+0x79/frame 0xfffffe00e37f3a90 VOP_RECLAIM_APV() at VOP_RECLAIM_APV+0x59/frame 0xfffffe00e37f3ab0 vgonel() at vgonel+0x3b7/frame 0xfffffe00e37f3b10 vnlru_proc() at vnlru_proc+0x7fb/frame 0xfffffe00e37f3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e37f3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e37f3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00e60226e8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e37f3040 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e37f3050 db_get_value() at db_get_value+0x4c/frame 0xfffffe00e37f3090 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00e37f3120 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e37f3140 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e37f31e0 db_command() at db_command+0x25c/frame 0xfffffe00e37f32b0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00e37f3350 db_command() at db_command+0x25c/frame 0xfffffe00e37f3420 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e37f3430 db_trap() at db_trap+0xe8/frame 0xfffffe00e37f34c0 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00e37f3530 trap() at trap+0x7b8/frame 0xfffffe00e37f3640 calltrap() at calltrap+0x8/frame 0xfffffe00e37f3640 --- trap 0x3, rip = 0xffffffff80c0ab97, rsp = 0xfffffe00e37f3710, rbp = 0xfffffe00e37f3720 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e37f3720 vpanic() at vpanic+0x19e/frame 0xfffffe00e37f3770 panic() at panic+0x43/frame 0xfffffe00e37f37d0 trap_fatal() at trap_fatal+0x387/frame 0xfffffe00e37f3830 trap_pfault() at trap_pfault+0x99/frame 0xfffffe00e37f3890 trap() at trap+0x2a5/frame 0xfffffe00e37f39a0 calltrap() at calltrap+0x8/frame 0xfffffe00e37f39a0 --- trap 0xc, rip = 0xffffffff80ee9909, rsp = 0xfffffe00e37f3a70, rbp = 0xfffffe00e37f3a90 --- ufs_reclaim() at ufs_reclaim+0x79/frame 0xfffffe00e37f3a90 VOP_RECLAIM_APV() at VOP_RECLAIM_APV+0x59/frame 0xfffffe00e37f3ab0 vgonel() at vgonel+0x3b7/frame 0xfffffe00e37f3b10 vnlru_proc() at vnlru_proc+0x7fb/frame 0xfffffe00e37f3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e37f3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e37f3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command getty pid 2430 tid 100222 td 0xfffffe00e64b0300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e601d7c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e601d7e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e601d820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e601d880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e601d890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e601d8f0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e601d920 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e601d980 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e601d9b0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e601da10 dofileread() at dofileread+0x81/frame 0xfffffe00e601da60 sys_read() at sys_read+0xc0/frame 0xfffffe00e601dad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e601dbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e601dbf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043781a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2429 tid 100221 td 0xfffffe00e64b0a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e60187c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e60187e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e6018820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e6018880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e6018890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e60188f0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e6018920 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e6018980 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e60189b0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e6018a10 dofileread() at dofileread+0x81/frame 0xfffffe00e6018a60 sys_read() at sys_read+0xc0/frame 0xfffffe00e6018ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e6018bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e6018bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043781a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2428 tid 100220 td 0xfffffe00e64b1100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e60137c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e60137e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e6013820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e6013880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e6013890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e60138f0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e6013920 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e6013980 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e60139b0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e6013a10 dofileread() at dofileread+0x81/frame 0xfffffe00e6013a60 sys_read() at sys_read+0xc0/frame 0xfffffe00e6013ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e6013bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e6013bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043781a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2427 tid 100214 td 0xfffffe00e64b1800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e39f77c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e39f77e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e39f7820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e39f7880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e39f7890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e39f78f0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e39f7920 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e39f7980 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e39f79b0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e39f7a10 dofileread() at dofileread+0x81/frame 0xfffffe00e39f7a60 sys_read() at sys_read+0xc0/frame 0xfffffe00e39f7ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e39f7bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e39f7bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043781a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2426 tid 100209 td 0xfffffe00e3fc7800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e39d27c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e39d27e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e39d2820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e39d2880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e39d2890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e39d28f0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e39d2920 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e39d2980 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e39d29b0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e39d2a10 dofileread() at dofileread+0x81/frame 0xfffffe00e39d2a60 sys_read() at sys_read+0xc0/frame 0xfffffe00e39d2ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e39d2bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e39d2bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043781a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2425 tid 100216 td 0xfffffe00e4497300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e60047c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e60047e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e6004820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e6004880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e6004890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e60048f0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e6004920 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e6004980 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e60049b0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e6004a10 dofileread() at dofileread+0x81/frame 0xfffffe00e6004a60 sys_read() at sys_read+0xc0/frame 0xfffffe00e6004ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e6004bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e6004bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043781a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2424 tid 100217 td 0xfffffe00e4496c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e60097c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e60097e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e6009820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e6009880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e6009890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e60098f0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e6009920 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e6009980 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e60099b0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e6009a10 dofileread() at dofileread+0x81/frame 0xfffffe00e6009a60 sys_read() at sys_read+0xc0/frame 0xfffffe00e6009ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e6009bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e6009bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043781a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2423 tid 100218 td 0xfffffe00e4496500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e600e7c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e600e7e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e600e820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e600e880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e600e890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e600e8f0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e600e920 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e600e980 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e600e9b0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e600ea10 dofileread() at dofileread+0x81/frame 0xfffffe00e600ea60 sys_read() at sys_read+0xc0/frame 0xfffffe00e600ead0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e600ebf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e600ebf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043781a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2422 tid 100142 td 0xfffffe00d39fd500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e37fd7c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e37fd7e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e37fd820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e37fd880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e37fd890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e37fd8f0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e37fd920 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e37fd980 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e37fd9b0 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e37fda10 dofileread() at dofileread+0x81/frame 0xfffffe00e37fda60 sys_read() at sys_read+0xc0/frame 0xfffffe00e37fdad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e37fdbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e37fdbf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043781a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command cron pid 2373 tid 100198 td 0xfffffe00e3fc8e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e396b870 mi_switch() at mi_switch+0x155/frame 0xfffffe00e396b890 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e396b8d0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e396b930 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e396b970 _sleep() at _sleep+0x258/frame 0xfffffe00e396ba10 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe00e396ba90 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00e396bad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e396bbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e396bbf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003dcbaa, rsp = 0x7fffffffeaa8, rbp = 0x7fffffffec90 --- Tracing command sshd pid 2369 tid 100185 td 0xfffffe00e3fc6300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e3912740 mi_switch() at mi_switch+0x155/frame 0xfffffe00e3912760 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e39127a0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e3912800 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e3912810 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e3912870 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e39128b0 kern_select() at kern_select+0x87a/frame 0xfffffe00e3912a90 sys_select() at sys_select+0x56/frame 0xfffffe00e3912ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e3912bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3912bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8008e17fa, rsp = 0x7fffffffe638, rbp = 0x7fffffffe670 --- Tracing command powerd pid 2341 tid 100213 td 0xfffffe00e64e6000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e39f2700 mi_switch() at mi_switch+0x155/frame 0xfffffe00e39f2720 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e39f2760 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e39f27c0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e39f2800 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00e39f2870 seltdwait() at seltdwait+0x6b/frame 0xfffffe00e39f28b0 kern_select() at kern_select+0x87a/frame 0xfffffe00e39f2a90 sys_select() at sys_select+0x56/frame 0xfffffe00e39f2ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e39f2bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e39f2bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8004347fa, rsp = 0x7fffffffeb58, rbp = 0x7fffffffeca0 --- Tracing command ntpd pid 2338 tid 100165 td 0xfffffe00d31a7100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e3872740 mi_switch() at mi_switch+0x155/frame 0xfffffe00e3872760 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e38727a0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e3872800 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e3872810 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e3872870 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e38728b0 kern_select() at kern_select+0x87a/frame 0xfffffe00e3872a90 sys_select() at sys_select+0x56/frame 0xfffffe00e3872ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e3872bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3872bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80080f7fa, rsp = 0x7fffffffdec8, rbp = 0x7fffffffdf00 --- Tracing command rpc.lockd pid 2273 tid 100154 td 0xfffffe00e4498100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e383b640 mi_switch() at mi_switch+0x155/frame 0xfffffe00e383b660 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e383b6a0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e383b700 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e383b740 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00e383b7b0 svc_run_internal() at svc_run_internal+0xb05/frame 0xfffffe00e383b8f0 svc_run() at svc_run+0x253/frame 0xfffffe00e383b950 sys_nlm_syscall() at sys_nlm_syscall+0x74d/frame 0xfffffe00e383bad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e383bbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e383bbf0 --- syscall (154, FreeBSD ELF64, sys_nlm_syscall), rip = 0x8002f9b5a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec90 --- Tracing command rpc.statd pid 2270 tid 100190 td 0xfffffe00e64af500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e3937700 mi_switch() at mi_switch+0x155/frame 0xfffffe00e3937720 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e3937760 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e39377c0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e3937800 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00e3937870 seltdwait() at seltdwait+0x6b/frame 0xfffffe00e39378b0 kern_select() at kern_select+0x87a/frame 0xfffffe00e3937a90 sys_select() at sys_select+0x56/frame 0xfffffe00e3937ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e3937bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3937bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80042a7fa, rsp = 0x7fffffffea68, rbp = 0x7fffffffebb0 --- Tracing command watchdogd pid 2224 tid 100144 td 0xfffffe00d35e6e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e3809870 mi_switch() at mi_switch+0x155/frame 0xfffffe00e3809890 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e38098d0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e3809930 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e3809970 _sleep() at _sleep+0x258/frame 0xfffffe00e3809a10 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe00e3809a90 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00e3809ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e3809bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3809bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003c5baa, rsp = 0x7fffffffea68, rbp = 0x7fffffffeab0 --- Tracing command rpcbind pid 2076 tid 100171 td 0xfffffe00d39fc700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e389c780 mi_switch() at mi_switch+0x155/frame 0xfffffe00e389c7a0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e389c7e0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e389c840 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e389c880 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00e389c8f0 seltdwait() at seltdwait+0x6b/frame 0xfffffe00e389c930 kern_poll() at kern_poll+0x48b/frame 0xfffffe00e389cab0 sys_poll() at sys_poll+0x50/frame 0xfffffe00e389cad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e389cbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e389cbf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003d300a, rsp = 0x7fffffffca08, rbp = 0x7fffffffec20 --- Tracing command syslogd pid 2066 tid 100196 td 0xfffffe00d61fac00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e3955740 mi_switch() at mi_switch+0x155/frame 0xfffffe00e3955760 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e39557a0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e3955800 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e3955810 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e3955870 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e39558b0 kern_select() at kern_select+0x87a/frame 0xfffffe00e3955a90 sys_select() at sys_select+0x56/frame 0xfffffe00e3955ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e3955bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3955bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80043d7fa, rsp = 0x7fffffffe718, rbp = 0x7fffffffec90 --- Tracing command devd pid 1995 tid 100173 td 0xfffffe00d5df7500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e38a6700 mi_switch() at mi_switch+0x155/frame 0xfffffe00e38a6720 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e38a6760 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e38a67c0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e38a6800 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00e38a6870 seltdwait() at seltdwait+0x6b/frame 0xfffffe00e38a68b0 kern_select() at kern_select+0x87a/frame 0xfffffe00e38a6a90 sys_select() at sys_select+0x56/frame 0xfffffe00e38a6ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e38a6bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e38a6bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x2f63aa, rsp = 0x7fffffffcb18, rbp = 0x7fffffffecb0 --- Tracing command dhclient pid 1990 tid 100195 td 0xfffffe00d61fb300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e3950780 mi_switch() at mi_switch+0x155/frame 0xfffffe00e39507a0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e39507e0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e3950840 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e3950880 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00e39508f0 seltdwait() at seltdwait+0x6b/frame 0xfffffe00e3950930 kern_poll() at kern_poll+0x48b/frame 0xfffffe00e3950ab0 sys_poll() at sys_poll+0x50/frame 0xfffffe00e3950ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e3950bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3950bf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003f800a, rsp = 0x7fffffffebf8, rbp = 0x7fffffffec30 --- Tracing command dhclient pid 1931 tid 100172 td 0xfffffe00d5df7c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e38a17c0 mi_switch() at mi_switch+0x155/frame 0xfffffe00e38a17e0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e38a1820 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e38a1880 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e38a1890 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e38a18f0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e38a1930 kern_poll() at kern_poll+0x48b/frame 0xfffffe00e38a1ab0 sys_poll() at sys_poll+0x50/frame 0xfffffe00e38a1ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e38a1bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e38a1bf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003f800a, rsp = 0x7fffffffec08, rbp = 0x7fffffffec30 --- Tracing command dhclient pid 1928 tid 100158 td 0xfffffe00d2d8b100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e384f740 mi_switch() at mi_switch+0x155/frame 0xfffffe00e384f760 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e384f7a0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e384f800 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e384f810 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e384f870 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e384f8b0 kern_select() at kern_select+0x87a/frame 0xfffffe00e384fa90 sys_select() at sys_select+0x56/frame 0xfffffe00e384fad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00e384fbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e384fbf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8004547fa, rsp = 0x7fffffffe9b8, rbp = 0x7fffffffea70 --- Tracing command vnlru pid 34 tid 100140 td 0xfffffe00d35df500 (CPU 0) kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e37f3720 vpanic() at vpanic+0x19e/frame 0xfffffe00e37f3770 panic() at panic+0x43/frame 0xfffffe00e37f37d0 trap_fatal() at trap_fatal+0x387/frame 0xfffffe00e37f3830 trap_pfault() at trap_pfault+0x99/frame 0xfffffe00e37f3890 trap() at trap+0x2a5/frame 0xfffffe00e37f39a0 calltrap() at calltrap+0x8/frame 0xfffffe00e37f39a0 --- trap 0xc, rip = 0xffffffff80ee9909, rsp = 0xfffffe00e37f3a70, rbp = 0xfffffe00e37f3a90 --- ufs_reclaim() at ufs_reclaim+0x79/frame 0xfffffe00e37f3a90 VOP_RECLAIM_APV() at VOP_RECLAIM_APV+0x59/frame 0xfffffe00e37f3ab0 vgonel() at vgonel+0x3b7/frame 0xfffffe00e37f3b10 vnlru_proc() at vnlru_proc+0x7fb/frame 0xfffffe00e37f3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e37f3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e37f3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command syncer pid 33 tid 100136 td 0xfffffe00d35dfc00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00ddffda10 mi_switch() at mi_switch+0x155/frame 0xfffffe00ddffda30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00ddffda70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00ddffdab0 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x184/frame 0xfffffe00ddffdb20 sched_sync() at sched_sync+0x67b/frame 0xfffffe00ddffdbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00ddffdbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ddffdbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100130 td 0xfffffe00d35e0300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d743da20 mi_switch() at mi_switch+0x155/frame 0xfffffe00d743da40 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d743da80 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00d743dac0 _sleep() at _sleep+0x26c/frame 0xfffffe00d743db60 buf_daemon() at buf_daemon+0x112/frame 0xfffffe00d743dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d743dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d743dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100131 td 0xfffffe00d35e4300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00ddf84a10 mi_switch() at mi_switch+0x155/frame 0xfffffe00ddf84a30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00ddf84a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00ddf84ab0 _sleep() at _sleep+0x26c/frame 0xfffffe00ddf84b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00ddf84bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00ddf84bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ddf84bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100132 td 0xfffffe00d35e3c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00ddf89a10 mi_switch() at mi_switch+0x155/frame 0xfffffe00ddf89a30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00ddf89a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00ddf89ab0 _sleep() at _sleep+0x26c/frame 0xfffffe00ddf89b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00ddf89bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00ddf89bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ddf89bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100133 td 0xfffffe00d35e3500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00ddfeea10 mi_switch() at mi_switch+0x155/frame 0xfffffe00ddfeea30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00ddfeea70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00ddfeeab0 _sleep() at _sleep+0x26c/frame 0xfffffe00ddfeeb50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00ddfeebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00ddfeebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ddfeebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100134 td 0xfffffe00d35e2e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00ddff3a10 mi_switch() at mi_switch+0x155/frame 0xfffffe00ddff3a30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00ddff3a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00ddff3ab0 _sleep() at _sleep+0x26c/frame 0xfffffe00ddff3b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00ddff3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00ddff3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ddff3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100137 td 0xfffffe00d35e2700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e37e4a10 mi_switch() at mi_switch+0x155/frame 0xfffffe00e37e4a30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e37e4a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e37e4ab0 _sleep() at _sleep+0x26c/frame 0xfffffe00e37e4b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00e37e4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e37e4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e37e4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100138 td 0xfffffe00d35e2000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e37e9a10 mi_switch() at mi_switch+0x155/frame 0xfffffe00e37e9a30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e37e9a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e37e9ab0 _sleep() at _sleep+0x26c/frame 0xfffffe00e37e9b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00e37e9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e37e9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e37e9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100139 td 0xfffffe00d35e1800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e37eea10 mi_switch() at mi_switch+0x155/frame 0xfffffe00e37eea30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e37eea70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e37eeab0 _sleep() at _sleep+0x26c/frame 0xfffffe00e37eeb50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00e37eebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e37eebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e37eebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100150 td 0xfffffe00d2d8b800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e3827a40 mi_switch() at mi_switch+0x155/frame 0xfffffe00e3827a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e3827aa0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e3827ae0 _sleep() at _sleep+0x26c/frame 0xfffffe00e3827b80 softdep_flush() at softdep_flush+0x16e/frame 0xfffffe00e3827bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e3827bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e3827bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100211 td 0xfffffe00e3fc1500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e39e8a40 mi_switch() at mi_switch+0x155/frame 0xfffffe00e39e8a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e39e8aa0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e39e8ae0 _sleep() at _sleep+0x26c/frame 0xfffffe00e39e8b80 softdep_flush() at softdep_flush+0x16e/frame 0xfffffe00e39e8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e39e8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e39e8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vmdaemon pid 31 tid 100129 td 0xfffffe00d35e0a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d7438a40 mi_switch() at mi_switch+0x155/frame 0xfffffe00d7438a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d7438aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe00d7438b40 vm_daemon() at vm_daemon+0x82/frame 0xfffffe00d7438bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d7438bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d7438bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100128 td 0xfffffe00d6092e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d7433670 mi_switch() at mi_switch+0x155/frame 0xfffffe00d7433690 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d74336d0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00d7433710 _sleep() at _sleep+0x26c/frame 0xfffffe00d74337b0 vm_pageout_worker() at vm_pageout_worker+0x279/frame 0xfffffe00d7433b70 vm_pageout() at vm_pageout+0x193/frame 0xfffffe00d7433bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d7433bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d7433bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100135 td 0xfffffe00d35e7c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00ddff8830 mi_switch() at mi_switch+0x155/frame 0xfffffe00ddff8850 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00ddff8890 _sleep() at _sleep+0x2cd/frame 0xfffffe00ddff8930 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0xc11/frame 0xfffffe00ddff8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00ddff8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ddff8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100141 td 0xfffffe00d35e7500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e37f8a40 mi_switch() at mi_switch+0x155/frame 0xfffffe00e37f8a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e37f8aa0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e37f8ae0 _sleep() at _sleep+0x26c/frame 0xfffffe00e37f8b80 uma_reclaim_worker() at uma_reclaim_worker+0xb8/frame 0xfffffe00e37f8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e37f8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e37f8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon1 pid 29 tid 100127 td 0xfffffe00d5df9100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d742ea40 mi_switch() at mi_switch+0x155/frame 0xfffffe00d742ea60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d742eaa0 _sleep() at _sleep+0x2cd/frame 0xfffffe00d742eb40 enc_daemon() at enc_daemon+0xe4/frame 0xfffffe00d742ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d742ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d742ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon0 pid 28 tid 100126 td 0xfffffe00d61fc800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d7429a40 mi_switch() at mi_switch+0x155/frame 0xfffffe00d7429a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d7429aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe00d7429b40 enc_daemon() at enc_daemon+0xe4/frame 0xfffffe00d7429bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d7429bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d7429bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command rand_harvestq pid 27 tid 100120 td 0xfffffe00d6095800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037bfb9f0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037bfba10 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bfba50 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037bfba90 _sleep() at _sleep+0x26c/frame 0xfffffe0037bfbb30 random_kthread() at random_kthread+0x67/frame 0xfffffe0037bfbbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bfbbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bfbbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sctp_iterator pid 26 tid 100119 td 0xfffffe00d61f9000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037bf6a90 mi_switch() at mi_switch+0x155/frame 0xfffffe0037bf6ab0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bf6af0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037bf6b90 sctp_iterator_thread() at sctp_iterator_thread+0x59/frame 0xfffffe0037bf6bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bf6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bf6bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod4 pid 25 tid 100118 td 0xfffffe00d6092000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037bf1a30 mi_switch() at mi_switch+0x155/frame 0xfffffe0037bf1a50 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bf1a90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037bf1ad0 _sleep() at _sleep+0x26c/frame 0xfffffe0037bf1b70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe0037bf1bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bf1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bf1bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod3 pid 24 tid 100117 td 0xfffffe00d6092700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037beca30 mi_switch() at mi_switch+0x155/frame 0xfffffe0037beca50 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037beca90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037becad0 _sleep() at _sleep+0x26c/frame 0xfffffe0037becb70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe0037becbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037becbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037becbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod2 pid 23 tid 100116 td 0xfffffe003e45ec00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037be7a30 mi_switch() at mi_switch+0x155/frame 0xfffffe0037be7a50 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037be7a90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037be7ad0 _sleep() at _sleep+0x26c/frame 0xfffffe0037be7b70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe0037be7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037be7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037be7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod1 pid 22 tid 100115 td 0xfffffe003e45f300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037be2a30 mi_switch() at mi_switch+0x155/frame 0xfffffe0037be2a50 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037be2a90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037be2ad0 _sleep() at _sleep+0x26c/frame 0xfffffe0037be2b70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe0037be2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037be2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037be2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100096 td 0xfffffe00d2d89500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b77ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b77ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b77b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b77b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b77bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b77bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b77bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100097 td 0xfffffe00d2d88e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b7cab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b7cad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b7cb10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b7cb70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b7cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b7cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b7cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100098 td 0xfffffe00d2d88700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b81ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b81ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b81b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b81b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b81bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b81bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b81bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100099 td 0xfffffe00d2d88000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b86ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b86ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b86b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b86b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b86bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b86bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b86bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100100 td 0xfffffe003e1aa800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b8bab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b8bad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b8bb10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b8bb70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b8bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b8bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b8bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100102 td 0xfffffe003e1a9a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b95ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b95ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b95b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b95b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b95bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b95bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b95bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100103 td 0xfffffe00d2e1a500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b9aab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b9aad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b9ab10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b9ab70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b9abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b9abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b9abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100104 td 0xfffffe00d2e19e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b9fab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b9fad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b9fb10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b9fb70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b9fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b9fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b9fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100105 td 0xfffffe00d2e19700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037ba4ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037ba4ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ba4b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037ba4b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037ba4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ba4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ba4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100106 td 0xfffffe00d2e19000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037ba9ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037ba9ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ba9b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037ba9b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037ba9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ba9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ba9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100107 td 0xfffffe00d31a4e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037bbaab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037bbaad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bbab10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037bbab70 usb_process() at usb_process+0xc3/frame 0xfffffe0037bbabb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bbabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bbabf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100108 td 0xfffffe00d31a4700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037bbfab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037bbfad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bbfb10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037bbfb70 usb_process() at usb_process+0xc3/frame 0xfffffe0037bbfbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bbfbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bbfbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100109 td 0xfffffe00d31a4000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037bc4ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037bc4ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bc4b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037bc4b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037bc4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bc4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bc4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100110 td 0xfffffe00d2e1c800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037bc9ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037bc9ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bc9b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037bc9b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037bc9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bc9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bc9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100111 td 0xfffffe00d2e1c100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037bceab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037bcead0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bceb10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037bceb70 usb_process() at usb_process+0xc3/frame 0xfffffe0037bcebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bcebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bcebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100091 td 0xfffffe003e1a7700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b5ea60 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b5ea80 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b5eac0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b5eb60 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe0037b5ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b5ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b5ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100092 td 0xfffffe003e1a7000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b63a60 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b63a80 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b63ac0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b63b60 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe0037b63bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b63bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b63bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100093 td 0xfffffe003e1b6800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b68a60 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b68a80 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b68ac0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b68b60 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe0037b68bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b68bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b68bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100125 td 0xfffffe00d6093500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d7424a70 mi_switch() at mi_switch+0x155/frame 0xfffffe00d7424a90 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d7424ad0 _sleep() at _sleep+0x2cd/frame 0xfffffe00d7424b70 xpt_scanner_thread() at xpt_scanner_thread+0x68/frame 0xfffffe00d7424bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d7424bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d7424bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 11 pid 19 tid 100090 td 0xfffffe003e1a7e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b59a40 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b59a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b59aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b59b40 crypto_ret_proc() at crypto_ret_proc+0x240/frame 0xfffffe0037b59bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b59bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b59bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 10 pid 18 tid 100089 td 0xfffffe003e1a8500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b54a40 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b54a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b54aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b54b40 crypto_ret_proc() at crypto_ret_proc+0x240/frame 0xfffffe0037b54bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b54bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b54bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 9 pid 17 tid 100088 td 0xfffffe003e1a8c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b4fa40 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b4fa60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b4faa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b4fb40 crypto_ret_proc() at crypto_ret_proc+0x240/frame 0xfffffe0037b4fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b4fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b4fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 8 pid 16 tid 100087 td 0xfffffe003e1a9300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b4aa40 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b4aa60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b4aaa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b4ab40 crypto_ret_proc() at crypto_ret_proc+0x240/frame 0xfffffe0037b4abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b4abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b4abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 7 pid 15 tid 100086 td 0xfffffe003e1c2800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b45a40 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b45a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b45aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b45b40 crypto_ret_proc() at crypto_ret_proc+0x240/frame 0xfffffe0037b45bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b45bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b45bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 6 pid 9 tid 100085 td 0xfffffe003e1b3000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b40a40 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b40a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b40aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b40b40 crypto_ret_proc() at crypto_ret_proc+0x240/frame 0xfffffe0037b40bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b40bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b40bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 5 pid 8 tid 100084 td 0xfffffe003e1b3700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b3ba40 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b3ba60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b3baa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b3bb40 crypto_ret_proc() at crypto_ret_proc+0x240/frame 0xfffffe0037b3bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b3bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b3bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 4 pid 7 tid 100083 td 0xfffffe003e1b3e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b36a40 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b36a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b36aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b36b40 crypto_ret_proc() at crypto_ret_proc+0x240/frame 0xfffffe0037b36bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b36bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b36bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 3 pid 6 tid 100082 td 0xfffffe003e1b4500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b31a40 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b31a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b31aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b31b40 crypto_ret_proc() at crypto_ret_proc+0x240/frame 0xfffffe0037b31bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b31bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b31bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 2 pid 5 tid 100081 td 0xfffffe003e1b4c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b2ca40 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b2ca60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b2caa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b2cb40 crypto_ret_proc() at crypto_ret_proc+0x240/frame 0xfffffe0037b2cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b2cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b2cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 1 pid 4 tid 100080 td 0xfffffe003e1b5300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b27a40 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b27a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b27aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b27b40 crypto_ret_proc() at crypto_ret_proc+0x240/frame 0xfffffe0037b27bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b27bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b27bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 0 pid 3 tid 100079 td 0xfffffe003e1b5a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b22a40 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b22a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b22aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b22b40 crypto_ret_proc() at crypto_ret_proc+0x240/frame 0xfffffe0037b22bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b22bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b22bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 2 tid 100078 td 0xfffffe003e1bf000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b1da70 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b1da90 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b1dad0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b1db70 crypto_proc() at crypto_proc+0x24b/frame 0xfffffe0037b1dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b1dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b1dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sequencer 00 pid 14 tid 100065 td 0xfffffe003e1e5a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037adca70 mi_switch() at mi_switch+0x155/frame 0xfffffe0037adca90 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037adcad0 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037adcb30 seq_eventthread() at seq_eventthread+0x91/frame 0xfffffe0037adcbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037adcbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037adcbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100062 td 0xfffffe003e1efe00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037acda70 mi_switch() at mi_switch+0x155/frame 0xfffffe0037acda90 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037acdad0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037acdb70 g_run_events() at g_run_events+0x64/frame 0xfffffe0037acdbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037acdbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037acdbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100063 td 0xfffffe003e1e6800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037ad2a70 mi_switch() at mi_switch+0x155/frame 0xfffffe0037ad2a90 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ad2ad0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ad2b70 g_io_schedule_up() at g_io_schedule_up+0x3c/frame 0xfffffe0037ad2ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe0037ad2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ad2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ad2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100064 td 0xfffffe003e1e6100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037ad7a70 mi_switch() at mi_switch+0x155/frame 0xfffffe0037ad7a90 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ad7ad0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ad7b70 g_io_schedule_down() at g_io_schedule_down+0x4c/frame 0xfffffe0037ad7ba0 g_down_procbody() at g_down_procbody+0x5c/frame 0xfffffe0037ad7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ad7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ad7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100043 td 0xfffffe003e463000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037a0eb00 mi_switch() at mi_switch+0x155/frame 0xfffffe0037a0eb20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037a0ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a0ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a0ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100044 td 0xfffffe003e460800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037a13b00 mi_switch() at mi_switch+0x155/frame 0xfffffe0037a13b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037a13bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a13bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a13bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100046 td 0xfffffe003e45fa00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100047 td 0xfffffe003e1ef700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037a52b00 mi_switch() at mi_switch+0x155/frame 0xfffffe0037a52b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037a52bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a52bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a52bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100048 td 0xfffffe003e1ef000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037a57b00 mi_switch() at mi_switch+0x155/frame 0xfffffe0037a57b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037a57bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a57bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a57bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100049 td 0xfffffe003e466800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037a5cb00 mi_switch() at mi_switch+0x155/frame 0xfffffe0037a5cb20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037a5cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a5cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a5cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100050 td 0xfffffe003e466100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037a61b00 mi_switch() at mi_switch+0x155/frame 0xfffffe0037a61b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037a61bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a61bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a61bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100051 td 0xfffffe003e465a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037a66b00 mi_switch() at mi_switch+0x155/frame 0xfffffe0037a66b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037a66bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a66bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a66bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100052 td 0xfffffe003e465300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037a6bb00 mi_switch() at mi_switch+0x155/frame 0xfffffe0037a6bb20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037a6bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a6bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a6bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100053 td 0xfffffe003e464c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037a70b00 mi_switch() at mi_switch+0x155/frame 0xfffffe0037a70b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037a70bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a70bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a70bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100054 td 0xfffffe003e464500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037a75b00 mi_switch() at mi_switch+0x155/frame 0xfffffe0037a75b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037a75bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a75bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a75bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100055 td 0xfffffe003e1e3000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037a7ab00 mi_switch() at mi_switch+0x155/frame 0xfffffe0037a7ab20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037a7abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a7abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a7abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100056 td 0xfffffe003e1f2800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037a7fb00 mi_switch() at mi_switch+0x155/frame 0xfffffe0037a7fb20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037a7fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a7fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a7fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100057 td 0xfffffe003e1f2100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037a84b00 mi_switch() at mi_switch+0x155/frame 0xfffffe0037a84b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037a84bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a84bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a84bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100058 td 0xfffffe003e1f1a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037a89b00 mi_switch() at mi_switch+0x155/frame 0xfffffe0037a89b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037a89bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a89bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a89bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100059 td 0xfffffe003e1f1300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037a8eb00 mi_switch() at mi_switch+0x155/frame 0xfffffe0037a8eb20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037a8ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a8ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a8ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100060 td 0xfffffe003e1f0c00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100094 td 0xfffffe003e1b6100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b6db00 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b6db20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037b6dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b6dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b6dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100095 td 0xfffffe00d2d89c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b72b00 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b72b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037b72bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b72bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b72bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100101 td 0xfffffe003e1aa100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b90b00 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b90b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037b90bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b90bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b90bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100112 td 0xfffffe00d2e1ba00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100113 td 0xfffffe00d2e1b300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037bd8b00 mi_switch() at mi_switch+0x155/frame 0xfffffe0037bd8b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037bd8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bd8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bd8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100176 td 0xfffffe00e3a7dc00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100177 td 0xfffffe00e3a7d500 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100178 td 0xfffffe00e3a7ce00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100179 td 0xfffffe00e3a7c700 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100180 td 0xfffffe00e3a7c000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100181 td 0xfffffe00e3fc2a00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100182 td 0xfffffe00e3fc2300 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100183 td 0xfffffe00e3fc1c00 fork_trampoline() at fork_trampoline Tracing command idle pid 11 tid 100003 td 0xfffffe003e3e0300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add46ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add46ae0 sched_idletd() at sched_idletd+0x9e/frame 0xfffffe00add46bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add46bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add46bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffffe003e3dfc00 (CPU 1) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e17de00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e17de10 trap() at trap+0x56/frame 0xfffffe003e17df20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e17df20 --- trap 0x13, rip = 0xffffffff81024d36, rsp = 0xfffffe00add4ba50, rbp = 0xfffffe00add4ba50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add4ba50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add4baa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add4bac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add4bae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add4bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add4bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add4bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffffe003e3df500 (CPU 2) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e189e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e189e10 trap() at trap+0x56/frame 0xfffffe003e189f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e189f20 --- trap 0x13, rip = 0xffffffff81024d36, rsp = 0xfffffe00add50a50, rbp = 0xfffffe00add50a50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add50a50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add50aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add50ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add50ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add50bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add50bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add50bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffffe003e3dee00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add55ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add55ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add55bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add55bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add55bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffffe003e3de700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add5aac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add5aae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add5abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add5abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add5abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffffe003e3de000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add5fac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add5fae0 sched_idletd() at sched_idletd+0x41d/frame 0xfffffe00add5fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add5fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add5fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffffe003e3e8a00 (CPU 6) cpustop_handler() at cpustop_handler+0x26/frame 0xfffffe003e1b9e00 ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe003e1b9e10 trap() at trap+0x56/frame 0xfffffe003e1b9f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1b9f20 --- trap 0x13, rip = 0xffffffff81024d36, rsp = 0xfffffe00add64a50, rbp = 0xfffffe00add64a50 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add64a50 acpi_cpu_idle() at acpi_cpu_idle+0x232/frame 0xfffffe00add64aa0 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add64ac0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add64ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add64bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add64bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add64bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffffe003e3e8300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add69ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add69ae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add69bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add69bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add69bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffffe003e3e7c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add6eac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add6eae0 sched_idletd() at sched_idletd+0x41d/frame 0xfffffe00add6ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add6ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add6ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffffe003e3e7500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add73ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add73ae0 sched_idletd() at sched_idletd+0x9e/frame 0xfffffe00add73bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add73bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add73bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffffe003e3e6e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add78ac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add78ae0 sched_idletd() at sched_idletd+0x41d/frame 0xfffffe00add78bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add78bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add78bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffffe003e3e6700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add7dac0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add7dae0 sched_idletd() at sched_idletd+0x3d1/frame 0xfffffe00add7dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add7dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add7dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command init pid 1 tid 100002 td 0xfffffe003e3e0a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add416e0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add41700 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00add41740 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00add417a0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00add417b0 _sleep() at _sleep+0x2c3/frame 0xfffffe00add41850 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00add418e0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe00add41ad0 amd64_syscall() at amd64_syscall+0x159/frame 0xfffffe00add41bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00add41bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x2b133a, rsp = 0x7fffffffe778, rbp = 0x7fffffffe7e0 --- Tracing command audit pid 10 tid 100001 td 0xfffffe003e3e1100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add3ca90 mi_switch() at mi_switch+0x155/frame 0xfffffe00add3cab0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00add3caf0 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe00add3cb50 audit_worker() at audit_worker+0x9f/frame 0xfffffe00add3cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add3cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add3cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xffffffff81d9f300 sched_switch() at sched_switch+0x5b2/frame 0xffffffff82306c10 mi_switch() at mi_switch+0x155/frame 0xffffffff82306c30 sleepq_switch() at sleepq_switch+0x11a/frame 0xffffffff82306c70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xffffffff82306cb0 _sleep() at _sleep+0x26c/frame 0xffffffff82306d50 swapper() at swapper+0x75/frame 0xffffffff82306da0 mi_startup() at mi_startup+0x2ed/frame 0xffffffff82306df0 btext() at btext+0x2c Tracing command kernel pid 0 tid 100015 td 0xfffffe003e3e6000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add82ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add82ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00add82b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00add82b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00add82bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add82bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add82bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100016 td 0xfffffe003e3e1800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add87ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add87ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00add87b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00add87b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00add87bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add87bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add87bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100017 td 0xfffffe003e455300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add8cab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add8cad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00add8cb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00add8cb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00add8cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add8cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add8cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100018 td 0xfffffe003e454c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add91ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add91ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00add91b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00add91b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00add91bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add91bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add91bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100019 td 0xfffffe003e454500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add96ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add96ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00add96b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00add96b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00add96bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add96bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add96bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xfffffe003e453e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00add9bab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00add9bad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00add9bb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00add9bb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00add9bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add9bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add9bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xfffffe003e453700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00adda0ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00adda0ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00adda0b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00adda0b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00adda0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adda0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adda0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xfffffe003e453000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00adda5ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00adda5ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00adda5b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00adda5b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00adda5bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adda5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adda5bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xfffffe003e3e9800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addaaab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addaaad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addaab10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addaab80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addaabb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addaabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addaabf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xfffffe003e3e9100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addafab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addafad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addafb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addafb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addafbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addafbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addafbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xfffffe003e458c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addb4ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addb4ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addb4b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addb4b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addb4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addb4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addb4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100026 td 0xfffffe003e458500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addb9ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addb9ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addb9b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addb9b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addb9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addb9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addb9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100027 td 0xfffffe003e457e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addbeab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addbead0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addbeb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addbeb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addbebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addbebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addbebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100028 td 0xfffffe003e457700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addc3ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addc3ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addc3b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addc3b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addc3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addc3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addc3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100029 td 0xfffffe003e457000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addc8ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addc8ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addc8b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addc8b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addc8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addc8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addc8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100030 td 0xfffffe003e456800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addcdab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addcdad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addcdb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addcdb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addcdbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addcdbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addcdbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100031 td 0xfffffe003e456100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addd2ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addd2ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addd2b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addd2b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addd2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addd2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addd2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100032 td 0xfffffe003e455a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addd7ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addd7ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addd7b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addd7b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addd7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addd7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addd7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100033 td 0xfffffe003e45e500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00adddcab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00adddcad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00adddcb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00adddcb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00adddcbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adddcbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adddcbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100034 td 0xfffffe003e45de00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00adde1ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00adde1ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00adde1b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00adde1b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00adde1bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adde1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adde1bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100035 td 0xfffffe003e45d700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00adde6ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00adde6ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00adde6b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00adde6b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00adde6bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adde6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adde6bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100036 td 0xfffffe003e45d000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addebab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addebad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addebb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addebb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addebbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addebbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addebbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100037 td 0xfffffe003e45a800 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addf0ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addf0ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addf0b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addf0b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addf0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addf0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addf0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100038 td 0xfffffe003e45a100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addf5ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addf5ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addf5b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addf5b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addf5bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addf5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addf5bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100039 td 0xfffffe003e459a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addfaab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00addfaad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addfab10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addfab80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xef/frame 0xfffffe00addfabb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addfabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addfabf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100040 td 0xfffffe003e459300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00addffa80 mi_switch() at mi_switch+0x155/frame 0xfffffe00addffaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addffae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00addffb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00addffbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addffbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addffbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100041 td 0xfffffe003e463e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037a04a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037a04aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037a04ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037a04b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037a04bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a04bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a04bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100042 td 0xfffffe003e463700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037a09a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037a09aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037a09ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037a09b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037a09bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a09bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a09bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100045 td 0xfffffe003e460100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037a18a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037a18aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037a18ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037a18b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037a18bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a18bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a18bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100061 td 0xfffffe003e1f0500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037ac8a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037ac8aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ac8ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ac8b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037ac8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ac8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ac8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100066 td 0xfffffe003e1e5300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037ae1a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037ae1aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ae1ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ae1b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037ae1bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ae1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ae1bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100067 td 0xfffffe003e1e4c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037ae6a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037ae6aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ae6ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ae6b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037ae6bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ae6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ae6bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100068 td 0xfffffe003e1e4500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037aeba80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037aebaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037aebae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037aebb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037aebbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037aebbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037aebbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100069 td 0xfffffe003e1e3e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037af0a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037af0aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037af0ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037af0b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037af0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037af0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037af0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100070 td 0xfffffe003e1e3700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037af5a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037af5aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037af5ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037af5b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037af5bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037af5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037af5bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100071 td 0xfffffe003e1c2100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037afaa80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037afaaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037afaae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037afab80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037afabb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037afabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037afabf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100072 td 0xfffffe003e1c1a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037affa80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037affaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037affae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037affb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037affbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037affbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037affbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100073 td 0xfffffe003e1c1300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b04a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b04aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b04ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b04b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037b04bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b04bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b04bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100074 td 0xfffffe003e1c0c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b09a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b09aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b09ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b09b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037b09bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b09bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b09bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100075 td 0xfffffe003e1c0500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b0ea80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b0eaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b0eae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b0eb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037b0ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b0ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b0ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100076 td 0xfffffe003e1bfe00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b13a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b13aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b13ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b13b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037b13bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b13bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b13bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100077 td 0xfffffe003e1bf700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037b18a80 mi_switch() at mi_switch+0x155/frame 0xfffffe0037b18aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b18ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b18b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe0037b18bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b18bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b18bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100114 td 0xfffffe00d2e1ac00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe0037bddab0 mi_switch() at mi_switch+0x155/frame 0xfffffe0037bddad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bddb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0037bddb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xef/frame 0xfffffe0037bddbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bddbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bddbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100121 td 0xfffffe00d6095100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d7410ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00d7410ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d7410b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00d7410b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xef/frame 0xfffffe00d7410bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d7410bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d7410bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100122 td 0xfffffe00d6094a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d7415ab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00d7415ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d7415b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00d7415b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xef/frame 0xfffffe00d7415bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d7415bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d7415bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100123 td 0xfffffe00d6094300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d741aab0 mi_switch() at mi_switch+0x155/frame 0xfffffe00d741aad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d741ab10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00d741ab80 taskqueue_thread_loop() at taskqueue_thread_loop+0xef/frame 0xfffffe00d741abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d741abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d741abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100124 td 0xfffffe00d6093c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00d741fa80 mi_switch() at mi_switch+0x155/frame 0xfffffe00d741faa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00d741fae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00d741fb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00d741fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d741fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d741fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100827 td 0xfffffe00e6791500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00e6027a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00e6027aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e6027ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00e6027b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00e6027bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e6027bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e6027bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100830 td 0xfffffe00e6791c00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00f057aa80 mi_switch() at mi_switch+0x155/frame 0xfffffe00f057aaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00f057aae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00f057ab80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00f057abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00f057abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00f057abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100831 td 0xfffffe00e67b5100 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00f0511a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00f0511aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00f0511ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00f0511b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00f0511bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00f0511bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00f0511bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100832 td 0xfffffe00e681c700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00f0589a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00f0589aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00f0589ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00f0589b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00f0589bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00f0589bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00f0589bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100833 td 0xfffffe00e3a32a00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00f055fa80 mi_switch() at mi_switch+0x155/frame 0xfffffe00f055faa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00f055fae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00f055fb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00f055fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00f055fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00f055fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100834 td 0xfffffe00e3fc0e00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00f05aca80 mi_switch() at mi_switch+0x155/frame 0xfffffe00f05acaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00f05acae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00f05acb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00f05acbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00f05acbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00f05acbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100835 td 0xfffffe00e6912700 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00f051ba80 mi_switch() at mi_switch+0x155/frame 0xfffffe00f051baa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00f051bae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00f051bb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00f051bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00f051bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00f051bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100837 td 0xfffffe00e681d500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00f0525a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00f0525aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00f0525ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00f0525b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00f0525bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00f0525bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00f0525bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100838 td 0xfffffe00e6769500 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00f05fca80 mi_switch() at mi_switch+0x155/frame 0xfffffe00f05fcaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00f05fcae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00f05fcb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00f05fcbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00f05fcbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00f05fcbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100839 td 0xfffffe00e66b8300 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00f0601a80 mi_switch() at mi_switch+0x155/frame 0xfffffe00f0601aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00f0601ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00f0601b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00f0601bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00f0601bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00f0601bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100840 td 0xfffffe00e681c000 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00f048fa80 mi_switch() at mi_switch+0x155/frame 0xfffffe00f048faa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00f048fae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00f048fb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00f048fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00f048fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00f048fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100842 td 0xfffffe00e682fc00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00f058ea80 mi_switch() at mi_switch+0x155/frame 0xfffffe00f058eaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00f058eae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00f058eb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00f058ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00f058ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00f058ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100843 td 0xfffffe00e682ca00 sched_switch() at sched_switch+0x5b2/frame 0xfffffe00f060ba80 mi_switch() at mi_switch+0x155/frame 0xfffffe00f060baa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00f060bae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00f060bb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xfffffe00f060bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00f060bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00f060bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:pho> show allchains chain 1: thread 100771 (pid 79019, umount) is sleeping on 0xfffffe00e684d000 "mntref" chain 2: thread 103182 (pid 79017, sleep) is sleeping on 0xffffffff81c83958 "nanslp" chain 3: thread 103185 (pid 79015, sleep) is sleeping on 0xffffffff81c83956 "nanslp" chain 4: thread 100915 (pid 79014, sleep) is sleeping on 0xffffffff81c83953 "nanslp" chain 5: thread 104967 (pid 79013, sleep) is sleeping on 0xffffffff81c83959 "nanslp" chain 6: thread 102194 (pid 79012, sleep) is sleeping on 0xffffffff81c83954 "nanslp" chain 7: thread 103428 (pid 79011, sleep) is sleeping on 0xffffffff81c8395a "nanslp" chain 8: thread 104074 (pid 79010, sleep) is sleeping on 0xffffffff81c83951 "nanslp" chain 9: thread 102838 (pid 79008, sleep) is sleeping on 0xffffffff81c8395a "nanslp" chain 10: thread 100408 (pid 78994, sleep) is sleeping on 0xffffffff81c83956 "nanslp" chain 11: thread 104231 (pid 78992, sleep) is sleeping on 0xffffffff81c83957 "nanslp" chain 12: thread 100787 (pid 78990, sleep) is sleeping on 0xffffffff81c83952 "nanslp" chain 13: thread 103550 (pid 78989, sleep) is sleeping on 0xffffffff81c83950 "nanslp" chain 14: thread 103990 (pid 78936, sleep) is sleeping on 0xffffffff81c83958 "nanslp" chain 15: thread 105804 (pid 63211, sh) is sleeping on 0xfffff801e6655a50 "wait" chain 16: thread 105935 (pid 63209, sh) is blocked on lockmgr P:EXCL thread 0 (pid -512, ) is inactive chain 17: thread 101939 (pid 63206, sh) is sleeping on 0xfffff8080004b528 "wait" chain 18: thread 103737 (pid 63204, sh) is sleeping on 0xfffff803caff3a50 "wait" chain 19: thread 106038 (pid 63201, sh) is sleeping on 0xfffff8019cbbe000 "wait" chain 20: thread 101789 (pid 63199, sh) is sleeping on 0xfffff80801a95a50 "wait" chain 21: thread 104875 (pid 63198, sh) is sleeping on 0xfffff801abce0528 "wait" chain 22: thread 101430 (pid 63197, sh) is sleeping on 0xfffff803ca032000 "wait" chain 23: thread 104130 (pid 63195, sh) is sleeping on 0xfffff8061f267000 "wait" chain 24: thread 105836 (pid 63193, sh) is sleeping on 0xfffff801e6655000 "wait" chain 25: thread 105552 (pid 63192, sh) is blocked on lockmgr EXCL thread 0 (pid -512, ) is inactive chain 26: thread 103759 (pid 63188, sh) is sleeping on 0xfffff803caff3000 "wait" chain 27: thread 106158 (pid 63185, sh) is sleeping on 0xfffff801a9249000 "wait" chain 28: thread 104415 (pid 63183, sh) is sleeping on 0xfffff803ca407528 "wait" chain 29: thread 104123 (pid 63179, sh) is sleeping on 0xfffff8061f267528 "wait" chain 30: thread 101368 (pid 63178, sh) is sleeping on 0xfffff8002169b528 "wait" chain 31: thread 103115 (pid 63177, sh) is sleeping on 0xfffff803cab9ba50 "wait" chain 32: thread 103583 (pid 63176, sh) is sleeping on 0xfffff803cadc8a50 "wait" chain 33: thread 105858 (pid 63175, sh) is sleeping on 0xfffff807790d6000 "wait" chain 34: thread 104406 (pid 63173, sh) is sleeping on 0xfffff803ca1c8a50 "wait" chain 35: thread 103176 (pid 63172, sh) is sleeping on 0xfffff803caa08a50 "wait" chain 36: thread 105880 (pid 63167, md21) is sleeping on 0xfffff8071fa89000 "mdwait" chain 37: thread 100524 (pid 63156, md20) is sleeping on 0xfffff8058ed8a000 "mdwait" chain 38: thread 101987 (pid 63145, md19) is sleeping on 0xfffff8048805b000 "mdwait" chain 39: thread 105112 (pid 63134, md18) is sleeping on 0xfffff8075fa8c000 "mdwait" chain 40: thread 101034 (pid 63123, md17) is blocked on lockmgrKDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e37f2dc0 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e37f2dd0 trap() at trap+0x6c/frame 0xfffffe00e37f2ee0 calltrap() at calltrap+0x8/frame 0xfffffe00e37f2ee0 --- trap 0xc, rip = 0xffffffff80cb904f, rsp = 0xfffffe00e37f2fb0, rbp = 0xfffffe00e37f2fb0 --- strlen() at strlen+0x1f/frame 0xfffffe00e37f2fb0 kvprintf() at kvprintf+0xf70/frame 0xfffffe00e37f30e0 db_printf() at db_printf+0x5c/frame 0xfffffe00e37f3160 lockmgr_chain() at lockmgr_chain+0x3e/frame 0xfffffe00e37f3180 print_lockchain() at print_lockchain+0x94/frame 0xfffffe00e37f31b0 db_show_allchains() at db_show_allchains+0x97/frame 0xfffffe00e37f31e0 db_command() at db_command+0x25c/frame 0xfffffe00e37f32b0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00e37f3350 db_command() at db_command+0x25c/frame 0xfffffe00e37f3420 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e37f3430 db_trap() at db_trap+0xe8/frame 0xfffffe00e37f34c0 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00e37f3530 trap() at trap+0x7b8/frame 0xfffffe00e37f3640 calltrap() at calltrap+0x8/frame 0xfffffe00e37f3640 --- trap 0x3, rip = 0xffffffff80c0ab97, rsp = 0xfffffe00e37f3710, rbp = 0xfffffe00e37f3720 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e37f3720 vpanic() at vpanic+0x19e/frame 0xfffffe00e37f3770 panic() at panic+0x43/frame 0xfffffe00e37f37d0 trap_fatal() at trap_fatal+0x387/frame 0xfffffe00e37f3830 trap_pfault() at trap_pfault+0x99/frame 0xfffffe00e37f3890 trap() at trap+0x2a5/frame 0xfffffe00e37f39a0 calltrap() at calltrap+0x8/frame 0xfffffe00e37f39a0 --- trap 0xc, rip = 0xffffffff80ee9909, rsp = 0xfffffe00e37f3a70, rbp = 0xfffffe00e37f3a90 --- ufs_reclaim() at ufs_reclaim+0x79/frame 0xfffffe00e37f3a90 VOP_RECLAIM_APV() at VOP_RECLAIM_APV+0x59/frame 0xfffffe00e37f3ab0 vgonel() at vgonel+0x3b7/frame 0xfffffe00e37f3b10 vnlru_proc() at vnlru_proc+0x7fb/frame 0xfffffe00e37f3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e37f3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e37f3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Script command 'show allchains' returned error db:0:pho> chain 1: thread 100771 (pid 79019, umount) is sleeping on 0xfffffe00e684d000 "mntref" chain 2: thread 103182 (pid 79017, sleep) is sleeping on 0xffffffff81c83958 "nanslp" chain 3: thread 103185 (pid 79015, sleep) is sleeping on 0xffffffff81c83956 "nanslp" chain 4: thread 100915 (pid 79014, sleep) is sleeping on 0xffffffff81c83953 "nanslp" chain 5: thread 104967 (pid 79013, sleep) is sleeping on 0xffffffff81c83959 "nanslp" chain 6: thread 102194 (pid 79012, sleep) is sleeping on 0xffffffff81c83954 "nanslp" chain 7: thread 103428 (pid 79011, sleep) is sleeping on 0xffffffff81c8395a "nanslp" chain 8: thread 104074 (pid 79010, sleep) is sleeping on 0xffffffff81c83951 "nanslp" chain 9: thread 102838 (pid 79008, sleep) is sleeping on 0xffffffff81c8395a "nanslp" chain 10: thread 100408 (pid 78994, sleep) is sleeping on 0xffffffff81c83956 "nanslp" chain 11: thread 104231 (pid 78992, sleep) is sleeping on 0xffffffff81c83957 "nanslp" chain 12: thread 100787 (pid 78990, sleep) is sleeping on 0xffffffff81c83952 "nanslp" chain 13: thread 103550 (pid 78989, sleep) is sleeping on 0xffffffff81c83950 "nanslp" chain 14: thread 103990 (pid 78936, sleep) is sleeping on 0xffffffff81c83958 "nanslp" chain 15: thread 105804 (pid 63211, sh) is sleeping on 0xfffff801e6655a50 "wait" chain 16: thread 105935 (pid 63209, sh) is blocked on lockmgr P:EXCL thread 0 (pid -512, ) is inactive chain 17: thread 101939 (pid 63206, sh) is sleeping on 0xfffff8080004b528 "wait" chain 18: thread 103737 (pid 63204, sh) is sleeping on 0xfffff803caff3a50 "wait" chain 19: thread 106038 (pid 63201, sh) is sleeping on 0xfffff8019cbbe000 "wait" chain 20: thread 101789 (pid 63199, sh) is sleeping on 0xfffff80801a95a50 "wait" chain 21: thread 104875 (pid 63198, sh) is sleeping on 0xfffff801abce0528 "wait" chain 22: thread 101430 (pid 63197, sh) is sleeping on 0xfffff803ca032000 "wait" chain 23: thread 104130 (pid 63195, sh) is sleeping on 0xfffff8061f267000 "wait" chain 24: thread 105836 (pid 63193, sh) is sleeping on 0xfffff801e6655000 "wait" chain 25: thread 105552 (pid 63192, sh) is blocked on lockmgr EXCL thread 0 (pid -512, ) is inactive chain 26: thread 103759 (pid 63188, sh) is sleeping on 0xfffff803caff3000 "wait" chain 27: thread 106158 (pid 63185, sh) is sleeping on 0xfffff801a9249000 "wait" chain 28: thread 104415 (pid 63183, sh) is sleeping on 0xfffff803ca407528 "wait" chain 29: thread 104123 (pid 63179, sh) is sleeping on 0xfffff8061f267528 "wait" chain 30: thread 101368 (pid 63178, sh) is sleeping on 0xfffff8002169b528 "wait" chain 31: thread 103115 (pid 63177, sh) is sleeping on 0xfffff803cab9ba50 "wait" chain 32: thread 103583 (pid 63176, sh) is sleeping on 0xfffff803cadc8a50 "wait" chain 33: thread 105858 (pid 63175, sh) is sleeping on 0xfffff807790d6000 "wait" chain 34: thread 104406 (pid 63173, sh) is sleeping on 0xfffff803ca1c8a50 "wait" chain 35: thread 103176 (pid 63172, sh) is sleeping on 0xfffff803caa08a50 "wait" chain 36: thread 105880 (pid 63167, md21) is sleeping on 0xfffff8071fa89000 "mdwait" chain 37: thread 100524 (pid 63156, md20) is sleeping on 0xfffff8058ed8a000 "mdwait" chain 38: thread 101987 (pid 63145, md19) is sleeping on 0xfffff8048805b000 "mdwait" chain 39: thread 105112 (pid 63134, md18) is sleeping on 0xfffff8075fa8c000 "mdwait" chain 40: thread 101034 (pid 63123, md17) is blocked on lockmgrKDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e37f2dc0 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e37f2dd0 trap() at trap+0x6c/frame 0xfffffe00e37f2ee0 calltrap() at calltrap+0x8/frame 0xfffffe00e37f2ee0 --- trap 0xc, rip = 0xffffffff80cb904f, rsp = 0xfffffe00e37f2fb0, rbp = 0xfffffe00e37f2fb0 --- strlen() at strlen+0x1f/frame 0xfffffe00e37f2fb0 kvprintf() at kvprintf+0xf70/frame 0xfffffe00e37f30e0 db_printf() at db_printf+0x5c/frame 0xfffffe00e37f3160 lockmgr_chain() at lockmgr_chain+0x3e/frame 0xfffffe00e37f3180 print_lockchain() at print_lockchain+0x94/frame 0xfffffe00e37f31b0 db_show_allchains() at db_show_allchains+0x97/frame 0xfffffe00e37f31e0 db_command() at db_command+0x25c/frame 0xfffffe00e37f32b0 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00e37f3350 db_command() at db_command+0x25c/frame 0xfffffe00e37f3420 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e37f3430 db_trap() at db_trap+0xe8/frame 0xfffffe00e37f34c0 kdb_trap() at kdb_trap+0x154/frame 0xfffffe00e37f3530 trap() at trap+0x7b8/frame 0xfffffe00e37f3640 calltrap() at calltrap+0x8/frame 0xfffffe00e37f3640 --- trap 0x3, rip = 0xffffffff80c0ab97, rsp = 0xfffffe00e37f3710, rbp = 0xfffffe00e37f3720 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e37f3720 vpanic() at vpanic+0x19e/frame 0xfffffe00e37f3770 panic() at panic+0x43/frame 0xfffffe00e37f37d0 trap_fatal() at trap_fatal+0x387/frame 0xfffffe00e37f3830 trap_pfault() at trap_pfault+0x99/frame 0xfffffe00e37f3890 trap() at trap+0x2a5/frame 0xfffffe00e37f39a0 calltrap() at calltrap+0x8/frame 0xfffffe00e37f39a0 --- trap 0xc, rip = 0xffffffff80ee9909, rsp = 0xfffffe00e37f3a70, rbp = 0xfffffe00e37f3a90 --- ufs_reclaim() at ufs_reclaim+0x79/frame 0xfffffe00e37f3a90 VOP_RECLAIM_APV() at VOP_RECLAIM_APV+0x59/frame 0xfffffe00e37f3ab0 vgonel() at vgonel+0x3b7/frame 0xfffffe00e37f3b10 vnlru_proc() at vnlru_proc+0x7fb/frame 0xfffffe00e37f3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e37f3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e37f3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Script command '' returned error db> reset (kgdb) bt #0 doadump (textdump=0x0) at include/pcpu_aux.h:55 #1 0xffffffff8049b44a in db_dump (dummy=, dummy2=, dummy3=, dummy4=) at ../../../ddb/db_command.c:575 #2 0xffffffff8049b20c in db_command (cmd_table=, dopager=0x0) at ../../../ddb/db_command.c:482 #3 0xffffffff804a0168 in db_script_exec (scriptname=, warnifnotfound=) at ../../../ddb/db_script.c:304 #4 0xffffffff8049b20c in db_command (cmd_table=, dopager=0x0) at ../../../ddb/db_command.c:482 #5 0xffffffff804a0168 in db_script_exec (scriptname=, warnifnotfound=) at ../../../ddb/db_script.c:304 #6 0xffffffff8049b20c in db_command (cmd_table=, dopager=0x1) at ../../../ddb/db_command.c:482 #7 0xffffffff8049af7d in db_command_loop () at ../../../ddb/db_command.c:535 #8 0xffffffff8049e178 in db_trap (type=, code=) at ../../../ddb/db_main.c:253 #9 0xffffffff80c0b404 in kdb_trap (type=0x3, code=0x0, tf=) at ../../../kern/subr_kdb.c:699 #10 0xffffffff81065c88 in trap (frame=0xfffffe00e37f3650) at ../../../amd64/amd64/trap.c:578 #11 0xffffffff8103bc78 in calltrap () at ../../../amd64/amd64/exception.S:289 #12 0xffffffff80c0ab97 in kdb_enter (why=0xffffffff811f62f8 "panic", msg=) at include/cpufunc.h:65 #13 0xffffffff80bc0e1e in vpanic (fmt=, ap=) at ../../../kern/kern_shutdown.c:902 #14 0xffffffff80bc0bb3 in panic (fmt=) at ../../../kern/kern_shutdown.c:839 #15 0xffffffff810660d7 in trap_fatal (frame=, eva=) at ../../../amd64/amd64/trap.c:919 #16 0xffffffff81066179 in trap_pfault (frame=0xfffffe00e37f39b0, usermode=, signo=, ucode=) at include/pcpu_aux.h:55 #17 0xffffffff81065775 in trap (frame=0xfffffe00e37f39b0) at ../../../amd64/amd64/trap.c:400 #18 0xffffffff8103bc78 in calltrap () at ../../../amd64/amd64/exception.S:289 #19 0xffffffff80ee9909 in ufs_reclaim (ap=) at ../../../ufs/ufs/ufs_inode.c:247 #20 0xffffffff810e3739 in VOP_RECLAIM_APV (vop=0xffffffff81959f98, a=0xfffffe00e37f3ac0) at vnode_if.c:1928 #21 0xffffffff80c9bac7 in vgonel (vp=0xfffff802c69e7280) at vnode_if.h:850 #22 0xffffffff80ca0b9b in vnlru_proc () at ../../../kern/vfs_subr.c:1179 #23 0xffffffff80b7e820 in fork_exit (callout=0xffffffff80ca03a0 , arg=0x0, frame=0xfffffe00e37f3c00) at ../../../kern/kern_fork.c:1051 #24 0xffffffff8103ccbe in fork_trampoline () at ../../../amd64/amd64/exception.S:1080 #25 0x0000000000000000 in ?? () Current language: auto; currently minimal (kgdb) f 19 #19 0xffffffff80ee9909 in ufs_reclaim (ap=) at ../../../ufs/ufs/ufs_inode.c:247 247 UFS_UPDATE(vp, 0); (kgdb) l 242 ufsdirhash_free(ip); 243 #endif 244 245 if (ip->i_flag & IN_LAZYMOD) 246 UFS_INODE_SET_FLAG(ip, IN_MODIFIED); 247 UFS_UPDATE(vp, 0); 248 /* 249 * Remove the inode from its hash chain. 250 */ 251 vfs_hash_remove(vp); (kgdb) info loc vp = (struct vnode *) 0xfffff802c69e7280 i = Cannot access memory at address 0x2 (kgdb) p *vp $1 = {v_type = VDIR, v_irflag = 0x1, v_op = 0xffffffff81959f98, v_data = 0xfffff801582b6aa0, v_mount = 0xfffffe00e684d000, v_nmntvnodes = {tqe_next = 0x0, tqe_prev = 0xfffffe00e684d060}, {v_mountedhere = 0x0, v_unpcb = 0x0, v_rdev = 0x0, v_fifoinfo = 0x0}, v_hashlist = {le_next = 0xfffff802ed9ea500, le_prev = 0xfffff8002d238cb8}, v_cache_src = {lh_first = 0x0}, v_cache_dst = {tqh_first = 0x0, tqh_last = 0xfffff802c69e72d0}, v_cache_dd = 0x0, v_lock = { lock_object = {lo_name = 0xffffffff8110effc "ufs", lo_flags = 0x6fb0000, lo_data = 0x0, lo_witness = 0x0}, lk_lock = 0xfffffe00d35df500, lk_exslpfail = 0x0, lk_timo = 0x33, lk_pri = 0x60, lk_stack = {depth = 0x6, pcs = 0xfffff802c69e7320}}, v_interlock = {lock_object = {lo_name = 0xffffffff8123caa3 "vnode interlock", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0x0}, mtx_lock = 0x0}, v_vnlock = 0xfffff802c69e72e8, v_vnodelist = {tqe_next = 0xfffff8001b093400, tqe_prev = 0xfffff802735b13d8}, v_lazylist = {tqe_next = 0xfffff80818445280, tqe_prev = 0xfffff804e31338e8}, v_bufobj = {bo_lock = {lock_object = { lo_name = 0xffffffff811fbe94 "bufobj interlock", lo_flags = 0x5230000, lo_data = 0x0, lo_witness = 0x0}, rw_lock = 0x1}, bo_ops = 0xffffffff8191e5c0, bo_object = 0x0, bo_synclist = {le_next = 0xfffff802c6f94b78, le_prev = 0xfffff807f23966a8}, bo_private = 0xfffff802c69e7280, bo_clean = {bv_hd = {tqh_first = 0x0, tqh_last = 0xfffff802c69e7440}, bv_root = {pt_root = 0x0}, bv_cnt = 0x0}, bo_dirty = {bv_hd = {tqh_first = 0x0, tqh_last = 0xfffff802c69e7460}, bv_root = { pt_root = 0x0}, bv_cnt = 0x0}, bo_numoutput = 0x0, bo_flag = 0x4, bo_domain = 0x1, bo_bsize = 0x8000}, v_pollinfo = 0x0, v_label = 0x0, v_lockf = 0x0, v_rl = { rl_waiters = {tqh_first = 0x0, tqh_last = 0xfffff802c69e74b0}, rl_currdep = 0x0}, v_cstart = 0x0, v_lasta = 0x0, v_lastw = 0x0, v_clen = 0x0, v_holdcnt = 0x1, v_usecount = 0x0, v_iflag = 0x0, v_vflag = 0x0, v_mflag = 0x0, v_dbatchcpu = 0xffff, v_writecount = 0x0, v_hash = 0x4e20f} (kgdb) (kgdb) p *(struct ufsmount *)0xfffffe00e684d000 $5 = {um_mountp = 0xffffffff810ef7d2, um_dev = 0x1030000, um_cp = 0xfffff8087fd75c00, um_bo = 0x0, um_odevvp = 0x342, um_devvp = 0xfffffe00e685fb80, um_fstype = 0xfffffe00e684e728, um_fs = 0xffffffff81959820, um_extattr = {uepm_lock = {lock_object = {lo_name = 0xffffffff81959940 "\004\005\030 ufs", lo_flags = 0x769fd000, lo_data = 0xfffff802, lo_witness = 0x0}, sx_lock = 0x2}, uepm_list = {lh_first = 0xfffff802c69e7280}, uepm_ucred = 0xfffff802c69e72a0, uepm_flags = 0x1}, um_nindir = 0x41006160, um_bptrtodb = 0x0, um_seqinc = 0xfffff80021aebad0, um_lock = {lock_object = {lo_name = 0x0, lo_flags = 0x78, lo_data = 0x0, lo_witness = 0x3520140518}, mtx_lock = 0x1000}, um_fsckpid = 0x1000, um_softdep = 0x8000, um_quotas = 0xfffffe00e684d0c0, um_cred = 0xfffffe00e684d0d0, um_btime = 0xfffffe00e684d0e0, um_itime = 0xfffffe00e684d0f0, um_qflags = 0xfffffe00e684d100 "", um_savedmaxfilesize = 0x0, um_flags = 0x0, um_last_fullmsg = { tv_sec = 0x0, tv_usec = 0x0}, um_secs_fullmsg = 0x0, um_last_integritymsg = {tv_sec = 0x0, tv_usec = 0x0}, um_secs_integritymsg = 0x0, um_trim_inflight = 0x0, um_trim_inflight_blks = 0x0, um_trim_total = 0x0, um_trim_total_blks = 0xff, um_trim_tq = 0xf9f53b915e86fa80, um_trimhash = 0x0, um_trimlisthashsize = 0x0, um_balloc = 0, um_blkatoff = 0, um_truncate = 0, um_update = 0, um_valloc = 0, um_vfree = 0, um_ifree = 0, um_rdonly = 0, um_snapgone = 0x736675, um_check_blkno = 0} (kgdb) -- Test scenario: misc/zz-combo03.sh