panic: pmap_page_exists_quick: page 0xfffffe001510f3f0 is not managed, vmcore.110 KDB: debugger backends: ddb KDB: current backend: ddb ---<>--- Copyright (c) 1992-2019 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 13.0-CURRENT #0 r354415: Wed Nov 6 22:54:39 CET 2019 pho@mercat1.netperf.freebsd.org:/usr/src/sys/amd64/compile/PHO amd64 FreeBSD clang version 9.0.0 (tags/RELEASE_900/final 372316) (based on LLVM 9.0.0) WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. Entering uma_startup with 10 boot pages configured startup_alloc from "UMA Kegs", 8 boot pages left startup_alloc from "UMA Zones", 7 boot pages left startup_alloc from "UMA Zones", 6 boot pages left startup_alloc from "UMA Zones", 5 boot pages left startup_alloc from "UMA Zones", 4 boot pages left startup_alloc from "UMA Zones", 3 boot pages left startup_alloc from "UMA Hash", 2 boot pages left startup_alloc from "UMA Zones", 1 boot pages left Entering uma_startup1 with 0 boot pages left Entering uma_startup2 with 0 boot pages left VT(vga): resolution 640x480 CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.08-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics real memory = 34359738368 (32768 MB) avail memory = 33164058624 (31627 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 12 CPUs FreeBSD/SMP: 1 package(s) x 6 core(s) x 2 hardware threads random: registering fast source Intel Secure Key RNG random: fast provider: "Intel Secure Key RNG" random: unblocking device. ioapic0 irqs 0-23 ioapic1 irqs 24-47 Launching APs: 1 8 6 2 11 9 10 3 4 7 5 Timecounter "TSC-low" frequency 1750037516 Hz quality 1000 random: entropy device external interface kbd1 at kbdmux0 module_register_init: MOD_LOAD (vesa, 0xffffffff80fb4f40, 0) error 19 000.000055 [4336] netmap_init netmap: loaded module [ath_hal] loaded nexus0 vtvga0: cryptosoft0: acpi0: acpi0: Power Button (fixed) cpu0: on acpi0 atrtc0: port 0x70-0x71,0x74-0x77 irq 8 on acpi0 atrtc0: registered as a time-of-day clock, resolution 1.000000s Event timer "RTC" frequency 32768 Hz quality 0 attimer0: port 0x40-0x43,0x50-0x53 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Event timer "HPET" frequency 14318180 Hz quality 350 Event timer "HPET1" frequency 14318180 Hz quality 340 Event timer "HPET2" frequency 14318180 Hz quality 340 Event timer "HPET3" frequency 14318180 Hz quality 340 Event timer "HPET4" frequency 14318180 Hz quality 340 Event timer "HPET5" frequency 14318180 Hz quality 340 Event timer "HPET6" frequency 14318180 Hz quality 340 Event timer "HPET7" frequency 14318180 Hz quality 340 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 pcib0: on acpi0 pci0: on pcib0 pci0: at device 11.1 (no driver attached) pci0: at device 11.2 (no driver attached) pci0: at device 16.1 (no driver attached) pci0: at device 16.6 (no driver attached) pci0: at device 18.1 (no driver attached) acpi_syscontainer0: on acpi0 acpi_syscontainer1: on acpi0 acpi_syscontainer2: on acpi0 acpi_syscontainer3: on acpi0 pcib1: port 0xcf8-0xcff on acpi0 pci1: on pcib1 pcib2: irq 26 at device 1.0 on pci1 pci2: on pcib2 pcib3: irq 32 at device 2.0 on pci1 pci3: on pcib3 pci3: at device 0.0 (no driver attached) pci3: at device 0.1 (no driver attached) pcib4: irq 40 at device 3.0 on pci1 pci4: on pcib4 pci1: at device 17.0 (no driver attached) ahci0: port 0xf110-0xf117,0xf100-0xf103,0xf0f0-0xf0f7,0xf0e0-0xf0e3,0xf020-0xf03f mem 0xfb438000-0xfb4387ff irq 16 at device 17.4 on pci1 ahci0: AHCI v1.30 with 4 6Gbps ports, Port Multiplier not supported ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahcich2: at channel 2 on ahci0 ahcich3: at channel 3 on ahci0 ahciem0: on ahci0 xhci0: mem 0xfb400000-0xfb40ffff irq 19 at device 20.0 on pci1 xhci0: 32 bytes context size, 64-bit DMA usbus0 on xhci0 usbus0: 5.0Gbps Super Speed USB v3.0 pci1: at device 22.0 (no driver attached) pci1: at device 22.1 (no driver attached) ehci0: mem 0xfb434000-0xfb4343ff irq 18 at device 26.0 on pci1 usbus1: EHCI version 1.0 usbus1 on ehci0 usbus1: 480Mbps High Speed USB v2.0 pcib5: irq 16 at device 28.0 on pci1 pci5: on pcib5 pcib6: irq 18 at device 28.2 on pci1 pci6: on pcib6 pcib7: at device 0.0 on pci6 pci7: on pcib7 vgapci0: port 0xe000-0xe07f mem 0xfa000000-0xfaffffff,0xfb000000-0xfb01ffff irq 18 at device 0.0 on pci7 vgapci0: Boot video device pcib8: irq 16 at device 28.4 on pci1 pci8: on pcib8 igb0: port 0xd020-0xd03f mem 0xfb320000-0xfb33ffff,0xfb344000-0xfb347fff irq 16 at device 0.0 on pci8 igb0: Using 1024 TX descriptors and 1024 RX descriptors igb0: queue equality override not set, capping rx_queues at 6 and tx_quugen0.3: at usbus0 ukbd0 on uhub3 ukbd0: on usbus0 kbd2 at ukbd0 Starting Network: lo0 igb0 igb1. lo0: flags=8049 metric 0 mtu 16384 options=680003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x3 inet 127.0.0.1 netmask 0xff000000 groups: lo nd6 options=21 igb0: flags=8843 metric 0 mtu 1500 options=4e507bb ether 0c:c4:7a:a8:cd:da inet6 fe80::ec4:7aff:fea8:cdda%igb0 prefixlen 64 scopeid 0x1 media: Ethernet autoselect status: no carrier nd6 options=21 igb1: flags=8802 metric 0 mtu 1500 options=4e507bb ether 0c:c4:7a:a8:cd:db media: Ethernet autoselect status: no carrier nd6 options=29 Starting devd. igb0: link state changed to UP Autoloading module: ioat.ko ioat0: mem 0xfb42c000-0xfb42ffff irq 31 at device 4.0 on pci1 ioat0: Capabilities: 2f7 ioat1: mem 0xfb428000-0xfb42bfff irq 39 at device 4.1 on pci1 ioat1: Capabilities: 2f7 ioat2: mem 0xfb424000-0xfb427fff irq 31 at device 4.2 on pci1 ioat2: Capabilities: f7 ioat3: mem 0xfb420000-0xfb423fff irq 39 at device 4.3 on pci1 ioat3: Capabilities: f7 ioat4: mem 0xfb41c000-0xfb41ffff irq 31 at device 4.4 on pci1 ioat4: Capabilities: f7 ioat5: mem 0xfb418000-0xfb41bfff irq 39 at device 4.5 on pci1 ioat5: Capabilities: f7 ioat6: mem 0xfb414000-0xfb417fff irq 31 at device 4.6 on pci1 ioat6: Capabilities: f7 ioat7: mem 0xfb410000-0xfb413fff irq 39 at device 4.7 on pci1 ioat7: Capabilities: f7 Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Starting Network: igb1. igb1: flags=8802 metric 0 mtu 1500 options=4e507bb ether 0c:c4:7a:a8:cd:db media: Ethernet autoselect status: no carrier nd6 options=29 Autoloading module: uhid.ko Autoloading module: ums.ko ums0 on uhub3 ums0: on usbus0 ums0: 3 buttons and [Z] coordinates ID=0 Starting dhclient. DHCPREQUEST on igb0 to 255.255.255.255 port 67 DHCPACK from 192if_delmulti_locked: detaching ifnet instance 0xfffff8000453b800 .168.5.1 bound to 192.168.5.171 -- renewal in 300 seconds. add host 127.0.0.1: gateway lo0 fib 0: route already in table add host ::1: gateway lo0 fib 0: route already in table add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Creating and/or trimming log files. Starting syslogd. Setting date via ntp. 6 Nov 23:18:06 ntpdate[2047]: step time server 192.168.5.1 offset -0.404070 sec Starting rpcbind. NFS access cache time=60 Starting watchdogd. No core dumps found. Clearing /tmp (X related). Starting statd. Starting lockd. fscklock order reversal: 1st 0xfffff8000783fcc0 ufs (ufs) @ kern/vfs_mount.c:1603 2nd 0xfffff80004930068 devfs (devfs) @ ufs/ffs/ffs_softdep.c:1927 stack backtrace: #0 0xffffffff80c30cd1 at witness_debugger+0x71 #1 0xffffffff80c30a41 at witness_checkorder+0xab1 #2 0xffffffff80b96a78 at lockmgr_lock_fast_path+0x178 #3 0xffffffff810dc3b2 at VOP_LOCK1_APV+0x92 #4 0xffffffff80cb0fd5 at _vn_lock+0x65 #5 0xffffffff80ebf20d at softdep_flushworklist+0x5d #6 0xffffffff80ee01a6 at ffs_sync+0x406 #7 0xffffffff80c9534a at dounmount+0x46a #8 0xffffffff80c94e8e at sys_unmount+0x2ae #9 0xffffffff810625d0 at amd64_syscall+0x2d0 #10 0xffffffff81038bb0 at fast_syscall_common+0x101 ** /dev/gpt/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 232 files, 1506 used, 1263901 free (173 frags, 157966 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** Updating motd:. Mounting late filesystems:. Security policy loaded: MAC/ntpd (mac_ntpd) Starting ntpd. Configuring vt: blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting cron. Wed Nov 6 23:18 FreeBSD/amd64 (mercat1.netperf.freebsd.org) (ttyu1) login: roo Password: Login incorrect login: root Nov 6 23:18:19 mercat1 login[2329]: ROOT LOGIN (root) ON ttyu1 Last login: Wed Nov 6 22:36:39 on ttyu1 FreeBSD 13.0-CURRENT (PHO) #0 r354415: Wed Nov 6 22:54:39 CET 2019 root@mercat1:~ # Nov 6 23:18:35 mercat1 su[2344]: pho to root on /dev/pts/0 20191106 23:19:04 all (1/676): 1st.sh 20191106 23:19:06 all (2/676): 256m.sh 20191106 23:19:07 all (3/676): audit.sh 20191106 23:19:09 all (4/676): beneath2.sh 20191106 23:19:13 all (5/676): beneath3.sh 20191106 23:19:14 all (6/676): buildworld.sh 20191106 23:19:16 all (7/676): buildworld2.sh 20191106 23:19:17 all (8/676): cluster.sh 20191106 23:19:18 all (9/676): cpuset.sh 20191106 23:19:20 all (10/676): crossmp2.sh 20191106 23:19:21 all (11/676): crossmp6.sh 20191106 23:19:23 all (12/676): datagram2.sh 20191106 23:19:25 all (13/676): datagram3.sh 20191106 23:19:26 all (14/676): datamove.sh 20191106 23:19:28 all (15/676): datamove3.sh 20191106 23:19:30 all (16/676): devfs2.sh 20191106 23:19:31 all (17/676): devfs5.sh 20191106 23:19:32 all (18/676): dtrace_fault.sh 20191106 23:19:34 all (19/676): dumpfs.sh newblk leak: 296/312. 20191106 23:19:36 all (20/676): dup2.sh 20191106 23:19:37 all (21/676): execi386.sh 20191106 23:19:39 all (22/676): extattr_set_fd.sh 20191106 23:19:41 all (23/676): extattrctl.sh lock order reversal: 1st 0xfffff8001e759838 ufs_extattr_sx (ufs_extattr_sx) @ ufs/ufs/ufs_extattr.c:119 2nd 0xfffff80116d38558 ufs (ufs) @ ufs/ffs/ffs_vfsops.c:1718 stack backtrace: #0 0xffffffff80c30cd1 at witness_debugger+0x71 #1 0xffffffff80c30a41 at witness_checkorder+0xab1 #2 0xffffffff80b9705f at lockmgr_xlock_hard+0x6f #3 0xffffffff80b97bed at __lockmgr_args+0x60d #4 0xffffffff80edd2c1 at ffs_vgetf+0x161 #5 0xffffffff80ef010b at ufs_root+0x1b #6 0xffffffff80ca1e67 at vfs_cache_root_fallback+0x117 #7 0xffffffff80ca1c0f at vfs_cache_root+0x1af #8 0xffffffff80ee856f at ufs_extattr_autostart+0x5f #9 0xffffffff80edf68a at ffs_mount+0x1c6a #10 0xffffffff80c94029 at vfs_domount+0x819 #11 0xffffffff80c929c1 at vfs_donmount+0x911 #12 0xffffffff80c92079 at sys_nmount+0x69 #13 0xffffffff810625d0 at amd64_syscall+0x2d0 #14 0xffffffff81038bb0 at fast_syscall_common+0x101 20191106 23:19:42 all (24/676): fcntl3.sh 20191106 23:19:44 all (25/676): fifo.sh 20191106 23:19:45 all (26/676): forkbomb.sh 20191106 23:19:47 all (27/676): fsck2.sh 20191106 23:19:48 all (28/676): fsck3.sh 20191106 23:19:50 all (29/676): fsck4.sh 20191106 23:19:51 all (30/676): geomleak.sh 20191106 23:19:53 all (31/676): getrandom.sh 20191106 23:19:54 all (32/676): gnop3.sh 20191106 23:19:56 all (33/676): gnop5.sh GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. 20191106 23:19:58 all (34/676): holdcnt0.sh 20191106 23:19:59 all (35/676): holdcnt02.sh 20191106 23:20:01 all (36/676): holdcnt03.sh 20191106 23:20:02 all (37/676): holdcnt04.sh 20191106 23:20:03 all (38/676): holdcnt05.sh 20191106 23:20:05 all (39/676): isofs2.sh 20191106 23:20:06 all (40/676): jail.sh 20191106 23:20:08 all (41/676): jail2.sh 20191106 23:20:09 all (42/676): jail3.sh 20191106 23:20:11 all (43/676): jail4.sh 20191106 23:20:12 all (44/676): kern_umtx_inf_loop.sh 20191106 23:20:14 all (45/676): kevent10.sh 20191106 23:20:15 all (46/676): kevent3.sh 20191106 23:20:17 all (47/676): ldt.sh 20191106 23:20:19 all (48/676): ldt2.sh 20191106 23:20:20 all (49/676): libMicro.sh 20191106 23:20:22 all (50/676): linux.sh 20191106 23:20:23 all (51/676): lockd.sh 20191106 23:20:24 all (52/676): lockf.sh 20191106 23:20:26 all (53/676): lookup_shared.sh 20191106 23:20:27 all (54/676): mac.sh 20191106 23:20:29 all (55/676): mac_chkexec.sh 20191106 23:20:30 all (56/676): machipc.sh 20191106 23:20:32 all (57/676): machipc2.sh 20191106 23:20:33 all (58/676): maxmemdom.sh 20191106 23:20:34 all (59/676): maxproc.sh 20191106 23:20:36 all (60/676): md4.sh 20191106 23:20:37 all (61/676): md5.sh 20191106 23:20:39 all (62/676): md6.sh 20191106 23:20:41 all (63/676): mdconfig.sh 20191106 23:20:42 all (64/676): mdconfig3.sh 20191106 23:20:44 all (65/676): memguard4.sh 20191106 23:20:45 all (66/676): mkfifo5.sh 20191106 23:20:47 all (67/676): mkfifo7.sh mount leak: 16/47 20191106 23:20:48 all (68/676): mlockall5.sh 20191106 23:20:50 all (69/676): mmap.sh 20191106 23:20:51 all (70/676): mmap12.sh 20191106 23:20:53 all (71/676): mmap16.sh 20191106 23:20:54 all (72/676): mmap17.sh 20191106 23:20:56 all (73/676): mmap20.sh 20191106 23:20:57 all (74/676): mmap24.sh 20191106 23:20:59 all (75/676): mmap30.sh 20191106 23:21:00 all (76/676): mmap33.sh 20191106 23:21:02 all (77/676): mmap35.sh 20191106 23:21:03 all (78/676): mmap36.sh 20191106 23:21:05 all (79/676): mount.sh 20191106 23:21:06 all (80/676): mountro3.sh newblk leak: 1729/2041. 20191106 23:21:08 all (81/676): mprotect.sh 20191106 23:21:09 all (82/676): msdos2.sh 20191106 23:21:11 all (83/676): msdos3.sh 20191106 23:21:12 all (84/676): msdos7.sh lock order reversal: 1st 0xfffff8017f1662e0 msdosfs (msdosfs) @ kern/vfs_syscalls.c:3424 2nd 0xfffff8019c47d558 devfs (devfs) @ fs/msdosfs/msdosfs_vnops.c:853 stack backtrace: #0 0xffffffff80c30cd1 at witness_debugger+0x71 #1 0xffffffff80c30a41 at witness_checkorder+0xab1 #2 0xffffffff80b96a78 at lockmgr_lock_fast_path+0x178 #3 0xffffffff810dc3b2 at VOP_LOCK1_APV+0x92 #4 0xffffffff80cb0fd5 at _vn_lock+0x65 #5 0xffffffff80a84709 at msdosfs_fsync+0x49 #6 0xffffffff810db10a at VOP_FSYNC_APV+0xaa #7 0xffffffff80cacb59 at kern_fsync+0x199 #8 0xffffffff810625d0 at amd64_syscall+0x2d0 #9 0xffffffff81038bb0 at fast_syscall_common+0x101 20191106 23:21:14 all (85/676): msdos8.sh 20191106 23:21:16 all (86/676): msetdomain.sh 20191106 23:21:17 all (87/676): nanosleep.sh 20191106 23:21:19 all (88/676): nbufkv.sh 20191106 23:21:20 all (89/676): nfs.sh 20191106 23:21:22 all (90/676): nfs12.sh 20191106 23:21:23 all (91/676): nfs14.sh 20191106 23:21:24 all (92/676): nfs15.sh 20191106 23:21:26 all (93/676): nfs15lockd.sh 20191106 23:21:27 all (94/676): nfs15lockd3.sh 20191106 23:21:29 all (95/676): nfs3.sh 20191106 23:21:30 all (96/676): nfs4.sh 20191106 23:21:32 all (97/676): nfs7.sh 20191106 23:21:33 all (98/676): nfs8.sh 20191106 23:21:34 all (99/676): nfs9.sh 20191106 23:21:36 all (100/676): nfs_halfpage.sh 20191106 23:21:37 all (101/676): nfs_halfpage2.sh 20191106 23:21:39 all (102/676): nfsdelegation.sh 20191106 23:21:40 all (103/676): nfsdepth.sh 20191106 23:21:42 all (104/676): nfsrename.sh 20191106 23:21:43 all (105/676): nfssillyrename.sh 20191106 23:21:45 all (106/676): nullfs13.sh 20191106 23:21:46 all (107/676): nullfs14.sh 20191106 23:21:48 all (108/676): nullfs15.sh 20191106 23:21:49 all (109/676): nullfs21.sh 20191106 23:21:51 all (110/676): nullfs23.sh 20191106 23:21:52 all (111/676): nullfs4.sh 20191106 23:21:54 all (112/676): nullfs6.sh 20191106 23:21:55 all (113/676): nullfs7.sh 20191106 23:21:57 all (114/676): nullfs9.sh 20191106 23:21:58 all (115/676): numa.sh 20191106 23:22:00 all (116/676): oom.sh 20191106 23:22:01 all (117/676): open.sh 20191106 23:22:03 all (118/676): pagefault.sh 20191106 23:22:04 all (119/676): parallelmount2.sh 20191106 23:22:05 all (120/676): pathconf.sh 20191106 23:22:07 all (121/676): pathconf2.sh 20191106 23:22:08 all (122/676): pcatch.sh 20191106 23:22:10 all (123/676): pcatch2.sh 20191106 23:22:11 all (124/676): ping.sh 20191106 23:22:12 all (125/676): pkru.sh 20191106 23:22:14 all (126/676): pkru2.sh 20191106 23:22:15 all (127/676): pmc4.sh 20191106 23:22:17 all (128/676): pmc5.sh 20191106 23:22:19 all (129/676): poll.sh 20191106 23:22:20 all (130/676): posix_fadvise.sh 20191106 23:22:22 all (131/676): posix_fadvise2.sh 20191106 23:22:23 all (132/676): procfs5.sh 20191106 23:22:25 all (133/676): procfs6.sh 20191106 23:22:26 all (134/676): procstat.sh 20191106 23:22:27 all (135/676): pthread9.sh 20191106 23:22:29 all (136/676): ptrace.sh 20191106 23:22:31 all (137/676): ptrace3.sh 20191106 23:22:32 all (138/676): pts2.sh 20191106 23:22:34 all (139/676): quota5.sh 20191106 23:22:35 all (140/676): rename13.sh 20191106 23:22:37 all (141/676): rename4.sh 20191106 23:22:38 all (142/676): revoke.sh 20191106 23:22:40 all (143/676): routetbl.sh 20191106 23:22:41 all (144/676): ruby.sh 20191106 23:22:43 all (145/676): rwlock_ronly.sh 20191106 23:22:44 all (146/676): schedfuzz.sh 20191106 23:22:46 all (147/676): seekdir.sh 20191106 23:22:47 all (148/676): segnp.sh 20191106 23:22:49 all (149/676): segregs.sh 20191106 23:22:50 all (150/676): select3.sh 20191106 23:22:52 all (151/676): sendfile2.sh lock order reversal: 1st 0xfffff8001ecc6040 filedesc structure (filedesc structure) @ kern/sys_generic.c:1516 2nd 0xfffff8011615f558 ufs (ufs) @ kern/vfs_vnops.c:1551 stack backtrace: #0 0xffffffff80c30cd1 at witness_debugger+0x71 #1 0xffffffff80c30a41 at witness_checkorder+0xab1 #2 0xffffffff80b9705f at lockmgr_xlock_hard+0x6f #3 0xffffffff80b97bed at __lockmgr_args+0x60d #4 0xffffffff80ee19ec at ffs_lock+0x7c #5 0xffffffff810dc3b2 at VOP_LOCK1_APV+0x92 #6 0xffffffff80cb0fd5 at _vn_lock+0x65 #7 0xffffffff80cafa8a at vn_poll+0x3a #8 0xffffffff80c37199 at kern_poll+0x419 #9 0xffffffff80c36d70 at sys_poll+0x50 #10 0xffffffff810625d0 at amd64_syscall+0x2d0 #11 0xffffffff81038bb0 at fast_syscall_common+0x101 20191106 23:22:54 all (152/676): sendfile4.sh 20191106 23:22:55 all (153/676): setuid.sh 20191106 23:22:57 all (154/676): shm_super.sh 20191106 23:22:58 all (155/676): sigaltstack.sh 20191106 23:23:00 all (156/676): sigreturn.sh 20191106 23:23:01 all (157/676): sigstop.sh 20191106 23:23:03 all (158/676): snap12.sh lock order reversal: 1st 0xfffff8001ecc8068 ufs (ufs) @ kern/vfs_mount.c:1603 2nd 0xfffff8017f869b30 snaplk (snaplk) @ ufs/ffs/ffs_snapshot.c:2131 3rd 0xfffff8019caf97d0 ufs (ufs) @ ufs/ffs/ffs_snapshot.c:2132 stack backtrace: #0 0xffffffff80c30cd1 at witness_debugger+0x71 #1 0xffffffff80c30a41 at witness_checkorder+0xab1 #2 0xffffffff80b9705f at lockmgr_xlock_hard+0x6f #3 0xffffffff80b97bed at __lockmgr_args+0x60d #4 0xffffffff80ebdc25 at ffs_snapshot_unmount+0x135 #5 0xffffffff80edd029 at ffs_flushfiles+0x79 #6 0xffffffff80ebf4cd at softdep_flushfiles+0xad #7 0xffffffff80edf897 at ffs_unmount+0xd7 #8 0xffffffff80c95339 at dounmount+0x459 #9 0xffffffff80c94e8e at sys_unmount+0x2ae #10 0xffffffff810625d0 at amd64_syscall+0x2d0 #11 0xffffffff81038bb0 at fast_syscall_common+0x101 20191106 23:23:05 all (159/676): snap2-1.sh lock order reversal: 1st 0xfffffe00381a7be8 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:283 2nd 0xfffff8017f869b30 snaplk (snaplk) @ ufs/ffs/ffs_snapshot.c:2326 stack backtrace: #0 0xffffffff80c30cd1 at witness_debugger+0x71 #1 0xffffffff80c30a41 at witness_checkorder+0xab1 #2 0xffffffff80b9705f at lockmgr_xlock_hard+0x6f #3 0xffffffff80b97bed at __lockmgr_args+0x60d #4 0xffffffff80ebe296 at ffs_copyonwrite+0x166 #5 0xffffffff80ee0a7c at ffs_geom_strategy+0x8c #6 0xffffffff80ef42e3 at ufs_strategy+0x83 #7 0xffffffff810dc7c2 at VOP_STRATEGY_APV+0xb2 #8 0xffffffff80c78584 at bufstrategy+0x44 #9 0xffffffff80c7841a at bufwrite+0x24a #10 0xffffffff80ee288d at ffs_syncvnode+0x2bd #11 0xffffffff80ee1892 at ffs_fsync+0x22 #12 0xffffffff810db10a at VOP_FSYNC_APV+0xaa #13 0xffffffff80ef1f0f at ufs_remove+0xdf #14 0xffffffff810db29e at VOP_REMOVE_APV+0xce #15 0xffffffff80ca9811 at kern_funlinkat+0x2c1 #16 0xffffffff80ca9548 at sys_unlink+0x28 #17 0xffffffff810625d0 at amd64_syscall+0x2d0 20191106 23:23:06 all (160/676): snap2.sh 20191106 23:23:08 all (161/676): sndstat.sh 20191106 23:23:09 all (162/676): socketpair.sh 20191106 23:23:11 all (163/676): socketpair2.sh 20191106 23:23:12 all (164/676): suj2.sh 20191106 23:23:14 all (165/676): suj32.sh 20191106 23:23:16 all (166/676): suj35.sh Nov 6 23:23:17 mercat1 kernel: pid 61949 (mkdir), uid 0 inumber 255 on /mnt: out of inodes 20191106 23:23:17 all (167/676): suj7.sh Failed to find journal. Use tunefs to create one Failed to start journal: 2 20191106 23:23:19 all (168/676): suj8.sh Nov 6 23:23:20 mercat1 kernel: pid 62196 (dd), uid 0 inumber 4 on /mnt: filesystem full Nov 6 23:23:20 mercat1 kernel: pid 62212 (dd), uid 0 inumber 5 on /mnt: filesystem full 20191106 23:23:21 all (169/676): tar.sh 20191106 23:23:22 all (170/676): temp.sh 20191106 23:23:24 all (171/676): tmpfs15.sh 20191106 23:23:25 all (172/676): tmpfs4.sh 20191106 23:23:27 all (173/676): tmpfs6.sh 20191106 23:23:29 all (174/676): tmpfs7.sh 20191106 23:23:31 all (175/676): trim5.sh 20191106 23:23:32 all (176/676): trim6.sh 20191106 23:23:34 all (177/676): trim7.sh 20191106 23:23:35 all (178/676): trim8.sh 20191106 23:23:37 all (179/676): truncate4.sh 20191106 23:23:38 all (180/676): truncate6.sh 20191106 23:23:40 all (181/676): tvnlru.sh 20191106 23:23:41 all (182/676): ufssuspend.sh 20191106 23:23:43 all (183/676): uma_zalloc_arg.sh 20191106 23:23:44 all (184/676): unlink.sh 20191106 23:23:46 all (185/676): unload.sh 20191106 23:23:47 all (186/676): unload2.sh 20191106 23:23:49 all (187/676): vfork.sh 20191106 23:23:51 all (188/676): vmio.sh 20191106 23:23:52 all (189/676): watchman.sh 20191106 23:23:54 all (190/676): write.sh 20191106 23:23:55 all (191/676): snap.sh 20191106 23:23:57 all (192/676): contigmalloc3.sh 20191106 23:24:03 all (193/676): datagram.sh 20191106 23:24:05 all (194/676): ext2fs3.sh 20191106 23:24:08 all (195/676): extattr.sh 20191106 23:24:10 all (196/676): fpclone2.sh 20191106 23:24:12 all (197/676): isofs.sh 20191106 23:24:15 all (198/676): killpg.sh 20191106 23:24:17 all (199/676): md9.sh 20191106 23:24:20 all (200/676): mmap25.sh 20191106 23:24:22 all (201/676): mmap26.sh 20191106 23:24:25 all (202/676): mmap28.sh Nov 6 23:24:27 mercat1 kernel: Failed to fully fault in a core file segment at VA 0x800e00000 with size 0x4196000 to be written at offset 0x86b000 for process mmap28 20191106 23:24:27 all (203/676): mmap8.sh 20191106 23:24:30 all (204/676): mmap9.sh 20191106 23:24:33 all (205/676): mountro2.sh 20191106 23:24:35 all (206/676): nullfs10.sh 20191106 23:24:37 all (207/676): nullfs12.sh 20191106 23:24:39 all (208/676): nullfs16.sh 20191106 23:24:41 all (209/676): nullfs3.sh 20191106 23:24:44 all (210/676): openlock.sh 20191106 23:24:47 all (211/676): overcommit.sh Nov 6 23:25:48 mercat1 kernel: pid 77394 (swap), jid 0, uid 2007, was killed: out of swap space Nov 6 23:25:59 mercat1 kernel: pid 77384 (swap), jid 0, uid 2007, was killed: out of swap space Nov 6 23:26:20 mercat1 kernel: pid 77412 (symlink), uid 2007 inumber 65541 on /mnt: filesystem full Nov 6 23:27:03 mercat1 kernel: pid 79203 (rw), uid 2007 inumber 208345 on /mnt: filesystem full Nov 6 23:27:22 mercat1 kernel: pid 79208 (swap), jid 0, uid 2007, was killed: out of swap space Nov 6 23:31:14 mercat1 kernel: pid 82861 (rw), uid 2007 inumber 197096 on /mnt: filesystem full Nov 6 23:31:59 mercat1 kernel: pid 82925 (swap), jid 0, uid 2007, was killed: out of swap space Nov 6 23:32:19 mercat1 kernel: pid 82855 (rw), uid 2007 inumber 205969 on /mnt: filesystem full Nov 6 23:33:19 mercat1 kernel: pid 84359 (rw), uid 2007 inumber 261676 on /mnt: filesystem full Nov 6 23:33:47 mercat1 kernel: pid 84357 (swap), jid 0, uid 2007, was killed: out of swap space Nov 6 23:34:02 mercat1 kernel: pid 84334 (swap), jid 0, uid 2007, was killed: out of swap space 20191106 23:35:17 all (212/676): ptrace11.sh 20191106 23:35:22 all (213/676): ptrace8.sh 20191106 23:35:25 all (214/676): quota9.sh lock order reversal: 1st 0xfffff8001e09ba88 FFS (FFS Lock) @ ufs/ufs/ufs_quota.c:759 2nd 0xfffff801cded6000 struct mount mtx (struct mount mtx) @ ufs/ufs/ufs_quota.c:765 stack backtrace: #0 0xffffffff80c30cd1 at witness_debugger+0x71 #1 0xffffffff80c30a41 at witness_checkorder+0xab1 #2 0xffffffff80ba2944 at __mtx_lock_flags+0x94 #3 0xffffffff80eeeced at quotaoff_inchange+0xbd #4 0xffffffff80edd0dd at ffs_flushfiles+0x12d #5 0xffffffff80ebf4cd at softdep_flushfiles+0xad #6 0xffffffff80edf897 at ffs_unmount+0xd7 #7 0xffffffff80c95339 at dounmount+0x459 #8 0xffffffff80c94e8e at sys_unmount+0x2ae #9 0xffffffff810625d0 at amd64_syscall+0x2d0 #10 0xffffffff81038bb0 at fast_syscall_common+0x101 20191106 23:35:27 all (215/676): random.sh 20191106 23:35:30 all (216/676): rename6.sh 20191106 23:35:32 all (217/676): scp.sh 20191106 23:35:35 all (218/676): sendfile.sh 20191106 23:35:37 all (219/676): sendfile6.sh 20191106 23:35:38 all (220/676): snap10.sh 20191106 23:35:41 all (221/676): spin.sh 20191106 23:35:44 all (222/676): trim2.sh 20191106 23:35:46 all (223/676): umtx_suspend.sh 20191106 23:35:48 all (224/676): vm_fault_dontneed.sh 20191106 23:35:51 all (225/676): contigmalloc2.sh 20191106 23:35:59 all (226/676): datamove4.sh 20191106 23:36:03 all (227/676): dup.sh 20191106 23:36:07 all (228/676): extattr3.sh 20191106 23:36:11 all (229/676): fcntl.sh 20191106 23:36:14 all (230/676): kevent2.sh 20191106 23:36:18 all (231/676): kevent8.sh 20191106 23:36:22 all (232/676): mlockall7.sh 20191106 23:36:26 all (233/676): mmap23.sh 20191106 23:36:30 all (234/676): mmap4.sh vnode_pager_putpages: I/O error 28 0xfffff8074baa99e0: tag ufs, type VREG usecount 0, writecount 0, refcount 3203 flags (VI_ACTIVE|VI_DOINGINACT) v_object 0xfffff80681cab840 ref 0 pages 25608 cleanbuf 3200 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff8019c932000 (pid 4173, mmap4, tid 100233) #0 0xffffffff80b973fa at lockmgr_xlock_hard+0x40a #1 0xffffffff80b97bed at __lockmgr_args+0x60d #2 0xffffffff80ee19ec at ffs_lock+0x7c #3 0xffffffff810dc3b2 at VOP_LOCK1_APV+0x92 #4 0xffffffff80cb0fd5 at _vn_lock+0x65 #5 0xffffffff80c9e68c at vputx+0x22c #6 0xffffffff80f0a4bd at vm_map_process_deferred+0xad #7 0xffffffff80f10286 at vm_map_remove+0xc6 #8 0xffffffff80f09f75 at vmspace_exit+0xd5 #9 0xffffffff80b7cb52 at exit1+0x5a2 #10 0xffffffff80b7c5ad at sys_sys_exit+0xd #11 0xffffffff810625d0 at amd64_syscall+0x2d0 #12 0xffffffff81038bb0 at fast_syscall_common+0x101 nlink=1, effnlink=1, size=104857600, extsize 0 generation=52a54eb3, uid=0, gid=0, flags=0x0 ino 4, on dev md10a vnode_pager_putpages: residual I/O 32768 at 9760 0xfffff8074baa99e0: tag ufs, type VREG usecount 0, writecount 0, refcount 3203 flags (VI_ACTIVE|VI_DOINGINACT) v_object 0xfffff80681cab840 ref 0 pages 25608 cleanbuf 3200 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff8019c932000 (pid 4173, mmap4, tid 100233) #0 0xffffffff80b973fa at lockmgr_xlock_hard+0x40a #1 0xffffffff80b97bed at __lockmgr_args+0x60d #2 0xffffffff80ee19ec at ffs_lock+0x7c #3 0xffffffff810dc3b2 at VOP_LOCK1_APV+0x92 #4 0xffffffff80cb0fd5 at _vn_lock+0x65 #5 0xffffffff80c9e68c at vputx+0x22c #6 0xffffffff80f0a4bd at vm_map_process_deferred+0xad Nov 6 23:36:31 #7 0xffffffff80f10286 at vm_map_remove+0xc6 mercat1 kernel: #8 0xffffffff80f09f75 at vmspace_exit+0xd5 pid 4173 (mmap4)#9 0xffffffff80b7cb52 at exit1+0x5a2 , uid 0 inumber #10 0xffffffff80b7c5ad at sys_sys_exit+0xd 4 on /mnt: files#11 0xffffffff810625d0 at amd64_syscall+0x2d0 ystem full #12 0xffffffff81038bb0 at fast_syscall_common+0x101 nlink=1, effnlink=1, size=104857600, extsize 0 generation=52a54eb3, uid=0, gid=0, flags=0x0 ino 4, on dev md10a lock order reversal: 1st 0xfffff8028aad4068 syncer (syncer) @ kern/vfs_subr.c:2349 2nd 0xfffff8074baa9a48 ufs (ufs) @ kern/vfs_subr.c:2778 stack backtrace: #0 0xffffffff80c30cd1 at witness_debugger+0x71 #1 0xffffffff80c30a41 at witness_checkorder+0xab1 #2 0xffffffff80b9705f at lockmgr_xlock_hard+0x6f #3 0xffffffff80b97bed at __lockmgr_args+0x60d #4 0xffffffff80ee19ec at ffs_lock+0x7c #5 0xffffffff810dc3b2 at VOP_LOCK1_APV+0x92 #6 0xffffffff80cb0fd5 at _vn_lock+0x65 #7 0xffffffff80c9dbab at vget_finish+0x8b #8 0xffffffff80ca00b5 at vfs_msync+0x125 #9 0xffffffff80ca59fe at sync_fsync+0x10e #10 0xffffffff810db10a at VOP_FSYNC_APV+0xaa #11 0xffffffff80ca3972 at sched_sync+0x3d2 #12 0xffffffff80b81f40 at fork_exit+0x80 #13 0xffffffff810392ce at fork_trampoline+0xe vnode_pager_putpages: zero-length write at 40075264 resid 131072 0xfffff8074baa99e0: tag ufs, type VREG usecount 1, writecount 0, refcount 3203 flags (VI_ACTIVE) v_object 0xfffff80681cab840 ref 0 pages 25608 cleanbuf 3201 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff80007a3d6e0 (pid 33, syncer, tid 100140) #0 0xffffffff80b973fa at lockmgr_xlock_hard+0x40a #1 0xffffffff80b97bed at __lockmgr_args+0x60d #2 0xffffffff80ee19ec at ffs_lock+0x7c #3 0xffffffff810dc3b2 at VOP_LOCK1_APV+0x92 #4 0xffffffff80cb0fd5 at _vn_lock+0x65 #5 0xffffffff80c9dbab at vget_finish+0x8b #6 0xffffffff80ca00b5 at vfs_msync+0x125 #7 0xffffffff80ca59fe at sync_fsync+0x10e #8 0xffffffff810db10a at VOP_FSYNC_APV+0xaa #9 0xffffffff80ca3972 at sched_sync+0x3d2 #10 0xffffffff80b81f40 at fork_exit+0x80 #11 0xffffffff810392ce at fork_trampoline+0xe nlink=1, effnlink=1, size=104857600, extsize 0 generation=52a54eb3, uid=0, gid=0, flags=0x0 ino 4, on dev md10a Nov 6 23:36:32 mercat1 kernel: pid 33 (syncer), uid 0 inumber 4 on /mnt: filesystem full 20191106 23:36:33 all (235/676): msdos9.sh 20191106 23:36:36 all (236/676): newfs5.sh 20191106 23:36:39 all (237/676): procfs2.sh 20191106 23:36:43 all (238/676): pthread.sh 20191106 23:36:47 all (239/676): tmpfs5.sh 20191106 23:36:50 all (240/676): truncate5.sh 20191106 23:36:54 all (241/676): udp.sh 20191106 23:36:57 all (242/676): unix_socket.sh 20191106 23:37:01 all (243/676): devfd.sh 20191106 23:37:05 all (244/676): mkfifo6.sh 20191106 23:37:10 all (245/676): mmap13.sh 20191106 23:37:15 all (246/676): mountro4.sh 20191106 23:37:20 all (247/676): growfs.sh g_access(997): provider ufsid/5dc34b21e3af5782 has error 6 set g_access(997): provider ufsid/5dc34b21e3af5782 has error 6 set g_access(997): provider ufsid/5dc34b21e3af5782 has error 6 set g_access(997): provider gptid/ff0008e0-00e5-11ea-9c05-0cc47aa8cdda has error 6 set g_access(997): provider gptid/ff0008e0-00e5-11ea-9c05-0cc47aa8cdda has error 6 set g_access(997): provider gptid/ff0008e0-00e5-11ea-9c05-0cc47aa8cdda has error 6 set g_dev_taste: make_dev_p() failed (gp->name=gptid/ff0008e0-00e5-11ea-9c05-0cc47aa8cdda, error=17) g_dev_taste: make_dev_p() failed (gp->name=gptid/ff0008e0-00e5-11ea-9c05-0cc47aa8cdda, error=17) g_dev_taste: make_dev_p() failed (gp->name=ufsid/5dc34b21e3af5782, error=17) g_dev_taste: make_dev_p() failed (gp->name=gptid/ff0008e0-00e5-11ea-9c05-0cc47aa8cdda, error=17) g_dev_taste: make_dev_p() failed (gp->name=ufsid/5dc34b21e3af5782, error=17) g_dev_taste: make_dev_p() failed (gp->name=gptid/ff0008e0-00e5-11ea-9c05-0cc47aa8cdda, error=17) g_dev_taste: make_dev_p() failed (gp->name=ufsid/5dc34b21e3af5782, error=17) GEOM leak: 14/87 20191106 23:37:26 all (248/676): procfs.sh 20191106 23:37:31 all (249/676): pshared.sh 20191106 23:37:37 all (250/676): ptrace2.sh 20191106 23:37:43 all (251/676): rename11.sh 20191106 23:37:48 all (252/676): symlink4.sh 20191106 23:37:54 all (253/676): tmpfs10.sh 20191106 23:37:59 all (254/676): truncate3.sh 20191106 23:38:05 all (255/676): truncate7.sh 20191106 23:38:09 all (256/676): datamove5.sh 20191106 23:38:16 all (257/676): fork.sh 20191106 23:38:23 all (258/676): linger3.sh 20191106 23:38:29 all (259/676): mlockall4.sh 20191106 23:38:36 all (260/676): ptrace9.sh 20191106 23:38:43 all (261/676): sparse.sh 20191106 23:38:46 all (262/676): linger2.sh Nov 6 23:38:50 mercat1 kernel: pid 52204 (linger2), uid 2007 inumber 889 on /mnt: filesystem full 20191106 23:38:53 all (263/676): linger4.sh Nov 6 23:38:59 mercat1 kernel: pid 53507 (linger4), uid 2007 inumber 37645 on /mnt: out of inodes 20191106 23:39:01 all (264/676): symlink2.sh 20191106 23:39:09 all (265/676): sysctl.sh 20191106 23:39:17 all (266/676): md8.sh 20191106 23:39:27 all (267/676): quota11.sh 20191106 23:39:36 all (268/676): shm_open.sh 20191106 23:39:50 all (269/676): compare.sh 20191106 23:40:00 all (270/676): ffs_blkfree.sh newblk leak: 26640/28681. 20191106 23:40:10 all (271/676): procfs3.sh 20191106 23:40:16 all (272/676): execve.sh 20191106 23:40:58 all (273/676): rename8.sh 20191106 23:41:10 all (274/676): thr.sh witness_lock_list_get: witness exhausted 20191106 23:41:20 all (275/676): tmpfs8.sh 20191106 23:41:31 all (276/676): fsck5.sh 20191106 23:41:42 all (277/676): nfs15lockd2.sh 20191106 23:41:53 all (278/676): proccontrol.sh 20191106 23:42:04 all (279/676): rdgsbase.sh 20191106 23:42:16 all (280/676): rename9.sh 20191106 23:42:27 all (281/676): umountf4.sh freework leak: 98/197. 20191106 23:42:38 all (282/676): pmc7.sh 20191106 23:42:50 all (283/676): posix_fadvise3.sh 20191106 23:43:02 all (284/676): tmpfs14.sh 20191106 23:43:14 all (285/676): mprotect2.sh 20191106 23:46:54 all (286/676): pipe2.sh 20191106 23:47:06 all (287/676): umountf11.sh 20191106 23:47:20 all (288/676): umountf12.sh 20191106 23:47:34 all (289/676): umountf6.sh 20191106 23:47:46 all (290/676): radix.sh Nov 6 23:47:53 mercat1 kernel: pid 68394 (radix), jid 0, uid 0, was killed: out of swap space 20191106 23:47:54 all (291/676): recursiveflushes.sh 20191106 23:48:15 all (292/676): mountu.sh 20191106 23:48:32 all (293/676): suj10.sh 20191106 23:48:48 all (294/676): kevent6.sh 20191106 23:49:07 all (295/676): rdwr.sh 20191106 23:49:25 all (296/676): sem.sh 20191106 23:49:43 all (297/676): suj14.sh Nov 6 23:49:57 mercat1 kernel: pid 8401 (cp), uid 0 inumber 107070 on /mnt: filesystem full Nov 6 23:49:58 mercat1 kernel: pid 8401 (cp), uid 0 inumber 107110 on /mnt: filesystem full Nov 6 23:49:59 mercat1 kernel: pid 8401 (cp), uid 0 inumber 107143 on /mnt: filesystem full Nov 6 23:50:00 mercat1 kernel: pid 8421 (cp), uid 0 inumber 107158 on /mnt: filesystem full Nov 6 23:50:01 mercat1 kernel: pid 8454 (mkdir), uid 0 inumber 107159 on /mnt: filesystem full 20191106 23:50:03 all (298/676): mountro6.sh 20191106 23:50:24 all (299/676): multicast.sh 20191106 23:50:45 all (300/676): pdfork.sh 20191106 23:51:07 all (301/676): rename7.sh 20191106 23:51:29 all (302/676): core4.sh Nov 6 23:51:31 mercat1 kernel: Failed to write core file for process core4 (error 5) 20191106 23:51:51 all (303/676): tmpfs19.sh Nov 6 23:51:50 mercat1 syslogd: last message repeated 59 times 20191106 23:52:20 all (304/676): sendfile5.sh 20191106 23:52:45 all (305/676): swap4.sh swp_pager_getswapspace(17): failed Nov 6 23:52:57 mercat1 kernel: pid 25686 (swap4), jid 0, uid 0, was killed: out of swap space Nov 6 23:53:04 mercat1 kernel: pid 25690 (swap4), jid 0, uid 0, was killed: out of swap space 20191106 23:53:05 all (306/676): tmpfs2.sh 20191106 23:53:29 all (307/676): f_offset.sh 20191106 23:53:53 all (308/676): mmap7.sh 20191106 23:54:20 all (309/676): pread.sh 20191106 23:55:17 all (310/676): sendmsg2.sh 20191106 23:55:42 all (311/676): multicast2.sh Nov 6 23:55:45 mercat1 mDNSResponder[18632]: mDNSResponder (Engineering Build) (Jul 27 2019 06:17:54) starting Nov 6 23:55:45 mercat1 mDNSResponder[18632]: mDNS_AddDNSServer: Lock not held! mDNS_busy (0) mDNS_reentrancy (0) Nov 6 23:55:45 mercat1 mDNSResponder[18632]: mDNSPlatformSourceAddrForDest: connect 1.1.1.1 failed errno 51 (Network is unreachable) if_delmulti_locked: detaching ifnet instance 0xfffff80727150000 if_delmulti_locked: detaching ifnet instance 0xfffff80727150000 if_delmulti_locked: detaching ifnet instance 0xfffff8000453b800 if_delmulti_locked: detaching ifnet instance 0xfffff80727150000 if_delmulti_locked: detaching ifnet instance 0xfffff80727150000 if_delmulti_locked: detaching ifnet instance 0xfffff80727150000 if_delmulti_locked: detaching ifnet instance 0xfffff80727150000 if_delmulti_locked: detaching ifnet instance 0xfffff80727150000 if_delmulti_locked: detaching ifnet instance 0xfffff80727150000 if_delmulti_locked: detaching ifnet instance 0xfffff80727150000 if_delmulti_locked: detaching ifnet instance 0xfffff80727150000 if_delmulti_locked: detaching ifnet instance 0xfffff8000453b800 Nov 6 23:57:13 mercat1 kernel: pid 18604 (swap), jid 0, uid 0, was killed: out of swap space Nov 6 23:57:22 mercat1 mDNSResponder[18632]: mDNSResponder (Engineering Build) (Jul 27 2019 06:17:54) stopping if_delmulti_locked: detaching ifnet instance 0xfffff8000453b800 20191106 23:58:03 all (312/676): sendfile3.sh 20191106 23:58:32 all (313/676): beneath.sh 20191106 23:59:01 all (314/676): namecache2.sh 20191106 23:59:30 all (315/676): mkfifo3.sh 20191107 00:00:02 all (316/676): mmap37.sh 20191107 00:00:34 all (317/676): split.sh 20191107 00:00:59 all (318/676): pthread5.sh 20191107 00:02:02 all (319/676): credleak.sh 20191107 00:02:38 all (320/676): msdos5.sh GEOM leak: 19/106 20191107 00:03:13 all (321/676): nullfs22.sh 20191107 00:03:48 all (322/676): tcp4.sh Expensive timeout(9) function: 0xffffffff80dff820(0xfffff802d7b107a0) 0.008758871 s Expensive timeout(9) function: 0xffffffff80e00760(0xfffff8074c7bf000) 0.022087441 s 20191107 00:04:34 all (323/676): core2.sh 20191107 00:05:09 all (324/676): rename3.sh 20191107 00:05:45 all (325/676): mmap5.sh 20191107 00:06:14 all (326/676): umountf5.sh Nov 7 00:06:18 mercat1 kernel: pid 48164 (creat), uid 0 inumber 1152 on /mnt: out of inodes Nov 7 00:06:20 mercat1 kernel: pid 48165 (creat), uid 0 inumber 1153 on /mnt: out of inodes Nov 7 00:06:21 mercat1 kernel: pid 48159 (creat), uid 0 inumber 385 on /mnt: out of inodes Nov 7 00:06:23 mercat1 kernel: pid 48169 (creat), uid 0 inumber 387 on /mnt: out of inodes Nov 7 00:06:25 mercat1 kernel: pid 48159 (creat), uid 0 inumber 385 on /mnt: out of inodes Nov 7 00:06:26 mercat1 kernel: pid 48165 (creat), uid 0 inumber 1153 on /mnt: out of inodes Nov 7 00:06:29 mercat1 kernel: pid 48162 (creat), uid 0 inumber 768 on /mnt: out of inodes Nov 7 00:06:35 mercat1 syslogd: last message repeated 2 times Nov 7 00:06:37 mercat1 kernel: pid 48160 (creat), uid 0 inumber 389 on /mnt: out of inodes Nov 7 00:06:39 mercat1 kernel: pid 48163 (creat), uid 0 inumber 769 on /mnt: out of inodes Nov 7 00:06:40 mercat1 kernel: pid 48174 (mkdir), uid 0 inumber 743 on /mnt: out of inodes Nov 7 00:06:44 mercat1 kernel: pid 48165 (creat), uid 0 inumber 1153 on /mnt: out of inodes 20191107 00:06:52 all (327/676): umountf.sh 20191107 00:07:25 all (328/676): sendfile_shm.sh 20191107 00:07:39 all (329/676): vnodes.sh 20191107 00:08:20 all (330/676): quota8.sh 20191107 00:08:56 all (331/676): crossmp7.sh ZFS filesystem version: 5 ZFS storage pool version: features support (5000) Warning: memory type solaris leaked memory on destroy (4 allocations, 2112 bytes leaked). 20191107 00:09:48 all (332/676): suj33.sh 20191107 00:10:18 all (333/676): fpu.sh 20191107 00:11:11 all (334/676): ufsbench.sh 20191107 00:12:03 all (335/676): nullfs11.sh 20191107 00:13:00 all (336/676): crossmp5.sh 20191107 00:14:00 all (337/676): fifo3.sh 20191107 00:14:57 all (338/676): posix_openpt.sh 20191107 00:15:54 all (339/676): advlock.sh 20191107 00:16:56 all (340/676): bench.sh 20191107 00:18:04 all (341/676): flock.sh 20191107 00:19:06 all (342/676): fsgs.sh 20191107 00:20:07 all (343/676): fts2.sh 20191107 00:21:08 all (344/676): fullpath.sh 20191107 00:22:10 all (345/676): jumbo.sh 20191107 00:23:11 all (346/676): mdconfig2.sh 20191107 00:24:12 all (347/676): midi2.sh 20191107 00:25:13 all (348/676): mknod.sh 20191107 00:26:14 all (349/676): mmap29.sh 20191107 00:27:16 all (350/676): pts3.sh 20191107 00:28:20 all (351/676): sem_wait.sh 20191107 00:29:21 all (352/676): shm.sh 20191107 00:30:23 all (353/676): sigstop2.sh 20191107 00:31:24 all (354/676): socketpair3.sh 20191107 00:32:25 all (355/676): crossmp8.sh 20191107 00:33:27 all (356/676): fsck.sh Superblock check-hash failed: recorded check-hash 0xa97a6921 != computed check-hash 0x8dc20a (Ignored) Superblock check-hash failed: recorded check-hash 0xa97a6921 != computed check-hash 0x8dc20a (Ignored) free inode /mnt11/1292 had -2161727821137838080 blocks Nov 7 00:34:11 mercat1 kernel: pid 66959 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:11 mercat1 kernel: pid 66982 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:11 mercat1 kernel: pid 67005 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:11 mercat1 kernel: pid 67028 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:11 mercat1 kernel: pid 67051 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:11 mercat1 kernel: pid 67074 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:11 mercat1 kernel: pid 67097 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:11 mercat1 kernel: pid 67120 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:11 mercat1 kernel: pid 67143 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:11 mercat1 kernel: pid 67166 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:11 mercat1 kernel: pid 67189 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:11 mercat1 kernel: pid 67212 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:11 mercat1 kernel: pid 67235 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:11 mercat1 kernel: pid 67258 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:11 mercat1 kernel: pid 67281 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:11 mercat1 kernel: pid 67304 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:11 mercat1 kernel: pid 67327 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:11 mercat1 kernel: pid 67350 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:11 mercat1 kernel: pid 67373 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:11 mercat1 kernel: pid 67396 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:11 mercat1 kernel: pid 67419 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:11 mercat1 kernel: pid 67442 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:11 mercat1 kernel: pid 67465 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:11 mercat1 kernel: pid 67488 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:11 mercat1 kernel: pid 67511 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:11 mercat1 kernel: pid 67534 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:11 mercat1 kernel: pid 67557 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:11 mercat1 kernel: pid 67580 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:12 mercat1 kernel: pid 67631 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:12 mercat1 kernel: pid 67654 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:12 mercat1 kernel: pid 67705 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:12 mercat1 kernel: pid 67728 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:12 mercat1 kernel: pid 67751 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:12 mercat1 kernel: pid 67774 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:12 mercat1 kernel: pid 67797 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:12 mercat1 kernel: pid 67820 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:12 mercat1 kernel: pid 67843 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:12 mercat1 kernel: pid 67866 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:12 mercat1 kernel: pid 67889 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:12 mercat1 kernel: pid 67912 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:12 mercat1 kernel: pid 67935 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:12 mercat1 kernel: pid 67958 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:12 mercat1 kernel: pid 67981 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:12 mercat1 kernel: pid 68004 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:12 mercat1 kernel: pid 68027 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:12 mercat1 kernel: pid 68050 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:12 mercat1 kernel: pid 68073 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:12 mercat1 kernel: pid 68096 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:12 mercat1 kernel: pid 68119 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:12 mercat1 kernel: pid 68142 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:12 mercat1 kernel: pid 68165 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:12 mercat1 kernel: pid 68188 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:12 mercat1 kernel: pid 68211 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:12 mercat1 kernel: pid 68234 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:12 mercat1 kernel: pid 68257 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:12 mercat1 kernel: pid 68280 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:13 mercat1 kernel: pid 68303 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:13 mercat1 kernel: pid 68326 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:13 mercat1 kernel: pid 68349 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:13 mercat1 kernel: pid 68372 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:13 mercat1 kernel: pid 68395 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:13 mercat1 kernel: pid 68418 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:13 mercat1 kernel: pid 68441 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:13 mercat1 kernel: pid 68464 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:13 mercat1 kernel: pid 68487 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:13 mercat1 kernel: pid 68510 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:13 mercat1 kernel: pid 68533 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:13 mercat1 kernel: pid 68556 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:13 mercat1 kernel: pid 68579 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:13 mercat1 kernel: pid 68602 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:13 mercat1 kernel: pid 68625 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:13 mercat1 kernel: pid 68648 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:13 mercat1 kernel: pid 68671 (touch), uid 0 inumber 2 on /mnt11: out of inodes Nov 7 00:34:13 mercat1 kernel: pid 68694 (touch), uid 0 inumber 2 on /mnt11: out of inodes 20191107 00:34:14 all (357/676): sendfile8.sh 20191107 00:35:16 all (358/676): sendfile9.sh 20191107 00:36:17 all (359/676): exlock.sh 20191107 00:37:22 all (360/676): tcp3.sh 20191107 00:38:24 all (361/676): rename10.sh 20191107 00:39:31 all (362/676): truss2.sh 20191107 00:41:04 all (363/676): suj6.sh 20191107 00:42:15 all (364/676): stack_guard_page.sh Nov 7 00:42:25 mercat1 kernel: pid 15263 (rw), uid 2007 inumber 96960 on /mnt: filesystem full Nov 7 00:42:27 mercat1 kernel: pid 15272 (rw), uid 2007 inumber 109350 on /mnt: filesystem full Nov 7 00:42:39 mercat1 kernel: pid 15265 (rw), uid 2007 inumber 67721 on /mnt: filesystem full Nov 7 00:42:41 mercat1 kernel: pid 15247 (swap), jid 0, uid 2007, was killed: out of swap space Nov 7 00:43:04 mercat1 kernel: pid 15262 (rw), uid 2007 inumber 65674 on /mnt: out of inodes Nov 7 00:43:13 mercat1 kernel: pid 15347 (creat), uid 2007 inumber 65573 on /mnt: out of inodes 20191107 00:43:27 all (365/676): suj5.sh 20191107 00:44:38 all (366/676): dd.sh Nov 7 00:45:40 mercat1 kernel: pid 26597 (dd), uid 0 inumber 481540 on /tmp: filesystem full 20191107 00:45:43 all (367/676): vmstat.sh 20191107 00:46:52 all (368/676): quota4.sh newblk leak: 4116/32797. 20191107 00:49:09 all (369/676): mountro5.sh 20191107 00:50:28 all (370/676): zfs6.sh ZFS filesystem version: 5 ZFS storage pool version: features support (5000) Warning: memory type solaris leaked memory on destroy (4 allocations, 2112 bytes leaked). 20191107 00:52:04 all (371/676): tmpfs12.sh Nov 7 00:52:30 mercat1 kernel: pid 59247 (swap), jid 0, uid 0, was killed: out of swap space Nov 7 00:52:55 mercat1 kernel: pid 59255 (swap), jid 0, uid 0, was killed: out of swap space 20191107 00:53:24 all (372/676): crossmp.sh 20191107 00:54:46 all (373/676): overcommit2.sh Nov 7 00:56:12 mercat1 kernel: pid 21934 (dd), uid 0 inumber 11 on /mnt: filesystem full 20191107 00:56:25 all (374/676): rename12.sh 20191107 00:57:48 all (375/676): pthread2.sh 20191107 00:59:21 all (376/676): pmc6.sh 20191107 01:01:01 all (377/676): pthread7.sh 20191107 01:02:41 all (378/676): mmap18.sh 20191107 01:04:03 all (379/676): ptrace10.sh 20191107 01:05:51 all (380/676): umountf2.sh 20191107 01:08:10 all (381/676): alternativeFlushPath.sh Nov 7 01:12:28 mercat1 kernel: pid 18547 (alternativeFlushPat), uid 0 inumber 86 on /tmp: out of inodes 20191107 01:28:13 all (382/676): pthread3.sh 20191107 01:30:09 all (383/676): mmap21.sh Nov 7 01:32:14 mercat1 kernel: pid 64965 (mmap21), uid 2007 inumber 86 on /tmp: filesystem full Nov 7 01:32:14 mercat1 kernel: Failed to write core file for process mmap21 (error 28) Nov 7 01:32:49 mercat1 kernel: pid 64964 (mmap21), uid 2007 inumber 86 on /tmp: filesystem full Nov 7 01:32:49 mercat1 kernel: Failed to write core file for process mmap21 (error 28) 20191107 01:32:49 all (384/676): msdos10.sh 20191107 01:34:37 all (385/676): gnop2.sh GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. 20191107 01:36:32 all (386/676): fifo2.sh 20191107 01:38:33 all (387/676): kevent.sh 20191107 01:40:35 all (388/676): kevent14.sh 20191107 01:42:36 all (389/676): midi.sh 20191107 01:44:37 all (390/676): overflow3.sh 20191107 01:46:39 all (391/676): ftruncate3.sh GEOM leak: 10/116 20191107 01:48:42 all (392/676): sendfile10.sh 20191107 01:50:44 all (393/676): mmap27.sh 20191107 01:52:47 all (394/676): shm2.sh Nov 7 01:53:18 mercat1 kernel: pid 2873 (swap), jid 0, uid 0, was killed: out of swap space Nov 7 01:54:40 mercat1 kernel: pid 2869 (swap), jid 0, uid 0, was killed: out of swap space 20191107 01:54:51 all (395/676): snap11.sh 20191107 01:56:55 all (396/676): truncate9.sh 20191107 01:58:59 all (397/676): poll2.sh 20191107 02:01:05 all (398/676): fts3.sh 20191107 02:03:08 all (399/676): graid1_3.sh g_access(997): provider ufsid/5dc34b21e3af5782 has error 6 set g_access(997): provider gptid/ff0008e0-00e5-11ea-9c05-0cc47aa8cdda has error 6 set 20191107 02:05:12 all (400/676): vm_map.sh 20191107 02:07:17 all (401/676): graid1_10.sh g_access(997): provider ufsid/5dc34b21e3af5782 has error 6 set g_access(997): provider gptid/ff0008e0-00e5-11ea-9c05-0cc47aa8cdda has error 6 set 20191107 02:09:22 all (402/676): mmap31.sh Nov 7 02:11:04 mercat1 kernel: pid 27847 (swap), jid 0, uid 0, was killed: out of swap space 20191107 02:11:28 all (403/676): tmpfs13.sh 20191107 02:13:35 all (404/676): nullfs18.sh Nov 7 02:14:01 mercat1 kernel: pid 37804 (swap), jid 0, uid 0, was killed: out of swap space 20191107 02:15:44 all (405/676): racct.sh 20191107 02:17:51 all (406/676): swappedout.sh 20191107 02:20:05 all (407/676): fifo4.sh 20191107 02:22:09 all (408/676): fpclone.sh 20191107 02:24:18 all (409/676): kevent4.sh Nov 7 02:24:36 mercat1 kernel: pid 88420 (swap), jid 0, uid 0, was killed: out of swap space 20191107 02:26:27 all (410/676): truncate2.sh 20191107 02:28:35 all (411/676): contigmalloc.sh 20191107 02:30:39 all (412/676): arp.sh Nov 7 02:31:18 mercat1 kernel: pid 17618 (swap), jid 0, uid 0, was killed: out of swap space 20191107 02:32:45 all (413/676): vmstat2.sh Nov 7 02:33:28 mercat1 kernel: pid 32777 (swap), jid 0, uid 0, was killed: out of swap space Nov 7 02:33:58 mercat1 kernel: pid 32764 (swap), jid 0, uid 0, was killed: out of swap space 20191107 02:34:52 all (414/676): suj23.sh 20191107 02:36:59 all (415/676): syscall4.sh WARNING pid 58495 (calls): ioctl sign-extension ioctl d7a254ab36d08451 WARNING pid 58517 (calls): ioctl sign-extension ioctl 4401676dfb59 WARNING pid 58642 (calls): ioctl sign-extension ioctl a6521b6d4b598a48 WARNING pid 58656 (calls): ioctl sign-extension ioctl ebd02a413456fe53 WARNING pid 58968 (calls): ioctl sign-extension ioctl 7fd89cec8293 WARNING pid 59080 (calls): ioctl sign-extension ioctl 5d6dcb441104b21 WARNING pid 59587 (calls): ioctl sign-extension ioctl e439defe3779ea71 WARNING pid 59706 (calls): ioctl sign-extension ioctl 7f3874f5939339de WARNING pid 59963 (calls): ioctl sign-extension ioctl 3b30f44007f0b282 WARNING pid 59990 (calls): ioctl sign-extension ioctl 3cbc0fb9c50a WARNING pid 60010 (calls): ioctl sign-extension ioctl fc0012a2d770570e WARNING pid 60015 (calls): ioctl sign-extension ioctl 6203c67f77cf WARNING pid 60024 (calls): ioctl sign-extension ioctl 4351e67dacc9 WARNING pid 60049 (calls): ioctl sign-extension ioctl 4625fb1642ee WARNING pid 60051 (calls): ioctl sign-extension ioctl 4b1c764dccbc WARNING pid 60069 (calls): ioctl sign-extension ioctl 48de29cd8276 WARNING pid 60138 (calls): ioctl sign-extension ioctl 67c890541842 WARNING pid 60179 (calls): ioctl sign-extension ioctl b60f520a90fda220 WARNING pid 60180 (calls): ioctl sign-extension ioctl 92ab1a9f7b71907b WARNING pid 60205 (calls): ioctl sign-extension ioctl d5f3e0ee6462f0b2 WARNING pid 60310 (calls): ioctl sign-extension ioctl b3116b8b6940c193 WARNING pid 60406 (calls): ioctl sign-extension ioctl c43b7eba43 WARNING pid 60471 (calls): ioctl sign-extension ioctl 2798c4f1e580 WARNING pid 60472 (calls): ioctl sign-extension ioctl 75ea15c6eb5e WARNING pid 61520 (calls): ioctl sign-extension ioctl cdfe2dbc19b6a005 WARNING pid 61821 (calls): ioctl sign-extension ioctl 47c8bcd52072 WARNING pid 61862 (calls): ioctl sign-extension ioctl 1acc849f21c5cb3 WARNING pid 61866 (calls): ioctl sign-extension ioctl a4b8f8c28892d7ce WARNING pid 61873 (calls): ioctl sign-extension ioctl a730aa42a4155b24 WARNING pid 61875 (calls): ioctl sign-extension ioctl 35bdadc27016 WARNING pid 61966 (calls): ioctl sign-extension ioctl c421152f4f6031e5 WARNING pid 62082 (calls): ioctl sign-extension ioctl 4302462e25e8 WARNING pid 62529 (calls): ioctl sign-extension ioctl c4a80b0438082963 WARNING pid 62548 (calls): ioctl sign-extension ioctl 5fbb8f70e04b WARNING pid 63052 (calls): ioctl sign-extension ioctl 4aa7c9c019ba3e3 WARNING pid 63082 (calls): ioctl sign-extension ioctl cbb55c19de633abb WARNING pid 63098 (calls): ioctl sign-extension ioctl 6a44652a80239e37 WARNING pid 63130 (calls): ioctl sign-extension ioctl c1d74570cd7952a5 WARNING pid 63589 (calls): ioctl sign-extension ioctl 397b36be02f WARNING pid 63602 (calls): ioctl sign-extension ioctl 12fc5fd624b2 WARNING pid 63687 (calls): ioctl sign-extension ioctl f3cab22d8a6a0f53 WARNING pid 63763 (calls): ioctl sign-extension ioctl 3fe8473d47da WARNING pid 63810 (calls): ioctl sign-extension ioctl 47e31fd732f9 WARNING pid 63821 (calls): ioctl sign-extension ioctl 8e233bf797f40760 WARNING pid 64157 (calls): ioctl sign-extension ioctl 60322c96742e WARNING pid 64667 (calls): ioctl sign-extension ioctl d93786436fe49670 WARNING pid 64996 (calls): ioctl sign-extension ioctl 1472574241499366 WARNING pid 65024 (calls): ioctl sign-extension ioctl 23373997979d WARNING pid 65253 (calls): ioctl sign-extension ioctl 82dc2944b7302aca WARNING pid 65351 (calls): ioctl sign-extension ioctl 761df666dcbae16c WARNING pid 65410 (calls): ioctl sign-extension ioctl 9666e1b36b0d3ddd WARNING pid 65568 (calls): ioctl sign-extension ioctl 4800e1e26eca WARNING pid 65599 (calls): ioctl sign-extension ioctl 2698af2ecd51 WARNING pid 65636 (calls): ioctl sign-extension ioctl 22a8754910e3 WARNING pid 65729 (calls): ioctl sign-extension ioctl fc90b79ca3d3c686 WARNING pid 66468 (calls): ioctl sign-extension ioctl 28db9b2b2aeb WARNING pid 66480 (calls): ioctl sign-extension ioctl 590c897bfc213b30 WARNING pid 66663 (calls): ioctl sign-extension ioctl 213a7c76cbd62606 WARNING pid 67033 (calls): ioctl sign-extension ioctl c4322e7d4a90fb3 WARNING pid 67051 (calls): ioctl sign-extension ioctl 3bccd2371145c029 WARNING pid 67062 (calls): ioctl sign-extension ioctl 36accebb66c17cfa WARNING pid 67148 (calls): ioctl sign-extension ioctl 27c06e6a152a WARNING pid 67178 (calls): ioctl sign-extension ioctl f10a958a2322bf36 WARNING pid 67184 (calls): ioctl sign-extension ioctl af9838d9b74a5e16 WARNING pid 67357 (calls): ioctl sign-extension ioctl b6d38e7c54b6af29 WARNING pid 67364 (calls): ioctl sign-extension ioctl 624f0af9bd96 WARNING pid 67442 (calls): ioctl sign-extension ioctl d1e58bb4ac1386d3 WARNING pid 68634 (calls): ioctl sign-extension ioctl 14d71b05377e WARNING pid 68657 (calls): ioctl sign-extension ioctl 52029a5daf17 WARNING pid 68774 (calls): ioctl sign-extension ioctl ef7fb9ffbc13e187 WARNING pid 68859 (calls): ioctl sign-extension ioctl f69be80b96cea34c WARNING pid 68907 (calls): ioctl sign-extension ioctl f27bf6f6f277bf79 WARNING pid 68981 (calls): ioctl sign-extension ioctl 99d74a8686a1e3a0 WARNING pid 70084 (calls): ioctl sign-extension ioctl 1cef920316 WARNING pid 70274 (calls): ioctl sign-extension ioctl 6eb3f5b792ac WARNING pid 70441 (calls): ioctl sign-extension ioctl 9d8ac553b06 WARNING pid 70652 (calls): ioctl sign-extension ioctl 6d01ee41b8daf96b WARNING pid 70689 (calls): ioctl sign-extension ioctl d5d6fa67b36521de WARNING pid 70695 (calls): ioctl sign-extension ioctl ab922658957bfeae WARNING pid 70709 (calls): ioctl sign-extension ioctl ae94ff78e00 WARNING pid 72091 (calls): ioctl sign-extension ioctl 69caf69f8e59 WARNING pid 72100 (calls): ioctl sign-extension ioctl cda313ac94ab9bdf WARNING pid 72144 (calls): ioctl sign-extension ioctl fc9c0b9eafffd640 WARNING pid 72160 (calls): ioctl sign-extension ioctl 7b8108abdad3 WARNING pid 72264 (calls): ioctl sign-extension ioctl 6e8e427c6e539c69 WARNING pid 73779 (calls): ioctl sign-extension ioctl 66ee1727d777 WARNING pid 73860 (calls): ioctl sign-extension ioctl e60c629421907a69 WARNING pid 73996 (calls): ioctl sign-extension ioctl 4a963e4b038bdac6 WARNING pid 74031 (calls): ioctl sign-extension ioctl 75ca29bffada1ed3 WARNING pid 74098 (calls): ioctl sign-extension ioctl 2e000d229d7d WARNING pid 74124 (calls): ioctl sign-extension ioctl 2e7586498a56 WARNING pid 74132 (calls): ioctl sign-extension ioctl 52bfcb704776 WARNING pid 74181 (calls): ioctl sign-extension ioctl c5b4cd5d7223b8c3 WARNING pid 74181 (calls): ioctl sign-extension ioctl 17df27d45176cfc0 WARNING pid 74240 (calls): ioctl sign-extension ioctl 251ada47d8ed WARNING pid 74291 (calls): ioctl sign-extension ioctl 88e7f0fbde1f58be WARNING pid 74302 (calls): ioctl sign-extension ioctl 4165ca6131d4dd35 WARNING pid 74392 (calls): ioctl sign-extension ioctl ddce118b25beff39 WARNING pid 75588 (calls): ioctl sign-extension ioctl c66a145144e26ff0 WARNING pid 75636 (calls): ioctl sign-extension ioctl cd54640820838a97 WARNING pid 75660 (calls): ioctl sign-extension ioctl 38a4780aca8f 20191107 02:39:01 all (416/676): nullfs19.sh 20191107 02:41:04 all (417/676): pthread4.sh 20191107 02:43:27 all (418/676): mmap32.sh 20191107 02:45:48 all (419/676): callout_reset_on.sh 20191107 02:47:40 all (420/676): zz-combo3.sh 20191107 02:50:38 all (421/676): umountf8.sh Nov 7 02:50:39 mercat1 kernel: pid 79819 (run), uid 2007 inumber 481537 on /tmp: filesystem full 20191107 02:53:09 all (422/676): procfs4.sh 20191107 02:58:12 all (423/676): pfl.sh 20191107 03:00:45 all (424/676): swapoff.sh Nov 7 03:00:47 mercat1 kernel: pid 89845 (run), uid 2007 inumber 481537 on /tmp: filesystem full 20191107 03:03:20 all (425/676): fork2.sh 20191107 03:06:33 all (426/676): flock_open_close.sh 20191107 03:09:22 all (427/676): link2.sh Nov 7 03:09:36 mercat1 kernel: pid 78108 (swap), jid 0, uid 0, was killed: out of swap space panic: pmap_page_exists_quick: page 0xfffffe001510f3f0 is not managed cpuid = 11 time = 1573092588 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00d32359b0 vpanic() at vpanic+0x17e/frame 0xfffffe00d3235a10 panic() at panic+0x43/frame 0xfffffe00d3235a70 pmap_page_exists_quick() at pmap_page_exists_quick+0x17a/frame 0xfffffe00d3235aa0 vm_swapout_object_deactivate_pages() at vm_swapout_object_deactivate_pages+0x13b/frame 0xfffffe00d3235af0 vm_swapout_map_deactivate_pages() at vm_swapout_map_deactivate_pages+0x1b3/frame 0xfffffe00d3235b40 vm_daemon() at vm_daemon+0x85a/frame 0xfffffe00d3235bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d3235bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d3235bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- KDB: enter: panic [ thread pid 31 tid 100129 ] Stopped at kdb_enter+0x37: movq $0,0x10885a6(%rip) db> run pho db:0:pho> set $lines 20000 db:0:pho> run pho1 db:1:pho1> bt Tracing pid 31 tid 100129 td 0xfffff8000758f6e0 kdb_enter() at kdb_enter+0x37/frame 0xfffffe00d32359b0 vpanic() at vpanic+0x19a/frame 0xfffffe00d3235a10 panic() at panic+0x43/frame 0xfffffe00d3235a70 pmap_page_exists_quick() at pmap_page_exists_quick+0x17a/frame 0xfffffe00d3235aa0 vm_swapout_object_deactivate_pages() at vm_swapout_object_deactivate_pages+0x13b/frame 0xfffffe00d3235af0 vm_swapout_map_deactivate_pages() at vm_swapout_map_deactivate_pages+0x1b3/frame 0xfffffe00d3235b40 vm_daemon() at vm_daemon+0x85a/frame 0xfffffe00d3235bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d3235bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d3235bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:1:pho1> show allpcpu Current CPU: 11 cpuid = 0 dynamic pcpu = 0x96c200 curthread = 0xfffff804f49a3000: pid 78102 tid 104576 "swap" curpcb = 0xfffff804f49a34f0 fpcurthread = 0xfffff804f49a3000: pid 78102 "swap" idlethread = 0xfffff800038c0000: tid 100003 "idle: cpu0" curpmap = 0xfffff80661793130 tssp = 0xffffffff81de9ca0 commontssp = 0xffffffff81de9ca0 rsp0 = 0xfffffe033afbccc0 kcr3 = 0x80000002ccfdd74a ucr3 = 0x80000003965b1f4a scr3 = 0x2ef8d8f43 gs32p = 0xffffffff81df04d8 ldt = 0xffffffff81df0518 tss = 0xffffffff81df0508 tlb gen = 160433183 curvnet = 0 spin locks held: cpuid = 1 dynamic pcpu = 0xfffffe00bc7ec200 curthread = 0xfffff80437fd46e0: pid 78076 tid 120940 "link" curpcb = 0xfffff80437fd4bd0 fpcurthread = 0xfffff80437fd46e0: pid 78076 "link" idlethread = 0xfffff800038c66e0: tid 100004 "idle: cpu1" curpmap = 0xfffff804bdc44130 tssp = 0xffffffff81de9d08 commontssp = 0xffffffff81de9d08 rsp0 = 0xfffffe035a9d0cc0 kcr3 = 0x80000008321966a9 ucr3 = 0x8000000263e4fea9 scr3 = 0x4402b9e96 gs32p = 0xffffffff81df0540 ldt = 0xffffffff81df0580 tss = 0xffffffff81df0570 tlb gen = 160433216 curvnet = 0 spin locks held: cpuid = 2 dynamic pcpu = 0xfffffe00bc7f8200 curthread = 0xfffff8000758e000: pid 30 tid 100128 "dom0" curpcb = 0xfffff8000758e4f0 fpcurthread = none idlethread = 0xfffff800038c6000: tid 100005 "idle: cpu2" curpmap = 0xffffffff81d9ba60 tssp = 0xffffffff81de9d70 commontssp = 0xffffffff81de9d70 rsp0 = 0xfffffe00d3224cc0 kcr3 = 0x80000000022fb00b ucr3 = 0xffffffffffffffff scr3 = 0x6980d69de gs32p = 0xffffffff81df05a8 ldt = 0xffffffff81df05e8 tss = 0xffffffff81df05d8 tlb gen = 160433195 curvnet = 0 spin locks held: cpuid = 3 dynamic pcpu = 0xfffffe00bc804200 curthread = 0xfffff805823c46e0: pid 78098 tid 123747 "swap" curpcb = 0xfffff805823c4bd0 fpcurthread = 0xfffff805823c46e0: pid 78098 "swap" idlethread = 0xfffff800038b06e0: tid 100006 "idle: cpu3" curpmap = 0xfffff807bb3cb130 tssp = 0xffffffff81de9dd8 commontssp = 0xffffffff81de9dd8 rsp0 = 0xfffffe0365edbcc0 kcr3 = 0x8000000043e3d3aa ucr3 = 0x80000000166d6baa scr3 = 0x22a8e2ba9 gs32p = 0xffffffff81df0610 ldt = 0xffffffff81df0650 tss = 0xffffffff81df0640 tlb gen = 160433183 curvnet = 0 spin locks held: cpuid = 4 dynamic pcpu = 0xfffffe00bc810200 curthread = 0xfffff80446c89000: pid 78106 tid 116865 "swap" curpcb = 0xfffff80446c894f0 fpcurthread = 0xfffff80446c89000: pid 78106 "swap" idlethread = 0xfffff800038b0000: tid 100007 "idle: cpu4" curpmap = 0xfffff807c3b05130 tssp = 0xffffffff81de9e40 commontssp = 0xffffffff81de9e40 rsp0 = 0xfffffe036c9e9cc0 kcr3 = 0x80000006f8def16c ucr3 = 0x80000003b330596c scr3 = 0x73ad13969 gs32p = 0xffffffff81df0678 ldt = 0xffffffff81df06b8 tss = 0xffffffff81df06a8 tlb gen = 160433183 curvnet = 0 spin locks held: cpuid = 5 dynamic pcpu = 0xfffffe00bc81c200 curthread = 0xfffff80007733000: pid 30 tid 100131 "laundry: dom0" curpcb = 0xfffff800077334f0 fpcurthread = none idlethread = 0xfffff800038b16e0: tid 100008 "idle: cpu5" curpmap = 0xffffffff81d9ba60 tssp = 0xffffffff81de9ea8 commontssp = 0xffffffff81de9ea8 rsp0 = 0xfffffe00d33cbcc0 kcr3 = 0x80000000022fb002 ucr3 = 0xffffffffffffffff scr3 = 0x4b719cfcb gs32p = 0xffffffff81df06e0 ldt = 0xffffffff81df0720 tss = 0xffffffff81df0710 tlb gen = 160433183 curvnet = 0 spin locks held: cpuid = 6 dynamic pcpu = 0xfffffe00bc828200 curthread = 0xfffff8000405f6e0: pid 20 tid 100092 "doneq1" curpcb = 0xfffff8000405fbd0 fpcurthread = none idlethread = 0xfffff800038b1000: tid 100009 "idle: cpu6" curpmap = 0xffffffff81d9ba60 tssp = 0xffffffff81de9f10 commontssp = 0xffffffff81de9f10 rsp0 = 0xfffffe003e534cc0 kcr3 = 0x80000000022fb004 ucr3 = 0xffffffffffffffff scr3 = 0x6ce7b987f gs32p = 0xffffffff81df0748 ldt = 0xffffffff81df0788 tss = 0xffffffff81df0778 tlb gen = 160433219 curvnet = 0 spin locks held: cpuid = 7 dynamic pcpu = 0xfffffe00bc834200 curthread = 0xfffff806c7bcb6e0: pid 78101 tid 124382 "swap" curpcb = 0xfffff806c7bcbbd0 fpcurthread = 0xfffff806c7bcb6e0: pid 78101 "swap" idlethread = 0xfffff800038bf6e0: tid 100010 "idle: cpu7" curpmap = 0xfffff806dda2c130 tssp = 0xffffffff81de9f78 commontssp = 0xffffffff81de9f78 rsp0 = 0xfffffe034074ecc0 kcr3 = 0x800000079142e370 ucr3 = 0x8000000229651b70 scr3 = 0x6980d6b71 gs32p = 0xffffffff81df07b0 ldt = 0xffffffff81df07f0 tss = 0xffffffff81df07e0 tlb gen = 160433211 curvnet = 0 spin locks held: cpuid = 8 dynamic pcpu = 0xfffffe00bc840200 curthread = 0xfffff80280981000: pid 78094 tid 116528 "swap" curpcb = 0xfffff802809814f0 fpcurthread = 0xfffff80280981000: pid 78094 "swap" idlethread = 0xfffff800038ad000: tid 100011 "idle: cpu8" curpmap = 0xfffff800468c3130 tssp = 0xffffffff81de9fe0 commontssp = 0xffffffff81de9fe0 rsp0 = 0xfffffe036034ecc0 kcr3 = 0x8000000030c2d3a4 ucr3 = 0x80000004bbae4ba4 scr3 = 0x73ad13baa gs32p = 0xffffffff81df0818 ldt = 0xffffffff81df0858 tss = 0xffffffff81df0848 tlb gen = 160433220 curvnet = 0 spin locks held: cpuid = 9 dynamic pcpu = 0xfffffe00bc84c200 curthread = 0xfffff80151c536e0: pid 78100 tid 120932 "swap" curpcb = 0xfffff80151c53bd0 fpcurthread = 0xfffff80151c536e0: pid 78100 "swap" idlethread = 0xfffff800038ae6e0: tid 100012 "idle: cpu9" curpmap = 0xfffff8011bdee130 tssp = 0xffffffff81dea048 commontssp = 0xffffffff81dea048 rsp0 = 0xfffffe035a9a8cc0 kcr3 = 0x800000072afcf10b ucr3 = 0x80000001c1b3490b scr3 = 0x6ce7b9900 gs32p = 0xffffffff81df0880 ldt = 0xffffffff81df08c0 tss = 0xffffffff81df08b0 tlb gen = 160433212 curvnet = 0 spin locks held: cpuid = 10 dynamic pcpu = 0xfffffe00bc858200 curthread = 0xfffff80469e8b6e0: pid 78092 tid 105108 "swap" curpcb = 0xfffff80469e8bbd0 fpcurthread = 0xfffff80469e8b6e0: pid 78092 "swap" idlethread = 0xfffff800038ae000: tid 100013 "idle: cpu10" curpmap = 0xfffff807c39d0130 tssp = 0xffffffff81dea0b0 commontssp = 0xffffffff81dea0b0 rsp0 = 0xfffffe033af8fcc0 kcr3 = 0x8000000108a871fb ucr3 = 0x80000003837589fb scr3 = 0x3b103da0e gs32p = 0xffffffff81df08e8 ldt = 0xffffffff81df0928 tss = 0xffffffff81df0918 tlb gen = 160433215 curvnet = 0 spin locks held: cpuid = 11 dynamic pcpu = 0xfffffe00bc864200 curthread = 0xfffff8000758f6e0: pid 31 tid 100129 "vmdaemon" curpcb = 0xfffff8000758fbd0 fpcurthread = none idlethread = 0xfffff800038af6e0: tid 100014 "idle: cpu11" curpmap = 0xffffffff81d9ba60 tssp = 0xffffffff81dea118 commontssp = 0xffffffff81dea118 rsp0 = 0xfffffe00d3235cc0 kcr3 = 0x80000000022fb00c ucr3 = 0xffffffffffffffff scr3 = 0x36a452e79 gs32p = 0xffffffff81df0950 ldt = 0xffffffff81df0990 tss = 0xffffffff81df0980 tlb gen = 160433177 curvnet = 0 spin locks held: db:1:pho1> show alllocks db:1:pho1> show lockedvnods Locked vnodes vnode 0xfffff8029c912000: tag ufs, type VDIR usecount 38, writecount 0, refcount 6 mountedhere 0 flags (VV_ROOT|VI_ACTIVE) v_object 0xfffff80541c80e70 ref 0 pages 1 cleanbuf 0 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff80437fd46e0 (pid 78076, link, tid 120940) with exclusive waiters pending with shared waiters pending #0 0xffffffff80b973fa at lockmgr_xlock_hard+0x40a #1 0xffffffff80b97bed at __lockmgr_args+0x60d #2 0xffffffff80ee19ec at ffs_lock+0x7c #3 0xffffffff810dc3b2 at VOP_LOCK1_APV+0x92 #4 0xffffffff80cb0fd5 at _vn_lock+0x65 #5 0xffffffff80ef2274 at ufs_rename+0x114 #6 0xffffffff810db602 at VOP_RENAME_APV+0x92 #7 0xffffffff80cacfc7 at kern_renameat+0x367 #8 0xffffffff810625d0 at amd64_syscall+0x2d0 #9 0xffffffff81038bb0 at fast_syscall_common+0x101 nlink=3, effnlink=3, size=512, extsize 0 generation=2f004db8, uid=0, gid=0, flags=0x0 ino 2, on dev md10a vnode 0xfffff801a0cb89e0: tag ufs, type VREG usecount 1, writecount 0, refcount 2 flags (VI_ACTIVE) lock type ufs: EXCL by thread 0xfffff80437fd46e0 (pid 78076, link, tid 120940) #0 0xffffffff80b973fa at lockmgr_xlock_hard+0x40a #1 0xffffffff80b97bed at __lockmgr_args+0x60d #2 0xffffffff80ee19ec at ffs_lock+0x7c #3 0xffffffff810dc3b2 at VOP_LOCK1_APV+0x92 #4 0xffffffff80cb0fd5 at _vn_lock+0x65 #5 0xffffffff80c9dbab at vget_finish+0x8b #6 0xffffffff80c8deff at vfs_hash_get+0xbf #7 0xffffffff80edd1b9 at ffs_vgetf+0x59 #8 0xffffffff80ef23e9 at ufs_rename+0x289 #9 0xffffffff810db602 at VOP_RENAME_APV+0x92 #10 0xffffffff80cacfc7 at kern_renameat+0x367 #11 0xffffffff810625d0 at amd64_syscall+0x2d0 #12 0xffffffff81038bb0 at fast_syscall_common+0x101 nlink=3, effnlink=1, size=0, extsize 0 generation=2d60deed, uid=0, gid=0, flags=0x0 ino 19, on dev md10a db:1:pho1> show mount 0xfffff80004377000 /dev/gpt/work on / (ufs) 0xfffff80004376000 devfs on /dev (devfs) 0xfffff80116de4000 /dev/gpt/tmp on /tmp (ufs) 0xfffff801cd045000 procfs on /proc (procfs) 0xfffff801cd98e000 /dev/md10a on /mnt (ufs) More info: show mount db:1:pho1> show bufqueues bqempty: 2906 Buf domain 0 freebufs 353 lofreebufs 219 hifreebufs 329 bufspace 189550592 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 3 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 14700 (188489728) dirtyq count 3 (45056) wakeup 0 lim 25 CPU 22, 2, 19, 0, 0, 1, 1, 0, 11, 1, 0, 20, Locked buffers: 1 space 4096 Total buffers: 15496 space 189550592 Buf domain 1 freebufs 2939 lofreebufs 219 hifreebufs 329 bufspace 235466752 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 42 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 12041 (232550400) dirtyq count 42 (1376256) wakeup 0 lim 25 CPU 15, 21, 18, 0, 2, 15, 2, 1, 9, 8, 1, 19, Locked buffers: 0 space 0 Total buffers: 12745 space 235466752 Buf domain 2 freebufs 346 lofreebufs 219 hifreebufs 329 bufspace 210354176 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 11 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 14728 (209686528) dirtyq count 11 (274432) wakeup 0 lim 25 CPU 4, 1, 0, 0, 11, 3, 3, 0, 7, 4, 14, 0, Locked buffers: 1 space 32768 Total buffers: 15512 space 210354176 Buf domain 3 freebufs 332 lofreebufs 219 hifreebufs 329 bufspace 193073152 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 27 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 14712 (191430656) dirtyq count 27 (868352) wakeup 0 lim 25 CPU 1, 19, 3, 0, 10, 3, 1, 0, 3, 13, 0, 9, Locked buffers: 0 space 0 Total buffers: 15694 space 193073152 Buf domain 4 freebufs 355 lofreebufs 219 hifreebufs 329 bufspace 179302400 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 14685 (178176000) dirtyq count 0 (0) wakeup 0 lim 25 CPU 18, 22, 3, 0, 14, 1, 0, 16, 0, 0, 19, 0, Locked buffers: 0 space 0 Total buffers: 15394 space 179302400 Buf domain 5 freebufs 353 lofreebufs 219 hifreebufs 329 bufspace 195821568 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 1 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 14680 (193404928) dirtyq count 1 (24576) wakeup 0 lim 25 CPU 4, 0, 16, 0, 0, 24, 18, 17, 0, 1, 8, 11, Locked buffers: 0 space 0 Total buffers: 15496 space 195821568 Buf domain 6 freebufs 352 lofreebufs 219 hifreebufs 329 bufspace 182743040 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 1 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 14747 (182337536) dirtyq count 1 (4096) wakeup 0 lim 25 CPU 0, 0, 4, 12, 10, 2, 0, 0, 0, 5, 0, 0, Locked buffers: 0 space 0 Total buffers: 15594 space 182743040 db:1:pho1> show page vm_cnt.v_free_count: 42217 vm_cnt.v_inactive_count: 3827 vm_cnt.v_active_count: 6922059 vm_cnt.v_laundry_count: 5007 vm_cnt.v_wire_count: 1148420 vm_cnt.v_free_reserved: 10644 vm_cnt.v_free_min: 51263 vm_cnt.v_free_target: 173120 vm_cnt.v_inactive_target: 259680 db:1:pho1> show pageq pq_free 42217 dom 0 page_cnt 8124058 free 42217 pq_act 6922059 pq_inact 3827 pq_laund 5007 pq_unsw 0 db:0:pho> show freepages DOMAIN: 0 FREE LIST 0: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000000 | 000000 09 (002048K) | 000000 | 000000 08 (001024K) | 000000 | 000000 07 (000512K) | 000000 | 000000 06 (000256K) | 000001 | 000000 05 (000128K) | 000000 | 000000 04 (000064K) | 000001 | 000001 03 (000032K) | 000220 | 000000 02 (000016K) | 000137 | 000000 01 (000008K) | 001898 | 000003 00 (000004K) | 004955 | 005599 FREE LIST 1: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000000 | 000000 09 (002048K) | 000000 | 000000 08 (001024K) | 000000 | 000000 07 (000512K) | 000000 | 000000 06 (000256K) | 000000 | 000000 05 (000128K) | 000000 | 000000 04 (000064K) | 000000 | 000000 03 (000032K) | 000000 | 000000 02 (000016K) | 000000 | 000000 01 (000008K) | 000000 | 000000 00 (000004K) | 000000 | 000000 db:0:pho> show uma Zone Size Used Free Requests Sleeps Bucket Total Mem XFree socket 904 51 939653 5067014 0 13 849492416 0 VNODE 632 619478 1018 141068956 0 131 392153472 0 VM OBJECT 264 158966 468184 173620575 0 108 165567600 0 FFS2 dinode 256 619359 1146 70261524 0 117 158849280 0 FFS inode 160 619359 1209 70278452 0 133 99290880 0 THREAD 1760 23694 28078 36351230 0 5 91118720 0 RADIX NODE 144 525419 18922 186547384 0 149 78385104 0 Files 80 127 941751 284699047 0 125 75350240 0 S VFS Cache 108 433604 23986 72053055 0 125 49419720 0 mbuf_cluster 2048 12266 3332 218094 0 5 31944704 0 PROC 1328 119 23458 8872883 0 9 31310256 0 swblk 136 457 139932 1481459 0 61 19092904 0 BUF TRIE 144 5081 100867 34254262 0 61 15256512 0 VMSPACE 2552 81 5372 8853550 0 3 13916056 0 128 128 103582 361 1758863 0 125 13304704 0 512 512 23595 44 1915331 0 29 12103168 0 L VFS Cache 328 31174 4406 238100 0 29 11670240 0 DIRHASH 1024 9828 1516 774256 0 13 11616256 0 128 128 5378 60249 587447152 0 128 8400256 0 TURNSTILE 136 51773 447 51773 0 61 7101920 0 mbuf 256 16455 10840 366570385 0 253 6987520 0 vmem btag 56 89805 34716 1552974 0 253 6973176 0 fakepg 104 0 53732 3229772 0 125 5588128 0 SLEEPQUEUE 88 51773 245 51773 0 125 4577584 0 MAP ENTRY 112 2516 30699 500803971 0 138 3720080 0 UMA Slabs 112 12245 13994 595165 0 0 2938768 0 ksiginfo 112 23550 670 1464004 0 125 2712640 0 128 128 14402 261 954884 0 125 1876864 0 4096 4096 370 1 1182405 0 1 1519616 0 swpctrie 144 78 10155 120418 0 61 1473552 0 256 256 788 4822 59987241 0 61 1436160 0 256 256 912 4458 52862675 0 66 1374720 0 pbuf 984 0 1008 0 0 1 991872 0 16384 16384 54 0 2355073 0 1 884736 0 512 512 1237 450 594879 0 29 863744 0 8192 8192 90 0 95 0 1 737280 0 64 64 9324 844 583355 0 253 650752 0 4096 4096 137 2 8954557 0 1 569344 0 64 64 8448 418 346616816 0 253 567424 0 64 64 1303 5454 25358681 0 253 432448 0 32768 32768 13 0 672 0 1 425984 0 32768 32768 13 0 13 0 1 425984 0 65536 65536 6 0 2429 0 1 393216 0 Mountpoints 3008 5 112 61707 0 3 351936 0 6 Bucket 48 1327 5977 598374 0 253 350592 0 rl_entry 40 6393 2022 6393 0 253 336600 0 32768 32768 10 0 3769 0 1 327680 0 128 128 716 1640 155679326 0 131 301568 0 filedesc0 1104 119 145 8872884 0 9 291456 0 64 64 666 3798 355444568 0 253 285696 0 1024 1024 183 61 11742516 0 13 249856 0 64 64 158 3438 12438315 0 253 230144 0 4096 4096 54 0 46119 0 1 221184 0 selfd 64 596 2628 106774425 0 253 206336 0 65536 65536 3 0 42 0 1 196608 0 256 Bucket 2048 20 73 6306165 0 94 190464 0 2048 2048 88 2 426274 0 5 184320 0 UMA Zones 1968 90 1 31482 0 0 179088 0 128 128 584 749 217825 0 125 170624 0 4 Bucket 32 2473 2611 17316866 0 253 162688 0 512 512 69 225 75302124 0 39 150528 0 8192 8192 18 0 429281 0 1 147456 0 32 32 3263 1201 295316 0 253 142848 0 128 128 705 380 13499224 0 125 138880 0 256 256 84 456 73487523 0 61 138240 0 AIO 208 0 627 959 0 61 130416 0 AIOCB 752 0 160 1145 0 13 120320 0 128 Bucket 1024 29 87 1739536 0 34 118784 0 32 32 933 2415 2444038 0 253 107136 0 8192 8192 13 0 4839 0 1 106496 0 32 32 455 2769 13377220 0 253 103168 0 256 256 220 155 167537 0 61 96000 0 16 16 2828 2650 93543 0 253 87648 0 64 64 318 1046 3642734 0 253 87296 0 64 Bucket 512 24 144 2804661 0 29 86016 0 NAMEI 1024 25 55 591744593 0 20 81920 0 16384 16384 5 0 6 0 1 81920 0 1024 1024 44 36 507024 0 13 81920 0 ttyinq 160 330 174 62616901 0 61 80640 0 512 512 78 76 15027785 0 29 78848 0 ttyoutq 256 173 127 33395675 0 61 76800 0 512 512 112 35 2362210 0 29 75264 0 256 256 68 217 5996547 0 61 72960 0 128 128 79 448 305 0 125 67456 0 65536 65536 1 0 41 0 1 65536 0 65536 65536 1 0 23 0 1 65536 0 65536 65536 1 0 1 0 1 65536 0 65536 65536 1 0 14351 0 1 65536 0 32768 32768 2 0 94 0 1 65536 0 2048 2048 23 9 5291754 0 5 65536 0 16 16 1073 2911 93510 0 253 63744 0 1024 1024 49 11 788462 0 13 61440 0 8192 8192 7 0 105 0 1 57344 0 512 512 41 71 215 0 29 57344 0 32 32 260 1476 546148 0 253 55552 0 16 16 76 3161 14495951 0 253 51792 0 32 32 49 1563 485231 0 253 51584 0 8192 8192 5 1 804216 0 1 49152 0 256 256 22 158 962765 0 61 46080 0 cpuset 104 27 407 638 0 125 45136 0 2048 2048 14 8 169 0 5 45056 0 32 32 48 1316 504 0 253 43648 0 64 pcpu 8 3128 1992 97795 0 253 40960 0 16 16 191 2299 518 0 253 39840 0 32 32 15 1225 116684833 0 253 39680 0 pipe 760 11 39 26331413 0 13 38000 0 4096 4096 9 0 5608130 0 1 36864 0 mt_stats_zone 64 430 146 573 0 253 36864 0 unpcb 256 19 116 5026990 0 61 34560 0 32768 32768 1 0 3 0 1 32768 0 16384 16384 2 0 55841 0 1 32768 0 16384 16384 2 0 238 0 1 32768 0 1024 1024 13 19 34 0 13 32768 0 16 16 187 1805 10148710 0 253 31872 0 16 16 498 1494 892077 0 253 31872 0 32 32 23 969 18622897 0 253 31744 0 rtentry 208 12 140 18 0 61 31616 0 udp_inpcb 488 20 44 1413 0 29 31232 0 1024 1024 8 20 412304 0 13 28672 0 64 64 35 399 44243818 0 253 27776 0 512 512 17 32 534761 0 29 25088 0 tcpcb 976 9 15 38536 0 13 23424 0 KMAP ENTRY 112 21 186 269 0 125 23184 0 256 256 17 73 1255962 0 61 23040 0 UMA Kegs 216 79 16 31471 0 0 20520 0 16 16 79 1166 94748488 0 253 19920 0 mt_zone 24 430 400 573 0 253 19920 0 udpcb 32 20 600 1413 0 253 19840 0 AIOP 32 4 616 4 0 253 19840 0 64 64 20 290 7974826 0 253 19840 0 tcp_inpcb 488 9 31 38536 0 29 19520 0 16384 16384 1 0 102 0 1 16384 0 16384 16384 1 0 8 0 1 16384 0 8192 8192 2 0 23790 0 1 16384 0 8192 8192 2 0 2366 0 1 16384 0 MAP 232 2 65 2 0 61 15544 0 2048 2048 4 2 20839643 0 5 12288 0 2048 2048 5 1 1083 0 5 12288 0 1024 1024 6 6 12326 0 13 12288 0 int pcpu 4 468 2604 468 0 253 12288 0 g_bio 408 10 17 168063564 0 139 11016 0 512 512 15 6 42 0 29 10752 0 8192 8192 1 0 1 0 1 8192 0 4096 4096 1 1 1271312 0 1 8192 0 2048 2048 2 2 56640 0 5 8192 0 1024 1024 5 3 4446531 0 13 8192 0 128 128 32 30 22722549 0 125 7936 0 mqnode 416 3 15 3 0 29 7488 0 mbuf_packet 256 20 0 54834853 0 253 5120 0 epoch_record pcpu 256 4 12 4 0 61 4096 0 4096 4096 1 0 512987 0 1 4096 0 4096 4096 1 0 1967710 0 1 4096 0 2048 2048 1 1 12492653 0 5 4096 0 2048 2048 1 1 1 0 5 4096 0 1024 1024 1 3 9637027 0 13 4096 0 rentr 24 0 166 9936813 0 253 3984 0 procdesc 136 1 28 1017922 0 61 3944 0 hostcache 96 1 40 2 0 125 3936 0 ripcb 488 1 7 16 0 29 3904 0 256 256 2 13 89496185 0 61 3840 0 swwbuf 984 3 0 802965 0 1 2952 0 UMA Hash 256 0 10 196 0 0 2560 0 vmem 1856 0 1 0 0 5 1856 0 mqnotifier 216 0 0 0 0 61 0 0 mvdata 64 0 0 0 0 253 0 0 mqueue 264 0 0 0 0 29 0 0 FFS1 dinode 128 0 0 11 0 125 0 0 udplite_inpcb 488 0 0 0 0 29 0 0 sctp_asconf_ack 48 0 0 0 0 253 0 0 sctp_asconf 40 0 0 0 0 253 0 0 sctp_stream_msg_out 112 0 0 0 0 125 0 0 sctp_readq 152 0 0 0 0 61 0 0 sctp_chunk 152 0 0 0 0 61 0 0 sctp_raddr 736 0 0 0 0 13 0 0 sctp_laddr 48 0 0 6 0 253 0 0 sctp_asoc 2408 0 0 0 0 3 0 0 sctp_ep 1280 0 0 0 0 9 0 0 tcp_log_node 120 0 0 0 0 125 0 0 tcp_log_bucket 144 0 0 0 0 61 0 0 tcp_log 408 0 0 0 0 29 0 0 tcpreass 48 0 0 16721 0 253 0 0 tfo_ccache_entries 80 0 0 0 0 125 0 0 tfo 4 0 0 0 0 253 0 0 sackhole 32 0 0 23037 0 253 0 0 syncache 168 0 0 10905 0 61 0 0 tcptw 88 0 0 1220 0 125 0 0 ipq 56 0 0 0 0 253 0 0 IPsec SA lft_c 16 0 0 0 0 253 0 0 KNOTE 160 0 0 69905475 0 61 0 0 itimer 352 0 0 0 0 29 0 0 AIOLIO 280 0 0 0 0 29 0 0 NCLNODE 744 0 0 0 0 13 0 0 LTS VFS Cache 368 0 0 0 0 29 0 0 STS VFS Cache 148 0 0 0 0 61 0 0 VNODEPOLL 120 0 0 324 0 125 0 0 vtnet_tx_hdr 24 0 0 0 0 253 0 0 crypto_session 24 0 0 0 0 253 0 0 cryptodesc 120 0 0 0 0 125 0 0 cryptop 128 0 0 0 0 125 0 0 nvme_request 128 0 0 0 0 125 0 0 DMAR_MAP_ENTRY 120 0 0 0 0 125 0 0 FPU_save_area 832 0 0 0 0 13 0 0 mbuf_extpgs 256 0 0 0 0 61 0 0 mbuf_jumbo_16k 16384 0 0 0 0 1 0 0 mbuf_jumbo_9k 9216 0 0 0 0 1 0 0 mbuf_jumbo_page 4096 0 0 19971419 0 1 0 0 audit_record 1280 0 0 0 0 9 0 0 domainset 40 0 0 377 0 253 0 0 MAC labels 40 0 0 0 0 253 0 0 vnpbuf 984 0 0 2484 0 13 0 0 clpbuf 984 0 0 4492495 522938 5 0 0 mdpbuf 984 0 0 576451 0 1 0 0 nfspbuf 984 0 0 0 0 5 0 0 swrbuf 984 0 0 221993 0 5 0 0 umtx_shm 88 0 0 35 0 125 0 0 umtx pi 96 0 0 37664726 0 125 0 0 rangeset pctrie nodes 144 0 0 0 0 61 0 0 65536 65536 0 0 629 0 1 0 0 65536 65536 0 0 135585 0 1 0 0 32768 32768 0 0 45496 0 1 0 0 32768 32768 0 0 0 0 1 0 0 32768 32768 0 0 1366545 0 1 0 0 16384 16384 0 0 849 0 1 0 0 16384 16384 0 0 0 0 1 0 0 4096 4096 0 0 12 0 1 0 0 16 16 0 0 5594930 0 253 0 0 12 Bucket 96 0 0 422578 0 125 0 0 db:0:pho> show umacache Zone Size Used Free Requests Bucket debugnet_mbuf_packet 2048 0 0 0 0 debugnet_mbuf_cluster 2048 -6144 0 0 0 debugnet_mbuf 256 -10240 0 0 0 kstack_cache 16384 23567 12 36351101 1 vm pgcache 104 620059 2128 200291314 253 vm pgcache 104 3278468 0 553075245 253 buf free cache 984 100901 2124 42766032 65 buffer arena-65 65536 0 8 74 1 buffer arena-61 61440 0 0 0 1 buffer arena-57 57344 0 0 0 1 buffer arena-53 53248 0 0 0 1 buffer arena-49 49152 0 0 0 1 buffer arena-45 45056 0 0 0 1 buffer arena-40 40960 0 0 0 1 buffer arena-36 36864 0 0 0 1 buffer arena-32 32768 39609 6359 14103711 2 buffer arena-28 28672 0 0 0 1 buffer arena-24 24576 0 0 0 1 buffer arena-20 20480 0 0 0 1 buffer arena-16 16384 6 834 3866825 1 buffer arena-12 12288 0 0 0 1 buffer arena-81 8192 0 0 0 1 buffer arena-40 4096 0 11 40 1 db:0:pho> acttrace Tracing command swap pid 78106 tid 116865 td 0xfffff80446c89000 (CPU 4) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e197dd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e197df0 trap() at trap+0x44/frame 0xfffffe003e197f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e197f20 --- trap 0x13, rip = 0x203687, rsp = 0x7fffffffe510, rbp = 0x7fffffffe530 --- Tracing command swap pid 78102 tid 104576 td 0xfffff804f49a3000 (CPU 0) cpustop_handler() at cpustop_handler+0x2a/frame 0xffffffff81d845f0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xffffffff81d84610 trap() at trap+0x44/frame 0xffffffff81d84740 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81d84740 --- trap 0x13, rip = 0x203687, rsp = 0x7fffffffe510, rbp = 0x7fffffffe530 --- Tracing command swap pid 78101 tid 124382 td 0xfffff806c7bcb6e0 (CPU 7) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1bbdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1bbdf0 trap() at trap+0x44/frame 0xfffffe003e1bbf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1bbf20 --- trap 0x13, rip = 0x203687, rsp = 0x7fffffffe510, rbp = 0x7fffffffe530 --- Tracing command swap pid 78100 tid 120932 td 0xfffff80151c536e0 (CPU 9) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1d3dd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1d3df0 trap() at trap+0x44/frame 0xfffffe003e1d3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1d3f20 --- trap 0x13, rip = 0x20368e, rsp = 0x7fffffffe510, rbp = 0x7fffffffe530 --- Tracing command swap pid 78098 tid 123747 td 0xfffff805823c46e0 (CPU 3) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e18bdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e18bdf0 trap() at trap+0x44/frame 0xfffffe003e18bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e18bf20 --- trap 0x13, rip = 0x203687, rsp = 0x7fffffffe510, rbp = 0x7fffffffe530 --- Tracing command swap pid 78094 tid 116528 td 0xfffff80280981000 (CPU 8) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1c7dd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1c7df0 trap() at trap+0x44/frame 0xfffffe003e1c7f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1c7f20 --- trap 0x13, rip = 0x203687, rsp = 0x7fffffffe510, rbp = 0x7fffffffe530 --- Tracing command swap pid 78092 tid 105108 td 0xfffff80469e8b6e0 (CPU 10) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1dfdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1dfdf0 trap() at trap+0x44/frame 0xfffffe003e1dff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1dff20 --- trap 0x13, rip = 0xffffffff81039450, rsp = 0xffffffff8241a2d8, rbp = 0x7fffffffe530 --- Xapic_isr1_pti() at Xapic_isr1_pti/frame 0x7fffffffe530 Tracing command link pid 78076 tid 120940 td 0xfffff80437fd46e0 (CPU 1) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e173dd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e173df0 trap() at trap+0x44/frame 0xfffffe003e173f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e173f20 --- trap 0x13, rip = 0xffffffff80ecddfc, rsp = 0xfffffe035a9d04e0, rbp = 0xfffffe035a9d0500 --- workitem_free() at workitem_free+0x6c/frame 0xfffffe035a9d0500 newdirrem() at newdirrem+0x8b4/frame 0xfffffe035a9d05b0 softdep_setup_remove() at softdep_setup_remove+0x3c/frame 0xfffffe035a9d05f0 ufs_dirremove() at ufs_dirremove+0x1ca/frame 0xfffffe035a9d0640 ufs_rename() at ufs_rename+0x1317/frame 0xfffffe035a9d0820 VOP_RENAME_APV() at VOP_RENAME_APV+0x92/frame 0xfffffe035a9d0840 kern_renameat() at kern_renameat+0x367/frame 0xfffffe035a9d0ac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe035a9d0bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe035a9d0bf0 --- syscall (128, FreeBSD ELF64, sys_rename), rip = 0x8002db54a, rsp = 0x7fffffffdea8, rbp = 0x7fffffffe6e0 --- Tracing command vmdaemon pid 31 tid 100129 td 0xfffff8000758f6e0 (CPU 11) kdb_enter() at kdb_enter+0x37/frame 0xfffffe00d32359b0 vpanic() at vpanic+0x19a/frame 0xfffffe00d3235a10 panic() at panic+0x43/frame 0xfffffe00d3235a70 pmap_page_exists_quick() at pmap_page_exists_quick+0x17a/frame 0xfffffe00d3235aa0 vm_swapout_object_deactivate_pages() at vm_swapout_object_deactivate_pages+0x13b/frame 0xfffffe00d3235af0 vm_swapout_map_deactivate_pages() at vm_swapout_map_deactivate_pages+0x1b3/frame 0xfffffe00d3235b40 vm_daemon() at vm_daemon+0x85a/frame 0xfffffe00d3235bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d3235bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d3235bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100128 td 0xfffff8000758e000 (CPU 2) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e17fdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e17fdf0 trap() at trap+0x44/frame 0xfffffe003e17ff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e17ff20 --- trap 0x13, rip = 0xffffffff80f25537, rsp = 0xfffffe00d32247c0, rbp = 0xfffffe00d3224b70 --- vm_pageout_worker() at vm_pageout_worker+0xee7/frame 0xfffffe00d3224b70 vm_pageout() at vm_pageout+0x193/frame 0xfffffe00d3224bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d3224bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d3224bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100131 td 0xfffff80007733000 (CPU 5) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1a3dd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1a3df0 trap() at trap+0x44/frame 0xfffffe003e1a3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1a3f20 --- trap 0x13, rip = 0xffffffff80f25e7c, rsp = 0xfffffe00d33cb940, rbp = 0xfffffe00d33cbbb0 --- vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x35c/frame 0xfffffe00d33cbbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d33cbbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d33cbbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100092 td 0xfffff8000405f6e0 (CPU 6) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1afdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1afdf0 trap() at trap+0x44/frame 0xfffffe003e1aff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1aff20 --- trap 0x13, rip = 0xffffffff80c10320, rsp = 0xfffffe003e534790, rbp = 0xfffffe003e5347a0 --- lock_delay() at lock_delay+0x30/frame 0xfffffe003e5347a0 __mtx_lock_sleep() at __mtx_lock_sleep+0x108/frame 0xfffffe003e534850 __mtx_lock_flags() at __mtx_lock_flags+0xea/frame 0xfffffe003e5348a0 vm_page_dequeue() at vm_page_dequeue+0x10a/frame 0xfffffe003e5348e0 _vm_page_deactivate_noreuse() at _vm_page_deactivate_noreuse+0x71/frame 0xfffffe003e534900 swp_pager_async_iodone() at swp_pager_async_iodone+0x245/frame 0xfffffe003e534940 bufdone() at bufdone+0x70/frame 0xfffffe003e5349c0 swapgeom_done() at swapgeom_done+0x4f/frame 0xfffffe003e5349f0 g_io_deliver() at g_io_deliver+0x292/frame 0xfffffe003e534a40 g_io_deliver() at g_io_deliver+0x292/frame 0xfffffe003e534a90 g_io_deliver() at g_io_deliver+0x292/frame 0xfffffe003e534ae0 g_disk_done() at g_disk_done+0x106/frame 0xfffffe003e534b20 xpt_done_process() at xpt_done_process+0x384/frame 0xfffffe003e534b60 xpt_done_td() at xpt_done_td+0xf5/frame 0xfffffe003e534bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e534bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e534bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:pho> ps pid ppid pgrp uid state wmesg wchan cmd 79633 79631 10016 0 R sed 79631 79428 10016 0 S wait 0xfffff80287fd6000 sh 79621 78047 2347 0 S+ nanslp 0xffffffff81c7feb4 sleep 79428 10055 10016 0 S piperd 0xfffff8055c37d2f8 sh 78109 78089 78068 0 D pfault 0xffffffff81847ec0 swap 78107 78089 78068 0 D pfault 0xffffffff81847ec0 swap 78106 78089 78068 0 R CPU 4 swap 78105 78089 78068 0 D pfault 0xffffffff81847ec0 swap 78104 78089 78068 0 D pfault 0xffffffff81847ec0 swap 78103 78089 78068 0 D pfault 0xffffffff81847ec0 swap 78102 78089 78068 0 R CPU 0 swap 78101 78089 78068 0 R CPU 7 swap 78100 78089 78068 0 R CPU 9 swap 78099 78089 78068 0 D pfault 0xffffffff81847ec0 swap 78098 78089 78068 0 R CPU 3 swap 78097 78089 78068 0 D pfault 0xffffffff81847ec0 swap 78096 78089 78068 0 R swap 78095 78089 78068 0 D pfault 0xffffffff81847ec0 swap 78094 78089 78068 0 R CPU 8 swap 78093 78089 78068 0 D pfault 0xffffffff81847ec0 swap 78092 78089 78068 0 R CPU 10 swap 78091 78089 78068 0 D pfault 0xffffffff81847ec0 swap 78090 78089 78068 0 D pfault 0xffffffff81847ec0 swap 78089 78068 78068 0 SW wait 0xfffff8075207b000 swap 78088 78069 2347 0 D+ ufs 0xfffff8029c912068 link 78087 78069 2347 0 R+ link 78086 78069 2347 0 R+ link 78085 78069 2347 0 D+ ufs 0xfffff8029c912068 link 78084 78069 2347 0 R+ link 78083 78069 2347 0 D+ ufs 0xfffff8029c912068 link 78082 78069 2347 0 D+ ufs 0xfffff8029c912068 link 78081 78069 2347 0 D+ ufs 0xfffff8029c912068 link 78080 78069 2347 0 D+ ufs 0xfffff8029c912068 link 78079 78069 2347 0 D+ ufs 0xfffff8029c912068 link 78078 78069 2347 0 R+ link 78077 78069 2347 0 D+ ufs 0xfffff8029c912068 link 78076 78069 2347 0 R+ CPU 1 link 78075 78069 2347 0 D+ ufs 0xfffff8029c912068 link 78074 78069 2347 0 D+ ufs 0xfffff8029c912068 link 78073 78069 2347 0 D+ ufs 0xfffff8029c912068 link 78069 78047 2347 0 SW+ wait 0xfffff804719a6a60 link 78068 1 78068 0 Ss nanslp 0xffffffff81c7feb7 swap 78063 0 0 0 DL mdwait 0xfffff804b70c3000 [md10] 78047 78045 2347 0 S+ wait 0xfffff80396472000 sh 78046 2347 2347 0 S+ piperd 0xfffff8032caf85f0 tee 78045 2347 2347 0 SW+ wait 0xfffff801ce532a60 sh 58437 0 0 0 DL aiordy 0xfffff8011bc49530 [aiod4] 58436 0 0 0 DL aiordy 0xfffff802a81fb000 [aiod3] 58435 0 0 0 DL aiordy 0xfffff8057669a530 [aiod2] 58434 0 0 0 DL aiordy 0xfffff80287f1ea60 [aiod1] 10058 10016 10016 0 S piperd 0xfffff80007714be0 sh 10056 10016 10016 0 S piperd 0xfffff8019c50c000 awk 10055 10016 10016 0 SWL wait 0xfffff8001e0fc530 sh 10016 1 10016 0 SWs wait 0xfffff8019c569000 sh 2347 2346 2347 0 SW+ wait 0xfffff8000760d530 sh 2346 2344 2346 0 S+ select 0xfffff80007788740 bash 2344 2343 2344 0 SW+ pause 0xfffff800074a2b08 csh 2343 2338 2343 2006 SW+ wait 0xfffff80116a1c530 su 2338 2337 2338 2006 SWs+ wait 0xfffff80003d50000 bash 2337 2334 2334 2006 S select 0xfffff80007788440 sshd 2334 2270 2334 0 Ss select 0xfffff800049abb40 sshd 2330 2329 2330 0 S+ ttyin 0xfffff800064e58b0 csh 2329 1 2329 0 SWs+ wait 0xfffff8017f233530 login 2328 1 2328 0 Ss+ ttyin 0xfffff800064f9cb0 getty 2327 1 2327 0 Ss+ ttyin 0xfffff800076864b0 getty 2326 1 2326 0 Ss+ ttyin 0xfffff80007686cb0 getty 2325 1 2325 0 Ss+ ttyin 0xfffff800076854b0 getty 2324 1 2324 0 Ss+ ttyin 0xfffff80007685cb0 getty 2323 1 2323 0 Ss+ ttyin 0xfffff800076844b0 getty 2322 1 2322 0 Ss+ ttyin 0xfffff80003dca0b0 getty 2321 1 2321 0 Ss+ ttyin 0xfffff80003dcd8b0 getty 2320 1 2320 0 Ss+ ttyin 0xfffff80003dcccb0 getty 2274 1 2274 0 SWs nanslp 0xffffffff81c7feb7 cron 2270 1 2270 0 Ss select 0xfffff800064ac7c0 sshd 2241 1 2241 123 Ss (threaded) ntpd 100163 S select 0xfffff800078848c0 ntpd 124717 S usem 0xfffff807951a4600 ntpd 2178 1 2178 0 Ss rpcsvc 0xfffff80004365460 NLM: master 2175 1 2175 0 Ss select 0xfffff800064ac8c0 rpc.statd 2129 1 2129 0 Ss nanslp 0xffffffff81c7feba watchdogd 2050 1 2050 0 Ss select 0xfffff800077887c0 rpcbind 2040 1 2040 0 Ss select 0xfffff80003ca4940 syslogd 1969 1 1969 0 Ss select 0xfffff80006111c40 devd 1964 1 1964 65 Ss select 0xfffff800064ac940 dhclient 1920 1 1920 0 Ss select 0xfffff8004d16ed40 dhclient 1917 1 1917 0 Ss select 0xfffff80007668ac0 dhclient 34 0 0 0 DL vlruwt 0xfffff80003ac4a60 [vnlru] 33 0 0 0 DL syncer 0xffffffff81d56370 [syncer] 32 0 0 0 DL (threaded) [bufdaemon] 100130 D qsleep 0xffffffff81d55818 [bufdaemon] 100133 D - 0xffffffff8180a900 [bufspacedaemon-0] 100134 D - 0xffffffff81812bc0 [bufspacedaemon-1] 100135 D - 0xffffffff8181ae80 [bufspacedaemon-2] 100136 D - 0xffffffff81823140 [bufspacedaemon-3] 100137 D - 0xffffffff8182b400 [bufspacedaemon-4] 100138 D - 0xffffffff818336c0 [bufspacedaemon-5] 100139 D - 0xffffffff8183b980 [bufspacedaemon-6] 100152 D sdflush 0xfffff80007f8f4e8 [/ worker] 100196 D sdflush 0xfffff80116d190e8 [/tmp worker] 105161 D sdflush 0xfffff80007f8f2e8 [/mnt worker] 31 0 0 0 RL CPU 11 [vmdaemon] 30 0 0 0 RL (threaded) [pagedaemon] 100128 Run CPU 2 [dom0] 100131 Run CPU 5 [laundry: dom0] 100132 D umarcl 0xffffffff80effb60 [uma] 29 0 0 0 DL idle 0xfffff8000600c000 [enc_daemon1] 28 0 0 0 DL idle 0xfffff8000600c530 [enc_daemon0] 27 0 0 0 DL - 0xffffffff81adbb20 [rand_harvestq] 26 0 0 0 DL waiting 0xffffffff81de20f0 [sctp_iterator] 25 0 0 0 DL - 0xffffffff81d5521c [soaiod4] 24 0 0 0 DL - 0xffffffff81d5521c [soaiod3] 23 0 0 0 DL - 0xffffffff81d5521c [soaiod2] 22 0 0 0 DL - 0xffffffff81d5521c [soaiod1] 21 0 0 0 DL (threaded) [usb] 100096 D - 0xfffffe00d1584460 [usbus0] 100097 D - 0xfffffe00d15844b8 [usbus0] 100098 D - 0xfffffe00d1584510 [usbus0] 100099 D - 0xfffffe00d1584568 [usbus0] 100100 D - 0xfffffe00d15845c0 [usbus0] 100102 D - 0xfffffe0037b66d10 [usbus1] 100103 D - 0xfffffe0037b66d68 [usbus1] 100104 D - 0xfffffe0037b66dc0 [usbus1] 100105 D - 0xfffffe0037b66e18 [usbus1] 100106 D - 0xfffffe0037b66e70 [usbus1] 100107 D - 0xfffffe00d16a7d10 [usbus2] 100108 D - 0xfffffe00d16a7d68 [usbus2] 100109 D - 0xfffffe00d16a7dc0 [usbus2] 100110 D - 0xfffffe00d16a7e18 [usbus2] 100111 D - 0xfffffe00d16a7e70 [usbus2] 20 0 0 0 RL (threaded) [cam] 100091 D - 0xffffffff819b6ec0 [doneq0] 100092 Run CPU 6 [doneq1] 100093 D - 0xffffffff819b6fc0 [doneq2] 100125 D - 0xffffffff819b6d88 [scanner] 19 0 0 0 DL crypto_ 0xfffff8000388f450 [crypto returns 11] 18 0 0 0 DL crypto_ 0xfffff8000388f3f0 [crypto returns 10] 17 0 0 0 DL crypto_ 0xfffff8000388f390 [crypto returns 9] 16 0 0 0 DL crypto_ 0xfffff8000388f330 [crypto returns 8] 15 0 0 0 DL crypto_ 0xfffff8000388f2d0 [crypto returns 7] 9 0 0 0 DL crypto_ 0xfffff8000388f270 [crypto returns 6] 8 0 0 0 DL crypto_ 0xfffff8000388f210 [crypto returns 5] 7 0 0 0 DL crypto_ 0xfffff8000388f1b0 [crypto returns 4] 6 0 0 0 DL crypto_ 0xfffff8000388f150 [crypto returns 3] 5 0 0 0 DL crypto_ 0xfffff8000388f0f0 [crypto returns 2] 4 0 0 0 DL crypto_ 0xfffff8000388f090 [crypto returns 1] 3 0 0 0 DL crypto_ 0xfffff8000388f030 [crypto returns 0] 2 0 0 0 DL crypto_ 0xffffffff81d6b308 [crypto] 14 0 0 0 DL seqstat 0xfffff800037d7c88 [sequencer 00] 13 0 0 0 DL (threaded) [geom] 100062 D - 0xffffffff81d9b110 [g_event] 100063 D - 0xffffffff81d9b120 [g_up] 100064 D - 0xffffffff81d9b118 [g_down] 12 0 0 0 WL (threaded) [intr] 100018 I [swi6: task queue] 100019 I [swi6: Giant taskq] 100021 I [swi5: fast taskq] 100047 I [swi3: vm] 100048 I [swi1: netisr 0] 100049 I [swi4: clock (0)] 100050 I [swi4: clock (1)] 100051 I [swi4: clock (2)] 100052 I [swi4: clock (3)] 100053 I [swi4: clock (4)] 100054 I [swi4: clock (5)] 100055 I [swi4: clock (6)] 100056 I [swi4: clock (7)] 100057 I [swi4: clock (8)] 100058 I [swi4: clock (9)] 100059 I [swi4: clock (10)] 100060 I [swi4: clock (11)] 100094 I [irq56: ahci0] 100095 I [irq19: xhci0] 100101 I [irq18: ehci0 ehci1] 100112 I [irq71: ahci1] 100113 I [swi0: uart uart] 100176 I [irq72: ioat0] 100177 I [irq73: ioat1] 100178 I [irq74: ioat2] 100179 I [irq75: ioat3] 100180 I [irq76: ioat4] 100181 I [irq77: ioat5] 100182 I [irq78: ioat6] 100183 I [irq79: ioat7] 11 0 0 0 RL (threaded) [idle] 100003 CanRun [idle: cpu0] 100004 CanRun [idle: cpu1] 100005 CanRun [idle: cpu2] 100006 CanRun [idle: cpu3] 100007 CanRun [idle: cpu4] 100008 CanRun [idle: cpu5] 100009 CanRun [idle: cpu6] 100010 CanRun [idle: cpu7] 100011 CanRun [idle: cpu8] 100012 CanRun [idle: cpu9] 100013 CanRun [idle: cpu10] 100014 CanRun [idle: cpu11] 1 0 1 0 SLs wait 0xfffff800038c7530 [init] 10 0 0 0 DL audit_w 0xffffffff81de2d80 [audit] 0 0 0 0 DLs (threaded) [kernel] 100000 D swapin 0xffffffff81d8a828 [swapper] 100015 D - 0xfffff8000389b000 [config_0] 100016 D - 0xfffff80003885000 [kqueue_ctx taskq] 100017 D - 0xfffff80003886e00 [aiod_kick taskq] 100020 D - 0xfffff80003886b00 [thread taskq] 100022 D - 0xfffff8000389ce00 [if_config_tqg_0] 100023 D - 0xfffff8000389cd00 [softirq_0] 100024 D - 0xfffff8000389cc00 [softirq_1] 100025 D - 0xfffff8000389cb00 [softirq_2] 100026 D - 0xfffff8000389ca00 [softirq_3] 100027 D - 0xfffff8000389c900 [softirq_4] 100028 D - 0xfffff8000389c800 [softirq_5] 100029 D - 0xfffff8000389c700 [softirq_6] 100030 D - 0xfffff8000389c600 [softirq_7] 100031 D - 0xfffff8000389c500 [softirq_8] 100032 D - 0xfffff8000389c400 [softirq_9] 100033 D - 0xfffff8000389c300 [softirq_10] 100034 D - 0xfffff8000389c200 [softirq_11] 100035 D - 0xfffff8000389c100 [if_io_tqg_0] 100036 D - 0xfffff8000389c000 [if_io_tqg_1] 100037 D - 0xfffff8000389de00 [if_io_tqg_2] 100038 D - 0xfffff8000389dd00 [if_io_tqg_3] 100039 D - 0xfffff8000389dc00 [if_io_tqg_4] 100040 D - 0xfffff8000389db00 [if_io_tqg_5] 100041 D - 0xfffff8000389da00 [if_io_tqg_6] 100042 D - 0xfffff8000389d900 [if_io_tqg_7] 100043 D - 0xfffff8000389d800 [if_io_tqg_8] 100044 D - 0xfffff8000389d700 [if_io_tqg_9] 100045 D - 0xfffff8000389d600 [if_io_tqg_10] 100046 D - 0xfffff8000389d500 [if_io_tqg_11] 100061 D - 0xfffff80003886900 [firmware taskq] 100066 D - 0xfffff80003887e00 [crypto_0] 100067 D - 0xfffff80003887e00 [crypto_1] 100068 D - 0xfffff80003887e00 [crypto_2] 100069 D - 0xfffff80003887e00 [crypto_3] 100070 D - 0xfffff80003887e00 [crypto_4] 100071 D - 0xfffff80003887e00 [crypto_5] 100072 D - 0xfffff80003887e00 [crypto_6] 100073 D - 0xfffff80003887e00 [crypto_7] 100074 D - 0xfffff80003887e00 [crypto_8] 100075 D - 0xfffff80003887e00 [crypto_9] 100076 D - 0xfffff80003887e00 [crypto_10] 100077 D - 0xfffff80003887e00 [crypto_11] 100114 D - 0xfffff800064a1100 [mca taskq] 100121 D - 0xfffff80007591200 [acpi_task_0] 100122 D - 0xfffff80007591200 [acpi_task_1] 100123 D - 0xfffff80007591200 [acpi_task_2] 100124 D - 0xfffff80003887800 [CAM taskq] 78108 78089 78068 0 Z swap db:0:pho> allt Tracing command sed pid 79633 tid 116868 td 0xfffff8050679d6e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe036c9f8b60 mi_switch() at mi_switch+0x166/frame 0xfffffe036c9f8ba0 critical_exit_preempt() at critical_exit_preempt+0x63/frame 0xfffffe036c9f8bc0 ipi_bitmap_handler() at ipi_bitmap_handler+0x9f/frame 0xfffffe036c9f8bf0 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0xb3/frame 0xfffffe036c9f8bf0 --- interrupt, rip = 0x80035ae98, rsp = 0x7fffffffd260, rbp = 0x7fffffffd290 --- Tracing command sh pid 79631 tid 104113 td 0xfffff80506d73000 sched_switch() at sched_switch+0x38f/frame 0xfffffe0369f80690 mi_switch() at mi_switch+0x166/frame 0xfffffe0369f806d0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe0369f80710 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe0369f80770 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe0369f807a0 _sleep() at _sleep+0x2c3/frame 0xfffffe0369f80840 kern_wait6() at kern_wait6+0x482/frame 0xfffffe0369f808d0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe0369f80ac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe0369f80bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0369f80bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040791a, rsp = 0x7fffffffdd08, rbp = 0x7fffffffddc0 --- Tracing command sleep pid 79621 tid 104132 td 0xfffff805506066e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe0369f08830 mi_switch() at mi_switch+0x166/frame 0xfffffe0369f08870 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe0369f088b0 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe0369f08910 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe0369f08950 _sleep() at _sleep+0x258/frame 0xfffffe0369f089f0 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe0369f08a80 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe0369f08ac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe0369f08bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0369f08bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003a8a7a, rsp = 0x7fffffffe6c8, rbp = 0x7fffffffe710 --- Tracing command sh pid 79428 tid 123553 td 0xfffff804f4375000 sched_switch() at sched_switch+0x38f/frame 0xfffffe034ab0d7d0 mi_switch() at mi_switch+0x166/frame 0xfffffe034ab0d810 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe034ab0d850 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe034ab0d8b0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe034ab0d8e0 _sleep() at _sleep+0x2c3/frame 0xfffffe034ab0d980 pipe_read() at pipe_read+0x428/frame 0xfffffe034ab0d9e0 dofileread() at dofileread+0x81/frame 0xfffffe034ab0da30 kern_readv() at kern_readv+0x49/frame 0xfffffe034ab0da70 sys_read() at sys_read+0x83/frame 0xfffffe034ab0dac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe034ab0dbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe034ab0dbf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800476b8a, rsp = 0x7fffffffdf58, rbp = 0x7fffffffe0a0 --- Tracing command swap pid 78109 tid 104173 td 0xfffff8028005a6e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe0369fe4710 mi_switch() at mi_switch+0x166/frame 0xfffffe0369fe4750 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe0369fe4790 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0369fe47d0 _sleep() at _sleep+0x26c/frame 0xfffffe0369fe4870 vm_waitpfault() at vm_waitpfault+0x79/frame 0xfffffe0369fe48a0 vm_fault() at vm_fault+0x9ef/frame 0xfffffe0369fe4a00 vm_fault_trap() at vm_fault_trap+0x6e/frame 0xfffffe0369fe4a40 trap_pfault() at trap_pfault+0x1f3/frame 0xfffffe0369fe4ac0 trap() at trap+0x453/frame 0xfffffe0369fe4bf0 calltrap() at calltrap+0x8/frame 0xfffffe0369fe4bf0 --- trap 0xc, rip = 0x8004331e5, rsp = 0x7fffffffe1b8, rbp = 0x7fffffffe200 --- Tracing command swap pid 78107 tid 113532 td 0xfffff806c1ef96e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe034f712710 mi_switch() at mi_switch+0x166/frame 0xfffffe034f712750 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe034f712790 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe034f7127d0 _sleep() at _sleep+0x26c/frame 0xfffffe034f712870 vm_waitpfault() at vm_waitpfault+0x79/frame 0xfffffe034f7128a0 vm_fault() at vm_fault+0x9ef/frame 0xfffffe034f712a00 vm_fault_trap() at vm_fault_trap+0x6e/frame 0xfffffe034f712a40 trap_pfault() at trap_pfault+0x1f3/frame 0xfffffe034f712ac0 trap() at trap+0x453/frame 0xfffffe034f712bf0 calltrap() at calltrap+0x8/frame 0xfffffe034f712bf0 --- trap 0xc, rip = 0x8004331e5, rsp = 0x7fffffffe1b8, rbp = 0x7fffffffe200 --- Tracing command swap pid 78106 tid 116865 td 0xfffff80446c89000 (CPU 4) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e197dd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e197df0 trap() at trap+0x44/frame 0xfffffe003e197f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e197f20 --- trap 0x13, rip = 0x203687, rsp = 0x7fffffffe510, rbp = 0x7fffffffe530 --- Tracing command swap pid 78105 tid 100915 td 0xfffff8012e206000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e72c2710 mi_switch() at mi_switch+0x166/frame 0xfffffe00e72c2750 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e72c2790 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00e72c27d0 _sleep() at _sleep+0x26c/frame 0xfffffe00e72c2870 vm_waitpfault() at vm_waitpfault+0x79/frame 0xfffffe00e72c28a0 vm_fault() at vm_fault+0x9ef/frame 0xfffffe00e72c2a00 vm_fault_trap() at vm_fault_trap+0x6e/frame 0xfffffe00e72c2a40 trap_pfault() at trap_pfault+0x1f3/frame 0xfffffe00e72c2ac0 trap() at trap+0x453/frame 0xfffffe00e72c2bf0 calltrap() at calltrap+0x8/frame 0xfffffe00e72c2bf0 --- trap 0xc, rip = 0x8004331e5, rsp = 0x7fffffffe1b8, rbp = 0x7fffffffe200 --- Tracing command swap pid 78104 tid 111997 td 0xfffff806c2f9a6e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe034812b710 mi_switch() at mi_switch+0x166/frame 0xfffffe034812b750 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe034812b790 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe034812b7d0 _sleep() at _sleep+0x26c/frame 0xfffffe034812b870 vm_waitpfault() at vm_waitpfault+0x79/frame 0xfffffe034812b8a0 vm_fault() at vm_fault+0x9ef/frame 0xfffffe034812ba00 vm_fault_trap() at vm_fault_trap+0x6e/frame 0xfffffe034812ba40 trap_pfault() at trap_pfault+0x1f3/frame 0xfffffe034812bac0 trap() at trap+0x453/frame 0xfffffe034812bbf0 calltrap() at calltrap+0x8/frame 0xfffffe034812bbf0 --- trap 0xc, rip = 0x8004331e5, rsp = 0x7fffffffe1b8, rbp = 0x7fffffffe200 --- Tracing command swap pid 78103 tid 120955 td 0xfffff8006ce85000 sched_switch() at sched_switch+0x38f/frame 0xfffffe0344a1d710 mi_switch() at mi_switch+0x166/frame 0xfffffe0344a1d750 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe0344a1d790 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0344a1d7d0 _sleep() at _sleep+0x26c/frame 0xfffffe0344a1d870 vm_waitpfault() at vm_waitpfault+0x79/frame 0xfffffe0344a1d8a0 vm_fault() at vm_fault+0x9ef/frame 0xfffffe0344a1da00 vm_fault_trap() at vm_fault_trap+0x6e/frame 0xfffffe0344a1da40 trap_pfault() at trap_pfault+0x1f3/frame 0xfffffe0344a1dac0 trap() at trap+0x453/frame 0xfffffe0344a1dbf0 calltrap() at calltrap+0x8/frame 0xfffffe0344a1dbf0 --- trap 0xc, rip = 0x8004331e5, rsp = 0x7fffffffe1b8, rbp = 0x7fffffffe200 --- Tracing command swap pid 78102 tid 104576 td 0xfffff804f49a3000 (CPU 0) cpustop_handler() at cpustop_handler+0x2a/frame 0xffffffff81d845f0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xffffffff81d84610 trap() at trap+0x44/frame 0xffffffff81d84740 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81d84740 --- trap 0x13, rip = 0x203687, rsp = 0x7fffffffe510, rbp = 0x7fffffffe530 --- Tracing command swap pid 78101 tid 124382 td 0xfffff806c7bcb6e0 (CPU 7) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1bbdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1bbdf0 trap() at trap+0x44/frame 0xfffffe003e1bbf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1bbf20 --- trap 0x13, rip = 0x203687, rsp = 0x7fffffffe510, rbp = 0x7fffffffe530 --- Tracing command swap pid 78100 tid 120932 td 0xfffff80151c536e0 (CPU 9) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1d3dd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1d3df0 trap() at trap+0x44/frame 0xfffffe003e1d3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1d3f20 --- trap 0x13, rip = 0x20368e, rsp = 0x7fffffffe510, rbp = 0x7fffffffe530 --- Tracing command swap pid 78099 tid 104288 td 0xfffff801f3f8a000 sched_switch() at sched_switch+0x38f/frame 0xfffffe034dfa3710 mi_switch() at mi_switch+0x166/frame 0xfffffe034dfa3750 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe034dfa3790 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe034dfa37d0 _sleep() at _sleep+0x26c/frame 0xfffffe034dfa3870 vm_waitpfault() at vm_waitpfault+0x79/frame 0xfffffe034dfa38a0 vm_fault() at vm_fault+0x9ef/frame 0xfffffe034dfa3a00 vm_fault_trap() at vm_fault_trap+0x6e/frame 0xfffffe034dfa3a40 trap_pfault() at trap_pfault+0x1f3/frame 0xfffffe034dfa3ac0 trap() at trap+0x453/frame 0xfffffe034dfa3bf0 calltrap() at calltrap+0x8/frame 0xfffffe034dfa3bf0 --- trap 0xc, rip = 0x8004331e5, rsp = 0x7fffffffe1b8, rbp = 0x7fffffffe200 --- Tracing command swap pid 78098 tid 123747 td 0xfffff805823c46e0 (CPU 3) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e18bdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e18bdf0 trap() at trap+0x44/frame 0xfffffe003e18bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e18bf20 --- trap 0x13, rip = 0x203687, rsp = 0x7fffffffe510, rbp = 0x7fffffffe530 --- Tracing command swap pid 78097 tid 119759 td 0xfffff806c7bcf000 sched_switch() at sched_switch+0x38f/frame 0xfffffe0340aa9710 mi_switch() at mi_switch+0x166/frame 0xfffffe0340aa9750 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe0340aa9790 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0340aa97d0 _sleep() at _sleep+0x26c/frame 0xfffffe0340aa9870 vm_waitpfault() at vm_waitpfault+0x79/frame 0xfffffe0340aa98a0 vm_fault() at vm_fault+0x9ef/frame 0xfffffe0340aa9a00 vm_fault_trap() at vm_fault_trap+0x6e/frame 0xfffffe0340aa9a40 trap_pfault() at trap_pfault+0x1f3/frame 0xfffffe0340aa9ac0 trap() at trap+0x453/frame 0xfffffe0340aa9bf0 calltrap() at calltrap+0x8/frame 0xfffffe0340aa9bf0 --- trap 0xc, rip = 0x8004331e5, rsp = 0x7fffffffe1b8, rbp = 0x7fffffffe200 --- Tracing command swap pid 78096 tid 123541 td 0xfffff8044934c000 sched_switch() at sched_switch+0x38f/frame 0xfffffe034aad1b60 mi_switch() at mi_switch+0x166/frame 0xfffffe034aad1ba0 critical_exit_preempt() at critical_exit_preempt+0x63/frame 0xfffffe034aad1bc0 ipi_bitmap_handler() at ipi_bitmap_handler+0x9f/frame 0xfffffe034aad1bf0 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0xb3/frame 0xfffffe034aad1bf0 --- interrupt, rip = 0x203689, rsp = 0x7fffffffe510, rbp = 0x7fffffffe530 --- Tracing command swap pid 78095 tid 115138 td 0xfffff8048d7a0000 sched_switch() at sched_switch+0x38f/frame 0xfffffe0374a0e710 mi_switch() at mi_switch+0x166/frame 0xfffffe0374a0e750 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe0374a0e790 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0374a0e7d0 _sleep() at _sleep+0x26c/frame 0xfffffe0374a0e870 vm_waitpfault() at vm_waitpfault+0x79/frame 0xfffffe0374a0e8a0 vm_fault() at vm_fault+0x9ef/frame 0xfffffe0374a0ea00 vm_fault_trap() at vm_fault_trap+0x6e/frame 0xfffffe0374a0ea40 trap_pfault() at trap_pfault+0x1f3/frame 0xfffffe0374a0eac0 trap() at trap+0x453/frame 0xfffffe0374a0ebf0 calltrap() at calltrap+0x8/frame 0xfffffe0374a0ebf0 --- trap 0xc, rip = 0x8004331e5, rsp = 0x7fffffffe1b8, rbp = 0x7fffffffe200 --- Tracing command swap pid 78094 tid 116528 td 0xfffff80280981000 (CPU 8) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1c7dd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1c7df0 trap() at trap+0x44/frame 0xfffffe003e1c7f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1c7f20 --- trap 0x13, rip = 0x203687, rsp = 0x7fffffffe510, rbp = 0x7fffffffe530 --- Tracing command swap pid 78093 tid 104133 td 0xfffff8065b9ab6e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe0369f0d710 mi_switch() at mi_switch+0x166/frame 0xfffffe0369f0d750 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe0369f0d790 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0369f0d7d0 _sleep() at _sleep+0x26c/frame 0xfffffe0369f0d870 vm_waitpfault() at vm_waitpfault+0x79/frame 0xfffffe0369f0d8a0 vm_fault() at vm_fault+0x9ef/frame 0xfffffe0369f0da00 vm_fault_trap() at vm_fault_trap+0x6e/frame 0xfffffe0369f0da40 trap_pfault() at trap_pfault+0x1f3/frame 0xfffffe0369f0dac0 trap() at trap+0x453/frame 0xfffffe0369f0dbf0 calltrap() at calltrap+0x8/frame 0xfffffe0369f0dbf0 --- trap 0xc, rip = 0x8004331e5, rsp = 0x7fffffffe1b8, rbp = 0x7fffffffe200 --- Tracing command swap pid 78092 tid 105108 td 0xfffff80469e8b6e0 (CPU 10) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1dfdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1dfdf0 trap() at trap+0x44/frame 0xfffffe003e1dff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1dff20 --- trap 0x13, rip = 0xffffffff81039450, rsp = 0xffffffff8241a2d8, rbp = 0x7fffffffe530 --- Xapic_isr1_pti() at Xapic_isr1_pti/frame 0x7fffffffe530 Tracing command swap pid 78091 tid 104927 td 0xfffff803e982f000 sched_switch() at sched_switch+0x38f/frame 0xfffffe036f7be710 mi_switch() at mi_switch+0x166/frame 0xfffffe036f7be750 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe036f7be790 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe036f7be7d0 _sleep() at _sleep+0x26c/frame 0xfffffe036f7be870 vm_waitpfault() at vm_waitpfault+0x79/frame 0xfffffe036f7be8a0 vm_fault() at vm_fault+0x9ef/frame 0xfffffe036f7bea00 vm_fault_trap() at vm_fault_trap+0x6e/frame 0xfffffe036f7bea40 trap_pfault() at trap_pfault+0x1f3/frame 0xfffffe036f7beac0 trap() at trap+0x453/frame 0xfffffe036f7bebf0 calltrap() at calltrap+0x8/frame 0xfffffe036f7bebf0 --- trap 0xc, rip = 0x8004331e5, rsp = 0x7fffffffe1b8, rbp = 0x7fffffffe200 --- Tracing command swap pid 78090 tid 124457 td 0xfffff804370eb000 sched_switch() at sched_switch+0x38f/frame 0xfffffe03538c7710 mi_switch() at mi_switch+0x166/frame 0xfffffe03538c7750 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe03538c7790 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe03538c77d0 _sleep() at _sleep+0x26c/frame 0xfffffe03538c7870 vm_waitpfault() at vm_waitpfault+0x79/frame 0xfffffe03538c78a0 vm_fault() at vm_fault+0x9ef/frame 0xfffffe03538c7a00 vm_fault_trap() at vm_fault_trap+0x6e/frame 0xfffffe03538c7a40 trap_pfault() at trap_pfault+0x1f3/frame 0xfffffe03538c7ac0 trap() at trap+0x453/frame 0xfffffe03538c7bf0 calltrap() at calltrap+0x8/frame 0xfffffe03538c7bf0 --- trap 0xc, rip = 0x8004331e5, rsp = 0x7fffffffe1b8, rbp = 0x7fffffffe200 --- Tracing command swap pid 78089 tid 110775 td 0xfffff80582a70000 sched_switch() at sched_switch+0x38f/frame 0xfffffe036fe72690 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00d3235010 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00d3235020 trap() at trap+0x56/frame 0xfffffe00d3235150 calltrap() at calltrap+0x8/frame 0xfffffe00d3235150 --- trap 0xc, rip = 0xffffffff810354c0, rsp = 0xfffffe00d3235220, rbp = 0xfffffe00d32352b0 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe00d32352b0 db_get_value() at db_get_value+0x32/frame 0xfffffe00d32352f0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00d3235380 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00d32353a0 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00d3235440 db_command() at db_command+0x25c/frame 0xfffffe00d3235510 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00d32355b0 db_command() at db_command+0x25c/frame 0xfffffe00d3235680 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00d3235690 db_trap() at db_trap+0xe8/frame 0xfffffe00d3235720 kdb_trap() at kdb_trap+0x157/frame 0xfffffe00d32357a0 trap() at trap+0x7b7/frame 0xfffffe00d32358d0 calltrap() at calltrap+0x8/frame 0xfffffe00d32358d0 --- trap 0x3, rip = 0xffffffff80c0ed07, rsp = 0xfffffe00d32359a0, rbp = 0xfffffe00d32359b0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00d32359b0 vpanic() at vpanic+0x19a/frame 0xfffffe00d3235a10 panic() at panic+0x43/frame 0xfffffe00d3235a70 pmap_page_exists_quick() at pmap_page_exists_quick+0x17a/frame 0xfffffe00d3235aa0 vm_swapout_object_deactivate_pages() at vm_swapout_object_deactivate_pages+0x13b/frame 0xfffffe00d3235af0 vm_swapout_map_deactivate_pages() at vm_swapout_map_deactivate_pages+0x1b3/frame 0xfffffe00d3235b40 vm_daemon() at vm_daemon+0x85a/frame 0xfffffe00d3235bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d3235bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d3235bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe036fe72698 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00d32352a0 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00d32352b0 db_get_value() at db_get_value+0x4c/frame 0xfffffe00d32352f0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00d3235380 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00d32353a0 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00d3235440 db_command() at db_command+0x25c/frame 0xfffffe00d3235510 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00d32355b0 db_command() at db_command+0x25c/frame 0xfffffe00d3235680 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00d3235690 db_trap() at db_trap+0xe8/frame 0xfffffe00d3235720 kdb_trap() at kdb_trap+0x157/frame 0xfffffe00d32357a0 trap() at trap+0x7b7/frame 0xfffffe00d32358d0 calltrap() at calltrap+0x8/frame 0xfffffe00d32358d0 --- trap 0x3, rip = 0xffffffff80c0ed07, rsp = 0xfffffe00d32359a0, rbp = 0xfffffe00d32359b0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00d32359b0 vpanic() at vpanic+0x19a/frame 0xfffffe00d3235a10 panic() at panic+0x43/frame 0xfffffe00d3235a70 pmap_page_exists_quick() at pmap_page_exists_quick+0x17a/frame 0xfffffe00d3235aa0 vm_swapout_object_deactivate_pages() at vm_swapout_object_deactivate_pages+0x13b/frame 0xfffffe00d3235af0 vm_swapout_map_deactivate_pages() at vm_swapout_map_deactivate_pages+0x1b3/frame 0xfffffe00d3235b40 vm_daemon() at vm_daemon+0x85a/frame 0xfffffe00d3235bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d3235bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d3235bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command link pid 78088 tid 105099 td 0xfffff806c17706e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe0349fad300 mi_switch() at mi_switch+0x166/frame 0xfffffe0349fad340 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe0349fad380 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0349fad3b0 sleeplk() at sleeplk+0x107/frame 0xfffffe0349fad410 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x225/frame 0xfffffe0349fad4d0 lockmgr_upgrade() at lockmgr_upgrade+0x10f/frame 0xfffffe0349fad520 __lockmgr_args() at __lockmgr_args+0x6a0/frame 0xfffffe0349fad5e0 ffs_lock() at ffs_lock+0x7c/frame 0xfffffe0349fad630 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x92/frame 0xfffffe0349fad650 _vn_lock() at _vn_lock+0x65/frame 0xfffffe0349fad6b0 lookup() at lookup+0x52c/frame 0xfffffe0349fad750 namei() at namei+0x4fc/frame 0xfffffe0349fad840 kern_renameat() at kern_renameat+0x9d/frame 0xfffffe0349fadac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe0349fadbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0349fadbf0 --- syscall (128, FreeBSD ELF64, sys_rename), rip = 0x8002db54a, rsp = 0x7fffffffdea8, rbp = 0x7fffffffe6e0 --- Tracing command link pid 78087 tid 100801 td 0xfffff8044b406000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e73d5300 mi_switch() at mi_switch+0x166/frame 0xfffffe00e73d5340 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e73d5380 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00e73d53b0 sleeplk() at sleeplk+0x107/frame 0xfffffe00e73d5410 lockmgr_slock_hard() at lockmgr_slock_hard+0x1d6/frame 0xfffffe00e73d54c0 __lockmgr_args() at __lockmgr_args+0x762/frame 0xfffffe00e73d5580 ffs_lock() at ffs_lock+0x7c/frame 0xfffffe00e73d55d0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x92/frame 0xfffffe00e73d55f0 _vn_lock() at _vn_lock+0x65/frame 0xfffffe00e73d5650 vfs_cache_root() at vfs_cache_root+0x129/frame 0xfffffe00e73d56b0 lookup() at lookup+0x7e7/frame 0xfffffe00e73d5750 namei() at namei+0x4fc/frame 0xfffffe00e73d5840 kern_renameat() at kern_renameat+0x9d/frame 0xfffffe00e73d5ac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00e73d5bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e73d5bf0 --- syscall (128, FreeBSD ELF64, sys_rename), rip = 0x8002db54a, rsp = 0x7fffffffdea8, rbp = 0x7fffffffe6e0 --- Tracing command link pid 78086 tid 114924 td 0xfffff806c2daf000 sched_switch() at sched_switch+0x38f/frame 0xfffffe03727da300 mi_switch() at mi_switch+0x166/frame 0xfffffe03727da340 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe03727da380 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe03727da3b0 sleeplk() at sleeplk+0x107/frame 0xfffffe03727da410 lockmgr_slock_hard() at lockmgr_slock_hard+0x1d6/frame 0xfffffe03727da4c0 __lockmgr_args() at __lockmgr_args+0x762/frame 0xfffffe03727da580 ffs_lock() at ffs_lock+0x7c/frame 0xfffffe03727da5d0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x92/frame 0xfffffe03727da5f0 _vn_lock() at _vn_lock+0x65/frame 0xfffffe03727da650 vfs_cache_root() at vfs_cache_root+0x129/frame 0xfffffe03727da6b0 lookup() at lookup+0x7e7/frame 0xfffffe03727da750 namei() at namei+0x4fc/frame 0xfffffe03727da840 kern_renameat() at kern_renameat+0x9d/frame 0xfffffe03727daac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe03727dabf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe03727dabf0 --- syscall (128, FreeBSD ELF64, sys_rename), rip = 0x8002db54a, rsp = 0x7fffffffdea8, rbp = 0x7fffffffe6e0 --- Tracing command link pid 78085 tid 116871 td 0xfffff80550569000 sched_switch() at sched_switch+0x38f/frame 0xfffffe036e809300 mi_switch() at mi_switch+0x166/frame 0xfffffe036e809340 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe036e809380 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe036e8093b0 sleeplk() at sleeplk+0x107/frame 0xfffffe036e809410 lockmgr_slock_hard() at lockmgr_slock_hard+0x1d6/frame 0xfffffe036e8094c0 __lockmgr_args() at __lockmgr_args+0x762/frame 0xfffffe036e809580 ffs_lock() at ffs_lock+0x7c/frame 0xfffffe036e8095d0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x92/frame 0xfffffe036e8095f0 _vn_lock() at _vn_lock+0x65/frame 0xfffffe036e809650 vfs_cache_root() at vfs_cache_root+0x129/frame 0xfffffe036e8096b0 lookup() at lookup+0x7e7/frame 0xfffffe036e809750 namei() at namei+0x4fc/frame 0xfffffe036e809840 kern_renameat() at kern_renameat+0x187/frame 0xfffffe036e809ac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe036e809bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe036e809bf0 --- syscall (128, FreeBSD ELF64, sys_rename), rip = 0x8002db54a, rsp = 0x7fffffffdea8, rbp = 0x7fffffffe6e0 --- Tracing command link pid 78084 tid 113494 td 0xfffff805507e16e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe03752c22e0 mi_switch() at mi_switch+0x166/frame 0xfffffe03752c2320 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe03752c2360 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe03752c2390 sleeplk() at sleeplk+0x107/frame 0xfffffe03752c23f0 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x225/frame 0xfffffe03752c24b0 __lockmgr_args() at __lockmgr_args+0x60d/frame 0xfffffe03752c2570 ffs_lock() at ffs_lock+0x7c/frame 0xfffffe03752c25c0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x92/frame 0xfffffe03752c25e0 _vn_lock() at _vn_lock+0x65/frame 0xfffffe03752c2640 ufs_rename() at ufs_rename+0x114/frame 0xfffffe03752c2820 VOP_RENAME_APV() at VOP_RENAME_APV+0x92/frame 0xfffffe03752c2840 kern_renameat() at kern_renameat+0x367/frame 0xfffffe03752c2ac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe03752c2bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe03752c2bf0 --- syscall (128, FreeBSD ELF64, sys_rename), rip = 0x8002db54a, rsp = 0x7fffffffdea8, rbp = 0x7fffffffe6e0 --- Tracing command link pid 78083 tid 121544 td 0xfffff805065946e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe035a3a8300 mi_switch() at mi_switch+0x166/frame 0xfffffe035a3a8340 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe035a3a8380 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe035a3a83b0 sleeplk() at sleeplk+0x107/frame 0xfffffe035a3a8410 lockmgr_slock_hard() at lockmgr_slock_hard+0x1d6/frame 0xfffffe035a3a84c0 __lockmgr_args() at __lockmgr_args+0x762/frame 0xfffffe035a3a8580 ffs_lock() at ffs_lock+0x7c/frame 0xfffffe035a3a85d0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x92/frame 0xfffffe035a3a85f0 _vn_lock() at _vn_lock+0x65/frame 0xfffffe035a3a8650 vfs_cache_root() at vfs_cache_root+0x129/frame 0xfffffe035a3a86b0 lookup() at lookup+0x7e7/frame 0xfffffe035a3a8750 namei() at namei+0x4fc/frame 0xfffffe035a3a8840 kern_renameat() at kern_renameat+0x187/frame 0xfffffe035a3a8ac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe035a3a8bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe035a3a8bf0 --- syscall (128, FreeBSD ELF64, sys_rename), rip = 0x8002db54a, rsp = 0x7fffffffdea8, rbp = 0x7fffffffe6e0 --- Tracing command link pid 78082 tid 122171 td 0xfffff803e903a000 sched_switch() at sched_switch+0x38f/frame 0xfffffe0362bf3300 mi_switch() at mi_switch+0x166/frame 0xfffffe0362bf3340 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe0362bf3380 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0362bf33b0 sleeplk() at sleeplk+0x107/frame 0xfffffe0362bf3410 lockmgr_slock_hard() at lockmgr_slock_hard+0x1d6/frame 0xfffffe0362bf34c0 __lockmgr_args() at __lockmgr_args+0x762/frame 0xfffffe0362bf3580 ffs_lock() at ffs_lock+0x7c/frame 0xfffffe0362bf35d0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x92/frame 0xfffffe0362bf35f0 _vn_lock() at _vn_lock+0x65/frame 0xfffffe0362bf3650 vfs_cache_root() at vfs_cache_root+0x129/frame 0xfffffe0362bf36b0 lookup() at lookup+0x7e7/frame 0xfffffe0362bf3750 namei() at namei+0x4fc/frame 0xfffffe0362bf3840 kern_renameat() at kern_renameat+0x187/frame 0xfffffe0362bf3ac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe0362bf3bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0362bf3bf0 --- syscall (128, FreeBSD ELF64, sys_rename), rip = 0x8002db54a, rsp = 0x7fffffffdea8, rbp = 0x7fffffffe6e0 --- Tracing command link pid 78081 tid 120820 td 0xfffff804374176e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe036d576300 mi_switch() at mi_switch+0x166/frame 0xfffffe036d576340 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe036d576380 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe036d5763b0 sleeplk() at sleeplk+0x107/frame 0xfffffe036d576410 lockmgr_slock_hard() at lockmgr_slock_hard+0x1d6/frame 0xfffffe036d5764c0 __lockmgr_args() at __lockmgr_args+0x762/frame 0xfffffe036d576580 ffs_lock() at ffs_lock+0x7c/frame 0xfffffe036d5765d0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x92/frame 0xfffffe036d5765f0 _vn_lock() at _vn_lock+0x65/frame 0xfffffe036d576650 vfs_cache_root() at vfs_cache_root+0x129/frame 0xfffffe036d5766b0 lookup() at lookup+0x7e7/frame 0xfffffe036d576750 namei() at namei+0x4fc/frame 0xfffffe036d576840 kern_renameat() at kern_renameat+0x9d/frame 0xfffffe036d576ac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe036d576bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe036d576bf0 --- syscall (128, FreeBSD ELF64, sys_rename), rip = 0x8002db54a, rsp = 0x7fffffffdea8, rbp = 0x7fffffffe6e0 --- Tracing command link pid 78080 tid 123555 td 0xfffff804f4af7000 sched_switch() at sched_switch+0x38f/frame 0xfffffe034ab17300 mi_switch() at mi_switch+0x166/frame 0xfffffe034ab17340 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe034ab17380 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe034ab173b0 sleeplk() at sleeplk+0x107/frame 0xfffffe034ab17410 lockmgr_slock_hard() at lockmgr_slock_hard+0x1d6/frame 0xfffffe034ab174c0 __lockmgr_args() at __lockmgr_args+0x762/frame 0xfffffe034ab17580 ffs_lock() at ffs_lock+0x7c/frame 0xfffffe034ab175d0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x92/frame 0xfffffe034ab175f0 _vn_lock() at _vn_lock+0x65/frame 0xfffffe034ab17650 vfs_cache_root() at vfs_cache_root+0x129/frame 0xfffffe034ab176b0 lookup() at lookup+0x7e7/frame 0xfffffe034ab17750 namei() at namei+0x4fc/frame 0xfffffe034ab17840 kern_renameat() at kern_renameat+0x187/frame 0xfffffe034ab17ac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe034ab17bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe034ab17bf0 --- syscall (128, FreeBSD ELF64, sys_rename), rip = 0x8002db54a, rsp = 0x7fffffffdea8, rbp = 0x7fffffffe6e0 --- Tracing command link pid 78079 tid 124487 td 0xfffff804370e4000 sched_switch() at sched_switch+0x38f/frame 0xfffffe035395d300 mi_switch() at mi_switch+0x166/frame 0xfffffe035395d340 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe035395d380 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe035395d3b0 sleeplk() at sleeplk+0x107/frame 0xfffffe035395d410 lockmgr_slock_hard() at lockmgr_slock_hard+0x1d6/frame 0xfffffe035395d4c0 __lockmgr_args() at __lockmgr_args+0x762/frame 0xfffffe035395d580 ffs_lock() at ffs_lock+0x7c/frame 0xfffffe035395d5d0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x92/frame 0xfffffe035395d5f0 _vn_lock() at _vn_lock+0x65/frame 0xfffffe035395d650 vfs_cache_root() at vfs_cache_root+0x129/frame 0xfffffe035395d6b0 lookup() at lookup+0x7e7/frame 0xfffffe035395d750 namei() at namei+0x4fc/frame 0xfffffe035395d840 kern_renameat() at kern_renameat+0x9d/frame 0xfffffe035395dac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe035395dbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe035395dbf0 --- syscall (128, FreeBSD ELF64, sys_rename), rip = 0x8002db54a, rsp = 0x7fffffffdea8, rbp = 0x7fffffffe6e0 --- Tracing command link pid 78078 tid 116869 td 0xfffff8050679d000 sched_switch() at sched_switch+0x38f/frame 0xfffffe036c9fd2e0 mi_switch() at mi_switch+0x166/frame 0xfffffe036c9fd320 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe036c9fd360 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe036c9fd390 sleeplk() at sleeplk+0x107/frame 0xfffffe036c9fd3f0 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x225/frame 0xfffffe036c9fd4b0 __lockmgr_args() at __lockmgr_args+0x60d/frame 0xfffffe036c9fd570 ffs_lock() at ffs_lock+0x7c/frame 0xfffffe036c9fd5c0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x92/frame 0xfffffe036c9fd5e0 _vn_lock() at _vn_lock+0x65/frame 0xfffffe036c9fd640 ufs_rename() at ufs_rename+0x114/frame 0xfffffe036c9fd820 VOP_RENAME_APV() at VOP_RENAME_APV+0x92/frame 0xfffffe036c9fd840 kern_renameat() at kern_renameat+0x367/frame 0xfffffe036c9fdac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe036c9fdbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe036c9fdbf0 --- syscall (128, FreeBSD ELF64, sys_rename), rip = 0x8002db54a, rsp = 0x7fffffffdea8, rbp = 0x7fffffffe6e0 --- Tracing command link pid 78077 tid 120642 td 0xfffff802b5c92000 sched_switch() at sched_switch+0x38f/frame 0xfffffe0362df8300 mi_switch() at mi_switch+0x166/frame 0xfffffe0362df8340 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe0362df8380 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0362df83b0 sleeplk() at sleeplk+0x107/frame 0xfffffe0362df8410 lockmgr_slock_hard() at lockmgr_slock_hard+0x1d6/frame 0xfffffe0362df84c0 __lockmgr_args() at __lockmgr_args+0x762/frame 0xfffffe0362df8580 ffs_lock() at ffs_lock+0x7c/frame 0xfffffe0362df85d0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x92/frame 0xfffffe0362df85f0 _vn_lock() at _vn_lock+0x65/frame 0xfffffe0362df8650 vfs_cache_root() at vfs_cache_root+0x129/frame 0xfffffe0362df86b0 lookup() at lookup+0x7e7/frame 0xfffffe0362df8750 namei() at namei+0x4fc/frame 0xfffffe0362df8840 kern_renameat() at kern_renameat+0x187/frame 0xfffffe0362df8ac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe0362df8bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0362df8bf0 --- syscall (128, FreeBSD ELF64, sys_rename), rip = 0x8002db54a, rsp = 0x7fffffffdea8, rbp = 0x7fffffffe6e0 --- Tracing command link pid 78076 tid 120940 td 0xfffff80437fd46e0 (CPU 1) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e173dd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e173df0 trap() at trap+0x44/frame 0xfffffe003e173f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e173f20 --- trap 0x13, rip = 0xffffffff80ecddfc, rsp = 0xfffffe035a9d04e0, rbp = 0xfffffe035a9d0500 --- workitem_free() at workitem_free+0x6c/frame 0xfffffe035a9d0500 newdirrem() at newdirrem+0x8b4/frame 0xfffffe035a9d05b0 softdep_setup_remove() at softdep_setup_remove+0x3c/frame 0xfffffe035a9d05f0 ufs_dirremove() at ufs_dirremove+0x1ca/frame 0xfffffe035a9d0640 ufs_rename() at ufs_rename+0x1317/frame 0xfffffe035a9d0820 VOP_RENAME_APV() at VOP_RENAME_APV+0x92/frame 0xfffffe035a9d0840 kern_renameat() at kern_renameat+0x367/frame 0xfffffe035a9d0ac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe035a9d0bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe035a9d0bf0 --- syscall (128, FreeBSD ELF64, sys_rename), rip = 0x8002db54a, rsp = 0x7fffffffdea8, rbp = 0x7fffffffe6e0 --- Tracing command link pid 78075 tid 122090 td 0xfffff80151b6c000 sched_switch() at sched_switch+0x38f/frame 0xfffffe0362a5e300 mi_switch() at mi_switch+0x166/frame 0xfffffe0362a5e340 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe0362a5e380 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0362a5e3b0 sleeplk() at sleeplk+0x107/frame 0xfffffe0362a5e410 lockmgr_slock_hard() at lockmgr_slock_hard+0x1d6/frame 0xfffffe0362a5e4c0 __lockmgr_args() at __lockmgr_args+0x762/frame 0xfffffe0362a5e580 ffs_lock() at ffs_lock+0x7c/frame 0xfffffe0362a5e5d0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x92/frame 0xfffffe0362a5e5f0 _vn_lock() at _vn_lock+0x65/frame 0xfffffe0362a5e650 vfs_cache_root() at vfs_cache_root+0x129/frame 0xfffffe0362a5e6b0 lookup() at lookup+0x7e7/frame 0xfffffe0362a5e750 namei() at namei+0x4fc/frame 0xfffffe0362a5e840 kern_renameat() at kern_renameat+0x9d/frame 0xfffffe0362a5eac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe0362a5ebf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0362a5ebf0 --- syscall (128, FreeBSD ELF64, sys_rename), rip = 0x8002db54a, rsp = 0x7fffffffdea8, rbp = 0x7fffffffe6e0 --- Tracing command link pid 78074 tid 112648 td 0xfffff806c2b1f6e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe03601e9300 mi_switch() at mi_switch+0x166/frame 0xfffffe03601e9340 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe03601e9380 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe03601e93b0 sleeplk() at sleeplk+0x107/frame 0xfffffe03601e9410 lockmgr_slock_hard() at lockmgr_slock_hard+0x1d6/frame 0xfffffe03601e94c0 __lockmgr_args() at __lockmgr_args+0x762/frame 0xfffffe03601e9580 ffs_lock() at ffs_lock+0x7c/frame 0xfffffe03601e95d0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x92/frame 0xfffffe03601e95f0 _vn_lock() at _vn_lock+0x65/frame 0xfffffe03601e9650 vfs_cache_root() at vfs_cache_root+0x129/frame 0xfffffe03601e96b0 lookup() at lookup+0x7e7/frame 0xfffffe03601e9750 namei() at namei+0x4fc/frame 0xfffffe03601e9840 kern_renameat() at kern_renameat+0x187/frame 0xfffffe03601e9ac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe03601e9bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe03601e9bf0 --- syscall (128, FreeBSD ELF64, sys_rename), rip = 0x8002db54a, rsp = 0x7fffffffdea8, rbp = 0x7fffffffe6e0 --- Tracing command link pid 78073 tid 124635 td 0xfffff806c7f476e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe033ae45300 mi_switch() at mi_switch+0x166/frame 0xfffffe033ae45340 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe033ae45380 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe033ae453b0 sleeplk() at sleeplk+0x107/frame 0xfffffe033ae45410 lockmgr_slock_hard() at lockmgr_slock_hard+0x1d6/frame 0xfffffe033ae454c0 __lockmgr_args() at __lockmgr_args+0x762/frame 0xfffffe033ae45580 ffs_lock() at ffs_lock+0x7c/frame 0xfffffe033ae455d0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x92/frame 0xfffffe033ae455f0 _vn_lock() at _vn_lock+0x65/frame 0xfffffe033ae45650 vfs_cache_root() at vfs_cache_root+0x129/frame 0xfffffe033ae456b0 lookup() at lookup+0x7e7/frame 0xfffffe033ae45750 namei() at namei+0x4fc/frame 0xfffffe033ae45840 kern_renameat() at kern_renameat+0x9d/frame 0xfffffe033ae45ac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe033ae45bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe033ae45bf0 --- syscall (128, FreeBSD ELF64, sys_rename), rip = 0x8002db54a, rsp = 0x7fffffffdea8, rbp = 0x7fffffffe6e0 --- Tracing command link pid 78069 tid 102243 td 0xfffff801108016e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe033afc6690 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00d3235010 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00d3235020 trap() at trap+0x56/frame 0xfffffe00d3235150 calltrap() at calltrap+0x8/frame 0xfffffe00d3235150 --- trap 0xc, rip = 0xffffffff810354c0, rsp = 0xfffffe00d3235220, rbp = 0xfffffe00d32352b0 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe00d32352b0 db_get_value() at db_get_value+0x32/frame 0xfffffe00d32352f0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00d3235380 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00d32353a0 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00d3235440 db_command() at db_command+0x25c/frame 0xfffffe00d3235510 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00d32355b0 db_command() at db_command+0x25c/frame 0xfffffe00d3235680 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00d3235690 db_trap() at db_trap+0xe8/frame 0xfffffe00d3235720 kdb_trap() at kdb_trap+0x157/frame 0xfffffe00d32357a0 trap() at trap+0x7b7/frame 0xfffffe00d32358d0 calltrap() at calltrap+0x8/frame 0xfffffe00d32358d0 --- trap 0x3, rip = 0xffffffff80c0ed07, rsp = 0xfffffe00d32359a0, rbp = 0xfffffe00d32359b0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00d32359b0 vpanic() at vpanic+0x19a/frame 0xfffffe00d3235a10 panic() at panic+0x43/frame 0xfffffe00d3235a70 pmap_page_exists_quick() at pmap_page_exists_quick+0x17a/frame 0xfffffe00d3235aa0 vm_swapout_object_deactivate_pages() at vm_swapout_object_deactivate_pages+0x13b/frame 0xfffffe00d3235af0 vm_swapout_map_deactivate_pages() at vm_swapout_map_deactivate_pages+0x1b3/frame 0xfffffe00d3235b40 vm_daemon() at vm_daemon+0x85a/frame 0xfffffe00d3235bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d3235bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d3235bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe033afc6698 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00d32352a0 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00d32352b0 db_get_value() at db_get_value+0x4c/frame 0xfffffe00d32352f0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00d3235380 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00d32353a0 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00d3235440 db_command() at db_command+0x25c/frame 0xfffffe00d3235510 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00d32355b0 db_command() at db_command+0x25c/frame 0xfffffe00d3235680 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00d3235690 db_trap() at db_trap+0xe8/frame 0xfffffe00d3235720 kdb_trap() at kdb_trap+0x157/frame 0xfffffe00d32357a0 trap() at trap+0x7b7/frame 0xfffffe00d32358d0 calltrap() at calltrap+0x8/frame 0xfffffe00d32358d0 --- trap 0x3, rip = 0xffffffff80c0ed07, rsp = 0xfffffe00d32359a0, rbp = 0xfffffe00d32359b0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00d32359b0 vpanic() at vpanic+0x19a/frame 0xfffffe00d3235a10 panic() at panic+0x43/frame 0xfffffe00d3235a70 pmap_page_exists_quick() at pmap_page_exists_quick+0x17a/frame 0xfffffe00d3235aa0 vm_swapout_object_deactivate_pages() at vm_swapout_object_deactivate_pages+0x13b/frame 0xfffffe00d3235af0 vm_swapout_map_deactivate_pages() at vm_swapout_map_deactivate_pages+0x1b3/frame 0xfffffe00d3235b40 vm_daemon() at vm_daemon+0x85a/frame 0xfffffe00d3235bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d3235bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d3235bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command swap pid 78068 tid 107894 td 0xfffff80449491000 sched_switch() at sched_switch+0x38f/frame 0xfffffe0340db2830 mi_switch() at mi_switch+0x166/frame 0xfffffe0340db2870 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe0340db28b0 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe0340db2910 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe0340db2950 _sleep() at _sleep+0x258/frame 0xfffffe0340db29f0 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe0340db2a80 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe0340db2ac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe0340db2bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0340db2bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003c3a7a, rsp = 0x7fffffffe548, rbp = 0x7fffffffe590 --- Tracing command md10 pid 78063 tid 123654 td 0xfffff80216f61000 sched_switch() at sched_switch+0x38f/frame 0xfffffe0359f08a00 mi_switch() at mi_switch+0x166/frame 0xfffffe0359f08a40 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe0359f08a80 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0359f08ab0 _sleep() at _sleep+0x2cd/frame 0xfffffe0359f08b50 md_kthread() at md_kthread+0xe5/frame 0xfffffe0359f08bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0359f08bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0359f08bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sh pid 78047 tid 110153 td 0xfffff8055095c000 sched_switch() at sched_switch+0x38f/frame 0xfffffe0357926690 mi_switch() at mi_switch+0x166/frame 0xfffffe03579266d0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe0357926710 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe0357926770 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe03579267a0 _sleep() at _sleep+0x2c3/frame 0xfffffe0357926840 kern_wait6() at kern_wait6+0x482/frame 0xfffffe03579268d0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe0357926ac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe0357926bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0357926bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040791a, rsp = 0x7fffffffe2c8, rbp = 0x7fffffffe380 --- Tracing command tee pid 78046 tid 102316 td 0xfffff8050dac8000 sched_switch() at sched_switch+0x38f/frame 0xfffffe033e73f7d0 mi_switch() at mi_switch+0x166/frame 0xfffffe033e73f810 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe033e73f850 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe033e73f8b0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe033e73f8e0 _sleep() at _sleep+0x2c3/frame 0xfffffe033e73f980 pipe_read() at pipe_read+0x428/frame 0xfffffe033e73f9e0 dofileread() at dofileread+0x81/frame 0xfffffe033e73fa30 kern_readv() at kern_readv+0x49/frame 0xfffffe033e73fa70 sys_read() at sys_read+0x83/frame 0xfffffe033e73fac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe033e73fbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe033e73fbf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800417b8a, rsp = 0x7fffffffe6a8, rbp = 0x7fffffffe6f0 --- Tracing command sh pid 78045 tid 114920 td 0xfffff803e8883000 sched_switch() at sched_switch+0x38f/frame 0xfffffe03727c6690 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00d3235010 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00d3235020 trap() at trap+0x56/frame 0xfffffe00d3235150 calltrap() at calltrap+0x8/frame 0xfffffe00d3235150 --- trap 0xc, rip = 0xffffffff810354c0, rsp = 0xfffffe00d3235220, rbp = 0xfffffe00d32352b0 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe00d32352b0 db_get_value() at db_get_value+0x32/frame 0xfffffe00d32352f0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00d3235380 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00d32353a0 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00d3235440 db_command() at db_command+0x25c/frame 0xfffffe00d3235510 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00d32355b0 db_command() at db_command+0x25c/frame 0xfffffe00d3235680 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00d3235690 db_trap() at db_trap+0xe8/frame 0xfffffe00d3235720 kdb_trap() at kdb_trap+0x157/frame 0xfffffe00d32357a0 trap() at trap+0x7b7/frame 0xfffffe00d32358d0 calltrap() at calltrap+0x8/frame 0xfffffe00d32358d0 --- trap 0x3, rip = 0xffffffff80c0ed07, rsp = 0xfffffe00d32359a0, rbp = 0xfffffe00d32359b0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00d32359b0 vpanic() at vpanic+0x19a/frame 0xfffffe00d3235a10 panic() at panic+0x43/frame 0xfffffe00d3235a70 pmap_page_exists_quick() at pmap_page_exists_quick+0x17a/frame 0xfffffe00d3235aa0 vm_swapout_object_deactivate_pages() at vm_swapout_object_deactivate_pages+0x13b/frame 0xfffffe00d3235af0 vm_swapout_map_deactivate_pages() at vm_swapout_map_deactivate_pages+0x1b3/frame 0xfffffe00d3235b40 vm_daemon() at vm_daemon+0x85a/frame 0xfffffe00d3235bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d3235bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d3235bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe03727c6698 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00d32352a0 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00d32352b0 db_get_value() at db_get_value+0x4c/frame 0xfffffe00d32352f0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00d3235380 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00d32353a0 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00d3235440 db_command() at db_command+0x25c/frame 0xfffffe00d3235510 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00d32355b0 db_command() at db_command+0x25c/frame 0xfffffe00d3235680 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00d3235690 db_trap() at db_trap+0xe8/frame 0xfffffe00d3235720 kdb_trap() at kdb_trap+0x157/frame 0xfffffe00d32357a0 trap() at trap+0x7b7/frame 0xfffffe00d32358d0 calltrap() at calltrap+0x8/frame 0xfffffe00d32358d0 --- trap 0x3, rip = 0xffffffff80c0ed07, rsp = 0xfffffe00d32359a0, rbp = 0xfffffe00d32359b0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00d32359b0 vpanic() at vpanic+0x19a/frame 0xfffffe00d3235a10 panic() at panic+0x43/frame 0xfffffe00d3235a70 pmap_page_exists_quick() at pmap_page_exists_quick+0x17a/frame 0xfffffe00d3235aa0 vm_swapout_object_deactivate_pages() at vm_swapout_object_deactivate_pages+0x13b/frame 0xfffffe00d3235af0 vm_swapout_map_deactivate_pages() at vm_swapout_map_deactivate_pages+0x1b3/frame 0xfffffe00d3235b40 vm_daemon() at vm_daemon+0x85a/frame 0xfffffe00d3235bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d3235bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d3235bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command aiod4 pid 58437 tid 101700 td 0xfffff80253ad1000 sched_switch() at sched_switch+0x38f/frame 0xfffffe033847ca00 mi_switch() at mi_switch+0x166/frame 0xfffffe033847ca40 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe033847ca80 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe033847cac0 _sleep() at _sleep+0x26c/frame 0xfffffe033847cb60 aio_daemon() at aio_daemon+0x2ea/frame 0xfffffe033847cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe033847cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe033847cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command aiod3 pid 58436 tid 102367 td 0xfffff8048d8636e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe034affda00 mi_switch() at mi_switch+0x166/frame 0xfffffe034affda40 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe034affda80 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe034affdac0 _sleep() at _sleep+0x26c/frame 0xfffffe034affdb60 aio_daemon() at aio_daemon+0x2ea/frame 0xfffffe034affdbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe034affdbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe034affdbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command aiod2 pid 58435 tid 100785 td 0xfffff806b94cd6e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e9588a00 mi_switch() at mi_switch+0x166/frame 0xfffffe00e9588a40 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e9588a80 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00e9588ac0 _sleep() at _sleep+0x26c/frame 0xfffffe00e9588b60 aio_daemon() at aio_daemon+0x2ea/frame 0xfffffe00e9588bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e9588bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e9588bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command aiod1 pid 58434 tid 104129 td 0xfffff8081a208000 sched_switch() at sched_switch+0x38f/frame 0xfffffe0369ef9a00 mi_switch() at mi_switch+0x166/frame 0xfffffe0369ef9a40 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe0369ef9a80 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0369ef9ac0 _sleep() at _sleep+0x26c/frame 0xfffffe0369ef9b60 aio_daemon() at aio_daemon+0x2ea/frame 0xfffffe0369ef9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0369ef9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0369ef9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sh pid 10058 tid 100275 td 0xfffff8019cb316e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e3ff47d0 mi_switch() at mi_switch+0x166/frame 0xfffffe00e3ff4810 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e3ff4850 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe00e3ff48b0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3ff48e0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e3ff4980 pipe_read() at pipe_read+0x428/frame 0xfffffe00e3ff49e0 dofileread() at dofileread+0x81/frame 0xfffffe00e3ff4a30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e3ff4a70 sys_read() at sys_read+0x83/frame 0xfffffe00e3ff4ac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00e3ff4bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3ff4bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800476b8a, rsp = 0x7fffffffe238, rbp = 0x7fffffffe330 --- Tracing command awk pid 10056 tid 100274 td 0xfffff8019cb30000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e3fef7d0 mi_switch() at mi_switch+0x166/frame 0xfffffe00e3fef810 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e3fef850 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe00e3fef8b0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3fef8e0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e3fef980 pipe_read() at pipe_read+0x428/frame 0xfffffe00e3fef9e0 dofileread() at dofileread+0x81/frame 0xfffffe00e3fefa30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e3fefa70 sys_read() at sys_read+0x83/frame 0xfffffe00e3fefac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00e3fefbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3fefbf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80047bb8a, rsp = 0x7fffffffe318, rbp = 0x7fffffffe330 --- Tracing command sh pid 10055 tid 100171 td 0xfffff80007f816e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e1d99690 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00d3235010 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00d3235020 trap() at trap+0x56/frame 0xfffffe00d3235150 calltrap() at calltrap+0x8/frame 0xfffffe00d3235150 --- trap 0xc, rip = 0xffffffff810354c0, rsp = 0xfffffe00d3235220, rbp = 0xfffffe00d32352b0 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe00d32352b0 db_get_value() at db_get_value+0x32/frame 0xfffffe00d32352f0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00d3235380 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00d32353a0 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00d3235440 db_command() at db_command+0x25c/frame 0xfffffe00d3235510 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00d32355b0 db_command() at db_command+0x25c/frame 0xfffffe00d3235680 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00d3235690 db_trap() at db_trap+0xe8/frame 0xfffffe00d3235720 kdb_trap() at kdb_trap+0x157/frame 0xfffffe00d32357a0 trap() at trap+0x7b7/frame 0xfffffe00d32358d0 calltrap() at calltrap+0x8/frame 0xfffffe00d32358d0 --- trap 0x3, rip = 0xffffffff80c0ed07, rsp = 0xfffffe00d32359a0, rbp = 0xfffffe00d32359b0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00d32359b0 vpanic() at vpanic+0x19a/frame 0xfffffe00d3235a10 panic() at panic+0x43/frame 0xfffffe00d3235a70 pmap_page_exists_quick() at pmap_page_exists_quick+0x17a/frame 0xfffffe00d3235aa0 vm_swapout_object_deactivate_pages() at vm_swapout_object_deactivate_pages+0x13b/frame 0xfffffe00d3235af0 vm_swapout_map_deactivate_pages() at vm_swapout_map_deactivate_pages+0x1b3/frame 0xfffffe00d3235b40 vm_daemon() at vm_daemon+0x85a/frame 0xfffffe00d3235bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d3235bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d3235bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00e1d99698 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00d32352a0 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00d32352b0 db_get_value() at db_get_value+0x4c/frame 0xfffffe00d32352f0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00d3235380 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00d32353a0 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00d3235440 db_command() at db_command+0x25c/frame 0xfffffe00d3235510 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00d32355b0 db_command() at db_command+0x25c/frame 0xfffffe00d3235680 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00d3235690 db_trap() at db_trap+0xe8/frame 0xfffffe00d3235720 kdb_trap() at kdb_trap+0x157/frame 0xfffffe00d32357a0 trap() at trap+0x7b7/frame 0xfffffe00d32358d0 calltrap() at calltrap+0x8/frame 0xfffffe00d32358d0 --- trap 0x3, rip = 0xffffffff80c0ed07, rsp = 0xfffffe00d32359a0, rbp = 0xfffffe00d32359b0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00d32359b0 vpanic() at vpanic+0x19a/frame 0xfffffe00d3235a10 panic() at panic+0x43/frame 0xfffffe00d3235a70 pmap_page_exists_quick() at pmap_page_exists_quick+0x17a/frame 0xfffffe00d3235aa0 vm_swapout_object_deactivate_pages() at vm_swapout_object_deactivate_pages+0x13b/frame 0xfffffe00d3235af0 vm_swapout_map_deactivate_pages() at vm_swapout_map_deactivate_pages+0x1b3/frame 0xfffffe00d3235b40 vm_daemon() at vm_daemon+0x85a/frame 0xfffffe00d3235bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d3235bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d3235bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sh pid 10016 tid 100256 td 0xfffff8017f1b8000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e3f95690 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00d3235010 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00d3235020 trap() at trap+0x56/frame 0xfffffe00d3235150 calltrap() at calltrap+0x8/frame 0xfffffe00d3235150 --- trap 0xc, rip = 0xffffffff810354c0, rsp = 0xfffffe00d3235220, rbp = 0xfffffe00d32352b0 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe00d32352b0 db_get_value() at db_get_value+0x32/frame 0xfffffe00d32352f0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00d3235380 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00d32353a0 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00d3235440 db_command() at db_command+0x25c/frame 0xfffffe00d3235510 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00d32355b0 db_command() at db_command+0x25c/frame 0xfffffe00d3235680 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00d3235690 db_trap() at db_trap+0xe8/frame 0xfffffe00d3235720 kdb_trap() at kdb_trap+0x157/frame 0xfffffe00d32357a0 trap() at trap+0x7b7/frame 0xfffffe00d32358d0 calltrap() at calltrap+0x8/frame 0xfffffe00d32358d0 --- trap 0x3, rip = 0xffffffff80c0ed07, rsp = 0xfffffe00d32359a0, rbp = 0xfffffe00d32359b0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00d32359b0 vpanic() at vpanic+0x19a/frame 0xfffffe00d3235a10 panic() at panic+0x43/frame 0xfffffe00d3235a70 pmap_page_exists_quick() at pmap_page_exists_quick+0x17a/frame 0xfffffe00d3235aa0 vm_swapout_object_deactivate_pages() at vm_swapout_object_deactivate_pages+0x13b/frame 0xfffffe00d3235af0 vm_swapout_map_deactivate_pages() at vm_swapout_map_deactivate_pages+0x1b3/frame 0xfffffe00d3235b40 vm_daemon() at vm_daemon+0x85a/frame 0xfffffe00d3235bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d3235bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d3235bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00e3f95698 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00d32352a0 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00d32352b0 db_get_value() at db_get_value+0x4c/frame 0xfffffe00d32352f0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00d3235380 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00d32353a0 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00d3235440 db_command() at db_command+0x25c/frame 0xfffffe00d3235510 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00d32355b0 db_command() at db_command+0x25c/frame 0xfffffe00d3235680 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00d3235690 db_trap() at db_trap+0xe8/frame 0xfffffe00d3235720 kdb_trap() at kdb_trap+0x157/frame 0xfffffe00d32357a0 trap() at trap+0x7b7/frame 0xfffffe00d32358d0 calltrap() at calltrap+0x8/frame 0xfffffe00d32358d0 --- trap 0x3, rip = 0xffffffff80c0ed07, rsp = 0xfffffe00d32359a0, rbp = 0xfffffe00d32359b0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00d32359b0 vpanic() at vpanic+0x19a/frame 0xfffffe00d3235a10 panic() at panic+0x43/frame 0xfffffe00d3235a70 pmap_page_exists_quick() at pmap_page_exists_quick+0x17a/frame 0xfffffe00d3235aa0 vm_swapout_object_deactivate_pages() at vm_swapout_object_deactivate_pages+0x13b/frame 0xfffffe00d3235af0 vm_swapout_map_deactivate_pages() at vm_swapout_map_deactivate_pages+0x1b3/frame 0xfffffe00d3235b40 vm_daemon() at vm_daemon+0x85a/frame 0xfffffe00d3235bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d3235bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d3235bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sh pid 2347 tid 100162 td 0xfffff800076316e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e1d54690 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00d3235010 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00d3235020 trap() at trap+0x56/frame 0xfffffe00d3235150 calltrap() at calltrap+0x8/frame 0xfffffe00d3235150 --- trap 0xc, rip = 0xffffffff810354c0, rsp = 0xfffffe00d3235220, rbp = 0xfffffe00d32352b0 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe00d32352b0 db_get_value() at db_get_value+0x32/frame 0xfffffe00d32352f0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00d3235380 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00d32353a0 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00d3235440 db_command() at db_command+0x25c/frame 0xfffffe00d3235510 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00d32355b0 db_command() at db_command+0x25c/frame 0xfffffe00d3235680 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00d3235690 db_trap() at db_trap+0xe8/frame 0xfffffe00d3235720 kdb_trap() at kdb_trap+0x157/frame 0xfffffe00d32357a0 trap() at trap+0x7b7/frame 0xfffffe00d32358d0 calltrap() at calltrap+0x8/frame 0xfffffe00d32358d0 --- trap 0x3, rip = 0xffffffff80c0ed07, rsp = 0xfffffe00d32359a0, rbp = 0xfffffe00d32359b0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00d32359b0 vpanic() at vpanic+0x19a/frame 0xfffffe00d3235a10 panic() at panic+0x43/frame 0xfffffe00d3235a70 pmap_page_exists_quick() at pmap_page_exists_quick+0x17a/frame 0xfffffe00d3235aa0 vm_swapout_object_deactivate_pages() at vm_swapout_object_deactivate_pages+0x13b/frame 0xfffffe00d3235af0 vm_swapout_map_deactivate_pages() at vm_swapout_map_deactivate_pages+0x1b3/frame 0xfffffe00d3235b40 vm_daemon() at vm_daemon+0x85a/frame 0xfffffe00d3235bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d3235bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d3235bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00e1d54698 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00d32352a0 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00d32352b0 db_get_value() at db_get_value+0x4c/frame 0xfffffe00d32352f0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00d3235380 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00d32353a0 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00d3235440 db_command() at db_command+0x25c/frame 0xfffffe00d3235510 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00d32355b0 db_command() at db_command+0x25c/frame 0xfffffe00d3235680 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00d3235690 db_trap() at db_trap+0xe8/frame 0xfffffe00d3235720 kdb_trap() at kdb_trap+0x157/frame 0xfffffe00d32357a0 trap() at trap+0x7b7/frame 0xfffffe00d32358d0 calltrap() at calltrap+0x8/frame 0xfffffe00d32358d0 --- trap 0x3, rip = 0xffffffff80c0ed07, rsp = 0xfffffe00d32359a0, rbp = 0xfffffe00d32359b0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00d32359b0 vpanic() at vpanic+0x19a/frame 0xfffffe00d3235a10 panic() at panic+0x43/frame 0xfffffe00d3235a70 pmap_page_exists_quick() at pmap_page_exists_quick+0x17a/frame 0xfffffe00d3235aa0 vm_swapout_object_deactivate_pages() at vm_swapout_object_deactivate_pages+0x13b/frame 0xfffffe00d3235af0 vm_swapout_map_deactivate_pages() at vm_swapout_map_deactivate_pages+0x1b3/frame 0xfffffe00d3235b40 vm_daemon() at vm_daemon+0x85a/frame 0xfffffe00d3235bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d3235bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d3235bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bash pid 2346 tid 100188 td 0xfffff800076f36e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e3e226b0 mi_switch() at mi_switch+0x166/frame 0xfffffe00e3e226f0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e3e22730 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe00e3e22790 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3e227c0 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e3e22820 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e3e22860 kern_select() at kern_select+0x962/frame 0xfffffe00e3e22a40 sys_pselect() at sys_pselect+0x127/frame 0xfffffe00e3e22ac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00e3e22bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3e22bf0 --- syscall (522, FreeBSD ELF64, sys_pselect), rip = 0x800517a3a, rsp = 0x7fffffffd638, rbp = 0x7fffffffd700 --- Tracing command csh pid 2344 tid 100174 td 0xfffff800076f4000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e1da8880 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00d3235010 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00d3235020 trap() at trap+0x56/frame 0xfffffe00d3235150 calltrap() at calltrap+0x8/frame 0xfffffe00d3235150 --- trap 0xc, rip = 0xffffffff810354c0, rsp = 0xfffffe00d3235220, rbp = 0xfffffe00d32352b0 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe00d32352b0 db_get_value() at db_get_value+0x32/frame 0xfffffe00d32352f0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00d3235380 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00d32353a0 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00d3235440 db_command() at db_command+0x25c/frame 0xfffffe00d3235510 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00d32355b0 db_command() at db_command+0x25c/frame 0xfffffe00d3235680 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00d3235690 db_trap() at db_trap+0xe8/frame 0xfffffe00d3235720 kdb_trap() at kdb_trap+0x157/frame 0xfffffe00d32357a0 trap() at trap+0x7b7/frame 0xfffffe00d32358d0 calltrap() at calltrap+0x8/frame 0xfffffe00d32358d0 --- trap 0x3, rip = 0xffffffff80c0ed07, rsp = 0xfffffe00d32359a0, rbp = 0xfffffe00d32359b0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00d32359b0 vpanic() at vpanic+0x19a/frame 0xfffffe00d3235a10 panic() at panic+0x43/frame 0xfffffe00d3235a70 pmap_page_exists_quick() at pmap_page_exists_quick+0x17a/frame 0xfffffe00d3235aa0 vm_swapout_object_deactivate_pages() at vm_swapout_object_deactivate_pages+0x13b/frame 0xfffffe00d3235af0 vm_swapout_map_deactivate_pages() at vm_swapout_map_deactivate_pages+0x1b3/frame 0xfffffe00d3235b40 vm_daemon() at vm_daemon+0x85a/frame 0xfffffe00d3235bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d3235bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d3235bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00e1da8888 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00d32352a0 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00d32352b0 db_get_value() at db_get_value+0x4c/frame 0xfffffe00d32352f0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00d3235380 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00d32353a0 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00d3235440 db_command() at db_command+0x25c/frame 0xfffffe00d3235510 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00d32355b0 db_command() at db_command+0x25c/frame 0xfffffe00d3235680 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00d3235690 db_trap() at db_trap+0xe8/frame 0xfffffe00d3235720 kdb_trap() at kdb_trap+0x157/frame 0xfffffe00d32357a0 trap() at trap+0x7b7/frame 0xfffffe00d32358d0 calltrap() at calltrap+0x8/frame 0xfffffe00d32358d0 --- trap 0x3, rip = 0xffffffff80c0ed07, rsp = 0xfffffe00d32359a0, rbp = 0xfffffe00d32359b0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00d32359b0 vpanic() at vpanic+0x19a/frame 0xfffffe00d3235a10 panic() at panic+0x43/frame 0xfffffe00d3235a70 pmap_page_exists_quick() at pmap_page_exists_quick+0x17a/frame 0xfffffe00d3235aa0 vm_swapout_object_deactivate_pages() at vm_swapout_object_deactivate_pages+0x13b/frame 0xfffffe00d3235af0 vm_swapout_map_deactivate_pages() at vm_swapout_map_deactivate_pages+0x1b3/frame 0xfffffe00d3235b40 vm_daemon() at vm_daemon+0x85a/frame 0xfffffe00d3235bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d3235bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d3235bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command su pid 2343 tid 100199 td 0xfffff80004992000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e1d40690 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00d3235010 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00d3235020 trap() at trap+0x56/frame 0xfffffe00d3235150 calltrap() at calltrap+0x8/frame 0xfffffe00d3235150 --- trap 0xc, rip = 0xffffffff810354c0, rsp = 0xfffffe00d3235220, rbp = 0xfffffe00d32352b0 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe00d32352b0 db_get_value() at db_get_value+0x32/frame 0xfffffe00d32352f0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00d3235380 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00d32353a0 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00d3235440 db_command() at db_command+0x25c/frame 0xfffffe00d3235510 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00d32355b0 db_command() at db_command+0x25c/frame 0xfffffe00d3235680 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00d3235690 db_trap() at db_trap+0xe8/frame 0xfffffe00d3235720 kdb_trap() at kdb_trap+0x157/frame 0xfffffe00d32357a0 trap() at trap+0x7b7/frame 0xfffffe00d32358d0 calltrap() at calltrap+0x8/frame 0xfffffe00d32358d0 --- trap 0x3, rip = 0xffffffff80c0ed07, rsp = 0xfffffe00d32359a0, rbp = 0xfffffe00d32359b0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00d32359b0 vpanic() at vpanic+0x19a/frame 0xfffffe00d3235a10 panic() at panic+0x43/frame 0xfffffe00d3235a70 pmap_page_exists_quick() at pmap_page_exists_quick+0x17a/frame 0xfffffe00d3235aa0 vm_swapout_object_deactivate_pages() at vm_swapout_object_deactivate_pages+0x13b/frame 0xfffffe00d3235af0 vm_swapout_map_deactivate_pages() at vm_swapout_map_deactivate_pages+0x1b3/frame 0xfffffe00d3235b40 vm_daemon() at vm_daemon+0x85a/frame 0xfffffe00d3235bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d3235bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d3235bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00e1d40698 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00d32352a0 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00d32352b0 db_get_value() at db_get_value+0x4c/frame 0xfffffe00d32352f0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00d3235380 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00d32353a0 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00d3235440 db_command() at db_command+0x25c/frame 0xfffffe00d3235510 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00d32355b0 db_command() at db_command+0x25c/frame 0xfffffe00d3235680 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00d3235690 db_trap() at db_trap+0xe8/frame 0xfffffe00d3235720 kdb_trap() at kdb_trap+0x157/frame 0xfffffe00d32357a0 trap() at trap+0x7b7/frame 0xfffffe00d32358d0 calltrap() at calltrap+0x8/frame 0xfffffe00d32358d0 --- trap 0x3, rip = 0xffffffff80c0ed07, rsp = 0xfffffe00d32359a0, rbp = 0xfffffe00d32359b0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00d32359b0 vpanic() at vpanic+0x19a/frame 0xfffffe00d3235a10 panic() at panic+0x43/frame 0xfffffe00d3235a70 pmap_page_exists_quick() at pmap_page_exists_quick+0x17a/frame 0xfffffe00d3235aa0 vm_swapout_object_deactivate_pages() at vm_swapout_object_deactivate_pages+0x13b/frame 0xfffffe00d3235af0 vm_swapout_map_deactivate_pages() at vm_swapout_map_deactivate_pages+0x1b3/frame 0xfffffe00d3235b40 vm_daemon() at vm_daemon+0x85a/frame 0xfffffe00d3235bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d3235bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d3235bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bash pid 2338 tid 100165 td 0xfffff80003d3d000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e1d63690 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00d3235010 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00d3235020 trap() at trap+0x56/frame 0xfffffe00d3235150 calltrap() at calltrap+0x8/frame 0xfffffe00d3235150 --- trap 0xc, rip = 0xffffffff810354c0, rsp = 0xfffffe00d3235220, rbp = 0xfffffe00d32352b0 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe00d32352b0 db_get_value() at db_get_value+0x32/frame 0xfffffe00d32352f0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00d3235380 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00d32353a0 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00d3235440 db_command() at db_command+0x25c/frame 0xfffffe00d3235510 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00d32355b0 db_command() at db_command+0x25c/frame 0xfffffe00d3235680 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00d3235690 db_trap() at db_trap+0xe8/frame 0xfffffe00d3235720 kdb_trap() at kdb_trap+0x157/frame 0xfffffe00d32357a0 trap() at trap+0x7b7/frame 0xfffffe00d32358d0 calltrap() at calltrap+0x8/frame 0xfffffe00d32358d0 --- trap 0x3, rip = 0xffffffff80c0ed07, rsp = 0xfffffe00d32359a0, rbp = 0xfffffe00d32359b0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00d32359b0 vpanic() at vpanic+0x19a/frame 0xfffffe00d3235a10 panic() at panic+0x43/frame 0xfffffe00d3235a70 pmap_page_exists_quick() at pmap_page_exists_quick+0x17a/frame 0xfffffe00d3235aa0 vm_swapout_object_deactivate_pages() at vm_swapout_object_deactivate_pages+0x13b/frame 0xfffffe00d3235af0 vm_swapout_map_deactivate_pages() at vm_swapout_map_deactivate_pages+0x1b3/frame 0xfffffe00d3235b40 vm_daemon() at vm_daemon+0x85a/frame 0xfffffe00d3235bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d3235bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d3235bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00e1d63698 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00d32352a0 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00d32352b0 db_get_value() at db_get_value+0x4c/frame 0xfffffe00d32352f0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00d3235380 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00d32353a0 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00d3235440 db_command() at db_command+0x25c/frame 0xfffffe00d3235510 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00d32355b0 db_command() at db_command+0x25c/frame 0xfffffe00d3235680 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00d3235690 db_trap() at db_trap+0xe8/frame 0xfffffe00d3235720 kdb_trap() at kdb_trap+0x157/frame 0xfffffe00d32357a0 trap() at trap+0x7b7/frame 0xfffffe00d32358d0 calltrap() at calltrap+0x8/frame 0xfffffe00d32358d0 --- trap 0x3, rip = 0xffffffff80c0ed07, rsp = 0xfffffe00d32359a0, rbp = 0xfffffe00d32359b0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00d32359b0 vpanic() at vpanic+0x19a/frame 0xfffffe00d3235a10 panic() at panic+0x43/frame 0xfffffe00d3235a70 pmap_page_exists_quick() at pmap_page_exists_quick+0x17a/frame 0xfffffe00d3235aa0 vm_swapout_object_deactivate_pages() at vm_swapout_object_deactivate_pages+0x13b/frame 0xfffffe00d3235af0 vm_swapout_map_deactivate_pages() at vm_swapout_map_deactivate_pages+0x1b3/frame 0xfffffe00d3235b40 vm_daemon() at vm_daemon+0x85a/frame 0xfffffe00d3235bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d3235bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d3235bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sshd pid 2337 tid 100143 td 0xfffff80003d3c000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e1ce96f0 mi_switch() at mi_switch+0x166/frame 0xfffffe00e1ce9730 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e1ce9770 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe00e1ce97d0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e1ce9800 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e1ce9860 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e1ce98a0 kern_select() at kern_select+0x962/frame 0xfffffe00e1ce9a80 sys_select() at sys_select+0x56/frame 0xfffffe00e1ce9ac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00e1ce9bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e1ce9bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8008f5b6a, rsp = 0x7fffffffa578, rbp = 0x7fffffffa5b0 --- Tracing command sshd pid 2334 tid 100160 td 0xfffff800076f46e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e1d4a770 mi_switch() at mi_switch+0x166/frame 0xfffffe00e1d4a7b0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e1d4a7f0 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe00e1d4a850 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e1d4a880 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e1d4a8e0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e1d4a920 kern_poll() at kern_poll+0x48b/frame 0xfffffe00e1d4aaa0 sys_poll() at sys_poll+0x50/frame 0xfffffe00e1d4aac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00e1d4abf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e1d4abf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x80089913a, rsp = 0x7fffffffe5d8, rbp = 0x7fffffffe610 --- Tracing command csh pid 2330 tid 100201 td 0xfffff800076e86e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e3e82750 mi_switch() at mi_switch+0x166/frame 0xfffffe00e3e82790 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e3e827d0 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe00e3e82830 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3e82860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e3e828c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e3e828f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e3e82950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e3e82980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e3e829e0 dofileread() at dofileread+0x81/frame 0xfffffe00e3e82a30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e3e82a70 sys_read() at sys_read+0x83/frame 0xfffffe00e3e82ac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00e3e82bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3e82bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004fbb8a, rsp = 0x7fffffffe1e8, rbp = 0x7fffffffe210 --- Tracing command login pid 2329 tid 100212 td 0xfffff80007d206e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e3eb9690 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00d3235010 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00d3235020 trap() at trap+0x56/frame 0xfffffe00d3235150 calltrap() at calltrap+0x8/frame 0xfffffe00d3235150 --- trap 0xc, rip = 0xffffffff810354c0, rsp = 0xfffffe00d3235220, rbp = 0xfffffe00d32352b0 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe00d32352b0 db_get_value() at db_get_value+0x32/frame 0xfffffe00d32352f0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00d3235380 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00d32353a0 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00d3235440 db_command() at db_command+0x25c/frame 0xfffffe00d3235510 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00d32355b0 db_command() at db_command+0x25c/frame 0xfffffe00d3235680 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00d3235690 db_trap() at db_trap+0xe8/frame 0xfffffe00d3235720 kdb_trap() at kdb_trap+0x157/frame 0xfffffe00d32357a0 trap() at trap+0x7b7/frame 0xfffffe00d32358d0 calltrap() at calltrap+0x8/frame 0xfffffe00d32358d0 --- trap 0x3, rip = 0xffffffff80c0ed07, rsp = 0xfffffe00d32359a0, rbp = 0xfffffe00d32359b0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00d32359b0 vpanic() at vpanic+0x19a/frame 0xfffffe00d3235a10 panic() at panic+0x43/frame 0xfffffe00d3235a70 pmap_page_exists_quick() at pmap_page_exists_quick+0x17a/frame 0xfffffe00d3235aa0 vm_swapout_object_deactivate_pages() at vm_swapout_object_deactivate_pages+0x13b/frame 0xfffffe00d3235af0 vm_swapout_map_deactivate_pages() at vm_swapout_map_deactivate_pages+0x1b3/frame 0xfffffe00d3235b40 vm_daemon() at vm_daemon+0x85a/frame 0xfffffe00d3235bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d3235bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d3235bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00e3eb9698 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00d32352a0 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00d32352b0 db_get_value() at db_get_value+0x4c/frame 0xfffffe00d32352f0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00d3235380 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00d32353a0 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00d3235440 db_command() at db_command+0x25c/frame 0xfffffe00d3235510 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00d32355b0 db_command() at db_command+0x25c/frame 0xfffffe00d3235680 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00d3235690 db_trap() at db_trap+0xe8/frame 0xfffffe00d3235720 kdb_trap() at kdb_trap+0x157/frame 0xfffffe00d32357a0 trap() at trap+0x7b7/frame 0xfffffe00d32358d0 calltrap() at calltrap+0x8/frame 0xfffffe00d32358d0 --- trap 0x3, rip = 0xffffffff80c0ed07, rsp = 0xfffffe00d32359a0, rbp = 0xfffffe00d32359b0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00d32359b0 vpanic() at vpanic+0x19a/frame 0xfffffe00d3235a10 panic() at panic+0x43/frame 0xfffffe00d3235a70 pmap_page_exists_quick() at pmap_page_exists_quick+0x17a/frame 0xfffffe00d3235aa0 vm_swapout_object_deactivate_pages() at vm_swapout_object_deactivate_pages+0x13b/frame 0xfffffe00d3235af0 vm_swapout_map_deactivate_pages() at vm_swapout_map_deactivate_pages+0x1b3/frame 0xfffffe00d3235b40 vm_daemon() at vm_daemon+0x85a/frame 0xfffffe00d3235bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d3235bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d3235bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command getty pid 2328 tid 100211 td 0xfffff80116118000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e3eb4750 mi_switch() at mi_switch+0x166/frame 0xfffffe00e3eb4790 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e3eb47d0 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe00e3eb4830 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3eb4860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e3eb48c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e3eb48f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e3eb4950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e3eb4980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e3eb49e0 dofileread() at dofileread+0x81/frame 0xfffffe00e3eb4a30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e3eb4a70 sys_read() at sys_read+0x83/frame 0xfffffe00e3eb4ac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00e3eb4bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3eb4bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800433b8a, rsp = 0x7fffffffebd8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2327 tid 100210 td 0xfffff801161186e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e3eaf750 mi_switch() at mi_switch+0x166/frame 0xfffffe00e3eaf790 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e3eaf7d0 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe00e3eaf830 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3eaf860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e3eaf8c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e3eaf8f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e3eaf950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e3eaf980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e3eaf9e0 dofileread() at dofileread+0x81/frame 0xfffffe00e3eafa30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e3eafa70 sys_read() at sys_read+0x83/frame 0xfffffe00e3eafac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00e3eafbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3eafbf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800433b8a, rsp = 0x7fffffffebd8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2326 tid 100209 td 0xfffff80007e3b6e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e3eaa750 mi_switch() at mi_switch+0x166/frame 0xfffffe00e3eaa790 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e3eaa7d0 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe00e3eaa830 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3eaa860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e3eaa8c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e3eaa8f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e3eaa950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e3eaa980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e3eaa9e0 dofileread() at dofileread+0x81/frame 0xfffffe00e3eaaa30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e3eaaa70 sys_read() at sys_read+0x83/frame 0xfffffe00e3eaaac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00e3eaabf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3eaabf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800433b8a, rsp = 0x7fffffffebd8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2325 tid 100208 td 0xfffff801161d2000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e3ea5750 mi_switch() at mi_switch+0x166/frame 0xfffffe00e3ea5790 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e3ea57d0 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe00e3ea5830 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3ea5860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e3ea58c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e3ea58f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e3ea5950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e3ea5980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e3ea59e0 dofileread() at dofileread+0x81/frame 0xfffffe00e3ea5a30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e3ea5a70 sys_read() at sys_read+0x83/frame 0xfffffe00e3ea5ac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00e3ea5bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3ea5bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800433b8a, rsp = 0x7fffffffebd8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2324 tid 100207 td 0xfffff801161d26e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e3ea0750 mi_switch() at mi_switch+0x166/frame 0xfffffe00e3ea0790 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e3ea07d0 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe00e3ea0830 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3ea0860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e3ea08c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e3ea08f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e3ea0950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e3ea0980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e3ea09e0 dofileread() at dofileread+0x81/frame 0xfffffe00e3ea0a30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e3ea0a70 sys_read() at sys_read+0x83/frame 0xfffffe00e3ea0ac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00e3ea0bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3ea0bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800433b8a, rsp = 0x7fffffffebd8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2323 tid 100206 td 0xfffff801161d1000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e3e9b750 mi_switch() at mi_switch+0x166/frame 0xfffffe00e3e9b790 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e3e9b7d0 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe00e3e9b830 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3e9b860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e3e9b8c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e3e9b8f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e3e9b950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e3e9b980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e3e9b9e0 dofileread() at dofileread+0x81/frame 0xfffffe00e3e9ba30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e3e9ba70 sys_read() at sys_read+0x83/frame 0xfffffe00e3e9bac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00e3e9bbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3e9bbf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800433b8a, rsp = 0x7fffffffebd8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2322 tid 100156 td 0xfffff8000773c6e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e1d2a750 mi_switch() at mi_switch+0x166/frame 0xfffffe00e1d2a790 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e1d2a7d0 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe00e1d2a830 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e1d2a860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e1d2a8c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e1d2a8f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e1d2a950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e1d2a980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e1d2a9e0 dofileread() at dofileread+0x81/frame 0xfffffe00e1d2aa30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e1d2aa70 sys_read() at sys_read+0x83/frame 0xfffffe00e1d2aac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00e1d2abf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e1d2abf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800433b8a, rsp = 0x7fffffffebd8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2321 tid 100191 td 0xfffff801161d16e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e3e49750 mi_switch() at mi_switch+0x166/frame 0xfffffe00e3e49790 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e3e497d0 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe00e3e49830 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3e49860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e3e498c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e3e498f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e3e49950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e3e49980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e3e499e0 dofileread() at dofileread+0x81/frame 0xfffffe00e3e49a30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e3e49a70 sys_read() at sys_read+0x83/frame 0xfffffe00e3e49ac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00e3e49bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3e49bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800433b8a, rsp = 0x7fffffffebd8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2320 tid 100142 td 0xfffff800040606e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e1ce4750 mi_switch() at mi_switch+0x166/frame 0xfffffe00e1ce4790 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e1ce47d0 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe00e1ce4830 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e1ce4860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e1ce48c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e1ce48f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e1ce4950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e1ce4980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e1ce49e0 dofileread() at dofileread+0x81/frame 0xfffffe00e1ce4a30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e1ce4a70 sys_read() at sys_read+0x83/frame 0xfffffe00e1ce4ac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00e1ce4bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e1ce4bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800433b8a, rsp = 0x7fffffffebd8, rbp = 0x7fffffffec10 --- Tracing command cron pid 2274 tid 100144 td 0xfffff8000605e6e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e1cee830 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00d3235010 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00d3235020 trap() at trap+0x56/frame 0xfffffe00d3235150 calltrap() at calltrap+0x8/frame 0xfffffe00d3235150 --- trap 0xc, rip = 0xffffffff810354c0, rsp = 0xfffffe00d3235220, rbp = 0xfffffe00d32352b0 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe00d32352b0 db_get_value() at db_get_value+0x32/frame 0xfffffe00d32352f0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00d3235380 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00d32353a0 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00d3235440 db_command() at db_command+0x25c/frame 0xfffffe00d3235510 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00d32355b0 db_command() at db_command+0x25c/frame 0xfffffe00d3235680 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00d3235690 db_trap() at db_trap+0xe8/frame 0xfffffe00d3235720 kdb_trap() at kdb_trap+0x157/frame 0xfffffe00d32357a0 trap() at trap+0x7b7/frame 0xfffffe00d32358d0 calltrap() at calltrap+0x8/frame 0xfffffe00d32358d0 --- trap 0x3, rip = 0xffffffff80c0ed07, rsp = 0xfffffe00d32359a0, rbp = 0xfffffe00d32359b0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00d32359b0 vpanic() at vpanic+0x19a/frame 0xfffffe00d3235a10 panic() at panic+0x43/frame 0xfffffe00d3235a70 pmap_page_exists_quick() at pmap_page_exists_quick+0x17a/frame 0xfffffe00d3235aa0 vm_swapout_object_deactivate_pages() at vm_swapout_object_deactivate_pages+0x13b/frame 0xfffffe00d3235af0 vm_swapout_map_deactivate_pages() at vm_swapout_map_deactivate_pages+0x1b3/frame 0xfffffe00d3235b40 vm_daemon() at vm_daemon+0x85a/frame 0xfffffe00d3235bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d3235bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d3235bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- *** error reading from address fffffe00e1cee838 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00d32352a0 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00d32352b0 db_get_value() at db_get_value+0x4c/frame 0xfffffe00d32352f0 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00d3235380 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00d32353a0 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00d3235440 db_command() at db_command+0x25c/frame 0xfffffe00d3235510 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00d32355b0 db_command() at db_command+0x25c/frame 0xfffffe00d3235680 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00d3235690 db_trap() at db_trap+0xe8/frame 0xfffffe00d3235720 kdb_trap() at kdb_trap+0x157/frame 0xfffffe00d32357a0 trap() at trap+0x7b7/frame 0xfffffe00d32358d0 calltrap() at calltrap+0x8/frame 0xfffffe00d32358d0 --- trap 0x3, rip = 0xffffffff80c0ed07, rsp = 0xfffffe00d32359a0, rbp = 0xfffffe00d32359b0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00d32359b0 vpanic() at vpanic+0x19a/frame 0xfffffe00d3235a10 panic() at panic+0x43/frame 0xfffffe00d3235a70 pmap_page_exists_quick() at pmap_page_exists_quick+0x17a/frame 0xfffffe00d3235aa0 vm_swapout_object_deactivate_pages() at vm_swapout_object_deactivate_pages+0x13b/frame 0xfffffe00d3235af0 vm_swapout_map_deactivate_pages() at vm_swapout_map_deactivate_pages+0x1b3/frame 0xfffffe00d3235b40 vm_daemon() at vm_daemon+0x85a/frame 0xfffffe00d3235bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d3235bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d3235bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sshd pid 2270 tid 100200 td 0xfffff80116a196e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e3e7d6f0 mi_switch() at mi_switch+0x166/frame 0xfffffe00e3e7d730 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e3e7d770 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe00e3e7d7d0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3e7d800 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e3e7d860 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e3e7d8a0 kern_select() at kern_select+0x962/frame 0xfffffe00e3e7da80 sys_select() at sys_select+0x56/frame 0xfffffe00e3e7dac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00e3e7dbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3e7dbf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8008f5b6a, rsp = 0x7fffffffe668, rbp = 0x7fffffffe6a0 --- Tracing command ntpd pid 2241 tid 100163 td 0xfffff8001e111000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e1d596f0 mi_switch() at mi_switch+0x166/frame 0xfffffe00e1d59730 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e1d59770 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe00e1d597d0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e1d59800 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e1d59860 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e1d598a0 kern_select() at kern_select+0x962/frame 0xfffffe00e1d59a80 sys_select() at sys_select+0x56/frame 0xfffffe00e1d59ac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00e1d59bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e1d59bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800827b6a, rsp = 0x7fffffffdf18, rbp = 0x7fffffffdf50 --- Tracing command ntpd pid 2241 tid 124717 td 0xfffff8079515e6e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe033afdf7e0 mi_switch() at mi_switch+0x166/frame 0xfffffe033afdf820 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe033afdf860 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe033afdf8c0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe033afdf8f0 _sleep() at _sleep+0x2c3/frame 0xfffffe033afdf990 umtxq_sleep() at umtxq_sleep+0x19e/frame 0xfffffe033afdf9f0 do_sem2_wait() at do_sem2_wait+0x422/frame 0xfffffe033afdfa70 __umtx_op_sem2_wait() at __umtx_op_sem2_wait+0x76/frame 0xfffffe033afdfac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe033afdfbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe033afdfbf0 --- syscall (454, FreeBSD ELF64, sys__umtx_op), rip = 0x80071df7a, rsp = 0x7fffdff7bed8, rbp = 0x7fffdff7bf50 --- Tracing command rpc.lockd pid 2178 tid 100170 td 0xfffff800076e5000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e1d94610 mi_switch() at mi_switch+0x166/frame 0xfffffe00e1d94650 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e1d94690 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe00e1d946f0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00e1d94730 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00e1d947a0 svc_run_internal() at svc_run_internal+0xabe/frame 0xfffffe00e1d948e0 svc_run() at svc_run+0x253/frame 0xfffffe00e1d94940 sys_nlm_syscall() at sys_nlm_syscall+0x745/frame 0xfffffe00e1d94ac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00e1d94bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e1d94bf0 --- syscall (154, FreeBSD ELF64, sys_nlm_syscall), rip = 0x8002f54aa, rsp = 0x7fffffffec08, rbp = 0x7fffffffecc0 --- Tracing command rpc.statd pid 2175 tid 100155 td 0xfffff80007734000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e1d256d0 mi_switch() at mi_switch+0x166/frame 0xfffffe00e1d25710 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e1d25750 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe00e1d257b0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00e1d257f0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00e1d25860 seltdwait() at seltdwait+0x6b/frame 0xfffffe00e1d258a0 kern_select() at kern_select+0x962/frame 0xfffffe00e1d25a80 sys_select() at sys_select+0x56/frame 0xfffffe00e1d25ac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00e1d25bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e1d25bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800427b6a, rsp = 0x7fffffffeaa8, rbp = 0x7fffffffebf0 --- Tracing command watchdogd pid 2129 tid 100194 td 0xfffff80007e926e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e3e58830 mi_switch() at mi_switch+0x166/frame 0xfffffe00e3e58870 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e3e588b0 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe00e3e58910 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00e3e58950 _sleep() at _sleep+0x258/frame 0xfffffe00e3e589f0 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe00e3e58a80 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00e3e58ac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00e3e58bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3e58bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003c1a7a, rsp = 0x7fffffffea98, rbp = 0x7fffffffeae0 --- Tracing command rpcbind pid 2050 tid 100173 td 0xfffff80007e8b6e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e1da3750 mi_switch() at mi_switch+0x166/frame 0xfffffe00e1da3790 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e1da37d0 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe00e1da3830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00e1da3870 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00e1da38e0 seltdwait() at seltdwait+0x6b/frame 0xfffffe00e1da3920 kern_poll() at kern_poll+0x48b/frame 0xfffffe00e1da3aa0 sys_poll() at sys_poll+0x50/frame 0xfffffe00e1da3ac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00e1da3bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e1da3bf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003cf13a, rsp = 0x7fffffffca38, rbp = 0x7fffffffec50 --- Tracing command syslogd pid 2040 tid 100153 td 0xfffff800048fd000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e1d1b6f0 mi_switch() at mi_switch+0x166/frame 0xfffffe00e1d1b730 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e1d1b770 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe00e1d1b7d0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e1d1b800 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e1d1b860 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e1d1b8a0 kern_select() at kern_select+0x962/frame 0xfffffe00e1d1ba80 sys_select() at sys_select+0x56/frame 0xfffffe00e1d1bac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00e1d1bbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e1d1bbf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800438b6a, rsp = 0x7fffffffe748, rbp = 0x7fffffffecc0 --- Tracing command devd pid 1969 tid 100150 td 0xfffff800039e86e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e1d0c6d0 mi_switch() at mi_switch+0x166/frame 0xfffffe00e1d0c710 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e1d0c750 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe00e1d0c7b0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00e1d0c7f0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00e1d0c860 seltdwait() at seltdwait+0x6b/frame 0xfffffe00e1d0c8a0 kern_select() at kern_select+0x962/frame 0xfffffe00e1d0ca80 sys_select() at sys_select+0x56/frame 0xfffffe00e1d0cac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00e1d0cbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e1d0cbf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x2f5d1a, rsp = 0x7fffffffcb58, rbp = 0x7fffffffece0 --- Tracing command dhclient pid 1964 tid 100193 td 0xfffff80116a15000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e3e53750 mi_switch() at mi_switch+0x166/frame 0xfffffe00e3e53790 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e3e537d0 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe00e3e53830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00e3e53870 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00e3e538e0 seltdwait() at seltdwait+0x6b/frame 0xfffffe00e3e53920 kern_poll() at kern_poll+0x48b/frame 0xfffffe00e3e53aa0 sys_poll() at sys_poll+0x50/frame 0xfffffe00e3e53ac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00e3e53bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3e53bf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003f213a, rsp = 0x7fffffffec28, rbp = 0x7fffffffec60 --- Tracing command dhclient pid 1920 tid 100147 td 0xfffff80004991000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e1cfd770 mi_switch() at mi_switch+0x166/frame 0xfffffe00e1cfd7b0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e1cfd7f0 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe00e1cfd850 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e1cfd880 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e1cfd8e0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e1cfd920 kern_poll() at kern_poll+0x48b/frame 0xfffffe00e1cfdaa0 sys_poll() at sys_poll+0x50/frame 0xfffffe00e1cfdac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00e1cfdbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e1cfdbf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003f213a, rsp = 0x7fffffffec38, rbp = 0x7fffffffec60 --- Tracing command dhclient pid 1917 tid 100185 td 0xfffff8000758d6e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e3e136f0 mi_switch() at mi_switch+0x166/frame 0xfffffe00e3e13730 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e3e13770 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe00e3e137d0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00e3e13800 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e3e13860 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e3e138a0 kern_select() at kern_select+0x962/frame 0xfffffe00e3e13a80 sys_select() at sys_select+0x56/frame 0xfffffe00e3e13ac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00e3e13bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e3e13bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80044eb6a, rsp = 0x7fffffffe9e8, rbp = 0x7fffffffeaa0 --- Tracing command vnlru pid 34 tid 100141 td 0xfffff80007a3d000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00da9fd9c0 mi_switch() at mi_switch+0x166/frame 0xfffffe00da9fda00 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00da9fda40 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00da9fda80 _sleep() at _sleep+0x26c/frame 0xfffffe00da9fdb20 vnlru_proc() at vnlru_proc+0x149/frame 0xfffffe00da9fdbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00da9fdbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00da9fdbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command syncer pid 33 tid 100140 td 0xfffff80007a3d6e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00da9f89f0 mi_switch() at mi_switch+0x166/frame 0xfffffe00da9f8a30 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00da9f8a70 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00da9f8ab0 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x184/frame 0xfffffe00da9f8b20 sched_sync() at sched_sync+0x5ce/frame 0xfffffe00da9f8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00da9f8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00da9f8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100130 td 0xfffff8000758f000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00d3246a00 mi_switch() at mi_switch+0x166/frame 0xfffffe00d3246a40 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00d3246a80 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00d3246ac0 _sleep() at _sleep+0x26c/frame 0xfffffe00d3246b60 buf_daemon() at buf_daemon+0x112/frame 0xfffffe00d3246bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d3246bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d3246bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100133 td 0xfffff800076346e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00d33f59f0 mi_switch() at mi_switch+0x166/frame 0xfffffe00d33f5a30 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00d33f5a70 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00d33f5ab0 _sleep() at _sleep+0x26c/frame 0xfffffe00d33f5b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00d33f5bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d33f5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d33f5bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100134 td 0xfffff80007634000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00d33fa9f0 mi_switch() at mi_switch+0x166/frame 0xfffffe00d33faa30 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00d33faa70 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00d33faab0 _sleep() at _sleep+0x26c/frame 0xfffffe00d33fab50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00d33fabb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d33fabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d33fabf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100135 td 0xfffff800076406e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00d33ff9f0 mi_switch() at mi_switch+0x166/frame 0xfffffe00d33ffa30 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00d33ffa70 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00d33ffab0 _sleep() at _sleep+0x26c/frame 0xfffffe00d33ffb50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00d33ffbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d33ffbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d33ffbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100136 td 0xfffff80007640000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00da8e49f0 mi_switch() at mi_switch+0x166/frame 0xfffffe00da8e4a30 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00da8e4a70 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00da8e4ab0 _sleep() at _sleep+0x26c/frame 0xfffffe00da8e4b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00da8e4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00da8e4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00da8e4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100137 td 0xfffff800077336e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00da9e99f0 mi_switch() at mi_switch+0x166/frame 0xfffffe00da9e9a30 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00da9e9a70 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00da9e9ab0 _sleep() at _sleep+0x26c/frame 0xfffffe00da9e9b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00da9e9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00da9e9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00da9e9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100138 td 0xfffff8000762f000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00da9ee9f0 mi_switch() at mi_switch+0x166/frame 0xfffffe00da9eea30 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00da9eea70 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00da9eeab0 _sleep() at _sleep+0x26c/frame 0xfffffe00da9eeb50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00da9eebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00da9eebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00da9eebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100139 td 0xfffff800076306e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00da9f39f0 mi_switch() at mi_switch+0x166/frame 0xfffffe00da9f3a30 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00da9f3a70 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00da9f3ab0 _sleep() at _sleep+0x26c/frame 0xfffffe00da9f3b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00da9f3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00da9f3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00da9f3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100152 td 0xfffff80007f796e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e1d16a20 mi_switch() at mi_switch+0x166/frame 0xfffffe00e1d16a60 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e1d16aa0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00e1d16ae0 _sleep() at _sleep+0x26c/frame 0xfffffe00e1d16b80 softdep_flush() at softdep_flush+0x175/frame 0xfffffe00e1d16bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e1d16bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e1d16bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100196 td 0xfffff80116de06e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00e3e6ea20 mi_switch() at mi_switch+0x166/frame 0xfffffe00e3e6ea60 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00e3e6eaa0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00e3e6eae0 _sleep() at _sleep+0x26c/frame 0xfffffe00e3e6eb80 softdep_flush() at softdep_flush+0x175/frame 0xfffffe00e3e6ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e3e6ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e3e6ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 105161 td 0xfffff8043763e000 sched_switch() at sched_switch+0x38f/frame 0xfffffe035f20ea20 mi_switch() at mi_switch+0x166/frame 0xfffffe035f20ea60 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe035f20eaa0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe035f20eae0 _sleep() at _sleep+0x26c/frame 0xfffffe035f20eb80 softdep_flush() at softdep_flush+0x175/frame 0xfffffe035f20ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe035f20ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe035f20ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vmdaemon pid 31 tid 100129 td 0xfffff8000758f6e0 (CPU 11) kdb_enter() at kdb_enter+0x37/frame 0xfffffe00d32359b0 vpanic() at vpanic+0x19a/frame 0xfffffe00d3235a10 panic() at panic+0x43/frame 0xfffffe00d3235a70 pmap_page_exists_quick() at pmap_page_exists_quick+0x17a/frame 0xfffffe00d3235aa0 vm_swapout_object_deactivate_pages() at vm_swapout_object_deactivate_pages+0x13b/frame 0xfffffe00d3235af0 vm_swapout_map_deactivate_pages() at vm_swapout_map_deactivate_pages+0x1b3/frame 0xfffffe00d3235b40 vm_daemon() at vm_daemon+0x85a/frame 0xfffffe00d3235bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d3235bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d3235bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100128 td 0xfffff8000758e000 (CPU 2) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e17fdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e17fdf0 trap() at trap+0x44/frame 0xfffffe003e17ff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e17ff20 --- trap 0x13, rip = 0xffffffff80f25537, rsp = 0xfffffe00d32247c0, rbp = 0xfffffe00d3224b70 --- vm_pageout_worker() at vm_pageout_worker+0xee7/frame 0xfffffe00d3224b70 vm_pageout() at vm_pageout+0x193/frame 0xfffffe00d3224bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d3224bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d3224bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100131 td 0xfffff80007733000 (CPU 5) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1a3dd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1a3df0 trap() at trap+0x44/frame 0xfffffe003e1a3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1a3f20 --- trap 0x13, rip = 0xffffffff80f25e7c, rsp = 0xfffffe00d33cb940, rbp = 0xfffffe00d33cbbb0 --- vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x35c/frame 0xfffffe00d33cbbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d33cbbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d33cbbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100132 td 0xfffff800077346e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00d33f0a20 mi_switch() at mi_switch+0x166/frame 0xfffffe00d33f0a60 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00d33f0aa0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00d33f0ae0 _sleep() at _sleep+0x26c/frame 0xfffffe00d33f0b80 uma_reclaim_worker() at uma_reclaim_worker+0xb8/frame 0xfffffe00d33f0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d33f0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d33f0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon1 pid 29 tid 100127 td 0xfffff800049916e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00d32139e0 mi_switch() at mi_switch+0x166/frame 0xfffffe00d3213a20 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00d3213a60 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00d3213a90 _sleep() at _sleep+0x2cd/frame 0xfffffe00d3213b30 enc_daemon() at enc_daemon+0xe1/frame 0xfffffe00d3213bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d3213bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d3213bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon0 pid 28 tid 100126 td 0xfffff80006002000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00d320e9e0 mi_switch() at mi_switch+0x166/frame 0xfffffe00d320ea20 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00d320ea60 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00d320ea90 _sleep() at _sleep+0x2cd/frame 0xfffffe00d320eb30 enc_daemon() at enc_daemon+0xe1/frame 0xfffffe00d320ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d320ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d320ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command rand_harvestq pid 27 tid 100120 td 0xfffff800075bc000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e5f09f0 mi_switch() at mi_switch+0x166/frame 0xfffffe003e5f0a30 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e5f0a70 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe003e5f0ab0 _sleep() at _sleep+0x26c/frame 0xfffffe003e5f0b50 random_kthread() at random_kthread+0x67/frame 0xfffffe003e5f0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e5f0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e5f0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sctp_iterator pid 26 tid 100119 td 0xfffff800075bc6e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e5dfa40 mi_switch() at mi_switch+0x166/frame 0xfffffe003e5dfa80 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e5dfac0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e5dfaf0 _sleep() at _sleep+0x2cd/frame 0xfffffe003e5dfb90 sctp_iterator_thread() at sctp_iterator_thread+0x59/frame 0xfffffe003e5dfbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e5dfbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e5dfbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod4 pid 25 tid 100118 td 0xfffff800060026e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e5cea10 mi_switch() at mi_switch+0x166/frame 0xfffffe003e5cea50 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e5cea90 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe003e5cead0 _sleep() at _sleep+0x26c/frame 0xfffffe003e5ceb70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe003e5cebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e5cebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e5cebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod3 pid 24 tid 100117 td 0xfffff800049f6000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e5c9a10 mi_switch() at mi_switch+0x166/frame 0xfffffe003e5c9a50 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e5c9a90 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe003e5c9ad0 _sleep() at _sleep+0x26c/frame 0xfffffe003e5c9b70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe003e5c9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e5c9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e5c9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod2 pid 23 tid 100116 td 0xfffff800049f66e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e5c4a10 mi_switch() at mi_switch+0x166/frame 0xfffffe003e5c4a50 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e5c4a90 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe003e5c4ad0 _sleep() at _sleep+0x26c/frame 0xfffffe003e5c4b70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe003e5c4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e5c4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e5c4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod1 pid 22 tid 100115 td 0xfffff800049f5000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e5bfa10 mi_switch() at mi_switch+0x166/frame 0xfffffe003e5bfa50 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e5bfa90 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe003e5bfad0 _sleep() at _sleep+0x26c/frame 0xfffffe003e5bfb70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe003e5bfbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e5bfbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e5bfbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100096 td 0xfffff8000448c6e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e548a60 mi_switch() at mi_switch+0x166/frame 0xfffffe003e548aa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e548ae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e548b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe003e548b70 usb_process() at usb_process+0xc3/frame 0xfffffe003e548bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e548bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e548bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100097 td 0xfffff8000448c000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e54da60 mi_switch() at mi_switch+0x166/frame 0xfffffe003e54daa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e54dae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e54db10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe003e54db70 usb_process() at usb_process+0xc3/frame 0xfffffe003e54dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e54dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e54dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100098 td 0xfffff8000405e6e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e552a60 mi_switch() at mi_switch+0x166/frame 0xfffffe003e552aa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e552ae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e552b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe003e552b70 usb_process() at usb_process+0xc3/frame 0xfffffe003e552bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e552bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e552bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100099 td 0xfffff80004907000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e557a60 mi_switch() at mi_switch+0x166/frame 0xfffffe003e557aa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e557ae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e557b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe003e557b70 usb_process() at usb_process+0xc3/frame 0xfffffe003e557bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e557bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e557bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100100 td 0xfffff800049086e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e55ca60 mi_switch() at mi_switch+0x166/frame 0xfffffe003e55caa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e55cae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e55cb10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe003e55cb70 usb_process() at usb_process+0xc3/frame 0xfffffe003e55cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e55cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e55cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100102 td 0xfffff800049096e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e566a60 mi_switch() at mi_switch+0x166/frame 0xfffffe003e566aa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e566ae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e566b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe003e566b70 usb_process() at usb_process+0xc3/frame 0xfffffe003e566bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e566bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e566bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100103 td 0xfffff80004909000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e56ba60 mi_switch() at mi_switch+0x166/frame 0xfffffe003e56baa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e56bae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e56bb10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe003e56bb70 usb_process() at usb_process+0xc3/frame 0xfffffe003e56bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e56bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e56bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100104 td 0xfffff800048fc6e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e570a60 mi_switch() at mi_switch+0x166/frame 0xfffffe003e570aa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e570ae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e570b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe003e570b70 usb_process() at usb_process+0xc3/frame 0xfffffe003e570bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e570bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e570bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100105 td 0xfffff800048fc000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e575a60 mi_switch() at mi_switch+0x166/frame 0xfffffe003e575aa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e575ae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e575b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe003e575b70 usb_process() at usb_process+0xc3/frame 0xfffffe003e575bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e575bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e575bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100106 td 0xfffff800048fd6e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e57aa60 mi_switch() at mi_switch+0x166/frame 0xfffffe003e57aaa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e57aae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e57ab10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe003e57ab70 usb_process() at usb_process+0xc3/frame 0xfffffe003e57abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e57abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e57abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100107 td 0xfffff800039e8000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e597a60 mi_switch() at mi_switch+0x166/frame 0xfffffe003e597aa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e597ae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e597b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe003e597b70 usb_process() at usb_process+0xc3/frame 0xfffffe003e597bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e597bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e597bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100108 td 0xfffff800039e96e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e59ca60 mi_switch() at mi_switch+0x166/frame 0xfffffe003e59caa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e59cae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e59cb10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe003e59cb70 usb_process() at usb_process+0xc3/frame 0xfffffe003e59cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e59cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e59cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100109 td 0xfffff800039e9000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e5a1a60 mi_switch() at mi_switch+0x166/frame 0xfffffe003e5a1aa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e5a1ae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e5a1b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe003e5a1b70 usb_process() at usb_process+0xc3/frame 0xfffffe003e5a1bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e5a1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e5a1bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100110 td 0xfffff800039f56e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e5a6a60 mi_switch() at mi_switch+0x166/frame 0xfffffe003e5a6aa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e5a6ae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e5a6b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe003e5a6b70 usb_process() at usb_process+0xc3/frame 0xfffffe003e5a6bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e5a6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e5a6bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100111 td 0xfffff800039f5000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e5aba60 mi_switch() at mi_switch+0x166/frame 0xfffffe003e5abaa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e5abae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e5abb10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe003e5abb70 usb_process() at usb_process+0xc3/frame 0xfffffe003e5abbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e5abbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e5abbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100091 td 0xfffff8000405e000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e52fa10 mi_switch() at mi_switch+0x166/frame 0xfffffe003e52fa50 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e52fa90 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e52fac0 _sleep() at _sleep+0x2cd/frame 0xfffffe003e52fb60 xpt_done_td() at xpt_done_td+0x8b/frame 0xfffffe003e52fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e52fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e52fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100092 td 0xfffff8000405f6e0 (CPU 6) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1afdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1afdf0 trap() at trap+0x44/frame 0xfffffe003e1aff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1aff20 --- trap 0x13, rip = 0xffffffff80c10320, rsp = 0xfffffe003e534790, rbp = 0xfffffe003e5347a0 --- lock_delay() at lock_delay+0x30/frame 0xfffffe003e5347a0 __mtx_lock_sleep() at __mtx_lock_sleep+0x108/frame 0xfffffe003e534850 __mtx_lock_flags() at __mtx_lock_flags+0xea/frame 0xfffffe003e5348a0 vm_page_dequeue() at vm_page_dequeue+0x10a/frame 0xfffffe003e5348e0 _vm_page_deactivate_noreuse() at _vm_page_deactivate_noreuse+0x71/frame 0xfffffe003e534900 swp_pager_async_iodone() at swp_pager_async_iodone+0x245/frame 0xfffffe003e534940 bufdone() at bufdone+0x70/frame 0xfffffe003e5349c0 swapgeom_done() at swapgeom_done+0x4f/frame 0xfffffe003e5349f0 g_io_deliver() at g_io_deliver+0x292/frame 0xfffffe003e534a40 g_io_deliver() at g_io_deliver+0x292/frame 0xfffffe003e534a90 g_io_deliver() at g_io_deliver+0x292/frame 0xfffffe003e534ae0 g_disk_done() at g_disk_done+0x106/frame 0xfffffe003e534b20 xpt_done_process() at xpt_done_process+0x384/frame 0xfffffe003e534b60 xpt_done_td() at xpt_done_td+0xf5/frame 0xfffffe003e534bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e534bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e534bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100093 td 0xfffff8000405f000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e539a10 mi_switch() at mi_switch+0x166/frame 0xfffffe003e539a50 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e539a90 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e539ac0 _sleep() at _sleep+0x2cd/frame 0xfffffe003e539b60 xpt_done_td() at xpt_done_td+0x8b/frame 0xfffffe003e539bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e539bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e539bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100125 td 0xfffff8000758e6e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00d3209a00 mi_switch() at mi_switch+0x166/frame 0xfffffe00d3209a40 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00d3209a80 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00d3209ab0 _sleep() at _sleep+0x2cd/frame 0xfffffe00d3209b50 xpt_scanner_thread() at xpt_scanner_thread+0x92/frame 0xfffffe00d3209bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d3209bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d3209bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 11 pid 19 tid 100090 td 0xfffff80003fc76e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e52a9f0 mi_switch() at mi_switch+0x166/frame 0xfffffe003e52aa30 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e52aa70 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e52aaa0 _sleep() at _sleep+0x2cd/frame 0xfffffe003e52ab40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe003e52abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e52abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e52abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 10 pid 18 tid 100089 td 0xfffff80003fc1000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e5259f0 mi_switch() at mi_switch+0x166/frame 0xfffffe003e525a30 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e525a70 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e525aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe003e525b40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe003e525bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e525bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e525bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 9 pid 17 tid 100088 td 0xfffff80003fc16e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e5209f0 mi_switch() at mi_switch+0x166/frame 0xfffffe003e520a30 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e520a70 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e520aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe003e520b40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe003e520bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e520bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e520bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 8 pid 16 tid 100087 td 0xfffff80003fc0000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e51b9f0 mi_switch() at mi_switch+0x166/frame 0xfffffe003e51ba30 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e51ba70 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e51baa0 _sleep() at _sleep+0x2cd/frame 0xfffffe003e51bb40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe003e51bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e51bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e51bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 7 pid 15 tid 100086 td 0xfffff80003fc06e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e5169f0 mi_switch() at mi_switch+0x166/frame 0xfffffe003e516a30 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e516a70 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e516aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe003e516b40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe003e516bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e516bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e516bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 6 pid 9 tid 100085 td 0xfffff80003fc9000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e5119f0 mi_switch() at mi_switch+0x166/frame 0xfffffe003e511a30 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e511a70 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e511aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe003e511b40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe003e511bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e511bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e511bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 5 pid 8 tid 100084 td 0xfffff80003fc96e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e50c9f0 mi_switch() at mi_switch+0x166/frame 0xfffffe003e50ca30 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e50ca70 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e50caa0 _sleep() at _sleep+0x2cd/frame 0xfffffe003e50cb40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe003e50cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e50cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e50cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 4 pid 7 tid 100083 td 0xfffff80003fc8000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e5079f0 mi_switch() at mi_switch+0x166/frame 0xfffffe003e507a30 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e507a70 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e507aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe003e507b40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe003e507bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e507bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e507bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 3 pid 6 tid 100082 td 0xfffff80003fc86e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e5029f0 mi_switch() at mi_switch+0x166/frame 0xfffffe003e502a30 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e502a70 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e502aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe003e502b40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe003e502bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e502bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e502bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 2 pid 5 tid 100081 td 0xfffff80003fc7000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e4fd9f0 mi_switch() at mi_switch+0x166/frame 0xfffffe003e4fda30 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e4fda70 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e4fdaa0 _sleep() at _sleep+0x2cd/frame 0xfffffe003e4fdb40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe003e4fdbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e4fdbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e4fdbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 1 pid 4 tid 100080 td 0xfffff80003fd56e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e4f89f0 mi_switch() at mi_switch+0x166/frame 0xfffffe003e4f8a30 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e4f8a70 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e4f8aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe003e4f8b40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe003e4f8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e4f8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e4f8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 0 pid 3 tid 100079 td 0xfffff80003fd4000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e4f39f0 mi_switch() at mi_switch+0x166/frame 0xfffffe003e4f3a30 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e4f3a70 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e4f3aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe003e4f3b40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe003e4f3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e4f3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e4f3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 2 tid 100078 td 0xfffff80003fd46e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e4eea20 mi_switch() at mi_switch+0x166/frame 0xfffffe003e4eea60 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e4eeaa0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e4eead0 _sleep() at _sleep+0x2cd/frame 0xfffffe003e4eeb70 crypto_proc() at crypto_proc+0x2bf/frame 0xfffffe003e4eebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e4eebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e4eebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sequencer 00 pid 14 tid 100065 td 0xfffff800037d1000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e4ada20 mi_switch() at mi_switch+0x166/frame 0xfffffe003e4ada60 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e4adaa0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e4adad0 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe003e4adb30 seq_eventthread() at seq_eventthread+0x8c/frame 0xfffffe003e4adbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e4adbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e4adbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100062 td 0xfffff800040356e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e492a20 mi_switch() at mi_switch+0x166/frame 0xfffffe003e492a60 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e492aa0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e492ad0 _sleep() at _sleep+0x2cd/frame 0xfffffe003e492b70 g_run_events() at g_run_events+0x45d/frame 0xfffffe003e492bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e492bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e492bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100063 td 0xfffff80004035000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e497a20 mi_switch() at mi_switch+0x166/frame 0xfffffe003e497a60 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e497aa0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e497ad0 _sleep() at _sleep+0x2cd/frame 0xfffffe003e497b70 g_io_schedule_up() at g_io_schedule_up+0x4c/frame 0xfffffe003e497ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe003e497bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e497bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e497bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100064 td 0xfffff800037d16e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e49ca20 mi_switch() at mi_switch+0x166/frame 0xfffffe003e49ca60 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e49caa0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e49cad0 _sleep() at _sleep+0x2cd/frame 0xfffffe003e49cb70 g_io_schedule_down() at g_io_schedule_down+0x4c/frame 0xfffffe003e49cba0 g_down_procbody() at g_down_procbody+0x5c/frame 0xfffffe003e49cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e49cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e49cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100018 td 0xfffff800038826e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00addbdb10 mi_switch() at mi_switch+0x166/frame 0xfffffe00addbdb50 ithread_loop() at ithread_loop+0x39e/frame 0xfffffe00addbdbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addbdbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addbdbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100019 td 0xfffff80003882000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00addc2b10 mi_switch() at mi_switch+0x166/frame 0xfffffe00addc2b50 ithread_loop() at ithread_loop+0x39e/frame 0xfffffe00addc2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addc2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addc2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100021 td 0xfffff8000387a000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100047 td 0xfffff8000383a000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100048 td 0xfffff8000383b6e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e404b10 mi_switch() at mi_switch+0x166/frame 0xfffffe003e404b50 ithread_loop() at ithread_loop+0x39e/frame 0xfffffe003e404bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e404bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e404bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100049 td 0xfffff8000383b000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e409b10 mi_switch() at mi_switch+0x166/frame 0xfffffe003e409b50 ithread_loop() at ithread_loop+0x39e/frame 0xfffffe003e409bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e409bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e409bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100050 td 0xfffff8000383c6e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e40eb10 mi_switch() at mi_switch+0x166/frame 0xfffffe003e40eb50 ithread_loop() at ithread_loop+0x39e/frame 0xfffffe003e40ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e40ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e40ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100051 td 0xfffff80003833000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e413b10 mi_switch() at mi_switch+0x166/frame 0xfffffe003e413b50 ithread_loop() at ithread_loop+0x39e/frame 0xfffffe003e413bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e413bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e413bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100052 td 0xfffff800038346e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e418b10 mi_switch() at mi_switch+0x166/frame 0xfffffe003e418b50 ithread_loop() at ithread_loop+0x39e/frame 0xfffffe003e418bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e418bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e418bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100053 td 0xfffff80003834000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e41db10 mi_switch() at mi_switch+0x166/frame 0xfffffe003e41db50 ithread_loop() at ithread_loop+0x39e/frame 0xfffffe003e41dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e41dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e41dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100054 td 0xfffff800038356e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e422b10 mi_switch() at mi_switch+0x166/frame 0xfffffe003e422b50 ithread_loop() at ithread_loop+0x39e/frame 0xfffffe003e422bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e422bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e422bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100055 td 0xfffff80003835000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e427b10 mi_switch() at mi_switch+0x166/frame 0xfffffe003e427b50 ithread_loop() at ithread_loop+0x39e/frame 0xfffffe003e427bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e427bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e427bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100056 td 0xfffff8000382e6e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e42cb10 mi_switch() at mi_switch+0x166/frame 0xfffffe003e42cb50 ithread_loop() at ithread_loop+0x39e/frame 0xfffffe003e42cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e42cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e42cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100057 td 0xfffff8000382e000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e431b10 mi_switch() at mi_switch+0x166/frame 0xfffffe003e431b50 ithread_loop() at ithread_loop+0x39e/frame 0xfffffe003e431bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e431bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e431bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100058 td 0xfffff8000382f6e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e436b10 mi_switch() at mi_switch+0x166/frame 0xfffffe003e436b50 ithread_loop() at ithread_loop+0x39e/frame 0xfffffe003e436bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e436bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e436bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100059 td 0xfffff8000382f000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e43bb10 mi_switch() at mi_switch+0x166/frame 0xfffffe003e43bb50 ithread_loop() at ithread_loop+0x39e/frame 0xfffffe003e43bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e43bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e43bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100060 td 0xfffff800038336e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e440b10 mi_switch() at mi_switch+0x166/frame 0xfffffe003e440b50 ithread_loop() at ithread_loop+0x39e/frame 0xfffffe003e440bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e440bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e440bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100094 td 0xfffff800044806e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e53eb10 mi_switch() at mi_switch+0x166/frame 0xfffffe003e53eb50 ithread_loop() at ithread_loop+0x39e/frame 0xfffffe003e53ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e53ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e53ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100095 td 0xfffff80004480000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e543b10 mi_switch() at mi_switch+0x166/frame 0xfffffe003e543b50 ithread_loop() at ithread_loop+0x39e/frame 0xfffffe003e543bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e543bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e543bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100101 td 0xfffff80004908000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e561b10 mi_switch() at mi_switch+0x166/frame 0xfffffe003e561b50 ithread_loop() at ithread_loop+0x39e/frame 0xfffffe003e561bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e561bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e561bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100112 td 0xfffff800039e46e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100113 td 0xfffff800039e4000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e5b5b10 mi_switch() at mi_switch+0x166/frame 0xfffffe003e5b5b50 ithread_loop() at ithread_loop+0x39e/frame 0xfffffe003e5b5bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e5b5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e5b5bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100176 td 0xfffff8001e3af6e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100177 td 0xfffff8001e3af000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100178 td 0xfffff8001e3b06e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100179 td 0xfffff8001e3b0000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100180 td 0xfffff8001e1116e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100181 td 0xfffff80007e3b000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100182 td 0xfffff8004d0ce6e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100183 td 0xfffff8004d0ce000 fork_trampoline() at fork_trampoline Tracing command idle pid 11 tid 100003 td 0xfffff800038c0000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00add72a90 mi_switch() at mi_switch+0x166/frame 0xfffffe00add72ad0 sched_idletd() at sched_idletd+0x459/frame 0xfffffe00add72bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add72bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add72bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffff800038c66e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00add77a90 mi_switch() at mi_switch+0x166/frame 0xfffffe00add77ad0 sched_idletd() at sched_idletd+0xa3/frame 0xfffffe00add77bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add77bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add77bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffff800038c6000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00add7ca90 mi_switch() at mi_switch+0x166/frame 0xfffffe00add7cad0 sched_idletd() at sched_idletd+0xa3/frame 0xfffffe00add7cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add7cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add7cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffff800038b06e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00add81a90 mi_switch() at mi_switch+0x166/frame 0xfffffe00add81ad0 sched_idletd() at sched_idletd+0xa3/frame 0xfffffe00add81bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add81bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add81bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffff800038b0000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00add86a90 mi_switch() at mi_switch+0x166/frame 0xfffffe00add86ad0 sched_idletd() at sched_idletd+0x459/frame 0xfffffe00add86bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add86bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add86bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffff800038b16e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00add8ba90 mi_switch() at mi_switch+0x166/frame 0xfffffe00add8bad0 sched_idletd() at sched_idletd+0x459/frame 0xfffffe00add8bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add8bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add8bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffff800038b1000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00add90a90 mi_switch() at mi_switch+0x166/frame 0xfffffe00add90ad0 sched_idletd() at sched_idletd+0xa3/frame 0xfffffe00add90bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add90bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add90bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffff800038bf6e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00add95a90 mi_switch() at mi_switch+0x166/frame 0xfffffe00add95ad0 sched_idletd() at sched_idletd+0xa3/frame 0xfffffe00add95bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add95bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add95bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffff800038ad000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00add9aa90 mi_switch() at mi_switch+0x166/frame 0xfffffe00add9aad0 sched_idletd() at sched_idletd+0x459/frame 0xfffffe00add9abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add9abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add9abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffff800038ae6e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00add9fa90 mi_switch() at mi_switch+0x166/frame 0xfffffe00add9fad0 sched_idletd() at sched_idletd+0xa3/frame 0xfffffe00add9fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add9fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add9fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffff800038ae000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00adda4a90 mi_switch() at mi_switch+0x166/frame 0xfffffe00adda4ad0 sched_idletd() at sched_idletd+0x459/frame 0xfffffe00adda4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adda4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adda4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffff800038af6e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00adda9a90 mi_switch() at mi_switch+0x166/frame 0xfffffe00adda9ad0 sched_idletd() at sched_idletd+0xa3/frame 0xfffffe00adda9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adda9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adda9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command init pid 1 tid 100002 td 0xfffff800038c06e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00add6d690 mi_switch() at mi_switch+0x166/frame 0xfffffe00add6d6d0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00add6d710 sleepq_catch_signals() at sleepq_catch_signals+0x415/frame 0xfffffe00add6d770 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00add6d7a0 _sleep() at _sleep+0x2c3/frame 0xfffffe00add6d840 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00add6d8d0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00add6dac0 amd64_syscall() at amd64_syscall+0x2d0/frame 0xfffffe00add6dbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00add6dbf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x2b0c2a, rsp = 0x7fffffffe778, rbp = 0x7fffffffe7e0 --- Tracing command audit pid 10 tid 100001 td 0xfffff800038bf000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00add68a40 mi_switch() at mi_switch+0x166/frame 0xfffffe00add68a80 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00add68ac0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00add68af0 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe00add68b50 audit_worker() at audit_worker+0x9f/frame 0xfffffe00add68bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add68bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add68bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xffffffff81d9b220 sched_switch() at sched_switch+0x38f/frame 0xffffffff822f4bf0 mi_switch() at mi_switch+0x166/frame 0xffffffff822f4c30 sleepq_switch() at sleepq_switch+0x10e/frame 0xffffffff822f4c70 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xffffffff822f4cb0 _sleep() at _sleep+0x26c/frame 0xffffffff822f4d50 swapper() at swapper+0x75/frame 0xffffffff822f4da0 mi_startup() at mi_startup+0x2ed/frame 0xffffffff822f4df0 btext() at btext+0x2c Tracing command kernel pid 0 tid 100015 td 0xfffff800038af000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00addaea60 mi_switch() at mi_switch+0x166/frame 0xfffffe00addaeaa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00addaeae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00addaeb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addaeb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00addaebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addaebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addaebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100016 td 0xfffff800038816e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00addb3a30 mi_switch() at mi_switch+0x166/frame 0xfffffe00addb3a70 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00addb3ab0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00addb3ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00addb3b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00addb3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addb3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addb3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100017 td 0xfffff80003881000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00addb8a30 mi_switch() at mi_switch+0x166/frame 0xfffffe00addb8a70 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00addb8ab0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00addb8ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00addb8b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00addb8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addb8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addb8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xfffff800038ad6e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00addc7a30 mi_switch() at mi_switch+0x166/frame 0xfffffe00addc7a70 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00addc7ab0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00addc7ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00addc7b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00addc7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addc7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addc7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xfffff8000387b6e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe0037781a60 mi_switch() at mi_switch+0x166/frame 0xfffffe0037781aa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe0037781ae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0037781b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0037781b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe0037781bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037781bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037781bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xfffff8000387b000 sched_switch() at sched_switch+0x38f/frame 0xfffffe0037786a60 mi_switch() at mi_switch+0x166/frame 0xfffffe0037786aa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe0037786ae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0037786b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0037786b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe0037786bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037786bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037786bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xfffff8000387c6e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003778ba60 mi_switch() at mi_switch+0x166/frame 0xfffffe003778baa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003778bae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003778bb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe003778bb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe003778bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003778bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003778bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xfffff8000387c000 sched_switch() at sched_switch+0x38f/frame 0xfffffe0037790a60 mi_switch() at mi_switch+0x166/frame 0xfffffe0037790aa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe0037790ae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0037790b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0037790b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe0037790bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037790bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037790bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100026 td 0xfffff800038486e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe0037795a60 mi_switch() at mi_switch+0x166/frame 0xfffffe0037795aa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe0037795ae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0037795b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0037795b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe0037795bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037795bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037795bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100027 td 0xfffff80003848000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003779aa60 mi_switch() at mi_switch+0x166/frame 0xfffffe003779aaa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003779aae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003779ab10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe003779ab80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe003779abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003779abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003779abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100028 td 0xfffff800038496e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003779fa60 mi_switch() at mi_switch+0x166/frame 0xfffffe003779faa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003779fae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003779fb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe003779fb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe003779fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003779fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003779fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100029 td 0xfffff80003849000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00377a4a60 mi_switch() at mi_switch+0x166/frame 0xfffffe00377a4aa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00377a4ae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00377a4b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377a4b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377a4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377a4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377a4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100030 td 0xfffff8000387a6e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00377a9a60 mi_switch() at mi_switch+0x166/frame 0xfffffe00377a9aa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00377a9ae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00377a9b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377a9b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377a9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377a9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377a9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100031 td 0xfffff80003843000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00377aea60 mi_switch() at mi_switch+0x166/frame 0xfffffe00377aeaa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00377aeae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00377aeb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377aeb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377aebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377aebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377aebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100032 td 0xfffff800038446e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00377b3a60 mi_switch() at mi_switch+0x166/frame 0xfffffe00377b3aa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00377b3ae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00377b3b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377b3b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377b3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377b3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377b3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100033 td 0xfffff80003844000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00377b8a60 mi_switch() at mi_switch+0x166/frame 0xfffffe00377b8aa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00377b8ae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00377b8b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377b8b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377b8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377b8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377b8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100034 td 0xfffff800038456e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00377bda60 mi_switch() at mi_switch+0x166/frame 0xfffffe00377bdaa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00377bdae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00377bdb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377bdb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377bdbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377bdbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377bdbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100035 td 0xfffff80003845000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00377c2a60 mi_switch() at mi_switch+0x166/frame 0xfffffe00377c2aa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00377c2ae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00377c2b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377c2b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377c2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377c2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377c2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100036 td 0xfffff800038416e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00377c7a60 mi_switch() at mi_switch+0x166/frame 0xfffffe00377c7aa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00377c7ae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00377c7b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377c7b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377c7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377c7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377c7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100037 td 0xfffff80003841000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00377cca60 mi_switch() at mi_switch+0x166/frame 0xfffffe00377ccaa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00377ccae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00377ccb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377ccb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377ccbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377ccbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377ccbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100038 td 0xfffff800038426e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00377d1a60 mi_switch() at mi_switch+0x166/frame 0xfffffe00377d1aa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00377d1ae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00377d1b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377d1b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377d1bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377d1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377d1bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100039 td 0xfffff80003842000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00377d6a60 mi_switch() at mi_switch+0x166/frame 0xfffffe00377d6aa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00377d6ae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00377d6b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377d6b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377d6bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377d6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377d6bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100040 td 0xfffff800038436e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00377dba60 mi_switch() at mi_switch+0x166/frame 0xfffffe00377dbaa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00377dbae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00377dbb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377dbb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377dbbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377dbbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377dbbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100041 td 0xfffff8000383c000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00377e0a60 mi_switch() at mi_switch+0x166/frame 0xfffffe00377e0aa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00377e0ae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00377e0b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377e0b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377e0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377e0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377e0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100042 td 0xfffff8000383d6e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00377e5a60 mi_switch() at mi_switch+0x166/frame 0xfffffe00377e5aa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00377e5ae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00377e5b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377e5b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377e5bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377e5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377e5bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100043 td 0xfffff8000383d000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00377eaa60 mi_switch() at mi_switch+0x166/frame 0xfffffe00377eaaa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00377eaae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00377eab10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377eab80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377eabb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377eabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377eabf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100044 td 0xfffff8000383e6e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00377efa60 mi_switch() at mi_switch+0x166/frame 0xfffffe00377efaa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00377efae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00377efb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377efb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377efbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377efbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377efbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100045 td 0xfffff8000383e000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00377f4a60 mi_switch() at mi_switch+0x166/frame 0xfffffe00377f4aa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00377f4ae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00377f4b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377f4b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377f4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377f4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377f4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100046 td 0xfffff8000383a6e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe00377f9a60 mi_switch() at mi_switch+0x166/frame 0xfffffe00377f9aa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00377f9ae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00377f9b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377f9b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377f9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377f9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377f9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100061 td 0xfffff80004030000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e48da30 mi_switch() at mi_switch+0x166/frame 0xfffffe003e48da70 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e48dab0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e48dae0 _sleep() at _sleep+0x2cd/frame 0xfffffe003e48db80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe003e48dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e48dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e48dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100066 td 0xfffff80003fd86e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e4b2a30 mi_switch() at mi_switch+0x166/frame 0xfffffe003e4b2a70 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e4b2ab0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e4b2ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe003e4b2b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe003e4b2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e4b2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e4b2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100067 td 0xfffff80003fd8000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e4b7a30 mi_switch() at mi_switch+0x166/frame 0xfffffe003e4b7a70 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e4b7ab0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e4b7ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe003e4b7b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe003e4b7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e4b7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e4b7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100068 td 0xfffff80003fd96e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e4bca30 mi_switch() at mi_switch+0x166/frame 0xfffffe003e4bca70 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e4bcab0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e4bcae0 _sleep() at _sleep+0x2cd/frame 0xfffffe003e4bcb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe003e4bcbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e4bcbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e4bcbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100069 td 0xfffff80003fd9000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e4c1a30 mi_switch() at mi_switch+0x166/frame 0xfffffe003e4c1a70 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e4c1ab0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e4c1ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe003e4c1b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe003e4c1bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e4c1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e4c1bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100070 td 0xfffff800040306e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e4c6a30 mi_switch() at mi_switch+0x166/frame 0xfffffe003e4c6a70 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e4c6ab0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e4c6ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe003e4c6b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe003e4c6bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e4c6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e4c6bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100071 td 0xfffff80003fd5000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e4cba30 mi_switch() at mi_switch+0x166/frame 0xfffffe003e4cba70 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e4cbab0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e4cbae0 _sleep() at _sleep+0x2cd/frame 0xfffffe003e4cbb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe003e4cbbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e4cbbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e4cbbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100072 td 0xfffff80003fd66e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e4d0a30 mi_switch() at mi_switch+0x166/frame 0xfffffe003e4d0a70 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e4d0ab0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e4d0ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe003e4d0b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe003e4d0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e4d0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e4d0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100073 td 0xfffff80003fd6000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e4d5a30 mi_switch() at mi_switch+0x166/frame 0xfffffe003e4d5a70 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e4d5ab0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e4d5ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe003e4d5b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe003e4d5bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e4d5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e4d5bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100074 td 0xfffff80003fd76e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e4daa30 mi_switch() at mi_switch+0x166/frame 0xfffffe003e4daa70 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e4daab0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e4daae0 _sleep() at _sleep+0x2cd/frame 0xfffffe003e4dab80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe003e4dabb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e4dabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e4dabf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100075 td 0xfffff80003fd7000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e4dfa30 mi_switch() at mi_switch+0x166/frame 0xfffffe003e4dfa70 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e4dfab0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e4dfae0 _sleep() at _sleep+0x2cd/frame 0xfffffe003e4dfb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe003e4dfbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e4dfbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e4dfbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100076 td 0xfffff80003fd36e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e4e4a30 mi_switch() at mi_switch+0x166/frame 0xfffffe003e4e4a70 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e4e4ab0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e4e4ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe003e4e4b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe003e4e4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e4e4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e4e4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100077 td 0xfffff80003fd3000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e4e9a30 mi_switch() at mi_switch+0x166/frame 0xfffffe003e4e9a70 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e4e9ab0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e4e9ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe003e4e9b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe003e4e9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e4e9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e4e9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100114 td 0xfffff800039e56e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e5baa60 mi_switch() at mi_switch+0x166/frame 0xfffffe003e5baaa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e5baae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e5bab10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe003e5bab80 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe003e5babb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e5babf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e5babf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100121 td 0xfffff800075c86e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e5f5a60 mi_switch() at mi_switch+0x166/frame 0xfffffe003e5f5aa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e5f5ae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e5f5b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe003e5f5b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe003e5f5bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e5f5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e5f5bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100122 td 0xfffff800075c8000 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e5faa60 mi_switch() at mi_switch+0x166/frame 0xfffffe003e5faaa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e5faae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e5fab10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe003e5fab80 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe003e5fabb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e5fabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e5fabf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100123 td 0xfffff800049f56e0 sched_switch() at sched_switch+0x38f/frame 0xfffffe003e5ffa60 mi_switch() at mi_switch+0x166/frame 0xfffffe003e5ffaa0 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe003e5ffae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe003e5ffb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe003e5ffb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe003e5ffbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003e5ffbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003e5ffbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100124 td 0xfffff8000758d000 sched_switch() at sched_switch+0x38f/frame 0xfffffe00d3204a30 mi_switch() at mi_switch+0x166/frame 0xfffffe00d3204a70 sleepq_switch() at sleepq_switch+0x10e/frame 0xfffffe00d3204ab0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00d3204ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00d3204b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00d3204bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d3204bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d3204bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:pho> dump Dumping 4243 out of 32626 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% Dump complete db:0:pho> show allchains chain 1: thread 104113 (pid 79631, sh) sleeping on 0xfffff80287fd6000 "wait" chain 2: thread 104132 (pid 79621, sleep) sleeping on 0xffffffff81c7feb4 "nanslp" chain 3: thread 123553 (pid 79428, sh) sleeping on 0xfffff8055c37d2f8 "piperd" chain 4: thread 104173 (pid 78109, swap) sleeping on 0xffffffff81847ec0 "pfault" chain 5: thread 113532 (pid 78107, swap) sleeping on 0xffffffff81847ec0 "pfault" chain 6: thread 100915 (pid 78105, swap) sleeping on 0xffffffff81847ec0 "pfault" chain 7: thread 111997 (pid 78104, swap) sleeping on 0xffffffff81847ec0 "pfault" chain 8: thread 120955 (pid 78103, swap) sleeping on 0xffffffff81847ec0 "pfault" chain 9: thread 104288 (pid 78099, swap) sleeping on 0xffffffff81847ec0 "pfault" chain 10: thread 119759 (pid 78097, swap) sleeping on 0xffffffff81847ec0 "pfault" chain 11: thread 115138 (pid 78095, swap) sleeping on 0xffffffff81847ec0 "pfault" chain 12: thread 104133 (pid 78093, swap) sleeping on 0xffffffff81847ec0 "pfault" chain 13: thread 104927 (pid 78091, swap) sleeping on 0xffffffff81847ec0 "pfault" chain 14: thread 124457 (pid 78090, swap) sleeping on 0xffffffff81847ec0 "pfault" chain 15: thread 110775 (pid 78089, swap) sleeping on 0xfffff8075207b000 "wait" chain 16: thread 105099 (pid 78088, link) blocked on lockmgr ufsEXCL thread 120940 (pid 78076, link) running on CPU 1 chain 17: thread 116871 (pid 78085, link) blocked on lockmgr ufsEXCL thread 120940 (pid 78076, link) running on CPU 1 chain 18: thread 121544 (pid 78083, link) blocked on lockmgr ufsEXCL thread 120940 (pid 78076, link) running on CPU 1 chain 19: thread 122171 (pid 78082, link) blocked on lockmgr ufsEXCL thread 120940 (pid 78076, link) running on CPU 1 chain 20: thread 120820 (pid 78081, link) blocked on lockmgr ufsEXCL thread 120940 (pid 78076, link) running on CPU 1 chain 21: thread 123555 (pid 78080, link) blocked on lockmgr ufsEXCL thread 120940 (pid 78076, link) running on CPU 1 chain 22: thread 124487 (pid 78079, link) blocked on lockmgr ufsEXCL thread 120940 (pid 78076, link) running on CPU 1 chain 23: thread 120642 (pid 78077, link) blocked on lockmgr ufsEXCL thread 120940 (pid 78076, link) running on CPU 1 chain 24: thread 122090 (pid 78075, link) blocked on lockmgr ufsEXCL thread 120940 (pid 78076, link) running on CPU 1 chain 25: thread 112648 (pid 78074, link) blocked on lockmgr ufsEXCL thread 120940 (pid 78076, link) running on CPU 1 chain 26: thread 124635 (pid 78073, link) blocked on lockmgr ufsEXCL thread 120940 (pid 78076, link) running on CPU 1 chain 27: thread 102243 (pid 78069, link) sleeping on 0xfffff804719a6a60 "wait" chain 28: thread 107894 (pid 78068, swap) sleeping on 0xffffffff81c7feb7 "nanslp" chain 29: thread 123654 (pid 78063, md10) sleeping on 0xfffff804b70c3000 "mdwait" chain 30: thread 110153 (pid 78047, sh) sleeping on 0xfffff80396472000 "wait" chain 31: thread 102316 (pid 78046, tee) sleeping on 0xfffff8032caf85f0 "piperd" chain 32: thread 114920 (pid 78045, sh) sleeping on 0xfffff801ce532a60 "wait" chain 33: thread 101700 (pid 58437, aiod4) sleeping on 0xfffff8011bc49530 "aiordy" chain 34: thread 102367 (pid 58436, aiod3) sleeping on 0xfffff802a81fb000 "aiordy" chain 35: thread 100785 (pid 58435, aiod2) sleeping on 0xfffff8057669a530 "aiordy" chain 36: thread 104129 (pid 58434, aiod1) blocked on lockmgr `EXCL thread 0 (pid -512, ) is inactive chain 37: thread 100275 (pid 10058, sh) sleeping on 0xfffff80007714be0 "piperd" chain 38: thread 100274 (pid 10056, awk) sleeping on 0xfffff8019c50c000 "piperd" chain 39: thread 100171 (pid 10055, sh) sleeping on 0xfffff8001e0fc530 "wait" chain 40: thread 100256 (pid 10016, sh) sleeping on 0xfffff8019c569000 "wait" chain 41: thread 100162 (pid 2347, sh) sleeping on 0xfffff8000760d530 "wait" chain 42: thread 100188 (pid 2346, bash) sleeping on 0xfffff80007788740 "select" chain 43: thread 100174 (pid 2344, csh) sleeping on 0xfffff800074a2b08 "pause" chain 44: thread 100199 (pid 2343, su) sleeping on 0xfffff80116a1c530 "wait" chain 45: thread 100165 (pid 2338, bash) blocked on lockmgr EXCL thread 0 (pid -512, ) ??? (0x6) chain 46: thread 100143 (pid 2337, sshd) sleeping on 0xfffff80007788440 "select" chain 47: thread 100160 (pid 2334, sshd) sleeping on 0xfffff800049abb40 "select" chain 48: thread 100201 (pid 2330, csh) sleeping on 0xfffff800064e58b0 "ttyin" chain 49: thread 100212 (pid 2329, login) sleeping on 0xfffff8017f233530 "wait" chain 50: thread 100211 (pid 2328, getty) sleeping on 0xfffff800064f9cb0 "ttyin" chain 51: thread 100210 (pid 2327, getty) sleeping on 0xfffff800076864b0 "ttyin" chain 52: thread 100209 (pid 2326, getty) sleeping on 0xfffff80007686cb0 "ttyin" chain 53: thread 100208 (pid 2325, getty) sleeping on 0xfffff800076854b0 "ttyin" chain 54: thread 100207 (pid 2324, getty) sleeping on 0xfffff80007685cb0 "ttyin" chain 55: thread 100206 (pid 2323, getty) sleeping on 0xfffff800076844b0 "ttyin" chain 56: thread 100156 (pid 2322, getty) sleeping on 0xfffff80003dca0b0 "ttyin" chain 57: thread 100191 (pid 2321, getty) sleeping on 0xfffff80003dcd8b0 "ttyin" chain 58: thread 100142 (pid 2320, getty) sleeping on 0xfffff80003dcccb0 "ttyin" chain 59: thread 100144 (pid 2274, cron) sleeping on 0xffffffff81c7feb7 "nanslp" chain 60: thread 100200 (pid 2270, sshd) sleeping on 0xfffff800064ac7c0 "select" chain 61: thread 100163 (pid 2241, ntpd) sleeping on 0xfffff800078848c0 "select" chain 62: thread 124717 (pid 2241, ntpd) sleeping on 0xfffff807951a4600 "usem" chain 63: thread 100170 (pid 2178, NLM: master) sleeping on 0xfffff80004365460 "rpcsvc" chain 64: thread 100155 (pid 2175, rpc.statd) sleeping on 0xfffff800064ac8c0 "select" chain 65: thread 100194 (pid 2129, watchdogd) sleeping on 0xffffffff81c7feba "nanslp" chain 66: thread 100173 (pid 2050, rpcbind) sleeping on 0xfffff800077887c0 "select" chain 67: thread 100153 (pid 2040, syslogd) sleeping on 0xfffff80003ca4940 "select" chain 68: thread 100150 (pid 1969, devd) sleeping on 0xfffff80006111c40 "select" chain 69: thread 100193 (pid 1964, dhclient) sleeping on 0xfffff800064ac940 "select" chain 70: thread 100147 (pid 1920, dhclient) sleeping on 0xfffff8004d16ed40 "select" chain 71: thread 100185 (pid 1917, dhclient) sleeping on 0xfffff80007668ac0 "select" chain 72: thread 100141 (pid 34, vnlru) blocked on lockmgr 0EXCL thread 0 (pid -512, ) is inactive chain 73: thread 100140 (pid 33, syncer) sleeping on 0xffffffff81d56370 "syncer" chain 74: thread 100130 (pid 32, bufdaemon) sleeping on 0xffffffff81d55818 "qsleep" chain 75: thread 100133 (pid 32, bufspacedaemon-0) sleeping on 0xffffffff8180a900 "-" chain 76: thread 100134 (pid 32, bufspacedaemon-1) sleeping on 0xffffffff81812bc0 "-" chain 77: thread 100135 (pid 32, bufspacedaemon-2) sleeping on 0xffffffff8181ae80 "-" chain 78: thread 100136 (pid 32, bufspacedaemon-3) sleeping on 0xffffffff81823140 "-" chain 79: thread 100137 (pid 32, bufspacedaemon-4) sleeping on 0xffffffff8182b400 "-" chain 80: thread 100138 (pid 32, bufspacedaemon-5) sleeping on 0xffffffff818336c0 "-" chain 81: thread 100139 (pid 32, bufspacedaemon-6) sleeping on 0xffffffff8183b980 "-" chain 82: thread 100152 (pid 32, / worker) blocked on lockmgr }0EXCL thread 0 (pid -1, p@yppp) ??? (0xdeadc0de) chain 83: thread 100196 (pid 32, /tmp worker) sleeping on 0xfffff80116d190e8 "sdflush" chain 84: thread 105161 (pid 32, /mnt worker) sleeping on 0xfffff80007f8f2e8 "sdflush" chain 85: thread 100132 (pid 30, uma) sleeping on 0xffffffff80effb60 "umarcl" chain 86: thread 100127 (pid 29, enc_daemon1) sleeping on 0xfffff8000600c000 "idle" chain 87: thread 100126 (pid 28, enc_daemon0) blocked on lockmgr `\EXCL thread 0 (pid -512, ) is inactive chain 88: thread 100120 (pid 27, rand_harvestq) sleeping on 0xffffffff81adbb20 "-" chain 89: thread 100119 (pid 26, sctp_iterator) sleeping on 0xffffffff81de20f0 "waiting_for_work" chain 90: thread 100118 (pid 25, soaiod4) sleeping on 0xffffffff81d5521c "-" chain 91: thread 100117 (pid 24, soaiod3) sleeping on 0xffffffff81d5521c "-" chain 92: thread 100116 (pid 23, soaiod2) sleeping on 0xffffffff81d5521c "-" chain 93: thread 100115 (pid 22, soaiod1) sleeping on 0xffffffff81d5521c "-" chain 94: thread 100096 (pid 21, usbus0) sleeping on 0xfffffe00d1584460 "-" chain 95: thread 100097 (pid 21, usbus0) sleeping on 0xfffffe00d15844b8 "-" chain 96: thread 100098 (pid 21, usbus0) sleeping on 0xfffffe00d1584510 "-" chain 97: thread 100099 (pid 21, usbus0) sleeping on 0xfffffe00d1584568 "-" chain 98: thread 100100 (pid 21, usbus0) sleeping on 0xfffffe00d15845c0 "-" chain 99: thread 100102 (pid 21, usbus1) sleeping on 0xfffffe0037b66d10 "-" chain 100: thread 100103 (pid 21, usbus1) sleeping on 0xfffffe0037b66d68 "-" chain 101: thread 100104 (pid 21, usbus1) sleeping on 0xfffffe0037b66dc0 "-" chain 102: thread 100105 (pid 21, usbus1) sleeping on 0xfffffe0037b66e18 "-" chain 103: thread 100106 (pid 21, usbus1) sleeping on 0xfffffe0037b66e70 "-" chain 104: thread 100107 (pid 21, usbus2) sleeping on 0xfffffe00d16a7d10 "-" chain 105: thread 100108 (pid 21, usbus2) sleeping on 0xfffffe00d16a7d68 "-" chain 106: thread 100109 (pid 21, usbus2) sleeping on 0xfffffe00d16a7dc0 "-" chain 107: thread 100110 (pid 21, usbus2) sleeping on 0xfffffe00d16a7e18 "-" chain 108: thread 100111 (pid 21, usbus2) sleeping on 0xfffffe00d16a7e70 "-" chain 109: thread 100091 (pid 20, doneq0) sleeping on 0xffffffff819b6ec0 "-" chain 110: thread 100093 (pid 20, doneq2) sleeping on 0xffffffff819b6fc0 "-" chain 111: thread 100125 (pid 20, scanner) sleeping on 0xffffffff819b6d88 "-" chain 112: thread 100090 (pid 19, crypto returns 11) sleeping on 0xfffff8000388f450 "crypto_ret_wait" chain 113: thread 100089 (pid 18, crypto returns 10) sleeping on 0xfffff8000388f3f0 "crypto_ret_wait" chain 114: thread 100088 (pid 17, crypto returns 9) sleeping on 0xfffff8000388f390 "crypto_ret_wait" chain 115: thread 100087 (pid 16, crypto returns 8) sleeping on 0xfffff8000388f330 "crypto_ret_wait" chain 116: thread 100086 (pid 15, crypto returns 7) sleeping on 0xfffff8000388f2d0 "crypto_ret_wait" chain 117: thread 100085 (pid 9, crypto returns 6) sleeping on 0xfffff8000388f270 "crypto_ret_wait" chain 118: thread 100084 (pid 8, crypto returns 5) sleeping on 0xfffff8000388f210 "crypto_ret_wait" chain 119: thread 100083 (pid 7, crypto returns 4) sleeping on 0xfffff8000388f1b0 "crypto_ret_wait" chain 120: thread 100082 (pid 6, crypto returns 3) sleeping on 0xfffff8000388f150 "crypto_ret_wait" chain 121: thread 100081 (pid 5, crypto returns 2) sleeping on 0xfffff8000388f0f0 "crypto_ret_wait" chain 122: thread 100080 (pid 4, crypto returns 1) sleeping on 0xfffff8000388f090 "crypto_ret_wait" chain 123: thread 100079 (pid 3, crypto returns 0) sleeping on 0xfffff8000388f030 "crypto_ret_wait" chain 124: thread 100078 (pid 2, crypto) sleeping on 0xffffffff81d6b308 "crypto_wait" chain 125: thread 100065 (pid 14, sequencer 00) sleeping on 0xfffff800037d7c88 "seqstate" chain 126: thread 100062 (pid 13, g_event) sleeping on 0xffffffff81d9b110 "-" chain 127: thread 100063 (pid 13, g_up) sleeping on 0xffffffff81d9b120 "-" chain 128: thread 100064 (pid 13, g_down) sleeping on 0xffffffff81d9b118 "-" chain 129: thread 100002 (pid 1, init) sleeping on 0xfffff800038c7530 "wait" chain 130: thread 100001 (pid 10, audit) sleeping on 0xffffffff81de2d80 "audit_worker_cv" chain 131: thread 100000 (pid 0, swapper) sleeping on 0xffffffff81d8a828 "swapin" chain 132: thread 100015 (pid 0, config_0) sleeping on 0xfffff8000389b000 "-" chain 133: thread 100016 (pid 0, kqueue_ctx taskq) sleeping on 0xfffff80003885000 "-" chain 134: thread 100017 (pid 0, aiod_kick taskq) sleeping on 0xfffff80003886e00 "-" chain 135: thread 100020 (pid 0, thread taskq) sleeping on 0xfffff80003886b00 "-" chain 136: thread 100022 (pid 0, if_config_tqg_0) sleeping on 0xfffff8000389ce00 "-" chain 137: thread 100023 (pid 0, softirq_0) sleeping on 0xfffff8000389cd00 "-" chain 138: thread 100024 (pid 0, softirq_1) sleeping on 0xfffff8000389cc00 "-" chain 139: thread 100025 (pid 0, softirq_2) sleeping on 0xfffff8000389cb00 "-" chain 140: thread 100026 (pid 0, softirq_3) sleeping on 0xfffff8000389ca00 "-" chain 141: thread 100027 (pid 0, softirq_4) sleeping on 0xfffff8000389c900 "-" chain 142: thread 100028 (pid 0, softirq_5) sleeping on 0xfffff8000389c800 "-" chain 143: thread 100029 (pid 0, softirq_6) sleeping on 0xfffff8000389c700 "-" chain 144: thread 100030 (pid 0, softirq_7) sleeping on 0xfffff8000389c600 "-" chain 145: thread 100031 (pid 0, softirq_8) sleeping on 0xfffff8000389c500 "-" chain 146: thread 100032 (pid 0, softirq_9) sleeping on 0xfffff8000389c400 "-" chain 147: thread 100033 (pid 0, softirq_10) sleeping on 0xfffff8000389c300 "-" chain 148: thread 100034 (pid 0, softirq_11) sleeping on 0xfffff8000389c200 "-" chain 149: thread 100035 (pid 0, if_io_tqg_0) sleeping on 0xfffff8000389c100 "-" chain 150: thread 100036 (pid 0, if_io_tqg_1) sleeping on 0xfffff8000389c000 "-" chain 151: thread 100037 (pid 0, if_io_tqg_2) sleeping on 0xfffff8000389de00 "-" chain 152: thread 100038 (pid 0, if_io_tqg_3) sleeping on 0xfffff8000389dd00 "-" chain 153: thread 100039 (pid 0, if_io_tqg_4) sleeping on 0xfffff8000389dc00 "-" chain 154: thread 100040 (pid 0, if_io_tqg_5) sleeping on 0xfffff8000389db00 "-" chain 155: thread 100041 (pid 0, if_io_tqg_6) sleeping on 0xfffff8000389da00 "-" chain 156: thread 100042 (pid 0, if_io_tqg_7) sleeping on 0xfffff8000389d900 "-" chain 157: thread 100043 (pid 0, if_io_tqg_8) sleeping on 0xfffff8000389d800 "-" chain 158: thread 100044 (pid 0, if_io_tqg_9) sleeping on 0xfffff8000389d700 "-" chain 159: thread 100045 (pid 0, if_io_tqg_10) sleeping on 0xfffff8000389d600 "-" chain 160: thread 100046 (pid 0, if_io_tqg_11) sleeping on 0xfffff8000389d500 "-" chain 161: thread 100061 (pid 0, firmware taskq) sleeping on 0xfffff80003886900 "-" chain 162: thread 100066 (pid 0, crypto_0) sleeping on 0xfffff80003887e00 "-" chain 163: thread 100067 (pid 0, crypto_1) sleeping on 0xfffff80003887e00 "-" chain 164: thread 100068 (pid 0, crypto_2) sleeping on 0xfffff80003887e00 "-" chain 165: thread 100069 (pid 0, crypto_3) sleeping on 0xfffff80003887e00 "-" chain 166: thread 100070 (pid 0, crypto_4) sleeping on 0xfffff80003887e00 "-" chain 167: thread 100071 (pid 0, crypto_5) sleeping on 0xfffff80003887e00 "-" chain 168: thread 100072 (pid 0, crypto_6) sleeping on 0xfffff80003887e00 "-" chain 169: thread 100073 (pid 0, crypto_7) sleeping on 0xfffff80003887e00 "-" chain 170: thread 100074 (pid 0, crypto_8) sleeping on 0xfffff80003887e00 "-" chain 171: thread 100075 (pid 0, crypto_9) sleeping on 0xfffff80003887e00 "-" chain 172: thread 100076 (pid 0, crypto_10) sleeping on 0xfffff80003887e00 "-" chain 173: thread 100077 (pid 0, crypto_11) sleeping on 0xfffff80003887e00 "-" chain 174: thread 100114 (pid 0, mca taskq) blocked on lockmgr (null)EXCL chain 175: thread 100121 (pid 0, acpi_task_0) sleeping on 0xfffff80007591200 "-" chain 176: thread 100122 (pid 0, acpi_task_1) sleeping on 0xfffff80007591200 "-" chain 177: thread 100123 (pid 0, acpi_task_2) sleeping on 0xfffff80007591200 "-" chain 178: thread 100124 (pid 0, CAM taskq) sleeping on 0xfffff80003887800 "-" db:0:pho> chain 1: thread 104113 (pid 79631, sh) sleeping on 0xfffff80287fd6000 "wait" chain 2: thread 104132 (pid 79621, sleep) sleeping on 0xffffffff81c7feb4 "nanslp" chain 3: thread 123553 (pid 79428, sh) sleeping on 0xfffff8055c37d2f8 "piperd" chain 4: thread 104173 (pid 78109, swap) sleeping on 0xffffffff81847ec0 "pfault" chain 5: thread 113532 (pid 78107, swap) sleeping on 0xffffffff81847ec0 "pfault" chain 6: thread 100915 (pid 78105, swap) sleeping on 0xffffffff81847ec0 "pfault" chain 7: thread 111997 (pid 78104, swap) sleeping on 0xffffffff81847ec0 "pfault" chain 8: thread 120955 (pid 78103, swap) sleeping on 0xffffffff81847ec0 "pfault" chain 9: thread 104288 (pid 78099, swap) sleeping on 0xffffffff81847ec0 "pfault" chain 10: thread 119759 (pid 78097, swap) sleeping on 0xffffffff81847ec0 "pfault" chain 11: thread 115138 (pid 78095, swap) sleeping on 0xffffffff81847ec0 "pfault" chain 12: thread 104133 (pid 78093, swap) sleeping on 0xffffffff81847ec0 "pfault" chain 13: thread 104927 (pid 78091, swap) sleeping on 0xffffffff81847ec0 "pfault" chain 14: thread 124457 (pid 78090, swap) sleeping on 0xffffffff81847ec0 "pfault" chain 15: thread 110775 (pid 78089, swap) sleeping on 0xfffff8075207b000 "wait" chain 16: thread 105099 (pid 78088, link) blocked on lockmgr ufsEXCL thread 120940 (pid 78076, link) running on CPU 1 chain 17: thread 116871 (pid 78085, link) blocked on lockmgr ufsEXCL thread 120940 (pid 78076, link) running on CPU 1 chain 18: thread 121544 (pid 78083, link) blocked on lockmgr ufsEXCL thread 120940 (pid 78076, link) running on CPU 1 chain 19: thread 122171 (pid 78082, link) blocked on lockmgr ufsEXCL thread 120940 (pid 78076, link) running on CPU 1 chain 20: thread 120820 (pid 78081, link) blocked on lockmgr ufsEXCL thread 120940 (pid 78076, link) running on CPU 1 chain 21: thread 123555 (pid 78080, link) blocked on lockmgr ufsEXCL thread 120940 (pid 78076, link) running on CPU 1 chain 22: thread 124487 (pid 78079, link) blocked on lockmgr ufsEXCL thread 120940 (pid 78076, link) running on CPU 1 chain 23: thread 120642 (pid 78077, link) blocked on lockmgr ufsEXCL thread 120940 (pid 78076, link) running on CPU 1 chain 24: thread 122090 (pid 78075, link) blocked on lockmgr ufsEXCL thread 120940 (pid 78076, link) running on CPU 1 chain 25: thread 112648 (pid 78074, link) blocked on lockmgr ufsEXCL thread 120940 (pid 78076, link) running on CPU 1 chain 26: thread 124635 (pid 78073, link) blocked on lockmgr ufsEXCL thread 120940 (pid 78076, link) running on CPU 1 chain 27: thread 102243 (pid 78069, link) sleeping on 0xfffff804719a6a60 "wait" chain 28: thread 107894 (pid 78068, swap) sleeping on 0xffffffff81c7feb7 "nanslp" chain 29: thread 123654 (pid 78063, md10) sleeping on 0xfffff804b70c3000 "mdwait" chain 30: thread 110153 (pid 78047, sh) sleeping on 0xfffff80396472000 "wait" chain 31: thread 102316 (pid 78046, tee) sleeping on 0xfffff8032caf85f0 "piperd" chain 32: thread 114920 (pid 78045, sh) sleeping on 0xfffff801ce532a60 "wait" chain 33: thread 101700 (pid 58437, aiod4) sleeping on 0xfffff8011bc49530 "aiordy" chain 34: thread 102367 (pid 58436, aiod3) sleeping on 0xfffff802a81fb000 "aiordy" chain 35: thread 100785 (pid 58435, aiod2) sleeping on 0xfffff8057669a530 "aiordy" chain 36: thread 104129 (pid 58434, aiod1) blocked on lockmgr `EXCL thread 0 (pid -512, ) is inactive chain 37: thread 100275 (pid 10058, sh) sleeping on 0xfffff80007714be0 "piperd" chain 38: thread 100274 (pid 10056, awk) sleeping on 0xfffff8019c50c000 "piperd" chain 39: thread 100171 (pid 10055, sh) sleeping on 0xfffff8001e0fc530 "wait" chain 40: thread 100256 (pid 10016, sh) sleeping on 0xfffff8019c569000 "wait" chain 41: thread 100162 (pid 2347, sh) sleeping on 0xfffff8000760d530 "wait" chain 42: thread 100188 (pid 2346, bash) sleeping on 0xfffff80007788740 "select" chain 43: thread 100174 (pid 2344, csh) sleeping on 0xfffff800074a2b08 "pause" chain 44: thread 100199 (pid 2343, su) sleeping on 0xfffff80116a1c530 "wait" chain 45: thread 100165 (pid 2338, bash) blocked on lockmgr EXCL thread 0 (pid -512, ) ??? (0x6) chain 46: thread 100143 (pid 2337, sshd) sleeping on 0xfffff80007788440 "select" chain 47: thread 100160 (pid 2334, sshd) sleeping on 0xfffff800049abb40 "select" chain 48: thread 100201 (pid 2330, csh) sleeping on 0xfffff800064e58b0 "ttyin" chain 49: thread 100212 (pid 2329, login) sleeping on 0xfffff8017f233530 "wait" chain 50: thread 100211 (pid 2328, getty) sleeping on 0xfffff800064f9cb0 "ttyin" chain 51: thread 100210 (pid 2327, getty) sleeping on 0xfffff800076864b0 "ttyin" chain 52: thread 100209 (pid 2326, getty) sleeping on 0xfffff80007686cb0 "ttyin" chain 53: thread 100208 (pid 2325, getty) sleeping on 0xfffff800076854b0 "ttyin" chain 54: thread 100207 (pid 2324, getty) sleeping on 0xfffff80007685cb0 "ttyin" chain 55: thread 100206 (pid 2323, getty) sleeping on 0xfffff800076844b0 "ttyin" chain 56: thread 100156 (pid 2322, getty) sleeping on 0xfffff80003dca0b0 "ttyin" chain 57: thread 100191 (pid 2321, getty) sleeping on 0xfffff80003dcd8b0 "ttyin" chain 58: thread 100142 (pid 2320, getty) sleeping on 0xfffff80003dcccb0 "ttyin" chain 59: thread 100144 (pid 2274, cron) sleeping on 0xffffffff81c7feb7 "nanslp" chain 60: thread 100200 (pid 2270, sshd) sleeping on 0xfffff800064ac7c0 "select" chain 61: thread 100163 (pid 2241, ntpd) sleeping on 0xfffff800078848c0 "select" chain 62: thread 124717 (pid 2241, ntpd) sleeping on 0xfffff807951a4600 "usem" chain 63: thread 100170 (pid 2178, NLM: master) sleeping on 0xfffff80004365460 "rpcsvc" chain 64: thread 100155 (pid 2175, rpc.statd) sleeping on 0xfffff800064ac8c0 "select" chain 65: thread 100194 (pid 2129, watchdogd) sleeping on 0xffffffff81c7feba "nanslp" chain 66: thread 100173 (pid 2050, rpcbind) sleeping on 0xfffff800077887c0 "select" chain 67: thread 100153 (pid 2040, syslogd) sleeping on 0xfffff80003ca4940 "select" chain 68: thread 100150 (pid 1969, devd) sleeping on 0xfffff80006111c40 "select" chain 69: thread 100193 (pid 1964, dhclient) sleeping on 0xfffff800064ac940 "select" chain 70: thread 100147 (pid 1920, dhclient) sleeping on 0xfffff8004d16ed40 "select" chain 71: thread 100185 (pid 1917, dhclient) sleeping on 0xfffff80007668ac0 "select" chain 72: thread 100141 (pid 34, vnlru) blocked on lockmgr 0EXCL thread 0 (pid -512, ) is inactive chain 73: thread 100140 (pid 33, syncer) sleeping on 0xffffffff81d56370 "syncer" chain 74: thread 100130 (pid 32, bufdaemon) sleeping on 0xffffffff81d55818 "qsleep" chain 75: thread 100133 (pid 32, bufspacedaemon-0) sleeping on 0xffffffff8180a900 "-" chain 76: thread 100134 (pid 32, bufspacedaemon-1) sleeping on 0xffffffff81812bc0 "-" chain 77: thread 100135 (pid 32, bufspacedaemon-2) sleeping on 0xffffffff8181ae80 "-" chain 78: thread 100136 (pid 32, bufspacedaemon-3) sleeping on 0xffffffff81823140 "-" chain 79: thread 100137 (pid 32, bufspacedaemon-4) sleeping on 0xffffffff8182b400 "-" chain 80: thread 100138 (pid 32, bufspacedaemon-5) sleeping on 0xffffffff818336c0 "-" chain 81: thread 100139 (pid 32, bufspacedaemon-6) sleeping on 0xffffffff8183b980 "-" chain 82: thread 100152 (pid 32, / worker) blocked on lockmgr }0EXCL thread 0 (pid -1, p@yppp) ??? (0xdeadc0de) chain 83: thread 100196 (pid 32, /tmp worker) sleeping on 0xfffff80116d190e8 "sdflush" chain 84: thread 105161 (pid 32, /mnt worker) sleeping on 0xfffff80007f8f2e8 "sdflush" chain 85: thread 100132 (pid 30, uma) sleeping on 0xffffffff80effb60 "umarcl" chain 86: thread 100127 (pid 29, enc_daemon1) sleeping on 0xfffff8000600c000 "idle" chain 87: thread 100126 (pid 28, enc_daemon0) blocked on lockmgr `\EXCL thread 0 (pid -512, ) is inactive chain 88: thread 100120 (pid 27, rand_harvestq) sleeping on 0xffffffff81adbb20 "-" chain 89: thread 100119 (pid 26, sctp_iterator) sleeping on 0xffffffff81de20f0 "waiting_for_work" chain 90: thread 100118 (pid 25, soaiod4) sleeping on 0xffffffff81d5521c "-" chain 91: thread 100117 (pid 24, soaiod3) sleeping on 0xffffffff81d5521c "-" chain 92: thread 100116 (pid 23, soaiod2) sleeping on 0xffffffff81d5521c "-" chain 93: thread 100115 (pid 22, soaiod1) sleeping on 0xffffffff81d5521c "-" chain 94: thread 100096 (pid 21, usbus0) sleeping on 0xfffffe00d1584460 "-" chain 95: thread 100097 (pid 21, usbus0) sleeping on 0xfffffe00d15844b8 "-" chain 96: thread 100098 (pid 21, usbus0) sleeping on 0xfffffe00d1584510 "-" chain 97: thread 100099 (pid 21, usbus0) sleeping on 0xfffffe00d1584568 "-" chain 98: thread 100100 (pid 21, usbus0) sleeping on 0xfffffe00d15845c0 "-" chain 99: thread 100102 (pid 21, usbus1) sleeping on 0xfffffe0037b66d10 "-" chain 100: thread 100103 (pid 21, usbus1) sleeping on 0xfffffe0037b66d68 "-" chain 101: thread 100104 (pid 21, usbus1) sleeping on 0xfffffe0037b66dc0 "-" chain 102: thread 100105 (pid 21, usbus1) sleeping on 0xfffffe0037b66e18 "-" chain 103: thread 100106 (pid 21, usbus1) sleeping on 0xfffffe0037b66e70 "-" chain 104: thread 100107 (pid 21, usbus2) sleeping on 0xfffffe00d16a7d10 "-" chain 105: thread 100108 (pid 21, usbus2) sleeping on 0xfffffe00d16a7d68 "-" chain 106: thread 100109 (pid 21, usbus2) sleeping on 0xfffffe00d16a7dc0 "-" chain 107: thread 100110 (pid 21, usbus2) sleeping on 0xfffffe00d16a7e18 "-" chain 108: thread 100111 (pid 21, usbus2) sleeping on 0xfffffe00d16a7e70 "-" chain 109: thread 100091 (pid 20, doneq0) sleeping on 0xffffffff819b6ec0 "-" chain 110: thread 100093 (pid 20, doneq2) sleeping on 0xffffffff819b6fc0 "-" chain 111: thread 100125 (pid 20, scanner) sleeping on 0xffffffff819b6d88 "-" chain 112: thread 100090 (pid 19, crypto returns 11) sleeping on 0xfffff8000388f450 "crypto_ret_wait" chain 113: thread 100089 (pid 18, crypto returns 10) sleeping on 0xfffff8000388f3f0 "crypto_ret_wait" chain 114: thread 100088 (pid 17, crypto returns 9) sleeping on 0xfffff8000388f390 "crypto_ret_wait" chain 115: thread 100087 (pid 16, crypto returns 8) sleeping on 0xfffff8000388f330 "crypto_ret_wait" chain 116: thread 100086 (pid 15, crypto returns 7) sleeping on 0xfffff8000388f2d0 "crypto_ret_wait" chain 117: thread 100085 (pid 9, crypto returns 6) sleeping on 0xfffff8000388f270 "crypto_ret_wait" chain 118: thread 100084 (pid 8, crypto returns 5) sleeping on 0xfffff8000388f210 "crypto_ret_wait" chain 119: thread 100083 (pid 7, crypto returns 4) sleeping on 0xfffff8000388f1b0 "crypto_ret_wait" chain 120: thread 100082 (pid 6, crypto returns 3) sleeping on 0xfffff8000388f150 "crypto_ret_wait" chain 121: thread 100081 (pid 5, crypto returns 2) sleeping on 0xfffff8000388f0f0 "crypto_ret_wait" chain 122: thread 100080 (pid 4, crypto returns 1) sleeping on 0xfffff8000388f090 "crypto_ret_wait" chain 123: thread 100079 (pid 3, crypto returns 0) sleeping on 0xfffff8000388f030 "crypto_ret_wait" chain 124: thread 100078 (pid 2, crypto) sleeping on 0xffffffff81d6b308 "crypto_wait" chain 125: thread 100065 (pid 14, sequencer 00) sleeping on 0xfffff800037d7c88 "seqstate" chain 126: thread 100062 (pid 13, g_event) sleeping on 0xffffffff81d9b110 "-" chain 127: thread 100063 (pid 13, g_up) sleeping on 0xffffffff81d9b120 "-" chain 128: thread 100064 (pid 13, g_down) sleeping on 0xffffffff81d9b118 "-" chain 129: thread 100002 (pid 1, init) sleeping on 0xfffff800038c7530 "wait" chain 130: thread 100001 (pid 10, audit) sleeping on 0xffffffff81de2d80 "audit_worker_cv" chain 131: thread 100000 (pid 0, swapper) sleeping on 0xffffffff81d8a828 "swapin" chain 132: thread 100015 (pid 0, config_0) sleeping on 0xfffff8000389b000 "-" chain 133: thread 100016 (pid 0, kqueue_ctx taskq) sleeping on 0xfffff80003885000 "-" chain 134: thread 100017 (pid 0, aiod_kick taskq) sleeping on 0xfffff80003886e00 "-" chain 135: thread 100020 (pid 0, thread taskq) sleeping on 0xfffff80003886b00 "-" chain 136: thread 100022 (pid 0, if_config_tqg_0) sleeping on 0xfffff8000389ce00 "-" chain 137: thread 100023 (pid 0, softirq_0) sleeping on 0xfffff8000389cd00 "-" chain 138: thread 100024 (pid 0, softirq_1) sleeping on 0xfffff8000389cc00 "-" chain 139: thread 100025 (pid 0, softirq_2) sleeping on 0xfffff8000389cb00 "-" chain 140: thread 100026 (pid 0, softirq_3) sleeping on 0xfffff8000389ca00 "-" chain 141: thread 100027 (pid 0, softirq_4) sleeping on 0xfffff8000389c900 "-" chain 142: thread 100028 (pid 0, softirq_5) sleeping on 0xfffff8000389c800 "-" chain 143: thread 100029 (pid 0, softirq_6) sleeping on 0xfffff8000389c700 "-" chain 144: thread 100030 (pid 0, softirq_7) sleeping on 0xfffff8000389c600 "-" chain 145: thread 100031 (pid 0, softirq_8) sleeping on 0xfffff8000389c500 "-" chain 146: thread 100032 (pid 0, softirq_9) sleeping on 0xfffff8000389c400 "-" chain 147: thread 100033 (pid 0, softirq_10) sleeping on 0xfffff8000389c300 "-" chain 148: thread 100034 (pid 0, softirq_11) sleeping on 0xfffff8000389c200 "-" chain 149: thread 100035 (pid 0, if_io_tqg_0) sleeping on 0xfffff8000389c100 "-" chain 150: thread 100036 (pid 0, if_io_tqg_1) sleeping on 0xfffff8000389c000 "-" chain 151: thread 100037 (pid 0, if_io_tqg_2) sleeping on 0xfffff8000389de00 "-" chain 152: thread 100038 (pid 0, if_io_tqg_3) sleeping on 0xfffff8000389dd00 "-" chain 153: thread 100039 (pid 0, if_io_tqg_4) sleeping on 0xfffff8000389dc00 "-" chain 154: thread 100040 (pid 0, if_io_tqg_5) sleeping on 0xfffff8000389db00 "-" chain 155: thread 100041 (pid 0, if_io_tqg_6) sleeping on 0xfffff8000389da00 "-" chain 156: thread 100042 (pid 0, if_io_tqg_7) sleeping on 0xfffff8000389d900 "-" chain 157: thread 100043 (pid 0, if_io_tqg_8) sleeping on 0xfffff8000389d800 "-" chain 158: thread 100044 (pid 0, if_io_tqg_9) sleeping on 0xfffff8000389d700 "-" chain 159: thread 100045 (pid 0, if_io_tqg_10) sleeping on 0xfffff8000389d600 "-" chain 160: thread 100046 (pid 0, if_io_tqg_11) sleeping on 0xfffff8000389d500 "-" chain 161: thread 100061 (pid 0, firmware taskq) sleeping on 0xfffff80003886900 "-" chain 162: thread 100066 (pid 0, crypto_0) sleeping on 0xfffff80003887e00 "-" chain 163: thread 100067 (pid 0, crypto_1) sleeping on 0xfffff80003887e00 "-" chain 164: thread 100068 (pid 0, crypto_2) sleeping on 0xfffff80003887e00 "-" chain 165: thread 100069 (pid 0, crypto_3) sleeping on 0xfffff80003887e00 "-" chain 166: thread 100070 (pid 0, crypto_4) sleeping on 0xfffff80003887e00 "-" chain 167: thread 100071 (pid 0, crypto_5) sleeping on 0xfffff80003887e00 "-" chain 168: thread 100072 (pid 0, crypto_6) sleeping on 0xfffff80003887e00 "-" chain 169: thread 100073 (pid 0, crypto_7) sleeping on 0xfffff80003887e00 "-" chain 170: thread 100074 (pid 0, crypto_8) sleeping on 0xfffff80003887e00 "-" chain 171: thread 100075 (pid 0, crypto_9) sleeping on 0xfffff80003887e00 "-" chain 172: thread 100076 (pid 0, crypto_10) sleeping on 0xfffff80003887e00 "-" chain 173: thread 100077 (pid 0, crypto_11) sleeping on 0xfffff80003887e00 "-" chain 174: thread 100114 (pid 0, mca taskq) blocked on lockmgr (null)EXCL chain 175: thread 100121 (pid 0, acpi_task_0) sleeping on 0xfffff80007591200 "-" chain 176: thread 100122 (pid 0, acpi_task_1) sleeping on 0xfffff80007591200 "-" chain 177: thread 100123 (pid 0, acpi_task_2) sleeping on 0xfffff80007591200 "-" chain 178: thread 100124 (pid 0, CAM taskq) sleeping on 0xfffff80003887800 "-" db> reset cpu_reset: Restarting BSP cpu_reset_proxy: Stopped CPU 11 (kgdb) bt #0 __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:55 #1 doadump (textdump=0x0) at ../../../kern/kern_shutdown.c:392 #2 0xffffffff80495aca in db_dump (dummy=, dummy2=, dummy3=, dummy4=) at ../../../ddb/db_command.c:575 #3 0xffffffff8049588c in db_command (last_cmdp=, cmd_table=, dopager=0x0) at ../../../ddb/db_command.c:482 #4 0xffffffff8049a858 in db_script_exec (scriptname=, warnifnotfound=) at ../../../ddb/db_script.c:304 #5 0xffffffff8049588c in db_command (last_cmdp=, cmd_table=, dopager=0x1) at ../../../ddb/db_command.c:482 #6 0xffffffff804955fd in db_command_loop () at ../../../ddb/db_command.c:535 #7 0xffffffff80498828 in db_trap (type=, code=) at ../../../ddb/db_main.c:252 #8 0xffffffff80c0f5b7 in kdb_trap (type=0x3, code=0x0, tf=) at ../../../kern/subr_kdb.c:691 #9 0xffffffff81061617 in trap (frame=0xfffffe00d32358e0) at ../../../amd64/amd64/trap.c:585 #10 #11 kdb_enter (why=0xffffffff811ea395 "panic", msg=) at ../../../kern/subr_kdb.c:478 #12 0xffffffff80bc3daa in vpanic (fmt=, ap=) at ../../../kern/kern_shutdown.c:897 #13 0xffffffff80bc3b43 in panic (fmt=0xffffffff81c79658 "e\355\032\201\377\377\377\377") at ../../../kern/kern_shutdown.c:835 #14 0xffffffff810519fa in pmap_page_exists_quick (pmap=, m=0xfffffe001510f3f0) at ../../../amd64/amd64/pmap.c:6938 #15 0xffffffff80f3087b in vm_swapout_object_deactivate_pages (pmap=0xfffff80007a30130, first_object=0xfffff8017f091108, desired=0x0) at ../../../vm/vm_swapout.c:221 #16 0xffffffff80f306d3 in vm_swapout_map_deactivate_pages (map=, desired=) at ../../../vm/vm_swapout.c:324 #17 0xffffffff80f3023a in vm_daemon () at ../../../vm/vm_swapout.c:488 #18 0xffffffff80b81f40 in fork_exit (callout=0xffffffff80f2f9e0 , arg=0x0, frame=0xfffffe00d3235c00) at ../../../kern/kern_fork.c:1059 #19 (kgdb) f 14 #14 0xffffffff810519fa in pmap_page_exists_quick (pmap=, m=0xfffffe001510f3f0) at ../../../amd64/amd64/pmap.c:6938 6938 KASSERT((m->oflags & VPO_UNMANAGED) == 0, (kgdb) l 6933 struct rwlock *lock; 6934 pv_entry_t pv; 6935 int loops = 0; 6936 boolean_t rv; 6937 6938 KASSERT((m->oflags & VPO_UNMANAGED) == 0, 6939 ("pmap_page_exists_quick: page %p is not managed", m)); 6940 rv = FALSE; 6941 lock = VM_PAGE_TO_PV_LIST_LOCK(m); 6942 rw_rlock(lock); (kgdb) info loc loops = rv = lock = pv = pvh = (kgdb) f 15 #15 0xffffffff80f3087b in vm_swapout_object_deactivate_pages (pmap=0xfffff80007a30130, first_object=0xfffff8017f091108, desired=0x0) at ../../../vm/vm_swapout.c:221 221 if (vm_page_wired(p) || !pmap_page_exists_quick(pmap, p)) { (kgdb) l 216 * The page may acquire a wiring after this check. 217 * The page daemon handles wired pages, so there is 218 * no harm done if a wiring appears while we are 219 * attempting to deactivate the page. 220 */ 221 if (vm_page_wired(p) || !pmap_page_exists_quick(pmap, p)) { 222 vm_page_xunbusy(p); 223 continue; 224 } 225 act_delta = pmap_ts_referenced(p); (kgdb) info loc object = 0xfffff8017f091108 remove_mode = p = 0xfffffe001510f3f0 act_delta = backing_object = (kgdb) p *p $1 = {plinks = {q = {tqe_next = 0xfffffe00271f6268, tqe_prev = 0xffffffff81d9ca48 }, s = {ss = {sle_next = 0xfffffe00271f6268}, pv = 0xffffffff81d9ca48 }, memguard = {p = 0xfffffe00271f6268, v = 0xffffffff81d9ca48}}, listq = {tqe_next = 0xfffffe000cab86e8, tqe_prev = 0xfffffe00096110f8}, object = 0xfffff8017f091108, pindex = 0x8, phys_addr = 0x33db06000, md = {pv_list = {tqh_first = 0x0, tqh_last = 0xfffffe001510f428}, pv_gen = 0x5e4, pat_mode = 0x6}, ref_count = 0x80000000, busy_lock = 0x2, flags = 0x0, order = 0xd, pool = 0x0, aflags = 0x2, oflags = 0x4, queue = 0xff, psind = 0x0, segind = 0x8, act_count = 0x0, valid = 0xff, dirty = 0xff} (kgdb) p *object $2 = {lock = {lock_object = {lo_name = 0xffffffff81146502 "vm object", lo_flags = 0x25630000, lo_data = 0x0, lo_witness = 0xfffff8087fd6b780}, rw_lock = 0x21}, object_list = {tqe_next = 0xfffff8017f091210, tqe_prev = 0xfffff8017f091020}, shadow_head = {lh_first = 0x0}, shadow_list = { le_next = 0xfffff80003e50630, le_prev = 0xfffff801606fd560}, memq = {tqh_first = 0xfffffe0016e677e8, tqh_last = 0xfffffe002242c290}, rtree = {rt_root = 0xfffff80780511900}, size = 0x23, domain = {dr_policy = 0x0, dr_iter = 0x0}, generation = 0x1, cleangeneration = 0x1, ref_count = 0x1, shadow_count = 0x0, memattr = 0x6, type = 0x1, flags = 0x1000, pg_color = 0x245, paging_in_progress = 0x0, busy = 0x0, resident_page_count = 0x5, backing_object = 0xfffff8017f226318, backing_object_offset = 0x0, pager_object_list = {tqe_next = 0x0, tqe_prev = 0x0}, rvq = {lh_first = 0x0}, handle = 0x0, un_pager = {vnp = {vnp_size = 0x0, writemappings = 0x0}, devp = {devp_pglist = {tqh_first = 0x0, tqh_last = 0x0}, ops = 0x0, dev = 0x0}, sgp = {sgp_pglist = {tqh_first = 0x0, tqh_last = 0x0}}, swp = {swp_tmpfs = 0x0, swp_blks = {pt_root = 0x0}, writemappings = 0x0}}, cred = 0xfffff80003a28400, charge = 0x23000, umtx_data = 0x0} (kgdb) p *pmap $3 = {pm_mtx = {lock_object = {lo_name = 0xffffffff810e6544 "pmap", lo_flags = 0x1430000, lo_data = 0x0, lo_witness = 0xfffff8087fd6b900}, mtx_lock = 0x0}, pm_pml4 = 0xfffff8004deba000, pm_pml4u = 0xfffff8019ca36000, pm_cr3 = 0x4deba000, pm_ucr3 = 0x19ca36000, pm_pvchunk = { tqh_first = 0xfffff8065942b000, tqh_last = 0xfffff80375f24008}, pm_active = {__bits = {0x0, 0x0, 0x0, 0x0}}, pm_type = PT_X86, pm_stats = {resident_count = 0x129, wired_count = 0x0}, pm_root = {rt_root = 0x0}, pm_eptgen = 0x0, pm_flags = 0x100, pm_pcids = {{pm_pcid = 0x791, pm_gen = 0x0}, {pm_pcid = 0x34d, pm_gen = 0x0}, {pm_pcid = 0x4f9, pm_gen = 0x0}, {pm_pcid = 0x798, pm_gen = 0x0}, {pm_pcid = 0x537, pm_gen = 0x0}, {pm_pcid = 0xe4, pm_gen = 0x0}, {pm_pcid = 0x2b6, pm_gen = 0x0}, {pm_pcid = 0x57c, pm_gen = 0x0}, {pm_pcid = 0x523, pm_gen = 0x0}, {pm_pcid = 0x247, pm_gen = 0x0}, {pm_pcid = 0x57b, pm_gen = 0x0}, {pm_pcid = 0x209, pm_gen = 0x0}, {pm_pcid = 0x0, pm_gen = 0x0} }, pm_pkru = {rs_trie = {pt_root = 0x0}, rs_dup_data = 0x0, rs_free_data = 0x0, rs_data_ctx = 0x0, rs_alloc_flags = 0x0}} (kgdb) p *first_object $4 = {lock = {lock_object = {lo_name = 0xffffffff81146502 "vm object", lo_flags = 0x25630000, lo_data = 0x0, lo_witness = 0xfffff8087fd6b780}, rw_lock = 0x21}, object_list = {tqe_next = 0xfffff8017f091210, tqe_prev = 0xfffff8017f091020}, shadow_head = {lh_first = 0x0}, shadow_list = { le_next = 0xfffff80003e50630, le_prev = 0xfffff801606fd560}, memq = {tqh_first = 0xfffffe0016e677e8, tqh_last = 0xfffffe002242c290}, rtree = {rt_root = 0xfffff80780511900}, size = 0x23, domain = {dr_policy = 0x0, dr_iter = 0x0}, generation = 0x1, cleangeneration = 0x1, ref_count = 0x1, shadow_count = 0x0, memattr = 0x6, type = 0x1, flags = 0x1000, pg_color = 0x245, paging_in_progress = 0x0, busy = 0x0, resident_page_count = 0x5, backing_object = 0xfffff8017f226318, backing_object_offset = 0x0, pager_object_list = {tqe_next = 0x0, tqe_prev = 0x0}, rvq = {lh_first = 0x0}, handle = 0x0, un_pager = {vnp = {vnp_size = 0x0, writemappings = 0x0}, devp = {devp_pglist = {tqh_first = 0x0, tqh_last = 0x0}, ops = 0x0, dev = 0x0}, sgp = {sgp_pglist = {tqh_first = 0x0, tqh_last = 0x0}}, swp = {swp_tmpfs = 0x0, swp_blks = {pt_root = 0x0}, writemappings = 0x0}}, cred = 0xfffff80003a28400, charge = 0x23000, umtx_data = 0x0} (kgdb) -- Test scenario: misc/link2.sh